-- Logs begin at Tue 2022-07-26 18:45:14 UTC, end at Tue 2022-07-26 21:19:50 UTC. -- Jul 26 19:32:25.099550 n-d-708768-8 systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 19:32:25.106911 n-d-708768-8 devstack@n-api.service[110654]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 19:32:25.108939 n-d-708768-8 devstack@n-api.service[110654]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 19:32:25 2022] *** Jul 26 19:32:25.108939 n-d-708768-8 devstack@n-api.service[110654]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 19:32:25.108939 n-d-708768-8 devstack@n-api.service[110654]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 19:32:25.108939 n-d-708768-8 devstack@n-api.service[110654]: nodename: n-d-708768-8 Jul 26 19:32:25.108939 n-d-708768-8 devstack@n-api.service[110654]: machine: x86_64 Jul 26 19:32:25.108939 n-d-708768-8 devstack@n-api.service[110654]: clock source: unix Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: pcre jit disabled Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: detected number of CPU cores: 4 Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: current working directory: / Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: detected binary path: /usr/bin/uwsgi-core Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: your processes number limit is 47680 Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: your memory page size is 4096 bytes Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: detected max file descriptor number: 2048 Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: lock engine: pthread robust mutexes Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: thunder lock: enabled Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 19:32:25.109382 n-d-708768-8 devstack@n-api.service[110654]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 19:32:25.149938 n-d-708768-8 devstack@n-api.service[110654]: Python main interpreter initialized at 0x555c6db419c0 Jul 26 19:32:25.149938 n-d-708768-8 devstack@n-api.service[110654]: python threads support enabled Jul 26 19:32:25.149938 n-d-708768-8 devstack@n-api.service[110654]: your server socket listen backlog is limited to 100 connections Jul 26 19:32:25.149938 n-d-708768-8 devstack@n-api.service[110654]: your mercy for graceful operations on workers is 90 seconds Jul 26 19:32:25.150296 n-d-708768-8 devstack@n-api.service[110654]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 19:32:25.150389 n-d-708768-8 devstack@n-api.service[110654]: *** Operational MODE: preforking *** Jul 26 19:32:25.150650 n-d-708768-8 devstack@n-api.service[110654]: *** uWSGI is running in multiple interpreter mode *** Jul 26 19:32:25.150650 n-d-708768-8 devstack@n-api.service[110654]: spawned uWSGI master process (pid: 110654) Jul 26 19:32:25.150838 n-d-708768-8 systemd[1]: Started Devstack devstack@n-api.service. Jul 26 19:32:25.151641 n-d-708768-8 devstack@n-api.service[110654]: spawned uWSGI worker 1 (pid: 110655, cores: 1) Jul 26 19:32:25.151744 n-d-708768-8 devstack@n-api.service[110654]: spawned uWSGI worker 2 (pid: 110656, cores: 1) Jul 26 19:32:25.152258 n-d-708768-8 devstack@n-api.service[110654]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 19:32:25.814357 n-d-708768-8 devstack@n-api.service[110656]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 19:32:25.815231 n-d-708768-8 devstack@n-api.service[110655]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 19:32:26.896870 n-d-708768-8 devstack@n-api.service[110656]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 19:32:26.896870 n-d-708768-8 devstack@n-api.service[110656]: from cryptography.utils import int_from_bytes Jul 26 19:32:26.897488 n-d-708768-8 devstack@n-api.service[110655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 19:32:26.897488 n-d-708768-8 devstack@n-api.service[110655]: from cryptography.utils import int_from_bytes Jul 26 19:32:26.897895 n-d-708768-8 devstack@n-api.service[110656]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 19:32:26.897895 n-d-708768-8 devstack@n-api.service[110656]: from cryptography.utils import int_from_bytes Jul 26 19:32:26.898012 n-d-708768-8 devstack@n-api.service[110655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 19:32:26.898012 n-d-708768-8 devstack@n-api.service[110655]: from cryptography.utils import int_from_bytes Jul 26 19:32:29.392056 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 19:32:29.392749 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 19:32:29.392749 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 19:32:29.393124 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 19:32:29.393401 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 19:32:29.393826 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.394167 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.394487 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.394805 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.394890 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 19:32:29.395272 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 19:32:29.395359 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.395439 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.395653 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 19:32:29.395754 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.396025 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 19:32:29.396123 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.396283 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 19:32:29.396367 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.396618 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.396702 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.396938 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.397033 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.397258 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-708768-8 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.397341 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.397575 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.397667 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.397879 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.397970 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.398185 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.398268 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.398500 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.398590 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.398801 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.398892 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.399119 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.399203 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.399379 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.399463 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.399738 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.399934 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.400067 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-708768-8 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.401081 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.401296 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.401425 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.401507 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.401638 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.401729 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.401729 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.401926 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402061 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402189 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402270 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402391 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402485 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402569 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402569 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402766 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402863 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.402949 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.403070 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.403256 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.403461 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-708768-8 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.403629 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.403810 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.403942 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.404122 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.404225 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.404430 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.404539 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.404801 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.404894 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.405108 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.405204 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.405423 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.405525 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.405736 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.405819 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.406056 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.406163 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-708768-8 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.406360 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.406445 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.406682 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.406784 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.407003 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.407088 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.407321 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.407446 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.407655 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.407786 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.407958 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.408095 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.408264 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.408416 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.408570 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.409320 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.409607 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.409695 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.409929 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.410031 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.410236 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.410322 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.410486 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.410579 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.410793 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.410879 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.411111 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.411204 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.411428 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.411513 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.411770 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.411883 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.412031 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.412123 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.412271 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.412384 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.412590 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.412703 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.412908 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.412994 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.413214 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.413308 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.413518 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.413605 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.413822 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.413905 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.414127 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.414210 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.414387 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.414471 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.414638 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.414724 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.414963 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.415064 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.415285 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.415386 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.415598 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.415723 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.415929 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.416022 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.416236 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.416319 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.416540 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.416621 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.416846 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.416944 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.417154 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.417238 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.417463 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.417548 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.417772 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.417862 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.418089 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.418178 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.418405 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.418489 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.418713 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.418797 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.419024 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.419117 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.419340 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.419421 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.419668 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.419769 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.419994 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.420097 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.420280 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.420369 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.420596 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.420681 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.420926 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.421010 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.421227 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.421315 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.421474 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.421558 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.421772 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.421855 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.422072 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.422172 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.422386 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.422484 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.422687 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.422771 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.422990 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.423082 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.423292 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.423375 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.423587 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.423703 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.423894 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.423998 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.424196 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.424324 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.425147 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.425300 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.425459 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.425628 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.425776 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.425868 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.426039 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.426122 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.426344 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.426427 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.426647 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.426730 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.426947 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.427029 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.427250 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.427340 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.427556 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.427660 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.427895 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.427987 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.428200 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.428283 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.428498 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.428595 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.428802 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.428886 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.429106 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.429189 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.429409 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.429490 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.429711 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.429804 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.430031 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.430114 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.430331 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.430413 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.430633 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.430715 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.430940 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.431031 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.431241 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.431324 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.431543 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.431646 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.431874 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.431959 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.432172 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.432255 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.432475 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.432558 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.432782 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.432865 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.433084 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.433172 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.433386 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.433485 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.433684 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.433775 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.433986 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.434112 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.434287 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.434398 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.434586 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.434680 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.434882 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.434976 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.435180 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.435284 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.435476 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.435570 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.435808 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.435902 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.436108 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.436204 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.436411 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.436496 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.436714 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.436809 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.437014 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.437111 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.437312 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.437397 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.437615 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.437710 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.437913 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.438006 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.438230 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.438323 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.438549 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.438636 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.438860 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.438946 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.439166 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.439250 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.439471 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.439556 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.439813 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:32:29.439921 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.440172 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.440264 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.440503 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.440672 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.440847 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.440992 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.441165 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.441305 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.441498 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.441617 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.441830 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.441936 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.442151 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.442255 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.442466 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.442577 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.442783 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.442881 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.443108 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.443193 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.443421 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.443536 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.443760 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.443921 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.444081 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.444226 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.444362 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.444509 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.444686 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.444817 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.445022 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.445156 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.445340 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.445477 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.445657 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.445791 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.446010 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.446154 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.446304 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.446437 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.446568 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.446700 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.446891 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.447022 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.447200 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.447332 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.447511 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.447673 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.447856 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.447941 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.448189 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.448290 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.448500 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.448591 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.448817 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.448902 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.449126 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.449211 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.449434 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.449518 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.449738 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.449830 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.450045 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.450145 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.450351 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.450436 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.450683 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.450776 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.450999 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.451084 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.451312 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.451404 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.451661 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.451762 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.451955 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.452090 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.452265 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.452357 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.452572 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.452668 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.452878 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.452968 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.453182 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.453274 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.453484 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.453578 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.453785 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.453907 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.454090 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.454180 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.454390 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.454475 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.454708 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.454791 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.455024 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.455107 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.455326 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.455410 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.455697 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.455824 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.456005 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.456223 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.456319 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.456390 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.456608 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.456703 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.456909 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.456995 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.457232 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.457320 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.457561 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.457667 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.457869 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.457965 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.458171 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.458257 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.458494 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.458581 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.458803 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.458897 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.459108 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.459192 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.459417 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.459510 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.459746 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.459847 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.460052 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.460145 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.460361 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.460445 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.460666 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.460764 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.460974 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.461058 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.461285 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.461371 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.461589 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.461674 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.461908 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.461993 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.462211 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.462295 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.462517 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.462612 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.462833 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.462933 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.463145 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.463243 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.463452 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.463539 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.463790 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.463892 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.464105 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.464201 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.464423 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.464511 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.464728 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.464812 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.465036 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.465135 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.465341 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.465426 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.465644 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.465730 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.465946 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.466042 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.466254 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.466339 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.466555 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.466640 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.466858 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.466953 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.467160 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.467244 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.467460 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.467552 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.467793 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.467890 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.468100 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.468184 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.468405 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.468492 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.468703 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.468797 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.469002 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.469087 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.469303 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.469403 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.469602 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.469688 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.469906 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.470000 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.470211 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.470304 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.470533 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.470620 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.470842 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.470927 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.471678 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.471774 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.472031 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.472159 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.472338 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.472436 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.472648 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.472832 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.472957 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.473152 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.473268 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.473498 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.473603 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.473837 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.473940 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.474158 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.474253 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.474471 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.474563 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.474779 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.474914 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.475092 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.475222 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.475395 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.475534 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.475736 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.475825 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.476041 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.476132 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.476355 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.476468 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.476670 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.476753 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.476980 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.477071 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.477302 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.477471 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.477614 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.477706 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.477920 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.478010 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.478238 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.478330 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.478543 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.478625 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.478851 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.478933 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.479155 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.479248 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.479463 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.479550 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.479803 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.479890 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.480111 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.480208 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.480425 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.480510 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.480734 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.480817 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.481051 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.481134 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.481354 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.481445 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.481664 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.481747 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.481963 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.482055 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.482273 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.482357 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.482590 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.482680 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.482903 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.482988 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.483211 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.483332 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.483519 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.483603 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.483862 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.483946 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.484169 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.484253 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.484476 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.484569 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.484779 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.484860 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.485077 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.485160 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.485379 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.485470 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.485684 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.485769 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.485994 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.486077 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.486299 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.486404 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.486606 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.486702 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.487510 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.487703 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.487854 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.488016 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.488168 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.488254 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.488472 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.488555 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.488775 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.488860 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.489083 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.489166 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.489400 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.489484 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.489707 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.489795 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.490014 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.490097 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.490318 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.490402 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.490618 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.490702 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.490920 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.491012 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.491223 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.491306 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.491529 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.491634 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.491854 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.491955 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.492157 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.492241 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.492460 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.492545 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.492781 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.492864 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.493097 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.493197 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.493396 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.493480 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.493701 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.493794 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.494018 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.494110 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.494323 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.494412 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.494628 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.494718 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.494933 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.495025 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.495236 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.495319 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.495552 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.495666 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.495902 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.496211 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.496296 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.496521 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.496620 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.496831 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.496936 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.497136 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.497220 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.497442 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.497533 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.497757 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.497853 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.498067 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.498157 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.498375 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.498458 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.498679 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.498774 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.498981 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.499071 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.499287 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.499371 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.499598 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.499754 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.499930 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.500189 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.500274 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.500525 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.500617 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.500842 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.500926 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.501148 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.501230 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.501460 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.501552 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.501772 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.501857 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.502080 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.502164 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.502405 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.502497 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.502777 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.502944 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.503112 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.503376 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.503463 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.503705 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.503809 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.504011 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.504097 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.504320 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.504450 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.504623 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.504782 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.504927 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.505012 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.505228 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.505320 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.505535 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.505621 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.505837 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.505949 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.506139 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.506260 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.506438 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.506573 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.506739 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.506888 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.507051 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.507193 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.507350 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.507504 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.507679 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.507840 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.507988 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.508147 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.508306 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.508454 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.508610 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.508765 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.508912 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.509070 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.509212 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.509377 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.509513 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.509682 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.509852 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.509988 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.510154 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.510304 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.510487 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.510609 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.510813 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.510907 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.511153 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.511253 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.511734 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.511826 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.512042 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.512139 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.512362 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.512449 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.512663 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.512748 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.512963 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.513049 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.513262 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.513349 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.513587 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.513681 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.513875 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.513979 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.514173 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.514259 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.514485 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.514636 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.514774 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.514926 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.515063 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.515202 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.515369 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.515507 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.515696 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.515797 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.516005 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.516097 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.516303 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.516397 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.516614 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.516711 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.516917 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.517061 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.517216 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.517307 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.517512 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.517604 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.517816 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.517901 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.518197 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.518337 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.518504 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.518657 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.518807 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.519091 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.519179 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.519401 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.519496 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.519794 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.519944 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.520136 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.520274 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.520417 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.520564 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.520686 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.520810 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.520941 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.521077 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.521229 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.521386 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.521530 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.521670 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.521813 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.521952 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.522104 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.522248 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.522391 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.522527 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.522665 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.522807 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.522953 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.523086 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.523227 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.523376 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.523519 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.523794 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.523963 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.524108 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.524248 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.524388 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.524540 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.524758 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.524900 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.525019 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.525142 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.525286 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.525415 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.525565 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.525688 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.525874 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.525964 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.526043 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.526121 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.526212 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.526389 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.526499 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.526686 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.526809 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.526983 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.527129 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.527279 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.527444 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.527594 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.527782 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.527922 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.528092 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.528219 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.528396 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.528520 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.528701 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.528819 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.529006 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.529158 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.529313 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.529457 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.529615 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.529812 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.529959 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.530114 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.530198 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.530423 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.530509 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.530740 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.530865 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.531046 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.531131 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.531352 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.531436 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.531685 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.531778 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.531989 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.532094 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.532290 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.532396 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.532598 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.532736 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.532906 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.533032 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.533208 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.533369 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.533516 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.534148 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.534425 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.534579 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.534719 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.534945 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.535127 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.535270 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.535452 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.535582 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.535803 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.535968 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.536116 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.536260 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.536404 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.536548 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.536705 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.536846 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.536998 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.537148 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.537347 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.537474 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.537612 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.537742 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.537875 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.537995 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.538173 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.538283 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.538481 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.538574 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.538790 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.538874 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.539099 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.539183 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.539404 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.539489 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.539735 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.539824 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.540044 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.540145 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.540348 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.540431 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.540649 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.540732 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.540956 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.541047 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.541265 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.541364 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.541567 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.541652 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.541876 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.541974 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.542177 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.542261 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.542485 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.542575 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.542787 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.542879 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.543092 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.543211 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.543404 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.543519 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.543737 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.543862 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.544046 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.544165 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.544373 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.544460 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.544687 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.544780 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.544996 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.545090 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.545307 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.545392 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.545616 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.545701 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.545930 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.546055 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.546242 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.546366 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.546669 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.546754 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.546975 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.547058 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.547279 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.547416 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.547580 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.547738 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.547913 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.548006 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.548227 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.548321 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.548536 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.548628 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.548840 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.548924 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.549142 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.549235 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.550094 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.550232 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.550397 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.550514 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.550719 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.550848 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.551136 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.551221 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.551446 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.551530 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.551775 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.551862 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.552090 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.552181 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.552418 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.552503 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.552730 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.552816 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.553039 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.553132 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.553348 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.553432 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.553676 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.553762 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.553981 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.554074 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.554292 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.554376 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.554603 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.554698 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.554921 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.555050 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.555243 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.555337 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.555554 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.555728 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.555894 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.556048 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.556197 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.556362 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.556518 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.556685 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.556837 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.557008 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.557149 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.557332 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.557467 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.557646 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.557881 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.557971 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.558200 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.558285 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.558513 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.558610 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.558836 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.558920 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.559157 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.559241 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.559459 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.559552 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.559792 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.559876 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.560099 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.560183 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.560401 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.560506 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.560702 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.560794 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.561020 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.561112 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.561320 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.561443 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.561627 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.561774 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.561933 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.562090 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.562237 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.562417 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.562538 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.562749 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.562833 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.563059 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.563152 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.563366 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.563460 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.563708 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.563810 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.564018 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.564112 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.564327 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.564421 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.564653 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.564738 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.565003 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.565102 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.565409 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.565560 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.565715 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.565855 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.566004 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.566099 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.566308 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.566393 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.566610 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.566695 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.566953 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.567052 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.567255 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.567341 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.567575 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.567690 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.567915 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.567999 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.568239 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.568323 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.568554 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.568651 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.568859 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.568950 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.569184 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.569274 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.569497 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.569595 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.569806 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.569897 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.570111 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.570196 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.570413 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.570505 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.570718 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.570802 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.571025 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.571118 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.571327 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.571414 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.571648 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.571737 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.571956 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.572040 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.572260 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.572355 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.572561 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.572647 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.572863 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.572956 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.573165 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.573250 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.573483 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.573567 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.573785 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.573870 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.574101 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.574193 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.574406 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.574490 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.574708 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.574801 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.575013 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.575097 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.575314 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.575407 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.575678 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.575780 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.575987 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.576072 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.576295 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.576385 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.576601 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.576739 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.576908 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.577022 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.577232 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.577344 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.577537 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.577661 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.577853 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.577949 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.578162 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.578245 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.578467 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.578555 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.578774 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.578859 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.579079 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.579170 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.579388 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.579473 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.579724 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.579825 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.580037 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.580129 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.580346 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.580431 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.580698 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.580837 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.581015 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.581186 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.581320 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.581406 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.581645 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.581845 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.581984 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.582174 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.582260 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.582486 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.582578 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.582796 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.582881 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.583107 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.583193 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.583418 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.583502 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.583759 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.583846 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.584070 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.584157 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.584379 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.584465 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.584685 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.584769 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.584995 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.585096 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.585321 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.585526 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.585639 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.585863 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.585951 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.586190 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.586276 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.586509 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.586602 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.586826 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.586919 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.587141 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.587226 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.587455 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.587547 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.587794 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.587930 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.588110 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.588195 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.588423 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.588526 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.588731 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.588828 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.589042 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.589133 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.589353 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.589447 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.589659 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.589743 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.589964 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.590055 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.590272 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.590358 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.590609 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.590705 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.590882 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.590968 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.591185 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.591271 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.591494 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.591579 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.591828 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.591927 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.592147 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.592233 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.592471 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.592556 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.592783 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.592878 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.593093 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.593178 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.593402 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.593485 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.593713 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.593807 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.594025 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.594226 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.594338 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.594538 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.594647 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.594866 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.594962 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.595185 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.595270 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.595503 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.595596 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.595842 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.595927 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.596657 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.596815 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.596995 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.597158 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.597310 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.597456 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.597586 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.597673 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.597893 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.598039 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.598200 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.598441 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.598533 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.598757 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.598854 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.599091 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.599176 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.599389 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.599472 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.599728 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.599831 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.600035 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.600120 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.600357 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.600562 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.600684 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.600904 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.600997 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.601221 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.601306 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.601543 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.601635 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.601865 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.601957 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.602168 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.602252 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.602468 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.602559 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.602787 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.602870 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.603085 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.603168 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.603384 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.603476 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.603725 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.603810 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.604031 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.604263 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.604350 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.604613 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.604698 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.604916 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.605039 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.605220 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.605305 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.605518 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.605603 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.605823 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.605914 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.606121 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.606214 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.606441 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.606525 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.606740 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.606824 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.607039 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.607132 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.607338 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.607422 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.607664 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.607752 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.607969 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.608108 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.608270 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.608356 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.608569 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.608653 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.608873 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.608965 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.609175 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.609259 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.609472 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.609555 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.609774 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.609858 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.610072 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.610155 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.610379 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.610464 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.610679 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.610765 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.610981 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.611073 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.611290 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.611383 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.611593 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.611729 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.612492 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.612638 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.612786 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.612933 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.613082 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.613174 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.613385 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.613471 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.613704 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.613800 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.614015 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.614101 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.614319 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.614402 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.614630 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.614722 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.614936 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.615021 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.615245 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.615484 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.615596 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.615860 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.615949 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.616183 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.616268 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.616516 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.616611 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.616831 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.616922 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.617141 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.617225 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.617444 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.617536 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.617751 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.617835 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.618062 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.618143 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.618372 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.618472 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.618680 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.618772 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.618995 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.619239 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.619324 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.619575 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.619696 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.619917 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.620022 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.620224 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.620322 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.620531 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.620615 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.620837 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.620964 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.621142 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.621235 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.621447 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.621532 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.621753 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.621836 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.622057 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.622150 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.622367 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.622458 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.622681 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.622773 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.622995 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.623089 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.623308 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.623393 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.623632 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.623775 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.623951 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.624037 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.624262 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.624353 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.624567 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.624650 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.624872 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.624963 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.625175 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.625302 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.625483 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.625574 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.625825 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.626120 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.626348 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.626434 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.626675 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.626823 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.627023 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.627136 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.627346 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.627500 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.627722 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.627891 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.628061 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.628214 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.628385 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.628472 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.628699 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.628794 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.629014 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.629098 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.629326 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.629411 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.629638 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.629724 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.629956 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.630040 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.630291 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.630375 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.630605 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.630689 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.630914 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.630998 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.631219 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.631334 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.631522 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.631670 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.631849 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.631991 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.632159 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.632316 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.632476 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.632625 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.632783 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.632949 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.633083 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.633272 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.633382 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.633587 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.633701 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.633909 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.634012 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.634222 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.634320 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.634547 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.634651 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.634847 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.634943 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.635151 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.635264 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.635449 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.635544 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.635772 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.635881 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.636068 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.636172 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.636613 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.636706 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.636914 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.637014 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.637213 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.637300 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.637515 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.637608 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.637813 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.637913 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.638112 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.638198 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.638410 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.638508 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.638707 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.638804 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.639009 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.639095 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.639314 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.639399 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.639634 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.639725 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.639947 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.640035 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.640250 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.640337 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.640554 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.640649 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.640857 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.640951 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.641162 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.641259 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.641460 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.641558 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.641762 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.641850 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.642115 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.642222 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.642371 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.642458 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.642675 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.642762 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.642977 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.643561 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.643819 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.643920 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.644121 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.644208 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.644427 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.644530 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.644732 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.644818 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.645039 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.645125 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.645362 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.645521 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.645685 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.645779 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.645983 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.646069 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.646299 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.646392 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.646611 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.646697 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.646927 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.647014 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.647238 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.647325 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.647543 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.647652 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.647895 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.647989 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.648203 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.648298 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.648512 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.648609 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.648814 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.648909 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.649119 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.649213 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.649425 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.649510 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.649732 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.649827 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.650039 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.650125 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.650343 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.650430 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.650654 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.650753 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.650966 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.651053 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.651284 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.651388 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.651600 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.651721 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.651926 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.652022 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.652237 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.652337 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.652556 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.652642 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.652898 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.653183 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.653269 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.653504 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.653601 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.653817 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.653903 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.654130 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.654222 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.654436 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.654531 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.654738 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.654825 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.654981 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 19:32:29.655067 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.655346 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.655700 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.656019 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.656345 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.656673 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.656988 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.657316 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.657642 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.657991 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.658301 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.658644 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.659650 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.659961 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.660279 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.660591 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:32:29.660839 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 19:32:29.809086 n-d-708768-8 devstack@n-api.service[110655]: INFO dbcounter [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Registered counter for database nova_api Jul 26 19:32:29.813232 n-d-708768-8 devstack@n-api.service[110656]: INFO dbcounter [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Registered counter for database nova_api Jul 26 19:32:29.830393 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_db.sqlalchemy.engines [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:32:29.833643 n-d-708768-8 devstack@n-api.service[110656]: DEBUG oslo_db.sqlalchemy.engines [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:32:29.837737 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writer thread running {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:32:29.840016 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writer thread running {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:32:29.895703 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.context [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) {{(pid=110655) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 19:32:29.897095 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.context [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) {{(pid=110656) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 19:32:29.899629 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:32:29.901024 n-d-708768-8 devstack@n-api.service[110656]: DEBUG oslo_concurrency.lockutils [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:32:29.901194 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:32:29.901993 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:32:29.902570 n-d-708768-8 devstack@n-api.service[110656]: DEBUG oslo_concurrency.lockutils [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:32:29.903365 n-d-708768-8 devstack@n-api.service[110656]: DEBUG oslo_concurrency.lockutils [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:32:29.904000 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:32:29.905379 n-d-708768-8 devstack@n-api.service[110656]: DEBUG oslo_concurrency.lockutils [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:32:29.905953 n-d-708768-8 devstack@n-api.service[110655]: INFO dbcounter [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Registered counter for database nova_cell0 Jul 26 19:32:29.907327 n-d-708768-8 devstack@n-api.service[110656]: INFO dbcounter [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Registered counter for database nova_cell0 Jul 26 19:32:29.912028 n-d-708768-8 devstack@n-api.service[110655]: INFO dbcounter [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Registered counter for database nova_cell1 Jul 26 19:32:29.913387 n-d-708768-8 devstack@n-api.service[110656]: INFO dbcounter [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Registered counter for database nova_cell1 Jul 26 19:32:29.919127 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_db.sqlalchemy.engines [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:32:29.921317 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_db.sqlalchemy.engines [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:32:29.922865 n-d-708768-8 devstack@n-api.service[110656]: DEBUG oslo_db.sqlalchemy.engines [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:32:29.925829 n-d-708768-8 devstack@n-api.service[110656]: DEBUG oslo_db.sqlalchemy.engines [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:32:29.927943 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writer thread running {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:32:29.929907 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writer thread running {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:32:30.066841 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writer thread running {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:32:30.069451 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writer thread running {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:32:30.076734 n-d-708768-8 devstack@n-api.service[110655]: INFO dbcounter [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Registered counter for database nova_cell0 Jul 26 19:32:30.078495 n-d-708768-8 devstack@n-api.service[110656]: INFO dbcounter [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Registered counter for database nova_cell0 Jul 26 19:32:30.086444 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_db.sqlalchemy.engines [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:32:30.089984 n-d-708768-8 devstack@n-api.service[110656]: DEBUG oslo_db.sqlalchemy.engines [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:32:30.091186 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writer thread running {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:32:30.094618 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writer thread running {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:32:30.428797 n-d-708768-8 devstack@n-api.service[110655]: WARNING keystonemiddleware.auth_token [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 19:32:30.431004 n-d-708768-8 devstack@n-api.service[110656]: WARNING keystonemiddleware.auth_token [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 19:32:30.436105 n-d-708768-8 devstack@n-api.service[110655]: WARNING keystonemiddleware.auth_token [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 19:32:30.438105 n-d-708768-8 devstack@n-api.service[110656]: WARNING keystonemiddleware.auth_token [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 19:32:30.782031 n-d-708768-8 devstack@n-api.service[110656]: WARNING keystonemiddleware.auth_token [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 19:32:30.783370 n-d-708768-8 devstack@n-api.service[110655]: WARNING keystonemiddleware.auth_token [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 19:32:30.788808 n-d-708768-8 devstack@n-api.service[110656]: WARNING keystonemiddleware.auth_token [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 19:32:30.789849 n-d-708768-8 devstack@n-api.service[110655]: WARNING keystonemiddleware.auth_token [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 19:32:30.794224 n-d-708768-8 devstack@n-api.service[110656]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555c6db419c0 pid: 110656 (default app) Jul 26 19:32:30.795874 n-d-708768-8 devstack@n-api.service[110655]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555c6db419c0 pid: 110655 (default app) Jul 26 19:32:30.796471 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:32:30.797714 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-beb06763-1f4d-4794-a529-8733e1ffc068 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001809 Jul 26 19:32:30.798164 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Tue Jul 26 19:32:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:33:46.743774 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:33:46.744978 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Jul 26 19:33:46.745383 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:33:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:33:46.758050 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writing DB stats nova_api:SELECT=3 {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:33:46.759190 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writing DB stats nova_cell0:SELECT=3 {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:33:46.760643 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writing DB stats nova_cell1:SELECT=3 {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:33:46.761768 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:33:47.627815 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-a71b4d73-8474-4de9-9081-cbf9591105a1 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:33:47.660491 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-a71b4d73-8474-4de9-9081-cbf9591105a1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907551 Jul 26 19:33:47.661349 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1291 bytes} [Tue Jul 26 19:33:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:33:49.905624 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:33:49.906631 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-e6e680d2-3b2f-4d49-836e-8c6000fcd42f None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Jul 26 19:33:49.907067 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:33:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:33:50.379331 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-e5ac75c7-f8f3-4bf9-aa6b-f04e00a8cf1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:33:50.400250 n-d-708768-8 devstack@n-api.service[110656]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:33:50.400250 n-d-708768-8 devstack@n-api.service[110656]: warnings.warn(msg) Jul 26 19:33:50.427640 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-e5ac75c7-f8f3-4bf9-aa6b-f04e00a8cf1c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.514031 Jul 26 19:33:50.428378 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:33:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:33:50.441871 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writing DB stats nova_api:SELECT=3 {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:33:50.443091 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writing DB stats nova_cell1:SELECT=3 {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:33:50.444095 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writing DB stats nova_cell0:SELECT=3 {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:33:50.444908 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:33:50.648672 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-103bb9cf-d486-4a0a-ae4d-a7070e6df70e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:33:50.652994 n-d-708768-8 devstack@n-api.service[110655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:33:50.652994 n-d-708768-8 devstack@n-api.service[110655]: warnings.warn(msg) Jul 26 19:33:50.715184 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-103bb9cf-d486-4a0a-ae4d-a7070e6df70e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278309 Jul 26 19:33:50.715790 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jul 26 19:33:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:33:52.979295 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-e5ac75c7-f8f3-4bf9-aa6b-f04e00a8cf1c admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:33:52.980382 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-e5ac75c7-f8f3-4bf9-aa6b-f04e00a8cf1c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jul 26 19:33:52.980778 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:33:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:33:53.693470 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-411e0101-45a7-4212-9055-f0482da1000d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "disk": 5, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:33:53.726299 n-d-708768-8 devstack@n-api.service[110655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:33:53.726299 n-d-708768-8 devstack@n-api.service[110655]: warnings.warn(msg) Jul 26 19:33:53.748986 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-411e0101-45a7-4212-9055-f0482da1000d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.761091 Jul 26 19:33:53.749846 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:33:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:33:53.762851 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-e115350e-9110-4e89-bd4a-1a8c57659e68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:33:53.766217 n-d-708768-8 devstack@n-api.service[110656]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:33:53.766217 n-d-708768-8 devstack@n-api.service[110656]: warnings.warn(msg) Jul 26 19:33:53.800983 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-e115350e-9110-4e89-bd4a-1a8c57659e68 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042689 Jul 26 19:33:53.802106 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jul 26 19:33:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:33:56.067982 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-411e0101-45a7-4212-9055-f0482da1000d admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:33:56.069000 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-411e0101-45a7-4212-9055-f0482da1000d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 26 19:33:56.076091 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:33:56.759140 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-76cf4a4a-a5f5-4582-b3fd-9b6c736fb725 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:33:56.782466 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-76cf4a4a-a5f5-4582-b3fd-9b6c736fb725 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706646 Jul 26 19:33:56.783771 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:33:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:33:56.795901 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e207191a-c7b9-4d51-b291-9c3157579450 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:33:56.825254 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-e207191a-c7b9-4d51-b291-9c3157579450 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033656 Jul 26 19:33:56.826756 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jul 26 19:33:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:33:59.114069 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-76cf4a4a-a5f5-4582-b3fd-9b6c736fb725 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:33:59.115089 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-76cf4a4a-a5f5-4582-b3fd-9b6c736fb725 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 26 19:33:59.115491 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:33:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:33:59.520863 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-c98ea9de-d220-40f1-9b72-35c57c549789 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:33:59.540192 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-c98ea9de-d220-40f1-9b72-35c57c549789 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418598 Jul 26 19:33:59.543649 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:33:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:33:59.552716 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-9737c974-e06a-416a-8d72-a87028bc5876 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:33:59.578088 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-9737c974-e06a-416a-8d72-a87028bc5876 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029049 Jul 26 19:33:59.578920 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jul 26 19:33:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:34:01.830530 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-c98ea9de-d220-40f1-9b72-35c57c549789 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:01.831549 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-c98ea9de-d220-40f1-9b72-35c57c549789 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 26 19:34:01.832244 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:34:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:02.319796 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-671d9792-4e58-4527-9913-f7f866dbc1cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:02.340181 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-671d9792-4e58-4527-9913-f7f866dbc1cd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502175 Jul 26 19:34:02.347683 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:34:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:34:02.353083 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-08caf9af-d57a-4779-89ad-def124e36171 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:02.378333 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-08caf9af-d57a-4779-89ad-def124e36171 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028690 Jul 26 19:34:02.384076 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1335 bytes} [Tue Jul 26 19:34:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:34:04.711896 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-671d9792-4e58-4527-9913-f7f866dbc1cd admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:04.713898 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-671d9792-4e58-4527-9913-f7f866dbc1cd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002605 Jul 26 19:34:04.714629 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:05.242156 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-4cc713fe-906a-4f92-8641-71a6f923fc6b admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:05.268418 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-4cc713fe-906a-4f92-8641-71a6f923fc6b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.546910 Jul 26 19:34:05.284113 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1291 bytes} [Tue Jul 26 19:34:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:34:07.564179 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-671d9792-4e58-4527-9913-f7f866dbc1cd admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:07.565190 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-671d9792-4e58-4527-9913-f7f866dbc1cd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 26 19:34:07.565591 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:34:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:34:08.011070 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-9fba9c6b-6412-44bd-89b7-375955faafd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:08.033637 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-9fba9c6b-6412-44bd-89b7-375955faafd7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.460749 Jul 26 19:34:08.034191 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:34:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:34:08.046911 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-9f714bcb-d026-445d-aae4-555508aeb8e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:08.073571 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-9f714bcb-d026-445d-aae4-555508aeb8e3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030913 Jul 26 19:34:08.074346 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jul 26 19:34:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:34:10.662277 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-9fba9c6b-6412-44bd-89b7-375955faafd7 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:10.663366 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-9fba9c6b-6412-44bd-89b7-375955faafd7 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 26 19:34:10.663804 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:34:11.132619 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-648ea8cd-842b-4943-a2e1-7bee37706935 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:11.153935 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-648ea8cd-842b-4943-a2e1-7bee37706935 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484019 Jul 26 19:34:11.154581 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:34:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:34:11.166302 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-6c3d6d4c-4e1b-4fe7-b44f-10bc5e681c97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:11.193433 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-6c3d6d4c-4e1b-4fe7-b44f-10bc5e681c97 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030702 Jul 26 19:34:11.194005 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jul 26 19:34:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:34:13.440734 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-648ea8cd-842b-4943-a2e1-7bee37706935 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:13.441748 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-648ea8cd-842b-4943-a2e1-7bee37706935 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 26 19:34:13.442152 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:13.836505 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-a8ae94cf-cbef-4a4d-86b4-2940300d65ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 40}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:13.854672 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-a8ae94cf-cbef-4a4d-86b4-2940300d65ea admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.406591 Jul 26 19:34:13.855464 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:34:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:34:13.867563 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-64fd8448-35a1-4152-bec1-2ccf3ed0c60a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:13.892179 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-64fd8448-35a1-4152-bec1-2ccf3ed0c60a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028395 Jul 26 19:34:13.892748 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jul 26 19:34:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:34:16.102471 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-a8ae94cf-cbef-4a4d-86b4-2940300d65ea admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:16.103512 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-a8ae94cf-cbef-4a4d-86b4-2940300d65ea admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 26 19:34:16.103965 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:34:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:16.544899 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-c8a060d2-0408-4e0f-b532-9f95b4f484b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "id": "4", "swap": 0, "ram": 8192, "disk": 80}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:16.563850 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-c8a060d2-0408-4e0f-b532-9f95b4f484b8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450778 Jul 26 19:34:16.564625 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:34:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:34:16.576972 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-a8f7e6ce-7d67-4ef8-bb04-14ea85d41b2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:16.600808 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-a8f7e6ce-7d67-4ef8-bb04-14ea85d41b2d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028025 Jul 26 19:34:16.601382 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jul 26 19:34:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:34:18.827267 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-c8a060d2-0408-4e0f-b532-9f95b4f484b8 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:18.828378 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-c8a060d2-0408-4e0f-b532-9f95b4f484b8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Jul 26 19:34:18.828950 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:19.390484 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-75045b60-09d9-4915-9503-c783dff6ae83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "swap": 0, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:19.410472 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-75045b60-09d9-4915-9503-c783dff6ae83 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.575743 Jul 26 19:34:19.411179 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1282 bytes} [Tue Jul 26 19:34:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:34:19.423823 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-9b5a0f7d-4773-4324-9345-93224b24f1fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:19.432099 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:34:19.450054 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-9b5a0f7d-4773-4324-9345-93224b24f1fb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029940 Jul 26 19:34:19.450621 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1332 bytes} [Tue Jul 26 19:34:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:34:43.921699 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-75045b60-09d9-4915-9503-c783dff6ae83 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:43.922710 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-75045b60-09d9-4915-9503-c783dff6ae83 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 26 19:34:43.923113 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:34:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:44.311118 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-d23d92aa-36c6-4b43-a75c-b81869ec732d admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:44.329908 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-d23d92aa-36c6-4b43-a75c-b81869ec732d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400966 Jul 26 19:34:44.330436 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1291 bytes} [Tue Jul 26 19:34:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:34:45.395030 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-75045b60-09d9-4915-9503-c783dff6ae83 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:45.396076 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-75045b60-09d9-4915-9503-c783dff6ae83 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 26 19:34:45.396479 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:34:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:45.927325 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-3151dde2-0ee2-46f8-9d80-e6bd57b4aed5 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:45.932959 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.wsgi [None req-3151dde2-0ee2-46f8-9d80-e6bd57b4aed5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-3151dde2-0ee2-46f8-9d80-e6bd57b4aed5 admin admin] Request method failure captured: Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: Accept: application/json Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: Accept-Encoding: gzip, deflate Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: Connection: keep-alive Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: Content-Length: 0 Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: Host: 10.222.0.58 Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: Openstack-Api-Version: compute 2.90 Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: Openstack-System-Scope: None Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: User-Agent: python-novaclient Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Auth-Token: gAAAAABi4EHVWaOTWGp-W-03wUc0OjI5e7-E82-NHN4N4KVmj1U0QgfDi7AXB_OralnbnLrEoYIalcMr9k0sqQp4Be0G4uTpRKO9951pBDhf_CjprVG_5_wxu2z7oec9zrCggT-ZyKa5djOVEMzwIrdbQg85BPz2alWweyFedw0Kq7SYHpD0tTM Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Domain-Id: None Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Domain-Name: None Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Identity-Status: Confirmed Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Is-Admin-Project: True Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Domain-Id: default Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Domain-Name: Default Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Name: admin Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Role: member,admin,reader Jul 26 19:34:45.936198 n-d-708768-8 devstack@n-api.service[110656]: X-Roles: member,admin,reader Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4619130e986a4c25b0dd8ba8b488d47c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}] Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant: admin Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant-Name: admin Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-User: admin Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-User-Domain-Id: default Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-User-Domain-Name: Default Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-User-Id: 8228dc17776f463fa2dc6bbe4a277cd6 Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: X-User-Name: admin Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: method: > Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: exception: Flavor 42 could not be found. Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: action_args: {'id': '42'} Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:34:45.937809 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:45.938838 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:45.940193 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-3151dde2-0ee2-46f8-9d80-e6bd57b4aed5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:34:45.941262 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-3151dde2-0ee2-46f8-9d80-e6bd57b4aed5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391431 Jul 26 19:34:45.941262 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jul 26 19:34:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:34:45.947132 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-2b835dd8-f59b-4d7a-b990-ec9c5bb2f462 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:45.951294 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:34:45.971012 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-2b835dd8-f59b-4d7a-b990-ec9c5bb2f462 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027366 Jul 26 19:34:45.971559 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jul 26 19:34:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:34:45.988206 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-91a013e8-18d2-4e21-9132-6af944b611c3 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:46.011974 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-91a013e8-18d2-4e21-9132-6af944b611c3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027364 Jul 26 19:34:46.012503 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jul 26 19:34:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:34:46.021762 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e7c0a57d-fbb1-4b3a-b670-5c85bd761b3a admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:46.028303 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.wsgi [None req-e7c0a57d-fbb1-4b3a-b670-5c85bd761b3a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e7c0a57d-fbb1-4b3a-b670-5c85bd761b3a admin admin] Request method failure captured: Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: Accept: application/json Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: Accept-Encoding: gzip, deflate Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: Connection: keep-alive Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: Content-Length: 0 Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: Host: 10.222.0.58 Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: Openstack-Api-Version: compute 2.90 Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: Openstack-System-Scope: None Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: User-Agent: python-novaclient Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Auth-Token: gAAAAABi4EHVWaOTWGp-W-03wUc0OjI5e7-E82-NHN4N4KVmj1U0QgfDi7AXB_OralnbnLrEoYIalcMr9k0sqQp4Be0G4uTpRKO9951pBDhf_CjprVG_5_wxu2z7oec9zrCggT-ZyKa5djOVEMzwIrdbQg85BPz2alWweyFedw0Kq7SYHpD0tTM Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Domain-Id: None Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Domain-Name: None Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Identity-Status: Confirmed Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Is-Admin-Project: True Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Domain-Id: default Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Domain-Name: Default Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Name: admin Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Role: member,admin,reader Jul 26 19:34:46.031541 n-d-708768-8 devstack@n-api.service[110655]: X-Roles: member,admin,reader Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4619130e986a4c25b0dd8ba8b488d47c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}] Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant: admin Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant-Name: admin Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-User: admin Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-User-Domain-Id: default Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-User-Domain-Name: Default Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-User-Id: 8228dc17776f463fa2dc6bbe4a277cd6 Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: X-User-Name: admin Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: method: > Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: exception: Flavor 42 could not be found. Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: action_args: {'id': '42'} Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:34:46.033065 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:46.033941 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:46.035185 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e7c0a57d-fbb1-4b3a-b670-5c85bd761b3a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:34:46.036479 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-e7c0a57d-fbb1-4b3a-b670-5c85bd761b3a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014804 Jul 26 19:34:46.036479 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jul 26 19:34:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:34:47.007803 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-91a013e8-18d2-4e21-9132-6af944b611c3 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:47.008837 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-91a013e8-18d2-4e21-9132-6af944b611c3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 26 19:34:47.009498 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:34:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:47.530514 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-60018dce-40db-4467-ae48-c9b4a2061139 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:47.535860 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.wsgi [None req-60018dce-40db-4467-ae48-c9b4a2061139 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-60018dce-40db-4467-ae48-c9b4a2061139 admin admin] Request method failure captured: Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: Accept: application/json Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: Accept-Encoding: gzip, deflate Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: Connection: keep-alive Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: Content-Length: 0 Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: Host: 10.222.0.58 Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: Openstack-Api-Version: compute 2.90 Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: Openstack-System-Scope: None Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: User-Agent: python-novaclient Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Auth-Token: gAAAAABi4EHWFgtz4DhxBjtLK2Q25DWsMFCGFOmQsARjQFtsDrHTKE_xaCQ9ziaHa2qhKSs7ImD0xe2nZS77ZmJ9XyHx9GP2ywV4r5bGggFkRGclaS-g1O5uRe1XlU84DpZRop3x9CUyLCJNFHeXz2si8tjS0NTxXyqyYRNBULtVwZPjLOfsO28 Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Domain-Id: None Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Domain-Name: None Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Identity-Status: Confirmed Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Is-Admin-Project: True Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Domain-Id: default Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Domain-Name: Default Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Name: admin Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Role: member,admin,reader Jul 26 19:34:47.537343 n-d-708768-8 devstack@n-api.service[110655]: X-Roles: member,admin,reader Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4619130e986a4c25b0dd8ba8b488d47c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}] Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant: admin Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant-Name: admin Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-User: admin Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-User-Domain-Id: default Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-User-Domain-Name: Default Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-User-Id: 8228dc17776f463fa2dc6bbe4a277cd6 Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: X-User-Name: admin Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: method: > Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: exception: Flavor 84 could not be found. Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: action_args: {'id': '84'} Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:34:47.538950 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:47.539946 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.541307 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-60018dce-40db-4467-ae48-c9b4a2061139 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:34:47.543353 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-60018dce-40db-4467-ae48-c9b4a2061139 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392031 Jul 26 19:34:47.543353 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jul 26 19:34:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:34:47.549196 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-dc34f647-20fa-454d-9957-4557b8ee0824 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:47.563794 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-dc34f647-20fa-454d-9957-4557b8ee0824 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018101 Jul 26 19:34:47.564304 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jul 26 19:34:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:34:47.573580 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-de96debc-ec63-4940-9196-a18160f71b0c admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:47.588431 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-de96debc-ec63-4940-9196-a18160f71b0c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018445 Jul 26 19:34:47.589731 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jul 26 19:34:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:34:47.598615 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-9938ad39-e48f-4e31-9d56-b179fa081b85 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:47.603855 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.wsgi [None req-9938ad39-e48f-4e31-9d56-b179fa081b85 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-9938ad39-e48f-4e31-9d56-b179fa081b85 admin admin] Request method failure captured: Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: Accept: application/json Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: Accept-Encoding: gzip, deflate Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: Connection: keep-alive Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: Content-Length: 0 Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: Host: 10.222.0.58 Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: Openstack-Api-Version: compute 2.90 Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: Openstack-System-Scope: None Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: User-Agent: python-novaclient Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Auth-Token: gAAAAABi4EHWFgtz4DhxBjtLK2Q25DWsMFCGFOmQsARjQFtsDrHTKE_xaCQ9ziaHa2qhKSs7ImD0xe2nZS77ZmJ9XyHx9GP2ywV4r5bGggFkRGclaS-g1O5uRe1XlU84DpZRop3x9CUyLCJNFHeXz2si8tjS0NTxXyqyYRNBULtVwZPjLOfsO28 Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Domain-Id: None Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Domain-Name: None Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Identity-Status: Confirmed Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Is-Admin-Project: True Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Domain-Id: default Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Domain-Name: Default Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Name: admin Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Role: member,admin,reader Jul 26 19:34:47.606119 n-d-708768-8 devstack@n-api.service[110656]: X-Roles: member,admin,reader Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4619130e986a4c25b0dd8ba8b488d47c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}] Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant: admin Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant-Name: admin Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-User: admin Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-User-Domain-Id: default Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-User-Domain-Name: Default Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-User-Id: 8228dc17776f463fa2dc6bbe4a277cd6 Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: X-User-Name: admin Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: method: > Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: exception: Flavor 84 could not be found. Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: action_args: {'id': '84'} Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:34:47.607669 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:47.608683 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:47.610185 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-9938ad39-e48f-4e31-9d56-b179fa081b85 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:34:47.611438 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-9938ad39-e48f-4e31-9d56-b179fa081b85 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012316 Jul 26 19:34:47.611438 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jul 26 19:34:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:34:48.589914 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-de96debc-ec63-4940-9196-a18160f71b0c admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:48.590917 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-de96debc-ec63-4940-9196-a18160f71b0c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Jul 26 19:34:48.591342 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:49.112080 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-5771997c-5d08-476f-b448-1e3b15dbed3d admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:49.117734 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.wsgi [None req-5771997c-5d08-476f-b448-1e3b15dbed3d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-5771997c-5d08-476f-b448-1e3b15dbed3d admin admin] Request method failure captured: Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: Accept: application/json Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: Accept-Encoding: gzip, deflate Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: Connection: keep-alive Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: Content-Length: 0 Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: Host: 10.222.0.58 Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: Openstack-Api-Version: compute 2.90 Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: Openstack-System-Scope: None Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: User-Agent: python-novaclient Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Auth-Token: gAAAAABi4EHY5egHwB8XP6iut_MKyb89rc8iri8-gS3J2JCjXcgiFz5yfd_msE9_PfW-2HgEwPnaz1NXdl-aZTB1lHxDeRQfk-HO9iYKkI5FqZA02RLKBr1bEm2fYt_9-D4VK5plgDannQ1f_HmbZoFW59isAVT4A2PHPrpA-UjYn0L_pNBW8uE Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Domain-Id: None Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Domain-Name: None Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Identity-Status: Confirmed Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Is-Admin-Project: True Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Domain-Id: default Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Domain-Name: Default Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Project-Name: admin Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Role: member,admin,reader Jul 26 19:34:49.119207 n-d-708768-8 devstack@n-api.service[110656]: X-Roles: member,admin,reader Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4619130e986a4c25b0dd8ba8b488d47c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}] Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant: admin Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-Tenant-Name: admin Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-User: admin Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-User-Domain-Id: default Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-User-Domain-Name: Default Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-User-Id: 8228dc17776f463fa2dc6bbe4a277cd6 Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: X-User-Name: admin Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: method: > Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: exception: Flavor 451 could not be found. Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: action_args: {'id': '451'} Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:34:49.120797 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:49.121893 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.123254 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-5771997c-5d08-476f-b448-1e3b15dbed3d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:34:49.124531 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-5771997c-5d08-476f-b448-1e3b15dbed3d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389173 Jul 26 19:34:49.124531 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jul 26 19:34:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 19:34:49.130498 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-5de5f18d-5bd6-4e20-8737-cc63650fab60 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:49.145997 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-5de5f18d-5bd6-4e20-8737-cc63650fab60 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019177 Jul 26 19:34:49.146518 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jul 26 19:34:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:34:49.156369 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:49.170971 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018098 Jul 26 19:34:49.171487 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Jul 26 19:34:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:34:49.180417 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e6b8628d-fe07-4b4d-8f37-b24e9b0ecf8d admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:49.185809 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.wsgi [None req-e6b8628d-fe07-4b4d-8f37-b24e9b0ecf8d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e6b8628d-fe07-4b4d-8f37-b24e9b0ecf8d admin admin] Request method failure captured: Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: Accept: application/json Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: Accept-Encoding: gzip, deflate Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: Connection: keep-alive Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: Content-Length: 0 Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: Host: 10.222.0.58 Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: Openstack-Api-Version: compute 2.90 Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: Openstack-System-Scope: None Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: User-Agent: python-novaclient Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Auth-Token: gAAAAABi4EHY5egHwB8XP6iut_MKyb89rc8iri8-gS3J2JCjXcgiFz5yfd_msE9_PfW-2HgEwPnaz1NXdl-aZTB1lHxDeRQfk-HO9iYKkI5FqZA02RLKBr1bEm2fYt_9-D4VK5plgDannQ1f_HmbZoFW59isAVT4A2PHPrpA-UjYn0L_pNBW8uE Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Domain-Id: None Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Domain-Name: None Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Identity-Status: Confirmed Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Is-Admin-Project: True Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Domain-Id: default Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Domain-Name: Default Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Project-Name: admin Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Role: member,admin,reader Jul 26 19:34:49.187307 n-d-708768-8 devstack@n-api.service[110655]: X-Roles: member,admin,reader Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4619130e986a4c25b0dd8ba8b488d47c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4619130e986a4c25b0dd8ba8b488d47c"}]}] Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant: admin Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant-Id: 4619130e986a4c25b0dd8ba8b488d47c Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-Tenant-Name: admin Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-User: admin Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-User-Domain-Id: default Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-User-Domain-Name: Default Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-User-Id: 8228dc17776f463fa2dc6bbe4a277cd6 Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: X-User-Name: admin Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: method: > Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: exception: Flavor 451 could not be found. Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: action_args: {'id': '451'} Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:34:49.189029 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:49.190156 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: ERROR nova.api.openstack.wsgi Jul 26 19:34:49.191425 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-e6b8628d-fe07-4b4d-8f37-b24e9b0ecf8d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:34:49.192676 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-e6b8628d-fe07-4b4d-8f37-b24e9b0ecf8d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011795 Jul 26 19:34:49.192676 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jul 26 19:34:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:34:50.176744 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:50.177748 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 26 19:34:50.178144 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:50.701414 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-c3c96314-e427-4b3c-a4a7-d303fcaddef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:50.720496 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-c3c96314-e427-4b3c-a4a7-d303fcaddef1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402338 Jul 26 19:34:50.721039 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Jul 26 19:34:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:34:51.683242 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:51.684264 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 26 19:34:51.684659 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:52.199212 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-23a689b1-05d7-44c7-aaec-f3c8d81a5958 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:52.217582 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-23a689b1-05d7-44c7-aaec-f3c8d81a5958 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.396615 Jul 26 19:34:52.218113 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Jul 26 19:34:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:34:53.188904 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:53.189898 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 26 19:34:53.190326 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:53.709458 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-c8b4d224-7862-4b3a-9f56-0161e3645dab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:53.727784 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-c8b4d224-7862-4b3a-9f56-0161e3645dab admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400257 Jul 26 19:34:53.728315 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Jul 26 19:34:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:34:54.695025 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:54.696060 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 26 19:34:54.696457 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:34:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:55.213844 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-a9f1c832-f828-4af5-91f2-5686fc5b0ff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:34:55.232574 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-a9f1c832-f828-4af5-91f2-5686fc5b0ff8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.396648 Jul 26 19:34:55.233104 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Jul 26 19:34:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:34:56.199796 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:56.200970 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002246 Jul 26 19:34:56.201390 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:34:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:34:56.720047 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-2de9b4b8-fa01-47bc-8689-a39fbf3ec40d admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:34:56.741062 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-2de9b4b8-fa01-47bc-8689-a39fbf3ec40d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402308 Jul 26 19:34:56.741575 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1202 bytes} [Tue Jul 26 19:34:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:35:47.867135 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:35:47.868166 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-489315e3-a7c1-4f66-b58c-b987cf25ac71 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 26 19:35:47.868580 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 930 bytes} [Tue Jul 26 19:35:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:35:47.878854 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:35:48.268486 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-605b8d4d-b83a-4be9-99ba-0a1ce8e936e5 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:35:48.288861 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-605b8d4d-b83a-4be9-99ba-0a1ce8e936e5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414428 Jul 26 19:35:48.289328 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1291 bytes} [Tue Jul 26 19:35:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:35:48.313090 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-90909b4d-2fec-47d3-a39a-cd260058b020 admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:35:48.316540 n-d-708768-8 devstack@n-api.service[110656]: DEBUG dbcounter [-] [110656] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:35:48.323371 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-90909b4d-2fec-47d3-a39a-cd260058b020 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013917 Jul 26 19:35:48.324057 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 33/65] 10.222.0.58 () {60 vars in 1282 bytes} [Tue Jul 26 19:35:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:35:48.335658 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-32bc9b98-685b-4d4c-bac7-456a314687a4 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:35:48.343758 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-32bc9b98-685b-4d4c-bac7-456a314687a4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011634 Jul 26 19:35:48.344273 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1285 bytes} [Tue Jul 26 19:35:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:35:48.356281 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-56463e4d-dd3d-4f3f-98b6-65e1a0c4397c admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:35:48.364228 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-56463e4d-dd3d-4f3f-98b6-65e1a0c4397c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012397 Jul 26 19:35:48.364752 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1285 bytes} [Tue Jul 26 19:35:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:35:48.376543 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-fa57f81b-acbf-4dc2-91da-6d3855f0c5a4 admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:35:48.384581 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-fa57f81b-acbf-4dc2-91da-6d3855f0c5a4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011077 Jul 26 19:35:48.385092 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 34/68] 10.222.0.58 () {60 vars in 1282 bytes} [Tue Jul 26 19:35:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:41:18.701000 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-56463e4d-dd3d-4f3f-98b6-65e1a0c4397c admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:41:18.702022 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-56463e4d-dd3d-4f3f-98b6-65e1a0c4397c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 26 19:41:18.702424 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:41:18.845233 n-d-708768-8 devstack@n-api.service[110655]: DEBUG dbcounter [-] [110655] Writing DB stats nova_api:SELECT=6 {{(pid=110655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:41:18.985119 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-981d1c06-47fb-4afa-9d65-021f985d5b7c admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:41:18.988005 n-d-708768-8 devstack@n-api.service[110655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:41:18.988005 n-d-708768-8 devstack@n-api.service[110655]: warnings.warn(msg) Jul 26 19:41:18.989206 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-981d1c06-47fb-4afa-9d65-021f985d5b7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:41:18.989639 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-981d1c06-47fb-4afa-9d65-021f985d5b7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:41:18.990417 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-981d1c06-47fb-4afa-9d65-021f985d5b7c admin admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:41:18.990836 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-981d1c06-47fb-4afa-9d65-021f985d5b7c admin admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:41:19.030595 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-981d1c06-47fb-4afa-9d65-021f985d5b7c admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.186874 Jul 26 19:41:19.031164 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 35/70] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jul 26 19:41:18 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:41:19.857915 n-d-708768-8 devstack@n-api.service[110656]: DEBUG nova.api.openstack.wsgi [None req-56463e4d-dd3d-4f3f-98b6-65e1a0c4397c admin admin] Calling method '>' {{(pid=110656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:41:19.858905 n-d-708768-8 devstack@n-api.service[110656]: INFO nova.api.openstack.requestlog [None req-56463e4d-dd3d-4f3f-98b6-65e1a0c4397c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jul 26 19:41:19.859292 n-d-708768-8 devstack@n-api.service[110656]: [pid: 110656|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Jul 26 19:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:41:20.050888 n-d-708768-8 devstack@n-api.service[110655]: DEBUG nova.api.openstack.wsgi [None req-1153384c-a613-4106-9c70-1157ea40423b admin admin] Calling method '>' {{(pid=110655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:41:20.053299 n-d-708768-8 devstack@n-api.service[110655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:41:20.053299 n-d-708768-8 devstack@n-api.service[110655]: warnings.warn(msg) Jul 26 19:41:20.054620 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-1153384c-a613-4106-9c70-1157ea40423b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:41:20.055069 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-1153384c-a613-4106-9c70-1157ea40423b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:41:20.056396 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-1153384c-a613-4106-9c70-1157ea40423b admin admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:41:20.056833 n-d-708768-8 devstack@n-api.service[110655]: DEBUG oslo_concurrency.lockutils [None req-1153384c-a613-4106-9c70-1157ea40423b admin admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:41:20.078995 n-d-708768-8 devstack@n-api.service[110655]: INFO nova.api.openstack.requestlog [None req-1153384c-a613-4106-9c70-1157ea40423b admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.080934 Jul 26 19:41:20.079510 n-d-708768-8 devstack@n-api.service[110655]: [pid: 110655|app: 0|req: 36/72] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jul 26 19:41:19 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:42:06.642564 n-d-708768-8 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 19:42:06.643120 n-d-708768-8 devstack@n-api.service[110654]: Tue Jul 26 19:42:06 2022 - graceful shutdown triggered... Jul 26 19:42:06.643708 n-d-708768-8 devstack@n-api.service[110656]: Gracefully killing worker 2 (pid: 110656)... Jul 26 19:42:06.644093 n-d-708768-8 devstack@n-api.service[110655]: Gracefully killing worker 1 (pid: 110655)... Jul 26 19:42:07.643725 n-d-708768-8 devstack@n-api.service[110654]: worker 1 buried after 1 seconds Jul 26 19:42:07.643725 n-d-708768-8 devstack@n-api.service[110654]: worker 2 buried after 1 seconds Jul 26 19:42:07.643725 n-d-708768-8 devstack@n-api.service[110654]: goodbye to uWSGI. Jul 26 19:42:07.645877 n-d-708768-8 systemd[1]: devstack@n-api.service: Succeeded. Jul 26 19:42:07.646456 n-d-708768-8 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 19:42:07.649264 n-d-708768-8 systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 19:42:07.668201 n-d-708768-8 devstack@n-api.service[125952]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 19:42:07 2022] *** Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: nodename: n-d-708768-8 Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: machine: x86_64 Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: clock source: unix Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: pcre jit disabled Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: detected number of CPU cores: 4 Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: current working directory: / Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: detected binary path: /usr/bin/uwsgi-core Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: your processes number limit is 47680 Jul 26 19:42:07.689153 n-d-708768-8 devstack@n-api.service[125952]: your memory page size is 4096 bytes Jul 26 19:42:07.690114 n-d-708768-8 devstack@n-api.service[125952]: detected max file descriptor number: 2048 Jul 26 19:42:07.690114 n-d-708768-8 devstack@n-api.service[125952]: lock engine: pthread robust mutexes Jul 26 19:42:07.690114 n-d-708768-8 devstack@n-api.service[125952]: thunder lock: enabled Jul 26 19:42:07.690114 n-d-708768-8 devstack@n-api.service[125952]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 19:42:07.690114 n-d-708768-8 devstack@n-api.service[125952]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 19:42:07.729488 n-d-708768-8 devstack@n-api.service[125952]: Python main interpreter initialized at 0x5569b15d49c0 Jul 26 19:42:07.729488 n-d-708768-8 devstack@n-api.service[125952]: python threads support enabled Jul 26 19:42:07.729488 n-d-708768-8 devstack@n-api.service[125952]: your server socket listen backlog is limited to 100 connections Jul 26 19:42:07.729488 n-d-708768-8 devstack@n-api.service[125952]: your mercy for graceful operations on workers is 90 seconds Jul 26 19:42:07.729960 n-d-708768-8 devstack@n-api.service[125952]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 19:42:07.729960 n-d-708768-8 devstack@n-api.service[125952]: *** Operational MODE: preforking *** Jul 26 19:42:07.730181 n-d-708768-8 devstack@n-api.service[125952]: *** uWSGI is running in multiple interpreter mode *** Jul 26 19:42:07.730181 n-d-708768-8 devstack@n-api.service[125952]: spawned uWSGI master process (pid: 125952) Jul 26 19:42:07.730392 n-d-708768-8 systemd[1]: Started Devstack devstack@n-api.service. Jul 26 19:42:07.732050 n-d-708768-8 devstack@n-api.service[125952]: spawned uWSGI worker 1 (pid: 125963, cores: 1) Jul 26 19:42:07.732050 n-d-708768-8 devstack@n-api.service[125952]: spawned uWSGI worker 2 (pid: 125964, cores: 1) Jul 26 19:42:07.732050 n-d-708768-8 devstack@n-api.service[125952]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 19:42:08.394056 n-d-708768-8 devstack@n-api.service[125963]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 19:42:08.404918 n-d-708768-8 devstack@n-api.service[125964]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 19:42:09.553128 n-d-708768-8 devstack@n-api.service[125963]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 19:42:09.553128 n-d-708768-8 devstack@n-api.service[125963]: from cryptography.utils import int_from_bytes Jul 26 19:42:09.553798 n-d-708768-8 devstack@n-api.service[125963]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 19:42:09.553798 n-d-708768-8 devstack@n-api.service[125963]: from cryptography.utils import int_from_bytes Jul 26 19:42:09.569083 n-d-708768-8 devstack@n-api.service[125964]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 19:42:09.569083 n-d-708768-8 devstack@n-api.service[125964]: from cryptography.utils import int_from_bytes Jul 26 19:42:09.569620 n-d-708768-8 devstack@n-api.service[125964]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 19:42:09.569620 n-d-708768-8 devstack@n-api.service[125964]: from cryptography.utils import int_from_bytes Jul 26 19:42:11.974465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 19:42:11.975230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 19:42:11.975230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 19:42:11.975641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 19:42:11.975865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 19:42:11.976258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.976587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.976907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.977225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.977553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.977864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.978183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.978500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.978824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.979085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.979399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.979744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-708768-8 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.980068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.980517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.980829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.981151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.981460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.981786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.982094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.982594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.984019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.984019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.984019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.984019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.984383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.984625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.985385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.985385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.985589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.985817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.986230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-708768-8 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.986550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.986863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.987175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.987585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.987961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.988276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.988590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.988908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.989912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.990244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.990581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.990895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.991230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.991542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.991878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.992180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.992498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.993001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.993313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.993565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.993872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.994204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.994527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.994852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.995106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.995355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.995700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.996024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.996334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.996645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.996954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.997262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.997570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.997879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.998187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.998494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.998817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.999135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.999460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:11.999797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.000122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.000553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.000805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.001116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.001464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.001785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.002098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.002421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.002747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.003058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.003366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.003700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.004031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.004356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.004699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.004950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.005258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.005624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.005916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.006188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.006495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.006801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.007102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.007409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.007744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.008052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.008357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.008663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.008971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.009280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.009585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.009889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.010221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.010544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.010858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.011163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.011472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.011806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.012132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.012443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.012744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.013077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.013382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.013687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.014026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.014321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.014625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.014941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.015241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.015548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.015893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.016200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.016504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.017074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.017378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.017681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.017984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.018285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.018586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.018887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.019214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.019670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.019879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.020189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.025045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.025045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.025045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.025045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.025045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.025045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.025045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.025045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.026387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.026387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.026387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.026387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.026387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.026387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.026387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.026387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.027530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.027530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.027530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.027530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.027530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.028287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.028287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.028287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.028700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.028844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.032980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.032980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.032980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.032980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.032980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.032980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.032980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.032980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.034363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.034363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.034363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.034363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.034363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.034363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.034363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.034363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.037320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.037320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.037320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.037320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.037320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.037320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.037320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.037320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.040074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.040074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.040074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.040074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.040074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.040074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.040074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.040074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.041230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.041230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.041230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.041230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.046995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.046995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.046995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.046995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.046995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.046995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.046995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.046995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.048159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.048159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.048159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.048159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.048159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.048159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.049201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.049201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.049201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.049647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.049647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.049920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.050175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.050478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.050785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.051094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.051399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.051793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.052203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.052510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.052816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.053150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.053463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.053768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.054159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.055273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.055273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.055273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.055769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.055924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.056182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.056515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.057003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.057151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.057551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.057866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.058178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.058491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.058813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.059123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.059444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.059784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.060112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.060423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.060744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.061050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.061363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.061709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.062047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.062367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.062691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.063003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.063318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.063649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.063969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.064282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.064596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.064926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.065250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.065554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.065859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.066186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.066498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.066818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.067157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.067472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.067831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.068167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.068480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.068793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.069122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.069432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.069744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.070053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.070358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.070666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.070975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.071288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.071597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.071945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.072237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.072551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.072861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.073167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.073473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.073786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.074113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.074429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.074754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.075079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.075388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.075725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.076050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.076360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.076664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.076968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.077274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.077621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.077933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.078238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.078554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.079152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.079152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.079541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.079809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.080168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.080512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.080876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.081188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.081500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.081827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.082139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.082448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.083498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.083851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.084108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.084422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.084727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.085046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.085366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.086105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.086612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.086937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.087258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.087580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.087929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.088260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.088590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.089091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.089477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.089795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.090106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.090416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.090729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.091036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.091344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.091671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.091985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.092291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.092598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.092903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.093207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.093523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.093828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.094141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.094446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.094774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.095084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.095389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.095718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.096028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.096369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.096677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.097016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.097346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.097599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 19:42:12.098020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.098126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 19:42:12.098214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.098298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.098472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 19:42:12.099225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.099337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 19:42:12.099534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.099813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 19:42:12.099922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.100017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.100160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.100269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.100471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.100565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.100781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.100874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.101086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.101197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.101400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.101492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.101711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.101812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.102020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.102114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.102327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.102420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.102631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.102731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.102939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.103032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.103241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.103340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-708768-8 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.103555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.103669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.103889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.104068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.104193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.104385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.104496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.104707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.104865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.105018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.105120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.105344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.105444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.105656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.105749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.106059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.106205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.106487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.106595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.106698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.106793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.106879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.107056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.107158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.107399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.107507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.107786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.107885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.108087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.108189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.108412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.108507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.108722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.108822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.109024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.109126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.109329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.109431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.109635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.109729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-708768-8 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.109940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.110060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.110241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.110333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.110566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.110668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.110869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.111045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.111186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.111362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.111490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.111705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.111822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.112032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.112125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.112359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.112460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.112671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.112773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.112981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.113073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.113282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.113388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.113584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.113691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.113886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.114029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.114218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.114388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.114516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.114728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.114829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.115082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.115176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.115407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.115514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.115744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.115849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.116056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.116174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.116339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.116493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.116651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.116756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.116942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.117034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.117269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.117372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.117602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.117699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.117857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.117959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.118110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.118233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.118433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.118554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.118758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.118865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.119074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.119168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.119455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.119549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.119789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.119896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.120141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.120241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.120399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.120492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.120704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.120810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.121027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.121127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.121340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.121433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.121652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.121756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.121968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.122060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.122291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.122389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.122601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.122707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.122911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.123003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.123221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.123321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.123534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.123764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.123890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.123990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.124203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.124294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.124512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.124605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.124831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.124924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.125144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.125237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.125458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.125555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.125767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.125856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.126075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.126167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.126395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.126493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.126761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.126867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.126998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.127091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.127304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.127397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.127600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.127751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.127949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.128048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.128254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.128357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.128561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.128654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.128866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.128969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.129176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.129276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.129477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.129570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.129894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.129995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.130271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.130403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.130665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.130757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.130972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.131074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.131285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.131379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.131597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.131723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.131958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.132059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.132273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.132375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.132576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.132676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.132884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.132989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.133210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.133303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.133538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.133638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.133854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.133957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.134165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.134258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.134467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.134572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.134778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.134878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.135099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.135200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.135406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.135499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.135739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.135837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.136071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.136182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.136381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.136481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.136690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.136935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.137047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.137134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.137318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.137411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.137630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.137722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.137952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.138055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.138259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.138396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.138574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.138704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.138897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.139017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.139207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.139310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.139516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.139638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.139847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.139950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.140154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.140259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.140462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.140578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.140767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.140867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.141071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.141163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.141378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.141485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.141947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.142055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.142269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.142369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.142594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.142695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.142901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.142993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.143210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.143302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.143517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.143649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.143859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.143960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 19:42:12.144196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.144287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.144534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.144627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.144884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.144987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.145203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.145818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.146063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.146260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.146455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.146655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.146773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.146998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.147113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.147304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.147405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.147644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.147741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.147989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.148090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.148298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.148396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.148613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.148719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.148928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.149022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.149238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.149331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.149571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.149694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.149842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.149936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.150165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.150272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.150538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.150657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.150794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.150888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.151105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.151210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.151427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.151532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.151774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.151894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.152084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.152195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.152397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.152499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.152701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.152802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.153005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.153098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.153309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.153415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.153612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.153711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.153953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.154054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.154258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.154359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.154577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.154670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.154904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.155002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.155234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.155341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.155543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.155695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.155902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.155998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.156226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.156318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.156536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.156627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.156851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.156943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.157169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.157278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.157467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.157566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.157769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.157872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.158076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.158170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.158379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.158480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.158680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.158819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.158982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.159084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.159288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.159388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.159588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.159721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.159922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.160023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.160225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.160319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.160549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.160668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.160878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.160998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.162321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.162443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.162541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.162641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.162729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.162822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.162909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.162909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.163082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.163261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.163356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.163568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.163713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.163926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.164035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.164241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.164341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.164560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.164662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.164878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.164987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.165191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.165291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.165503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.165603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.165821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.165923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.166135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.166234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.166444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.166536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.166759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.166862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.167072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.167188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.167382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.167498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.167714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.167812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.168023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.168117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.168335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.168428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.168646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.168747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.168959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.169062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.169274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.169505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.169608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.169834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.169927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.170150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.170243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.170460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.170553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.170770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.170862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.171082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.171174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.171394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.171488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.171729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.171825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.172047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.172179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.172357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.172457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.172665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.172757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.172993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.173101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.173314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.173414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.173623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.173722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.173931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.174114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.174240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.174333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.174552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.174644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.174858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.174961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.175165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.175267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.175473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.175573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.175805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.175900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.176114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.176219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.176435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.176578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.176802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.176939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.177239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.177341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.177559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.177673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.177868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.177961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.178183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.178276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.178495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.178601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.178805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.178899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.179114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.179215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.179426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.179528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.179763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.179870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.180089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.180183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.180425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.180536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.180739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.180831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.181049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.181155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.181361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.181466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.181671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.181776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.181994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.182190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.182292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.182509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.182603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.182844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.182944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.183171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.183319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.183498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.183593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.183844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.183939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.184159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.184264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.184479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.184572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.184786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.184878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.185093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.185196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.185407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.185501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.185718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.185810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.186023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.186116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.186343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.186436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.186654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.186750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.186956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.187058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.187266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.187367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.187652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.187813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.187920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.188121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.188215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.188467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.188559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.188783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.188886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.189109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.189202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.189432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.189532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.189748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.189882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.190055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.190156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.190371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.190472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.190673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.190774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.190977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.191069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.191291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.191384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.191602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.191746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.191938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.192033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.192270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.192374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.192580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.192882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.192976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.193183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.193284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.193491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.193584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.193791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.193884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.194113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.194204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.194413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.194506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.194714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.194806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.195015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.195108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.195330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.195431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.195655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.195752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.195960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.196054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.196261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.196354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.196563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.196704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.196871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.196979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.197173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.197262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.197478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.197570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.197782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.197940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.198090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.198191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.198392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.198491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.198698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.198805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.199036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.199128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.199352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.199446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.199677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.199791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.199987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.200086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.200297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.200399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.200645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.200753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.200962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.201056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.201270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.201367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.201591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.201686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.201916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.202023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.202230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.202337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.202546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.202759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.202862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.203094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.203196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.203416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.203509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.203774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.203870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.204101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.204208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.204406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.204508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.204711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.204804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.205015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.205122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.205327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.205427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.205638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.205730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.205945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.206049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.206254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.206347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.206566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.206666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.206870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.206966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.207174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.207267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.207484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.207587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.208337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.208650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.208789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.208960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.209140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.209270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.209472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.209567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.209805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.209899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.210137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.210230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.210468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.210560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.210804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.210904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.211122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.211228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.211437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.211537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.211779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.211892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.212091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.212192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.212402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.212503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.212712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.212813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.213017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.213109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.213329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.213429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.213640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.213780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.213951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.214045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.214252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.214352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.214564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.214665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.214874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.214966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.215183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.215285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.215493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.215587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.215836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.215932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.216146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.216253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.216464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.216558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.216773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.216909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.217099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.217204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.217413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.217542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.217721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.217851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.218030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.218135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.218345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.218568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.218692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.218786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.218997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.219097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.219304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.219434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.219636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.219761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.219942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.220077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.220260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.220390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.220572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.220673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.220878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.220983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.221183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.221277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.221492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.221597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.221796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.221891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.222099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.222194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.222403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.222510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.222706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.222810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.223014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.223114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.223316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.223524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.224205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.224312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.224525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.224635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.224785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.224931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.225089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.225182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.225392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.225495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.225706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.225809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.226009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.226110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.226312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.226413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.226614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.226715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.226917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.227014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.227222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.227315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.227530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.227683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.227872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.227977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.228184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.228287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.228509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.228614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.228824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.228938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.229131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.229233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.229438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.229531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.229748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.229841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.230061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.230169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.230369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.230515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.230675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.230759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.230997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.231098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.231303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.231404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.231640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.231754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.231938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.232115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.232247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.232341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.232554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.232648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.232866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.232970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.233192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.233295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.233515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.233609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.233819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.233913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.234129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.234260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.234435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.234529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.234742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.234836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.235048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.235143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.235354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.235445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.235718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.235831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.236032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.236134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.236340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.236446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.236647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.236740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.236953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.237048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.237260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.237365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.237575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.237676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.237881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.237985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.238188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.238298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.238494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.238593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.238820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.238950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.239164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.239343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.239495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.239589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.239833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.240015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.240160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.240341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.240487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.240669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.240834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.240988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.241149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.241306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.241489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.241620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.241818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.241912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.242132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.242229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.242443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.242543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.242747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.242849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.242986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 19:42:12.243135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.243444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.243801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.244121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.244440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.244765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.245096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.245427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.245770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.246058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.246352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.246671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.246986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.247301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.247627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.247953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.248276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.248594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.248912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.249224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.249541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.249857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.250167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.250498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.250813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.251124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.251582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.251920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.252238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.252548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.252983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.253301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.253618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.253926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.254241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.254556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.255046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.255371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.255703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.256129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.256448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.256764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.257079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.257387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.257696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.258013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.258346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.258658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.258986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.259280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.259619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.259939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.260285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.260684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.260998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.261310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.261727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.262037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.262351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.262677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.263003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.263331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.263664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.263982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.264297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.264623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.264955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.265272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.265589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.265897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.266224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.266551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.267122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.267449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.267896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.268227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.268553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.268878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.269208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.269520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.269831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.270144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.270983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.271331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.271723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.272039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.272359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.272678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.272994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.273305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.273615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.273942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.274251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.274596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.274898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.275227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.275555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.275890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.276217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.276531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.276842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.277151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.277463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.277809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.278121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.278444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.278779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.279117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.279431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.279791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.280123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.280440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.280762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.281090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.281397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.281703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.282014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.282320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.282624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.282930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.283241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.283547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.283878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.284187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.284514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.284823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.285150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.285462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.285771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.286788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.287212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.287567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.287906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.288248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.288575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.288910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.289247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.289563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.289910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.290220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.290544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.290865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.291185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.291505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.291850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.292172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.292486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.292806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.293124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.293443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.293993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.294324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.294645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.294961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.295277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.295596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.295936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.296251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.296565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.296880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.297193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.297531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.297857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.298188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.298528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.298855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.299176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.299493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.299839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.300199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.300517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.300828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.301144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.301484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.301887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.302208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.302520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.302837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.303153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.303466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.303803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.304123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.304439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.304764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.305032 n-d-708768-8 devstack@n-api.service[125963]: INFO dbcounter [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Registered counter for database nova_api Jul 26 19:42:12.305130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.305409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.305724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.306042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.306359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.306883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.307204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.307540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.308011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.308349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.308674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.309003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.309337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.309649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.309959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.310273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.310587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.310895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.311221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.311536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.311870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.312191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.312503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.313040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.313394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.313716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.314047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.341809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.341809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.341809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.341809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.341809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.341809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.341809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.341809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.344861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.344861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.344861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.344861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.344861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.344861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.344861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.344861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.349772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.349772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.349772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.349772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.349772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.349772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.349772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.349772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.355039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.355039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.355039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.355039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.355039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.355039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.355039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.355039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_db.sqlalchemy.engines [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:42:12.356715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.356715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.357893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.358094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writer thread running {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:42:12.358246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.358246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.358246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.358246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.358246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.358246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.358246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.358246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.359260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.359260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.359260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.359260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.359260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.359260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.359260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.359260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.360558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.361847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.362753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.363764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.364241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.364241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.364241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.364241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.364488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.364872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.365193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.365519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.365837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.366154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.366476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.366795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.367130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.367465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.367804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.368140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.368474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.368824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.369150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.369499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.369836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.370152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.370471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.370780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 19:42:12.371025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 19:42:12.394096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.context [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) {{(pid=125963) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 19:42:12.398911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:12.400578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:12.401381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:12.403367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:12.405376 n-d-708768-8 devstack@n-api.service[125963]: INFO dbcounter [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Registered counter for database nova_cell0 Jul 26 19:42:12.409341 n-d-708768-8 devstack@n-api.service[125963]: INFO dbcounter [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Registered counter for database nova_cell1 Jul 26 19:42:12.417346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_db.sqlalchemy.engines [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:42:12.419644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_db.sqlalchemy.engines [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:42:12.424782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writer thread running {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:42:12.426321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writer thread running {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:42:12.434904 n-d-708768-8 devstack@n-api.service[125964]: INFO dbcounter [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Registered counter for database nova_api Jul 26 19:42:12.455729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_db.sqlalchemy.engines [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:42:12.462551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writer thread running {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:42:12.519242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.context [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) {{(pid=125964) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 19:42:12.523693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:12.525311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:12.526122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:12.528154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:12.530150 n-d-708768-8 devstack@n-api.service[125964]: INFO dbcounter [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Registered counter for database nova_cell0 Jul 26 19:42:12.534226 n-d-708768-8 devstack@n-api.service[125964]: INFO dbcounter [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Registered counter for database nova_cell1 Jul 26 19:42:12.543836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_db.sqlalchemy.engines [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:42:12.545564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_db.sqlalchemy.engines [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:42:12.552187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writer thread running {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:42:12.553843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writer thread running {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:42:12.575561 n-d-708768-8 devstack@n-api.service[125963]: INFO dbcounter [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Registered counter for database nova_cell0 Jul 26 19:42:12.585140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_db.sqlalchemy.engines [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:42:12.589674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writer thread running {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:42:12.702625 n-d-708768-8 devstack@n-api.service[125964]: INFO dbcounter [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Registered counter for database nova_cell0 Jul 26 19:42:12.711440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_db.sqlalchemy.engines [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 19:42:12.717156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writer thread running {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 19:42:12.911891 n-d-708768-8 devstack@n-api.service[125963]: WARNING keystonemiddleware.auth_token [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 19:42:12.919258 n-d-708768-8 devstack@n-api.service[125963]: WARNING keystonemiddleware.auth_token [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 19:42:13.037197 n-d-708768-8 devstack@n-api.service[125964]: WARNING keystonemiddleware.auth_token [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 19:42:13.044519 n-d-708768-8 devstack@n-api.service[125964]: WARNING keystonemiddleware.auth_token [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 19:42:13.259319 n-d-708768-8 devstack@n-api.service[125963]: WARNING keystonemiddleware.auth_token [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 19:42:13.265662 n-d-708768-8 devstack@n-api.service[125963]: WARNING keystonemiddleware.auth_token [None req-db102b30-2a5b-4889-8018-6c6b037ec590 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 19:42:13.272019 n-d-708768-8 devstack@n-api.service[125963]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5569b15d49c0 pid: 125963 (default app) Jul 26 19:42:13.385311 n-d-708768-8 devstack@n-api.service[125964]: WARNING keystonemiddleware.auth_token [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 19:42:13.391331 n-d-708768-8 devstack@n-api.service[125964]: WARNING keystonemiddleware.auth_token [None req-8aeec5ba-5cad-49aa-9dc5-a945f16f40da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 19:42:13.397614 n-d-708768-8 devstack@n-api.service[125964]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5569b15d49c0 pid: 125964 (default app) Jul 26 19:42:58.127937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:42:58.130322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:42:58.131444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:42:58.132398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:42:58.221760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:42:58.223076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:42:58.223490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:42:58.225358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:42:59.581061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Calling method '.version_select at 0x7f8765b58940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:42:59.585343 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:42:59.585343 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:42:59.592194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) {{(pid=125964) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 26 19:42:59.593054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:59.593497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:59.657803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:59.659563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:59.693102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:59.693555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:59.711806 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5854318-67c8-4a04-bb5a-ce42d7644a2c tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.494094 Jul 26 19:42:59.713682 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1208 bytes} [Tue Jul 26 19:42:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:42:59.735246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ecc5bb67-7aa7-47da-913c-a618ade3a44f tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1268480231"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:42:59.752793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3852d19d-331a-4c9b-a171-69f911f9a511 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:42:59.778583 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:42:59.778583 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:42:59.781126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3852d19d-331a-4c9b-a171-69f911f9a511 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:59.782560 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:42:59.782560 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:42:59.783279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3852d19d-331a-4c9b-a171-69f911f9a511 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:59.785098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3852d19d-331a-4c9b-a171-69f911f9a511 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:42:59.787149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3852d19d-331a-4c9b-a171-69f911f9a511 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:42:59.787342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-ecc5bb67-7aa7-47da-913c-a618ade3a44f tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Generated uuid 9a68e26b-bf72-4200-8350-299c11fea483 for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:42:59.897739 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3852d19d-331a-4c9b-a171-69f911f9a511 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.773583 Jul 26 19:42:59.899195 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 19:42:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:42:59.954200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ecc5bb67-7aa7-47da-913c-a618ade3a44f tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.222896 Jul 26 19:42:59.955364 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2/3] 10.222.0.58 () {62 vars in 1205 bytes} [Tue Jul 26 19:42:59 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:42:59.966250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bacc0006-6177-4590-ae2a-4a5a9f9056a1 tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-127292254"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:00.110128 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:00.110128 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:00.166447 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bacc0006-6177-4590-ae2a-4a5a9f9056a1 tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.203866 Jul 26 19:43:00.175083 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3/4] 10.222.0.58 () {62 vars in 1210 bytes} [Tue Jul 26 19:42:59 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:43:00.182288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-beaedcd4-f013-4477-8ede-0a7a540f6fdb tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:00.184509 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:00.184509 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:00.194807 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-beaedcd4-f013-4477-8ede-0a7a540f6fdb tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.018091 Jul 26 19:43:00.212277 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 4/5] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Jul 26 19:43:00 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:43:00.224963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2dc9ba2a-083d-4a69-bb41-78fdb6d8f117 tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:00.229641 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:00.229641 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:00.242566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2dc9ba2a-083d-4a69-bb41-78fdb6d8f117 tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:00.243161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2dc9ba2a-083d-4a69-bb41-78fdb6d8f117 tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:00.358685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Calling method '.version_select at 0x7f8765b029d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:00.361800 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:00.361800 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:00.374945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) {{(pid=125963) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 26 19:43:00.376124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:00.376671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:00.426510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:00.427393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:00.506989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:00.508285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:00.548041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:00.550745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:00.567416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:00.567970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:00.575555 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11523730-a239-4d7a-9166-790bd361e5a4 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.675195 Jul 26 19:43:00.576683 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2/6] 10.222.0.58 () {60 vars in 1243 bytes} [Tue Jul 26 19:42:59 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:43:01.128079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bfae41e1-a101-4e4f-8aec-a8fa642e832a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '.version_select at 0x7f87659bb940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:01.129946 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:01.129946 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:01.133458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfae41e1-a101-4e4f-8aec-a8fa642e832a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.134750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfae41e1-a101-4e4f-8aec-a8fa642e832a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.188844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfae41e1-a101-4e4f-8aec-a8fa642e832a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.190359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfae41e1-a101-4e4f-8aec-a8fa642e832a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.218648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfae41e1-a101-4e4f-8aec-a8fa642e832a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.219535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfae41e1-a101-4e4f-8aec-a8fa642e832a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.239584 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bfae41e1-a101-4e4f-8aec-a8fa642e832a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.659328 Jul 26 19:43:01.241138 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3/7] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Jul 26 19:43:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:01.248325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Calling method '.version_select at 0x7f87659bbc10>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:01.252006 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:01.252006 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:01.262180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.262635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.301363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.303514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.353787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.354535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.385777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.386697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.417841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.420571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.434305 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d1a1a7a2-efa7-41f5-adfc-d45480cd4471 tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.191865 Jul 26 19:43:01.436223 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 4/8] 10.222.0.58 () {60 vars in 1222 bytes} [Tue Jul 26 19:43:01 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:43:01.539402 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2dc9ba2a-083d-4a69-bb41-78fdb6d8f117 tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.324522 Jul 26 19:43:01.540943 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 5/9] 10.222.0.58 () {62 vars in 1232 bytes} [Tue Jul 26 19:43:00 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:43:01.554598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e3d9d04-0aef-48f3-b6a2-952b43294ffb tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Calling method '.version_select at 0x7f87640e9a60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:01.561920 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:01.561920 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:01.563679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e3d9d04-0aef-48f3-b6a2-952b43294ffb tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.564241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e3d9d04-0aef-48f3-b6a2-952b43294ffb tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.593341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e3d9d04-0aef-48f3-b6a2-952b43294ffb tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.593835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e3d9d04-0aef-48f3-b6a2-952b43294ffb tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.613062 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e3d9d04-0aef-48f3-b6a2-952b43294ffb tempest-HypervisorAdminV253TestBase-1851574268 tempest-HypervisorAdminV253TestBase-1851574268-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/787d737c-dee4-4ea8-8937-18a3dbd7f545" status: 200 len: 791 microversion: 2.53 time: 0.070412 Jul 26 19:43:01.614154 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 6/10] 10.222.0.58 () {60 vars in 1298 bytes} [Tue Jul 26 19:43:01 2022] GET /compute/v2.1/os-hypervisors/787d737c-dee4-4ea8-8937-18a3dbd7f545 => generated 791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:43:01.625574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-faf6f322-0481-490a-ab60-c1ab69d426ed tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:01.632501 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:01.632501 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:01.654036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf6f322-0481-490a-ab60-c1ab69d426ed tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:01.655794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf6f322-0481-490a-ab60-c1ab69d426ed tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:01.818574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2048300963", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:01.906970 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-faf6f322-0481-490a-ab60-c1ab69d426ed tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.291578 Jul 26 19:43:01.913206 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 7/11] 10.222.0.58 () {62 vars in 1232 bytes} [Tue Jul 26 19:43:01 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:43:01.934285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de276870-732e-4c2c-a511-161af47c2cdb tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:01.937645 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:01.937645 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:01.986755 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de276870-732e-4c2c-a511-161af47c2cdb tempest-AggregatesAdminTestV241-1463347687 tempest-AggregatesAdminTestV241-1463347687-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.065468 Jul 26 19:43:01.989882 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 8/12] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jul 26 19:43:01 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:02.012519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23773c87-6fc2-489e-b7ae-acd4c52575a7 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-349698080", "name": "tempest-test_aggregate-1336443763"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:02.049951 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:02.049951 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:02.051094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-23773c87-6fc2-489e-b7ae-acd4c52575a7 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid ff642394-989b-4f2f-825c-df033a53e19d for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:02.132167 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23773c87-6fc2-489e-b7ae-acd4c52575a7 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.123762 Jul 26 19:43:02.134288 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 9/13] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Jul 26 19:43:02 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:02.145846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e55481be-3b09-4956-b288-ea669a3e0035 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:02.148255 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:02.148255 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:02.174663 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e55481be-3b09-4956-b288-ea669a3e0035 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.032905 Jul 26 19:43:02.178141 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 10/14] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:43:02 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:43:02.189273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38635b96-4209-4c09-8edf-af0c523cb744 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:02.202758 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:02.202758 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:02.211102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38635b96-4209-4c09-8edf-af0c523cb744 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:02.211949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38635b96-4209-4c09-8edf-af0c523cb744 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:02.468988 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38635b96-4209-4c09-8edf-af0c523cb744 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.1 time: 0.283264 Jul 26 19:43:02.482834 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 11/15] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:02.963355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4784c1ee-705f-4f83-ba6c-47cd77a2c974 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-821429197", "id": 1127877565, "os-flavor-access:is_public": "False"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:02.966768 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:02.966768 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:03.011583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4784c1ee-705f-4f83-ba6c-47cd77a2c974 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.532362 Jul 26 19:43:03.012866 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 12/16] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:02 2022] POST /compute/v2.1/flavors => generated 438 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:03.527098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:43:03.603772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1107689164", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "availability_zone": "tempest-test_az-349698080"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:03.657982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:03.658439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:03.659319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:03.659689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:04.052386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:43:04.370130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:43:04.371044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:43:04.372043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:43:04.373024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:43:04.374030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:43:04.380767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:43:04.381185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:43:04.381658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:43:04.382059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:43:04.382465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:43:04.394992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:04.396282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:04.397215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:04.397726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:04.403186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:04.403901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:04.404921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:04.405536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:04.439003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Getting quotas for project faba42986787481ca4f0f0136146df2f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:43:04.440084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Getting quotas for project bce247c23c2a4b80a654a31438a8c1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:43:04.447113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Getting quotas for user c0f3a87454ce4b7c93f7ea400bb41cba and project faba42986787481ca4f0f0136146df2f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:43:04.448852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Getting quotas for user ded76d8b532c4b5c89ba7616eaf8d08d and project bce247c23c2a4b80a654a31438a8c1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:43:04.463198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:43:04.466648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:43:04.473609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:43:04.477278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:43:04.558106 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3f89de3-e709-4491-be8d-d6e5cbeb286e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543894 Jul 26 19:43:04.559868 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 13/17] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:43:04.567687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ca1a16c-5f7d-4224-b0e4-8362608cbe23 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:04.570729 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:04.570729 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:04.620234 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa1cbb30-87bc-45cc-90e2-59d1d8a4a809 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.178142 Jul 26 19:43:04.621236 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 5/18] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:43:05.313911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-34bbae2d-6371-4deb-82f3-6d360c3e7f04 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-854751166", "ram": 512, "vcpus": 1, "disk": 10, "id": 272804545, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:05.318312 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:05.318312 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:05.387301 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-34bbae2d-6371-4deb-82f3-6d360c3e7f04 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.762394 Jul 26 19:43:05.393087 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 6/19] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:04 2022] POST /compute/v2.1/flavors => generated 412 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:05.401208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-941b03d1-0123-4cfa-8977-47d9a4760f21 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:05.407234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-941b03d1-0123-4cfa-8977-47d9a4760f21 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:05.516236 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ca1a16c-5f7d-4224-b0e4-8362608cbe23 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1127877565/action" status: 200 len: 97 microversion: 2.1 time: 0.954886 Jul 26 19:43:05.519590 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 14/20] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:43:04 2022] POST /compute/v2.1/flavors/1127877565/action => generated 97 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:05.531569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61bb8063-a32e-4e67-8100-22dcc2a1cd65 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:05.532697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61bb8063-a32e-4e67-8100-22dcc2a1cd65 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:05.596508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-941b03d1-0123-4cfa-8977-47d9a4760f21 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:05.652175 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-941b03d1-0123-4cfa-8977-47d9a4760f21 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1242 microversion: 2.1 time: 0.250103 Jul 26 19:43:05.670472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61bb8063-a32e-4e67-8100-22dcc2a1cd65 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:05.673113 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 7/21] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:05 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1242 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:05.690056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ed7f37a-58bc-4c3f-bebf-ec8db8cd6907 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:05.699995 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:05.699995 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:05.703287 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61bb8063-a32e-4e67-8100-22dcc2a1cd65 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1214 microversion: 2.1 time: 0.180248 Jul 26 19:43:05.703943 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 15/22] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:05 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:05.731589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66d15609-1539-43bb-8eaa-3acdb109ab7f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:05.761364 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:05.761364 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:05.774404 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ed7f37a-58bc-4c3f-bebf-ec8db8cd6907 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/272804545/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.096713 Jul 26 19:43:05.775703 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 8/23] 10.222.0.58 () {60 vars in 1221 bytes} [Tue Jul 26 19:43:05 2022] POST /compute/v2.1/flavors/272804545/os-extra_specs => generated 66 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:06.395740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3659a66-666d-480b-997d-267864793607 tempest-FlavorsExtraSpecsTestJSON-1861489535 tempest-FlavorsExtraSpecsTestJSON-1861489535-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:06.409721 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3659a66-666d-480b-997d-267864793607 tempest-FlavorsExtraSpecsTestJSON-1861489535 tempest-FlavorsExtraSpecsTestJSON-1861489535-project] 10.222.0.58 "GET /compute/v2.1/flavors/272804545/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.626487 Jul 26 19:43:06.411004 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 9/24] 10.222.0.58 () {58 vars in 1200 bytes} [Tue Jul 26 19:43:05 2022] GET /compute/v2.1/flavors/272804545/os-extra_specs => generated 66 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:06.423457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6626af11-14b4-4936-b167-9efd68aaa980 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:06.471847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6626af11-14b4-4936-b167-9efd68aaa980 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/272804545/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053470 Jul 26 19:43:06.472928 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 10/25] 10.222.0.58 () {60 vars in 1221 bytes} [Tue Jul 26 19:43:06 2022] POST /compute/v2.1/flavors/272804545/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:06.484507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a471703d-ff61-4d9c-91e6-cf008860cf2a tempest-FlavorsExtraSpecsTestJSON-1861489535 tempest-FlavorsExtraSpecsTestJSON-1861489535-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:06.498443 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a471703d-ff61-4d9c-91e6-cf008860cf2a tempest-FlavorsExtraSpecsTestJSON-1861489535 tempest-FlavorsExtraSpecsTestJSON-1861489535-project] 10.222.0.58 "GET /compute/v2.1/flavors/272804545/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.020128 Jul 26 19:43:06.507676 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 11/26] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 19:43:06 2022] GET /compute/v2.1/flavors/272804545/os-extra_specs/hw:numa_nodes => generated 22 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 19:43:06.511744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-20834d81-6de9-404f-9454-1c1edcc89354 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:06.562039 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-20834d81-6de9-404f-9454-1c1edcc89354 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/272804545/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053940 Jul 26 19:43:06.578045 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 12/27] 10.222.0.58 () {60 vars in 1221 bytes} [Tue Jul 26 19:43:06 2022] POST /compute/v2.1/flavors/272804545/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:06.580331 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-66d15609-1539-43bb-8eaa-3acdb109ab7f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project 585076ad585f4682ba0437cbdaa66e45 combination. Jul 26 19:43:06.596273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e01262f-ed91-4240-a6b6-abd038c3d2b4 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:06.607577 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e01262f-ed91-4240-a6b6-abd038c3d2b4 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/272804545/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025654 Jul 26 19:43:06.615532 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 13/28] 10.222.0.58 () {58 vars in 1200 bytes} [Tue Jul 26 19:43:06 2022] GET /compute/v2.1/flavors/272804545/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66d15609-1539-43bb-8eaa-3acdb109ab7f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Request method failure captured: Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/flavors/1127877565/action HTTP/1.1 Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 67 Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPEZaNrmxzmoi6GlXhqyha4EsVu9SafmnuiXTO-dwfYEzOhS79QKTZ7UWTlW-bQhX9mTDxpb_76--W0eIP9bNrTg7I9wc1TwVdPz7SHehQZeDmP_Lb47LD2Hu6QyiF5aKRcKLTHy28JgWk8YHWTsytqMLTDiUquUr0MA8KfzY8oFCg Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 581508c7485f43b6960459ed37d39c77 Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:06.618934 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/581508c7485f43b6960459ed37d39c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/581508c7485f43b6960459ed37d39c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_581508c7485f43b6960459ed37d39c77", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/581508c7485f43b6960459ed37d39c77"}]}] Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 581508c7485f43b6960459ed37d39c77 Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 3d001536f38b4d6da88b12f4569a4238 Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: {"addTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} Jul 26 19:43:06.620157 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: exception: Flavor access already exists for flavor 15 and project 585076ad585f4682ba0437cbdaa66e45 combination. Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '1127877565', 'body': {'addTenantAccess': {'tenant': '585076ad585f4682ba0437cbdaa66e45'}}} Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result.read() Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 19:43:06.620781 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-585076ad585f4682ba0437cbdaa66e45' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 19:43:06.621686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 19:43:06.622867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 19:43:06.623860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result.read() Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-585076ad585f4682ba0437cbdaa66e45' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 19, 43, 6, 565360), 'updated_at': None, 'flavor_id': 15, 'project_id': '585076ad585f4682ba0437cbdaa66e45'}] Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:06.625854 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project 585076ad585f4682ba0437cbdaa66e45 combination. Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:06.627624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project 585076ad585f4682ba0437cbdaa66e45 combination. Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:06.632928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:06.635131 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project 585076ad585f4682ba0437cbdaa66e45 combination. Jul 26 19:43:06.635131 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:06.635131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66d15609-1539-43bb-8eaa-3acdb109ab7f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project 585076ad585f4682ba0437cbdaa66e45 combination. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:06.635131 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66d15609-1539-43bb-8eaa-3acdb109ab7f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1127877565/action" status: 409 len: 152 microversion: 2.1 time: 0.915628 Jul 26 19:43:06.635131 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 16/29] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:43:05 2022] POST /compute/v2.1/flavors/1127877565/action => generated 152 bytes in 917 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:06.637836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a48372f9-6c71-4425-bfa0-c42e37e5da37 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:06.641485 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:06.641485 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:06.653276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b2dd9350-adb0-44ce-bd69-101eebdceae0 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:06.663814 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:06.663814 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:06.695871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a48372f9-6c71-4425-bfa0-c42e37e5da37 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/272804545/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.078656 Jul 26 19:43:06.697003 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 14/30] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:43:06 2022] PUT /compute/v2.1/flavors/272804545/os-extra_specs/hw:numa_nodes => generated 22 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:06.703571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fcd2ef58-8a37-4ee7-8f50-482cb672aa14 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:06.704336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fcd2ef58-8a37-4ee7-8f50-482cb672aa14 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:06.707153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:SAVEPOINT=8,nova_api:RELEASE=8,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:06.809831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fcd2ef58-8a37-4ee7-8f50-482cb672aa14 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:06.823159 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fcd2ef58-8a37-4ee7-8f50-482cb672aa14 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1242 microversion: 2.1 time: 0.123644 Jul 26 19:43:06.848905 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 15/31] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:06 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1242 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:06.855461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-63c186f9-fd5f-4536-bf4e-f1423b19fc98 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:06.866847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-63c186f9-fd5f-4536-bf4e-f1423b19fc98 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/272804545/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016299 Jul 26 19:43:06.869064 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 16/32] 10.222.0.58 () {58 vars in 1200 bytes} [Tue Jul 26 19:43:06 2022] GET /compute/v2.1/flavors/272804545/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:06.891264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fdd0dac7-9bd7-4751-97ad-ea01f480b9d0 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:06.892598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fdd0dac7-9bd7-4751-97ad-ea01f480b9d0 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:06.911882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdd0dac7-9bd7-4751-97ad-ea01f480b9d0 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:06.912664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdd0dac7-9bd7-4751-97ad-ea01f480b9d0 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:06.913662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdd0dac7-9bd7-4751-97ad-ea01f480b9d0 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:06.914981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdd0dac7-9bd7-4751-97ad-ea01f480b9d0 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:07.185028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fdd0dac7-9bd7-4751-97ad-ea01f480b9d0 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:07.206023 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fdd0dac7-9bd7-4751-97ad-ea01f480b9d0 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1239 microversion: 2.1 time: 0.335139 Jul 26 19:43:07.209281 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 17/33] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:06 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1239 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:07.222652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91804cac-7119-464f-8735-00492a7b47ed tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.227266 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:07.227266 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:07.287918 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91804cac-7119-464f-8735-00492a7b47ed tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/272804545/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.075910 Jul 26 19:43:07.290667 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 18/34] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:43:07 2022] DELETE /compute/v2.1/flavors/272804545/os-extra_specs/hw:numa_nodes => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:07.300475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c6ded2a-983a-4bbb-a19d-0ee38eb0aad7 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.341658 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c6ded2a-983a-4bbb-a19d-0ee38eb0aad7 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/272804545/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.046842 Jul 26 19:43:07.343241 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 19/35] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:43:07 2022] DELETE /compute/v2.1/flavors/272804545/os-extra_specs/hw:cpu_policy => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:07.352209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-27d77014-330f-4d75-ac98-6af1fb71742b tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.382701 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-27d77014-330f-4d75-ac98-6af1fb71742b tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/272804545/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034567 Jul 26 19:43:07.387461 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 20/36] 10.222.0.58 () {58 vars in 1200 bytes} [Tue Jul 26 19:43:07 2022] GET /compute/v2.1/flavors/272804545/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:07.401531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-084ee463-0947-4837-a256-d7fee8504ef3 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.402541 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:07.402541 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:07.424645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=11,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:07.437011 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-084ee463-0947-4837-a256-d7fee8504ef3 tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/272804545" status: 202 len: 0 microversion: 2.1 time: 0.038952 Jul 26 19:43:07.440767 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 21/37] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:43:07 2022] DELETE /compute/v2.1/flavors/272804545 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:43:07.449347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de7abbd4-818d-4e9d-b28d-2aaa83d6b3ae tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.494286 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b2dd9350-adb0-44ce-bd69-101eebdceae0 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1127877565/action" status: 200 len: 21 microversion: 2.1 time: 0.857366 Jul 26 19:43:07.497275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 17/38] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:43:06 2022] POST /compute/v2.1/flavors/1127877565/action => generated 21 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:07.515183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21e4e7bc-50bd-4513-9e55-d5832cc4b3a9 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.517790 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:07.517790 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:07.526301 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de7abbd4-818d-4e9d-b28d-2aaa83d6b3ae tempest-FlavorsExtraSpecsTestJSON-327299628 tempest-FlavorsExtraSpecsTestJSON-327299628-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084031 Jul 26 19:43:07.527396 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 22/39] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:07.553642 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21e4e7bc-50bd-4513-9e55-d5832cc4b3a9 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1127877565" status: 202 len: 0 microversion: 2.1 time: 0.051610 Jul 26 19:43:07.566939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-149d1aa0-0429-4c76-801d-d7435068eae0 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.574013 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 18/40] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:43:07 2022] DELETE /compute/v2.1/flavors/1127877565 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:43:07.591228 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-149d1aa0-0429-4c76-801d-d7435068eae0 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031973 Jul 26 19:43:07.592113 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 23/41] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:07.618078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e6bc17fb-b64a-497a-9afe-7ef1d234fc33 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1569115637", "id": 1188256071, "os-flavor-access:is_public": "True"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:07.621087 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:07.621087 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:07.651006 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e6bc17fb-b64a-497a-9afe-7ef1d234fc33 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.036875 Jul 26 19:43:07.661586 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 19/42] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:07 2022] POST /compute/v2.1/flavors => generated 438 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:07.673389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-86a074d2-8eed-4084-b036-4c10e0b62009 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.674616 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:07.674616 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:07.683946 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-86a074d2-8eed-4084-b036-4c10e0b62009 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-86a074d2-8eed-4084-b036-4c10e0b62009 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Request method failure captured: Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/flavors/1188256071/os-flavor-access HTTP/1.1 Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPEZaNrmxzmoi6GlXhqyha4EsVu9SafmnuiXTO-dwfYEzOhS79QKTZ7UWTlW-bQhX9mTDxpb_76--W0eIP9bNrTg7I9wc1TwVdPz7SHehQZeDmP_Lb47LD2Hu6QyiF5aKRcKLTHy28JgWk8YHWTsytqMLTDiUquUr0MA8KfzY8oFCg Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 581508c7485f43b6960459ed37d39c77 Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:07.686432 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/581508c7485f43b6960459ed37d39c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/581508c7485f43b6960459ed37d39c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_581508c7485f43b6960459ed37d39c77", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/581508c7485f43b6960459ed37d39c77"}]}] Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 581508c7485f43b6960459ed37d39c77 Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 3d001536f38b4d6da88b12f4569a4238 Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: exception: Access list not available for public flavors. Jul 26 19:43:07.687577 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'flavor_id': '1188256071'} Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 26 19:43:07.688229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:07.691374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-86a074d2-8eed-4084-b036-4c10e0b62009 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:07.693718 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-86a074d2-8eed-4084-b036-4c10e0b62009 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1188256071/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.023886 Jul 26 19:43:07.704111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aead0bda-2af3-4659-8021-25d09ab7816f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.711174 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 24/43] 10.222.0.58 () {58 vars in 1209 bytes} [Tue Jul 26 19:43:07 2022] GET /compute/v2.1/flavors/1188256071/os-flavor-access => generated 91 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:07.728203 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aead0bda-2af3-4659-8021-25d09ab7816f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1188256071" status: 202 len: 0 microversion: 2.1 time: 0.028626 Jul 26 19:43:07.729166 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 20/44] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:43:07 2022] DELETE /compute/v2.1/flavors/1188256071 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:43:07.750176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b531080-6a7f-4b60-8dc9-28081b4ba7e3 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.816776 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b531080-6a7f-4b60-8dc9-28081b4ba7e3 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080930 Jul 26 19:43:07.835815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 25/45] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:07.838990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a9b28e06-ad7b-4486-9628-7c87b8da5a47 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-88411748", "id": 1991192132, "os-flavor-access:is_public": "False"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:07.851830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1c1ccc03-8945-48eb-a485-c789ae20594e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:07.856789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1c1ccc03-8945-48eb-a485-c789ae20594e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:07.868696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc03-8945-48eb-a485-c789ae20594e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:07.874009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc03-8945-48eb-a485-c789ae20594e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:07.875006 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a9b28e06-ad7b-4486-9628-7c87b8da5a47 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.037832 Jul 26 19:43:07.875142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc03-8945-48eb-a485-c789ae20594e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:07.875680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c1ccc03-8945-48eb-a485-c789ae20594e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:07.890863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 21/46] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:07 2022] POST /compute/v2.1/flavors => generated 437 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:43:07.966464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1c1ccc03-8945-48eb-a485-c789ae20594e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:07.976816 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1c1ccc03-8945-48eb-a485-c789ae20594e tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1242 microversion: 2.1 time: 0.134943 Jul 26 19:43:07.990532 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 26/47] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:07 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:08.230188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7cb1065-85fc-41e9-9677-1a61cf695bbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:08.235864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e7cb1065-85fc-41e9-9677-1a61cf695bbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:08.246790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7cb1065-85fc-41e9-9677-1a61cf695bbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:08.250554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7cb1065-85fc-41e9-9677-1a61cf695bbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:08.253758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7cb1065-85fc-41e9-9677-1a61cf695bbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:08.255869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7cb1065-85fc-41e9-9677-1a61cf695bbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:08.424050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e7cb1065-85fc-41e9-9677-1a61cf695bbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:08.437131 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7cb1065-85fc-41e9-9677-1a61cf695bbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1293 microversion: 2.1 time: 0.210788 Jul 26 19:43:08.440684 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 27/48] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:08 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1293 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:08.496322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-392a8b0c-1deb-4c60-abf1-c3ef480b2c99 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:08.503600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-392a8b0c-1deb-4c60-abf1-c3ef480b2c99 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '8effc722e3444978aafa129b2ec35341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585076ad585f4682ba0437cbdaa66e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-392a8b0c-1deb-4c60-abf1-c3ef480b2c99 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] Request method failure captured: Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/flavors/1991192132/action HTTP/1.1 Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 67 Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPBPuM8AxR1-M7KXm0yAAsMRMs_WNvWZdh5CpSaHAfrxaSuiD41LklJqY5pLUgulq3P4Zjgm591To88Vg7k7tUGQt8WOksnFwYI2_XU8vv0bopDErvU_NkYOknMhZ57Q-9Ts1VjydhRQrUYAzapc1Y3zBRAcSZ1zJcfyVdKu6uG2FE Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 585076ad585f4682ba0437cbdaa66e45 Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-188616367 Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:08.514242 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/585076ad585f4682ba0437cbdaa66e45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/585076ad585f4682ba0437cbdaa66e45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_585076ad585f4682ba0437cbdaa66e45", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/585076ad585f4682ba0437cbdaa66e45"}]}] Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-188616367 Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 585076ad585f4682ba0437cbdaa66e45 Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-188616367 Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FlavorsAccessNegativeTestJSON-188616367-project Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8effc722e3444978aafa129b2ec35341 Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-188616367-project Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: {"addTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} Jul 26 19:43:08.515387 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '1991192132', 'body': {'addTenantAccess': {'tenant': '585076ad585f4682ba0437cbdaa66e45'}}} Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:08.516069 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 19:43:08.516976 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:08.523265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-392a8b0c-1deb-4c60-abf1-c3ef480b2c99 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:08.528131 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-392a8b0c-1deb-4c60-abf1-c3ef480b2c99 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] 10.222.0.58 "POST /compute/v2.1/flavors/1991192132/action" status: 403 len: 130 microversion: 2.1 time: 0.635087 Jul 26 19:43:08.528729 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 22/49] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:43:07 2022] POST /compute/v2.1/flavors/1991192132/action => generated 130 bytes in 637 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:08.538892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8cce5a7e-602e-4097-9f85-dcb03b2dde71 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:08.539287 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:08.539287 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:08.597710 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8cce5a7e-602e-4097-9f85-dcb03b2dde71 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1991192132" status: 202 len: 0 microversion: 2.1 time: 0.064455 Jul 26 19:43:08.607996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5f2fc14-b38e-4bfc-abb5-8a47314b8e81 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:08.612589 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 28/50] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:43:08 2022] DELETE /compute/v2.1/flavors/1991192132 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:43:08.668882 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5f2fc14-b38e-4bfc-abb5-8a47314b8e81 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064968 Jul 26 19:43:08.670699 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 23/51] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:08.689218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a7c3c05-2914-4207-810b-bc5d803d100a tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1173557152", "id": 1091553328, "os-flavor-access:is_public": "False"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:08.693360 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:08.693360 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:08.718339 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a7c3c05-2914-4207-810b-bc5d803d100a tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.032706 Jul 26 19:43:08.734978 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 29/52] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:08 2022] POST /compute/v2.1/flavors => generated 439 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:08.741561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-867f519f-3ff8-47c4-87e2-a1ee8bb50c83 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:08.998243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91284729-879a-41aa-a15f-9820c77ca3ea tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:08.999304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-91284729-879a-41aa-a15f-9820c77ca3ea tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:09.013401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91284729-879a-41aa-a15f-9820c77ca3ea tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:09.017933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91284729-879a-41aa-a15f-9820c77ca3ea tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:09.020989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91284729-879a-41aa-a15f-9820c77ca3ea tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:09.024626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91284729-879a-41aa-a15f-9820c77ca3ea tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:09.387061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-91284729-879a-41aa-a15f-9820c77ca3ea tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:09.406963 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91284729-879a-41aa-a15f-9820c77ca3ea tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1298 microversion: 2.1 time: 0.412851 Jul 26 19:43:09.431810 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 30/53] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:08 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1298 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:09.453363 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-867f519f-3ff8-47c4-87e2-a1ee8bb50c83 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1091553328/action" status: 200 len: 97 microversion: 2.1 time: 0.720033 Jul 26 19:43:09.454586 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 24/54] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:43:08 2022] POST /compute/v2.1/flavors/1091553328/action => generated 97 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:09.464415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9cf01062-1a5b-4b86-bcb5-21bf8e7c198d tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:09.465664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9cf01062-1a5b-4b86-bcb5-21bf8e7c198d tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:09.485192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cf01062-1a5b-4b86-bcb5-21bf8e7c198d tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:09.485504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9b6c13e2-81dc-4193-9ab6-295a5186f241 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:09.489406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cf01062-1a5b-4b86-bcb5-21bf8e7c198d tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:09.491491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cf01062-1a5b-4b86-bcb5-21bf8e7c198d tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:09.494685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cf01062-1a5b-4b86-bcb5-21bf8e7c198d tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:09.499935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9b6c13e2-81dc-4193-9ab6-295a5186f241 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '8effc722e3444978aafa129b2ec35341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585076ad585f4682ba0437cbdaa66e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9b6c13e2-81dc-4193-9ab6-295a5186f241 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] Request method failure captured: Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/flavors/1091553328/action HTTP/1.1 Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 70 Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPBPuM8AxR1-M7KXm0yAAsMRMs_WNvWZdh5CpSaHAfrxaSuiD41LklJqY5pLUgulq3P4Zjgm591To88Vg7k7tUGQt8WOksnFwYI2_XU8vv0bopDErvU_NkYOknMhZ57Q-9Ts1VjydhRQrUYAzapc1Y3zBRAcSZ1zJcfyVdKu6uG2FE Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 585076ad585f4682ba0437cbdaa66e45 Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-188616367 Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:09.502640 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/585076ad585f4682ba0437cbdaa66e45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/585076ad585f4682ba0437cbdaa66e45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_585076ad585f4682ba0437cbdaa66e45", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/585076ad585f4682ba0437cbdaa66e45"}]}] Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-188616367 Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 585076ad585f4682ba0437cbdaa66e45 Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-188616367 Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FlavorsAccessNegativeTestJSON-188616367-project Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8effc722e3444978aafa129b2ec35341 Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-188616367-project Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: {"removeTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} Jul 26 19:43:09.503961 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '1091553328', 'body': {'removeTenantAccess': {'tenant': '585076ad585f4682ba0437cbdaa66e45'}}} Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can( Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:09.505238 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 19:43:09.506395 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:09.510116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9b6c13e2-81dc-4193-9ab6-295a5186f241 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:09.512863 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9b6c13e2-81dc-4193-9ab6-295a5186f241 tempest-FlavorsAccessNegativeTestJSON-188616367 tempest-FlavorsAccessNegativeTestJSON-188616367-project] 10.222.0.58 "POST /compute/v2.1/flavors/1091553328/action" status: 403 len: 133 microversion: 2.1 time: 0.040592 Jul 26 19:43:09.514199 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 25/55] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:43:09 2022] POST /compute/v2.1/flavors/1091553328/action => generated 133 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:09.540546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c6111d2d-bd79-401b-b450-fa0410260386 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "585076ad585f4682ba0437cbdaa66e45"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:09.766085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9cf01062-1a5b-4b86-bcb5-21bf8e7c198d tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:09.774857 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9cf01062-1a5b-4b86-bcb5-21bf8e7c198d tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1293 microversion: 2.1 time: 0.317756 Jul 26 19:43:09.775445 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 31/56] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:09 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1293 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:10.443631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e493d750-f840-4218-a629-2736e2a98f29 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:10.444398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e493d750-f840-4218-a629-2736e2a98f29 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:10.451519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e493d750-f840-4218-a629-2736e2a98f29 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:10.452333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e493d750-f840-4218-a629-2736e2a98f29 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:10.453963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e493d750-f840-4218-a629-2736e2a98f29 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:10.454725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e493d750-f840-4218-a629-2736e2a98f29 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:10.470369 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c6111d2d-bd79-401b-b450-fa0410260386 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1091553328/action" status: 200 len: 21 microversion: 2.1 time: 0.946322 Jul 26 19:43:10.486474 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 26/57] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:43:09 2022] POST /compute/v2.1/flavors/1091553328/action => generated 21 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:10.509663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-73a510c2-82ff-4c63-8ba5-edaf969c1370 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:10.578125 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-73a510c2-82ff-4c63-8ba5-edaf969c1370 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1091553328" status: 202 len: 0 microversion: 2.1 time: 0.083862 Jul 26 19:43:10.584951 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 27/58] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:43:10 2022] DELETE /compute/v2.1/flavors/1091553328 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:43:10.592754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-044936e1-6074-4385-97a1-7f38f0af39f3 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:10.627878 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-044936e1-6074-4385-97a1-7f38f0af39f3 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040662 Jul 26 19:43:10.652608 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 28/59] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:10.674857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1ab89c5-0af0-49a3-9fec-a3d1f36ca77f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-408573531", "id": 662193240, "os-flavor-access:is_public": "False"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:10.725135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f1ab89c5-0af0-49a3-9fec-a3d1f36ca77f tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.061325 Jul 26 19:43:10.727174 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 29/60] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:10 2022] POST /compute/v2.1/flavors => generated 435 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:10.743375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a29a5bd8-e097-4ff0-a210-d080e1d6b325 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "567e1acada6246be90bd1e80b2d3020b"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:10.930515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e493d750-f840-4218-a629-2736e2a98f29 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:10.952099 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e493d750-f840-4218-a629-2736e2a98f29 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1296 microversion: 2.1 time: 0.513895 Jul 26 19:43:10.953850 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 32/61] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:10 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1296 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:10.960658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14936f28-2026-4819-ad46-37122ddb8b84 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:10.963247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14936f28-2026-4819-ad46-37122ddb8b84 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:10.993043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14936f28-2026-4819-ad46-37122ddb8b84 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:10.993605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14936f28-2026-4819-ad46-37122ddb8b84 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:10.995290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14936f28-2026-4819-ad46-37122ddb8b84 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:10.998954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14936f28-2026-4819-ad46-37122ddb8b84 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:11.491442 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-a29a5bd8-e097-4ff0-a210-d080e1d6b325 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] HTTP exception thrown: Flavor access not found for 20 / 567e1acada6246be90bd1e80b2d3020b combination. Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a29a5bd8-e097-4ff0-a210-d080e1d6b325 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Request method failure captured: Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/flavors/662193240/action HTTP/1.1 Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 70 Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPEZaNrmxzmoi6GlXhqyha4EsVu9SafmnuiXTO-dwfYEzOhS79QKTZ7UWTlW-bQhX9mTDxpb_76--W0eIP9bNrTg7I9wc1TwVdPz7SHehQZeDmP_Lb47LD2Hu6QyiF5aKRcKLTHy28JgWk8YHWTsytqMLTDiUquUr0MA8KfzY8oFCg Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 581508c7485f43b6960459ed37d39c77 Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:11.499685 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/581508c7485f43b6960459ed37d39c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/581508c7485f43b6960459ed37d39c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_581508c7485f43b6960459ed37d39c77", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/581508c7485f43b6960459ed37d39c77"}]}] Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 581508c7485f43b6960459ed37d39c77 Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-546707648 Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 3d001536f38b4d6da88b12f4569a4238 Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: {"removeTenantAccess": {"tenant": "567e1acada6246be90bd1e80b2d3020b"}} Jul 26 19:43:11.500893 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: exception: Flavor access not found for 20 / 567e1acada6246be90bd1e80b2d3020b combination. Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '662193240', 'body': {'removeTenantAccess': {'tenant': '567e1acada6246be90bd1e80b2d3020b'}}} Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 26 19:43:11.501513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / 567e1acada6246be90bd1e80b2d3020b combination. Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / 567e1acada6246be90bd1e80b2d3020b combination. Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:11.502470 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:11.503573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:11.503573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:11.503573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:11.503573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:11.503573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / 567e1acada6246be90bd1e80b2d3020b combination. Jul 26 19:43:11.503573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:11.503573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a29a5bd8-e097-4ff0-a210-d080e1d6b325 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Returning 404 to user: Flavor access not found for 20 / 567e1acada6246be90bd1e80b2d3020b combination. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:11.508525 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a29a5bd8-e097-4ff0-a210-d080e1d6b325 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/662193240/action" status: 404 len: 124 microversion: 2.1 time: 0.770324 Jul 26 19:43:11.510355 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 30/62] 10.222.0.58 () {60 vars in 1197 bytes} [Tue Jul 26 19:43:10 2022] POST /compute/v2.1/flavors/662193240/action => generated 124 bytes in 775 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:11.537071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-906b4155-e446-464c-a553-a50f97418c29 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:11.625971 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-906b4155-e446-464c-a553-a50f97418c29 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/662193240" status: 202 len: 0 microversion: 2.1 time: 0.108613 Jul 26 19:43:11.630696 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 31/63] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:43:11 2022] DELETE /compute/v2.1/flavors/662193240 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:43:11.648685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-874d55db-ef53-4909-9986-e430583d0789 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:11.731960 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-874d55db-ef53-4909-9986-e430583d0789 tempest-FlavorsAccessNegativeTestJSON-546707648 tempest-FlavorsAccessNegativeTestJSON-546707648-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092333 Jul 26 19:43:11.736559 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 32/64] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:11.984947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bb5f7107-8295-4ac7-a140-77fcfea9c3af tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:11.986436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bb5f7107-8295-4ac7-a140-77fcfea9c3af tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:12.005710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb5f7107-8295-4ac7-a140-77fcfea9c3af tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:12.009526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb5f7107-8295-4ac7-a140-77fcfea9c3af tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:12.013419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb5f7107-8295-4ac7-a140-77fcfea9c3af tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:12.015842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb5f7107-8295-4ac7-a140-77fcfea9c3af tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:12.431268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14936f28-2026-4819-ad46-37122ddb8b84 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:12.467368 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14936f28-2026-4819-ad46-37122ddb8b84 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 1.505237 Jul 26 19:43:12.470709 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 33/65] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:10 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:12.708396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bb5f7107-8295-4ac7-a140-77fcfea9c3af tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:12.764935 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bb5f7107-8295-4ac7-a140-77fcfea9c3af tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1296 microversion: 2.1 time: 0.769948 Jul 26 19:43:12.789204 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 33/66] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:11 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1296 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:13.496402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-35512e39-bf3b-4041-a1bf-9e7d592e9f78 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:13.497406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-35512e39-bf3b-4041-a1bf-9e7d592e9f78 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:13.520852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35512e39-bf3b-4041-a1bf-9e7d592e9f78 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:13.524846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35512e39-bf3b-4041-a1bf-9e7d592e9f78 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:13.526441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35512e39-bf3b-4041-a1bf-9e7d592e9f78 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:13.528775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35512e39-bf3b-4041-a1bf-9e7d592e9f78 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:14.214999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f60c50ab-bdb8-4f37-9a1b-22a80f208b6e tempest-InstanceUsageAuditLogTestJSON-217387191 tempest-InstanceUsageAuditLogTestJSON-217387191-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:14.218114 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:14.218114 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:14.264294 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f60c50ab-bdb8-4f37-9a1b-22a80f208b6e tempest-InstanceUsageAuditLogTestJSON-217387191 tempest-InstanceUsageAuditLogTestJSON-217387191-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26 19:43:13" status: 200 len: 318 microversion: 2.1 time: 0.976679 Jul 26 19:43:14.265319 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 34/67] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 19:43:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2019%3A43%3A13 => generated 318 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:14.420096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:14.422433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:14.560245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1581b98c-e8d8-411c-a33e-0d51a32e3c9c tempest-AZAdminNegativeTestJSON-156064415 tempest-AZAdminNegativeTestJSON-156064415-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:14.561021 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:14.561021 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:14.561889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1581b98c-e8d8-411c-a33e-0d51a32e3c9c tempest-AZAdminNegativeTestJSON-156064415 tempest-AZAdminNegativeTestJSON-156064415-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'a52cc15acc1041688581726608131637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39c387814f6479bb00b2bc6a4cdb7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1581b98c-e8d8-411c-a33e-0d51a32e3c9c tempest-AZAdminNegativeTestJSON-156064415 tempest-AZAdminNegativeTestJSON-156064415-project] Request method failure captured: Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPNpzUrxr5QcBt1OrjHQzjuartkqaODIZ4pCjoqp-qDqjvKCGJd7DdaPtr2CahqAx4IvbZhINJMLUncLVz1JvAHfw2q7HMMl3_zWnpNJuGqr04CwIdZfg6rmCOWho1Rxr0f8mNZphxmPGk5oDe_1eWQEhknuKw3in_qiHcJzg2RpSY Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: b39c387814f6479bb00b2bc6a4cdb7c9 Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AZAdminNegativeTestJSON-156064415 Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:14.568640 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b39c387814f6479bb00b2bc6a4cdb7c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b39c387814f6479bb00b2bc6a4cdb7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b39c387814f6479bb00b2bc6a4cdb7c9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b39c387814f6479bb00b2bc6a4cdb7c9"}]}] Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AZAdminNegativeTestJSON-156064415 Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: b39c387814f6479bb00b2bc6a4cdb7c9 Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-156064415 Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AZAdminNegativeTestJSON-156064415-project Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a52cc15acc1041688581726608131637 Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AZAdminNegativeTestJSON-156064415-project Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 19:43:14.569994 n-d-708768-8 devstack@n-api.service[125963]: action_args: {} Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:14.570745 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:14.572049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1581b98c-e8d8-411c-a33e-0d51a32e3c9c tempest-AZAdminNegativeTestJSON-156064415 tempest-AZAdminNegativeTestJSON-156064415-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:14.572975 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1581b98c-e8d8-411c-a33e-0d51a32e3c9c tempest-AZAdminNegativeTestJSON-156064415 tempest-AZAdminNegativeTestJSON-156064415-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.303724 Jul 26 19:43:14.572975 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 35/68] 10.222.0.58 () {58 vars in 1185 bytes} [Tue Jul 26 19:43:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 305 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:14.592076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a9ee692b-e34c-43b3-9b97-955f8ca0dc8a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:14.593306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a9ee692b-e34c-43b3-9b97-955f8ca0dc8a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:14.624335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9ee692b-e34c-43b3-9b97-955f8ca0dc8a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:14.627078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9ee692b-e34c-43b3-9b97-955f8ca0dc8a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:14.641782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9ee692b-e34c-43b3-9b97-955f8ca0dc8a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:14.642339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9ee692b-e34c-43b3-9b97-955f8ca0dc8a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:15.288158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-35512e39-bf3b-4041-a1bf-9e7d592e9f78 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:15.298180 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-35512e39-bf3b-4041-a1bf-9e7d592e9f78 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 1.806669 Jul 26 19:43:15.298778 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 34/69] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:13 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:15.356538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34619392-e715-4794-8b89-621c7a167768 tempest-InstanceUsageAuditLogTestJSON-217387191 tempest-InstanceUsageAuditLogTestJSON-217387191-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:15.358673 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:15.358673 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:15.425830 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34619392-e715-4794-8b89-621c7a167768 tempest-InstanceUsageAuditLogTestJSON-217387191 tempest-InstanceUsageAuditLogTestJSON-217387191-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.097059 Jul 26 19:43:15.440042 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 35/70] 10.222.0.58 () {58 vars in 1185 bytes} [Tue Jul 26 19:43:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:15.814487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0ee3f863-ea36-4462-955e-86a2173fe16c req-a32d3f22-3d07-41d5-9c89-a6bf2a0a45a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7887d20-6f23-42b2-9039-ed2f8cb81d65", "tag": "d3d7dc1a-20fa-4fa1-ba45-8a1ca4dd2c6c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:15.849966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0ee3f863-ea36-4462-955e-86a2173fe16c req-a32d3f22-3d07-41d5-9c89-a6bf2a0a45a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:15.850506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0ee3f863-ea36-4462-955e-86a2173fe16c req-a32d3f22-3d07-41d5-9c89-a6bf2a0a45a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:15.915754 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0ee3f863-ea36-4462-955e-86a2173fe16c req-a32d3f22-3d07-41d5-9c89-a6bf2a0a45a5 service nova] Creating event network-changed:d3d7dc1a-20fa-4fa1-ba45-8a1ca4dd2c6c for instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 on n-h1-708768-8 Jul 26 19:43:15.918150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0ee3f863-ea36-4462-955e-86a2173fe16c req-a32d3f22-3d07-41d5-9c89-a6bf2a0a45a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:43:15.919390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81d8a8e5-3317-44de-b4c5-722f1348b69a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:15.921381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81d8a8e5-3317-44de-b4c5-722f1348b69a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:15.922943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81d8a8e5-3317-44de-b4c5-722f1348b69a None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:15.924927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81d8a8e5-3317-44de-b4c5-722f1348b69a None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:15.937916 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.compute.rpcapi [None req-81d8a8e5-3317-44de-b4c5-722f1348b69a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 19:43:15.938821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81d8a8e5-3317-44de-b4c5-722f1348b69a None None] Releasing lock "compute-rpcapi-router" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:43:15.976787 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-81d8a8e5-3317-44de-b4c5-722f1348b69a None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.532200 Jul 26 19:43:15.976981 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 36/71] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:16.334785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45bd90da-1455-4e83-829e-b214fc63b5a9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:16.335798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45bd90da-1455-4e83-829e-b214fc63b5a9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:16.353131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45bd90da-1455-4e83-829e-b214fc63b5a9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:16.353619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45bd90da-1455-4e83-829e-b214fc63b5a9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:16.368441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45bd90da-1455-4e83-829e-b214fc63b5a9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:16.380808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45bd90da-1455-4e83-829e-b214fc63b5a9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:16.406146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a9ee692b-e34c-43b3-9b97-955f8ca0dc8a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:16.424106 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a9ee692b-e34c-43b3-9b97-955f8ca0dc8a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 1.851541 Jul 26 19:43:16.428410 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 36/72] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:14 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:17.225696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45bd90da-1455-4e83-829e-b214fc63b5a9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:17.252357 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45bd90da-1455-4e83-829e-b214fc63b5a9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.933461 Jul 26 19:43:17.253881 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 37/73] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:16 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:17.447055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a86b3abe-6e36-47d1-9dc4-d92eba0220e7 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:17.447804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a86b3abe-6e36-47d1-9dc4-d92eba0220e7 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:17.466909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a86b3abe-6e36-47d1-9dc4-d92eba0220e7 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:17.467409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a86b3abe-6e36-47d1-9dc4-d92eba0220e7 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:17.469242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a86b3abe-6e36-47d1-9dc4-d92eba0220e7 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:17.470804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a86b3abe-6e36-47d1-9dc4-d92eba0220e7 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:18.174474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a86b3abe-6e36-47d1-9dc4-d92eba0220e7 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:18.226983 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a86b3abe-6e36-47d1-9dc4-d92eba0220e7 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.780298 Jul 26 19:43:18.244186 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 37/74] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:17 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:18.279029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba25a874-f9b4-46d8-82e2-f5045deb9a0f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:18.279742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba25a874-f9b4-46d8-82e2-f5045deb9a0f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:18.288388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba25a874-f9b4-46d8-82e2-f5045deb9a0f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:18.288844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba25a874-f9b4-46d8-82e2-f5045deb9a0f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:18.293419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba25a874-f9b4-46d8-82e2-f5045deb9a0f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:18.297074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba25a874-f9b4-46d8-82e2-f5045deb9a0f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:18.992059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba25a874-f9b4-46d8-82e2-f5045deb9a0f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:19.007296 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba25a874-f9b4-46d8-82e2-f5045deb9a0f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.730908 Jul 26 19:43:19.013275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 38/75] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:18 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:19.265410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9f98dd5d-34da-4e20-ac7a-49c1d16d6b1c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:19.265410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9f98dd5d-34da-4e20-ac7a-49c1d16d6b1c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:19.274470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f98dd5d-34da-4e20-ac7a-49c1d16d6b1c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:19.274927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f98dd5d-34da-4e20-ac7a-49c1d16d6b1c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:19.278314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f98dd5d-34da-4e20-ac7a-49c1d16d6b1c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:19.278765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f98dd5d-34da-4e20-ac7a-49c1d16d6b1c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:20.043071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c26eaae-df4a-44f1-a52d-b4346e36caa8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:20.044339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c26eaae-df4a-44f1-a52d-b4346e36caa8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:20.055948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c26eaae-df4a-44f1-a52d-b4346e36caa8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:20.058651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c26eaae-df4a-44f1-a52d-b4346e36caa8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:20.060410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c26eaae-df4a-44f1-a52d-b4346e36caa8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:20.060489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c26eaae-df4a-44f1-a52d-b4346e36caa8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:20.526739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c26eaae-df4a-44f1-a52d-b4346e36caa8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:20.546922 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c26eaae-df4a-44f1-a52d-b4346e36caa8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.509668 Jul 26 19:43:20.568708 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 39/76] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:20 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:20.875946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9f98dd5d-34da-4e20-ac7a-49c1d16d6b1c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:20.887043 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9f98dd5d-34da-4e20-ac7a-49c1d16d6b1c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 1.630475 Jul 26 19:43:20.891112 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 38/77] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:19 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:21.174477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2ffa51b9-cbef-4241-a39c-d270faab3313 req-fcf5fd26-74c2-4097-a52a-823a7f44e7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa4d676-0350-4966-98db-fdf47eccbf14", "tag": "83f1aae3-3089-4513-9f52-28d010801468"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:21.189604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2ffa51b9-cbef-4241-a39c-d270faab3313 req-fcf5fd26-74c2-4097-a52a-823a7f44e7ac service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:21.190074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2ffa51b9-cbef-4241-a39c-d270faab3313 req-fcf5fd26-74c2-4097-a52a-823a7f44e7ac service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:21.213763 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2ffa51b9-cbef-4241-a39c-d270faab3313 req-fcf5fd26-74c2-4097-a52a-823a7f44e7ac service nova] Creating event network-changed:83f1aae3-3089-4513-9f52-28d010801468 for instance daa4d676-0350-4966-98db-fdf47eccbf14 on n-h1-708768-8 Jul 26 19:43:21.219477 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2ffa51b9-cbef-4241-a39c-d270faab3313 req-fcf5fd26-74c2-4097-a52a-823a7f44e7ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.648812 Jul 26 19:43:21.220619 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 40/78] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:21.572482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f92ce646-a38e-421b-b078-78ab256cc7be tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:21.573371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f92ce646-a38e-421b-b078-78ab256cc7be tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:21.587398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f92ce646-a38e-421b-b078-78ab256cc7be tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:21.588176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f92ce646-a38e-421b-b078-78ab256cc7be tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:21.589153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f92ce646-a38e-421b-b078-78ab256cc7be tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:21.589741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f92ce646-a38e-421b-b078-78ab256cc7be tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:21.950450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f92ce646-a38e-421b-b078-78ab256cc7be tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:21.962536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f92ce646-a38e-421b-b078-78ab256cc7be tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.390417 Jul 26 19:43:21.963430 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 39/79] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:21 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:21.970397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc94f0d5-5020-428d-bdb5-53c8fa3a9ffc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:21.980410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc94f0d5-5020-428d-bdb5-53c8fa3a9ffc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:21.990909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc94f0d5-5020-428d-bdb5-53c8fa3a9ffc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:21.991538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc94f0d5-5020-428d-bdb5-53c8fa3a9ffc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:21.996560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc94f0d5-5020-428d-bdb5-53c8fa3a9ffc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:21.997201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc94f0d5-5020-428d-bdb5-53c8fa3a9ffc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:22.038139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:22.108229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee394ded-9cc9-42aa-90af-68b04132b449 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Calling method '.version_select at 0x7f8757d299d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:22.110154 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:22.110154 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:22.111448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee394ded-9cc9-42aa-90af-68b04132b449 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:22.111926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee394ded-9cc9-42aa-90af-68b04132b449 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:22.115102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee394ded-9cc9-42aa-90af-68b04132b449 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:22.118434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee394ded-9cc9-42aa-90af-68b04132b449 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:22.169228 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ee394ded-9cc9-42aa-90af-68b04132b449 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.548329 Jul 26 19:43:22.170794 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 41/80] 10.222.0.58 () {58 vars in 1128 bytes} [Tue Jul 26 19:43:21 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:43:22.185943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c0142477-6021-41e2-87bf-c52fa501609c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Calling method '.version_select at 0x7f8757d293a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:22.189749 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:22.189749 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:22.191429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0142477-6021-41e2-87bf-c52fa501609c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:22.192464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0142477-6021-41e2-87bf-c52fa501609c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:22.193627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0142477-6021-41e2-87bf-c52fa501609c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:22.194346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0142477-6021-41e2-87bf-c52fa501609c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:22.235025 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c0142477-6021-41e2-87bf-c52fa501609c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.055681 Jul 26 19:43:22.237777 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 42/81] 10.222.0.58 () {58 vars in 1139 bytes} [Tue Jul 26 19:43:22 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:22.249607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e1eedb46-5d3f-4f3e-8fce-5dde8c572303 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Calling method '.version_select at 0x7f8757c76160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:22.252125 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:22.252125 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:22.253319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1eedb46-5d3f-4f3e-8fce-5dde8c572303 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:22.253777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1eedb46-5d3f-4f3e-8fce-5dde8c572303 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:22.254627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1eedb46-5d3f-4f3e-8fce-5dde8c572303 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:22.255061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1eedb46-5d3f-4f3e-8fce-5dde8c572303 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:22.257039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc94f0d5-5020-428d-bdb5-53c8fa3a9ffc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:22.272360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc94f0d5-5020-428d-bdb5-53c8fa3a9ffc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.305314 Jul 26 19:43:22.274495 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 40/82] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:21 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:22.318721 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e1eedb46-5d3f-4f3e-8fce-5dde8c572303 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.072351 Jul 26 19:43:22.319990 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 43/83] 10.222.0.58 () {58 vars in 1145 bytes} [Tue Jul 26 19:43:22 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:22.986288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-93965768-def7-4202-bbef-af04a08abfbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:22.988573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-93965768-def7-4202-bbef-af04a08abfbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:23.004102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93965768-def7-4202-bbef-af04a08abfbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:23.006074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93965768-def7-4202-bbef-af04a08abfbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:23.008619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93965768-def7-4202-bbef-af04a08abfbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:23.010573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93965768-def7-4202-bbef-af04a08abfbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:23.214498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-93965768-def7-4202-bbef-af04a08abfbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:23.225760 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-93965768-def7-4202-bbef-af04a08abfbf tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.243209 Jul 26 19:43:23.227729 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 41/84] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:22 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:23.295363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85b3e7dc-355c-4c7b-bfe4-9995955bcea0 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:23.296258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85b3e7dc-355c-4c7b-bfe4-9995955bcea0 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:23.308327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85b3e7dc-355c-4c7b-bfe4-9995955bcea0 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:23.308792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85b3e7dc-355c-4c7b-bfe4-9995955bcea0 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:23.318851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85b3e7dc-355c-4c7b-bfe4-9995955bcea0 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:23.319316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85b3e7dc-355c-4c7b-bfe4-9995955bcea0 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:23.725549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85b3e7dc-355c-4c7b-bfe4-9995955bcea0 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:23.742089 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85b3e7dc-355c-4c7b-bfe4-9995955bcea0 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.450950 Jul 26 19:43:23.751761 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 44/85] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:23 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:24.249784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e62c74d6-dc61-4fd7-b551-93a4f3bac45a tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:24.250602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e62c74d6-dc61-4fd7-b551-93a4f3bac45a tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:24.262599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=14 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:24.276753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e62c74d6-dc61-4fd7-b551-93a4f3bac45a tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.277212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e62c74d6-dc61-4fd7-b551-93a4f3bac45a tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.278040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e62c74d6-dc61-4fd7-b551-93a4f3bac45a tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.280033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e62c74d6-dc61-4fd7-b551-93a4f3bac45a tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.569839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f60a5111-17de-42dd-a691-3493bd0efe71 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-700260507", "ram": 512, "vcpus": 1, "disk": 10, "id": 369283936, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:24.573792 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:24.573792 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:24.596332 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f60a5111-17de-42dd-a691-3493bd0efe71 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.585513 Jul 26 19:43:24.607750 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 42/86] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:24 2022] POST /compute/v2.1/flavors => generated 412 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:24.632869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e62c74d6-dc61-4fd7-b551-93a4f3bac45a tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:24.644492 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e62c74d6-dc61-4fd7-b551-93a4f3bac45a tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.398172 Jul 26 19:43:24.646855 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 45/87] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:24 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:24.704734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2731f921-4489-4656-86fc-bbd85cc577ba tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f876476cd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:24.705533 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:24.705533 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:24.707295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2731f921-4489-4656-86fc-bbd85cc577ba tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.708539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2731f921-4489-4656-86fc-bbd85cc577ba tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.739632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2731f921-4489-4656-86fc-bbd85cc577ba tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.740355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2731f921-4489-4656-86fc-bbd85cc577ba tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.754067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2731f921-4489-4656-86fc-bbd85cc577ba tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.755376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2731f921-4489-4656-86fc-bbd85cc577ba tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.762320 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2731f921-4489-4656-86fc-bbd85cc577ba tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.153042 Jul 26 19:43:24.763514 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 43/88] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:24.834251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f84d708-66ba-4e0c-a996-d257c2aa83ec tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:24.845111 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-1f84d708-66ba-4e0c-a996-d257c2aa83ec tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] HTTP exception thrown: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f84d708-66ba-4e0c-a996-d257c2aa83ec tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Request method failure captured: Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/flavors/369283936/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPauIW5dC8J46dfYqejP-VjRpMt1o9OsjuIgBncHDIRZHsEkz7TllXfA5ayruKqr3vV4m7pWMpFvKtqTKb1VAaUy0zXJvYTsGDA_2od8RxoXYLl5cgNCSoZTPtleNZXtxgpITj5wp-9mdOBkajPX9uPz6pduGIgEtaW0Alixfww9tw Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5480545aa7b4496fb643afe05fbb3d9e Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:24.847896 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5480545aa7b4496fb643afe05fbb3d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5480545aa7b4496fb643afe05fbb3d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5480545aa7b4496fb643afe05fbb3d9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5480545aa7b4496fb643afe05fbb3d9e"}]}] Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5480545aa7b4496fb643afe05fbb3d9e Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: cc5ec1c02469468aab208519bc0b015a Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:24.849727 n-d-708768-8 devstack@n-api.service[125964]: exception: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'flavor_id': '369283936', 'id': 'hw:cpu_thread_policy'} Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:24.850347 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:24.851475 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:24.851475 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:24.851475 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:24.851475 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:24.851475 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:24.851475 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. Jul 26 19:43:24.851475 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:24.853287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f84d708-66ba-4e0c-a996-d257c2aa83ec tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Returning 404 to user: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:24.854907 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f84d708-66ba-4e0c-a996-d257c2aa83ec tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] 10.222.0.58 "GET /compute/v2.1/flavors/369283936/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.201401 Jul 26 19:43:24.861549 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 46/89] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:43:24 2022] GET /compute/v2.1/flavors/369283936/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:24.868176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6763f1cd-3e99-4d4d-bd04-f70fae41ebda tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:24.869087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6763f1cd-3e99-4d4d-bd04-f70fae41ebda tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:24.875749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=15,nova_api:INSERT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:24.877547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6763f1cd-3e99-4d4d-bd04-f70fae41ebda tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.878269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6763f1cd-3e99-4d4d-bd04-f70fae41ebda tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.879320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6763f1cd-3e99-4d4d-bd04-f70fae41ebda tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.881002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6763f1cd-3e99-4d4d-bd04-f70fae41ebda tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.947824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6a13baf2-9ca4-4574-a878-236a9f2e7f69 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:24.956708 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6a13baf2-9ca4-4574-a878-236a9f2e7f69 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.191808 Jul 26 19:43:24.965264 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 44/90] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:43:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:24.965264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a88f9b47-c66a-4adb-bfcd-35f0ca527f35 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f876472fd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:24.965264 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:24.965264 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:24.965264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a88f9b47-c66a-4adb-bfcd-35f0ca527f35 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.965264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a88f9b47-c66a-4adb-bfcd-35f0ca527f35 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.982008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a88f9b47-c66a-4adb-bfcd-35f0ca527f35 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.982535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a88f9b47-c66a-4adb-bfcd-35f0ca527f35 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:24.994166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a88f9b47-c66a-4adb-bfcd-35f0ca527f35 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:24.994612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a88f9b47-c66a-4adb-bfcd-35f0ca527f35 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.001029 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a88f9b47-c66a-4adb-bfcd-35f0ca527f35 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.042284 Jul 26 19:43:25.013487 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 45/91] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Jul 26 19:43:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:25.013487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31c181e2-820a-4b40-82d8-c6b152a68667 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.013487 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.013487 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.013487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-31c181e2-820a-4b40-82d8-c6b152a68667 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'cc5ec1c02469468aab208519bc0b015a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5480545aa7b4496fb643afe05fbb3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31c181e2-820a-4b40-82d8-c6b152a68667 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Request method failure captured: Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/flavors/369283936/os-extra_specs HTTP/1.1 Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 66 Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPauIW5dC8J46dfYqejP-VjRpMt1o9OsjuIgBncHDIRZHsEkz7TllXfA5ayruKqr3vV4m7pWMpFvKtqTKb1VAaUy0zXJvYTsGDA_2od8RxoXYLl5cgNCSoZTPtleNZXtxgpITj5wp-9mdOBkajPX9uPz6pduGIgEtaW0Alixfww9tw Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5480545aa7b4496fb643afe05fbb3d9e Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:25.013981 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5480545aa7b4496fb643afe05fbb3d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5480545aa7b4496fb643afe05fbb3d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5480545aa7b4496fb643afe05fbb3d9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5480545aa7b4496fb643afe05fbb3d9e"}]}] Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5480545aa7b4496fb643afe05fbb3d9e Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cc5ec1c02469468aab208519bc0b015a Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 26 19:43:25.015171 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'flavor_id': '369283936', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:25.015851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 19:43:25.016817 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.017804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31c181e2-820a-4b40-82d8-c6b152a68667 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:25.017804 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31c181e2-820a-4b40-82d8-c6b152a68667 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] 10.222.0.58 "POST /compute/v2.1/flavors/369283936/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.011557 Jul 26 19:43:25.017804 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 46/92] 10.222.0.58 () {60 vars in 1221 bytes} [Tue Jul 26 19:43:25 2022] POST /compute/v2.1/flavors/369283936/os-extra_specs => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:25.054517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6763f1cd-3e99-4d4d-bd04-f70fae41ebda tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:25.063498 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6763f1cd-3e99-4d4d-bd04-f70fae41ebda tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.200530 Jul 26 19:43:25.078241 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 47/93] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:24 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:25.084111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c65fcb4-a709-426c-a1ac-983100175818 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f8757bca3a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.085186 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.085186 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:25.086847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3d28f56-f900-4637-92a6-eea2311740d9 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-849505924", "id": 48274083, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.087239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c65fcb4-a709-426c-a1ac-983100175818 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.088142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c65fcb4-a709-426c-a1ac-983100175818 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.090079 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.090079 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.108410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c65fcb4-a709-426c-a1ac-983100175818 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.109438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c65fcb4-a709-426c-a1ac-983100175818 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.111135 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3d28f56-f900-4637-92a6-eea2311740d9 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.094924 Jul 26 19:43:25.112420 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 47/94] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:25 2022] POST /compute/v2.1/flavors => generated 418 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.123710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c65fcb4-a709-426c-a1ac-983100175818 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.124956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c65fcb4-a709-426c-a1ac-983100175818 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.133796 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c65fcb4-a709-426c-a1ac-983100175818 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054086 Jul 26 19:43:25.134634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b9c786b3-335e-4292-88d0-a63d5b4dd7e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.135164 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 48/95] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.145109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36130d85-d6b9-47a5-a7fc-91b40eb0df58 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.159469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=8,nova_api:INSERT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:25.161798 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36130d85-d6b9-47a5-a7fc-91b40eb0df58 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025365 Jul 26 19:43:25.163724 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 49/96] 10.222.0.58 () {58 vars in 1182 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:25.172217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d7020c04-1a53-4eaa-91a7-1cf01f139b23 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f8757bcaaf0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.173046 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.173046 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:25.180488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7020c04-1a53-4eaa-91a7-1cf01f139b23 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.180947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7020c04-1a53-4eaa-91a7-1cf01f139b23 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.183324 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b9c786b3-335e-4292-88d0-a63d5b4dd7e1 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/369283936/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069577 Jul 26 19:43:25.184018 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 48/97] 10.222.0.58 () {60 vars in 1221 bytes} [Tue Jul 26 19:43:25 2022] POST /compute/v2.1/flavors/369283936/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:25.190602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87b62f9e-8d96-429c-8c2a-653e2210d276 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1906642585", "id": 1571137765, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.216191 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87b62f9e-8d96-429c-8c2a-653e2210d276 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.030666 Jul 26 19:43:25.216886 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 49/98] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:25 2022] POST /compute/v2.1/flavors => generated 425 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.224894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-98613542-e8b6-4641-9d96-d5d19d359687 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.226202 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.226202 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.227248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-98613542-e8b6-4641-9d96-d5d19d359687 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'cc5ec1c02469468aab208519bc0b015a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5480545aa7b4496fb643afe05fbb3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-98613542-e8b6-4641-9d96-d5d19d359687 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Request method failure captured: Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPauIW5dC8J46dfYqejP-VjRpMt1o9OsjuIgBncHDIRZHsEkz7TllXfA5ayruKqr3vV4m7pWMpFvKtqTKb1VAaUy0zXJvYTsGDA_2od8RxoXYLl5cgNCSoZTPtleNZXtxgpITj5wp-9mdOBkajPX9uPz6pduGIgEtaW0Alixfww9tw Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5480545aa7b4496fb643afe05fbb3d9e Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:25.228971 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5480545aa7b4496fb643afe05fbb3d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5480545aa7b4496fb643afe05fbb3d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5480545aa7b4496fb643afe05fbb3d9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5480545aa7b4496fb643afe05fbb3d9e"}]}] Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5480545aa7b4496fb643afe05fbb3d9e Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cc5ec1c02469468aab208519bc0b015a Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:25.230336 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'flavor_id': '369283936', 'id': 'hw:numa_nodes'} Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:25.230939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.232134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-98613542-e8b6-4641-9d96-d5d19d359687 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:25.233223 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-98613542-e8b6-4641-9d96-d5d19d359687 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] 10.222.0.58 "DELETE /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012693 Jul 26 19:43:25.233223 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 50/99] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:43:25 2022] DELETE /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:25.235118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7020c04-1a53-4eaa-91a7-1cf01f139b23 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.235681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7020c04-1a53-4eaa-91a7-1cf01f139b23 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.237363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af7c55a7-8441-41f2-bf57-5ee87b371ec2 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.246602 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d7020c04-1a53-4eaa-91a7-1cf01f139b23 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.080755 Jul 26 19:43:25.247252 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 50/100] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.252461 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af7c55a7-8441-41f2-bf57-5ee87b371ec2 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019609 Jul 26 19:43:25.254649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-60261dd9-64dc-408c-a267-fc7bb380a2fb tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.259460 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.259460 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:25.259879 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 51/101] 10.222.0.58 () {58 vars in 1182 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:25.265681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ff81b951-2a84-48fb-878e-d44e780060c0 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f876477fb80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.267331 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.267331 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.269016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff81b951-2a84-48fb-878e-d44e780060c0 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.270149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff81b951-2a84-48fb-878e-d44e780060c0 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.286596 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-60261dd9-64dc-408c-a267-fc7bb380a2fb tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/369283936/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037237 Jul 26 19:43:25.287450 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 51/102] 10.222.0.58 () {60 vars in 1221 bytes} [Tue Jul 26 19:43:25 2022] POST /compute/v2.1/flavors/369283936/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:43:25.291523 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ff81b951-2a84-48fb-878e-d44e780060c0 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.030323 Jul 26 19:43:25.292960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3864b85-f77d-4f82-8947-1f7e94d79d1d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Action: 'create', calling method: .version_select at 0x7f8757b5cb80>, body: {"keypair": {"name": "tempest-keypair-1996243959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH86GhnMJveMiAw9lacnt72KhNuzCQ7sU1gaMG17OmEWjBEnG8f1ksafarYIpSdSGMaujUkvz+6bk9RLESWeopHUn2QH7aUpF41U9rIFpXj4eC92QdBK/osWkCgrj7PR4w=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.299563 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 52/103] 10.222.0.58 () {58 vars in 1179 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.305329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7799b14a-3e2c-43fb-aab6-ceae9b686a29 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.308093 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.308093 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.309258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7799b14a-3e2c-43fb-aab6-ceae9b686a29 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'cc5ec1c02469468aab208519bc0b015a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5480545aa7b4496fb643afe05fbb3d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7799b14a-3e2c-43fb-aab6-ceae9b686a29 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Request method failure captured: Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 22 Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPauIW5dC8J46dfYqejP-VjRpMt1o9OsjuIgBncHDIRZHsEkz7TllXfA5ayruKqr3vV4m7pWMpFvKtqTKb1VAaUy0zXJvYTsGDA_2od8RxoXYLl5cgNCSoZTPtleNZXtxgpITj5wp-9mdOBkajPX9uPz6pduGIgEtaW0Alixfww9tw Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5480545aa7b4496fb643afe05fbb3d9e Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:25.311249 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5480545aa7b4496fb643afe05fbb3d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5480545aa7b4496fb643afe05fbb3d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5480545aa7b4496fb643afe05fbb3d9e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5480545aa7b4496fb643afe05fbb3d9e"}]}] Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5480545aa7b4496fb643afe05fbb3d9e Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cc5ec1c02469468aab208519bc0b015a Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: {"hw:numa_nodes": "1"} Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:25.312360 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'flavor_id': '369283936', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:25.313017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 19:43:25.313950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.316267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7799b14a-3e2c-43fb-aab6-ceae9b686a29 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:25.317414 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7799b14a-3e2c-43fb-aab6-ceae9b686a29 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406 tempest-FlavorsExtraSpecsNegativeTestJSON-1867080406-project] 10.222.0.58 "PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016404 Jul 26 19:43:25.318478 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 53/104] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:43:25 2022] PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:25.324210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-939623f2-61d6-4f63-ab4d-118f5b2b993a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f87646d6f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.325365 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.325365 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.326699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-939623f2-61d6-4f63-ab4d-118f5b2b993a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.327369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-939623f2-61d6-4f63-ab4d-118f5b2b993a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.328835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c3864b85-f77d-4f82-8947-1f7e94d79d1d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Getting quotas for project 5112c2e993b44756a068fe8782e68681. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:43:25.334314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c3864b85-f77d-4f82-8947-1f7e94d79d1d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Getting quotas for user 7836e60170f1440c9d82b730e8d03344 and project 5112c2e993b44756a068fe8782e68681. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:43:25.343388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-939623f2-61d6-4f63-ab4d-118f5b2b993a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.344178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-939623f2-61d6-4f63-ab4d-118f5b2b993a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.356694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-939623f2-61d6-4f63-ab4d-118f5b2b993a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.357314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-939623f2-61d6-4f63-ab4d-118f5b2b993a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.365908 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-939623f2-61d6-4f63-ab4d-118f5b2b993a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045006 Jul 26 19:43:25.366999 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 54/105] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.374212 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3864b85-f77d-4f82-8947-1f7e94d79d1d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085487 Jul 26 19:43:25.375213 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 52/106] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:43:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.377889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-274a0fdb-f5da-4097-b265-88b2d1483a5a tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.378838 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.378838 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.380505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a471fe36-e558-46e1-923c-19533407b873 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f8757b8fa60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.386500 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-274a0fdb-f5da-4097-b265-88b2d1483a5a tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] HTTP exception thrown: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-274a0fdb-f5da-4097-b265-88b2d1483a5a tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Request method failure captured: Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/flavors/369283936/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPbdHeYMgGk8iBM6UXWv4wbKU9z8SX4_3W5c5AEc-Le0J3G8TXNWMRzu1t-42BLmWMPLh2TUTnowLYmtszxa_XJ9LZUjdrQrzCxIsLGBUBPCbCuH4FS0NVMq0hkKwwheKafln_1Le8ydRbin9XXXE4X5CBal78K2j6pWDjpvPiGWZ8 Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: c1529d0b466f44d0bdb1bed3d93a022c Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:25.388356 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c1529d0b466f44d0bdb1bed3d93a022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1529d0b466f44d0bdb1bed3d93a022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c1529d0b466f44d0bdb1bed3d93a022c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1529d0b466f44d0bdb1bed3d93a022c"}]}] Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: c1529d0b466f44d0bdb1bed3d93a022c Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 53441fa15b0440a4a1cf48813e60e597 Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:25.389717 n-d-708768-8 devstack@n-api.service[125963]: exception: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'flavor_id': '369283936', 'id': 'hw:cpu_thread_policy'} Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:25.390421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.391759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.391759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.391759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.391759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:25.391759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:25.391759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. Jul 26 19:43:25.391759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.392847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-274a0fdb-f5da-4097-b265-88b2d1483a5a tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Returning 404 to user: Flavor 369283936 has no extra specs with key hw:cpu_thread_policy. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:25.393829 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-274a0fdb-f5da-4097-b265-88b2d1483a5a tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/369283936/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.019935 Jul 26 19:43:25.395125 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 55/107] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 19:43:25 2022] DELETE /compute/v2.1/flavors/369283936/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:25.397226 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.397226 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:25.400729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a471fe36-e558-46e1-923c-19533407b873 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.402510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a471fe36-e558-46e1-923c-19533407b873 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.409002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ecb88ff-52bd-48c2-a036-0e7c87c870c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.418054 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.418054 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.419292 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0ecb88ff-52bd-48c2-a036-0e7c87c870c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ecb88ff-52bd-48c2-a036-0e7c87c870c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Request method failure captured: Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 27 Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPbdHeYMgGk8iBM6UXWv4wbKU9z8SX4_3W5c5AEc-Le0J3G8TXNWMRzu1t-42BLmWMPLh2TUTnowLYmtszxa_XJ9LZUjdrQrzCxIsLGBUBPCbCuH4FS0NVMq0hkKwwheKafln_1Le8ydRbin9XXXE4X5CBal78K2j6pWDjpvPiGWZ8 Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: c1529d0b466f44d0bdb1bed3d93a022c Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:25.421837 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c1529d0b466f44d0bdb1bed3d93a022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1529d0b466f44d0bdb1bed3d93a022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c1529d0b466f44d0bdb1bed3d93a022c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1529d0b466f44d0bdb1bed3d93a022c"}]}] Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: c1529d0b466f44d0bdb1bed3d93a022c Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 53441fa15b0440a4a1cf48813e60e597 Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: {"hw:cpu_policy": "shared"} Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:25.423375 n-d-708768-8 devstack@n-api.service[125963]: exception: Request body and URI mismatch Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'flavor_id': '369283936', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.424211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.425207 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:25.425207 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:25.425207 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 26 19:43:25.425207 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.425207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ecb88ff-52bd-48c2-a036-0e7c87c870c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:25.425207 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ecb88ff-52bd-48c2-a036-0e7c87c870c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.022657 Jul 26 19:43:25.427482 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 56/108] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:43:25 2022] PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 26 19:43:25.445569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85d582db-8dac-4587-86fb-f94e110d7ecc tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:25.446309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a471fe36-e558-46e1-923c-19533407b873 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.446914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a471fe36-e558-46e1-923c-19533407b873 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.454974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:25.458531 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a471fe36-e558-46e1-923c-19533407b873 tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.081970 Jul 26 19:43:25.467686 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 53/109] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85d582db-8dac-4587-86fb-f94e110d7ecc tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Request method failure captured: Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 49 Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPbdHeYMgGk8iBM6UXWv4wbKU9z8SX4_3W5c5AEc-Le0J3G8TXNWMRzu1t-42BLmWMPLh2TUTnowLYmtszxa_XJ9LZUjdrQrzCxIsLGBUBPCbCuH4FS0NVMq0hkKwwheKafln_1Le8ydRbin9XXXE4X5CBal78K2j6pWDjpvPiGWZ8 Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: c1529d0b466f44d0bdb1bed3d93a022c Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:25.467879 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c1529d0b466f44d0bdb1bed3d93a022c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1529d0b466f44d0bdb1bed3d93a022c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c1529d0b466f44d0bdb1bed3d93a022c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c1529d0b466f44d0bdb1bed3d93a022c"}]}] Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: c1529d0b466f44d0bdb1bed3d93a022c Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 53441fa15b0440a4a1cf48813e60e597 Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 26 19:43:25.469174 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'flavor_id': '369283936', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance: Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 26 19:43:25.469933 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.471229 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85d582db-8dac-4587-86fb-f94e110d7ecc tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85d582db-8dac-4587-86fb-f94e110d7ecc tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.029770 Jul 26 19:43:25.472375 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 57/110] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:43:25 2022] PUT /compute/v2.1/flavors/369283936/os-extra_specs/hw:numa_nodes => generated 117 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:43:25.485449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64256b4f-7862-4d62-ae6b-117d83d68d6e tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.486957 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.486957 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:25.488275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-102d5f80-91ac-40ba-b408-d36377b1091a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f8757b9d160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.491050 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.491050 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:25.494281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-102d5f80-91ac-40ba-b408-d36377b1091a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.494842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-102d5f80-91ac-40ba-b408-d36377b1091a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.525050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-102d5f80-91ac-40ba-b408-d36377b1091a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.525624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-102d5f80-91ac-40ba-b408-d36377b1091a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.525761 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64256b4f-7862-4d62-ae6b-117d83d68d6e tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/369283936" status: 202 len: 0 microversion: 2.1 time: 0.049087 Jul 26 19:43:25.531949 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 58/111] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:43:25 2022] DELETE /compute/v2.1/flavors/369283936 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:43:25.540193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d980171f-d2cd-4dd7-adae-b51fad8c8784 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.541240 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-102d5f80-91ac-40ba-b408-d36377b1091a tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.063286 Jul 26 19:43:25.543647 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 54/112] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.560287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-90f5c366-f76d-4221-9933-2ac0095c45ef tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Calling method '.version_select at 0x7f8757b8ff70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.562219 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:25.562219 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:25.568035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f5c366-f76d-4221-9933-2ac0095c45ef tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.570452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f5c366-f76d-4221-9933-2ac0095c45ef tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.601370 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d980171f-d2cd-4dd7-adae-b51fad8c8784 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237 tempest-FlavorsExtraSpecsNegativeTestJSON-1984675237-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.067556 Jul 26 19:43:25.601964 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 59/113] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:25.604325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f5c366-f76d-4221-9933-2ac0095c45ef tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.604932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f5c366-f76d-4221-9933-2ac0095c45ef tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.638111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f5c366-f76d-4221-9933-2ac0095c45ef tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.638669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f5c366-f76d-4221-9933-2ac0095c45ef tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.668005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3922f02-88fb-4641-9d4a-11c43f60363c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:25.668715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b3922f02-88fb-4641-9d4a-11c43f60363c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:25.694338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3922f02-88fb-4641-9d4a-11c43f60363c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.694795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3922f02-88fb-4641-9d4a-11c43f60363c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.698300 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-90f5c366-f76d-4221-9933-2ac0095c45ef tempest-HypervisorAdminTestJSON-1670045932 tempest-HypervisorAdminTestJSON-1670045932-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.141934 Jul 26 19:43:25.699236 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 55/114] 10.222.0.58 () {58 vars in 1173 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:25.705257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3922f02-88fb-4641-9d4a-11c43f60363c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:25.705257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3922f02-88fb-4641-9d4a-11c43f60363c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:25.988214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b3922f02-88fb-4641-9d4a-11c43f60363c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:26.001730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3922f02-88fb-4641-9d4a-11c43f60363c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.337741 Jul 26 19:43:26.017269 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 60/115] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:25 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:26.086620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4401010d-1172-432f-8f2a-c103e8d90143 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:26.087272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4401010d-1172-432f-8f2a-c103e8d90143 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:26.113674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4401010d-1172-432f-8f2a-c103e8d90143 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:26.114136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4401010d-1172-432f-8f2a-c103e8d90143 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:26.114929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4401010d-1172-432f-8f2a-c103e8d90143 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:26.115368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4401010d-1172-432f-8f2a-c103e8d90143 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:26.456910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4401010d-1172-432f-8f2a-c103e8d90143 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:26.472363 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4401010d-1172-432f-8f2a-c103e8d90143 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.390591 Jul 26 19:43:26.472983 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 56/116] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:26 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:27.023270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb3d14ce-720e-49d7-93c8-ad281a77650b tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:27.024916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb3d14ce-720e-49d7-93c8-ad281a77650b tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:27.038861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb3d14ce-720e-49d7-93c8-ad281a77650b tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:27.039578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb3d14ce-720e-49d7-93c8-ad281a77650b tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:27.040606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb3d14ce-720e-49d7-93c8-ad281a77650b tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:27.041241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb3d14ce-720e-49d7-93c8-ad281a77650b tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:27.282776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb3d14ce-720e-49d7-93c8-ad281a77650b tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:27.298288 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb3d14ce-720e-49d7-93c8-ad281a77650b tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.279240 Jul 26 19:43:27.300312 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 61/117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:27 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:27.499112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6bb668b0-daba-4f97-b528-a7d0655c4920 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:27.500826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6bb668b0-daba-4f97-b528-a7d0655c4920 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:27.518948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bb668b0-daba-4f97-b528-a7d0655c4920 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:27.520244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bb668b0-daba-4f97-b528-a7d0655c4920 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:27.522684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bb668b0-daba-4f97-b528-a7d0655c4920 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:27.523263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bb668b0-daba-4f97-b528-a7d0655c4920 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:27.918832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6bb668b0-daba-4f97-b528-a7d0655c4920 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:27.928678 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6bb668b0-daba-4f97-b528-a7d0655c4920 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.435086 Jul 26 19:43:27.945597 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 57/118] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:27 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:28.322453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4c017088-5acd-42b6-9f39-671de964c224 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:28.323975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4c017088-5acd-42b6-9f39-671de964c224 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:28.337104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c017088-5acd-42b6-9f39-671de964c224 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:28.338450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c017088-5acd-42b6-9f39-671de964c224 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:28.339795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c017088-5acd-42b6-9f39-671de964c224 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:28.340577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c017088-5acd-42b6-9f39-671de964c224 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:28.957330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f8b09259-95fd-4259-bfa6-c74161f66940 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:28.959961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f8b09259-95fd-4259-bfa6-c74161f66940 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:28.975017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8b09259-95fd-4259-bfa6-c74161f66940 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:28.979720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8b09259-95fd-4259-bfa6-c74161f66940 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:28.981769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8b09259-95fd-4259-bfa6-c74161f66940 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:28.984127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8b09259-95fd-4259-bfa6-c74161f66940 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:29.005192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4c017088-5acd-42b6-9f39-671de964c224 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:29.013294 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4c017088-5acd-42b6-9f39-671de964c224 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.696664 Jul 26 19:43:29.022907 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 62/119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:28 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:29.255906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1432769941", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "1571137765", "adminPass": "***", "networks": [{"uuid": "8278a3b7-4808-42be-b6e2-6bb4229f7cd2"}], "security_groups": [{"name": "tempest-securitygroup--490669374"}], "key_name": "tempest-keypair-1996243959", "user_data": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:29.346762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f8b09259-95fd-4259-bfa6-c74161f66940 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:29.361600 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f8b09259-95fd-4259-bfa6-c74161f66940 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.405324 Jul 26 19:43:29.362764 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 58/120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:28 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:29.539762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] validate_networks() for [('8278a3b7-4808-42be-b6e2-6bb4229f7cd2', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:43:30.043028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02770854-6320-4e9a-932e-271a9d8f6d3f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:30.044515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02770854-6320-4e9a-932e-271a9d8f6d3f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:30.054943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02770854-6320-4e9a-932e-271a9d8f6d3f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:30.055395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02770854-6320-4e9a-932e-271a9d8f6d3f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:30.077380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02770854-6320-4e9a-932e-271a9d8f6d3f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:30.079264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02770854-6320-4e9a-932e-271a9d8f6d3f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:30.395060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02770854-6320-4e9a-932e-271a9d8f6d3f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:30.405132 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02770854-6320-4e9a-932e-271a9d8f6d3f tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.365816 Jul 26 19:43:30.414836 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 59/121] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:30 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:30.454929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e4a4304e-b8ca-415e-baf8-ea54d3ee145b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:30.455785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e4a4304e-b8ca-415e-baf8-ea54d3ee145b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:30.477137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4a4304e-b8ca-415e-baf8-ea54d3ee145b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:30.477583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4a4304e-b8ca-415e-baf8-ea54d3ee145b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:30.478366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4a4304e-b8ca-415e-baf8-ea54d3ee145b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:30.484504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4a4304e-b8ca-415e-baf8-ea54d3ee145b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:31.382491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e4a4304e-b8ca-415e-baf8-ea54d3ee145b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:31.417586 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e4a4304e-b8ca-415e-baf8-ea54d3ee145b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.983390 Jul 26 19:43:31.420394 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 60/122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:30 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:31.441433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4d1d63b1-d609-4f46-a329-f0dee7297ed9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:31.445488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4d1d63b1-d609-4f46-a329-f0dee7297ed9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:31.476232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d1d63b1-d609-4f46-a329-f0dee7297ed9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:31.480363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d1d63b1-d609-4f46-a329-f0dee7297ed9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:31.482128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d1d63b1-d609-4f46-a329-f0dee7297ed9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:31.482564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d1d63b1-d609-4f46-a329-f0dee7297ed9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:31.903744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:43:31.904220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:43:31.904735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:43:31.905147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:43:31.905558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:43:31.924248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:31.924878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:31.927986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:31.929424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:31.979117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Getting quotas for project 5112c2e993b44756a068fe8782e68681. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:43:31.993292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Getting quotas for user 7836e60170f1440c9d82b730e8d03344 and project 5112c2e993b44756a068fe8782e68681. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:43:32.016403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:43:32.027804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:43:32.178119 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e481dd2c-2b6a-4ee2-9419-ed3b74094559 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.927487 Jul 26 19:43:32.189244 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 63/123] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 2939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:43:32.290998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:32.376525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4d1d63b1-d609-4f46-a329-f0dee7297ed9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:32.388327 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4d1d63b1-d609-4f46-a329-f0dee7297ed9 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.951880 Jul 26 19:43:32.392722 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 61/124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:31 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:32.405036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-80dd1f77-d9d8-4771-ab66-9e6f5b1cb6fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:32.405659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-80dd1f77-d9d8-4771-ab66-9e6f5b1cb6fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:32.543053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-80dd1f77-d9d8-4771-ab66-9e6f5b1cb6fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:32.545832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=17 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:32.585658 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-80dd1f77-d9d8-4771-ab66-9e6f5b1cb6fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1265 microversion: 2.1 time: 0.191736 Jul 26 19:43:32.589363 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 62/125] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:32 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:32.602670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e937696-f170-455c-a703-866ddacd7377 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Calling method '.version_select at 0x7f87646d6310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:32.606624 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:32.606624 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:32.610470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e937696-f170-455c-a703-866ddacd7377 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:32.613902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e937696-f170-455c-a703-866ddacd7377 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:32.615191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e937696-f170-455c-a703-866ddacd7377 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:32.616209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e937696-f170-455c-a703-866ddacd7377 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:32.706389 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e937696-f170-455c-a703-866ddacd7377 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.515414 Jul 26 19:43:32.709831 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 64/126] 10.222.0.58 () {58 vars in 1128 bytes} [Tue Jul 26 19:43:32 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:32.725220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1903657a-0f40-48c2-80bf-2065433f922c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:32.725969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1903657a-0f40-48c2-80bf-2065433f922c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:32.741469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1903657a-0f40-48c2-80bf-2065433f922c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:32.742287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1903657a-0f40-48c2-80bf-2065433f922c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:32.743284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1903657a-0f40-48c2-80bf-2065433f922c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:32.746128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1903657a-0f40-48c2-80bf-2065433f922c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:32.822638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-181dfc4b-df07-4219-80e6-e105dee2d0c5 req-565324e3-0a5d-4639-9c06-23e0149c65eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7887d20-6f23-42b2-9039-ed2f8cb81d65", "name": "network-vif-plugged", "status": "completed", "tag": "d3d7dc1a-20fa-4fa1-ba45-8a1ca4dd2c6c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:32.845105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-181dfc4b-df07-4219-80e6-e105dee2d0c5 req-565324e3-0a5d-4639-9c06-23e0149c65eb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:32.845741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-181dfc4b-df07-4219-80e6-e105dee2d0c5 req-565324e3-0a5d-4639-9c06-23e0149c65eb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:32.859555 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-181dfc4b-df07-4219-80e6-e105dee2d0c5 req-565324e3-0a5d-4639-9c06-23e0149c65eb service nova] Creating event network-vif-plugged:d3d7dc1a-20fa-4fa1-ba45-8a1ca4dd2c6c for instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 on n-h1-708768-8 Jul 26 19:43:32.867453 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-181dfc4b-df07-4219-80e6-e105dee2d0c5 req-565324e3-0a5d-4639-9c06-23e0149c65eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276652 Jul 26 19:43:32.870160 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 63/127] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:32.979645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1903657a-0f40-48c2-80bf-2065433f922c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:32.993353 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1903657a-0f40-48c2-80bf-2065433f922c tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.278023 Jul 26 19:43:32.994929 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 65/128] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:32 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:33.090386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af9f9834-ca9f-41d7-a09c-7a931f4f4ccf tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Calling method '.version_select at 0x7f8757ad9a60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.093034 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.093034 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:33.094463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af9f9834-ca9f-41d7-a09c-7a931f4f4ccf tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'ad4193400023420484b67a09771c2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fea069464648dc91a9fef685eb368c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af9f9834-ca9f-41d7-a09c-7a931f4f4ccf tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Request method failure captured: Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPitnUex-oNjdeo5ICe2BjXNZT3QFobuU4kywJbj1fQelis4kWZ49mCqw4J3QL6xeTAvn53A-SnZQ4vXvpQ7D8L5wI7zsala1ir7IerKeppwoeF_Sb8ehoVgsuKKPQfw4IeiZsQisyFX89bIQwJkYJB1hKL2qGKzZa8fhGoVGJXTLg Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:33.097561 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78fea069464648dc91a9fef685eb368c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78fea069464648dc91a9fef685eb368c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}] Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ad4193400023420484b67a09771c2053 Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: action_args: {} Jul 26 19:43:33.099055 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.099990 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 19:43:33.101224 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.102449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af9f9834-ca9f-41d7-a09c-7a931f4f4ccf tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.102449 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-af9f9834-ca9f-41d7-a09c-7a931f4f4ccf tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.227527 Jul 26 19:43:33.105773 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 64/129] 10.222.0.58 () {58 vars in 1128 bytes} [Tue Jul 26 19:43:32 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.115953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a2c7dda-ef38-4ced-ad38-768c98674878 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Calling method '.version_select at 0x7f8757aea3a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.116923 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.116923 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:33.119026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a2c7dda-ef38-4ced-ad38-768c98674878 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'ad4193400023420484b67a09771c2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fea069464648dc91a9fef685eb368c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a2c7dda-ef38-4ced-ad38-768c98674878 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Request method failure captured: Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts/n-d-708768-8/reboot HTTP/1.1 Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPitnUex-oNjdeo5ICe2BjXNZT3QFobuU4kywJbj1fQelis4kWZ49mCqw4J3QL6xeTAvn53A-SnZQ4vXvpQ7D8L5wI7zsala1ir7IerKeppwoeF_Sb8ehoVgsuKKPQfw4IeiZsQisyFX89bIQwJkYJB1hKL2qGKzZa8fhGoVGJXTLg Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:33.123142 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78fea069464648dc91a9fef685eb368c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78fea069464648dc91a9fef685eb368c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}] Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ad4193400023420484b67a09771c2053 Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'n-d-708768-8'} Jul 26 19:43:33.124556 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.125458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 19:43:33.126787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.131392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a2c7dda-ef38-4ced-ad38-768c98674878 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.136785 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a2c7dda-ef38-4ced-ad38-768c98674878 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-708768-8/reboot" status: 403 len: 111 microversion: 2.1 time: 0.026262 Jul 26 19:43:33.140552 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 65/130] 10.222.0.58 () {58 vars in 1188 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hosts/n-d-708768-8/reboot => generated 111 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.164011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-326da695-afdc-41c8-8e7e-c81fedde5c3f tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Calling method '.version_select at 0x7f8757b3f040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.192781 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-326da695-afdc-41c8-8e7e-c81fedde5c3f tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-326da695-afdc-41c8-8e7e-c81fedde5c3f tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Request method failure captured: Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPjTjOsFZ8Yq-t3xfNtYB8KeYaMWtrXvxhqASzA_Wm_ydSKRFbhx8sisDZ6z-RxszqzB6nYph3HoB-1T3KwGl_IRtyn0BWSnaYmjQ_opWHkTWZPqg0BEfKqfkU3GQuRlaQFUqpnGTPYGMeyIGnTZhRlPFMemQSi-qsNcsG5taQxwx8 Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:33.204934 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc5e72020b0a49a2a77e74ab3de056e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}] Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8f1918a20ec04d1f884e4fe559a3281f Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'nonexistent_hostname'} Jul 26 19:43:33.206389 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:33.207231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 19:43:33.209144 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.210322 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.212558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-326da695-afdc-41c8-8e7e-c81fedde5c3f tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.213729 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-326da695-afdc-41c8-8e7e-c81fedde5c3f tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.069217 Jul 26 19:43:33.214833 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 66/131] 10.222.0.58 () {58 vars in 1212 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:33.229397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-19f77c35-0669-4ef1-9c37-2afbbaa69aba tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Calling method '.version_select at 0x7f8757a149d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.231377 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.231377 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:33.235797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-19f77c35-0669-4ef1-9c37-2afbbaa69aba tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'ad4193400023420484b67a09771c2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fea069464648dc91a9fef685eb368c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-19f77c35-0669-4ef1-9c37-2afbbaa69aba tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Request method failure captured: Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts/n-d-708768-8 HTTP/1.1 Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPitnUex-oNjdeo5ICe2BjXNZT3QFobuU4kywJbj1fQelis4kWZ49mCqw4J3QL6xeTAvn53A-SnZQ4vXvpQ7D8L5wI7zsala1ir7IerKeppwoeF_Sb8ehoVgsuKKPQfw4IeiZsQisyFX89bIQwJkYJB1hKL2qGKzZa8fhGoVGJXTLg Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:33.238487 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78fea069464648dc91a9fef685eb368c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78fea069464648dc91a9fef685eb368c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}] Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ad4193400023420484b67a09771c2053 Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'n-d-708768-8'} Jul 26 19:43:33.240001 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.240877 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 19:43:33.242056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.243112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-19f77c35-0669-4ef1-9c37-2afbbaa69aba tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.245998 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-19f77c35-0669-4ef1-9c37-2afbbaa69aba tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-708768-8" status: 403 len: 109 microversion: 2.1 time: 0.023122 Jul 26 19:43:33.249058 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 67/132] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hosts/n-d-708768-8 => generated 109 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.267755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f02f569-6a9c-4936-9a54-524a96a7df92 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Calling method '.version_select at 0x7f8757a149d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.284719 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-4f02f569-6a9c-4936-9a54-524a96a7df92 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f02f569-6a9c-4936-9a54-524a96a7df92 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Request method failure captured: Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPjTjOsFZ8Yq-t3xfNtYB8KeYaMWtrXvxhqASzA_Wm_ydSKRFbhx8sisDZ6z-RxszqzB6nYph3HoB-1T3KwGl_IRtyn0BWSnaYmjQ_opWHkTWZPqg0BEfKqfkU3GQuRlaQFUqpnGTPYGMeyIGnTZhRlPFMemQSi-qsNcsG5taQxwx8 Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:33.287219 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc5e72020b0a49a2a77e74ab3de056e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}] Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8f1918a20ec04d1f884e4fe559a3281f Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'nonexistent_hostname'} Jul 26 19:43:33.288432 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.289116 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.290083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.291001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f02f569-6a9c-4936-9a54-524a96a7df92 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.291001 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f02f569-6a9c-4936-9a54-524a96a7df92 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030344 Jul 26 19:43:33.291001 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 68/133] 10.222.0.58 () {58 vars in 1191 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:33.300919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1922128a-c2fe-4f69-8e04-6e757f43de3b tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Calling method '.version_select at 0x7f8757c5e670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.301999 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.301999 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:33.303772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1922128a-c2fe-4f69-8e04-6e757f43de3b tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'ad4193400023420484b67a09771c2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fea069464648dc91a9fef685eb368c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1922128a-c2fe-4f69-8e04-6e757f43de3b tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Request method failure captured: Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts/n-d-708768-8/shutdown HTTP/1.1 Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPitnUex-oNjdeo5ICe2BjXNZT3QFobuU4kywJbj1fQelis4kWZ49mCqw4J3QL6xeTAvn53A-SnZQ4vXvpQ7D8L5wI7zsala1ir7IerKeppwoeF_Sb8ehoVgsuKKPQfw4IeiZsQisyFX89bIQwJkYJB1hKL2qGKzZa8fhGoVGJXTLg Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:33.305336 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78fea069464648dc91a9fef685eb368c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78fea069464648dc91a9fef685eb368c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}] Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ad4193400023420484b67a09771c2053 Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'n-d-708768-8'} Jul 26 19:43:33.308577 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.309268 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 19:43:33.310228 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.311100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1922128a-c2fe-4f69-8e04-6e757f43de3b tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.311100 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1922128a-c2fe-4f69-8e04-6e757f43de3b tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-708768-8/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.013159 Jul 26 19:43:33.312289 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 69/134] 10.222.0.58 () {58 vars in 1194 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hosts/n-d-708768-8/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:43:33.326005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-936272ca-9148-4bb7-a55e-63b998389b35 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Calling method '.version_select at 0x7f8757b3f310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.345792 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-936272ca-9148-4bb7-a55e-63b998389b35 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-936272ca-9148-4bb7-a55e-63b998389b35 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Request method failure captured: Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPjTjOsFZ8Yq-t3xfNtYB8KeYaMWtrXvxhqASzA_Wm_ydSKRFbhx8sisDZ6z-RxszqzB6nYph3HoB-1T3KwGl_IRtyn0BWSnaYmjQ_opWHkTWZPqg0BEfKqfkU3GQuRlaQFUqpnGTPYGMeyIGnTZhRlPFMemQSi-qsNcsG5taQxwx8 Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:33.353889 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc5e72020b0a49a2a77e74ab3de056e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}] Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8f1918a20ec04d1f884e4fe559a3281f Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'nonexistent_hostname'} Jul 26 19:43:33.355087 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:33.355799 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 19:43:33.356800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.357853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.360033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-936272ca-9148-4bb7-a55e-63b998389b35 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.360505 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-936272ca-9148-4bb7-a55e-63b998389b35 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.042710 Jul 26 19:43:33.363410 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 70/135] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:33.377031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63f7b8fd-e425-40c6-b316-64b9862cc258 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Calling method '.version_select at 0x7f8757a14a60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.377985 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.377985 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:33.379061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63f7b8fd-e425-40c6-b316-64b9862cc258 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'ad4193400023420484b67a09771c2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fea069464648dc91a9fef685eb368c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63f7b8fd-e425-40c6-b316-64b9862cc258 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Request method failure captured: Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts/n-d-708768-8/startup HTTP/1.1 Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPitnUex-oNjdeo5ICe2BjXNZT3QFobuU4kywJbj1fQelis4kWZ49mCqw4J3QL6xeTAvn53A-SnZQ4vXvpQ7D8L5wI7zsala1ir7IerKeppwoeF_Sb8ehoVgsuKKPQfw4IeiZsQisyFX89bIQwJkYJB1hKL2qGKzZa8fhGoVGJXTLg Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:33.381328 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78fea069464648dc91a9fef685eb368c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78fea069464648dc91a9fef685eb368c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}] Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ad4193400023420484b67a09771c2053 Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'n-d-708768-8'} Jul 26 19:43:33.382454 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.383249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 19:43:33.384370 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.385257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63f7b8fd-e425-40c6-b316-64b9862cc258 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.385257 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63f7b8fd-e425-40c6-b316-64b9862cc258 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-708768-8/startup" status: 403 len: 110 microversion: 2.1 time: 0.013975 Jul 26 19:43:33.385257 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 71/136] 10.222.0.58 () {58 vars in 1191 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hosts/n-d-708768-8/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:43:33.391368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12aa5a89-a9fc-4908-9802-f86eeb42ee38 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Calling method '.version_select at 0x7f87647251f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.392043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4adb917-bb22-42aa-acd8-c2523c733450 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Calling method '.version_select at 0x7f8757b2da60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.392663 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.392663 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:33.393772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-12aa5a89-a9fc-4908-9802-f86eeb42ee38 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cffa6c3d8d8f42df8626b985d2b39961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea7b8a883b443ac8d0c758bb7843fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12aa5a89-a9fc-4908-9802-f86eeb42ee38 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Request method failure captured: Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPjCSj4VURF4HAKcE_4X0LNeeHbt0EknpzKoo6lbByxnvvPjNNRpnPDQveQ_dR3uoiHo-SduWISFBkE9AxvQmcqzs1cnogeB5sVZE9P7CJ8P4EQBJVzP7yRISZJ3WQ_ugGCQXd2Hn8QxSmq06MKPsGfi4LNcUWqgMLyeceykGmx2Rw Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:33.396863 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eea7b8a883b443ac8d0c758bb7843fbf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}] Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cffa6c3d8d8f42df8626b985d2b39961 Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: action_args: {} Jul 26 19:43:33.398773 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.399712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 19:43:33.400928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.402315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12aa5a89-a9fc-4908-9802-f86eeb42ee38 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.402315 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-12aa5a89-a9fc-4908-9802-f86eeb42ee38 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.402396 Jul 26 19:43:33.410793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b4adb917-bb22-42aa-acd8-c2523c733450 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4adb917-bb22-42aa-acd8-c2523c733450 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Request method failure captured: Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPjTjOsFZ8Yq-t3xfNtYB8KeYaMWtrXvxhqASzA_Wm_ydSKRFbhx8sisDZ6z-RxszqzB6nYph3HoB-1T3KwGl_IRtyn0BWSnaYmjQ_opWHkTWZPqg0BEfKqfkU3GQuRlaQFUqpnGTPYGMeyIGnTZhRlPFMemQSi-qsNcsG5taQxwx8 Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:33.412844 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc5e72020b0a49a2a77e74ab3de056e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}] Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8f1918a20ec04d1f884e4fe559a3281f Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'nonexistent_hostname'} Jul 26 19:43:33.414299 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:33.414983 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 19:43:33.416230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.418320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4adb917-bb22-42aa-acd8-c2523c733450 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.419564 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 66/137] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Jul 26 19:43:32 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 414 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.419710 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4adb917-bb22-42aa-acd8-c2523c733450 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.025858 Jul 26 19:43:33.420988 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1215 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:33.421629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d96507db-d817-4320-8645-43261e67ac26 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Calling method '.version_select at 0x7f87646783a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.422493 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.422493 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:33.423599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d96507db-d817-4320-8645-43261e67ac26 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cffa6c3d8d8f42df8626b985d2b39961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea7b8a883b443ac8d0c758bb7843fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d96507db-d817-4320-8645-43261e67ac26 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Request method failure captured: Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPjCSj4VURF4HAKcE_4X0LNeeHbt0EknpzKoo6lbByxnvvPjNNRpnPDQveQ_dR3uoiHo-SduWISFBkE9AxvQmcqzs1cnogeB5sVZE9P7CJ8P4EQBJVzP7yRISZJ3WQ_ugGCQXd2Hn8QxSmq06MKPsGfi4LNcUWqgMLyeceykGmx2Rw Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:33.425210 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eea7b8a883b443ac8d0c758bb7843fbf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}] Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cffa6c3d8d8f42df8626b985d2b39961 Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: action_args: {} Jul 26 19:43:33.426391 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.427069 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 19:43:33.428068 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.429040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c4655f9-f184-4b5b-a13f-5e367807f480 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.429125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d96507db-d817-4320-8645-43261e67ac26 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.429738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c4655f9-f184-4b5b-a13f-5e367807f480 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:33.432383 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d96507db-d817-4320-8645-43261e67ac26 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017773 Jul 26 19:43:33.433256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c4655f9-f184-4b5b-a13f-5e367807f480 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.433824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c4655f9-f184-4b5b-a13f-5e367807f480 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.434805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c4655f9-f184-4b5b-a13f-5e367807f480 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.435250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c4655f9-f184-4b5b-a13f-5e367807f480 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.440367 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 67/139] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.449288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e294cec3-1406-4ba7-96e7-78c692936758 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Action: 'update', calling method: .version_select at 0x7f876471e0d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e294cec3-1406-4ba7-96e7-78c692936758 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Request method failure captured: Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/os-hosts/n-d-708768-8 HTTP/1.1 Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 51 Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPjTjOsFZ8Yq-t3xfNtYB8KeYaMWtrXvxhqASzA_Wm_ydSKRFbhx8sisDZ6z-RxszqzB6nYph3HoB-1T3KwGl_IRtyn0BWSnaYmjQ_opWHkTWZPqg0BEfKqfkU3GQuRlaQFUqpnGTPYGMeyIGnTZhRlPFMemQSi-qsNcsG5taQxwx8 Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:33.459428 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc5e72020b0a49a2a77e74ab3de056e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}] Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 8f1918a20ec04d1f884e4fe559a3281f Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: {"status": "enable", "maintenance_mode": "invalid"} Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:43:33.460711 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'n-d-708768-8', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance: Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.461414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.462756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.464795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.464795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:43:33.464795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:43:33.464795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 19:43:33.464795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.466382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e294cec3-1406-4ba7-96e7-78c692936758 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.467441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e294cec3-1406-4ba7-96e7-78c692936758 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-708768-8" status: 400 len: 199 microversion: 2.1 time: 0.025944 Jul 26 19:43:33.468365 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 68/140] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:43:33 2022] PUT /compute/v2.1/os-hosts/n-d-708768-8 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:43:33.476516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f6ce9f3c-e55c-40c9-9b7a-451f12ba9eee tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Calling method '.version_select at 0x7f876476c160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.477950 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.477950 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:33.479490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f6ce9f3c-e55c-40c9-9b7a-451f12ba9eee tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cffa6c3d8d8f42df8626b985d2b39961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea7b8a883b443ac8d0c758bb7843fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f6ce9f3c-e55c-40c9-9b7a-451f12ba9eee tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Request method failure captured: Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPjCSj4VURF4HAKcE_4X0LNeeHbt0EknpzKoo6lbByxnvvPjNNRpnPDQveQ_dR3uoiHo-SduWISFBkE9AxvQmcqzs1cnogeB5sVZE9P7CJ8P4EQBJVzP7yRISZJ3WQ_ugGCQXd2Hn8QxSmq06MKPsGfi4LNcUWqgMLyeceykGmx2Rw Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:33.481585 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eea7b8a883b443ac8d0c758bb7843fbf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}] Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cffa6c3d8d8f42df8626b985d2b39961 Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: action_args: {} Jul 26 19:43:33.482839 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.483598 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 19:43:33.484697 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.485594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f6ce9f3c-e55c-40c9-9b7a-451f12ba9eee tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.486440 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f6ce9f3c-e55c-40c9-9b7a-451f12ba9eee tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.016991 Jul 26 19:43:33.492115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 69/141] 10.222.0.58 () {58 vars in 1179 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.492294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5cc2b172-136b-4d2b-bc38-85c44c1bf59c tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Action: 'update', calling method: .version_select at 0x7f8764621040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5cc2b172-136b-4d2b-bc38-85c44c1bf59c tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Request method failure captured: Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/os-hosts/n-d-708768-8 HTTP/1.1 Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 51 Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPjTjOsFZ8Yq-t3xfNtYB8KeYaMWtrXvxhqASzA_Wm_ydSKRFbhx8sisDZ6z-RxszqzB6nYph3HoB-1T3KwGl_IRtyn0BWSnaYmjQ_opWHkTWZPqg0BEfKqfkU3GQuRlaQFUqpnGTPYGMeyIGnTZhRlPFMemQSi-qsNcsG5taQxwx8 Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:33.498344 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc5e72020b0a49a2a77e74ab3de056e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}] Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 8f1918a20ec04d1f884e4fe559a3281f Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: {"status": "invalid", "maintenance_mode": "enable"} Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:43:33.499769 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'n-d-708768-8', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance: Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.500630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.501966 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.503034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.503034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:43:33.503034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:43:33.503034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 19:43:33.503034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.503034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5cc2b172-136b-4d2b-bc38-85c44c1bf59c tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.503034 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5cc2b172-136b-4d2b-bc38-85c44c1bf59c tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-708768-8" status: 400 len: 189 microversion: 2.1 time: 0.011734 Jul 26 19:43:33.506976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 70/142] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:43:33 2022] PUT /compute/v2.1/os-hosts/n-d-708768-8 => generated 189 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:43:33.616806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c4655f9-f184-4b5b-a13f-5e367807f480 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.626087 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c4655f9-f184-4b5b-a13f-5e367807f480 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.204365 Jul 26 19:43:33.626672 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 73/143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:33.635293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88637e46-cce0-460b-b61a-645acd63db90 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Action: 'update', calling method: .version_select at 0x7f8757b3faf0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:33.640234 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.640234 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:33.642022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-88637e46-cce0-460b-b61a-645acd63db90 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'ad4193400023420484b67a09771c2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fea069464648dc91a9fef685eb368c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88637e46-cce0-460b-b61a-645acd63db90 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Request method failure captured: Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/os-hosts/n-d-708768-8 HTTP/1.1 Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 50 Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPitnUex-oNjdeo5ICe2BjXNZT3QFobuU4kywJbj1fQelis4kWZ49mCqw4J3QL6xeTAvn53A-SnZQ4vXvpQ7D8L5wI7zsala1ir7IerKeppwoeF_Sb8ehoVgsuKKPQfw4IeiZsQisyFX89bIQwJkYJB1hKL2qGKzZa8fhGoVGJXTLg Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:33.643972 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/78fea069464648dc91a9fef685eb368c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_78fea069464648dc91a9fef685eb368c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/78fea069464648dc91a9fef685eb368c"}]}] Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 78fea069464648dc91a9fef685eb368c Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815315643 Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ad4193400023420484b67a09771c2053 Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815315643-project Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: {"status": "enable", "maintenance_mode": "enable"} Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 19:43:33.646029 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'n-d-708768-8', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.646918 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 19:43:33.647974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.648975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88637e46-cce0-460b-b61a-645acd63db90 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.648975 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88637e46-cce0-460b-b61a-645acd63db90 tempest-HostsAdminNegativeTestJSON-815315643 tempest-HostsAdminNegativeTestJSON-815315643-project] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-708768-8" status: 403 len: 111 microversion: 2.1 time: 0.018566 Jul 26 19:43:33.651083 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 74/144] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:43:33 2022] PUT /compute/v2.1/os-hosts/n-d-708768-8 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.656415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9de9996c-56b5-4f61-b5b3-eb5f3f7a7c39 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.657271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9de9996c-56b5-4f61-b5b3-eb5f3f7a7c39 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:33.664916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9de9996c-56b5-4f61-b5b3-eb5f3f7a7c39 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.665449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9de9996c-56b5-4f61-b5b3-eb5f3f7a7c39 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.666317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9de9996c-56b5-4f61-b5b3-eb5f3f7a7c39 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.666973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9de9996c-56b5-4f61-b5b3-eb5f3f7a7c39 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.729903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-025cad3f-82b2-487c-b1b2-3297a8811e41 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Calling method '.version_select at 0x7f876477fc10>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.731830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025cad3f-82b2-487c-b1b2-3297a8811e41 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.732280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025cad3f-82b2-487c-b1b2-3297a8811e41 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.743143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9de9996c-56b5-4f61-b5b3-eb5f3f7a7c39 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.749484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025cad3f-82b2-487c-b1b2-3297a8811e41 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.750154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025cad3f-82b2-487c-b1b2-3297a8811e41 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.751838 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9de9996c-56b5-4f61-b5b3-eb5f3f7a7c39 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1317 microversion: 2.1 time: 0.099246 Jul 26 19:43:33.752407 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 75/145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1317 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:33.765871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025cad3f-82b2-487c-b1b2-3297a8811e41 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.766376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025cad3f-82b2-487c-b1b2-3297a8811e41 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.772759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f4e32dea-a7b7-4335-96d3-04d3e1ace1e7 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Action: 'update', calling method: .version_select at 0x7f8757b2d160>, body: {"status": null, "maintenance_mode": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:33.773543 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-025cad3f-82b2-487c-b1b2-3297a8811e41 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.265330 Jul 26 19:43:33.774526 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 71/146] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f4e32dea-a7b7-4335-96d3-04d3e1ace1e7 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Request method failure captured: Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/os-hosts/n-d-708768-8 HTTP/1.1 Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 42 Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPjTjOsFZ8Yq-t3xfNtYB8KeYaMWtrXvxhqASzA_Wm_ydSKRFbhx8sisDZ6z-RxszqzB6nYph3HoB-1T3KwGl_IRtyn0BWSnaYmjQ_opWHkTWZPqg0BEfKqfkU3GQuRlaQFUqpnGTPYGMeyIGnTZhRlPFMemQSi-qsNcsG5taQxwx8 Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:33.783289 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc5e72020b0a49a2a77e74ab3de056e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}] Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8f1918a20ec04d1f884e4fe559a3281f Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: {"status": null, "maintenance_mode": null} Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 19:43:33.784602 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'n-d-708768-8', 'body': {'status': None, 'maintenance_mode': None}} Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance: Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi None Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.785360 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.787317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.791342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:43:33.791342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:43:33.791342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 19:43:33.791342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.792035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18a71fa4-6072-4390-9abc-e846e2cb2372 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Calling method '.version_select at 0x7f876477fb80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.792187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f4e32dea-a7b7-4335-96d3-04d3e1ace1e7 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.792330 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.792330 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:33.792597 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f4e32dea-a7b7-4335-96d3-04d3e1ace1e7 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-708768-8" status: 400 len: 127 microversion: 2.1 time: 0.026437 Jul 26 19:43:33.792597 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 76/147] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:43:33 2022] PUT /compute/v2.1/os-hosts/n-d-708768-8 => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18a71fa4-6072-4390-9abc-e846e2cb2372 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cffa6c3d8d8f42df8626b985d2b39961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea7b8a883b443ac8d0c758bb7843fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18a71fa4-6072-4390-9abc-e846e2cb2372 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Request method failure captured: Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPjCSj4VURF4HAKcE_4X0LNeeHbt0EknpzKoo6lbByxnvvPjNNRpnPDQveQ_dR3uoiHo-SduWISFBkE9AxvQmcqzs1cnogeB5sVZE9P7CJ8P4EQBJVzP7yRISZJ3WQ_ugGCQXd2Hn8QxSmq06MKPsGfi4LNcUWqgMLyeceykGmx2Rw Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:33.792877 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eea7b8a883b443ac8d0c758bb7843fbf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}] Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cffa6c3d8d8f42df8626b985d2b39961 Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '1'} Jul 26 19:43:33.796785 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.798504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 19:43:33.800546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.802262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18a71fa4-6072-4390-9abc-e846e2cb2372 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.802262 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18a71fa4-6072-4390-9abc-e846e2cb2372 tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012715 Jul 26 19:43:33.802262 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 72/148] 10.222.0.58 () {58 vars in 1173 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.803190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aac81a84-6d2a-48d2-86c8-29d91b409b89 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Action: 'update', calling method: .version_select at 0x7f8757c76ee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:33.803553 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.803553 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:33.804139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22d79a13-5b6b-4c07-92d2-a8f5771a587b tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Calling method '.version_select at 0x7f8764807160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.806425 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-22d79a13-5b6b-4c07-92d2-a8f5771a587b tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] HTTP exception thrown: Hypervisor with ID 'bf3f4c61-5dac-4dc1-8f4a-cb169c175b89' could not be found. Jul 26 19:43:33.809090 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.hosts [None req-aac81a84-6d2a-48d2-86c8-29d91b409b89 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Enabling host nonexistent_hostname. Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22d79a13-5b6b-4c07-92d2-a8f5771a587b tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Request method failure captured: Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-hypervisors/bf3f4c61-5dac-4dc1-8f4a-cb169c175b89/uptime HTTP/1.1 Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPkCKikUz9_R7Sg5cCehrhlI9j5pXSXsaK3XG18Biuzpciqh7MC5hjNSXmq6ifVdXmhgDdyPRKr3GbeT5Ij9zKE9WXtiIfF67e2Lo3w6cCQCHZm85eCixDQHtmLxcUS_co6HuzK4Jcvur1DEr0v-FmKU_ed2CEqOcWqm1A81l2As-U Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 1dc1cadc76bf4524908bb65822d0c560 Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1740909306 Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:33.816343 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1dc1cadc76bf4524908bb65822d0c560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1dc1cadc76bf4524908bb65822d0c560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1dc1cadc76bf4524908bb65822d0c560", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1dc1cadc76bf4524908bb65822d0c560"}]}] Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1740909306 Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 1dc1cadc76bf4524908bb65822d0c560 Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1740909306 Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 53ef3b46f44a4c22ab40c4b2c2aae3eb Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: exception: Hypervisor with ID 'bf3f4c61-5dac-4dc1-8f4a-cb169c175b89' could not be found. Jul 26 19:43:33.818672 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'bf3f4c61-5dac-4dc1-8f4a-cb169c175b89'} Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'bf3f4c61-5dac-4dc1-8f4a-cb169c175b89' Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 26 19:43:33.819434 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'bf3f4c61-5dac-4dc1-8f4a-cb169c175b89' could not be found. Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.820666 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'bf3f4c61-5dac-4dc1-8f4a-cb169c175b89' could not be found. Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22d79a13-5b6b-4c07-92d2-a8f5771a587b tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Returning 404 to user: Hypervisor with ID 'bf3f4c61-5dac-4dc1-8f4a-cb169c175b89' could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22d79a13-5b6b-4c07-92d2-a8f5771a587b tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/bf3f4c61-5dac-4dc1-8f4a-cb169c175b89/uptime" status: 404 len: 123 microversion: 2.1 time: 0.019084 Jul 26 19:43:33.821820 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 73/149] 10.222.0.58 () {58 vars in 1278 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hypervisors/bf3f4c61-5dac-4dc1-8f4a-cb169c175b89/uptime => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:43:33.828289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dcd426b9-7c17-4190-accc-723d49bc245f tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Calling method '.version_select at 0x7f8764621310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.829655 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.829655 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:33.831488 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-aac81a84-6d2a-48d2-86c8-29d91b409b89 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aac81a84-6d2a-48d2-86c8-29d91b409b89 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Request method failure captured: Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 50 Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPjTjOsFZ8Yq-t3xfNtYB8KeYaMWtrXvxhqASzA_Wm_ydSKRFbhx8sisDZ6z-RxszqzB6nYph3HoB-1T3KwGl_IRtyn0BWSnaYmjQ_opWHkTWZPqg0BEfKqfkU3GQuRlaQFUqpnGTPYGMeyIGnTZhRlPFMemQSi-qsNcsG5taQxwx8 Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:33.834550 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc5e72020b0a49a2a77e74ab3de056e0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc5e72020b0a49a2a77e74ab3de056e0"}]}] Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: cc5e72020b0a49a2a77e74ab3de056e0 Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1776111001 Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8f1918a20ec04d1f884e4fe559a3281f Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1776111001-project-admin Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: {"status": "enable", "maintenance_mode": "enable"} Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.836441 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 19:43:33.837660 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:33.838623 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.839699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aac81a84-6d2a-48d2-86c8-29d91b409b89 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.840688 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aac81a84-6d2a-48d2-86c8-29d91b409b89 tempest-HostsAdminNegativeTestJSON-1776111001 tempest-HostsAdminNegativeTestJSON-1776111001-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.043163 Jul 26 19:43:33.840688 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 77/150] 10.222.0.58 () {60 vars in 1211 bytes} [Tue Jul 26 19:43:33 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:33.840850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd426b9-7c17-4190-accc-723d49bc245f tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.840850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd426b9-7c17-4190-accc-723d49bc245f tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.858115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd426b9-7c17-4190-accc-723d49bc245f tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.858898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd426b9-7c17-4190-accc-723d49bc245f tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.882727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd426b9-7c17-4190-accc-723d49bc245f tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:33.883334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd426b9-7c17-4190-accc-723d49bc245f tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:33.890238 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dcd426b9-7c17-4190-accc-723d49bc245f tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065398 Jul 26 19:43:33.891279 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 74/151] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:33.903852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-adddf384-cd26-4032-ba46-1a827130323d tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Calling method '.version_select at 0x7f8757b3f4c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.904752 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.904752 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:33.906350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-adddf384-cd26-4032-ba46-1a827130323d tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cffa6c3d8d8f42df8626b985d2b39961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea7b8a883b443ac8d0c758bb7843fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-adddf384-cd26-4032-ba46-1a827130323d tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Request method failure captured: Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPjCSj4VURF4HAKcE_4X0LNeeHbt0EknpzKoo6lbByxnvvPjNNRpnPDQveQ_dR3uoiHo-SduWISFBkE9AxvQmcqzs1cnogeB5sVZE9P7CJ8P4EQBJVzP7yRISZJ3WQ_ugGCQXd2Hn8QxSmq06MKPsGfi4LNcUWqgMLyeceykGmx2Rw Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:33.908586 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eea7b8a883b443ac8d0c758bb7843fbf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eea7b8a883b443ac8d0c758bb7843fbf"}]}] Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: eea7b8a883b443ac8d0c758bb7843fbf Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570 Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: cffa6c3d8d8f42df8626b985d2b39961 Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1389298570-project Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '1'} Jul 26 19:43:33.911052 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:33.911939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 19:43:33.913009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.914522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-adddf384-cd26-4032-ba46-1a827130323d tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.914522 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-adddf384-cd26-4032-ba46-1a827130323d tempest-HypervisorAdminNegativeTestJSON-1389298570 tempest-HypervisorAdminNegativeTestJSON-1389298570-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016321 Jul 26 19:43:33.916482 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 78/152] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:33.928379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4c9edf8-a989-40d8-94dc-be9241844bf4 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Calling method '.version_select at 0x7f8764807ca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:33.929456 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:33.929456 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:33.930536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-b4c9edf8-a989-40d8-94dc-be9241844bf4 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] HTTP exception thrown: Hypervisor with ID 'a4033242-2283-49e3-9251-d483fc40d714' could not be found. Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4c9edf8-a989-40d8-94dc-be9241844bf4 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Request method failure captured: Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-hypervisors/a4033242-2283-49e3-9251-d483fc40d714 HTTP/1.1 Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPkCKikUz9_R7Sg5cCehrhlI9j5pXSXsaK3XG18Biuzpciqh7MC5hjNSXmq6ifVdXmhgDdyPRKr3GbeT5Ij9zKE9WXtiIfF67e2Lo3w6cCQCHZm85eCixDQHtmLxcUS_co6HuzK4Jcvur1DEr0v-FmKU_ed2CEqOcWqm1A81l2As-U Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 1dc1cadc76bf4524908bb65822d0c560 Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1740909306 Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:33.933655 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1dc1cadc76bf4524908bb65822d0c560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1dc1cadc76bf4524908bb65822d0c560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1dc1cadc76bf4524908bb65822d0c560", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1dc1cadc76bf4524908bb65822d0c560"}]}] Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1740909306 Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 1dc1cadc76bf4524908bb65822d0c560 Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1740909306 Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 53ef3b46f44a4c22ab40c4b2c2aae3eb Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: exception: Hypervisor with ID 'a4033242-2283-49e3-9251-d483fc40d714' could not be found. Jul 26 19:43:33.934833 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a4033242-2283-49e3-9251-d483fc40d714'} Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a4033242-2283-49e3-9251-d483fc40d714' Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 26 19:43:33.935489 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 19:43:33.936714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a4033242-2283-49e3-9251-d483fc40d714' could not be found. Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a4033242-2283-49e3-9251-d483fc40d714' could not be found. Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:33.937777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4c9edf8-a989-40d8-94dc-be9241844bf4 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] Returning 404 to user: Hypervisor with ID 'a4033242-2283-49e3-9251-d483fc40d714' could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:33.938435 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4c9edf8-a989-40d8-94dc-be9241844bf4 tempest-HypervisorAdminNegativeTestJSON-1740909306 tempest-HypervisorAdminNegativeTestJSON-1740909306-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/a4033242-2283-49e3-9251-d483fc40d714" status: 404 len: 123 microversion: 2.1 time: 0.015982 Jul 26 19:43:33.940782 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 75/153] 10.222.0.58 () {58 vars in 1257 bytes} [Tue Jul 26 19:43:33 2022] GET /compute/v2.1/os-hypervisors/a4033242-2283-49e3-9251-d483fc40d714 => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:34.016330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b1df294-5934-419c-8fb7-70f17fe739fb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:34.021325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6b1df294-5934-419c-8fb7-70f17fe739fb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:34.041746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b1df294-5934-419c-8fb7-70f17fe739fb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:34.045427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b1df294-5934-419c-8fb7-70f17fe739fb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:34.047534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b1df294-5934-419c-8fb7-70f17fe739fb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:34.051056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b1df294-5934-419c-8fb7-70f17fe739fb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:34.389082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6b1df294-5934-419c-8fb7-70f17fe739fb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:34.413876 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b1df294-5934-419c-8fb7-70f17fe739fb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.401257 Jul 26 19:43:34.415525 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 79/154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:34 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:34.651264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1da356c9-3631-4931-836d-f4dd15ecd414 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:34.652594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1da356c9-3631-4931-836d-f4dd15ecd414 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:34.660232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1da356c9-3631-4931-836d-f4dd15ecd414 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:34.660763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1da356c9-3631-4931-836d-f4dd15ecd414 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:34.661723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1da356c9-3631-4931-836d-f4dd15ecd414 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:34.662174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1da356c9-3631-4931-836d-f4dd15ecd414 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:34.774471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1c1ca9b-ba99-467f-877a-f6f5f64b6d55 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:34.775446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f1c1ca9b-ba99-467f-877a-f6f5f64b6d55 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:34.785566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1c1ca9b-ba99-467f-877a-f6f5f64b6d55 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:34.787996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1c1ca9b-ba99-467f-877a-f6f5f64b6d55 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:34.790492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1c1ca9b-ba99-467f-877a-f6f5f64b6d55 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:34.791147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1c1ca9b-ba99-467f-877a-f6f5f64b6d55 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:34.939563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1da356c9-3631-4931-836d-f4dd15ecd414 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:34.960689 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1da356c9-3631-4931-836d-f4dd15ecd414 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1335 microversion: 2.1 time: 0.314860 Jul 26 19:43:34.961539 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 76/155] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:34 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1335 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:34.972363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-aa1a7347-f9e4-42e0-9093-0adf5c05a7f4 req-ea475634-0cee-4993-bd2b-49c8c3270f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa4d676-0350-4966-98db-fdf47eccbf14", "name": "network-vif-plugged", "status": "completed", "tag": "83f1aae3-3089-4513-9f52-28d010801468"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:34.987209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aa1a7347-f9e4-42e0-9093-0adf5c05a7f4 req-ea475634-0cee-4993-bd2b-49c8c3270f66 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:34.988240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aa1a7347-f9e4-42e0-9093-0adf5c05a7f4 req-ea475634-0cee-4993-bd2b-49c8c3270f66 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:35.000971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f1c1ca9b-ba99-467f-877a-f6f5f64b6d55 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:35.011287 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f1c1ca9b-ba99-467f-877a-f6f5f64b6d55 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1323 microversion: 2.1 time: 0.241337 Jul 26 19:43:35.017793 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 80/156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:34 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:35.027673 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aa1a7347-f9e4-42e0-9093-0adf5c05a7f4 req-ea475634-0cee-4993-bd2b-49c8c3270f66 service nova] Creating event network-vif-plugged:83f1aae3-3089-4513-9f52-28d010801468 for instance daa4d676-0350-4966-98db-fdf47eccbf14 on n-h1-708768-8 Jul 26 19:43:35.028185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aa1a7347-f9e4-42e0-9093-0adf5c05a7f4 req-ea475634-0cee-4993-bd2b-49c8c3270f66 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:43:35.029274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17f8f73c-3ab4-4c18-98ab-53ea55934e62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:35.029875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17f8f73c-3ab4-4c18-98ab-53ea55934e62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:35.031437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17f8f73c-3ab4-4c18-98ab-53ea55934e62 None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:35.032051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17f8f73c-3ab4-4c18-98ab-53ea55934e62 None None] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:35.047233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.rpcapi [None req-17f8f73c-3ab4-4c18-98ab-53ea55934e62 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 19:43:35.049601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17f8f73c-3ab4-4c18-98ab-53ea55934e62 None None] Releasing lock "compute-rpcapi-router" {{(pid=125963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:43:35.075868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-17f8f73c-3ab4-4c18-98ab-53ea55934e62 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112849 Jul 26 19:43:35.076705 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 77/157] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:35.436451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3b728b50-45bb-477a-8e15-16d852756b67 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:35.437075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3b728b50-45bb-477a-8e15-16d852756b67 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:35.488387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b728b50-45bb-477a-8e15-16d852756b67 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:35.489320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b728b50-45bb-477a-8e15-16d852756b67 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:35.490792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b728b50-45bb-477a-8e15-16d852756b67 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:35.491299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b728b50-45bb-477a-8e15-16d852756b67 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:35.894192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3b728b50-45bb-477a-8e15-16d852756b67 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:35.912507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3b728b50-45bb-477a-8e15-16d852756b67 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1338 microversion: 2.1 time: 0.478182 Jul 26 19:43:35.913550 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 81/158] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:35 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1338 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:35.983244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f440e9fc-4cb2-41d8-a9ef-ca61a1aad21c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:35.984121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f440e9fc-4cb2-41d8-a9ef-ca61a1aad21c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:35.994834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f440e9fc-4cb2-41d8-a9ef-ca61a1aad21c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:35.995297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f440e9fc-4cb2-41d8-a9ef-ca61a1aad21c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:35.999945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f440e9fc-4cb2-41d8-a9ef-ca61a1aad21c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:36.000486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f440e9fc-4cb2-41d8-a9ef-ca61a1aad21c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:36.041858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29a26695-1f39-45a3-8866-ff7ec6789666 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:36.043238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-29a26695-1f39-45a3-8866-ff7ec6789666 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:36.055664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29a26695-1f39-45a3-8866-ff7ec6789666 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:36.060299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29a26695-1f39-45a3-8866-ff7ec6789666 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:36.064107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29a26695-1f39-45a3-8866-ff7ec6789666 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:36.066645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29a26695-1f39-45a3-8866-ff7ec6789666 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:36.233764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-29a26695-1f39-45a3-8866-ff7ec6789666 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:36.249790 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29a26695-1f39-45a3-8866-ff7ec6789666 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1323 microversion: 2.1 time: 0.213738 Jul 26 19:43:36.250944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 82/159] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:36 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:36.518432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f440e9fc-4cb2-41d8-a9ef-ca61a1aad21c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:36.527987 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f440e9fc-4cb2-41d8-a9ef-ca61a1aad21c tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1484 microversion: 2.1 time: 0.549075 Jul 26 19:43:36.532046 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 78/160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:35 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1484 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:36.938419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18937b3e-b45d-4a84-8986-db0214c29e2a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:36.939359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18937b3e-b45d-4a84-8986-db0214c29e2a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:36.953016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18937b3e-b45d-4a84-8986-db0214c29e2a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:36.953869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18937b3e-b45d-4a84-8986-db0214c29e2a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:36.954809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18937b3e-b45d-4a84-8986-db0214c29e2a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:36.955466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18937b3e-b45d-4a84-8986-db0214c29e2a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.164869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a29e9ee-5f2a-4a92-9c14-b81f1d2a5273 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Calling method '.version_select at 0x7f8757bca5e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:37.196188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a29e9ee-5f2a-4a92-9c14-b81f1d2a5273 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.196707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a29e9ee-5f2a-4a92-9c14-b81f1d2a5273 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.243913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a29e9ee-5f2a-4a92-9c14-b81f1d2a5273 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.244367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a29e9ee-5f2a-4a92-9c14-b81f1d2a5273 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.275553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a29e9ee-5f2a-4a92-9c14-b81f1d2a5273 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/bce247c23c2a4b80a654a31438a8c1b8?start=2022-07-25T19%3A43%3A36.551659&end=2022-07-27T19%3A43%3A36.551659" status: 200 len: 695 microversion: 2.1 time: 0.719960 Jul 26 19:43:37.288424 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 83/161] 10.222.0.58 () {58 vars in 1412 bytes} [Tue Jul 26 19:43:36 2022] GET /compute/v2.1/os-simple-tenant-usage/bce247c23c2a4b80a654a31438a8c1b8?start=2022-07-25T19%3A43%3A36.551659&end=2022-07-27T19%3A43%3A36.551659 => generated 695 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:37.293705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-18dd3ed0-4823-4071-a369-8d73bddc64c8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:37.294412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-18dd3ed0-4823-4071-a369-8d73bddc64c8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:37.312890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18dd3ed0-4823-4071-a369-8d73bddc64c8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.313616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18dd3ed0-4823-4071-a369-8d73bddc64c8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.314525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18dd3ed0-4823-4071-a369-8d73bddc64c8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.315039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18dd3ed0-4823-4071-a369-8d73bddc64c8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.439088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-18dd3ed0-4823-4071-a369-8d73bddc64c8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:37.453013 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-18dd3ed0-4823-4071-a369-8d73bddc64c8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1323 microversion: 2.1 time: 0.162946 Jul 26 19:43:37.453977 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 84/162] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:37 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:37.459208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f8dd6621-4f34-4e94-8567-468d24774de5 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '.version_select at 0x7f8757b2d5e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:37.478451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8dd6621-4f34-4e94-8567-468d24774de5 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.480370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8dd6621-4f34-4e94-8567-468d24774de5 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.500658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8dd6621-4f34-4e94-8567-468d24774de5 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.502449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8dd6621-4f34-4e94-8567-468d24774de5 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.524872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18937b3e-b45d-4a84-8986-db0214c29e2a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:37.531965 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f8dd6621-4f34-4e94-8567-468d24774de5 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/bce247c23c2a4b80a654a31438a8c1b8?start=2022-07-25T19%3A43%3A36.551659&end=2022-07-27T19%3A43%3A36.551659" status: 200 len: 695 microversion: 2.1 time: 0.076453 Jul 26 19:43:37.539507 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18937b3e-b45d-4a84-8986-db0214c29e2a tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1488 microversion: 2.1 time: 0.605718 Jul 26 19:43:37.540314 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 79/163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:36 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1488 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:37.542045 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 85/164] 10.222.0.58 () {58 vars in 1412 bytes} [Tue Jul 26 19:43:37 2022] GET /compute/v2.1/os-simple-tenant-usage/bce247c23c2a4b80a654a31438a8c1b8?start=2022-07-25T19%3A43%3A36.551659&end=2022-07-27T19%3A43%3A36.551659 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:37.546844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-578990bd-83ad-41f1-a2d2-dfc6b90860b8 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Calling method '.version_select at 0x7f87645bb1f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:37.568459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9535eb6c-f3c7-4447-b892-2c86c36df7b8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:37.569086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9535eb6c-f3c7-4447-b892-2c86c36df7b8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:37.578276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-578990bd-83ad-41f1-a2d2-dfc6b90860b8 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.580159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9535eb6c-f3c7-4447-b892-2c86c36df7b8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.580377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-578990bd-83ad-41f1-a2d2-dfc6b90860b8 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.581182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9535eb6c-f3c7-4447-b892-2c86c36df7b8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.585829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9535eb6c-f3c7-4447-b892-2c86c36df7b8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.586558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9535eb6c-f3c7-4447-b892-2c86c36df7b8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.636692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-578990bd-83ad-41f1-a2d2-dfc6b90860b8 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.637153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-578990bd-83ad-41f1-a2d2-dfc6b90860b8 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.690481 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-578990bd-83ad-41f1-a2d2-dfc6b90860b8 tempest-TenantUsagesTestJSON-263030334 tempest-TenantUsagesTestJSON-263030334-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T19%3A43%3A36.551659&end=2022-07-27T19%3A43%3A36.551659&detailed=1" status: 200 len: 1380 microversion: 2.1 time: 0.137207 Jul 26 19:43:37.690481 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 80/165] 10.222.0.58 () {58 vars in 1335 bytes} [Tue Jul 26 19:43:37 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T19%3A43%3A36.551659&end=2022-07-27T19%3A43%3A36.551659&detailed=1 => generated 1380 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:37.711002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9169fa50-5ae6-40a0-8fd7-8841cbb134a8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:37.711002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9169fa50-5ae6-40a0-8fd7-8841cbb134a8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:37.759819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9169fa50-5ae6-40a0-8fd7-8841cbb134a8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.760248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9169fa50-5ae6-40a0-8fd7-8841cbb134a8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.762297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9169fa50-5ae6-40a0-8fd7-8841cbb134a8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:37.775838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9169fa50-5ae6-40a0-8fd7-8841cbb134a8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:37.865604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9169fa50-5ae6-40a0-8fd7-8841cbb134a8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:43:38.002935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:38.239322 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9169fa50-5ae6-40a0-8fd7-8841cbb134a8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 204 len: 0 microversion: 2.1 time: 0.546570 Jul 26 19:43:38.239960 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 81/166] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:43:37 2022] DELETE /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:43:38.251167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3418678-4c24-4017-9d9c-d2c681b082f8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:38.263592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3418678-4c24-4017-9d9c-d2c681b082f8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:38.286896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3418678-4c24-4017-9d9c-d2c681b082f8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:38.294496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3418678-4c24-4017-9d9c-d2c681b082f8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:38.295354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3418678-4c24-4017-9d9c-d2c681b082f8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:38.295826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3418678-4c24-4017-9d9c-d2c681b082f8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:38.752672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3418678-4c24-4017-9d9c-d2c681b082f8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:38.771467 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3418678-4c24-4017-9d9c-d2c681b082f8 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1490 microversion: 2.1 time: 0.524610 Jul 26 19:43:38.783248 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 82/167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:38 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1490 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:38.794894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:38.799498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-648185ee-0c6b-44dd-882a-ba9603f9c839 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:38.803237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-648185ee-0c6b-44dd-882a-ba9603f9c839 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:38.813730 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9535eb6c-f3c7-4447-b892-2c86c36df7b8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1639 microversion: 2.1 time: 1.250162 Jul 26 19:43:38.818574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-648185ee-0c6b-44dd-882a-ba9603f9c839 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:38.820308 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 86/168] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:37 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1639 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:38.828340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-648185ee-0c6b-44dd-882a-ba9603f9c839 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:38.830506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-648185ee-0c6b-44dd-882a-ba9603f9c839 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:38.831123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-648185ee-0c6b-44dd-882a-ba9603f9c839 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:38.842300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-069135a2-fbfd-4272-ab14-dcadc005e5e1 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:38.864624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-069135a2-fbfd-4272-ab14-dcadc005e5e1 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:38.876238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-069135a2-fbfd-4272-ab14-dcadc005e5e1 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:38.877625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-069135a2-fbfd-4272-ab14-dcadc005e5e1 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:38.879859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-069135a2-fbfd-4272-ab14-dcadc005e5e1 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:38.880605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-069135a2-fbfd-4272-ab14-dcadc005e5e1 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:38.934579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-069135a2-fbfd-4272-ab14-dcadc005e5e1 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:43:39.024159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-648185ee-0c6b-44dd-882a-ba9603f9c839 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:39.039043 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-648185ee-0c6b-44dd-882a-ba9603f9c839 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1323 microversion: 2.1 time: 0.253989 Jul 26 19:43:39.039675 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 83/169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:38 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1323 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:39.735275 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-069135a2-fbfd-4272-ab14-dcadc005e5e1 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "DELETE /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 204 len: 0 microversion: 2.1 time: 0.896754 Jul 26 19:43:39.740082 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 87/170] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:43:38 2022] DELETE /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:43:39.745595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-677aed2e-d1e0-4931-8144-e8de6c2430bb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:39.746518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-677aed2e-d1e0-4931-8144-e8de6c2430bb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:39.757919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-677aed2e-d1e0-4931-8144-e8de6c2430bb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:39.758797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-677aed2e-d1e0-4931-8144-e8de6c2430bb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:39.759774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-677aed2e-d1e0-4931-8144-e8de6c2430bb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:39.761449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-677aed2e-d1e0-4931-8144-e8de6c2430bb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:39.809153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a3ea2e22-8558-4c51-b4f4-c2b1dc6d40d4 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:39.810531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a3ea2e22-8558-4c51-b4f4-c2b1dc6d40d4 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:39.831328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3ea2e22-8558-4c51-b4f4-c2b1dc6d40d4 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:39.834904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3ea2e22-8558-4c51-b4f4-c2b1dc6d40d4 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:39.835816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3ea2e22-8558-4c51-b4f4-c2b1dc6d40d4 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:39.846749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3ea2e22-8558-4c51-b4f4-c2b1dc6d40d4 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:40.131949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-677aed2e-d1e0-4931-8144-e8de6c2430bb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:40.143325 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-677aed2e-d1e0-4931-8144-e8de6c2430bb tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1494 microversion: 2.1 time: 0.398190 Jul 26 19:43:40.163958 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 84/171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:39 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1494 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:40.180085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f31f79f7-37eb-44b9-9014-316530c4c3c5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:40.184266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f31f79f7-37eb-44b9-9014-316530c4c3c5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:40.203438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f31f79f7-37eb-44b9-9014-316530c4c3c5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:40.206145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f31f79f7-37eb-44b9-9014-316530c4c3c5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:40.210848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f31f79f7-37eb-44b9-9014-316530c4c3c5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:40.211297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f31f79f7-37eb-44b9-9014-316530c4c3c5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:40.381944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f31f79f7-37eb-44b9-9014-316530c4c3c5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:40.390874 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f31f79f7-37eb-44b9-9014-316530c4c3c5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1323 microversion: 2.1 time: 0.225471 Jul 26 19:43:40.391473 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 85/172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:40 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1323 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:40.545322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a3ea2e22-8558-4c51-b4f4-c2b1dc6d40d4 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:40.569188 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a3ea2e22-8558-4c51-b4f4-c2b1dc6d40d4 tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1490 microversion: 2.1 time: 0.760906 Jul 26 19:43:40.581379 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 88/173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:39 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1490 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:41.150124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-20642224-31dc-4a1c-996f-22a7c836d387 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:41.152883 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:41.152883 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:41.154208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20642224-31dc-4a1c-996f-22a7c836d387 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.161960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20642224-31dc-4a1c-996f-22a7c836d387 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.163098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20642224-31dc-4a1c-996f-22a7c836d387 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.165969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20642224-31dc-4a1c-996f-22a7c836d387 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.167868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5a668a1-072d-44f8-ba49-6c2a1efa8763 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:41.174961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5a668a1-072d-44f8-ba49-6c2a1efa8763 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:41.191673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5a668a1-072d-44f8-ba49-6c2a1efa8763 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.195274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5a668a1-072d-44f8-ba49-6c2a1efa8763 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.196485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5a668a1-072d-44f8-ba49-6c2a1efa8763 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.197687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5a668a1-072d-44f8-ba49-6c2a1efa8763 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.247271 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-20642224-31dc-4a1c-996f-22a7c836d387 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.498541 Jul 26 19:43:41.257087 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 86/174] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:43:40 2022] GET /compute/v2.1/os-services => generated 965 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:41.341232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2057363015", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:41.421623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:43:41.737750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5a668a1-072d-44f8-ba49-6c2a1efa8763 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:41.746501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5a668a1-072d-44f8-ba49-6c2a1efa8763 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1494 microversion: 2.1 time: 0.584009 Jul 26 19:43:41.747255 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 89/175] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:41 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1494 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:41.765096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:43:41.766552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4346bce7-db44-443b-9dd1-462e28a1ba98 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:41.767055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:43:41.771043 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:41.771043 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:41.772014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:43:41.772541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:43:41.773047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:43:41.778258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4346bce7-db44-443b-9dd1-462e28a1ba98 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.781494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4346bce7-db44-443b-9dd1-462e28a1ba98 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.783892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4346bce7-db44-443b-9dd1-462e28a1ba98 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.785195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4346bce7-db44-443b-9dd1-462e28a1ba98 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.791532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.792263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.793082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.793578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.806261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:41.826067 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4346bce7-db44-443b-9dd1-462e28a1ba98 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-708768-8" status: 200 len: 578 microversion: 2.1 time: 0.076860 Jul 26 19:43:41.827753 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 90/176] 10.222.0.58 () {58 vars in 1172 bytes} [Tue Jul 26 19:43:41 2022] GET /compute/v2.1/os-services?host=n-d-708768-8 => generated 578 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:41.833876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-791a7bbb-9080-482a-b99f-8042b8fc1c9b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:41.834876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-791a7bbb-9080-482a-b99f-8042b8fc1c9b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:41.842625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-791a7bbb-9080-482a-b99f-8042b8fc1c9b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.843428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-791a7bbb-9080-482a-b99f-8042b8fc1c9b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.844546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-791a7bbb-9080-482a-b99f-8042b8fc1c9b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:41.851846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-791a7bbb-9080-482a-b99f-8042b8fc1c9b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:41.889473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SAVEPOINT=1,nova_api:INSERT=5,nova_api:RELEASE=1,nova_api:SELECT=89,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:41.908859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Getting quotas for project a019aea2aed240728e898c76739c8fd6. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:43:41.917354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Getting quotas for user a84e343311cf4ca1a7ce698490e7578e and project a019aea2aed240728e898c76739c8fd6. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:43:41.933920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:43:41.952208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:43:42.043305 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-74db35b1-edb1-4586-b10d-74652e568ebe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784904 Jul 26 19:43:42.062433 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 87/177] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:43:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:43:42.077284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-35de9f7a-1c38-4b26-b721-f2c93aa228dd tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:42.078303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-35de9f7a-1c38-4b26-b721-f2c93aa228dd tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:42.085976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35de9f7a-1c38-4b26-b721-f2c93aa228dd tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.086431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35de9f7a-1c38-4b26-b721-f2c93aa228dd tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.088766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35de9f7a-1c38-4b26-b721-f2c93aa228dd tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.104829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35de9f7a-1c38-4b26-b721-f2c93aa228dd tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.556872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:42.647112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-35de9f7a-1c38-4b26-b721-f2c93aa228dd tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded76d8b532c4b5c89ba7616eaf8d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce247c23c2a4b80a654a31438a8c1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:42.658332 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-35de9f7a-1c38-4b26-b721-f2c93aa228dd tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 200 len: 1320 microversion: 2.1 time: 0.594710 Jul 26 19:43:42.673411 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 88/178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:42 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 1320 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:42.680558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-afbefc3f-d498-47c6-a4ea-9be5512cd47c tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:42.685221 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:42.685221 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:42.687038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-afbefc3f-d498-47c6-a4ea-9be5512cd47c tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.687933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-afbefc3f-d498-47c6-a4ea-9be5512cd47c tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.688980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-afbefc3f-d498-47c6-a4ea-9be5512cd47c tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.689703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-afbefc3f-d498-47c6-a4ea-9be5512cd47c tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.718224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-afbefc3f-d498-47c6-a4ea-9be5512cd47c tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.043370 Jul 26 19:43:42.719437 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 89/179] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 19:43:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:42.725550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3c808db5-4cf6-4316-abec-1401a1c4aaec req-c1bba20a-0e50-41c3-ba94-aca3d8422222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7887d20-6f23-42b2-9039-ed2f8cb81d65", "name": "network-vif-deleted", "tag": "d3d7dc1a-20fa-4fa1-ba45-8a1ca4dd2c6c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:42.737527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3c808db5-4cf6-4316-abec-1401a1c4aaec req-c1bba20a-0e50-41c3-ba94-aca3d8422222 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.738203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3c808db5-4cf6-4316-abec-1401a1c4aaec req-c1bba20a-0e50-41c3-ba94-aca3d8422222 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.750573 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3c808db5-4cf6-4316-abec-1401a1c4aaec req-c1bba20a-0e50-41c3-ba94-aca3d8422222 service nova] Creating event network-vif-deleted:d3d7dc1a-20fa-4fa1-ba45-8a1ca4dd2c6c for instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 on n-h1-708768-8 Jul 26 19:43:42.756467 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3c808db5-4cf6-4316-abec-1401a1c4aaec req-c1bba20a-0e50-41c3-ba94-aca3d8422222 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035472 Jul 26 19:43:42.761859 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 90/180] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:42.767406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d11f7188-eb4e-40d3-ba26-8f6f24cef69e tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:42.771573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d11f7188-eb4e-40d3-ba26-8f6f24cef69e tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:42.840384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d11f7188-eb4e-40d3-ba26-8f6f24cef69e tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:42.848033 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d11f7188-eb4e-40d3-ba26-8f6f24cef69e tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1219 microversion: 2.1 time: 0.084830 Jul 26 19:43:42.849721 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 91/181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:42 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:42.854330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d4a1d6b1-8dca-4f1a-b48c-9171f566a135 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:42.856914 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:42.856914 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:42.858113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4a1d6b1-8dca-4f1a-b48c-9171f566a135 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.858564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4a1d6b1-8dca-4f1a-b48c-9171f566a135 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.859442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4a1d6b1-8dca-4f1a-b48c-9171f566a135 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.860188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4a1d6b1-8dca-4f1a-b48c-9171f566a135 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.899151 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d4a1d6b1-8dca-4f1a-b48c-9171f566a135 tempest-ServicesAdminTestJSON-1839821913 tempest-ServicesAdminTestJSON-1839821913-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.048240 Jul 26 19:43:42.899850 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 92/182] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:43:42 2022] GET /compute/v2.1/os-services => generated 965 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:42.908905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa8ea5c6-a12b-4731-b3c5-29ed57837e7b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:42.917971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa8ea5c6-a12b-4731-b3c5-29ed57837e7b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:42.936746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8ea5c6-a12b-4731-b3c5-29ed57837e7b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.937551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8ea5c6-a12b-4731-b3c5-29ed57837e7b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.939117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8ea5c6-a12b-4731-b3c5-29ed57837e7b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:42.939651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8ea5c6-a12b-4731-b3c5-29ed57837e7b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:42.965454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-791a7bbb-9080-482a-b99f-8042b8fc1c9b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:42.978928 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-791a7bbb-9080-482a-b99f-8042b8fc1c9b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 1.149729 Jul 26 19:43:42.983723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 91/183] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:41 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:43.229595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa8ea5c6-a12b-4731-b3c5-29ed57837e7b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:43.239894 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa8ea5c6-a12b-4731-b3c5-29ed57837e7b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1494 microversion: 2.1 time: 0.337941 Jul 26 19:43:43.241048 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 93/184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:42 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1494 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:43.635774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5e8cd262-e04f-49a7-be83-fdf41da47b2d req-8e2c44c0-128a-4567-8107-ba090def7bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa4d676-0350-4966-98db-fdf47eccbf14", "name": "network-vif-deleted", "tag": "83f1aae3-3089-4513-9f52-28d010801468"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:43.658210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5e8cd262-e04f-49a7-be83-fdf41da47b2d req-8e2c44c0-128a-4567-8107-ba090def7bcd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:43.658680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5e8cd262-e04f-49a7-be83-fdf41da47b2d req-8e2c44c0-128a-4567-8107-ba090def7bcd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:43.679076 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5e8cd262-e04f-49a7-be83-fdf41da47b2d req-8e2c44c0-128a-4567-8107-ba090def7bcd service nova] Creating event network-vif-deleted:83f1aae3-3089-4513-9f52-28d010801468 for instance daa4d676-0350-4966-98db-fdf47eccbf14 on n-h1-708768-8 Jul 26 19:43:43.686231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:43.687523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] [instance: d7887d20-6f23-42b2-9039-ed2f8cb81d65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:43.695790 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5e8cd262-e04f-49a7-be83-fdf41da47b2d req-8e2c44c0-128a-4567-8107-ba090def7bcd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064821 Jul 26 19:43:43.698242 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 92/185] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:43.712705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:43.713693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:43.714150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:43.714768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:43.753522 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] HTTP exception thrown: Instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 could not be found. Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Request method failure captured: Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 HTTP/1.1 Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPBXNy_Xmxyi6IA5zDZNHWMJImQ7Pt0blgG_naw4GvEaJnA9sbpDfs_ygOVJOy2xiqzAb4S7_Vm1t-VCjS14mp9i47KCInnF0tzdjh2908qGbmK8A-2PQ3EryYhGEpBqLd4ErmCJsAD0ZvA2tmoDzcD6ntlYNQ3SwV1kvnXN8NF-aI Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: bce247c23c2a4b80a654a31438a8c1b8 Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TenantUsagesTestJSON-413109684 Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:43.765494 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bce247c23c2a4b80a654a31438a8c1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bce247c23c2a4b80a654a31438a8c1b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bce247c23c2a4b80a654a31438a8c1b8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bce247c23c2a4b80a654a31438a8c1b8"}]}] Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TenantUsagesTestJSON-413109684 Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: bce247c23c2a4b80a654a31438a8c1b8 Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TenantUsagesTestJSON-413109684 Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TenantUsagesTestJSON-413109684-project Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ded76d8b532c4b5c89ba7616eaf8d08d Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TenantUsagesTestJSON-413109684-project Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 could not be found. Jul 26 19:43:43.766748 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'd7887d20-6f23-42b2-9039-ed2f8cb81d65'} Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 could not be found. Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:43.767448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 could not be found. Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 could not be found. Jul 26 19:43:43.768590 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:43.769598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] Returning 404 to user: Instance d7887d20-6f23-42b2-9039-ed2f8cb81d65 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:43.769598 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-42491a72-5285-4a98-92cb-25f2cec43def tempest-TenantUsagesTestJSON-413109684 tempest-TenantUsagesTestJSON-413109684-project] 10.222.0.58 "GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65" status: 404 len: 111 microversion: 2.1 time: 0.086011 Jul 26 19:43:43.773491 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 94/186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:43 2022] GET /compute/v2.1/servers/d7887d20-6f23-42b2-9039-ed2f8cb81d65 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:43.876159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b27e00f1-86c9-4bbb-afba-570843e89686 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:43.877666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b27e00f1-86c9-4bbb-afba-570843e89686 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:43.893370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b27e00f1-86c9-4bbb-afba-570843e89686 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:43.894225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b27e00f1-86c9-4bbb-afba-570843e89686 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:43.896461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b27e00f1-86c9-4bbb-afba-570843e89686 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:43.898381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b27e00f1-86c9-4bbb-afba-570843e89686 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:44.010129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b74b8479-3436-4c1a-b0d7-6ff429958fa8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:44.011317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b74b8479-3436-4c1a-b0d7-6ff429958fa8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:44.023670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b74b8479-3436-4c1a-b0d7-6ff429958fa8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:44.024382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b74b8479-3436-4c1a-b0d7-6ff429958fa8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:44.025381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b74b8479-3436-4c1a-b0d7-6ff429958fa8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:44.025965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b74b8479-3436-4c1a-b0d7-6ff429958fa8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:44.053074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b27e00f1-86c9-4bbb-afba-570843e89686 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:44.066274 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b27e00f1-86c9-4bbb-afba-570843e89686 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1300 microversion: 2.1 time: 0.196208 Jul 26 19:43:44.087945 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 93/187] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:43 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:44.262638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:44.263257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:44.282588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:44.284074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:44.286398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:44.289189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:44.375002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:44.375881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:44.376606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lazy-loading 'fault' on Instance uuid daa4d676-0350-4966-98db-fdf47eccbf14 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:43:44.417120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b74b8479-3436-4c1a-b0d7-6ff429958fa8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:44.425150 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b74b8479-3436-4c1a-b0d7-6ff429958fa8 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 0.420899 Jul 26 19:43:44.426958 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 95/188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:44 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:44.496009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f3a87454ce4b7c93f7ea400bb41cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba42986787481ca4f0f0136146df2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:44.530334 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5cd147c5-0ce0-4f6a-9989-7c27b2e0a772 tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 200 len: 1328 microversion: 2.1 time: 0.268250 Jul 26 19:43:44.533940 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 94/189] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:44 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 1328 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:45.096209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e73d146f-5c62-49e6-ba24-742b618ea3a1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:45.096816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e73d146f-5c62-49e6-ba24-742b618ea3a1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:45.104191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e73d146f-5c62-49e6-ba24-742b618ea3a1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:45.105182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e73d146f-5c62-49e6-ba24-742b618ea3a1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:45.107741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e73d146f-5c62-49e6-ba24-742b618ea3a1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:45.108694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e73d146f-5c62-49e6-ba24-742b618ea3a1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:45.187465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e73d146f-5c62-49e6-ba24-742b618ea3a1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:45.196933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e73d146f-5c62-49e6-ba24-742b618ea3a1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1298 microversion: 2.1 time: 0.104456 Jul 26 19:43:45.198066 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 96/190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:45 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:45.450828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b03013ae-d998-49f2-b4fb-290c4e1d570b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:45.451439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b03013ae-d998-49f2-b4fb-290c4e1d570b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:45.464478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b03013ae-d998-49f2-b4fb-290c4e1d570b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:45.468302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b03013ae-d998-49f2-b4fb-290c4e1d570b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:45.469452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b03013ae-d998-49f2-b4fb-290c4e1d570b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:45.470051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b03013ae-d998-49f2-b4fb-290c4e1d570b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:45.555234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:45.556195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:45.587291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:45.588258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:45.589313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:45.591307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:45.652157 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] HTTP exception thrown: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Request method failure captured: Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 HTTP/1.1 Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPBOm2Y0KhBZDUkVWIiS_f2SvEr6mfICqoCpgcyFwPBMIv5HKrsySaWJypewGVeBv9mQPr9L32ZMUh7CoTZEvyeEjfrKTtnqj8G4cdsUXwYdVOvQvEB63eq0gtR5MAXAvhxDXGGvCZ78qIhCT6rwDrsKh6LgHMWB5L49XlhU9bxftM Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: faba42986787481ca4f0f0136146df2f Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:45.655274 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/faba42986787481ca4f0f0136146df2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/faba42986787481ca4f0f0136146df2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_faba42986787481ca4f0f0136146df2f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/faba42986787481ca4f0f0136146df2f"}]}] Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: faba42986787481ca4f0f0136146df2f Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminTestJSON-1890671270-project Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c0f3a87454ce4b7c93f7ea400bb41cba Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminTestJSON-1890671270-project Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:45.656766 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'daa4d676-0350-4966-98db-fdf47eccbf14'} Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:45.657610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:45.658954 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:45.665095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Returning 404 to user: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:45.666158 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd56a521-656f-4e8b-be96-6d4befd289ed tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 404 len: 111 microversion: 2.1 time: 0.115711 Jul 26 19:43:45.673858 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 97/191] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:45 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:43:45.695250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97fd6d81-ff91-4789-9db5-d26c5d53da59 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:45.706452 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:45.706452 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:45.767743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97fd6d81-ff91-4789-9db5-d26c5d53da59 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:45.768388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97fd6d81-ff91-4789-9db5-d26c5d53da59 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:46.074840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b03013ae-d998-49f2-b4fb-290c4e1d570b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:46.084313 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b03013ae-d998-49f2-b4fb-290c4e1d570b tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 0.637876 Jul 26 19:43:46.087896 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 95/192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:45 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:46.098843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f8da35ee-31a6-4daa-9781-ecaa107cf4d2 req-6870f447-85d7-453e-abd3-29340187f34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4a582-0699-43a9-89f9-19b22e0cda22", "tag": "f7718a1a-4b41-487e-ae8e-fd904b4c47e0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:46.112001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f8da35ee-31a6-4daa-9781-ecaa107cf4d2 req-6870f447-85d7-453e-abd3-29340187f34c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:46.112770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f8da35ee-31a6-4daa-9781-ecaa107cf4d2 req-6870f447-85d7-453e-abd3-29340187f34c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:46.128105 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f8da35ee-31a6-4daa-9781-ecaa107cf4d2 req-6870f447-85d7-453e-abd3-29340187f34c service nova] Creating event network-changed:f7718a1a-4b41-487e-ae8e-fd904b4c47e0 for instance 50a4a582-0699-43a9-89f9-19b22e0cda22 on n-h2-708768-8 Jul 26 19:43:46.143749 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f8da35ee-31a6-4daa-9781-ecaa107cf4d2 req-6870f447-85d7-453e-abd3-29340187f34c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052508 Jul 26 19:43:46.144402 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 96/193] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:46.219460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-790a40a2-7d71-4498-8eb3-a197472ff192 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:46.220217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-790a40a2-7d71-4498-8eb3-a197472ff192 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:46.233945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-790a40a2-7d71-4498-8eb3-a197472ff192 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:46.239384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-790a40a2-7d71-4498-8eb3-a197472ff192 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:46.241154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-790a40a2-7d71-4498-8eb3-a197472ff192 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:46.243917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-790a40a2-7d71-4498-8eb3-a197472ff192 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:46.547426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-790a40a2-7d71-4498-8eb3-a197472ff192 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:46.566032 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-790a40a2-7d71-4498-8eb3-a197472ff192 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1298 microversion: 2.1 time: 0.350971 Jul 26 19:43:46.567600 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 97/194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:46 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1298 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:46.766747 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97fd6d81-ff91-4789-9db5-d26c5d53da59 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 1.086829 Jul 26 19:43:46.780023 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 98/195] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:46.781804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b9dfb02-631f-45eb-8a52-88fb7e8850ed tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:46.782824 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:46.782824 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:46.858348 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0b9dfb02-631f-45eb-8a52-88fb7e8850ed tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.079576 Jul 26 19:43:46.862646 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 98/196] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:46 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 26 19:43:46.875572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32380f61-df27-4505-86a8-6037f436593e tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1017933211"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:46.893280 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:46.893280 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:46.896457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.aggregate [None req-32380f61-df27-4505-86a8-6037f436593e tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid a5d0a6dd-a25c-451e-8ccd-9749aeadae73 for aggregate {{(pid=125963) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:46.937672 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32380f61-df27-4505-86a8-6037f436593e tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069869 Jul 26 19:43:46.939395 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 99/197] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:46.953382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4c235ade-0886-40b1-9bbb-f30d825982fb tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:46.959311 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:46.959311 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:46.989709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c235ade-0886-40b1-9bbb-f30d825982fb tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:46.990365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c235ade-0886-40b1-9bbb-f30d825982fb tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.111462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18ea3d5e-e0a3-4def-962d-64df7d39036f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:47.112368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18ea3d5e-e0a3-4def-962d-64df7d39036f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:47.137410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ea3d5e-e0a3-4def-962d-64df7d39036f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:47.137888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ea3d5e-e0a3-4def-962d-64df7d39036f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.150999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ea3d5e-e0a3-4def-962d-64df7d39036f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:47.151671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ea3d5e-e0a3-4def-962d-64df7d39036f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.286543 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4c235ade-0886-40b1-9bbb-f30d825982fb tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.338826 Jul 26 19:43:47.290332 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 99/198] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:46 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:47.300133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-394fb8e6-cfa9-449d-ac62-4c033cfab8b7 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:47.310509 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:47.310509 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:47.332158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-394fb8e6-cfa9-449d-ac62-4c033cfab8b7 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:47.333176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-394fb8e6-cfa9-449d-ac62-4c033cfab8b7 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.392998 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-394fb8e6-cfa9-449d-ac62-4c033cfab8b7 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] HTTP exception thrown: Aggregate 3 already has host n-h1-708768-8. Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-394fb8e6-cfa9-449d-ac62-4c033cfab8b7 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Request method failure captured: Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 39 Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPCbgXgcJep9pkLtih39pcBHS7tzrB_M1hb_tGWeJ0qPovOE-FxIMkps6hXXWaDElrvj42S0yIA1bsh7cVYhw1B3ASqsFOMR9vNNaIxp-_1iawrZQIY5iy_woIeDR6zC9k0z-em18c-jzerZo9OaLLSZvWNUZo61oFeiCZEfvWbjTc Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:47.405797 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e936bc760804a9e8446da86e3d9999c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}] Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5668e62f221f4a0ca140f30334188696 Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: {"add_host": {"host": "n-h1-708768-8"}} Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:47.407095 n-d-708768-8 devstack@n-api.service[125964]: exception: Aggregate 3 already has host n-h1-708768-8. Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-708768-8'}}} Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result.read() Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 19:43:47.408011 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-708768-8-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 19:43:47.409047 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 19:43:47.410181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 19:43:47.413128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result.read() Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-708768-8-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 19, 43, 47, 374043), 'updated_at': None, 'host': 'n-h1-708768-8', 'aggregate_id': 3}] Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:47.415535 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 3 already has host n-h1-708768-8. Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.420008 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 3 already has host n-h1-708768-8. Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:47.422289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:47.425292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 3 already has host n-h1-708768-8. Jul 26 19:43:47.425292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:47.425292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-394fb8e6-cfa9-449d-ac62-4c033cfab8b7 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Returning 409 to user: Aggregate 3 already has host n-h1-708768-8. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:47.426413 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-394fb8e6-cfa9-449d-ac62-4c033cfab8b7 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 409 len: 95 microversion: 2.1 time: 0.123307 Jul 26 19:43:47.429901 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 100/199] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:47 2022] POST /compute/v2.1/os-aggregates/3/action => generated 95 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 26 19:43:47.449053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd38a677-cca8-42f3-a077-92563a1495e2 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:47.452650 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:47.452650 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:47.476270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd38a677-cca8-42f3-a077-92563a1495e2 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:47.478854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd38a677-cca8-42f3-a077-92563a1495e2 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.746326 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd38a677-cca8-42f3-a077-92563a1495e2 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.308963 Jul 26 19:43:47.749248 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 101/200] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:47 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:47.760000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7311a8f0-6a4a-4678-8b7f-37244411c68f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:47.763000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7311a8f0-6a4a-4678-8b7f-37244411c68f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:47.765604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18ea3d5e-e0a3-4def-962d-64df7d39036f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:47.779969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18ea3d5e-e0a3-4def-962d-64df7d39036f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 0.673548 Jul 26 19:43:47.781681 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 100/201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:47 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:47.788118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85e4d285-7f9a-4d25-a724-27d459477242 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:47.789316 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:47.789316 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:47.794192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7311a8f0-6a4a-4678-8b7f-37244411c68f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:47.795857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7311a8f0-6a4a-4678-8b7f-37244411c68f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.799138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7311a8f0-6a4a-4678-8b7f-37244411c68f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:47.799593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7311a8f0-6a4a-4678-8b7f-37244411c68f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.834657 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85e4d285-7f9a-4d25-a724-27d459477242 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.051711 Jul 26 19:43:47.841582 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 101/202] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:47 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:47.846309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f3b4199b-b54d-4b84-86b9-ccae97733ae3 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1286546048"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:47.856956 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:47.856956 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:47.859943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.aggregate [None req-f3b4199b-b54d-4b84-86b9-ccae97733ae3 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid 80391c97-e038-40a3-87b8-1ebdb780c31d for aggregate {{(pid=125963) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:47.918906 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f3b4199b-b54d-4b84-86b9-ccae97733ae3 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076056 Jul 26 19:43:47.928164 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 102/203] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:47.934065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0b7ea9bc-9bdd-4b9a-bfa8-ceaa821dee6c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Calling method '.version_select at 0x7f8764339430>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:47.936990 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:47.936990 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:47.938769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b7ea9bc-9bdd-4b9a-bfa8-ceaa821dee6c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:47.939947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b7ea9bc-9bdd-4b9a-bfa8-ceaa821dee6c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.941419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b7ea9bc-9bdd-4b9a-bfa8-ceaa821dee6c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:47.942824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b7ea9bc-9bdd-4b9a-bfa8-ceaa821dee6c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:47.976744 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0b7ea9bc-9bdd-4b9a-bfa8-ceaa821dee6c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.046667 Jul 26 19:43:47.978550 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 103/204] 10.222.0.58 () {58 vars in 1128 bytes} [Tue Jul 26 19:43:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:48.313387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7311a8f0-6a4a-4678-8b7f-37244411c68f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:48.336686 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7311a8f0-6a4a-4678-8b7f-37244411c68f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 0.585349 Jul 26 19:43:48.337987 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 102/205] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:47 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:48.354660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c71a8d82-ec6b-4d63-9943-9a1c1c780766 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Calling method '.version_select at 0x7f8757926c10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:48.359182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0d530b10-a8d1-4df1-a3a5-9f1be21d4bb2 tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:48.363445 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:48.363445 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:48.365507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0d530b10-a8d1-4df1-a3a5-9f1be21d4bb2 tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '803c9336f6404168b83db0773fcf5815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4a0d57c8e454599ee00c3e30de3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0d530b10-a8d1-4df1-a3a5-9f1be21d4bb2 tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Request method failure captured: Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 39 Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EO_7imK04D2xWJEBt0AkQmGyPwCb-WRFBh1TZLEihYfs2DZLYMKYm7FyEHd8uw7BsQhPjXd3gCMcrdH1nDG6BbSUXfMcqWm6sJUc-9J0MeyhFEadhBcRgabPPJg1BUSRbAvWijBUc-am44Ra-NIINUJ-rem8_xaMM4_W0jx6kJ4x1k Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:48.368329 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31b4a0d57c8e454599ee00c3e30de3a6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}] Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 803c9336f6404168b83db0773fcf5815 Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: {"add_host": {"host": "n-h1-708768-8"}} Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:48.369733 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h1-708768-8'}}} Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:48.370602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 19:43:48.371749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:48.374263 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:48.374263 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:48.375370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0d530b10-a8d1-4df1-a3a5-9f1be21d4bb2 tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:48.377374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c71a8d82-ec6b-4d63-9943-9a1c1c780766 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:48.377494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0d530b10-a8d1-4df1-a3a5-9f1be21d4bb2 tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 0.397758 Jul 26 19:43:48.377831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c71a8d82-ec6b-4d63-9943-9a1c1c780766 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:48.381353 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 104/206] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:47 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 402 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:48.389978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c71a8d82-ec6b-4d63-9943-9a1c1c780766 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:48.391795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c71a8d82-ec6b-4d63-9943-9a1c1c780766 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:48.399304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb833781-ac3b-4213-8335-a2b13dcda56b tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:48.402463 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:48.402463 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:48.452844 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c71a8d82-ec6b-4d63-9943-9a1c1c780766 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.113648 Jul 26 19:43:48.454319 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 103/207] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:48 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:48.493401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0177468-89b8-43e5-841f-16030be1794c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Calling method '.version_select at 0x7f8757b23040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:48.499361 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:48.499361 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:48.501832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0177468-89b8-43e5-841f-16030be1794c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:48.503921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0177468-89b8-43e5-841f-16030be1794c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:48.519559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0177468-89b8-43e5-841f-16030be1794c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:48.525192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0177468-89b8-43e5-841f-16030be1794c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:48.666491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0177468-89b8-43e5-841f-16030be1794c tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.202678 Jul 26 19:43:48.672471 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 104/208] 10.222.0.58 () {58 vars in 1128 bytes} [Tue Jul 26 19:43:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:48.686347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-59a1673c-d016-4a7e-8af4-b2e5c20ba4a2 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-883674288"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:48.695673 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:48.695673 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:48.697153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-59a1673c-d016-4a7e-8af4-b2e5c20ba4a2 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid be2db557-2166-43e2-b2ab-ea9370010e33 for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:48.751746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-59a1673c-d016-4a7e-8af4-b2e5c20ba4a2 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.077910 Jul 26 19:43:48.753453 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 105/209] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:48.769306 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fb833781-ac3b-4213-8335-a2b13dcda56b tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.383881 Jul 26 19:43:48.776931 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 105/210] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:48 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:48.785846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7b273c18-14c5-4aef-9d1f-5d72c8f5f747 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:48.790924 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:48.790924 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:48.813546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b273c18-14c5-4aef-9d1f-5d72c8f5f747 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:48.814931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b273c18-14c5-4aef-9d1f-5d72c8f5f747 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:48.824553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-37f11c6e-b7b8-4675-a06e-da91ff869cf8 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Calling method '.version_select at 0x7f8757934160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:48.826352 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:48.826352 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:48.861998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37f11c6e-b7b8-4675-a06e-da91ff869cf8 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:48.863424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37f11c6e-b7b8-4675-a06e-da91ff869cf8 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:48.910314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37f11c6e-b7b8-4675-a06e-da91ff869cf8 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:48.920177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37f11c6e-b7b8-4675-a06e-da91ff869cf8 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:48.999603 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-37f11c6e-b7b8-4675-a06e-da91ff869cf8 tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h1-708768-8" status: 200 len: 467 microversion: 2.1 time: 0.244446 Jul 26 19:43:49.000867 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 106/211] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Jul 26 19:43:48 2022] GET /compute/v2.1/os-hosts/n-h1-708768-8 => generated 467 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:49.009728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2452311-75cb-4f91-8353-d7d223c3fcec tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1697127921"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:49.018829 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:49.018829 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:49.029577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-c2452311-75cb-4f91-8353-d7d223c3fcec tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid d3eacd59-5040-404d-bd59-03d5b9193540 for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:49.081971 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c2452311-75cb-4f91-8353-d7d223c3fcec tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079613 Jul 26 19:43:49.089146 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 107/212] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:49.102088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a76bf06-aea2-4189-9ec9-c68c84eb6c14 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:49.102725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1a76bf06-aea2-4189-9ec9-c68c84eb6c14 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:49.107825 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7b273c18-14c5-4aef-9d1f-5d72c8f5f747 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.328860 Jul 26 19:43:49.108431 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 106/213] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:48 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:49.119178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a27a034c-08d9-44d8-b88f-659ed5b15f8e tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Calling method '.version_select at 0x7f8764339b80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:49.120134 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:49.120134 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:49.136038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a27a034c-08d9-44d8-b88f-659ed5b15f8e tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:49.136486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a27a034c-08d9-44d8-b88f-659ed5b15f8e tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:49.139449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a76bf06-aea2-4189-9ec9-c68c84eb6c14 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:49.139995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a76bf06-aea2-4189-9ec9-c68c84eb6c14 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:49.140820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a76bf06-aea2-4189-9ec9-c68c84eb6c14 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:49.141261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a76bf06-aea2-4189-9ec9-c68c84eb6c14 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:49.188597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a27a034c-08d9-44d8-b88f-659ed5b15f8e tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:49.189081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a27a034c-08d9-44d8-b88f-659ed5b15f8e tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:49.255420 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a27a034c-08d9-44d8-b88f-659ed5b15f8e tempest-HostsAdminTestJSON-371460193 tempest-HostsAdminTestJSON-371460193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h2-708768-8" status: 200 len: 467 microversion: 2.1 time: 0.145868 Jul 26 19:43:49.257353 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 107/214] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Jul 26 19:43:49 2022] GET /compute/v2.1/os-hosts/n-h2-708768-8 => generated 467 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:49.279198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-548597085"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:49.296934 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:49.296934 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:49.321047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:49.322255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:49.349867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:49.352720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:49.385229 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-548597085 could not be found. Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Request method failure captured: Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 57 Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPCbgXgcJep9pkLtih39pcBHS7tzrB_M1hb_tGWeJ0qPovOE-FxIMkps6hXXWaDElrvj42S0yIA1bsh7cVYhw1B3ASqsFOMR9vNNaIxp-_1iawrZQIY5iy_woIeDR6zC9k0z-em18c-jzerZo9OaLLSZvWNUZo61oFeiCZEfvWbjTc Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:49.394751 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e936bc760804a9e8446da86e3d9999c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}] Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5668e62f221f4a0ca140f30334188696 Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: {"add_host": {"host": "tempest-nonexist_host-548597085"}} Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:49.397563 n-d-708768-8 devstack@n-api.service[125963]: exception: Compute host tempest-nonexist_host-548597085 could not be found. Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6', 'body': {'add_host': {'host': 'tempest-nonexist_host-548597085'}}} Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-548597085' is not mapped to any cell Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:49.398282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 26 19:43:49.399370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-548597085 could not be found. Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-548597085 could not be found. Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:49.402234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.407021 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:49.407021 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:49.407021 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:49.407021 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:49.407021 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:49.407021 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-548597085 could not be found. Jul 26 19:43:49.407021 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:49.414413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-548597085 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:49.415916 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11ebeb51-6021-4a67-a942-057a9e9ce322 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/6/action" status: 404 len: 110 microversion: 2.1 time: 0.156955 Jul 26 19:43:49.416927 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 108/215] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:49 2022] POST /compute/v2.1/os-aggregates/6/action => generated 110 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:49.433139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ca9d008-2671-430d-bd4c-a2bc04520e18 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:49.435116 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:49.435116 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:49.451160 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ca9d008-2671-430d-bd4c-a2bc04520e18 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/5" status: 200 len: 241 microversion: 2.1 time: 0.029932 Jul 26 19:43:49.452964 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 109/216] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Jul 26 19:43:49 2022] GET /compute/v2.1/os-aggregates/5 => generated 241 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:49.467297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa4037d7-8106-4549-b485-c60c4e24d216 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:49.468310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fa4037d7-8106-4549-b485-c60c4e24d216 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:49.478399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa4037d7-8106-4549-b485-c60c4e24d216 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:49.479506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa4037d7-8106-4549-b485-c60c4e24d216 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:49.480558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa4037d7-8106-4549-b485-c60c4e24d216 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:49.481223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa4037d7-8106-4549-b485-c60c4e24d216 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:50.029724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fa4037d7-8106-4549-b485-c60c4e24d216 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:50.040466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:50.047981 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa4037d7-8106-4549-b485-c60c4e24d216 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 0.583971 Jul 26 19:43:50.051019 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 110/217] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:49 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:50.058602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-76f083ec-d05d-4c30-8d27-4f77810d7acf tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:50.067972 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.067972 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:50.130393 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-76f083ec-d05d-4c30-8d27-4f77810d7acf tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.075471 Jul 26 19:43:50.134504 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 111/218] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:50 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:50.147232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f791d4b1-ac3f-4a77-8c89-b4d9d106db8d tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.155974 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.155974 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:50.180187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f791d4b1-ac3f-4a77-8c89-b4d9d106db8d tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:50.180821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f791d4b1-ac3f-4a77-8c89-b4d9d106db8d tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:50.483813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:50.524304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a76bf06-aea2-4189-9ec9-c68c84eb6c14 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:50.530582 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f791d4b1-ac3f-4a77-8c89-b4d9d106db8d tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.389419 Jul 26 19:43:50.544016 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 112/219] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:50.548809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ce813a1a-51c8-4a8d-910f-fedcf9a873c5 req-00303b09-3abc-40f5-9d28-32a76ec1534a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6565e25a-1a8a-479f-87f9-9666c3cdfbf5", "tag": "7d464596-acdd-4bd5-92c5-f59401525b9d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.557319 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a76bf06-aea2-4189-9ec9-c68c84eb6c14 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 1.462646 Jul 26 19:43:50.563515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ce813a1a-51c8-4a8d-910f-fedcf9a873c5 req-00303b09-3abc-40f5-9d28-32a76ec1534a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:50.566412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ce813a1a-51c8-4a8d-910f-fedcf9a873c5 req-00303b09-3abc-40f5-9d28-32a76ec1534a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:50.582016 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 108/220] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:49 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:50.593657 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ce813a1a-51c8-4a8d-910f-fedcf9a873c5 req-00303b09-3abc-40f5-9d28-32a76ec1534a service nova] Creating event network-changed:7d464596-acdd-4bd5-92c5-f59401525b9d for instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 on n-h1-708768-8 Jul 26 19:43:50.601911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-13e7249b-17ff-468a-b9f9-d38a2527df85 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-13e7249b-17ff-468a-b9f9-d38a2527df85 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Request method failure captured: Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 283 Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPCbgXgcJep9pkLtih39pcBHS7tzrB_M1hb_tGWeJ0qPovOE-FxIMkps6hXXWaDElrvj42S0yIA1bsh7cVYhw1B3ASqsFOMR9vNNaIxp-_1iawrZQIY5iy_woIeDR6zC9k0z-em18c-jzerZo9OaLLSZvWNUZo61oFeiCZEfvWbjTc Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:50.606748 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e936bc760804a9e8446da86e3d9999c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}] Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5668e62f221f4a0ca140f30334188696 Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:43:50.608046 n-d-708768-8 devstack@n-api.service[125964]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 19:43:50.608694 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:43:50.609396 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:43:50.610424 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:43:50.611117 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 19:43:50.611117 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.611117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-13e7249b-17ff-468a-b9f9-d38a2527df85 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:50.611117 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-13e7249b-17ff-468a-b9f9-d38a2527df85 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.018255 Jul 26 19:43:50.611378 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 109/221] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:43:50.615106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63dd2fbc-11a9-4d60-83dd-208e4d02e177 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:50.616096 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.616096 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:50.618894 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ce813a1a-51c8-4a8d-910f-fedcf9a873c5 req-00303b09-3abc-40f5-9d28-32a76ec1534a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084565 Jul 26 19:43:50.619948 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 113/222] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:50.626121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-478e168c-0ab7-4cb5-8bd0-8c3d11be325c tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-478e168c-0ab7-4cb5-8bd0-8c3d11be325c tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Request method failure captured: Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 27 Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPCbgXgcJep9pkLtih39pcBHS7tzrB_M1hb_tGWeJ0qPovOE-FxIMkps6hXXWaDElrvj42S0yIA1bsh7cVYhw1B3ASqsFOMR9vNNaIxp-_1iawrZQIY5iy_woIeDR6zC9k0z-em18c-jzerZo9OaLLSZvWNUZo61oFeiCZEfvWbjTc Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:50.635220 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e936bc760804a9e8446da86e3d9999c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}] Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5668e62f221f4a0ca140f30334188696 Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: {"aggregate": {"name": ""}} Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:50.636956 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi '' Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:50.637688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 19:43:50.640630 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.643714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-478e168c-0ab7-4cb5-8bd0-8c3d11be325c tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:50.643714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-478e168c-0ab7-4cb5-8bd0-8c3d11be325c tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015821 Jul 26 19:43:50.643714 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 114/223] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:43:50.662119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-486fa30c-e086-4457-bba4-616a54fec63e tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1576380573"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.666890 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.666890 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:50.668899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-486fa30c-e086-4457-bba4-616a54fec63e tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '803c9336f6404168b83db0773fcf5815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4a0d57c8e454599ee00c3e30de3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-486fa30c-e086-4457-bba4-616a54fec63e tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Request method failure captured: Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 60 Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EO_7imK04D2xWJEBt0AkQmGyPwCb-WRFBh1TZLEihYfs2DZLYMKYm7FyEHd8uw7BsQhPjXd3gCMcrdH1nDG6BbSUXfMcqWm6sJUc-9J0MeyhFEadhBcRgabPPJg1BUSRbAvWijBUc-am44Ra-NIINUJ-rem8_xaMM4_W0jx6kJ4x1k Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:50.670843 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31b4a0d57c8e454599ee00c3e30de3a6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}] Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 803c9336f6404168b83db0773fcf5815 Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: {"aggregate": {"name": "tempest-test_aggregate-1576380573"}} Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:50.672192 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1576380573'}}} Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:50.673174 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:50.674909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 19:43:50.676184 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.679466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-486fa30c-e086-4457-bba4-616a54fec63e tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:50.680568 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-486fa30c-e086-4457-bba4-616a54fec63e tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.036634 Jul 26 19:43:50.682891 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 115/224] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:50.695515 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63dd2fbc-11a9-4d60-83dd-208e4d02e177 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.080502 Jul 26 19:43:50.696396 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 110/225] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:50 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:50.705630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa86fb9d-ca04-46e1-b79a-43d6daf4da74 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1419415027"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.712038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.aggregate [None req-fa86fb9d-ca04-46e1-b79a-43d6daf4da74 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid ae3033d3-2595-400e-825a-ebfc5f42aa3e for aggregate {{(pid=125963) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:50.719437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-60e04767-c887-4216-a3bb-1a973629fa38 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1161396554"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.726817 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.726817 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:50.747666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-60e04767-c887-4216-a3bb-1a973629fa38 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid 10d67257-6282-457d-a45a-9790413d8e99 for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:50.805303 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa86fb9d-ca04-46e1-b79a-43d6daf4da74 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.115775 Jul 26 19:43:50.811632 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 116/226] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:50.819990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12899819-26d0-4da7-a9fa-ee9acc301c87 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1419415027"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.839942 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.839942 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:50.841438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.aggregate [None req-12899819-26d0-4da7-a9fa-ee9acc301c87 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid 24f9ecbd-501b-4874-be09-81448134c2d1 for aggregate {{(pid=125963) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:50.842175 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-60e04767-c887-4216-a3bb-1a973629fa38 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.131204 Jul 26 19:43:50.852354 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 111/227] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:50.858599 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-12899819-26d0-4da7-a9fa-ee9acc301c87 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1419415027 already exists. Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12899819-26d0-4da7-a9fa-ee9acc301c87 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Request method failure captured: Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 60 Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPCbgXgcJep9pkLtih39pcBHS7tzrB_M1hb_tGWeJ0qPovOE-FxIMkps6hXXWaDElrvj42S0yIA1bsh7cVYhw1B3ASqsFOMR9vNNaIxp-_1iawrZQIY5iy_woIeDR6zC9k0z-em18c-jzerZo9OaLLSZvWNUZo61oFeiCZEfvWbjTc Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:50.862187 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e936bc760804a9e8446da86e3d9999c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}] Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5668e62f221f4a0ca140f30334188696 Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: {"aggregate": {"name": "tempest-test_aggregate-1419415027"}} Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:50.865369 n-d-708768-8 devstack@n-api.service[125963]: exception: Aggregate tempest-test_aggregate-1419415027 already exists. Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1419415027'}}} Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 26 19:43:50.866096 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1419415027 already exists. Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:50.867249 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1419415027 already exists. Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1419415027 already exists. Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:50.869693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12899819-26d0-4da7-a9fa-ee9acc301c87 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1419415027 already exists. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:50.871315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3fe39f4c-70fd-4f6f-9778-aa069e82a348 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.877449 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.877449 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:50.880188 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-12899819-26d0-4da7-a9fa-ee9acc301c87 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.049716 Jul 26 19:43:50.884979 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 117/228] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:50.891678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc4777ae-068f-4915-938c-6c1df832b715 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:50.893232 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.893232 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:50.917696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3fe39f4c-70fd-4f6f-9778-aa069e82a348 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:50.922893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3fe39f4c-70fd-4f6f-9778-aa069e82a348 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:50.941494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc4777ae-068f-4915-938c-6c1df832b715 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.054768 Jul 26 19:43:50.948672 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 118/229] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:50 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:50.962243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:50.967133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5255b923-05b8-4d28-b5d5-9199e5e19dbd tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1240725691"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:50.972982 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:50.972982 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:50.979703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.aggregate [None req-5255b923-05b8-4d28-b5d5-9199e5e19dbd tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid 75319ed6-27ac-4314-9d16-5edc32263263 for aggregate {{(pid=125963) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:51.066642 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5255b923-05b8-4d28-b5d5-9199e5e19dbd tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.114305 Jul 26 19:43:51.077089 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 119/230] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:51.093516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-84efe5aa-2099-42e7-b18b-1b58dba8600f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:51.122865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-84efe5aa-2099-42e7-b18b-1b58dba8600f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:51.148964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84efe5aa-2099-42e7-b18b-1b58dba8600f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:51.152098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84efe5aa-2099-42e7-b18b-1b58dba8600f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:51.153000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84efe5aa-2099-42e7-b18b-1b58dba8600f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:51.153453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84efe5aa-2099-42e7-b18b-1b58dba8600f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:51.292690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3fe39f4c-70fd-4f6f-9778-aa069e82a348 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.436482 Jul 26 19:43:51.293285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 112/231] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:50 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:51.304342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f67d53c6-f0a0-450b-875d-5457008046dd tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:51.305496 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.305496 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:51.306583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f67d53c6-f0a0-450b-875d-5457008046dd tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '803c9336f6404168b83db0773fcf5815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4a0d57c8e454599ee00c3e30de3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f67d53c6-f0a0-450b-875d-5457008046dd tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Request method failure captured: Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-aggregates/9 HTTP/1.1 Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EO_7imK04D2xWJEBt0AkQmGyPwCb-WRFBh1TZLEihYfs2DZLYMKYm7FyEHd8uw7BsQhPjXd3gCMcrdH1nDG6BbSUXfMcqWm6sJUc-9J0MeyhFEadhBcRgabPPJg1BUSRbAvWijBUc-am44Ra-NIINUJ-rem8_xaMM4_W0jx6kJ4x1k Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:51.308385 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31b4a0d57c8e454599ee00c3e30de3a6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}] Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 803c9336f6404168b83db0773fcf5815 Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 19:43:51.309879 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '9'} Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:51.310722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 19:43:51.312081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.317199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f67d53c6-f0a0-450b-875d-5457008046dd tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:51.318196 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f67d53c6-f0a0-450b-875d-5457008046dd tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/9" status: 403 len: 116 microversion: 2.1 time: 0.023091 Jul 26 19:43:51.318937 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 113/232] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:51.334878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e50fa52d-71a1-45b7-8005-a3ffee602b38 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:51.342457 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.342457 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:51.353534 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e50fa52d-71a1-45b7-8005-a3ffee602b38 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 459 microversion: 2.1 time: 0.033338 Jul 26 19:43:51.356751 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 114/233] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:43:51 2022] GET /compute/v2.1/os-aggregates => generated 459 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:51.367098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3228b7fa-4ce4-41e7-9ad1-8e8d7626d2bd tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:51.370765 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.370765 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:51.416595 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3228b7fa-4ce4-41e7-9ad1-8e8d7626d2bd tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.058478 Jul 26 19:43:51.419875 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 115/234] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:51.429943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b252f981-9c38-4362-8e8d-d0c0d142856a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:51.438924 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.438924 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:51.472539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b252f981-9c38-4362-8e8d-d0c0d142856a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:51.475636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b252f981-9c38-4362-8e8d-d0c0d142856a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:51.500067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=7,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:51.607157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-84efe5aa-2099-42e7-b18b-1b58dba8600f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:51.616908 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-84efe5aa-2099-42e7-b18b-1b58dba8600f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 0.538337 Jul 26 19:43:51.622675 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 120/235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:51 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:51.641720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-19a3a5c4-c70c-46c3-bddc-9630f287b1a1 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:51.642858 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.642858 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:51.659369 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-19a3a5c4-c70c-46c3-bddc-9630f287b1a1 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-19a3a5c4-c70c-46c3-bddc-9630f287b1a1 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Request method failure captured: Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPCbgXgcJep9pkLtih39pcBHS7tzrB_M1hb_tGWeJ0qPovOE-FxIMkps6hXXWaDElrvj42S0yIA1bsh7cVYhw1B3ASqsFOMR9vNNaIxp-_1iawrZQIY5iy_woIeDR6zC9k0z-em18c-jzerZo9OaLLSZvWNUZo61oFeiCZEfvWbjTc Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:51.662863 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e936bc760804a9e8446da86e3d9999c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}] Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5668e62f221f4a0ca140f30334188696 Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: exception: Aggregate -1 could not be found. Jul 26 19:43:51.664491 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '-1'} Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 19:43:51.665235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.666438 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:51.667747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:51.667747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:51.667747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:51.667747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:51.667747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 26 19:43:51.667747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.669764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-19a3a5c4-c70c-46c3-bddc-9630f287b1a1 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:51.670916 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-19a3a5c4-c70c-46c3-bddc-9630f287b1a1 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.033890 Jul 26 19:43:51.671855 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 121/236] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:51 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:51.684747 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b252f981-9c38-4362-8e8d-d0c0d142856a tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.262517 Jul 26 19:43:51.686335 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 116/237] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Jul 26 19:43:51 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:51.696070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7b1aa94c-a8e1-498a-8fa7-5cc0a548612c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:51.698373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7b1aa94c-a8e1-498a-8fa7-5cc0a548612c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:51.699092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-24f0f742-a12c-48d0-8e08-16c63a8a6b99 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-702874583"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:51.702339 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.702339 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:51.703551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-24f0f742-a12c-48d0-8e08-16c63a8a6b99 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid 147d8ec8-537f-47f5-bbf7-f1c839cf44ca for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:51.715164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b1aa94c-a8e1-498a-8fa7-5cc0a548612c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:51.717269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b1aa94c-a8e1-498a-8fa7-5cc0a548612c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:51.721343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b1aa94c-a8e1-498a-8fa7-5cc0a548612c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:51.723713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b1aa94c-a8e1-498a-8fa7-5cc0a548612c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:51.791368 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-24f0f742-a12c-48d0-8e08-16c63a8a6b99 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093239 Jul 26 19:43:51.791368 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 117/238] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:51.811986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6e6ab2d-9644-4b8d-94ea-225556ca8572 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:51.820157 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.820157 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:51.887002 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f6e6ab2d-9644-4b8d-94ea-225556ca8572 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.099725 Jul 26 19:43:51.888098 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 118/239] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:51 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:51.912627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-555d0314-0e25-4185-a773-a076c736382a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:51.914432 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.914432 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:51.920280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-555d0314-0e25-4185-a773-a076c736382a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '803c9336f6404168b83db0773fcf5815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4a0d57c8e454599ee00c3e30de3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-555d0314-0e25-4185-a773-a076c736382a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Request method failure captured: Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EO_7imK04D2xWJEBt0AkQmGyPwCb-WRFBh1TZLEihYfs2DZLYMKYm7FyEHd8uw7BsQhPjXd3gCMcrdH1nDG6BbSUXfMcqWm6sJUc-9J0MeyhFEadhBcRgabPPJg1BUSRbAvWijBUc-am44Ra-NIINUJ-rem8_xaMM4_W0jx6kJ4x1k Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:51.925880 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31b4a0d57c8e454599ee00c3e30de3a6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}] Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 803c9336f6404168b83db0773fcf5815 Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 19:43:51.927142 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '10'} Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:51.927849 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 19:43:51.928862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:51.938683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-555d0314-0e25-4185-a773-a076c736382a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:51.939666 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-555d0314-0e25-4185-a773-a076c736382a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates/10" status: 403 len: 114 microversion: 2.1 time: 0.045731 Jul 26 19:43:51.940243 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 119/240] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:51 2022] GET /compute/v2.1/os-aggregates/10 => generated 114 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:51.950895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-78ddc623-2a43-450c-8aa0-d0fad99a12ca tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-29813106"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:51.960043 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:51.960043 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:51.961234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-78ddc623-2a43-450c-8aa0-d0fad99a12ca tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid 2b8b9f85-6e3d-4b4e-8a5f-db58623bb737 for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:52.005687 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-78ddc623-2a43-450c-8aa0-d0fad99a12ca tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.064348 Jul 26 19:43:52.006469 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 120/241] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:52.027004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-acc3cfc8-fb57-4eb7-a248-f88c6233506b tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:52.027004 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.027004 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:52.101395 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-acc3cfc8-fb57-4eb7-a248-f88c6233506b tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.087417 Jul 26 19:43:52.102292 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 121/242] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:52 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:52.108419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ecaa0174-429a-4686-b9a0-69f52ced6cc1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:52.111279 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.111279 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:52.130000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecaa0174-429a-4686-b9a0-69f52ced6cc1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:52.131670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecaa0174-429a-4686-b9a0-69f52ced6cc1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:52.346106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b1aa94c-a8e1-498a-8fa7-5cc0a548612c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:52.367010 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7b1aa94c-a8e1-498a-8fa7-5cc0a548612c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 0.693606 Jul 26 19:43:52.367630 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 122/243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:51 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:52.394126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60ad3466-ed9d-4535-bfec-70345bfc63ad tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:52.395902 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.395902 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:52.408781 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ecaa0174-429a-4686-b9a0-69f52ced6cc1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 241 microversion: 2.1 time: 0.305401 Jul 26 19:43:52.416603 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 122/244] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 19:43:52 2022] POST /compute/v2.1/os-aggregates/11/action => generated 241 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:52.421911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56331058-aade-4253-a154-6cd3e040d004 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:52.428603 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-60ad3466-ed9d-4535-bfec-70345bfc63ad tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 26 19:43:52.430192 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.430192 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60ad3466-ed9d-4535-bfec-70345bfc63ad tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Request method failure captured: Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPCbgXgcJep9pkLtih39pcBHS7tzrB_M1hb_tGWeJ0qPovOE-FxIMkps6hXXWaDElrvj42S0yIA1bsh7cVYhw1B3ASqsFOMR9vNNaIxp-_1iawrZQIY5iy_woIeDR6zC9k0z-em18c-jzerZo9OaLLSZvWNUZo61oFeiCZEfvWbjTc Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:52.434569 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e936bc760804a9e8446da86e3d9999c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}] Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5668e62f221f4a0ca140f30334188696 Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: exception: Aggregate -1 could not be found. Jul 26 19:43:52.435860 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '-1'} Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:52.436550 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 26 19:43:52.437655 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:52.438641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60ad3466-ed9d-4535-bfec-70345bfc63ad tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:52.446766 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60ad3466-ed9d-4535-bfec-70345bfc63ad tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.065824 Jul 26 19:43:52.448707 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 123/245] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:52 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:52.461691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-130c86aa-d031-40ce-b819-a13d704fbd9a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:52.465233 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.465233 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:52.466884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-130c86aa-d031-40ce-b819-a13d704fbd9a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '803c9336f6404168b83db0773fcf5815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4a0d57c8e454599ee00c3e30de3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:52.470411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56331058-aade-4253-a154-6cd3e040d004 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:52.470908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56331058-aade-4253-a154-6cd3e040d004 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-130c86aa-d031-40ce-b819-a13d704fbd9a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Request method failure captured: Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EO_7imK04D2xWJEBt0AkQmGyPwCb-WRFBh1TZLEihYfs2DZLYMKYm7FyEHd8uw7BsQhPjXd3gCMcrdH1nDG6BbSUXfMcqWm6sJUc-9J0MeyhFEadhBcRgabPPJg1BUSRbAvWijBUc-am44Ra-NIINUJ-rem8_xaMM4_W0jx6kJ4x1k Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:52.471749 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31b4a0d57c8e454599ee00c3e30de3a6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}] Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 803c9336f6404168b83db0773fcf5815 Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 19:43:52.473000 n-d-708768-8 devstack@n-api.service[125963]: action_args: {} Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:52.473682 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 19:43:52.474738 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:52.477804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-130c86aa-d031-40ce-b819-a13d704fbd9a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:52.479104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-130c86aa-d031-40ce-b819-a13d704fbd9a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.024604 Jul 26 19:43:52.482203 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 124/246] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:43:52 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:52.650989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4929146f-323f-434a-9687-244f97d6e272 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:52.655322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4929146f-323f-434a-9687-244f97d6e272 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:52.677695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4929146f-323f-434a-9687-244f97d6e272 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:52.678174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4929146f-323f-434a-9687-244f97d6e272 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:52.682734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4929146f-323f-434a-9687-244f97d6e272 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:52.683190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4929146f-323f-434a-9687-244f97d6e272 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:52.774892 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56331058-aade-4253-a154-6cd3e040d004 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 226 microversion: 2.1 time: 0.356801 Jul 26 19:43:52.775505 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 123/247] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 19:43:52 2022] POST /compute/v2.1/os-aggregates/11/action => generated 226 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:52.789083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc7a1cf8-91d0-462f-bbd1-8419288cfbaa tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:52.792327 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.792327 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:52.837238 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc7a1cf8-91d0-462f-bbd1-8419288cfbaa tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.053144 Jul 26 19:43:52.838416 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 124/248] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:52 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:52.845275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=14 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:52.855031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b0a8078-bca9-42a1-8c04-e4a99c9b740b tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2012602129"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:52.863048 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.863048 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:52.869461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-5b0a8078-bca9-42a1-8c04-e4a99c9b740b tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid b43692fe-eb88-46e6-9363-d9a10f566a2a for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:52.917849 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b0a8078-bca9-42a1-8c04-e4a99c9b740b tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073536 Jul 26 19:43:52.918462 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 125/249] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:43:52.925223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-50772a3f-89b3-4dec-934c-996dbeeaca4e tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2016650753"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:52.928919 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.928919 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:52.929863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-50772a3f-89b3-4dec-934c-996dbeeaca4e tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid 3917df0d-9a0d-4435-9b0c-2af47e6385df for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:52.968820 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-50772a3f-89b3-4dec-934c-996dbeeaca4e tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046192 Jul 26 19:43:52.978755 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 126/250] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:52.978755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8774876d-925c-43e0-bacc-9a9535b33bc5 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:52.978755 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:52.978755 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:53.015490 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8774876d-925c-43e0-bacc-9a9535b33bc5 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.043147 Jul 26 19:43:53.023661 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 127/251] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:52 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:53.030183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad078233-52fa-42f2-a15e-e4752074c9a8 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:53.032742 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.032742 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:53.058970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad078233-52fa-42f2-a15e-e4752074c9a8 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:53.059417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad078233-52fa-42f2-a15e-e4752074c9a8 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:53.132375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4929146f-323f-434a-9687-244f97d6e272 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:53.158557 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4929146f-323f-434a-9687-244f97d6e272 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 0.518019 Jul 26 19:43:53.173696 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 125/252] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:52 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:53.195489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26e940f6-73f3-4714-8dc8-bce716a52026 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.196533 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.196533 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.211252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-26e940f6-73f3-4714-8dc8-bce716a52026 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26e940f6-73f3-4714-8dc8-bce716a52026 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Request method failure captured: Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPETeaGARnb8WU_b-RIZyIRdNDEuXLZ8YMTtHV1WzpimM6GeVmlbdXEDZoFC2vO40LFKygIr2ZmgjBpKGYslia_ex5b0ZWF7M-4hZtkNRgbFCph-cuQVPCSK7HceQJMmGjwbBNpYzVGqrhkd1X27kObMMsK4T2xIfZkztNGpoirw90 Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e7afa735e2b94d1389ba7640acc4306c Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:53.215272 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7afa735e2b94d1389ba7640acc4306c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7afa735e2b94d1389ba7640acc4306c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7afa735e2b94d1389ba7640acc4306c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7afa735e2b94d1389ba7640acc4306c"}]}] Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e7afa735e2b94d1389ba7640acc4306c Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminTestJSON-562603315-project-admin Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e04ea8b063894432aa78dc76307a2236 Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminTestJSON-562603315-project-admin Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: exception: Aggregate 12 could not be found. Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '12'} Jul 26 19:43:53.216981 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.217861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 26 19:43:53.218911 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.220459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26e940f6-73f3-4714-8dc8-bce716a52026 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:53.229185 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26e940f6-73f3-4714-8dc8-bce716a52026 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.046151 Jul 26 19:43:53.229445 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad078233-52fa-42f2-a15e-e4752074c9a8 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.207057 Jul 26 19:43:53.232954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 128/254] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 19:43:53 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:53.233087 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 126/254] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:53 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:53.238060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e33c1b94-8a63-4759-a871-b724d2dba8fa tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.239659 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.239659 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:53.243051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-63dca309-ebfd-4363-a7a2-d3aa90fb0d0a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:53.246256 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.246256 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.247140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-63dca309-ebfd-4363-a7a2-d3aa90fb0d0a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '803c9336f6404168b83db0773fcf5815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b4a0d57c8e454599ee00c3e30de3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-63dca309-ebfd-4363-a7a2-d3aa90fb0d0a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Request method failure captured: Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 42 Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EO_7imK04D2xWJEBt0AkQmGyPwCb-WRFBh1TZLEihYfs2DZLYMKYm7FyEHd8uw7BsQhPjXd3gCMcrdH1nDG6BbSUXfMcqWm6sJUc-9J0MeyhFEadhBcRgabPPJg1BUSRbAvWijBUc-am44Ra-NIINUJ-rem8_xaMM4_W0jx6kJ4x1k Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:53.248748 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_31b4a0d57c8e454599ee00c3e30de3a6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/31b4a0d57c8e454599ee00c3e30de3a6"}]}] Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 31b4a0d57c8e454599ee00c3e30de3a6 Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-169574571 Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 803c9336f6404168b83db0773fcf5815 Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-169574571-project Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: {"remove_host": {"host": "n-h1-708768-8"}} Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:53.249940 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-708768-8'}}} Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:53.250675 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 19:43:53.251815 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.252851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-63dca309-ebfd-4363-a7a2-d3aa90fb0d0a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:53.252851 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-63dca309-ebfd-4363-a7a2-d3aa90fb0d0a tempest-AggregatesAdminNegativeTestJSON-169574571 tempest-AggregatesAdminNegativeTestJSON-169574571-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.012864 Jul 26 19:43:53.255431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-e33c1b94-8a63-4759-a871-b724d2dba8fa tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 26 19:43:53.255868 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 127/255] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 19:43:53 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e33c1b94-8a63-4759-a871-b724d2dba8fa tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Request method failure captured: Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPETeaGARnb8WU_b-RIZyIRdNDEuXLZ8YMTtHV1WzpimM6GeVmlbdXEDZoFC2vO40LFKygIr2ZmgjBpKGYslia_ex5b0ZWF7M-4hZtkNRgbFCph-cuQVPCSK7HceQJMmGjwbBNpYzVGqrhkd1X27kObMMsK4T2xIfZkztNGpoirw90 Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e7afa735e2b94d1389ba7640acc4306c Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:43:53.258289 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7afa735e2b94d1389ba7640acc4306c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7afa735e2b94d1389ba7640acc4306c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7afa735e2b94d1389ba7640acc4306c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7afa735e2b94d1389ba7640acc4306c"}]}] Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e7afa735e2b94d1389ba7640acc4306c Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AggregatesAdminTestJSON-562603315-project-admin Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: e04ea8b063894432aa78dc76307a2236 Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AggregatesAdminTestJSON-562603315-project-admin Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: exception: Aggregate 12 could not be found. Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '12'} Jul 26 19:43:53.259637 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:53.260364 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.261377 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.263720 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.263720 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:53.263720 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:53.263720 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 26 19:43:53.263720 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.263720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e33c1b94-8a63-4759-a871-b724d2dba8fa tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:53.263720 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e33c1b94-8a63-4759-a871-b724d2dba8fa tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.025547 Jul 26 19:43:53.265355 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 129/256] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:53 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:53.270621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5c5f590-dca0-4060-adfe-5546f426e5f4 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:53.271118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2e30e32f-f6e6-4005-ad6d-34811ffa3fff tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-876757413", "name": "tempest-test_aggregate-897078872"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:53.275858 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.275858 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:53.277058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-2e30e32f-f6e6-4005-ad6d-34811ffa3fff tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid e0115b16-0b01-4ec8-bcae-673fd9472cb8 for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:53.299721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5c5f590-dca0-4060-adfe-5546f426e5f4 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:53.300772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5c5f590-dca0-4060-adfe-5546f426e5f4 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:53.342372 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2e30e32f-f6e6-4005-ad6d-34811ffa3fff tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.071548 Jul 26 19:43:53.350530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 130/257] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Jul 26 19:43:53 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:53.357084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4ff9190-2519-45b8-8ef9-71db1c3e4e72 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.358775 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.358775 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:53.392457 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4ff9190-2519-45b8-8ef9-71db1c3e4e72 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.040424 Jul 26 19:43:53.397945 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 131/258] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:53.403631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d75ab369-4688-4fc7-a885-9e8d4ff36da2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.404324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d75ab369-4688-4fc7-a885-9e8d4ff36da2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:53.413567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d75ab369-4688-4fc7-a885-9e8d4ff36da2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:53.414146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d75ab369-4688-4fc7-a885-9e8d4ff36da2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:53.414935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d75ab369-4688-4fc7-a885-9e8d4ff36da2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:53.415368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d75ab369-4688-4fc7-a885-9e8d4ff36da2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:53.488406 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c5c5f590-dca0-4060-adfe-5546f426e5f4 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.230622 Jul 26 19:43:53.490062 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 128/259] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 19:43:53 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:53.505674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12512309-57bc-4257-8710-fa1793f759a1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.506581 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.506581 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.513073 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-12512309-57bc-4257-8710-fa1793f759a1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12512309-57bc-4257-8710-fa1793f759a1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Request method failure captured: Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPETeaGARnb8WU_b-RIZyIRdNDEuXLZ8YMTtHV1WzpimM6GeVmlbdXEDZoFC2vO40LFKygIr2ZmgjBpKGYslia_ex5b0ZWF7M-4hZtkNRgbFCph-cuQVPCSK7HceQJMmGjwbBNpYzVGqrhkd1X27kObMMsK4T2xIfZkztNGpoirw90 Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e7afa735e2b94d1389ba7640acc4306c Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:53.514732 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7afa735e2b94d1389ba7640acc4306c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7afa735e2b94d1389ba7640acc4306c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7afa735e2b94d1389ba7640acc4306c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7afa735e2b94d1389ba7640acc4306c"}]}] Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e7afa735e2b94d1389ba7640acc4306c Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminTestJSON-562603315-project-admin Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e04ea8b063894432aa78dc76307a2236 Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminTestJSON-562603315-project-admin Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: exception: Aggregate 14 could not be found. Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '14'} Jul 26 19:43:53.516270 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.517170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 26 19:43:53.518529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.519866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12512309-57bc-4257-8710-fa1793f759a1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:53.521002 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-12512309-57bc-4257-8710-fa1793f759a1 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.029650 Jul 26 19:43:53.521966 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 129/260] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:53 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:53.526996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6815df08-c07d-4f27-b2a5-1038e876b7d3 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.527889 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.527889 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.560227 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6815df08-c07d-4f27-b2a5-1038e876b7d3 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.037062 Jul 26 19:43:53.561117 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 130/261] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:53 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:53.571795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d60b1e4-b38c-4119-998b-dab0e96263b6 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.572838 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.572838 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.589697 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-8d60b1e4-b38c-4119-998b-dab0e96263b6 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d60b1e4-b38c-4119-998b-dab0e96263b6 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Request method failure captured: Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPETeaGARnb8WU_b-RIZyIRdNDEuXLZ8YMTtHV1WzpimM6GeVmlbdXEDZoFC2vO40LFKygIr2ZmgjBpKGYslia_ex5b0ZWF7M-4hZtkNRgbFCph-cuQVPCSK7HceQJMmGjwbBNpYzVGqrhkd1X27kObMMsK4T2xIfZkztNGpoirw90 Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e7afa735e2b94d1389ba7640acc4306c Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:53.592522 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e7afa735e2b94d1389ba7640acc4306c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7afa735e2b94d1389ba7640acc4306c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e7afa735e2b94d1389ba7640acc4306c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e7afa735e2b94d1389ba7640acc4306c"}]}] Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e7afa735e2b94d1389ba7640acc4306c Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-562603315 Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminTestJSON-562603315-project-admin Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e04ea8b063894432aa78dc76307a2236 Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminTestJSON-562603315-project-admin Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: exception: Aggregate 14 could not be found. Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '14'} Jul 26 19:43:53.593768 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:53.594477 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.595510 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.599999 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.599999 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:53.599999 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:53.599999 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 26 19:43:53.599999 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.602394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d60b1e4-b38c-4119-998b-dab0e96263b6 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:53.603771 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d60b1e4-b38c-4119-998b-dab0e96263b6 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.040990 Jul 26 19:43:53.604941 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 131/262] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:53.627879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f6a9a1e5-9988-4955-ae30-2e93305c8095 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-733281526"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:53.638202 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.638202 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.647402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.aggregate [None req-f6a9a1e5-9988-4955-ae30-2e93305c8095 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Generated uuid 9785b6f4-89e8-4595-b267-de33fe745688 for aggregate {{(pid=125963) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:53.701036 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f6a9a1e5-9988-4955-ae30-2e93305c8095 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091956 Jul 26 19:43:53.709465 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 132/263] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:53.721132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0626f1a6-d227-41ef-83b1-108902cf3bcc tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1034761118"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:53.726515 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.726515 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.741984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.aggregate [None req-0626f1a6-d227-41ef-83b1-108902cf3bcc tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid 1b623383-820a-4a59-8b5b-b0c1fe66acff for aggregate {{(pid=125963) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:53.795533 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0626f1a6-d227-41ef-83b1-108902cf3bcc tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082584 Jul 26 19:43:53.798221 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 133/264] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:53.814804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:53.818801 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.818801 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.839135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:53.840365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:53.860688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:53.864295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:53.885800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.compute.aggregates [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 26 19:43:53.886618 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Request method failure captured: Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 42 Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPCbgXgcJep9pkLtih39pcBHS7tzrB_M1hb_tGWeJ0qPovOE-FxIMkps6hXXWaDElrvj42S0yIA1bsh7cVYhw1B3ASqsFOMR9vNNaIxp-_1iawrZQIY5iy_woIeDR6zC9k0z-em18c-jzerZo9OaLLSZvWNUZo61oFeiCZEfvWbjTc Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:43:53.888836 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2e936bc760804a9e8446da86e3d9999c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2e936bc760804a9e8446da86e3d9999c"}]}] Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2e936bc760804a9e8446da86e3d9999c Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132 Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5668e62f221f4a0ca140f30334188696 Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: {"remove_host": {"host": "nonexist_host"}} Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:53.890356 n-d-708768-8 devstack@n-api.service[125963]: exception: Cannot remove host nonexist_host in aggregate 15 Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 26 19:43:53.891274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 26 19:43:53.892701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.894181 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:53.895944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:53.895944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:53.895944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:53.895944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:53.895944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Jul 26 19:43:53.895944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:53.902355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:53.904000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-afc6e10f-6ea9-4b27-9521-adbe1aaf46cc tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.104483 Jul 26 19:43:53.912646 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 134/265] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 19:43:53 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:43:53.927924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80f85bd6-2c98-4c46-b83d-8bcd37ef037d tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.931213 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.931213 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:53.946548 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80f85bd6-2c98-4c46-b83d-8bcd37ef037d tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.032316 Jul 26 19:43:53.950685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 135/266] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:53 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:53.956082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-895eebdc-2abf-4449-89a0-fa8c66fc1634 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:53.962758 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:53.962758 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:54.049495 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-895eebdc-2abf-4449-89a0-fa8c66fc1634 tempest-AggregatesAdminNegativeTestJSON-1721164132 tempest-AggregatesAdminNegativeTestJSON-1721164132-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.097491 Jul 26 19:43:54.057418 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 136/267] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:54.074590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a419542-9cf0-45b7-a612-ce3f89d29821 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:54.079868 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.079868 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:54.151740 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a419542-9cf0-45b7-a612-ce3f89d29821 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.093636 Jul 26 19:43:54.154596 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 137/268] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 19:43:54 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:54.182290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa80fb56-ecd3-4dc1-9ebc-80125b4c0cd9 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:54.184551 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.184551 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:54.217203 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa80fb56-ecd3-4dc1-9ebc-80125b4c0cd9 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.046210 Jul 26 19:43:54.218489 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 138/269] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 19:43:54 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:54.224037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a15e92b-f3c4-42b3-9997-6c01995f6056 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:54.242477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a15e92b-f3c4-42b3-9997-6c01995f6056 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:54.256583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a15e92b-f3c4-42b3-9997-6c01995f6056 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:54.264299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a15e92b-f3c4-42b3-9997-6c01995f6056 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:54.268445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a15e92b-f3c4-42b3-9997-6c01995f6056 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:54.271342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a15e92b-f3c4-42b3-9997-6c01995f6056 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:54.282180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d75ab369-4688-4fc7-a885-9e8d4ff36da2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:54.294604 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d75ab369-4688-4fc7-a885-9e8d4ff36da2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 0.894710 Jul 26 19:43:54.310410 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 132/270] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:53 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:54.321035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd159082-3f1e-4bae-8223-35b544ad55c8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:54.327089 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.327089 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:54.398589 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd159082-3f1e-4bae-8223-35b544ad55c8 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.098835 Jul 26 19:43:54.404581 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 133/271] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:54 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:54.424410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-406a80e5-7a23-4fe0-8a0b-4ba43017f68f tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-696169841", "availability_zone": "tempest-test_az-1026439337"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:54.435583 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.435583 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:54.443715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-406a80e5-7a23-4fe0-8a0b-4ba43017f68f tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid 025c99e4-65aa-4b50-9497-08361cc25982 for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:54.507883 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-406a80e5-7a23-4fe0-8a0b-4ba43017f68f tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.101290 Jul 26 19:43:54.517041 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 134/272] 10.222.0.58 () {60 vars in 1165 bytes} [Tue Jul 26 19:43:54 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:54.522946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c8ed04fe-6cc5-4904-9b43-120a580c2def tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-696169841_new", "availability_zone": "tempest-test_az-1026439337_new"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:54.533244 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.533244 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:54.561029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=14,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:54.592179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8ed04fe-6cc5-4904-9b43-120a580c2def tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:54.594423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8ed04fe-6cc5-4904-9b43-120a580c2def tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:54.670694 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c8ed04fe-6cc5-4904-9b43-120a580c2def tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.151981 Jul 26 19:43:54.671893 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 135/273] 10.222.0.58 () {60 vars in 1173 bytes} [Tue Jul 26 19:43:54 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:54.694309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b496d24d-eae4-4f9c-b0f6-26df9b6f35af tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:54.697605 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.697605 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:54.718612 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b496d24d-eae4-4f9c-b0f6-26df9b6f35af tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.038160 Jul 26 19:43:54.726711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 136/274] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:43:54 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:54.735420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5e539816-cf99-4101-b8d8-842933a026ce tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:54.737269 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.737269 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:54.805673 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5e539816-cf99-4101-b8d8-842933a026ce tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.072445 Jul 26 19:43:54.807428 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 137/275] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:54 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:54.817615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a15e92b-f3c4-42b3-9997-6c01995f6056 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:54.821182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3cc5e51b-7fbc-46f9-a6a3-3c31bd28c699 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1508978926"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:54.827951 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a15e92b-f3c4-42b3-9997-6c01995f6056 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 0.606433 Jul 26 19:43:54.829398 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 139/276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:54 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:54.830183 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.830183 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:54.833090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-3cc5e51b-7fbc-46f9-a6a3-3c31bd28c699 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Generated uuid 503a2a69-9332-4988-bacb-6986a2940335 for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 19:43:54.877325 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3cc5e51b-7fbc-46f9-a6a3-3c31bd28c699 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064378 Jul 26 19:43:54.879855 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 138/277] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 19:43:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:54.889896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-785b6531-670c-43fd-92eb-050f5a03c237 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:54.890945 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.890945 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:54.910061 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-785b6531-670c-43fd-92eb-050f5a03c237 tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.024428 Jul 26 19:43:54.914367 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 140/278] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:43:54 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:54.924647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-544ac4ea-8ac8-427a-98a3-decb93b4327e tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:54.925805 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:54.925805 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:43:54.954570 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-544ac4ea-8ac8-427a-98a3-decb93b4327e tempest-AggregatesAdminTestJSON-562603315 tempest-AggregatesAdminTestJSON-562603315-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.033530 Jul 26 19:43:54.955795 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 139/279] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:43:54 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 19:43:54.967096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:54.967925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:54.980423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:54.981567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:54.982693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:54.983508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:55.001968 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] HTTP exception thrown: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Request method failure captured: Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 HTTP/1.1 Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPBOm2Y0KhBZDUkVWIiS_f2SvEr6mfICqoCpgcyFwPBMIv5HKrsySaWJypewGVeBv9mQPr9L32ZMUh7CoTZEvyeEjfrKTtnqj8G4cdsUXwYdVOvQvEB63eq0gtR5MAXAvhxDXGGvCZ78qIhCT6rwDrsKh6LgHMWB5L49XlhU9bxftM Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: faba42986787481ca4f0f0136146df2f Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:43:55.004205 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/faba42986787481ca4f0f0136146df2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/faba42986787481ca4f0f0136146df2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_faba42986787481ca4f0f0136146df2f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/faba42986787481ca4f0f0136146df2f"}]}] Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: faba42986787481ca4f0f0136146df2f Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AggregatesAdminTestJSON-1890671270-project Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c0f3a87454ce4b7c93f7ea400bb41cba Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AggregatesAdminTestJSON-1890671270-project Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.005551 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'daa4d676-0350-4966-98db-fdf47eccbf14'} Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:55.006349 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.007424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.010025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Returning 404 to user: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:55.010904 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5e9d4d85-cffe-442a-a0e4-41a9373809fc tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "DELETE /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 404 len: 111 microversion: 2.1 time: 0.048258 Jul 26 19:43:55.015447 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 141/280] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:43:54 2022] DELETE /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:43:55.032040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:55.032730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] [instance: daa4d676-0350-4966-98db-fdf47eccbf14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:55.047152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:55.049095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:55.050719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:55.051335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:55.085319 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] HTTP exception thrown: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Request method failure captured: Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 HTTP/1.1 Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPBOm2Y0KhBZDUkVWIiS_f2SvEr6mfICqoCpgcyFwPBMIv5HKrsySaWJypewGVeBv9mQPr9L32ZMUh7CoTZEvyeEjfrKTtnqj8G4cdsUXwYdVOvQvEB63eq0gtR5MAXAvhxDXGGvCZ78qIhCT6rwDrsKh6LgHMWB5L49XlhU9bxftM Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: faba42986787481ca4f0f0136146df2f Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:43:55.091257 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/faba42986787481ca4f0f0136146df2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/faba42986787481ca4f0f0136146df2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_faba42986787481ca4f0f0136146df2f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/faba42986787481ca4f0f0136146df2f"}]}] Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: faba42986787481ca4f0f0136146df2f Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1890671270 Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AggregatesAdminTestJSON-1890671270-project Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c0f3a87454ce4b7c93f7ea400bb41cba Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AggregatesAdminTestJSON-1890671270-project Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.092539 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'daa4d676-0350-4966-98db-fdf47eccbf14'} Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:43:55.093231 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. Jul 26 19:43:55.098937 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:43:55.099947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] Returning 404 to user: Instance daa4d676-0350-4966-98db-fdf47eccbf14 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:43:55.099947 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce205845-f03c-4e72-be49-c1e7012bc18b tempest-AggregatesAdminTestJSON-1890671270 tempest-AggregatesAdminTestJSON-1890671270-project] 10.222.0.58 "GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14" status: 404 len: 111 microversion: 2.1 time: 0.076725 Jul 26 19:43:55.099947 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 140/281] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:55 2022] GET /compute/v2.1/servers/daa4d676-0350-4966-98db-fdf47eccbf14 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:43:55.319167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-473a9831-6bc9-4269-a3da-a86073a3cdbc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:55.320275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-473a9831-6bc9-4269-a3da-a86073a3cdbc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:55.333766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-473a9831-6bc9-4269-a3da-a86073a3cdbc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:55.335250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-473a9831-6bc9-4269-a3da-a86073a3cdbc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:55.340016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-473a9831-6bc9-4269-a3da-a86073a3cdbc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:55.340741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-473a9831-6bc9-4269-a3da-a86073a3cdbc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:55.853727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e1edc4a-2f54-49b4-8ae2-d34c8e438cf2 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:55.854484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e1edc4a-2f54-49b4-8ae2-d34c8e438cf2 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:55.875624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e1edc4a-2f54-49b4-8ae2-d34c8e438cf2 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:55.877622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e1edc4a-2f54-49b4-8ae2-d34c8e438cf2 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:55.879525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e1edc4a-2f54-49b4-8ae2-d34c8e438cf2 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:55.881230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e1edc4a-2f54-49b4-8ae2-d34c8e438cf2 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:56.036753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-473a9831-6bc9-4269-a3da-a86073a3cdbc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:56.047550 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-473a9831-6bc9-4269-a3da-a86073a3cdbc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 0.733325 Jul 26 19:43:56.064866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 142/282] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:55 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:56.431206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-9aa7ecc1-50cb-4fa7-810b-fddbd79ad6e3 req-6bcc2ef3-3a7e-48b4-b21b-7b1f8e23c291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a4a582-0699-43a9-89f9-19b22e0cda22", "name": "network-vif-plugged", "status": "completed", "tag": "f7718a1a-4b41-487e-ae8e-fd904b4c47e0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:56.478251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9aa7ecc1-50cb-4fa7-810b-fddbd79ad6e3 req-6bcc2ef3-3a7e-48b4-b21b-7b1f8e23c291 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:56.481505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9aa7ecc1-50cb-4fa7-810b-fddbd79ad6e3 req-6bcc2ef3-3a7e-48b4-b21b-7b1f8e23c291 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:56.530680 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-9aa7ecc1-50cb-4fa7-810b-fddbd79ad6e3 req-6bcc2ef3-3a7e-48b4-b21b-7b1f8e23c291 service nova] Creating event network-vif-plugged:f7718a1a-4b41-487e-ae8e-fd904b4c47e0 for instance 50a4a582-0699-43a9-89f9-19b22e0cda22 on n-h2-708768-8 Jul 26 19:43:56.542769 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-9aa7ecc1-50cb-4fa7-810b-fddbd79ad6e3 req-6bcc2ef3-3a7e-48b4-b21b-7b1f8e23c291 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120519 Jul 26 19:43:56.546428 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 143/283] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:43:56.918687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-01b8560c-afb6-4c9a-b7d6-f96a1d8bf849 tempest-QuotaClassesAdminTestJSON-1561313869 tempest-QuotaClassesAdminTestJSON-1561313869-project-admin] Calling method '.version_select at 0x7f87643391f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:56.919584 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:56.919584 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:56.945509 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-01b8560c-afb6-4c9a-b7d6-f96a1d8bf849 tempest-QuotaClassesAdminTestJSON-1561313869 tempest-QuotaClassesAdminTestJSON-1561313869-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.250342 Jul 26 19:43:56.955215 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 144/284] 10.222.0.58 () {58 vars in 1185 bytes} [Tue Jul 26 19:43:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:43:56.961565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-424b98ae-4094-49f7-9d73-6b871a748bb4 tempest-QuotaClassesAdminTestJSON-1561313869 tempest-QuotaClassesAdminTestJSON-1561313869-project-admin] Action: 'update', calling method: .version_select at 0x7f87660379d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:56.974773 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:43:56.974773 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:43:57.038543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:57.130489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e1edc4a-2f54-49b4-8ae2-d34c8e438cf2 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:57.144824 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e1edc4a-2f54-49b4-8ae2-d34c8e438cf2 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 1.294131 Jul 26 19:43:57.147669 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 141/285] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:55 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:43:57.158309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-58849c05-ceea-4aaf-8225-440d3bdb1c18 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:57.162239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-58849c05-ceea-4aaf-8225-440d3bdb1c18 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:57.175474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58849c05-ceea-4aaf-8225-440d3bdb1c18 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:57.178816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58849c05-ceea-4aaf-8225-440d3bdb1c18 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:57.181075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58849c05-ceea-4aaf-8225-440d3bdb1c18 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:57.182871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58849c05-ceea-4aaf-8225-440d3bdb1c18 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:57.485090 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-424b98ae-4094-49f7-9d73-6b871a748bb4 tempest-QuotaClassesAdminTestJSON-1561313869 tempest-QuotaClassesAdminTestJSON-1561313869-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.528280 Jul 26 19:43:57.485989 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 145/286] 10.222.0.58 () {60 vars in 1206 bytes} [Tue Jul 26 19:43:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:57.501053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3b3798a0-5115-45d8-8a00-4d05b1785a1b tempest-QuotaClassesAdminTestJSON-1561313869 tempest-QuotaClassesAdminTestJSON-1561313869-project-admin] Calling method '.version_select at 0x7f8764621670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:57.515954 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3b3798a0-5115-45d8-8a00-4d05b1785a1b tempest-QuotaClassesAdminTestJSON-1561313869 tempest-QuotaClassesAdminTestJSON-1561313869-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.018800 Jul 26 19:43:57.517437 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 146/287] 10.222.0.58 () {58 vars in 1185 bytes} [Tue Jul 26 19:43:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:43:57.536678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7717f857-d706-463f-b335-fc240aae34e8 tempest-QuotaClassesAdminTestJSON-1561313869 tempest-QuotaClassesAdminTestJSON-1561313869-project-admin] Action: 'update', calling method: .version_select at 0x7f876431eca0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:57.758849 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7717f857-d706-463f-b335-fc240aae34e8 tempest-QuotaClassesAdminTestJSON-1561313869 tempest-QuotaClassesAdminTestJSON-1561313869-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.231170 Jul 26 19:43:57.759461 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 147/288] 10.222.0.58 () {60 vars in 1206 bytes} [Tue Jul 26 19:43:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:57.922163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-58849c05-ceea-4aaf-8225-440d3bdb1c18 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:57.943849 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-58849c05-ceea-4aaf-8225-440d3bdb1c18 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 0.790936 Jul 26 19:43:57.946509 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 142/289] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:57 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:58.168839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-937f7344-8241-4971-9f39-3b125c6d2936 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:58.170047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-937f7344-8241-4971-9f39-3b125c6d2936 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:58.180093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-937f7344-8241-4971-9f39-3b125c6d2936 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:58.180556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-937f7344-8241-4971-9f39-3b125c6d2936 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:58.183551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-937f7344-8241-4971-9f39-3b125c6d2936 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:58.184048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-937f7344-8241-4971-9f39-3b125c6d2936 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:58.408089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-937f7344-8241-4971-9f39-3b125c6d2936 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:58.416744 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-937f7344-8241-4971-9f39-3b125c6d2936 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 0.252747 Jul 26 19:43:58.431657 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 148/290] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:58 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:58.971138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afd62d37-559c-4a7f-b057-5be5a6d1fc74 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:58.971868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-afd62d37-559c-4a7f-b057-5be5a6d1fc74 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:59.014183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:43:59.022381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afd62d37-559c-4a7f-b057-5be5a6d1fc74 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:59.022836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afd62d37-559c-4a7f-b057-5be5a6d1fc74 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:59.033608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afd62d37-559c-4a7f-b057-5be5a6d1fc74 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:59.034111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afd62d37-559c-4a7f-b057-5be5a6d1fc74 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:59.451799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd654371-9910-4ce9-b694-1d1dcb4784e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:43:59.452455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd654371-9910-4ce9-b694-1d1dcb4784e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:43:59.466135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd654371-9910-4ce9-b694-1d1dcb4784e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:59.466879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd654371-9910-4ce9-b694-1d1dcb4784e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:59.467874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd654371-9910-4ce9-b694-1d1dcb4784e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:59.468490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd654371-9910-4ce9-b694-1d1dcb4784e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:59.653098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd654371-9910-4ce9-b694-1d1dcb4784e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:59.665366 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd654371-9910-4ce9-b694-1d1dcb4784e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 0.229704 Jul 26 19:43:59.676191 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 149/291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:59 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:43:59.691317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-09ea26ce-9a0f-4d34-a07b-042a8684f556 req-38a04e7b-2010-48a4-88a7-7b441e72be9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6565e25a-1a8a-479f-87f9-9666c3cdfbf5", "name": "network-vif-plugged", "status": "completed", "tag": "7d464596-acdd-4bd5-92c5-f59401525b9d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:43:59.715577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-09ea26ce-9a0f-4d34-a07b-042a8684f556 req-38a04e7b-2010-48a4-88a7-7b441e72be9e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:43:59.716227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-09ea26ce-9a0f-4d34-a07b-042a8684f556 req-38a04e7b-2010-48a4-88a7-7b441e72be9e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:43:59.748372 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-09ea26ce-9a0f-4d34-a07b-042a8684f556 req-38a04e7b-2010-48a4-88a7-7b441e72be9e service nova] Creating event network-vif-plugged:7d464596-acdd-4bd5-92c5-f59401525b9d for instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 on n-h1-708768-8 Jul 26 19:43:59.751000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afd62d37-559c-4a7f-b057-5be5a6d1fc74 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:43:59.760820 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afd62d37-559c-4a7f-b057-5be5a6d1fc74 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1390 microversion: 2.1 time: 0.796441 Jul 26 19:43:59.761414 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-09ea26ce-9a0f-4d34-a07b-042a8684f556 req-38a04e7b-2010-48a4-88a7-7b441e72be9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078018 Jul 26 19:43:59.762561 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 150/292] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:43:59.778717 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 143/293] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:43:58 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1390 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:00.687792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e83d36cc-61e0-44ff-922a-9e3ba4d725d7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:00.689020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e83d36cc-61e0-44ff-922a-9e3ba4d725d7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:00.699526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e83d36cc-61e0-44ff-922a-9e3ba4d725d7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:00.701028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e83d36cc-61e0-44ff-922a-9e3ba4d725d7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:00.703203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e83d36cc-61e0-44ff-922a-9e3ba4d725d7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:00.704525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e83d36cc-61e0-44ff-922a-9e3ba4d725d7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:00.940160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b3a20a2-8823-4474-85ac-cc3e7c91848a tempest-FlavorMetadataValidation-1491762681 tempest-FlavorMetadataValidation-1491762681-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-95877357", "id": 1060711374, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:00.955871 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:00.955871 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:01.015174 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b3a20a2-8823-4474-85ac-cc3e7c91848a tempest-FlavorMetadataValidation-1491762681 tempest-FlavorMetadataValidation-1491762681-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 469 microversion: 2.86 time: 0.356439 Jul 26 19:44:01.020320 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 151/294] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:44:00 2022] POST /compute/v2.1/flavors => generated 469 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:01.037908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dd7dd20f-c0c9-485f-b898-98edd33fc4dd tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:01.038981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dd7dd20f-c0c9-485f-b898-98edd33fc4dd tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:01.052101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd7dd20f-c0c9-485f-b898-98edd33fc4dd tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:01.052693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd7dd20f-c0c9-485f-b898-98edd33fc4dd tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:01.054716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd7dd20f-c0c9-485f-b898-98edd33fc4dd tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:01.061808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd7dd20f-c0c9-485f-b898-98edd33fc4dd tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:01.346421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dd7dd20f-c0c9-485f-b898-98edd33fc4dd tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:01.356009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dd7dd20f-c0c9-485f-b898-98edd33fc4dd tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1590 microversion: 2.1 time: 0.333787 Jul 26 19:44:01.368142 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 152/295] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:01 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1590 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:01.372673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3cca24aa-47fa-43b4-9d22-4acb5224e61e tempest-FlavorMetadataValidation-1491762681 tempest-FlavorMetadataValidation-1491762681-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:01.376345 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:01.376345 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:01.854035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=12,nova_api:UPDATE=22 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:01.933418 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3cca24aa-47fa-43b4-9d22-4acb5224e61e tempest-FlavorMetadataValidation-1491762681 tempest-FlavorMetadataValidation-1491762681-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1060711374/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.572256 Jul 26 19:44:01.937758 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 153/296] 10.222.0.58 () {62 vars in 1265 bytes} [Tue Jul 26 19:44:01 2022] POST /compute/v2.1/flavors/1060711374/os-extra_specs => generated 62 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:01.961016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ef396a5-1253-4be6-ada5-ca878a81d725 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:01.963116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6ef396a5-1253-4be6-ada5-ca878a81d725 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:01.976175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ef396a5-1253-4be6-ada5-ca878a81d725 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:01.982872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ef396a5-1253-4be6-ada5-ca878a81d725 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:01.985059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ef396a5-1253-4be6-ada5-ca878a81d725 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:01.985902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ef396a5-1253-4be6-ada5-ca878a81d725 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:02.094994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e83d36cc-61e0-44ff-922a-9e3ba4d725d7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:02.103547 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e83d36cc-61e0-44ff-922a-9e3ba4d725d7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1319 microversion: 2.1 time: 1.419994 Jul 26 19:44:02.121395 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 144/297] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:00 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1319 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:02.126416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c5501c9-7c52-467f-950e-79aa10865452 tempest-FlavorMetadataValidation-1491762681 tempest-FlavorMetadataValidation-1491762681-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:02.127485 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:02.127485 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:02.175508 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c5501c9-7c52-467f-950e-79aa10865452 tempest-FlavorMetadataValidation-1491762681 tempest-FlavorMetadataValidation-1491762681-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1060711374" status: 202 len: 0 microversion: 2.86 time: 0.050328 Jul 26 19:44:02.179075 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 145/298] 10.222.0.58 () {60 vars in 1202 bytes} [Tue Jul 26 19:44:02 2022] DELETE /compute/v2.1/flavors/1060711374 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:44:02.197305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d1c8439b-f909-49b0-a02c-bf0a7417da30 tempest-FlavorMetadataValidation-1491762681 tempest-FlavorMetadataValidation-1491762681-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:02.259950 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d1c8439b-f909-49b0-a02c-bf0a7417da30 tempest-FlavorMetadataValidation-1491762681 tempest-FlavorMetadataValidation-1491762681-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.075660 Jul 26 19:44:02.261795 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 146/299] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:44:02 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:44:02.290493 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6ef396a5-1253-4be6-ada5-ca878a81d725 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.349106 Jul 26 19:44:02.299918 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 154/300] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:44:01 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22/os-interface => generated 285 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:03.135829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6de0cc80-7a9a-4a61-9a0f-3baa4e793f1f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:03.136196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6de0cc80-7a9a-4a61-9a0f-3baa4e793f1f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:03.155081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6de0cc80-7a9a-4a61-9a0f-3baa4e793f1f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:03.155469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6de0cc80-7a9a-4a61-9a0f-3baa4e793f1f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:03.156314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6de0cc80-7a9a-4a61-9a0f-3baa4e793f1f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:03.156742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6de0cc80-7a9a-4a61-9a0f-3baa4e793f1f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:03.957177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6de0cc80-7a9a-4a61-9a0f-3baa4e793f1f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:03.972529 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6de0cc80-7a9a-4a61-9a0f-3baa4e793f1f tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1469 microversion: 2.1 time: 0.841211 Jul 26 19:44:03.973837 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 147/301] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:03 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1469 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:04.000584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=22 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:04.512752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-744374114", "block_migration": true, "disk_over_commit": false}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:04.515941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:04.516426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf7335d5-0237-4a4a-b9ca-d89266c76563 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:04.518056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf7335d5-0237-4a4a-b9ca-d89266c76563 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:04.518495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf7335d5-0237-4a4a-b9ca-d89266c76563 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:04.519276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf7335d5-0237-4a4a-b9ca-d89266c76563 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:04.524555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf7335d5-0237-4a4a-b9ca-d89266c76563 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:04.545353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:04.546005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:04.548534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:04.549147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:04.597953 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf7335d5-0237-4a4a-b9ca-d89266c76563 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.479877 Jul 26 19:44:04.605689 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 148/302] 10.222.0.58 () {58 vars in 1164 bytes} [Tue Jul 26 19:44:04 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 19:44:04.617146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab4a8745-2ce4-45dc-9f6b-f94574c58965 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:04.618012 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:04.618012 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:04.621222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab4a8745-2ce4-45dc-9f6b-f94574c58965 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:04.621670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab4a8745-2ce4-45dc-9f6b-f94574c58965 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:04.622470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab4a8745-2ce4-45dc-9f6b-f94574c58965 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:04.622897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab4a8745-2ce4-45dc-9f6b-f94574c58965 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:04.688866 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ab4a8745-2ce4-45dc-9f6b-f94574c58965 tempest-AZAdminV2TestJSON-743205783 tempest-AZAdminV2TestJSON-743205783-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.082039 Jul 26 19:44:04.695097 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 149/303] 10.222.0.58 () {58 vars in 1185 bytes} [Tue Jul 26 19:44:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:04.715492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lazy-loading 'flavor' on Instance uuid 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:44:04.819099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Going to try to live migrate instance to tempest-host-744374114 {{(pid=125963) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:44:04.842436 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] HTTP exception thrown: Compute host tempest-host-744374114 could not be found. Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Request method failure captured: Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5/action HTTP/1.1 Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 106 Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPsMYAgjEqjIoBbXFgRBvRuf1E55QHIOPhvATuNJZ5BRxRhXKY_4fyeu5nQ5bIRNiFmydujZz4WgBa08jOh4CzC8e1fe8zmfVKQjApObq2qm9rmKSgNcmCNL_gSidV8AAH1oWxMvSAwisVvBHydOliJtZR2NQkHNN_IvdmymEz0YcY Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 73a53e5542ec4a3990f07c5faaddd8b3 Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-LiveMigrationNegativeTest-1391053974 Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:44:04.846409 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/73a53e5542ec4a3990f07c5faaddd8b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/73a53e5542ec4a3990f07c5faaddd8b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_73a53e5542ec4a3990f07c5faaddd8b3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/73a53e5542ec4a3990f07c5faaddd8b3"}]}] Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-LiveMigrationNegativeTest-1391053974 Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 73a53e5542ec4a3990f07c5faaddd8b3 Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1391053974 Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-LiveMigrationNegativeTest-1391053974-project-admin Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bbcf172817924d4284552cf16b1284aa Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-LiveMigrationNegativeTest-1391053974-project-admin Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: {"os-migrateLive": {"host": "tempest-host-744374114", "block_migration": true, "disk_over_commit": false}} Jul 26 19:44:04.847766 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: exception: Compute host tempest-host-744374114 could not be found. Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6565e25a-1a8a-479f-87f9-9666c3cdfbf5', 'body': {'os-migrateLive': {'host': 'tempest-host-744374114', 'block_migration': True, 'disk_over_commit': False}}} Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:44:04.849171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-744374114 could not be found. Jul 26 19:44:04.850252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-744374114 could not be found. Jul 26 19:44:04.851380 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-744374114 could not be found. Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:04.852652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Returning 400 to user: Compute host tempest-host-744374114 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:04.864206 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b15e52b-fb69-47e5-bea1-454a0274982b tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5/action" status: 400 len: 99 microversion: 2.1 time: 0.851947 Jul 26 19:44:04.872036 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 155/304] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jul 26 19:44:03 2022] POST /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5/action => generated 99 bytes in 876 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:44:04.876814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d98285b4-9101-41e1-8abc-e3bb4a82c57a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:04.877435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d98285b4-9101-41e1-8abc-e3bb4a82c57a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:04.903127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d98285b4-9101-41e1-8abc-e3bb4a82c57a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:04.904062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d98285b4-9101-41e1-8abc-e3bb4a82c57a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:04.904880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d98285b4-9101-41e1-8abc-e3bb4a82c57a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:04.905381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d98285b4-9101-41e1-8abc-e3bb4a82c57a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:05.092016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e8ec5b4-e96b-48cf-a492-9f261bf3847f tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Action: 'update', calling method: .version_select at 0x7f8757876310>, body: {"quota_set": {"ram": "5120"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:05.463276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e8ec5b4-e96b-48cf-a492-9f261bf3847f tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:05.463756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e8ec5b4-e96b-48cf-a492-9f261bf3847f tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:05.467374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e8ec5b4-e96b-48cf-a492-9f261bf3847f tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:05.467374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e8ec5b4-e96b-48cf-a492-9f261bf3847f tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:05.538840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d98285b4-9101-41e1-8abc-e3bb4a82c57a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:05.544894 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d98285b4-9101-41e1-8abc-e3bb4a82c57a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1469 microversion: 2.1 time: 0.671799 Jul 26 19:44:05.554901 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 156/305] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:04 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1469 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:05.726622 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e8ec5b4-e96b-48cf-a492-9f261bf3847f tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/e1cf4bfb491441dab2402848c2845820" status: 200 len: 240 microversion: 2.36 time: 0.900762 Jul 26 19:44:05.729277 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 150/306] 10.222.0.58 () {62 vars in 1303 bytes} [Tue Jul 26 19:44:04 2022] PUT /compute/v2.1/os-quota-sets/e1cf4bfb491441dab2402848c2845820 => generated 240 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:44:05.740314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6a007f01-4f10-4b3d-bb05-59c728edd8d0 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Calling method '.version_select at 0x7f87643245e0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:05.938595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-419842671", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:06.051790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:06.264791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a007f01-4f10-4b3d-bb05-59c728edd8d0 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:06.265326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a007f01-4f10-4b3d-bb05-59c728edd8d0 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:06.266220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a007f01-4f10-4b3d-bb05-59c728edd8d0 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:06.266789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a007f01-4f10-4b3d-bb05-59c728edd8d0 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:06.292978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6a007f01-4f10-4b3d-bb05-59c728edd8d0 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/e1cf4bfb491441dab2402848c2845820/detail" status: 200 len: 672 microversion: 2.36 time: 0.556947 Jul 26 19:44:06.294190 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 157/307] 10.222.0.58 () {60 vars in 1304 bytes} [Tue Jul 26 19:44:05 2022] GET /compute/v2.1/os-quota-sets/e1cf4bfb491441dab2402848c2845820/detail => generated 672 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:06.614773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54ddcef4-11dd-4819-89e2-47889c43b06c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:06.616119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54ddcef4-11dd-4819-89e2-47889c43b06c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:06.632356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54ddcef4-11dd-4819-89e2-47889c43b06c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:06.635946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54ddcef4-11dd-4819-89e2-47889c43b06c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:06.636854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54ddcef4-11dd-4819-89e2-47889c43b06c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:06.641363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54ddcef4-11dd-4819-89e2-47889c43b06c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:06.877193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:44:06.878158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:44:06.879028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:44:06.880156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:44:06.880905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:44:06.907012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:06.909392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:06.911952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:06.913307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:06.964192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Getting quotas for project a019aea2aed240728e898c76739c8fd6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:06.986944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Getting quotas for user a84e343311cf4ca1a7ce698490e7578e and project a019aea2aed240728e898c76739c8fd6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:07.019356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:44:07.025626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:44:07.147480 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f6e477a-240c-4c0e-ba85-12cc55377e3a tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212687 Jul 26 19:44:07.149017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-54ddcef4-11dd-4819-89e2-47889c43b06c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:07.154285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 151/308] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:44:07.162371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-664e64cb-7b2e-4048-bfd4-7b28bf89331a req-17ae08f2-60e1-4ef5-a7da-973d562bada2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4a582-0699-43a9-89f9-19b22e0cda22", "tag": "f7718a1a-4b41-487e-ae8e-fd904b4c47e0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:07.163789 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54ddcef4-11dd-4819-89e2-47889c43b06c tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 200 len: 1590 microversion: 2.1 time: 0.555202 Jul 26 19:44:07.169441 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 158/309] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:06 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 1590 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:07.192156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-664e64cb-7b2e-4048-bfd4-7b28bf89331a req-17ae08f2-60e1-4ef5-a7da-973d562bada2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:07.194589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-664e64cb-7b2e-4048-bfd4-7b28bf89331a req-17ae08f2-60e1-4ef5-a7da-973d562bada2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:07.225887 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-664e64cb-7b2e-4048-bfd4-7b28bf89331a req-17ae08f2-60e1-4ef5-a7da-973d562bada2 service nova] Creating event network-changed:f7718a1a-4b41-487e-ae8e-fd904b4c47e0 for instance 50a4a582-0699-43a9-89f9-19b22e0cda22 on n-h2-708768-8 Jul 26 19:44:07.232775 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-664e64cb-7b2e-4048-bfd4-7b28bf89331a req-17ae08f2-60e1-4ef5-a7da-973d562bada2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076653 Jul 26 19:44:07.234583 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 152/310] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:07.257395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Action: 'update', calling method: .version_select at 0x7f8757b2dca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:07.486043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e88d5e0-9dbd-4872-9dd8-8ca45af935ae tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87643243a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2019782841", "description": "tempest-description-107201109"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:07.623160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:07.627448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:07.628518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:07.631023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:07.730212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:07.767298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:07.796767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:07.797815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:07.801595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:07.998613 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f0ae3e3c-bde8-4708-9813-baf16cd205f4 tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/e1cf4bfb491441dab2402848c2845820?user_id=1ed22d47ef2c49f480d53b56d563f2a5" status: 200 len: 240 microversion: 2.36 time: 0.762605 Jul 26 19:44:08.000920 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 153/311] 10.222.0.58 () {62 vars in 1384 bytes} [Tue Jul 26 19:44:07 2022] PUT /compute/v2.1/os-quota-sets/e1cf4bfb491441dab2402848c2845820?user_id=1ed22d47ef2c49f480d53b56d563f2a5 => generated 240 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:08.011783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-37eabb6b-66ef-4b83-a606-7507fb81d779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:08.044681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-37eabb6b-66ef-4b83-a606-7507fb81d779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:08.257619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-37eabb6b-66ef-4b83-a606-7507fb81d779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:08.268721 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-37eabb6b-66ef-4b83-a606-7507fb81d779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1218 microversion: 2.1 time: 0.261987 Jul 26 19:44:08.269301 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 154/312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:08 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:08.303146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c870fa4-e193-42cf-9674-1506800c9deb tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] Calling method '.version_select at 0x7f875780f310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:08.746647 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e88d5e0-9dbd-4872-9dd8-8ca45af935ae tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.562095 Jul 26 19:44:08.747276 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 159/313] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:44:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:08.769680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82e9abfe-52a6-4fa3-8649-0b72a74cbcfd tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87642a4af0>, body: {"security_group_rule": {"parent_group_id": "583f3d19-41d0-481c-91ad-98969b32259b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:09.330345 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-82e9abfe-52a6-4fa3-8649-0b72a74cbcfd tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.573207 Jul 26 19:44:09.331674 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 160/314] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:44:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:09.344955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af7f67c2-1297-4f27-ba53-e869427d25c4 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:09.347640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af7f67c2-1297-4f27-ba53-e869427d25c4 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:09.353705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c870fa4-e193-42cf-9674-1506800c9deb tempest-QuotasAdminTestV236-29741659 tempest-QuotasAdminTestV236-29741659-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/e1cf4bfb491441dab2402848c2845820?user_id=1ed22d47ef2c49f480d53b56d563f2a5" status: 200 len: 282 microversion: 2.36 time: 1.062895 Jul 26 19:44:09.360287 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 155/315] 10.222.0.58 () {60 vars in 1364 bytes} [Tue Jul 26 19:44:08 2022] GET /compute/v2.1/os-quota-sets/e1cf4bfb491441dab2402848c2845820?user_id=1ed22d47ef2c49f480d53b56d563f2a5 => generated 282 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:09.362323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1bb3bad6-4b5c-4bae-8080-49617c4be54f tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f8757a149d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1290530937", "description": "tempest-description-1309734905"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:09.369117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af7f67c2-1297-4f27-ba53-e869427d25c4 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:09.371438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af7f67c2-1297-4f27-ba53-e869427d25c4 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:09.372291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af7f67c2-1297-4f27-ba53-e869427d25c4 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:09.372732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af7f67c2-1297-4f27-ba53-e869427d25c4 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:09.594218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-af7f67c2-1297-4f27-ba53-e869427d25c4 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:09.604131 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af7f67c2-1297-4f27-ba53-e869427d25c4 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1276 microversion: 2.1 time: 0.271388 Jul 26 19:44:09.611145 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 161/316] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:09 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:09.974294 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1bb3bad6-4b5c-4bae-8080-49617c4be54f tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.617088 Jul 26 19:44:09.974906 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 156/317] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:44:09 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:09.989149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97f1ec85-9a54-4e43-817b-07eb3dd5f581 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87641e43a0>, body: {"security_group_rule": {"parent_group_id": "673d095d-735b-4775-9079-8085243fa7e0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:10.415224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97f1ec85-9a54-4e43-817b-07eb3dd5f581 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.430941 Jul 26 19:44:10.415916 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 162/318] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:44:09 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:10.432203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8613509-7b8c-4ef7-9180-396518a7d274 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87578768b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1093898974", "description": "tempest-description-1111062"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:10.625056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc0b6c4c-fd8c-4684-bb37-e086b0350779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:10.625729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc0b6c4c-fd8c-4684-bb37-e086b0350779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:10.643561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc0b6c4c-fd8c-4684-bb37-e086b0350779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:10.646857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc0b6c4c-fd8c-4684-bb37-e086b0350779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:10.648720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc0b6c4c-fd8c-4684-bb37-e086b0350779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:10.649405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc0b6c4c-fd8c-4684-bb37-e086b0350779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:10.662941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:11.663502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fc0b6c4c-fd8c-4684-bb37-e086b0350779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:11.687432 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc0b6c4c-fd8c-4684-bb37-e086b0350779 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1318 microversion: 2.1 time: 1.066275 Jul 26 19:44:11.695328 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 163/319] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:10 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1318 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:11.836311 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e8613509-7b8c-4ef7-9180-396518a7d274 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.409753 Jul 26 19:44:11.837372 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 157/320] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:44:10 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:11.852887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45caf510-4ce5-417a-aa58-068856b1a1a6 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87641e4f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1302800311", "description": "tempest-description-196649410"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:12.647969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45caf510-4ce5-417a-aa58-068856b1a1a6 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.798918 Jul 26 19:44:12.648554 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 164/321] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:44:11 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:12.661960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9887cb11-f167-4515-a91f-a3abfb0ca1ce tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87578391f0>, body: {"security_group_rule": {"parent_group_id": "b9986533-55ec-4883-9aa1-2849461c242f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ef9e67c0-7352-4604-a957-b7f3a5606d8c"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:12.714435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f9c8f895-7753-431c-92ee-bca4647f2c01 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:12.715916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f9c8f895-7753-431c-92ee-bca4647f2c01 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:12.726697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c8f895-7753-431c-92ee-bca4647f2c01 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:12.732538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c8f895-7753-431c-92ee-bca4647f2c01 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:12.737784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c8f895-7753-431c-92ee-bca4647f2c01 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:12.739106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c8f895-7753-431c-92ee-bca4647f2c01 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:13.658908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f9c8f895-7753-431c-92ee-bca4647f2c01 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:13.671493 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f9c8f895-7753-431c-92ee-bca4647f2c01 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1318 microversion: 2.1 time: 0.958866 Jul 26 19:44:13.672227 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 165/322] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:12 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:13.689687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-8679556b-e76b-4d30-bbc9-0d30efebbc26 req-e1c4739b-f0b1-450f-ba46-609020106b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4196c1-6cde-4426-aa86-5c090f8c8c7f", "tag": "ff56f7f2-fd7e-4525-9bed-51ca8a7fd2e2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:13.710486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8679556b-e76b-4d30-bbc9-0d30efebbc26 req-e1c4739b-f0b1-450f-ba46-609020106b6b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:13.716884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8679556b-e76b-4d30-bbc9-0d30efebbc26 req-e1c4739b-f0b1-450f-ba46-609020106b6b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:13.747941 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-8679556b-e76b-4d30-bbc9-0d30efebbc26 req-e1c4739b-f0b1-450f-ba46-609020106b6b service nova] Creating event network-changed:ff56f7f2-fd7e-4525-9bed-51ca8a7fd2e2 for instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f on n-h2-708768-8 Jul 26 19:44:13.773152 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-8679556b-e76b-4d30-bbc9-0d30efebbc26 req-e1c4739b-f0b1-450f-ba46-609020106b6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097524 Jul 26 19:44:13.775539 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 166/323] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:14.366391 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9887cb11-f167-4515-a91f-a3abfb0ca1ce tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.709484 Jul 26 19:44:14.367700 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 158/324] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:44:12 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:14.381370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e9f248f0-56b0-49ad-80d5-02cd029e4b07 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87641e49d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1006906713", "description": "tempest-description-937651777"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:14.694748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b630772-ee63-4286-9f7f-32426251aa39 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:14.695366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b630772-ee63-4286-9f7f-32426251aa39 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:14.716655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b630772-ee63-4286-9f7f-32426251aa39 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:14.717123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b630772-ee63-4286-9f7f-32426251aa39 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:14.717893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b630772-ee63-4286-9f7f-32426251aa39 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:14.720952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b630772-ee63-4286-9f7f-32426251aa39 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:14.992305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b630772-ee63-4286-9f7f-32426251aa39 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:15.009028 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b630772-ee63-4286-9f7f-32426251aa39 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1318 microversion: 2.1 time: 0.319215 Jul 26 19:44:15.010223 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 159/325] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:14 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:15.138476 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e9f248f0-56b0-49ad-80d5-02cd029e4b07 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.762403 Jul 26 19:44:15.147848 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 167/326] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:44:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:15.168067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c464368-4b54-4d8c-83f3-1248a86cfd1c tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87641e4550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-835208453", "description": "tempest-description-1043541613"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:15.638813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46d52139-ea3c-450b-b4b1-b3dbd615d06c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Calling method '.version_select at 0x7f8757876ca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:15.640613 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:15.640613 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:15.642282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d52139-ea3c-450b-b4b1-b3dbd615d06c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:15.642855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d52139-ea3c-450b-b4b1-b3dbd615d06c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:15.666719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d52139-ea3c-450b-b4b1-b3dbd615d06c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:15.667253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d52139-ea3c-450b-b4b1-b3dbd615d06c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:15.683739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d52139-ea3c-450b-b4b1-b3dbd615d06c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:15.684463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d52139-ea3c-450b-b4b1-b3dbd615d06c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:15.693155 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-46d52139-ea3c-450b-b4b1-b3dbd615d06c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.591224 Jul 26 19:44:15.694462 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 160/327] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:44:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:15.905507 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c464368-4b54-4d8c-83f3-1248a86cfd1c tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.756011 Jul 26 19:44:15.907121 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 168/328] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:44:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:16.148322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce96786e-97fe-4793-8610-ead8f3266634 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-520782879", "id": 1238606708, "os-flavor-access:is_public": "False"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:16.151815 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:16.151815 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:16.181282 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce96786e-97fe-4793-8610-ead8f3266634 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.485536 Jul 26 19:44:16.185409 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 161/329] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:15 2022] POST /compute/v2.1/flavors => generated 430 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:16.201384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed421091-f399-48e6-8927-3779ff0cb5c3 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f8757b2db80>, body: {"security_group_rule": {"parent_group_id": "dfd5cbf3-b5eb-4c54-b454-8386f88f52aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1891ed65-232e-49e4-b995-de41ddee4502"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:16.250962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14e32fa6-066d-4a35-abd7-32c8b6b8a98d tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] Calling method '.version_select at 0x7f8764324820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:16.251891 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:16.251891 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:16.252976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14e32fa6-066d-4a35-abd7-32c8b6b8a98d tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'cccfb8be1f404729b3aa8b8887841171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0e1b73b3a843379a9ede20655e5ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14e32fa6-066d-4a35-abd7-32c8b6b8a98d tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] Request method failure captured: Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-hypervisors/n-h1-708768-8/search HTTP/1.1 Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQMvhGaK4L8xU8dYSWVimMpKjQN2-mrSM7et18PoFnjPi0stezyEbfINi80D0Vr_lZ1s6tdY6xBL5DpHXpz7nWdTRCTgwDxxD3REeh6G7RmEZJ_cyc5kik7rTUJ3u0tPNi8DXxg77C21L1NyZWNPpD-4L5gZOpQ3Z7Mpm00kawmkP4 Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 4f0e1b73b3a843379a9ede20655e5ff7 Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163685688 Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:16.255320 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f0e1b73b3a843379a9ede20655e5ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f0e1b73b3a843379a9ede20655e5ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f0e1b73b3a843379a9ede20655e5ff7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f0e1b73b3a843379a9ede20655e5ff7"}]}] Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1163685688 Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 4f0e1b73b3a843379a9ede20655e5ff7 Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163685688 Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cccfb8be1f404729b3aa8b8887841171 Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 19:44:16.256696 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'n-h1-708768-8'} Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:44:16.257396 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 19:44:16.258454 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:16.271960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14e32fa6-066d-4a35-abd7-32c8b6b8a98d tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:16.273049 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14e32fa6-066d-4a35-abd7-32c8b6b8a98d tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-708768-8/search" status: 403 len: 117 microversion: 2.1 time: 0.363947 Jul 26 19:44:16.274102 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 169/330] 10.222.0.58 () {58 vars in 1209 bytes} [Tue Jul 26 19:44:15 2022] GET /compute/v2.1/os-hypervisors/n-h1-708768-8/search => generated 117 bytes in 366 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:16.276050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:16.281400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f15f24b8-5861-44c9-8131-8db7781cc695 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:16.282722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f15f24b8-5861-44c9-8131-8db7781cc695 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:16.291165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:16.316923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f15f24b8-5861-44c9-8131-8db7781cc695 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:16.318110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f15f24b8-5861-44c9-8131-8db7781cc695 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:16.322612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f15f24b8-5861-44c9-8131-8db7781cc695 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:16.323367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f15f24b8-5861-44c9-8131-8db7781cc695 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:16.736047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f15f24b8-5861-44c9-8131-8db7781cc695 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:16.743716 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f15f24b8-5861-44c9-8131-8db7781cc695 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1318 microversion: 2.1 time: 0.468289 Jul 26 19:44:16.746220 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 170/331] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:16 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:16.764620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9be76d15-7cdc-40f0-9a57-8f9a6fb9bd62 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "444c83e5d2c7405c9459c36437468918"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:16.767243 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:16.767243 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:16.771326 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed421091-f399-48e6-8927-3779ff0cb5c3 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.583112 Jul 26 19:44:16.772742 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 162/332] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:44:16 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:16.779647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6231a224-ad4a-4480-a5b0-11f56b05b45d tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Calling method '.version_select at 0x7f87578bf9d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:16.793027 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:16.793027 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:16.797011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6231a224-ad4a-4480-a5b0-11f56b05b45d tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:16.803294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6231a224-ad4a-4480-a5b0-11f56b05b45d tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:16.831843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-6231a224-ad4a-4480-a5b0-11f56b05b45d tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6231a224-ad4a-4480-a5b0-11f56b05b45d tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Request method failure captured: Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQOuNttIXnTWXwwCr_Kuurh9-xZL9rc9-SI7BjZBuxqz0oLoBNNCHspEjG0VEvv3NvHsewvotL_YmIpqA-zDY1fUSgABlJER_8T9RjYOgX1queGIR2Sa9Nb5ehPQiTZEQsms7XNNg34K1Y24_SktNea8APbEoGhmFlWh2vvny3xklA Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: bad452585c43435e874910d95f2f0123 Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1605418782 Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:44:16.834185 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bad452585c43435e874910d95f2f0123"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bad452585c43435e874910d95f2f0123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bad452585c43435e874910d95f2f0123", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bad452585c43435e874910d95f2f0123"}]}] Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1605418782 Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: bad452585c43435e874910d95f2f0123 Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1605418782 Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 1830f89ec01f49f190a31b04205fd9f1 Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 19:44:16.835450 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:16.836318 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:16.837401 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:16.837401 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:16.837401 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:16.837401 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 19:44:16.837401 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:16.844393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6231a224-ad4a-4480-a5b0-11f56b05b45d tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:16.845477 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6231a224-ad4a-4480-a5b0-11f56b05b45d tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.071087 Jul 26 19:44:16.847141 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 163/333] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 19:44:16 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:16.855243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96fd980e-5940-4c79-9064-711eacbc6081 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f87578bf3a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:17.277790 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96fd980e-5940-4c79-9064-711eacbc6081 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/1891ed65-232e-49e4-b995-de41ddee4502" status: 202 len: 0 microversion: 2.1 time: 0.428512 Jul 26 19:44:17.278919 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 164/334] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:16 2022] DELETE /compute/v2.1/os-security-groups/1891ed65-232e-49e4-b995-de41ddee4502 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:17.286582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22c79781-ce4f-43d3-a7cf-c019fc69a43c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Calling method '.version_select at 0x7f8757823820>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:17.287956 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:17.287956 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:17.293490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22c79781-ce4f-43d3-a7cf-c019fc69a43c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:17.295170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22c79781-ce4f-43d3-a7cf-c019fc69a43c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:17.338811 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9be76d15-7cdc-40f0-9a57-8f9a6fb9bd62 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1238606708/action" status: 200 len: 97 microversion: 2.1 time: 0.573360 Jul 26 19:44:17.340023 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 171/335] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:44:16 2022] POST /compute/v2.1/flavors/1238606708/action => generated 97 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:44:17.346530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22c79781-ce4f-43d3-a7cf-c019fc69a43c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:17.347684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22c79781-ce4f-43d3-a7cf-c019fc69a43c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:17.350694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d75aa60c-f55d-4545-a41c-c125046cfdbc tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f8764324160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:17.375572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22c79781-ce4f-43d3-a7cf-c019fc69a43c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:17.377023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22c79781-ce4f-43d3-a7cf-c019fc69a43c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:17.398457 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22c79781-ce4f-43d3-a7cf-c019fc69a43c tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.117802 Jul 26 19:44:17.402964 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 165/336] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:44:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:17.450873 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d75aa60c-f55d-4545-a41c-c125046cfdbc tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/dfd5cbf3-b5eb-4c54-b454-8386f88f52aa" status: 200 len: 247 microversion: 2.1 time: 0.109440 Jul 26 19:44:17.452164 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 172/337] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:44:17 2022] GET /compute/v2.1/os-security-groups/dfd5cbf3-b5eb-4c54-b454-8386f88f52aa => generated 247 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:17.460332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a812dc33-6b29-41cf-8825-7826aaf257ec tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] Calling method '.version_select at 0x7f87641e45e0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:17.461606 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:17.461606 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:17.465113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a812dc33-6b29-41cf-8825-7826aaf257ec tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'cccfb8be1f404729b3aa8b8887841171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0e1b73b3a843379a9ede20655e5ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a812dc33-6b29-41cf-8825-7826aaf257ec tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] Request method failure captured: Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQMvhGaK4L8xU8dYSWVimMpKjQN2-mrSM7et18PoFnjPi0stezyEbfINi80D0Vr_lZ1s6tdY6xBL5DpHXpz7nWdTRCTgwDxxD3REeh6G7RmEZJ_cyc5kik7rTUJ3u0tPNi8DXxg77C21L1NyZWNPpD-4L5gZOpQ3Z7Mpm00kawmkP4 Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 4f0e1b73b3a843379a9ede20655e5ff7 Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163685688 Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:17.472220 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4f0e1b73b3a843379a9ede20655e5ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f0e1b73b3a843379a9ede20655e5ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4f0e1b73b3a843379a9ede20655e5ff7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4f0e1b73b3a843379a9ede20655e5ff7"}]}] Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1163685688 Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 4f0e1b73b3a843379a9ede20655e5ff7 Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163685688 Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cccfb8be1f404729b3aa8b8887841171 Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 19:44:17.473764 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '1'} Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:44:17.474612 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 19:44:17.475919 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:17.480142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a812dc33-6b29-41cf-8825-7826aaf257ec tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:17.482868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a812dc33-6b29-41cf-8825-7826aaf257ec tempest-HypervisorAdminNegativeUnderV252Test-1163685688 tempest-HypervisorAdminNegativeUnderV252Test-1163685688-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.029038 Jul 26 19:44:17.486111 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 173/338] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 19:44:17 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:17.509306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-71a7dc5f-f504-4821-bd8b-7a9b50d6f153 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87641e4dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-161857636", "description": "tempest-description-948199048"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:17.820763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc68aa2c-eb3c-481d-bf8f-33ffffc4578e tempest-FlavorsAccessTestJSON-729802231 tempest-FlavorsAccessTestJSON-729802231-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:17.859485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=13 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:17.873652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc68aa2c-eb3c-481d-bf8f-33ffffc4578e tempest-FlavorsAccessTestJSON-729802231 tempest-FlavorsAccessTestJSON-729802231-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.1 time: 0.468411 Jul 26 19:44:17.875438 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 166/339] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:44:17 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:17.881320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54c639d4-c5a6-4214-b626-687f7c54c4cf tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Calling method '.version_select at 0x7f87578769d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:17.882698 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:17.882698 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:17.885410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54c639d4-c5a6-4214-b626-687f7c54c4cf tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:17.886819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54c639d4-c5a6-4214-b626-687f7c54c4cf tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:17.905739 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-54c639d4-c5a6-4214-b626-687f7c54c4cf tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] HTTP exception thrown: No hypervisor matching 'e0a0b45b-844d-432e-9eff-3d3e597a17a7' could be found. Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54c639d4-c5a6-4214-b626-687f7c54c4cf tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Request method failure captured: Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-hypervisors/e0a0b45b-844d-432e-9eff-3d3e597a17a7/servers HTTP/1.1 Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQOuNttIXnTWXwwCr_Kuurh9-xZL9rc9-SI7BjZBuxqz0oLoBNNCHspEjG0VEvv3NvHsewvotL_YmIpqA-zDY1fUSgABlJER_8T9RjYOgX1queGIR2Sa9Nb5ehPQiTZEQsms7XNNg34K1Y24_SktNea8APbEoGhmFlWh2vvny3xklA Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: bad452585c43435e874910d95f2f0123 Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1605418782 Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:44:17.913088 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bad452585c43435e874910d95f2f0123"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bad452585c43435e874910d95f2f0123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bad452585c43435e874910d95f2f0123", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bad452585c43435e874910d95f2f0123"}]}] Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1605418782 Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: bad452585c43435e874910d95f2f0123 Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1605418782 Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 1830f89ec01f49f190a31b04205fd9f1 Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: exception: No hypervisor matching 'e0a0b45b-844d-432e-9eff-3d3e597a17a7' could be found. Jul 26 19:44:17.914696 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'e0a0b45b-844d-432e-9eff-3d3e597a17a7'} Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'e0a0b45b-844d-432e-9eff-3d3e597a17a7' could be found. Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:17.915497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:17.917599 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:17.917599 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:17.917599 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:17.917599 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:17.917599 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'e0a0b45b-844d-432e-9eff-3d3e597a17a7' could be found. Jul 26 19:44:17.917599 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:17.923703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54c639d4-c5a6-4214-b626-687f7c54c4cf tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] Returning 404 to user: No hypervisor matching 'e0a0b45b-844d-432e-9eff-3d3e597a17a7' could be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:17.926873 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-54c639d4-c5a6-4214-b626-687f7c54c4cf tempest-HypervisorAdminNegativeUnderV252Test-1605418782 tempest-HypervisorAdminNegativeUnderV252Test-1605418782-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/e0a0b45b-844d-432e-9eff-3d3e597a17a7/servers" status: 404 len: 123 microversion: 2.1 time: 0.048425 Jul 26 19:44:17.928939 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 167/340] 10.222.0.58 () {58 vars in 1281 bytes} [Tue Jul 26 19:44:17 2022] GET /compute/v2.1/os-hypervisors/e0a0b45b-844d-432e-9eff-3d3e597a17a7/servers => generated 123 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:17.937561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bb24e054-cd3c-4692-826c-eba6e24589d1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:17.939678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bb24e054-cd3c-4692-826c-eba6e24589d1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:17.959458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb24e054-cd3c-4692-826c-eba6e24589d1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:17.960173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb24e054-cd3c-4692-826c-eba6e24589d1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:17.961001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb24e054-cd3c-4692-826c-eba6e24589d1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:17.961502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb24e054-cd3c-4692-826c-eba6e24589d1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:18.178092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bb24e054-cd3c-4692-826c-eba6e24589d1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:18.180225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:18.187878 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bb24e054-cd3c-4692-826c-eba6e24589d1 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1318 microversion: 2.1 time: 0.257646 Jul 26 19:44:18.189438 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 168/341] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:17 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:18.204321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b2e826ec-bd29-4f97-b0b7-2e3f033adf2b tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "444c83e5d2c7405c9459c36437468918"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:18.208766 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:18.208766 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:18.540364 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-71a7dc5f-f504-4821-bd8b-7a9b50d6f153 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.051791 Jul 26 19:44:18.541876 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 174/342] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:44:17 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:18.672248 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b2e826ec-bd29-4f97-b0b7-2e3f033adf2b tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1238606708/action" status: 200 len: 21 microversion: 2.1 time: 0.481491 Jul 26 19:44:18.675171 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 169/343] 10.222.0.58 () {60 vars in 1200 bytes} [Tue Jul 26 19:44:18 2022] POST /compute/v2.1/flavors/1238606708/action => generated 21 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:44:18.685997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0e9abc65-4c38-4cdf-956c-975ef18670da tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87578bff70>, body: {"security_group_rule": {"parent_group_id": "9e990083-3a8d-4bd9-ad5c-fb5cabd69a14", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:18.922511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-258020b2-361b-4827-8b90-f78ae84fa265 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Action: 'update', calling method: .version_select at 0x7f87641e4310>, body: {"quota_set": {"ram": "5120"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:19.007840 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0e9abc65-4c38-4cdf-956c-975ef18670da tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.330288 Jul 26 19:44:19.008490 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 170/344] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:44:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:19.018755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15bf37fa-fdb5-4b8d-81b4-3fd4f1a1d927 tempest-FlavorsAccessTestJSON-729802231 tempest-FlavorsAccessTestJSON-729802231-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:19.069994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15bf37fa-fdb5-4b8d-81b4-3fd4f1a1d927 tempest-FlavorsAccessTestJSON-729802231 tempest-FlavorsAccessTestJSON-729802231-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.059653 Jul 26 19:44:19.072830 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 171/345] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:44:19 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:19.092847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1932eef9-c3ad-4a6d-b81d-74f58cc73300 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Action: 'create', calling method: .version_select at 0x7f87578bfd30>, body: {"security_group_rule": {"parent_group_id": "9e990083-3a8d-4bd9-ad5c-fb5cabd69a14", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:19.201130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-258020b2-361b-4827-8b90-f78ae84fa265 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:19.201583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-258020b2-361b-4827-8b90-f78ae84fa265 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:19.204680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-258020b2-361b-4827-8b90-f78ae84fa265 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:19.206726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-258020b2-361b-4827-8b90-f78ae84fa265 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:19.326711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=32 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:19.390142 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-258020b2-361b-4827-8b90-f78ae84fa265 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/bfdc5f9e4a0b4974af1f564624453abb" status: 200 len: 148 microversion: 2.57 time: 0.846877 Jul 26 19:44:19.392237 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 175/346] 10.222.0.58 () {62 vars in 1303 bytes} [Tue Jul 26 19:44:18 2022] PUT /compute/v2.1/os-quota-sets/bfdc5f9e4a0b4974af1f564624453abb => generated 148 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:19.412646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-83891b8c-8617-424b-99d2-ee5182a63935 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:19.414282 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:19.414282 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:19.464889 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-83891b8c-8617-424b-99d2-ee5182a63935 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1238606708" status: 202 len: 0 microversion: 2.1 time: 0.049314 Jul 26 19:44:19.467213 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 176/347] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:44:19 2022] DELETE /compute/v2.1/flavors/1238606708 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:19.474932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c67814e7-d843-46b7-9d4c-8a09eeaebcb7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:19.478444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c67814e7-d843-46b7-9d4c-8a09eeaebcb7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:19.510312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c67814e7-d843-46b7-9d4c-8a09eeaebcb7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:19.510998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c67814e7-d843-46b7-9d4c-8a09eeaebcb7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:19.512240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c67814e7-d843-46b7-9d4c-8a09eeaebcb7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:19.512889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c67814e7-d843-46b7-9d4c-8a09eeaebcb7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:19.712890 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1932eef9-c3ad-4a6d-b81d-74f58cc73300 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.635365 Jul 26 19:44:19.713490 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 172/348] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:44:19 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:19.718170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-403a5acf-cf05-4d05-ba40-e6881e04c56a tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Calling method '.version_select at 0x7f87578bf820>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:20.000911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c67814e7-d843-46b7-9d4c-8a09eeaebcb7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:20.015882 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c67814e7-d843-46b7-9d4c-8a09eeaebcb7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1318 microversion: 2.1 time: 0.547318 Jul 26 19:44:20.031964 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 177/349] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:19 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:20.043654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-05c185c7-a3f2-482f-ab3e-8bc3da4bf350 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:20.078127 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-05c185c7-a3f2-482f-ab3e-8bc3da4bf350 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.042014 Jul 26 19:44:20.093252 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 178/350] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:44:20 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:20.102323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-20913b00-8552-4a9c-955d-790bab94f560 req-c744f90d-680a-484f-8a5c-379f94a17dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4196c1-6cde-4426-aa86-5c090f8c8c7f", "name": "network-vif-plugged", "status": "completed", "tag": "ff56f7f2-fd7e-4525-9bed-51ca8a7fd2e2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:20.112951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-20913b00-8552-4a9c-955d-790bab94f560 req-c744f90d-680a-484f-8a5c-379f94a17dff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:20.114575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-20913b00-8552-4a9c-955d-790bab94f560 req-c744f90d-680a-484f-8a5c-379f94a17dff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:20.129927 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-20913b00-8552-4a9c-955d-790bab94f560 req-c744f90d-680a-484f-8a5c-379f94a17dff service nova] Creating event network-vif-plugged:ff56f7f2-fd7e-4525-9bed-51ca8a7fd2e2 for instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f on n-h2-708768-8 Jul 26 19:44:20.138760 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-20913b00-8552-4a9c-955d-790bab94f560 req-c744f90d-680a-484f-8a5c-379f94a17dff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043333 Jul 26 19:44:20.139852 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 179/351] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:20.160696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dfcb59ec-98c1-4eb2-b3c7-89a83678296a tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f876417f9d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:20.296106 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dfcb59ec-98c1-4eb2-b3c7-89a83678296a tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/9e990083-3a8d-4bd9-ad5c-fb5cabd69a14" status: 200 len: 663 microversion: 2.1 time: 0.154648 Jul 26 19:44:20.297046 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 180/352] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:44:20 2022] GET /compute/v2.1/os-security-groups/9e990083-3a8d-4bd9-ad5c-fb5cabd69a14 => generated 663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:20.309432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5b6b6fc-dee7-440d-a259-f964975d751e tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-140167834", "id": 499768560, "os-flavor-access:is_public": "False"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:20.343206 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:20.343206 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:20.373678 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5b6b6fc-dee7-440d-a259-f964975d751e tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.075501 Jul 26 19:44:20.380738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-403a5acf-cf05-4d05-ba40-e6881e04c56a tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:20.381247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-403a5acf-cf05-4d05-ba40-e6881e04c56a tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:20.381930 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 181/353] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:20 2022] POST /compute/v2.1/flavors => generated 427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:20.386725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a693040-5b00-4458-870c-c81b48312d32 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f876417fb80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:20.387600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-403a5acf-cf05-4d05-ba40-e6881e04c56a tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:20.388141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-403a5acf-cf05-4d05-ba40-e6881e04c56a tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:20.423095 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-403a5acf-cf05-4d05-ba40-e6881e04c56a tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/bfdc5f9e4a0b4974af1f564624453abb/detail" status: 200 len: 463 microversion: 2.57 time: 0.708309 Jul 26 19:44:20.424024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 173/354] 10.222.0.58 () {60 vars in 1304 bytes} [Tue Jul 26 19:44:19 2022] GET /compute/v2.1/os-quota-sets/bfdc5f9e4a0b4974af1f564624453abb/detail => generated 463 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:20.429629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98becc8f-b35a-4b4d-8d2e-cc68f1e6673c tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:20.430579 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:20.430579 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:20.447092 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98becc8f-b35a-4b4d-8d2e-cc68f1e6673c tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/499768560/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021000 Jul 26 19:44:20.447979 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 174/355] 10.222.0.58 () {58 vars in 1206 bytes} [Tue Jul 26 19:44:20 2022] GET /compute/v2.1/flavors/499768560/os-flavor-access => generated 21 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:44:20.458011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8891e9ba-6e26-4933-aa6e-754cde3a0f6d tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:20.458767 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:20.458767 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:20.494229 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8891e9ba-6e26-4933-aa6e-754cde3a0f6d tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/499768560" status: 202 len: 0 microversion: 2.1 time: 0.039406 Jul 26 19:44:20.499748 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 175/356] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:44:20 2022] DELETE /compute/v2.1/flavors/499768560 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:44:20.507180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34553411-13ef-4a18-9369-b508ee377fc2 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:20.536238 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34553411-13ef-4a18-9369-b508ee377fc2 tempest-FlavorsAccessTestJSON-1693509881 tempest-FlavorsAccessTestJSON-1693509881-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035078 Jul 26 19:44:20.550362 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 176/357] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:44:20 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:20.819887 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a693040-5b00-4458-870c-c81b48312d32 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/746f741c-f07e-4667-8f40-9b698852bf39" status: 202 len: 0 microversion: 2.1 time: 0.436700 Jul 26 19:44:20.821070 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 182/358] 10.222.0.58 () {58 vars in 1287 bytes} [Tue Jul 26 19:44:20 2022] DELETE /compute/v2.1/os-security-group-rules/746f741c-f07e-4667-8f40-9b698852bf39 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:20.831467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d8d87ff8-3ffd-44e3-a91a-5ad012b057ba tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f87578bfd30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:21.040510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-20f52a8d-9e97-4f9e-983d-151a2f417c55 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:21.042185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-20f52a8d-9e97-4f9e-983d-151a2f417c55 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:21.056288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20f52a8d-9e97-4f9e-983d-151a2f417c55 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:21.059107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20f52a8d-9e97-4f9e-983d-151a2f417c55 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:21.061724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20f52a8d-9e97-4f9e-983d-151a2f417c55 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:21.063648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20f52a8d-9e97-4f9e-983d-151a2f417c55 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:21.204291 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d8d87ff8-3ffd-44e3-a91a-5ad012b057ba tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/9e990083-3a8d-4bd9-ad5c-fb5cabd69a14" status: 202 len: 0 microversion: 2.1 time: 0.377400 Jul 26 19:44:21.205247 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 177/359] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:20 2022] DELETE /compute/v2.1/os-security-groups/9e990083-3a8d-4bd9-ad5c-fb5cabd69a14 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:21.218150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a95d260-5d73-4009-a5f8-032248261ff9 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f87578d1ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:21.317754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-9a95d260-5d73-4009-a5f8-032248261ff9 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1891ed65-232e-49e4-b995-de41ddee4502 does not exist", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:44:21.318361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.security_group_api [None req-9a95d260-5d73-4009-a5f8-032248261ff9 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Neutron security group 1891ed65-232e-49e4-b995-de41ddee4502 not found {{(pid=125964) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:44:21.319147 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-9a95d260-5d73-4009-a5f8-032248261ff9 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] HTTP exception thrown: Security group 1891ed65-232e-49e4-b995-de41ddee4502 does not exist Jul 26 19:44:21.319147 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-0636aec7-fe36-4a38-9001-01cea343d8a0'] Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a95d260-5d73-4009-a5f8-032248261ff9 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Request method failure captured: Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-security-groups/1891ed65-232e-49e4-b995-de41ddee4502 HTTP/1.1 Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQGPW-j6L40SsC2TX8zPHXpioLJBVdaWn8trQSwYFByHGbECHHDYYFIdIQV_sTz6G68XZ6We0i3tHyFHmIZzbn0yjATUTYUWb9cZqZvr254Vz8VnCyxvbnckvy_BzgknjXziB4ZbPOvPOcJ86a4jKQUzeDYJ_bvLBOWC9TGg_qSbXg Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: bcfb030b448a41798293c196daa28a93 Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-990792581 Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:44:21.334218 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bcfb030b448a41798293c196daa28a93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcfb030b448a41798293c196daa28a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bcfb030b448a41798293c196daa28a93", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bcfb030b448a41798293c196daa28a93"}]}] Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupRulesTestJSON-990792581 Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: bcfb030b448a41798293c196daa28a93 Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-990792581 Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupRulesTestJSON-990792581-project Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ddfd741595244844b29a686da6fa3a43 Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupRulesTestJSON-990792581-project Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: exception: Security group 1891ed65-232e-49e4-b995-de41ddee4502 does not exist Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-0636aec7-fe36-4a38-9001-01cea343d8a0'] Jul 26 19:44:21.335532 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '1891ed65-232e-49e4-b995-de41ddee4502'} Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:44:21.336371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1891ed65-232e-49e4-b995-de41ddee4502 does not exist Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0636aec7-fe36-4a38-9001-01cea343d8a0'] Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:44:21.337699 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1891ed65-232e-49e4-b995-de41ddee4502 does not exist Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0636aec7-fe36-4a38-9001-01cea343d8a0'] Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1891ed65-232e-49e4-b995-de41ddee4502 does not exist Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0636aec7-fe36-4a38-9001-01cea343d8a0'] Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:21.340061 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:21.341864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:21.341864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:21.341864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:21.341864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:21.341864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1891ed65-232e-49e4-b995-de41ddee4502 does not exist Jul 26 19:44:21.341864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0636aec7-fe36-4a38-9001-01cea343d8a0'] Jul 26 19:44:21.341864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:21.344416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a95d260-5d73-4009-a5f8-032248261ff9 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Returning 404 to user: Security group 1891ed65-232e-49e4-b995-de41ddee4502 does not exist Jul 26 19:44:21.344416 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-0636aec7-fe36-4a38-9001-01cea343d8a0'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:21.346612 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a95d260-5d73-4009-a5f8-032248261ff9 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/1891ed65-232e-49e4-b995-de41ddee4502" status: 404 len: 194 microversion: 2.1 time: 0.135803 Jul 26 19:44:21.352508 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 178/360] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:21 2022] DELETE /compute/v2.1/os-security-groups/1891ed65-232e-49e4-b995-de41ddee4502 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:44:21.360635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-501534f7-628b-43ce-9994-71155e4008bd tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f875772b5e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:21.493544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-20f52a8d-9e97-4f9e-983d-151a2f417c55 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:21.505669 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-20f52a8d-9e97-4f9e-983d-151a2f417c55 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1318 microversion: 2.1 time: 0.471604 Jul 26 19:44:21.506414 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 183/361] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:21 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:21.625509 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-501534f7-628b-43ce-9994-71155e4008bd tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/dfd5cbf3-b5eb-4c54-b454-8386f88f52aa" status: 202 len: 0 microversion: 2.1 time: 0.268993 Jul 26 19:44:21.629085 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 179/362] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:21 2022] DELETE /compute/v2.1/os-security-groups/dfd5cbf3-b5eb-4c54-b454-8386f88f52aa => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:21.632190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Action: 'update', calling method: .version_select at 0x7f87578d1670>, body: {"quota_set": {"ram": "2048"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:21.760182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1978987", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:21.835002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:21.947657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:21.947657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:21.950103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:21.950591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:22.024980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:22.025732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:22.026727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:22.027386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:22.128863 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d44c80a-6dea-41fa-88ad-9fddf1471dd7 tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/bfdc5f9e4a0b4974af1f564624453abb?user_id=1c71f5ed22f246c1898f641db182f462" status: 200 len: 148 microversion: 2.57 time: 0.501229 Jul 26 19:44:22.130480 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 180/363] 10.222.0.58 () {62 vars in 1384 bytes} [Tue Jul 26 19:44:21 2022] PUT /compute/v2.1/os-quota-sets/bfdc5f9e4a0b4974af1f564624453abb?user_id=1c71f5ed22f246c1898f641db182f462 => generated 148 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:22.139240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5de4da27-c4a8-4efd-ac0a-462e1a14b399 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f875772b700>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:22.168212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:44:22.168771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:44:22.169198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:44:22.169604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:44:22.170006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:44:22.180425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:22.180861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:22.181758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:22.182190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:22.201612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Getting quotas for project 3e06cee988534593a9af9e773ecc9cc2. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:22.208602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Getting quotas for user c6fe5899d4764216a70b102339a74853 and project 3e06cee988534593a9af9e773ecc9cc2. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:22.224250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:44:22.227385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:44:22.304830 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-83cea408-3ec4-464b-a5d6-8542bd491c82 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787858 Jul 26 19:44:22.309343 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 184/364] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:44:22.330145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e46d5893-a265-4062-8a16-82a17258fd4f tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] Calling method '.version_select at 0x7f876417fee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:22.454495 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5de4da27-c4a8-4efd-ac0a-462e1a14b399 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ef9e67c0-7352-4604-a957-b7f3a5606d8c" status: 202 len: 0 microversion: 2.1 time: 0.322524 Jul 26 19:44:22.455448 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 181/365] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:22 2022] DELETE /compute/v2.1/os-security-groups/ef9e67c0-7352-4604-a957-b7f3a5606d8c => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:22.461867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f45868b-7930-44d8-a688-37a6ee28ec11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:22.462982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2f45868b-7930-44d8-a688-37a6ee28ec11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:22.668578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f45868b-7930-44d8-a688-37a6ee28ec11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:22.676240 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f45868b-7930-44d8-a688-37a6ee28ec11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1220 microversion: 2.1 time: 0.219284 Jul 26 19:44:22.677135 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 182/366] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:22 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1220 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:22.696237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-abe08161-fb36-4074-a19e-f873ecfcb265 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f87579d9f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:23.297207 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-abe08161-fb36-4074-a19e-f873ecfcb265 tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b9986533-55ec-4883-9aa1-2849461c242f" status: 202 len: 0 microversion: 2.1 time: 0.608354 Jul 26 19:44:23.298229 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 183/367] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:22 2022] DELETE /compute/v2.1/os-security-groups/b9986533-55ec-4883-9aa1-2849461c242f => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:23.305350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-630cebde-9318-4ad9-892b-08bdb6e155b0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:23.306190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-630cebde-9318-4ad9-892b-08bdb6e155b0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:23.331947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630cebde-9318-4ad9-892b-08bdb6e155b0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:23.335795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630cebde-9318-4ad9-892b-08bdb6e155b0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:23.337195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630cebde-9318-4ad9-892b-08bdb6e155b0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:23.337778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630cebde-9318-4ad9-892b-08bdb6e155b0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:23.501716 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e46d5893-a265-4062-8a16-82a17258fd4f tempest-QuotasAdminTestV257-452065574 tempest-QuotasAdminTestV257-452065574-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/bfdc5f9e4a0b4974af1f564624453abb?user_id=1c71f5ed22f246c1898f641db182f462" status: 200 len: 190 microversion: 2.57 time: 1.177811 Jul 26 19:44:23.503640 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 185/368] 10.222.0.58 () {60 vars in 1364 bytes} [Tue Jul 26 19:44:22 2022] GET /compute/v2.1/os-quota-sets/bfdc5f9e4a0b4974af1f564624453abb?user_id=1c71f5ed22f246c1898f641db182f462 => generated 190 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:23.537639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cee5772c-2cc9-4413-ac85-fddd78a6a74d tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f87641e4820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:23.662340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-630cebde-9318-4ad9-892b-08bdb6e155b0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:23.672898 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-630cebde-9318-4ad9-892b-08bdb6e155b0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1468 microversion: 2.1 time: 0.373141 Jul 26 19:44:23.689418 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 184/369] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:23 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1468 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:23.705130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5309d3e1-48b6-4a7f-8bca-44022e9a7330 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:23.707265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5309d3e1-48b6-4a7f-8bca-44022e9a7330 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:23.719441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5309d3e1-48b6-4a7f-8bca-44022e9a7330 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:23.721571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5309d3e1-48b6-4a7f-8bca-44022e9a7330 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:23.723789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5309d3e1-48b6-4a7f-8bca-44022e9a7330 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:23.727710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5309d3e1-48b6-4a7f-8bca-44022e9a7330 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:23.861326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5309d3e1-48b6-4a7f-8bca-44022e9a7330 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:23.874072 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5309d3e1-48b6-4a7f-8bca-44022e9a7330 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1216 microversion: 2.1 time: 0.176397 Jul 26 19:44:23.891921 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 185/370] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:23 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1216 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:23.902847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-483e848d-d060-4633-98e7-b0d00648d829 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:23.904541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-483e848d-d060-4633-98e7-b0d00648d829 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:23.913256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:23.936304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-483e848d-d060-4633-98e7-b0d00648d829 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:23.937901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-483e848d-d060-4633-98e7-b0d00648d829 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:23.940333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-483e848d-d060-4633-98e7-b0d00648d829 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:23.941335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-483e848d-d060-4633-98e7-b0d00648d829 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:24.120868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-483e848d-d060-4633-98e7-b0d00648d829 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lazy-loading 'flavor' on Instance uuid 5d4196c1-6cde-4426-aa86-5c090f8c8c7f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:44:24.204037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cee5772c-2cc9-4413-ac85-fddd78a6a74d tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/673d095d-735b-4775-9079-8085243fa7e0" status: 202 len: 0 microversion: 2.1 time: 0.684328 Jul 26 19:44:24.204990 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 186/371] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:23 2022] DELETE /compute/v2.1/os-security-groups/673d095d-735b-4775-9079-8085243fa7e0 => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:24.215473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91edda1f-6486-444a-811d-410eea761c3f tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] Calling method '.version_select at 0x7f87642a4310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:24.378007 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-483e848d-d060-4633-98e7-b0d00648d829 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f/action" status: 202 len: 0 microversion: 2.1 time: 0.483543 Jul 26 19:44:24.395584 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 186/372] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:44:23 2022] POST /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:24.417661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-112f8756-d32b-472e-bd09-ccd63940e5e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:24.420890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-112f8756-d32b-472e-bd09-ccd63940e5e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:24.443165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-112f8756-d32b-472e-bd09-ccd63940e5e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:24.445922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-112f8756-d32b-472e-bd09-ccd63940e5e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:24.451288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-112f8756-d32b-472e-bd09-ccd63940e5e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:24.451713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-112f8756-d32b-472e-bd09-ccd63940e5e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:24.750669 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91edda1f-6486-444a-811d-410eea761c3f tempest-SecurityGroupRulesTestJSON-990792581 tempest-SecurityGroupRulesTestJSON-990792581-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/583f3d19-41d0-481c-91ad-98969b32259b" status: 202 len: 0 microversion: 2.1 time: 0.540262 Jul 26 19:44:24.751806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 187/373] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:24 2022] DELETE /compute/v2.1/os-security-groups/583f3d19-41d0-481c-91ad-98969b32259b => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:44:24.899376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-25878e00-c4f7-408a-b0df-8285dd21414b tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:24.900519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-25878e00-c4f7-408a-b0df-8285dd21414b tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:24.911393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=2,nova_api:INSERT=8,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:24.918364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25878e00-c4f7-408a-b0df-8285dd21414b tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:24.921482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25878e00-c4f7-408a-b0df-8285dd21414b tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:24.924296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25878e00-c4f7-408a-b0df-8285dd21414b tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:24.935643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25878e00-c4f7-408a-b0df-8285dd21414b tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:25.147359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-25878e00-c4f7-408a-b0df-8285dd21414b tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:25.165107 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-25878e00-c4f7-408a-b0df-8285dd21414b tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1278 microversion: 2.1 time: 0.270013 Jul 26 19:44:25.172617 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 188/374] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:24 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1278 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:25.610572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-112f8756-d32b-472e-bd09-ccd63940e5e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:25.627936 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-112f8756-d32b-472e-bd09-ccd63940e5e7 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1476 microversion: 2.1 time: 1.223341 Jul 26 19:44:25.644701 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 187/375] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:24 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1476 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:26.194725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-faf1731c-1de2-49a1-b2a6-d1ac95494fbd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:26.195597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-faf1731c-1de2-49a1-b2a6-d1ac95494fbd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:26.205348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf1731c-1de2-49a1-b2a6-d1ac95494fbd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:26.205795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf1731c-1de2-49a1-b2a6-d1ac95494fbd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:26.214547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf1731c-1de2-49a1-b2a6-d1ac95494fbd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:26.215011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf1731c-1de2-49a1-b2a6-d1ac95494fbd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:26.323298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18195c8e-e661-4bef-a84d-0c6e8370eeca tempest-NetworksTest-458742942 tempest-NetworksTest-458742942-project-admin] Calling method '.version_select at 0x7f876417f670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:26.465807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-faf1731c-1de2-49a1-b2a6-d1ac95494fbd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:26.476609 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-faf1731c-1de2-49a1-b2a6-d1ac95494fbd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1278 microversion: 2.1 time: 0.286056 Jul 26 19:44:26.486474 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 188/376] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:26 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1278 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:26.660250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ec919c1-0bb0-4b68-8b9b-c20710d28c69 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:26.661025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ec919c1-0bb0-4b68-8b9b-c20710d28c69 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:26.693537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ec919c1-0bb0-4b68-8b9b-c20710d28c69 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:26.699929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ec919c1-0bb0-4b68-8b9b-c20710d28c69 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:26.700911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ec919c1-0bb0-4b68-8b9b-c20710d28c69 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:26.716708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ec919c1-0bb0-4b68-8b9b-c20710d28c69 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:26.930312 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18195c8e-e661-4bef-a84d-0c6e8370eeca tempest-NetworksTest-458742942 tempest-NetworksTest-458742942-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 5386 microversion: 2.1 time: 1.020783 Jul 26 19:44:26.931490 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 189/377] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:44:25 2022] GET /compute/v2.1/os-networks => generated 5386 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:26.940616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e78fc00-c033-4c16-bcc1-219c39f25aee tempest-NetworksTest-458742942 tempest-NetworksTest-458742942-project-admin] Calling method '.version_select at 0x7f87642a4dc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:27.044915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ec919c1-0bb0-4b68-8b9b-c20710d28c69 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:27.053411 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ec919c1-0bb0-4b68-8b9b-c20710d28c69 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1459 microversion: 2.1 time: 0.397180 Jul 26 19:44:27.072793 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 189/378] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:26 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1459 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:27.087119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-67140d9b-e5f4-4ed2-908b-fe1f3ac00d24 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:27.087706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-67140d9b-e5f4-4ed2-908b-fe1f3ac00d24 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:27.099580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67140d9b-e5f4-4ed2-908b-fe1f3ac00d24 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:27.103233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67140d9b-e5f4-4ed2-908b-fe1f3ac00d24 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:27.107836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67140d9b-e5f4-4ed2-908b-fe1f3ac00d24 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:27.108363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67140d9b-e5f4-4ed2-908b-fe1f3ac00d24 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:27.833820 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e78fc00-c033-4c16-bcc1-219c39f25aee tempest-NetworksTest-458742942 tempest-NetworksTest-458742942-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks/0276911f-94cd-4250-bec1-fa4860ff6b75" status: 200 len: 652 microversion: 2.1 time: 0.897345 Jul 26 19:44:27.834717 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 190/379] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 19:44:26 2022] GET /compute/v2.1/os-networks/0276911f-94cd-4250-bec1-fa4860ff6b75 => generated 652 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:27.843515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c94cea85-63ac-477d-9a96-e3bb64ce022f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:27.844399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c94cea85-63ac-477d-9a96-e3bb64ce022f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:27.868886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c94cea85-63ac-477d-9a96-e3bb64ce022f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:27.883630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c94cea85-63ac-477d-9a96-e3bb64ce022f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:27.889285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c94cea85-63ac-477d-9a96-e3bb64ce022f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:27.907397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c94cea85-63ac-477d-9a96-e3bb64ce022f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:28.456484 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-67140d9b-e5f4-4ed2-908b-fe1f3ac00d24 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1610 microversion: 2.1 time: 1.377733 Jul 26 19:44:28.457074 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 190/380] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:27 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1610 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:28.470255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a67d497e-ebaf-4108-a8d4-3608c41e984a tempest-NetworksTest-458742942 tempest-NetworksTest-458742942-project-admin] Calling method '.version_select at 0x7f87578bf670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:28.516067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c94cea85-63ac-477d-9a96-e3bb64ce022f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:28.530257 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c94cea85-63ac-477d-9a96-e3bb64ce022f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1320 microversion: 2.1 time: 0.694244 Jul 26 19:44:28.532440 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 191/381] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:27 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1320 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:29.115135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a67d497e-ebaf-4108-a8d4-3608c41e984a tempest-NetworksTest-458742942 tempest-NetworksTest-458742942-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 5386 microversion: 2.1 time: 0.652307 Jul 26 19:44:29.130776 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 191/382] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:44:28 2022] GET /compute/v2.1/os-networks => generated 5386 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:29.144331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3069b394-1116-4b2d-8593-20b08a112004 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:29.155752 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:29.155752 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:29.162630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3069b394-1116-4b2d-8593-20b08a112004 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:29.163474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3069b394-1116-4b2d-8593-20b08a112004 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:29.167906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3069b394-1116-4b2d-8593-20b08a112004 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:29.168888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3069b394-1116-4b2d-8593-20b08a112004 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:29.246608 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3069b394-1116-4b2d-8593-20b08a112004 tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.114444 Jul 26 19:44:29.252526 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 192/383] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 19:44:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:29.275895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-708768-8", "block_migration": true, "disk_over_commit": false}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:29.279224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:29.291915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:29.298148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:29.301857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:29.302559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:29.377244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e6b8c4ac-6419-494d-aec0-ce0c8672eb36 tempest-FlavorsV261TestJSON-2098904520 tempest-FlavorsV261TestJSON-2098904520-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1132280413", "id": 228280312, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:29.383343 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:29.383343 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:29.429924 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e6b8c4ac-6419-494d-aec0-ce0c8672eb36 tempest-FlavorsV261TestJSON-2098904520 tempest-FlavorsV261TestJSON-2098904520-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.894078 Jul 26 19:44:29.432161 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 192/384] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:44:28 2022] POST /compute/v2.1/flavors => generated 465 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:29.826269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02833b38-f6bf-4ffa-8363-4e1da4651a34 tempest-FlavorsV261TestJSON-524197942 tempest-FlavorsV261TestJSON-524197942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:29.843021 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02833b38-f6bf-4ffa-8363-4e1da4651a34 tempest-FlavorsV261TestJSON-524197942 tempest-FlavorsV261TestJSON-524197942-project] 10.222.0.58 "GET /compute/v2.1/flavors/228280312" status: 200 len: 465 microversion: 2.61 time: 0.399383 Jul 26 19:44:29.851903 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 193/385] 10.222.0.58 () {60 vars in 1196 bytes} [Tue Jul 26 19:44:29 2022] GET /compute/v2.1/flavors/228280312 => generated 465 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:29.857647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7cb7e298-2de4-44dd-8ec6-4313dd4860c1 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:29.858257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7cb7e298-2de4-44dd-8ec6-4313dd4860c1 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:29.874155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cb7e298-2de4-44dd-8ec6-4313dd4860c1 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:29.875877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cb7e298-2de4-44dd-8ec6-4313dd4860c1 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:29.877983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cb7e298-2de4-44dd-8ec6-4313dd4860c1 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:29.878426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cb7e298-2de4-44dd-8ec6-4313dd4860c1 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:30.262883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Lazy-loading 'flavor' on Instance uuid 5d4196c1-6cde-4426-aa86-5c090f8c8c7f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:44:30.305387 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f while it is in vm_state suspended Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Request method failure captured: Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f/action HTTP/1.1 Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 97 Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPsMYAgjEqjIoBbXFgRBvRuf1E55QHIOPhvATuNJZ5BRxRhXKY_4fyeu5nQ5bIRNiFmydujZz4WgBa08jOh4CzC8e1fe8zmfVKQjApObq2qm9rmKSgNcmCNL_gSidV8AAH1oWxMvSAwisVvBHydOliJtZR2NQkHNN_IvdmymEz0YcY Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 73a53e5542ec4a3990f07c5faaddd8b3 Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-LiveMigrationNegativeTest-1391053974 Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:44:30.309177 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/73a53e5542ec4a3990f07c5faaddd8b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/73a53e5542ec4a3990f07c5faaddd8b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_73a53e5542ec4a3990f07c5faaddd8b3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/73a53e5542ec4a3990f07c5faaddd8b3"}]}] Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-LiveMigrationNegativeTest-1391053974 Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 73a53e5542ec4a3990f07c5faaddd8b3 Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1391053974 Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-LiveMigrationNegativeTest-1391053974-project-admin Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bbcf172817924d4284552cf16b1284aa Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-LiveMigrationNegativeTest-1391053974-project-admin Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: {"os-migrateLive": {"host": "n-h1-708768-8", "block_migration": true, "disk_over_commit": false}} Jul 26 19:44:30.310728 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'os-migrateLive' instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f while it is in vm_state suspended Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5d4196c1-6cde-4426-aa86-5c090f8c8c7f', 'body': {'os-migrateLive': {'host': 'n-h1-708768-8', 'block_migration': True, 'disk_over_commit': False}}} Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 19:44:30.311573 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:30.312933 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f while it is in vm_state suspended Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f while it is in vm_state suspended Jul 26 19:44:30.314410 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:30.315667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f while it is in vm_state suspended {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:30.315667 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-57aeb0e1-1cd2-4a92-9f4b-45663c3b254e tempest-LiveMigrationNegativeTest-1391053974 tempest-LiveMigrationNegativeTest-1391053974-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f/action" status: 409 len: 155 microversion: 2.1 time: 1.047527 Jul 26 19:44:30.328705 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 193/386] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:44:29 2022] POST /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f/action => generated 155 bytes in 1062 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:44:30.344391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bedc6b38-4d0d-4202-8d8a-c96f23bd7f54 tempest-FlavorsV261TestJSON-2098904520 tempest-FlavorsV261TestJSON-2098904520-project-admin] Action: 'update', calling method: .version_select at 0x7f8765f18f70>, body: {"flavor": {"description": "new"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:30.374324 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:30.374324 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:30.461079 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bedc6b38-4d0d-4202-8d8a-c96f23bd7f54 tempest-FlavorsV261TestJSON-2098904520 tempest-FlavorsV261TestJSON-2098904520-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/228280312" status: 200 len: 466 microversion: 2.61 time: 0.118690 Jul 26 19:44:30.461753 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 194/387] 10.222.0.58 () {62 vars in 1216 bytes} [Tue Jul 26 19:44:30 2022] PUT /compute/v2.1/flavors/228280312 => generated 466 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:30.482099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a400ac53-6ef5-48d3-9f52-07af70b7dd70 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:30.483665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a400ac53-6ef5-48d3-9f52-07af70b7dd70 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:30.503959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a400ac53-6ef5-48d3-9f52-07af70b7dd70 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:30.504666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a400ac53-6ef5-48d3-9f52-07af70b7dd70 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:30.505638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a400ac53-6ef5-48d3-9f52-07af70b7dd70 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:30.506187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a400ac53-6ef5-48d3-9f52-07af70b7dd70 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:30.569340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a400ac53-6ef5-48d3-9f52-07af70b7dd70 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:44:30.571566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7cb7e298-2de4-44dd-8ec6-4313dd4860c1 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:30.580775 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7cb7e298-2de4-44dd-8ec6-4313dd4860c1 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1320 microversion: 2.1 time: 0.727665 Jul 26 19:44:30.586960 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 194/388] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:29 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1320 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:30.599011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ca67a0ed-de8c-45d3-94b9-79112b563019 req-26d04ca5-399f-4b79-bd57-5bb9dc4a1626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d463e8-9f7a-47e3-abed-dedba2bd9cca", "tag": "0f4e85ea-e190-40a8-bd6a-bf5e24493288"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:30.620395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ca67a0ed-de8c-45d3-94b9-79112b563019 req-26d04ca5-399f-4b79-bd57-5bb9dc4a1626 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:30.621456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ca67a0ed-de8c-45d3-94b9-79112b563019 req-26d04ca5-399f-4b79-bd57-5bb9dc4a1626 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:30.661166 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ca67a0ed-de8c-45d3-94b9-79112b563019 req-26d04ca5-399f-4b79-bd57-5bb9dc4a1626 service nova] Creating event network-changed:0f4e85ea-e190-40a8-bd6a-bf5e24493288 for instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca on n-h1-708768-8 Jul 26 19:44:30.689883 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ca67a0ed-de8c-45d3-94b9-79112b563019 req-26d04ca5-399f-4b79-bd57-5bb9dc4a1626 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097808 Jul 26 19:44:30.691902 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 195/389] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:30.706295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3bee459-19f1-44e7-a7c4-a1507b578b83 tempest-FlavorsV261TestJSON-524197942 tempest-FlavorsV261TestJSON-524197942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:30.757894 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a400ac53-6ef5-48d3-9f52-07af70b7dd70 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 204 len: 0 microversion: 2.1 time: 0.288395 Jul 26 19:44:30.758991 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 195/390] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:44:30 2022] DELETE /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:44:30.775492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f35a47d-8436-41ef-be58-580c93e8b5cc tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:30.776576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f35a47d-8436-41ef-be58-580c93e8b5cc tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:30.790558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f35a47d-8436-41ef-be58-580c93e8b5cc tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:30.793767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f35a47d-8436-41ef-be58-580c93e8b5cc tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:30.796216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f35a47d-8436-41ef-be58-580c93e8b5cc tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:30.796930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f35a47d-8436-41ef-be58-580c93e8b5cc tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:30.873358 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3bee459-19f1-44e7-a7c4-a1507b578b83 tempest-FlavorsV261TestJSON-524197942 tempest-FlavorsV261TestJSON-524197942-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 7150 microversion: 2.61 time: 0.179897 Jul 26 19:44:30.887649 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 196/391] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:44:30 2022] GET /compute/v2.1/flavors/detail => generated 7150 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:44:30.906082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fff35758-cc76-4c6a-b4fd-5d23c6968864 tempest-FlavorsV261TestJSON-524197942 tempest-FlavorsV261TestJSON-524197942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:30.942202 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fff35758-cc76-4c6a-b4fd-5d23c6968864 tempest-FlavorsV261TestJSON-524197942 tempest-FlavorsV261TestJSON-524197942-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3677 microversion: 2.61 time: 0.039664 Jul 26 19:44:30.945940 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 197/392] 10.222.0.58 () {60 vars in 1166 bytes} [Tue Jul 26 19:44:30 2022] GET /compute/v2.1/flavors => generated 3677 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:44:30.969822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c00129d6-aad7-4d41-96be-6c0f7517490a tempest-FlavorsV261TestJSON-2098904520 tempest-FlavorsV261TestJSON-2098904520-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:30.971529 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:30.971529 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:31.010184 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c00129d6-aad7-4d41-96be-6c0f7517490a tempest-FlavorsV261TestJSON-2098904520 tempest-FlavorsV261TestJSON-2098904520-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/228280312" status: 202 len: 0 microversion: 2.61 time: 0.038772 Jul 26 19:44:31.013413 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 198/393] 10.222.0.58 () {60 vars in 1199 bytes} [Tue Jul 26 19:44:30 2022] DELETE /compute/v2.1/flavors/228280312 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:44:31.024333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-537377ed-c507-433d-9f37-27b17fbb46b5 tempest-FlavorsV261TestJSON-2098904520 tempest-FlavorsV261TestJSON-2098904520-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:31.098971 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-537377ed-c507-433d-9f37-27b17fbb46b5 tempest-FlavorsV261TestJSON-2098904520 tempest-FlavorsV261TestJSON-2098904520-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.078016 Jul 26 19:44:31.101853 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 199/394] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:44:31 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:44:31.423057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f35a47d-8436-41ef-be58-580c93e8b5cc tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:31.434495 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f35a47d-8436-41ef-be58-580c93e8b5cc tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1465 microversion: 2.1 time: 0.670455 Jul 26 19:44:31.435328 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 196/395] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:30 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1465 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:31.633557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54a4b72c-a37d-4f42-8280-06c861c77674 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:31.635002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54a4b72c-a37d-4f42-8280-06c861c77674 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:31.649326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54a4b72c-a37d-4f42-8280-06c861c77674 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:31.651210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54a4b72c-a37d-4f42-8280-06c861c77674 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:31.655940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54a4b72c-a37d-4f42-8280-06c861c77674 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:31.656811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54a4b72c-a37d-4f42-8280-06c861c77674 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:32.076927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-54a4b72c-a37d-4f42-8280-06c861c77674 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:32.091342 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54a4b72c-a37d-4f42-8280-06c861c77674 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1320 microversion: 2.1 time: 0.465976 Jul 26 19:44:32.104402 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 200/396] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:31 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:32.464197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ea68885-d443-42e6-803a-632087ac2318 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:32.464792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ea68885-d443-42e6-803a-632087ac2318 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:32.481516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea68885-d443-42e6-803a-632087ac2318 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:32.481973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea68885-d443-42e6-803a-632087ac2318 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:32.484416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea68885-d443-42e6-803a-632087ac2318 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:32.484870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea68885-d443-42e6-803a-632087ac2318 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:32.673561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=16 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:33.131747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a7dce53-3b80-4193-bbf8-95f0108e8de0 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:33.132369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a7dce53-3b80-4193-bbf8-95f0108e8de0 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:33.144083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:33.151587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7dce53-3b80-4193-bbf8-95f0108e8de0 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:33.153252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7dce53-3b80-4193-bbf8-95f0108e8de0 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:33.155421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7dce53-3b80-4193-bbf8-95f0108e8de0 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:33.156466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7dce53-3b80-4193-bbf8-95f0108e8de0 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:33.484303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=18 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:33.577245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1a7dce53-3b80-4193-bbf8-95f0108e8de0 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:33.589071 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a7dce53-3b80-4193-bbf8-95f0108e8de0 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1320 microversion: 2.1 time: 0.462987 Jul 26 19:44:33.591022 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 201/397] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:33 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:33.638084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ea68885-d443-42e6-803a-632087ac2318 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:33.667635 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ea68885-d443-42e6-803a-632087ac2318 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1465 microversion: 2.1 time: 1.192473 Jul 26 19:44:33.668671 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 197/398] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:32 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1465 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:34.178426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2cdfff9f-84ef-44a8-a1fc-e3d1bbb88e55 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Calling method '.version_select at 0x7f87642a4c10>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:34.356365 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2cdfff9f-84ef-44a8-a1fc-e3d1bbb88e55 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 371 microversion: 2.1 time: 0.405720 Jul 26 19:44:34.358768 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 202/399] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 19:44:33 2022] GET /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:34.391987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-48aa364c-4126-479c-af2a-7254509b2924 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Action: 'update', calling method: .version_select at 0x7f87578bf0d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:34.620914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5d43aee-a52a-48dd-bf4c-628b61d6d2dd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:34.621529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a5d43aee-a52a-48dd-bf4c-628b61d6d2dd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:34.630781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5d43aee-a52a-48dd-bf4c-628b61d6d2dd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:34.639356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5d43aee-a52a-48dd-bf4c-628b61d6d2dd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:34.642413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5d43aee-a52a-48dd-bf4c-628b61d6d2dd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:34.644152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5d43aee-a52a-48dd-bf4c-628b61d6d2dd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:35.244411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48aa364c-4126-479c-af2a-7254509b2924 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:35.245538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48aa364c-4126-479c-af2a-7254509b2924 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:35.246529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48aa364c-4126-479c-af2a-7254509b2924 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:35.247206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48aa364c-4126-479c-af2a-7254509b2924 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:35.345503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a5d43aee-a52a-48dd-bf4c-628b61d6d2dd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:35.355700 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5d43aee-a52a-48dd-bf4c-628b61d6d2dd tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1320 microversion: 2.1 time: 0.738540 Jul 26 19:44:35.361113 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 203/400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:34 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1320 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:35.375377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:35.379499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:35.400000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:35.400775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:35.401878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:35.404656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:35.504681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:35.505684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:35.506304 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-48aa364c-4126-479c-af2a-7254509b2924 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 328 microversion: 2.1 time: 1.122549 Jul 26 19:44:35.507734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lazy-loading 'fault' on Instance uuid 5d4196c1-6cde-4426-aa86-5c090f8c8c7f {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:44:35.508868 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 198/401] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:44:34 2022] PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 328 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:35.560969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b70c4e7e-2144-4ea9-9cd3-3476758459dc req-3c22a491-6b21-478d-9b3d-e21eb095d6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4196c1-6cde-4426-aa86-5c090f8c8c7f", "name": "network-vif-deleted", "tag": "ff56f7f2-fd7e-4525-9bed-51ca8a7fd2e2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:35.612195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b70c4e7e-2144-4ea9-9cd3-3476758459dc req-3c22a491-6b21-478d-9b3d-e21eb095d6ee service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:35.614059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b70c4e7e-2144-4ea9-9cd3-3476758459dc req-3c22a491-6b21-478d-9b3d-e21eb095d6ee service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:35.626666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:35.642897 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b70c4e7e-2144-4ea9-9cd3-3476758459dc req-3c22a491-6b21-478d-9b3d-e21eb095d6ee service nova] Creating event network-vif-deleted:ff56f7f2-fd7e-4525-9bed-51ca8a7fd2e2 for instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f on n-h2-708768-8 Jul 26 19:44:35.643053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:35.657834 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b70c4e7e-2144-4ea9-9cd3-3476758459dc req-3c22a491-6b21-478d-9b3d-e21eb095d6ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146421 Jul 26 19:44:35.661723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 199/402] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:35.663286 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ad5940c-3a13-4680-ba9d-c9ad650346d0 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 200 len: 1308 microversion: 2.1 time: 0.298627 Jul 26 19:44:35.667270 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 204/403] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:35 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:36.076991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1330976481", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:36.150225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:36.368250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:44:36.368853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:44:36.369493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:44:36.369738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:44:36.370473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:44:36.379822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.380273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.381351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.382231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.388454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9f1277a1-6d03-4cf2-a28f-58c0e3b6bb11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:36.389063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9f1277a1-6d03-4cf2-a28f-58c0e3b6bb11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:36.396084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f1277a1-6d03-4cf2-a28f-58c0e3b6bb11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.397005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f1277a1-6d03-4cf2-a28f-58c0e3b6bb11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.398523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f1277a1-6d03-4cf2-a28f-58c0e3b6bb11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.399309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f1277a1-6d03-4cf2-a28f-58c0e3b6bb11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.402168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Getting quotas for project ef167af0e9dc4c63ba547c2feff9a20f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:36.408166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Getting quotas for user 249cce9c3bae4aa7b78bd6c8c0b7c250 and project ef167af0e9dc4c63ba547c2feff9a20f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:36.421330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.utils [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] cores quota exceeded for ef167af0e9dc4c63ba547c2feff9a20f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125964) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 19:44:36.422612 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Request method failure captured: Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 145 Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQgwNiPfopu0yWVhXaGlH4luIXU64fsZ1HXGSoSxpfKTJyrmwLdvUXiHIjW3-oM_tOhaxF6kzSz_BEK14EpJoWl5u_mKkImpsfcnTudTNxis1Rf5fXYr0CuWyh-wFE7Zm4iz7oRui-4BKQAUa4szWO2kpSBgVXIRMDYu-cqUtTtysY Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: ef167af0e9dc4c63ba547c2feff9a20f Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:44:36.452486 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ef167af0e9dc4c63ba547c2feff9a20f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef167af0e9dc4c63ba547c2feff9a20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ef167af0e9dc4c63ba547c2feff9a20f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef167af0e9dc4c63ba547c2feff9a20f"}]}] Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: ef167af0e9dc4c63ba547c2feff9a20f Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-QuotasAdminNegativeTest-1569910287-project Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 249cce9c3bae4aa7b78bd6c8c0b7c250 Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-QuotasAdminNegativeTest-1569910287-project Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1330976481", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} Jul 26 19:44:36.454059 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1330976481', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452'}}} Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 19:44:36.454911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:36.456202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.457775 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5918d0d-da9a-412a-a719-e6a9a0dd6cbf tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.603196 Jul 26 19:44:36.463056 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 200/404] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:35 2022] POST /compute/v2.1/servers => generated 111 bytes in 605 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:36.468829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-133a2856-2c5c-4ae6-94e6-c95833f5434c tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Action: 'update', calling method: .version_select at 0x7f875761a040>, body: {"quota_set": {"cores": 20}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:36.571765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9f1277a1-6d03-4cf2-a28f-58c0e3b6bb11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:36.580538 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9f1277a1-6d03-4cf2-a28f-58c0e3b6bb11 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1320 microversion: 2.1 time: 0.196134 Jul 26 19:44:36.580911 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 205/405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:36 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:36.688956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:36.689743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 5d4196c1-6cde-4426-aa86-5c090f8c8c7f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:36.703025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.703662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.704758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.705338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.723553 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] HTTP exception thrown: Instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f could not be found. Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Request method failure captured: Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f HTTP/1.1 Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPrl5NNx9Fw6rH2fdghHNfv7Yz0EMIXbkg03vz3ptTnImSTDSuoF23DtJnf7BRJX8OXoERzL8va1pnX7nWHEt1msJXWVsqDxuXAPeRRcusS9KdMvf6SLvftTerdt1MAIVVUXhsHbWZXUApwbcJM9P4XDylmATc92mPp-2pZg0lIFwE Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a019aea2aed240728e898c76739c8fd6 Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-LiveMigrationNegativeTest-717553334 Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:36.725478 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a019aea2aed240728e898c76739c8fd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a019aea2aed240728e898c76739c8fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a019aea2aed240728e898c76739c8fd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a019aea2aed240728e898c76739c8fd6"}]}] Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-LiveMigrationNegativeTest-717553334 Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a019aea2aed240728e898c76739c8fd6 Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-717553334 Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-LiveMigrationNegativeTest-717553334-project Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a84e343311cf4ca1a7ce698490e7578e Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-LiveMigrationNegativeTest-717553334-project Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f could not be found. Jul 26 19:44:36.726995 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5d4196c1-6cde-4426-aa86-5c090f8c8c7f'} Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f could not be found. Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:36.727883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f could not be found. Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f could not be found. Jul 26 19:44:36.729285 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:36.731336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Returning 404 to user: Instance 5d4196c1-6cde-4426-aa86-5c090f8c8c7f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:36.732532 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-791b813e-c7a8-449a-9d80-5f390dfd95f6 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f" status: 404 len: 111 microversion: 2.1 time: 0.047363 Jul 26 19:44:36.733210 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 206/406] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:36 2022] GET /compute/v2.1/servers/5d4196c1-6cde-4426-aa86-5c090f8c8c7f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:44:36.742127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-664c0d19-e0d5-49bd-89fc-6cb7606f3abe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:36.742809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-664c0d19-e0d5-49bd-89fc-6cb7606f3abe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:36.748787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-664c0d19-e0d5-49bd-89fc-6cb7606f3abe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.749223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-664c0d19-e0d5-49bd-89fc-6cb7606f3abe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.749985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-664c0d19-e0d5-49bd-89fc-6cb7606f3abe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.750404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-664c0d19-e0d5-49bd-89fc-6cb7606f3abe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.778889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-664c0d19-e0d5-49bd-89fc-6cb7606f3abe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:44:36.808919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:36.939284 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-664c0d19-e0d5-49bd-89fc-6cb7606f3abe tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 204 len: 0 microversion: 2.1 time: 0.201432 Jul 26 19:44:36.943206 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 207/407] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:44:36 2022] DELETE /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:44:36.956176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fbf00cfa-2d36-4f75-8f13-0d2a28cf301b tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:36.960916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fbf00cfa-2d36-4f75-8f13-0d2a28cf301b tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:36.974208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbf00cfa-2d36-4f75-8f13-0d2a28cf301b tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.975887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbf00cfa-2d36-4f75-8f13-0d2a28cf301b tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:36.977301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbf00cfa-2d36-4f75-8f13-0d2a28cf301b tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:36.979360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbf00cfa-2d36-4f75-8f13-0d2a28cf301b tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:37.137560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-133a2856-2c5c-4ae6-94e6-c95833f5434c tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:37.138010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-133a2856-2c5c-4ae6-94e6-c95833f5434c tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:37.139423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-133a2856-2c5c-4ae6-94e6-c95833f5434c tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:37.139889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-133a2856-2c5c-4ae6-94e6-c95833f5434c tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:37.181287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fbf00cfa-2d36-4f75-8f13-0d2a28cf301b tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:37.195962 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fbf00cfa-2d36-4f75-8f13-0d2a28cf301b tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1475 microversion: 2.1 time: 0.246578 Jul 26 19:44:37.198877 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 208/408] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:36 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1475 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:37.205229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-175e3c25-46ac-4ccc-83e1-b5d224252a3d req-cd5a2a5f-89ad-4208-ac7e-c57946496c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d463e8-9f7a-47e3-abed-dedba2bd9cca", "name": "network-vif-plugged", "status": "completed", "tag": "0f4e85ea-e190-40a8-bd6a-bf5e24493288"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:37.230103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-175e3c25-46ac-4ccc-83e1-b5d224252a3d req-cd5a2a5f-89ad-4208-ac7e-c57946496c1d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:37.231897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-175e3c25-46ac-4ccc-83e1-b5d224252a3d req-cd5a2a5f-89ad-4208-ac7e-c57946496c1d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:37.263901 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-175e3c25-46ac-4ccc-83e1-b5d224252a3d req-cd5a2a5f-89ad-4208-ac7e-c57946496c1d service nova] Creating event network-vif-plugged:0f4e85ea-e190-40a8-bd6a-bf5e24493288 for instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca on n-h1-708768-8 Jul 26 19:44:37.279381 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-175e3c25-46ac-4ccc-83e1-b5d224252a3d req-cd5a2a5f-89ad-4208-ac7e-c57946496c1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074253 Jul 26 19:44:37.280045 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 209/409] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:37.298217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08d65c23-c5ce-40cf-8255-a9e73be2a723 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:37.298795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08d65c23-c5ce-40cf-8255-a9e73be2a723 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:37.305002 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-133a2856-2c5c-4ae6-94e6-c95833f5434c tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 329 microversion: 2.1 time: 0.840770 Jul 26 19:44:37.319401 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 201/410] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:44:36 2022] PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 329 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:44:37.319646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08d65c23-c5ce-40cf-8255-a9e73be2a723 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:37.319646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08d65c23-c5ce-40cf-8255-a9e73be2a723 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:37.319646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08d65c23-c5ce-40cf-8255-a9e73be2a723 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:37.319883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08d65c23-c5ce-40cf-8255-a9e73be2a723 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:37.330262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68463f4c-da21-4736-bf3c-978a1ecc53cc tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Calling method '.version_select at 0x7f8757561310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:37.365816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08d65c23-c5ce-40cf-8255-a9e73be2a723 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:44:37.533562 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08d65c23-c5ce-40cf-8255-a9e73be2a723 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "DELETE /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 204 len: 0 microversion: 2.1 time: 0.239738 Jul 26 19:44:37.534168 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 210/411] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:44:37 2022] DELETE /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:44:37.603738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ddbe713-c590-4c88-be2b-ed2998b7df24 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:37.604440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ddbe713-c590-4c88-be2b-ed2998b7df24 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:37.617995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ddbe713-c590-4c88-be2b-ed2998b7df24 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:37.620468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ddbe713-c590-4c88-be2b-ed2998b7df24 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:37.622977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ddbe713-c590-4c88-be2b-ed2998b7df24 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:37.623345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ddbe713-c590-4c88-be2b-ed2998b7df24 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:37.833065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ddbe713-c590-4c88-be2b-ed2998b7df24 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:37.842581 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ddbe713-c590-4c88-be2b-ed2998b7df24 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1320 microversion: 2.1 time: 0.243910 Jul 26 19:44:37.843171 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 211/412] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:37 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:37.875130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1858340443", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "48274083", "adminPass": "***", "networks": [{"uuid": "8278a3b7-4808-42be-b6e2-6bb4229f7cd2"}], "security_groups": [{"name": "tempest-securitygroup--490669374"}], "key_name": "tempest-keypair-1996243959", "user_data": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:37.947747 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68463f4c-da21-4736-bf3c-978a1ecc53cc tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 371 microversion: 2.1 time: 0.621403 Jul 26 19:44:37.948334 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 202/413] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 19:44:37 2022] GET /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 371 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:37.966640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9b9083ce-b95b-4afb-b81d-5b17333f8853 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Action: 'update', calling method: .version_select at 0x7f8757561c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:38.088523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] validate_networks() for [('8278a3b7-4808-42be-b6e2-6bb4229f7cd2', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:38.571032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b9083ce-b95b-4afb-b81d-5b17333f8853 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:38.571896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b9083ce-b95b-4afb-b81d-5b17333f8853 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:38.572999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b9083ce-b95b-4afb-b81d-5b17333f8853 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:38.573699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b9083ce-b95b-4afb-b81d-5b17333f8853 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:38.659410 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9b9083ce-b95b-4afb-b81d-5b17333f8853 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 328 microversion: 2.1 time: 0.700065 Jul 26 19:44:38.663667 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 203/414] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:44:37 2022] PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 328 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:38.681970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-64fdf577-f7e3-4aa0-b3cd-9979b92f6a02 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:38.682722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-64fdf577-f7e3-4aa0-b3cd-9979b92f6a02 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:38.699502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64fdf577-f7e3-4aa0-b3cd-9979b92f6a02 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:38.699994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64fdf577-f7e3-4aa0-b3cd-9979b92f6a02 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:38.701263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64fdf577-f7e3-4aa0-b3cd-9979b92f6a02 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:38.701852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64fdf577-f7e3-4aa0-b3cd-9979b92f6a02 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:38.762485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:39.078984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:44:39.079519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:44:39.079852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:44:39.080257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:44:39.083377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:44:39.096594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:39.098180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:39.099059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:39.100414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:39.168002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Getting quotas for project 5112c2e993b44756a068fe8782e68681. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:39.192481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Getting quotas for user 7836e60170f1440c9d82b730e8d03344 and project 5112c2e993b44756a068fe8782e68681. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:39.216192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:44:39.221200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:44:39.337722 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c653ce8e-cca5-4374-98ef-89ca23bcdbf5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.466214 Jul 26 19:44:39.340280 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 212/415] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:44:39.352912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91c31377-bc56-4026-abce-3e9530460a2c tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:39.356652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-91c31377-bc56-4026-abce-3e9530460a2c tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:39.372579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91c31377-bc56-4026-abce-3e9530460a2c tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:39.378082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91c31377-bc56-4026-abce-3e9530460a2c tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:39.380388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91c31377-bc56-4026-abce-3e9530460a2c tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:39.383120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91c31377-bc56-4026-abce-3e9530460a2c tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:39.387206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-64fdf577-f7e3-4aa0-b3cd-9979b92f6a02 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e343311cf4ca1a7ce698490e7578e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a019aea2aed240728e898c76739c8fd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:39.413029 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-64fdf577-f7e3-4aa0-b3cd-9979b92f6a02 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 200 len: 1475 microversion: 2.1 time: 0.748020 Jul 26 19:44:39.420660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 204/416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:38 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 1475 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:39.434473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2024329627", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:39.552730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:39.821494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-91c31377-bc56-4026-abce-3e9530460a2c tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:39.830116 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91c31377-bc56-4026-abce-3e9530460a2c tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1469 microversion: 2.1 time: 0.488604 Jul 26 19:44:39.848617 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 213/417] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:39 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:39.859387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d9c6fad3-e36e-49dd-ac38-b7ca8e426a7a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:39.860400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d9c6fad3-e36e-49dd-ac38-b7ca8e426a7a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:40.033828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d9c6fad3-e36e-49dd-ac38-b7ca8e426a7a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:40.046482 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d9c6fad3-e36e-49dd-ac38-b7ca8e426a7a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1261 microversion: 2.1 time: 0.197411 Jul 26 19:44:40.050064 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 214/418] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:39 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:40.062624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:40.064526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:40.085290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:40.087218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:40.088152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:40.088706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:40.186181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Request method failure captured: Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca/diagnostics HTTP/1.1 Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQT81cJjGgdOWP811x_ZV6PycW32Njbb0o8G-1AKStQgOCJaFITus1npsIedZLZitBEd-9ZG7HblMgNwEL6Dz458Q5mMZMkv9_5UiZ8-InNdjTgPLNaHzV50-YNMuFWUldxMBjT9NmX4pPB56IpgoEwcDWof8Z6tYXp_M3ILCBsHLk Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 3e06cee988534593a9af9e773ecc9cc2 Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1423377013 Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:40.197927 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e06cee988534593a9af9e773ecc9cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e06cee988534593a9af9e773ecc9cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e06cee988534593a9af9e773ecc9cc2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e06cee988534593a9af9e773ecc9cc2"}]}] Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1423377013 Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 3e06cee988534593a9af9e773ecc9cc2 Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1423377013 Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiagnosticsNegativeTest-1423377013-project Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c6fe5899d4764216a70b102339a74853 Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1423377013-project Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:44:40.199277 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '49d463e8-9f7a-47e3-abed-dedba2bd9cca'} Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:44:40.200064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 19:44:40.201236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:40.204907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:40.206131 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-42da4def-92b9-41eb-8fbf-13fb0ae6e0d9 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.154859 Jul 26 19:44:40.207947 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 215/419] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:44:40 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca/diagnostics => generated 117 bytes in 156 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:40.217769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c63aab1b-7933-45af-a032-ad325dadee53 req-9ac02594-2e40-47ee-8949-dc62b2569beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6565e25a-1a8a-479f-87f9-9666c3cdfbf5", "name": "network-vif-deleted", "tag": "7d464596-acdd-4bd5-92c5-f59401525b9d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:40.255840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c63aab1b-7933-45af-a032-ad325dadee53 req-9ac02594-2e40-47ee-8949-dc62b2569beb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:40.259595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c63aab1b-7933-45af-a032-ad325dadee53 req-9ac02594-2e40-47ee-8949-dc62b2569beb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:40.300914 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c63aab1b-7933-45af-a032-ad325dadee53 req-9ac02594-2e40-47ee-8949-dc62b2569beb service nova] Creating event network-vif-deleted:7d464596-acdd-4bd5-92c5-f59401525b9d for instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 on n-h1-708768-8 Jul 26 19:44:40.314333 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c63aab1b-7933-45af-a032-ad325dadee53 req-9ac02594-2e40-47ee-8949-dc62b2569beb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104331 Jul 26 19:44:40.322876 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 216/420] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:40.333359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-488a278b-e6b0-46df-b7fa-ca6c2c877020 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:40.336146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-488a278b-e6b0-46df-b7fa-ca6c2c877020 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:40.354650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-488a278b-e6b0-46df-b7fa-ca6c2c877020 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:40.356638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-488a278b-e6b0-46df-b7fa-ca6c2c877020 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:40.359077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-488a278b-e6b0-46df-b7fa-ca6c2c877020 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:40.360777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-488a278b-e6b0-46df-b7fa-ca6c2c877020 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:40.424594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-488a278b-e6b0-46df-b7fa-ca6c2c877020 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:44:40.566084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:40.576287 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-488a278b-e6b0-46df-b7fa-ca6c2c877020 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "DELETE /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 204 len: 0 microversion: 2.1 time: 0.251142 Jul 26 19:44:40.577512 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 217/421] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:44:40 2022] DELETE /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:44:40.806239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1962117689", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:40.903389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:41.065866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:44:41.066334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:44:41.066882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:44:41.067565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:44:41.068136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:44:41.085911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.092184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.093960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.094418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.126004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Getting quotas for project ef167af0e9dc4c63ba547c2feff9a20f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:41.152355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Getting quotas for user 249cce9c3bae4aa7b78bd6c8c0b7c250 and project ef167af0e9dc4c63ba547c2feff9a20f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:41.203324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:44:41.205168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:44:41.206255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:44:41.206816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:44:41.207627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:44:41.218953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.219592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.220643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.221529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.232007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.utils [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] instances quota exceeded for ef167af0e9dc4c63ba547c2feff9a20f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125964) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 19:44:41.232813 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Request method failure captured: Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 145 Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQgwNiPfopu0yWVhXaGlH4luIXU64fsZ1HXGSoSxpfKTJyrmwLdvUXiHIjW3-oM_tOhaxF6kzSz_BEK14EpJoWl5u_mKkImpsfcnTudTNxis1Rf5fXYr0CuWyh-wFE7Zm4iz7oRui-4BKQAUa4szWO2kpSBgVXIRMDYu-cqUtTtysY Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: ef167af0e9dc4c63ba547c2feff9a20f Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:44:41.237599 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ef167af0e9dc4c63ba547c2feff9a20f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef167af0e9dc4c63ba547c2feff9a20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ef167af0e9dc4c63ba547c2feff9a20f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef167af0e9dc4c63ba547c2feff9a20f"}]}] Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: ef167af0e9dc4c63ba547c2feff9a20f Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-QuotasAdminNegativeTest-1569910287-project Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 249cce9c3bae4aa7b78bd6c8c0b7c250 Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-QuotasAdminNegativeTest-1569910287-project Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2024329627", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} Jul 26 19:44:41.239697 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2024329627', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452'}}} Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 19:44:41.240490 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:41.241676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.243081 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.244715 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:41.244715 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:41.244715 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:41.244715 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:41.244715 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 19:44:41.244715 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.246120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Getting quotas for project aa4bbc1be55b4513a8010a7bc71fbdf5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:41.247498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:41.252660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Getting quotas for user cb09db7f39f24139a8b9a50bb21c4a3d and project aa4bbc1be55b4513a8010a7bc71fbdf5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:41.254924 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-50202de5-4482-4fb9-b8f5-530b74179e30 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.831956 Jul 26 19:44:41.256678 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 205/422] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:39 2022] POST /compute/v2.1/servers => generated 119 bytes in 1835 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:41.270518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:44:41.274675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:44:41.363569 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fcbb98c9-ece9-4c3b-a731-6b4ab44afd0a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783893 Jul 26 19:44:41.365866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 218/423] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:44:41.383192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:41.383593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] [instance: 6565e25a-1a8a-479f-87f9-9666c3cdfbf5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:41.392184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.392996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.399204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f01ff81-e3f4-4661-a5bf-b75336dbc7db tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545 tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:41.400202 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:41.400202 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:44:41.405633 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-5f01ff81-e3f4-4661-a5bf-b75336dbc7db tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545 tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 26 19:44:41.408671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.411204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f01ff81-e3f4-4661-a5bf-b75336dbc7db tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545 tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545-project-admin] Request method failure captured: Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQoAuUMz-vcC-OfeALydzrR32DnMUqOiEyzorxRgY6jF9fujAuSmpjRGUrREcCECW2tAhMQitv-lh4eXMzqP801hQq25UjZQQ7ta4oNuvmLiSlLNmF0JHtktPPEZ8byLQMP0BYbBjx9cvKwZRrO-RGsP3HV_39MonyHyLhzd5jzT_M Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 4af19262040e416ea5c16674d22b9285 Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545 Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:44:41.424711 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4af19262040e416ea5c16674d22b9285"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4af19262040e416ea5c16674d22b9285"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4af19262040e416ea5c16674d22b9285", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4af19262040e416ea5c16674d22b9285"}]}] Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545 Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 4af19262040e416ea5c16674d22b9285 Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545 Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545-project-admin Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: d3d23f939a2b4f80bbdce7aeb9100e7c Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545-project-admin Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:44:41.426307 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid timestamp for date invalid_time Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'invalid_time'} Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:41.427099 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 26 19:44:41.428906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.431528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f01ff81-e3f4-4661-a5bf-b75336dbc7db tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545 tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:41.432817 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f01ff81-e3f4-4661-a5bf-b75336dbc7db tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545 tempest-InstanceUsageAuditLogNegativeTestJSON-1303380545-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.174675 Jul 26 19:44:41.436059 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 206/424] 10.222.0.58 () {58 vars in 1224 bytes} [Tue Jul 26 19:44:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:44:41.474204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-28f59276-9de6-4fcf-ac86-580bb3757e22 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:41.476428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-28f59276-9de6-4fcf-ac86-580bb3757e22 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:41.493496 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] HTTP exception thrown: Instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 could not be found. Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Request method failure captured: Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 HTTP/1.1 Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPrl5NNx9Fw6rH2fdghHNfv7Yz0EMIXbkg03vz3ptTnImSTDSuoF23DtJnf7BRJX8OXoERzL8va1pnX7nWHEt1msJXWVsqDxuXAPeRRcusS9KdMvf6SLvftTerdt1MAIVVUXhsHbWZXUApwbcJM9P4XDylmATc92mPp-2pZg0lIFwE Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a019aea2aed240728e898c76739c8fd6 Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-LiveMigrationNegativeTest-717553334 Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:41.502255 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a019aea2aed240728e898c76739c8fd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a019aea2aed240728e898c76739c8fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a019aea2aed240728e898c76739c8fd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a019aea2aed240728e898c76739c8fd6"}]}] Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-LiveMigrationNegativeTest-717553334 Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a019aea2aed240728e898c76739c8fd6 Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-717553334 Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-LiveMigrationNegativeTest-717553334-project Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a84e343311cf4ca1a7ce698490e7578e Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-LiveMigrationNegativeTest-717553334-project Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 could not be found. Jul 26 19:44:41.503841 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6565e25a-1a8a-479f-87f9-9666c3cdfbf5'} Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 could not be found. Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:41.504614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 could not be found. Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 could not be found. Jul 26 19:44:41.505944 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:41.507151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] Returning 404 to user: Instance 6565e25a-1a8a-479f-87f9-9666c3cdfbf5 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:41.507151 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c3ff58a-0538-40d1-bda3-48668620e472 tempest-LiveMigrationNegativeTest-717553334 tempest-LiveMigrationNegativeTest-717553334-project] 10.222.0.58 "GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5" status: 404 len: 111 microversion: 2.1 time: 0.138706 Jul 26 19:44:41.507307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28f59276-9de6-4fcf-ac86-580bb3757e22 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.507832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28f59276-9de6-4fcf-ac86-580bb3757e22 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.508832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28f59276-9de6-4fcf-ac86-580bb3757e22 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.510613 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 219/425] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:41 2022] GET /compute/v2.1/servers/6565e25a-1a8a-479f-87f9-9666c3cdfbf5 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:41.511700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28f59276-9de6-4fcf-ac86-580bb3757e22 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.525157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f8d3d043-943c-4d94-ae3f-06dc438c2865 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:41.531072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f8d3d043-943c-4d94-ae3f-06dc438c2865 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:41.559524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8d3d043-943c-4d94-ae3f-06dc438c2865 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.563599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8d3d043-943c-4d94-ae3f-06dc438c2865 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.565078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8d3d043-943c-4d94-ae3f-06dc438c2865 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:41.568129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8d3d043-943c-4d94-ae3f-06dc438c2865 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:41.929917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f8d3d043-943c-4d94-ae3f-06dc438c2865 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:41.946593 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f8d3d043-943c-4d94-ae3f-06dc438c2865 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1321 microversion: 2.1 time: 0.433428 Jul 26 19:44:41.950571 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 220/426] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:41 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:41.968211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eedd0365-40db-4106-8a4f-5d7f8f57fa84 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Action: 'update', calling method: .version_select at 0x7f876415a820>, body: {"quota_set": {"instances": 10}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:42.219127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eedd0365-40db-4106-8a4f-5d7f8f57fa84 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:42.221123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eedd0365-40db-4106-8a4f-5d7f8f57fa84 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:42.247895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eedd0365-40db-4106-8a4f-5d7f8f57fa84 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:42.249251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eedd0365-40db-4106-8a4f-5d7f8f57fa84 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:42.446057 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eedd0365-40db-4106-8a4f-5d7f8f57fa84 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 329 microversion: 2.1 time: 0.497537 Jul 26 19:44:42.455090 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 221/427] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:44:41 2022] PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 329 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:42.662956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-28f59276-9de6-4fcf-ac86-580bb3757e22 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:42.671771 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-28f59276-9de6-4fcf-ac86-580bb3757e22 tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1475 microversion: 2.1 time: 1.233253 Jul 26 19:44:42.677069 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 207/428] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:41 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1475 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:42.691731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-238863402", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:42.826383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:42.953500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f76a0b76-d1ba-4404-a6e2-bc2d5d3dd7b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:42.954365 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:42.954365 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:42.956108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f76a0b76-d1ba-4404-a6e2-bc2d5d3dd7b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '4817d356edb34e198338fa5dd64d2142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d6e9120aff43418447da500849d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f76a0b76-d1ba-4404-a6e2-bc2d5d3dd7b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] Request method failure captured: Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQmbijKjueYZYZ0BhJgiYWTIgcH7hHrhdga_gU7NZLsfZcLdU6uXsbZj4LdrPQDAfwdAqfidJ2SnAlqb-_6_cAJssEhbTv_D4cC6eDsDdtSUkk3lgfYGgCnE-bqOr5gTGAGxNryZUWihDd2lwSoIzaqRKvDfPmxp_9AEypW-wbIXdk Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 91d6e9120aff43418447da500849d47a Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:42.960217 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/91d6e9120aff43418447da500849d47a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91d6e9120aff43418447da500849d47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_91d6e9120aff43418447da500849d47a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91d6e9120aff43418447da500849d47a"}]}] Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 91d6e9120aff43418447da500849d47a Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4817d356edb34e198338fa5dd64d2142 Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:44:42.961779 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: action_args: {} Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:44:42.962605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 19:44:42.965546 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:42.969272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f76a0b76-d1ba-4404-a6e2-bc2d5d3dd7b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:42.970682 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f76a0b76-d1ba-4404-a6e2-bc2d5d3dd7b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.513829 Jul 26 19:44:42.975687 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 222/429] 10.222.0.58 () {58 vars in 1185 bytes} [Tue Jul 26 19:44:42 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 520 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:42.987779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-944f65e1-c27d-4e5a-8e62-6c3d0923738e tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Calling method '.version_select at 0x7f876417fdc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:43.252831 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-944f65e1-c27d-4e5a-8e62-6c3d0923738e tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 371 microversion: 2.1 time: 0.275452 Jul 26 19:44:43.256664 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 223/430] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 19:44:42 2022] GET /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:43.286336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-175623b9-6a9d-4f5e-8393-1b6e0cc06ebc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:43.287369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-175623b9-6a9d-4f5e-8393-1b6e0cc06ebc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:43.306423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-175623b9-6a9d-4f5e-8393-1b6e0cc06ebc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:43.306872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-175623b9-6a9d-4f5e-8393-1b6e0cc06ebc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:43.317397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-175623b9-6a9d-4f5e-8393-1b6e0cc06ebc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:43.318245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-175623b9-6a9d-4f5e-8393-1b6e0cc06ebc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:43.628836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-175623b9-6a9d-4f5e-8393-1b6e0cc06ebc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:43.650770 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-175623b9-6a9d-4f5e-8393-1b6e0cc06ebc tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1319 microversion: 2.1 time: 0.391677 Jul 26 19:44:43.653487 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 224/431] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:43 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:43.666958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae1c0946-f3af-4cf9-bf47-9e63eedfa9d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:43.670505 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:44:43.670505 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:44:43.676643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ae1c0946-f3af-4cf9-bf47-9e63eedfa9d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '4817d356edb34e198338fa5dd64d2142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d6e9120aff43418447da500849d47a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae1c0946-f3af-4cf9-bf47-9e63eedfa9d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] Request method failure captured: Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2019:44:42 HTTP/1.1 Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQmbijKjueYZYZ0BhJgiYWTIgcH7hHrhdga_gU7NZLsfZcLdU6uXsbZj4LdrPQDAfwdAqfidJ2SnAlqb-_6_cAJssEhbTv_D4cC6eDsDdtSUkk3lgfYGgCnE-bqOr5gTGAGxNryZUWihDd2lwSoIzaqRKvDfPmxp_9AEypW-wbIXdk Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 91d6e9120aff43418447da500849d47a Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:43.678856 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/91d6e9120aff43418447da500849d47a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91d6e9120aff43418447da500849d47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_91d6e9120aff43418447da500849d47a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/91d6e9120aff43418447da500849d47a"}]}] Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 91d6e9120aff43418447da500849d47a Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4817d356edb34e198338fa5dd64d2142 Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:44:43.680407 n-d-708768-8 devstack@n-api.service[125963]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '2022-07-26 19:44:42'} Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:44:43.681251 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 19:44:43.682600 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:43.684953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae1c0946-f3af-4cf9-bf47-9e63eedfa9d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:43.687156 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ae1c0946-f3af-4cf9-bf47-9e63eedfa9d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721 tempest-InstanceUsageAuditLogNegativeTestJSON-1096810721-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26 19:44:42" status: 403 len: 128 microversion: 2.1 time: 0.031132 Jul 26 19:44:43.690270 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 225/432] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 19:44:43 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2019%3A44%3A42 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:43.702504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5fcab37-c949-4b28-88f4-9092764ddc8b tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Action: 'update', calling method: .version_select at 0x7f87640cfdc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:43.947478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5fcab37-c949-4b28-88f4-9092764ddc8b tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:43.948454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5fcab37-c949-4b28-88f4-9092764ddc8b tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:43.949742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5fcab37-c949-4b28-88f4-9092764ddc8b tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:43.951498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5fcab37-c949-4b28-88f4-9092764ddc8b tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:44.100506 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5fcab37-c949-4b28-88f4-9092764ddc8b tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 325 microversion: 2.1 time: 0.408692 Jul 26 19:44:44.101545 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 226/433] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:44:43 2022] PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:44.107511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bdb5c106-f41f-4c12-a76c-0c6eec2a046f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:44.108311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bdb5c106-f41f-4c12-a76c-0c6eec2a046f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:44.117089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdb5c106-f41f-4c12-a76c-0c6eec2a046f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:44.117475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdb5c106-f41f-4c12-a76c-0c6eec2a046f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:44.118994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdb5c106-f41f-4c12-a76c-0c6eec2a046f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:44.119539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdb5c106-f41f-4c12-a76c-0c6eec2a046f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:44.922999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bdb5c106-f41f-4c12-a76c-0c6eec2a046f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe5899d4764216a70b102339a74853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e06cee988534593a9af9e773ecc9cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:44.940323 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bdb5c106-f41f-4c12-a76c-0c6eec2a046f tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 200 len: 1475 microversion: 2.1 time: 0.835037 Jul 26 19:44:44.954560 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 227/434] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:44 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 1475 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:44.954560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-94485637-cc79-48db-aa6d-3a015d8fc72a req-e5aef064-34cf-422f-b686-ca5b62f84958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a4a582-0699-43a9-89f9-19b22e0cda22", "name": "network-vif-deleted", "tag": "f7718a1a-4b41-487e-ae8e-fd904b4c47e0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:44.994274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-94485637-cc79-48db-aa6d-3a015d8fc72a req-e5aef064-34cf-422f-b686-ca5b62f84958 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:45.003944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-94485637-cc79-48db-aa6d-3a015d8fc72a req-e5aef064-34cf-422f-b686-ca5b62f84958 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:45.045854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-94485637-cc79-48db-aa6d-3a015d8fc72a req-e5aef064-34cf-422f-b686-ca5b62f84958 service nova] Creating event network-vif-deleted:f7718a1a-4b41-487e-ae8e-fd904b4c47e0 for instance 50a4a582-0699-43a9-89f9-19b22e0cda22 on n-h2-708768-8 Jul 26 19:44:45.069742 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-94485637-cc79-48db-aa6d-3a015d8fc72a req-e5aef064-34cf-422f-b686-ca5b62f84958 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125945 Jul 26 19:44:45.070938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 228/435] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:45.079251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-908008822", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:45.097711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:44:45.099378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:44:45.100045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:44:45.100608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:44:45.101158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:44:45.124261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:45.128986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:45.135304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:45.136024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:45.180162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Getting quotas for project aa4bbc1be55b4513a8010a7bc71fbdf5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:45.198169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Getting quotas for user cb09db7f39f24139a8b9a50bb21c4a3d and project aa4bbc1be55b4513a8010a7bc71fbdf5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:45.229826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:45.251120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:44:45.253502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:44:45.366521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-12ad55a0-560f-456f-98c2-f23b4d02b37a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.685021 Jul 26 19:44:45.372749 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 208/436] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:44:45.386279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74e73d45-b3ae-4521-8938-7ad623a1a4f3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:45.386895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74e73d45-b3ae-4521-8938-7ad623a1a4f3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:45.413606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74e73d45-b3ae-4521-8938-7ad623a1a4f3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:45.414321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74e73d45-b3ae-4521-8938-7ad623a1a4f3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:45.415449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74e73d45-b3ae-4521-8938-7ad623a1a4f3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:45.416836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74e73d45-b3ae-4521-8938-7ad623a1a4f3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:45.944289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:44:45.947720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:44:45.948474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:44:45.949102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:44:45.951194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:44:45.965713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:45.968346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:45.969488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:45.970173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:46.004205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Getting quotas for project ef167af0e9dc4c63ba547c2feff9a20f. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:46.015320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Getting quotas for user 249cce9c3bae4aa7b78bd6c8c0b7c250 and project ef167af0e9dc4c63ba547c2feff9a20f. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:46.057727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.utils [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] ram quota exceeded for ef167af0e9dc4c63ba547c2feff9a20f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125963) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 19:44:46.062276 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Request method failure captured: Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 144 Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQgwNiPfopu0yWVhXaGlH4luIXU64fsZ1HXGSoSxpfKTJyrmwLdvUXiHIjW3-oM_tOhaxF6kzSz_BEK14EpJoWl5u_mKkImpsfcnTudTNxis1Rf5fXYr0CuWyh-wFE7Zm4iz7oRui-4BKQAUa4szWO2kpSBgVXIRMDYu-cqUtTtysY Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: ef167af0e9dc4c63ba547c2feff9a20f Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:46.068005 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ef167af0e9dc4c63ba547c2feff9a20f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef167af0e9dc4c63ba547c2feff9a20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ef167af0e9dc4c63ba547c2feff9a20f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef167af0e9dc4c63ba547c2feff9a20f"}]}] Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: ef167af0e9dc4c63ba547c2feff9a20f Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-QuotasAdminNegativeTest-1569910287-project Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 249cce9c3bae4aa7b78bd6c8c0b7c250 Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-QuotasAdminNegativeTest-1569910287-project Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-908008822", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} Jul 26 19:44:46.069403 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-908008822', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452'}}} Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 19:44:46.070265 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:46.071356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.076284 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:46.079393 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:46.079393 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:46.079393 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:46.079393 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:46.079393 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 19:44:46.079393 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.081881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:46.083649 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d286e118-28d7-450c-900b-d4ca04e5a2dd tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.011080 Jul 26 19:44:46.085050 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 229/437] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 1013 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:46.093174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8fd90b8d-4319-4466-9c5d-33ac6ef0af52 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:46.094812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8fd90b8d-4319-4466-9c5d-33ac6ef0af52 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:46.448307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8fd90b8d-4319-4466-9c5d-33ac6ef0af52 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:46.465747 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8fd90b8d-4319-4466-9c5d-33ac6ef0af52 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1213 microversion: 2.1 time: 0.379203 Jul 26 19:44:46.478959 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 230/438] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:46 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1213 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:46.493915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-854014c2-9627-44c2-9acd-091d60fbac40 req-4b401dd8-4e0f-43a8-9fe5-33e92f2618d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d463e8-9f7a-47e3-abed-dedba2bd9cca", "name": "network-vif-deleted", "tag": "0f4e85ea-e190-40a8-bd6a-bf5e24493288"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:46.532627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-854014c2-9627-44c2-9acd-091d60fbac40 req-4b401dd8-4e0f-43a8-9fe5-33e92f2618d7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:46.533874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-854014c2-9627-44c2-9acd-091d60fbac40 req-4b401dd8-4e0f-43a8-9fe5-33e92f2618d7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:46.570739 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-854014c2-9627-44c2-9acd-091d60fbac40 req-4b401dd8-4e0f-43a8-9fe5-33e92f2618d7 service nova] Creating event network-vif-deleted:0f4e85ea-e190-40a8-bd6a-bf5e24493288 for instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca on n-h1-708768-8 Jul 26 19:44:46.578412 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-854014c2-9627-44c2-9acd-091d60fbac40 req-4b401dd8-4e0f-43a8-9fe5-33e92f2618d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109135 Jul 26 19:44:46.585412 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 231/439] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:46.593871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:46.594578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] [instance: 49d463e8-9f7a-47e3-abed-dedba2bd9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:46.602134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:46.602885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:46.603946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:46.604510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:46.615432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:46.646995 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] HTTP exception thrown: Instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca could not be found. Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Request method failure captured: Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca HTTP/1.1 Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQT81cJjGgdOWP811x_ZV6PycW32Njbb0o8G-1AKStQgOCJaFITus1npsIedZLZitBEd-9ZG7HblMgNwEL6Dz458Q5mMZMkv9_5UiZ8-InNdjTgPLNaHzV50-YNMuFWUldxMBjT9NmX4pPB56IpgoEwcDWof8Z6tYXp_M3ILCBsHLk Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 3e06cee988534593a9af9e773ecc9cc2 Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1423377013 Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:44:46.650203 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e06cee988534593a9af9e773ecc9cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e06cee988534593a9af9e773ecc9cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e06cee988534593a9af9e773ecc9cc2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e06cee988534593a9af9e773ecc9cc2"}]}] Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1423377013 Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 3e06cee988534593a9af9e773ecc9cc2 Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1423377013 Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiagnosticsNegativeTest-1423377013-project Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c6fe5899d4764216a70b102339a74853 Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1423377013-project Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca could not be found. Jul 26 19:44:46.651513 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '49d463e8-9f7a-47e3-abed-dedba2bd9cca'} Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca could not be found. Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:46.652399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca could not be found. Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca could not be found. Jul 26 19:44:46.653576 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:44:46.658979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] Returning 404 to user: Instance 49d463e8-9f7a-47e3-abed-dedba2bd9cca could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:46.660267 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-678c7474-edb0-47bd-8820-462c501e21ed tempest-ServerDiagnosticsNegativeTest-1423377013 tempest-ServerDiagnosticsNegativeTest-1423377013-project] 10.222.0.58 "GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca" status: 404 len: 111 microversion: 2.1 time: 0.079940 Jul 26 19:44:46.669481 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 232/440] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:46 2022] GET /compute/v2.1/servers/49d463e8-9f7a-47e3-abed-dedba2bd9cca => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:46.701392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-595e1f69-a86b-4d09-9abd-3b9cb30352d8 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Action: 'update', calling method: .version_select at 0x7f876413b280>, body: {"quota_set": {"ram": 51200}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:46.861391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-74e73d45-b3ae-4521-8938-7ad623a1a4f3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:46.899728 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74e73d45-b3ae-4521-8938-7ad623a1a4f3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1386 microversion: 2.1 time: 1.522021 Jul 26 19:44:46.906620 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 209/441] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:45 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1386 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:47.488052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6e08ba63-c2e5-408f-b1b6-1380b65156a8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:47.489492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6e08ba63-c2e5-408f-b1b6-1380b65156a8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:47.505222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e08ba63-c2e5-408f-b1b6-1380b65156a8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:47.509254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e08ba63-c2e5-408f-b1b6-1380b65156a8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:47.516628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e08ba63-c2e5-408f-b1b6-1380b65156a8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:47.518422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e08ba63-c2e5-408f-b1b6-1380b65156a8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:47.663936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-595e1f69-a86b-4d09-9abd-3b9cb30352d8 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:47.665325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-595e1f69-a86b-4d09-9abd-3b9cb30352d8 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:47.667731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-595e1f69-a86b-4d09-9abd-3b9cb30352d8 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:47.668976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-595e1f69-a86b-4d09-9abd-3b9cb30352d8 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:47.958900 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-595e1f69-a86b-4d09-9abd-3b9cb30352d8 tempest-QuotasAdminNegativeTest-182280130 tempest-QuotasAdminNegativeTest-182280130-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 200 len: 329 microversion: 2.1 time: 1.277649 Jul 26 19:44:47.961255 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 233/442] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:44:46 2022] PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 329 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:47.969144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d0411e88-0117-469f-ab24-71c38c4b7b85 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:47.971566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d0411e88-0117-469f-ab24-71c38c4b7b85 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:47.995795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:48.006956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0411e88-0117-469f-ab24-71c38c4b7b85 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:48.012358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0411e88-0117-469f-ab24-71c38c4b7b85 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:48.015677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0411e88-0117-469f-ab24-71c38c4b7b85 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:48.016497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0411e88-0117-469f-ab24-71c38c4b7b85 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:48.061924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6e08ba63-c2e5-408f-b1b6-1380b65156a8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:48.076610 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6e08ba63-c2e5-408f-b1b6-1380b65156a8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1209 microversion: 2.1 time: 0.587180 Jul 26 19:44:48.091150 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 210/443] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:47 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1209 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:48.110439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a6e6470-7469-4372-9199-912a08abbf93 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Action: 'update', calling method: .version_select at 0x7f87575db310>, body: {"quota_set": {"ram": 0}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:48.142052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a6e6470-7469-4372-9199-912a08abbf93 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '249cce9c3bae4aa7b78bd6c8c0b7c250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef167af0e9dc4c63ba547c2feff9a20f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a6e6470-7469-4372-9199-912a08abbf93 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Request method failure captured: Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f HTTP/1.1 Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 25 Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQgwNiPfopu0yWVhXaGlH4luIXU64fsZ1HXGSoSxpfKTJyrmwLdvUXiHIjW3-oM_tOhaxF6kzSz_BEK14EpJoWl5u_mKkImpsfcnTudTNxis1Rf5fXYr0CuWyh-wFE7Zm4iz7oRui-4BKQAUa4szWO2kpSBgVXIRMDYu-cqUtTtysY Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: ef167af0e9dc4c63ba547c2feff9a20f Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:44:48.162301 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ef167af0e9dc4c63ba547c2feff9a20f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef167af0e9dc4c63ba547c2feff9a20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ef167af0e9dc4c63ba547c2feff9a20f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ef167af0e9dc4c63ba547c2feff9a20f"}]}] Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: ef167af0e9dc4c63ba547c2feff9a20f Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1569910287 Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-QuotasAdminNegativeTest-1569910287-project Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 249cce9c3bae4aa7b78bd6c8c0b7c250 Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-QuotasAdminNegativeTest-1569910287-project Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: {"quota_set": {"ram": 0}} Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 19:44:48.163649 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ef167af0e9dc4c63ba547c2feff9a20f', 'body': {'quota_set': {'ram': 0}}} Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:44:48.164557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:48.165668 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:44:48.166853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:44:48.166853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:44:48.166853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:44:48.166853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:44:48.166853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 19:44:48.166853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:44:48.166853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a6e6470-7469-4372-9199-912a08abbf93 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:44:48.172439 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a6e6470-7469-4372-9199-912a08abbf93 tempest-QuotasAdminNegativeTest-1569910287 tempest-QuotasAdminNegativeTest-1569910287-project] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f" status: 403 len: 116 microversion: 2.1 time: 0.081408 Jul 26 19:44:48.183690 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 211/444] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:44:48 2022] PUT /compute/v2.1/os-quota-sets/ef167af0e9dc4c63ba547c2feff9a20f => generated 116 bytes in 105 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:44:49.100014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dc09929a-41b4-4a25-81d4-f0542cc80d37 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:49.100794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dc09929a-41b4-4a25-81d4-f0542cc80d37 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:49.128201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc09929a-41b4-4a25-81d4-f0542cc80d37 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:49.131868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc09929a-41b4-4a25-81d4-f0542cc80d37 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:49.140559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc09929a-41b4-4a25-81d4-f0542cc80d37 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:49.143934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc09929a-41b4-4a25-81d4-f0542cc80d37 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:49.381698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d0411e88-0117-469f-ab24-71c38c4b7b85 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:49.394515 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d0411e88-0117-469f-ab24-71c38c4b7b85 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1386 microversion: 2.1 time: 1.430782 Jul 26 19:44:49.395125 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 234/445] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:47 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1386 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:49.430683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c117bca9-cc13-4df6-9ec7-0ed4d226b1f5 req-97da636f-c5b8-4878-8d08-cd0a7c8f93f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091be344-7214-4348-bfc5-f6189853bc9f", "tag": "c766a17e-7fca-4fdb-9ff8-b81a156f4a06"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:49.501197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c117bca9-cc13-4df6-9ec7-0ed4d226b1f5 req-97da636f-c5b8-4878-8d08-cd0a7c8f93f7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:49.502430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c117bca9-cc13-4df6-9ec7-0ed4d226b1f5 req-97da636f-c5b8-4878-8d08-cd0a7c8f93f7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:49.528530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c117bca9-cc13-4df6-9ec7-0ed4d226b1f5 req-97da636f-c5b8-4878-8d08-cd0a7c8f93f7 service nova] Creating event network-changed:c766a17e-7fca-4fdb-9ff8-b81a156f4a06 for instance 091be344-7214-4348-bfc5-f6189853bc9f on n-h2-708768-8 Jul 26 19:44:49.538007 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c117bca9-cc13-4df6-9ec7-0ed4d226b1f5 req-97da636f-c5b8-4878-8d08-cd0a7c8f93f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127841 Jul 26 19:44:49.541732 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 235/446] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:49.777351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dc09929a-41b4-4a25-81d4-f0542cc80d37 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:49.789705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dc09929a-41b4-4a25-81d4-f0542cc80d37 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1271 microversion: 2.1 time: 0.694277 Jul 26 19:44:49.794098 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 212/447] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:49 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1271 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:50.429833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ff3a380-92b7-42de-ade4-0b5be26c9491 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:50.432161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ff3a380-92b7-42de-ade4-0b5be26c9491 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:50.453211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ff3a380-92b7-42de-ade4-0b5be26c9491 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:50.453663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ff3a380-92b7-42de-ade4-0b5be26c9491 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:50.455360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ff3a380-92b7-42de-ade4-0b5be26c9491 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:50.456045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ff3a380-92b7-42de-ade4-0b5be26c9491 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:50.819301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-027589db-13de-4d73-8efb-b984e920d7b5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:50.819752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-027589db-13de-4d73-8efb-b984e920d7b5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:50.830188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-027589db-13de-4d73-8efb-b984e920d7b5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:50.830874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-027589db-13de-4d73-8efb-b984e920d7b5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:50.831689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-027589db-13de-4d73-8efb-b984e920d7b5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:50.832132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-027589db-13de-4d73-8efb-b984e920d7b5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:50.864775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9ff3a380-92b7-42de-ade4-0b5be26c9491 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:50.880580 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ff3a380-92b7-42de-ade4-0b5be26c9491 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1386 microversion: 2.1 time: 0.456291 Jul 26 19:44:50.881488 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 236/448] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:50 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1386 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:51.569176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-027589db-13de-4d73-8efb-b984e920d7b5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:51.585785 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-027589db-13de-4d73-8efb-b984e920d7b5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1271 microversion: 2.1 time: 0.771946 Jul 26 19:44:51.588196 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 213/449] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:50 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1271 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:51.903921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0d0cb96e-f720-41ed-b073-62a90634e62f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:51.905120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0d0cb96e-f720-41ed-b073-62a90634e62f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:51.918933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d0cb96e-f720-41ed-b073-62a90634e62f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:51.919983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d0cb96e-f720-41ed-b073-62a90634e62f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:51.921935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d0cb96e-f720-41ed-b073-62a90634e62f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:51.924021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d0cb96e-f720-41ed-b073-62a90634e62f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:52.334381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0d0cb96e-f720-41ed-b073-62a90634e62f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:52.373196 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0d0cb96e-f720-41ed-b073-62a90634e62f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1386 microversion: 2.1 time: 0.471342 Jul 26 19:44:52.393445 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 237/450] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:51 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1386 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:52.611213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de105ee0-fddd-4a3e-a39e-ddcf1416eba5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:52.623736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de105ee0-fddd-4a3e-a39e-ddcf1416eba5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:52.694611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de105ee0-fddd-4a3e-a39e-ddcf1416eba5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:52.695069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de105ee0-fddd-4a3e-a39e-ddcf1416eba5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:52.726922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de105ee0-fddd-4a3e-a39e-ddcf1416eba5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:52.731000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de105ee0-fddd-4a3e-a39e-ddcf1416eba5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:53.405148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a1c8fba-040c-4b37-a017-4ea2181ad161 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:53.405846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a1c8fba-040c-4b37-a017-4ea2181ad161 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:53.418150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fba-040c-4b37-a017-4ea2181ad161 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:53.418662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fba-040c-4b37-a017-4ea2181ad161 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:53.425906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fba-040c-4b37-a017-4ea2181ad161 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:53.430340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a1c8fba-040c-4b37-a017-4ea2181ad161 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:53.792289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a1c8fba-040c-4b37-a017-4ea2181ad161 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:53.802803 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a1c8fba-040c-4b37-a017-4ea2181ad161 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1386 microversion: 2.1 time: 0.405337 Jul 26 19:44:53.804448 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 238/451] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:53 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1386 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:53.904060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-de105ee0-fddd-4a3e-a39e-ddcf1416eba5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:53.924335 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de105ee0-fddd-4a3e-a39e-ddcf1416eba5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 1.315272 Jul 26 19:44:53.940721 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 214/452] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:52 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:54.536714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-fb37d65f-e1b4-499a-a02e-5ac1fbc6a139 req-ff00fada-f3e9-4cec-b55f-696699e6e101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e71b9a-35b2-4a19-af94-4917b75573bb", "tag": "598edcf8-27c7-440a-9784-4e95c216149d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:54.573952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fb37d65f-e1b4-499a-a02e-5ac1fbc6a139 req-ff00fada-f3e9-4cec-b55f-696699e6e101 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:54.574909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fb37d65f-e1b4-499a-a02e-5ac1fbc6a139 req-ff00fada-f3e9-4cec-b55f-696699e6e101 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:54.612312 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-fb37d65f-e1b4-499a-a02e-5ac1fbc6a139 req-ff00fada-f3e9-4cec-b55f-696699e6e101 service nova] Creating event network-changed:598edcf8-27c7-440a-9784-4e95c216149d for instance 21e71b9a-35b2-4a19-af94-4917b75573bb on n-h1-708768-8 Jul 26 19:44:54.624795 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-fb37d65f-e1b4-499a-a02e-5ac1fbc6a139 req-ff00fada-f3e9-4cec-b55f-696699e6e101 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092820 Jul 26 19:44:54.631008 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 239/453] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:54.827041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dfd0d6cd-bc9a-40ca-a1ed-cb086d351833 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:54.827696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dfd0d6cd-bc9a-40ca-a1ed-cb086d351833 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:54.845467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dfd0d6cd-bc9a-40ca-a1ed-cb086d351833 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:54.847239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dfd0d6cd-bc9a-40ca-a1ed-cb086d351833 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:54.851121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dfd0d6cd-bc9a-40ca-a1ed-cb086d351833 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:54.852329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dfd0d6cd-bc9a-40ca-a1ed-cb086d351833 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:54.946679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54dde93f-e6dd-493e-98bc-8bff78748af5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:54.947393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54dde93f-e6dd-493e-98bc-8bff78748af5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:54.956691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54dde93f-e6dd-493e-98bc-8bff78748af5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:54.957741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54dde93f-e6dd-493e-98bc-8bff78748af5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:54.958690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54dde93f-e6dd-493e-98bc-8bff78748af5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:54.959130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54dde93f-e6dd-493e-98bc-8bff78748af5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:55.163985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=21 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:55.235509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=44 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:55.252892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-54dde93f-e6dd-493e-98bc-8bff78748af5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:55.267520 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54dde93f-e6dd-493e-98bc-8bff78748af5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 0.321064 Jul 26 19:44:55.293246 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 240/454] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:54 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:55.781962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dfd0d6cd-bc9a-40ca-a1ed-cb086d351833 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:55.812091 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dfd0d6cd-bc9a-40ca-a1ed-cb086d351833 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1386 microversion: 2.1 time: 0.986152 Jul 26 19:44:55.814357 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 215/455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:54 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1386 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:56.291346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-874952b9-f4ea-40a8-b809-80bb939ece53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:56.291873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-874952b9-f4ea-40a8-b809-80bb939ece53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:56.323061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-874952b9-f4ea-40a8-b809-80bb939ece53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:56.327070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-874952b9-f4ea-40a8-b809-80bb939ece53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:56.328484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-874952b9-f4ea-40a8-b809-80bb939ece53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:56.331035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-874952b9-f4ea-40a8-b809-80bb939ece53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:56.536548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-aafad9d3-5d9a-4534-8120-2d9369773ce7 req-d046564a-d470-41f8-a7a6-afacb5ff7c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091be344-7214-4348-bfc5-f6189853bc9f", "name": "network-vif-plugged", "status": "completed", "tag": "c766a17e-7fca-4fdb-9ff8-b81a156f4a06"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:56.584659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-aafad9d3-5d9a-4534-8120-2d9369773ce7 req-d046564a-d470-41f8-a7a6-afacb5ff7c8e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:56.589265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-aafad9d3-5d9a-4534-8120-2d9369773ce7 req-d046564a-d470-41f8-a7a6-afacb5ff7c8e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:56.649208 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-aafad9d3-5d9a-4534-8120-2d9369773ce7 req-d046564a-d470-41f8-a7a6-afacb5ff7c8e service nova] Creating event network-vif-plugged:c766a17e-7fca-4fdb-9ff8-b81a156f4a06 for instance 091be344-7214-4348-bfc5-f6189853bc9f on n-h2-708768-8 Jul 26 19:44:56.660269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-aafad9d3-5d9a-4534-8120-2d9369773ce7 req-d046564a-d470-41f8-a7a6-afacb5ff7c8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129849 Jul 26 19:44:56.664420 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 216/456] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:44:56.835450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26f6d266-20d5-4ad1-b47e-bc438ed1a438 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:56.837945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-26f6d266-20d5-4ad1-b47e-bc438ed1a438 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:56.852736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26f6d266-20d5-4ad1-b47e-bc438ed1a438 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:56.854703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26f6d266-20d5-4ad1-b47e-bc438ed1a438 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:56.856627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26f6d266-20d5-4ad1-b47e-bc438ed1a438 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:56.858142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26f6d266-20d5-4ad1-b47e-bc438ed1a438 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:57.160399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-874952b9-f4ea-40a8-b809-80bb939ece53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:57.171900 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-874952b9-f4ea-40a8-b809-80bb939ece53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 0.885582 Jul 26 19:44:57.174977 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 241/457] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:56 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:57.189641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-52fcaf2a-8920-475a-8d49-8517ae014ae6 req-409ce077-dfd7-4ec3-8e12-ca1d8faf009d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7", "tag": "74ed0b59-4c6e-42f4-b1fd-f295f3338802"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:57.213725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-52fcaf2a-8920-475a-8d49-8517ae014ae6 req-409ce077-dfd7-4ec3-8e12-ca1d8faf009d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:57.214569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-52fcaf2a-8920-475a-8d49-8517ae014ae6 req-409ce077-dfd7-4ec3-8e12-ca1d8faf009d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:57.242010 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-52fcaf2a-8920-475a-8d49-8517ae014ae6 req-409ce077-dfd7-4ec3-8e12-ca1d8faf009d service nova] Creating event network-changed:74ed0b59-4c6e-42f4-b1fd-f295f3338802 for instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 on n-h2-708768-8 Jul 26 19:44:57.256122 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-52fcaf2a-8920-475a-8d49-8517ae014ae6 req-409ce077-dfd7-4ec3-8e12-ca1d8faf009d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076630 Jul 26 19:44:57.259219 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 242/458] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:44:57.820543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-26f6d266-20d5-4ad1-b47e-bc438ed1a438 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:57.834467 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-26f6d266-20d5-4ad1-b47e-bc438ed1a438 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1386 microversion: 2.1 time: 1.004934 Jul 26 19:44:57.835687 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 217/459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:56 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1386 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:44:58.004885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:58.007815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=50 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:44:58.658052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1366899409", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:58.662659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-74aaff61-a6b6-40da-9129-00d4362f09c8 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Action: 'create', calling method: .version_select at 0x7f87641e4700>, body: {"keypair": {"name": "tempest-keypair-190804423", "type": "ssh", "user_id": "c016c7480afd436ea151b9f64e92551f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdrKNSie1eVYCY/weQYIKcL9uLU6Uc5oee2B+QBtLbnDlvrmgGLUf7Knn9qfJeHIzuq/HavFZjfH20ZAHX+bwRMeC+chdO2KFWk8qEx/pNgmCNl3MO83HaS5VJhCMbcOQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:58.716865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-74aaff61-a6b6-40da-9129-00d4362f09c8 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Getting quotas for project 7200c65ccf23461ebfa67bd299bbe829. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:58.722737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-74aaff61-a6b6-40da-9129-00d4362f09c8 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Getting quotas for user a57a3d82685c40f6bbc835aaac8b4392 and project 7200c65ccf23461ebfa67bd299bbe829. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:58.760925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:44:58.769956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-74aaff61-a6b6-40da-9129-00d4362f09c8 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.770907 Jul 26 19:44:58.786329 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 243/460] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 19:44:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 788 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 19:44:58.791764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7972fb71-552e-41fb-98d4-03cd98f7a3da tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:58.810030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7972fb71-552e-41fb-98d4-03cd98f7a3da tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:58.827583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7972fb71-552e-41fb-98d4-03cd98f7a3da tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:58.831735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7972fb71-552e-41fb-98d4-03cd98f7a3da tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:58.832733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7972fb71-552e-41fb-98d4-03cd98f7a3da tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:58.833704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7972fb71-552e-41fb-98d4-03cd98f7a3da tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:59.162259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7972fb71-552e-41fb-98d4-03cd98f7a3da tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:59.180004 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7972fb71-552e-41fb-98d4-03cd98f7a3da tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 0.387006 Jul 26 19:44:59.181012 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 244/461] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:58 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:59.186879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31a25dfa-d5f8-4838-af73-82fd32881f55 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Action: 'create', calling method: .version_select at 0x7f876415a940>, body: {"keypair": {"name": "tempest-keypair-1873305331", "type": "ssh", "user_id": "c016c7480afd436ea151b9f64e92551f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+Y2f6fDKiojAK/5n4o01O4dkTR3j+6MoSPcElvr1j5Zt8nhjd0eKrn8QTs7paRcf7B+D584QCD7MuIh8acUm6WO4xngTrN72bPAFAo3Zo1TbZuY8gfEqJTVW5/M27prg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:44:59.211282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-31a25dfa-d5f8-4838-af73-82fd32881f55 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Getting quotas for project 7200c65ccf23461ebfa67bd299bbe829. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:44:59.221051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-31a25dfa-d5f8-4838-af73-82fd32881f55 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Getting quotas for user a57a3d82685c40f6bbc835aaac8b4392 and project 7200c65ccf23461ebfa67bd299bbe829. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:44:59.296625 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31a25dfa-d5f8-4838-af73-82fd32881f55 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.114024 Jul 26 19:44:59.299071 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 245/462] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 19:44:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 19:44:59.312617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b5458575-647c-4537-9904-9e1a164f59f9 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:59.315269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b5458575-647c-4537-9904-9e1a164f59f9 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:59.327975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5458575-647c-4537-9904-9e1a164f59f9 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:59.329179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5458575-647c-4537-9904-9e1a164f59f9 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:59.330946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5458575-647c-4537-9904-9e1a164f59f9 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:59.332111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5458575-647c-4537-9904-9e1a164f59f9 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:59.769656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5458575-647c-4537-9904-9e1a164f59f9 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:44:59.780320 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b5458575-647c-4537-9904-9e1a164f59f9 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1585 microversion: 2.1 time: 0.479632 Jul 26 19:44:59.789060 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 246/463] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:44:59 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1585 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:44:59.808137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2e63aa8-4187-47a4-bee4-0f1b9927bff0 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Calling method '.version_select at 0x7f876405be50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:59.825471 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2e63aa8-4187-47a4-bee4-0f1b9927bff0 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-190804423?user_id=c016c7480afd436ea151b9f64e92551f" status: 200 len: 511 microversion: 2.10 time: 0.034750 Jul 26 19:44:59.826278 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 247/464] 10.222.0.58 () {60 vars in 1337 bytes} [Tue Jul 26 19:44:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-190804423?user_id=c016c7480afd436ea151b9f64e92551f => generated 511 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:44:59.833190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc5513f3-0de9-4c7a-8843-cbdd10991224 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:44:59.833696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc5513f3-0de9-4c7a-8843-cbdd10991224 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:44:59.845724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc5513f3-0de9-4c7a-8843-cbdd10991224 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:59.846185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc5513f3-0de9-4c7a-8843-cbdd10991224 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:44:59.847013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc5513f3-0de9-4c7a-8843-cbdd10991224 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:44:59.847452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc5513f3-0de9-4c7a-8843-cbdd10991224 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:00.055466 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc5513f3-0de9-4c7a-8843-cbdd10991224 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.228060 Jul 26 19:45:00.056367 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 248/465] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:44:59 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:00.064655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c11b2fa-502a-4517-a87e-97eca55fd966 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Action: 'create', calling method: .version_select at 0x7f876413b160>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1882561415", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgaHg1DVUU7Onx33fx1a2fc+BWR23gslzu97FZhH9oui4PxQ83U5tgxqj+ewhMxdjFnOaTtofnRwln0riLti22HxIAnhZyCu+aMc4ttD+ul5wXN8X/sSymWhkv6qla6ew=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:00.076587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:00.077878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:00.078568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:00.079187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:00.079896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:00.111270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:00.118008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:00.120527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:00.125480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:00.166040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8c11b2fa-502a-4517-a87e-97eca55fd966 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Getting quotas for project 7200c65ccf23461ebfa67bd299bbe829. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:00.188728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8c11b2fa-502a-4517-a87e-97eca55fd966 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Getting quotas for user a57a3d82685c40f6bbc835aaac8b4392 and project 7200c65ccf23461ebfa67bd299bbe829. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:00.212353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:00.235208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:00.270536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c11b2fa-502a-4517-a87e-97eca55fd966 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.212708 Jul 26 19:45:00.274160 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 249/466] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 19:45:00 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 19:45:00.279522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:00.282206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:00.285010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5825bcf-aa37-4f37-900e-9b553bf9e72a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:00.296492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5825bcf-aa37-4f37-900e-9b553bf9e72a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:00.308581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5825bcf-aa37-4f37-900e-9b553bf9e72a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:00.310071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5825bcf-aa37-4f37-900e-9b553bf9e72a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:00.312667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5825bcf-aa37-4f37-900e-9b553bf9e72a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:00.313383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5825bcf-aa37-4f37-900e-9b553bf9e72a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:00.384146 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7fb0d381-b124-4d6f-8aed-3a1c6bafb962 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202602 Jul 26 19:45:00.394108 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 218/467] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:45:00.967460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1646299943", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:01.112401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:01.212180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f5825bcf-aa37-4f37-900e-9b553bf9e72a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:01.222009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5825bcf-aa37-4f37-900e-9b553bf9e72a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 0.946504 Jul 26 19:45:01.225836 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 250/468] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:00 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:01.244918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-05375640-b587-4c06-9a51-bdef6a1e6955 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Calling method '.version_select at 0x7f87641e4310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:01.257733 n-d-708768-8 devstack@n-api.service[125963]: WARNING oslo_db.sqlalchemy.utils [None req-05375640-b587-4c06-9a51-bdef6a1e6955 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 19:45:01.280296 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-05375640-b587-4c06-9a51-bdef6a1e6955 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs?user_id=c016c7480afd436ea151b9f64e92551f" status: 200 len: 725 microversion: 2.10 time: 0.053182 Jul 26 19:45:01.285042 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 251/469] 10.222.0.58 () {60 vars in 1259 bytes} [Tue Jul 26 19:45:01 2022] GET /compute/v2.1/os-keypairs?user_id=c016c7480afd436ea151b9f64e92551f => generated 725 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:45:01.297600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f54331b6-d4bc-44a0-b03d-ef4fef7adcde tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:01.298740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f54331b6-d4bc-44a0-b03d-ef4fef7adcde tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:01.414794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f54331b6-d4bc-44a0-b03d-ef4fef7adcde tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:01.422739 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f54331b6-d4bc-44a0-b03d-ef4fef7adcde tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1217 microversion: 2.1 time: 0.136200 Jul 26 19:45:01.425872 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 252/470] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:01 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:02.066647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8e62ae9-eac7-4684-9c72-46e5829a9648 tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] Action: 'create', calling method: .version_select at 0x7f876405b9d0>, body: {"security_group": {"name": "tempest-securitygroup-1356985693", "description": "tempest-description-367682429"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:02.243504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:02.244520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:02.245899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:02.246530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:02.247820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:02.268680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:02.269409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:02.272233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:02.275882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:02.319711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Getting quotas for project b48045503d694e099175d17a83f0d4fa. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:02.334350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Getting quotas for user 9c4a54c0a0134fd0b636ff057c200b61 and project b48045503d694e099175d17a83f0d4fa. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:02.371814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:02.375268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:02.521036 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38c30e6e-4836-414a-9b6a-7c0aa294df7a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.123094 Jul 26 19:45:02.525234 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 219/471] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:45:02.547016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5a6ebc6-8ea1-42ae-bd67-74838f7cca5d tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Calling method '.version_select at 0x7f87575db4c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:02.612997 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5a6ebc6-8ea1-42ae-bd67-74838f7cca5d tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1882561415" status: 204 len: 0 microversion: 2.10 time: 0.085088 Jul 26 19:45:02.614373 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 220/472] 10.222.0.58 () {60 vars in 1325 bytes} [Tue Jul 26 19:45:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1882561415 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:45:02.739043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1414716115", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "90a80e65-c3c4-4058-b8fa-aa7f6384a3b0"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:02.831853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] validate_networks() for [('90a80e65-c3c4-4058-b8fa-aa7f6384a3b0', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:03.695418 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8e62ae9-eac7-4684-9c72-46e5829a9648 tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.263233 Jul 26 19:45:03.696231 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 253/473] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:45:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:03.701069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa2fac4a-7413-4dde-84dc-97072a34165d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:03.701675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fa2fac4a-7413-4dde-84dc-97072a34165d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:03.719723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa2fac4a-7413-4dde-84dc-97072a34165d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:03.719835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa2fac4a-7413-4dde-84dc-97072a34165d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:03.743901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa2fac4a-7413-4dde-84dc-97072a34165d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:03.744749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa2fac4a-7413-4dde-84dc-97072a34165d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:03.939757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:03.940725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:03.941382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:03.942034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:03.942601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:03.958564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:03.963555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:03.965845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:03.967388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:03.999661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fa2fac4a-7413-4dde-84dc-97072a34165d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:04.004169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Getting quotas for project 88d10cfa367f4bf591a86719352723d6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:04.012026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Getting quotas for user 4faef4f5be5941fc961c149905589902 and project 88d10cfa367f4bf591a86719352723d6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:04.012230 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa2fac4a-7413-4dde-84dc-97072a34165d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 0.314707 Jul 26 19:45:04.012658 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 254/474] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:03 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:04.019430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0052d246-0496-4882-8ec7-504a37a6107a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:04.037667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:04.041934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0052d246-0496-4882-8ec7-504a37a6107a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:04.048185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:04.055377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0052d246-0496-4882-8ec7-504a37a6107a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:04.056048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0052d246-0496-4882-8ec7-504a37a6107a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:04.056920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0052d246-0496-4882-8ec7-504a37a6107a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:04.057483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0052d246-0496-4882-8ec7-504a37a6107a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:04.164824 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e90f5ff-94c0-44b0-9382-5bd268544bc8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532868 Jul 26 19:45:04.171601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0052d246-0496-4882-8ec7-504a37a6107a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:04.175759 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 221/475] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:45:04.183155 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0052d246-0496-4882-8ec7-504a37a6107a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1275 microversion: 2.1 time: 0.169199 Jul 26 19:45:04.200849 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 255/476] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:04 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:04.210360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f5e64c4-454e-4bdb-8bbe-f12eb50c0a96 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:04.212374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7f5e64c4-454e-4bdb-8bbe-f12eb50c0a96 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:04.214431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac1053dc-3fb1-4d5c-a77f-adcabb365cac tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Calling method '.version_select at 0x7f876415a670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:04.227845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:04.232901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f5e64c4-454e-4bdb-8bbe-f12eb50c0a96 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:04.234907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f5e64c4-454e-4bdb-8bbe-f12eb50c0a96 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:04.237392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f5e64c4-454e-4bdb-8bbe-f12eb50c0a96 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:04.238203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f5e64c4-454e-4bdb-8bbe-f12eb50c0a96 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:04.262000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ac1053dc-3fb1-4d5c-a77f-adcabb365cac tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873305331?user_id=c016c7480afd436ea151b9f64e92551f" status: 204 len: 0 microversion: 2.10 time: 0.058203 Jul 26 19:45:04.264993 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 256/477] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 19:45:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873305331?user_id=c016c7480afd436ea151b9f64e92551f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:45:04.383452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7f5e64c4-454e-4bdb-8bbe-f12eb50c0a96 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:04.393557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f5e64c4-454e-4bdb-8bbe-f12eb50c0a96 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1274 microversion: 2.1 time: 0.212142 Jul 26 19:45:04.396770 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 222/478] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:04 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:04.415264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a4990dd9-6924-495e-a02e-bf2ce600179c req-8edf114b-4406-49e4-8a55-f3753b7d5967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e71b9a-35b2-4a19-af94-4917b75573bb", "name": "network-vif-plugged", "status": "completed", "tag": "598edcf8-27c7-440a-9784-4e95c216149d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:04.449286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a4990dd9-6924-495e-a02e-bf2ce600179c req-8edf114b-4406-49e4-8a55-f3753b7d5967 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:04.450074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a4990dd9-6924-495e-a02e-bf2ce600179c req-8edf114b-4406-49e4-8a55-f3753b7d5967 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:04.486149 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a4990dd9-6924-495e-a02e-bf2ce600179c req-8edf114b-4406-49e4-8a55-f3753b7d5967 service nova] Creating event network-vif-plugged:598edcf8-27c7-440a-9784-4e95c216149d for instance 21e71b9a-35b2-4a19-af94-4917b75573bb on n-h1-708768-8 Jul 26 19:45:04.499308 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a4990dd9-6924-495e-a02e-bf2ce600179c req-8edf114b-4406-49e4-8a55-f3753b7d5967 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100372 Jul 26 19:45:04.506941 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 223/479] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:04.517472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d2631d1-afe9-4ac5-96e6-2e70da4478df tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Action: 'create', calling method: .version_select at 0x7f876405bb80>, body: {"keypair": {"name": "tempest-keypair-1968079449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfkclmQThHIk8MHQkww5jXteeWM+5w2cbed1b+eIHJbplfsPjDVL+GgADHUFBKoCey0ib5SglDfVFC3ATIfeIEXxS23ptqiFY0PaA/UJgwfSO3J6CTpqz+j6bQpyCZcUQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:04.533488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-303cd75d-6a37-4908-8178-6cf86dd667ac tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:04.539689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-303cd75d-6a37-4908-8178-6cf86dd667ac tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:04.560208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-303cd75d-6a37-4908-8178-6cf86dd667ac tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:04.560786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-303cd75d-6a37-4908-8178-6cf86dd667ac tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:04.563469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-303cd75d-6a37-4908-8178-6cf86dd667ac tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:04.567412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-303cd75d-6a37-4908-8178-6cf86dd667ac tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:04.572788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9d2631d1-afe9-4ac5-96e6-2e70da4478df tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Getting quotas for project fbe6b28ebe6e4d06b4455356d52e6973. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:04.597454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9d2631d1-afe9-4ac5-96e6-2e70da4478df tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Getting quotas for user 43d0674f08c34d19b6e6be8760ee7b34 and project fbe6b28ebe6e4d06b4455356d52e6973. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:04.669085 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9d2631d1-afe9-4ac5-96e6-2e70da4478df tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401016 Jul 26 19:45:04.670181 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 257/480] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:45:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:04.684166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6ab4de99-0fc7-4c95-b415-733c388d34f0 req-23e6f6b1-a848-4352-ba19-090e3668c575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091be344-7214-4348-bfc5-f6189853bc9f", "tag": "c766a17e-7fca-4fdb-9ff8-b81a156f4a06"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:04.716230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6ab4de99-0fc7-4c95-b415-733c388d34f0 req-23e6f6b1-a848-4352-ba19-090e3668c575 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:04.718303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6ab4de99-0fc7-4c95-b415-733c388d34f0 req-23e6f6b1-a848-4352-ba19-090e3668c575 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:04.749665 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6ab4de99-0fc7-4c95-b415-733c388d34f0 req-23e6f6b1-a848-4352-ba19-090e3668c575 service nova] Creating event network-changed:c766a17e-7fca-4fdb-9ff8-b81a156f4a06 for instance 091be344-7214-4348-bfc5-f6189853bc9f on n-h2-708768-8 Jul 26 19:45:04.762798 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6ab4de99-0fc7-4c95-b415-733c388d34f0 req-23e6f6b1-a848-4352-ba19-090e3668c575 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088572 Jul 26 19:45:04.764765 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 258/481] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:04.785349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9712f7fe-c45c-4df3-b57b-482e3a317aba tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] Action: 'create', calling method: .version_select at 0x7f876415a820>, body: {"security_group": {"name": "tempest-securitygroup-1257474789", "description": "tempest-description-1714191129"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:05.207109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-303cd75d-6a37-4908-8178-6cf86dd667ac tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:05.224432 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-303cd75d-6a37-4908-8178-6cf86dd667ac tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1585 microversion: 2.1 time: 0.711167 Jul 26 19:45:05.225095 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 224/482] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:04 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1585 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:05.248417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b80b647d-9f68-43c0-91b3-cdcd3d26ab0a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:05.249315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b80b647d-9f68-43c0-91b3-cdcd3d26ab0a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:05.257766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b80b647d-9f68-43c0-91b3-cdcd3d26ab0a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:05.258563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b80b647d-9f68-43c0-91b3-cdcd3d26ab0a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:05.259496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b80b647d-9f68-43c0-91b3-cdcd3d26ab0a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:05.260105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b80b647d-9f68-43c0-91b3-cdcd3d26ab0a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:05.468985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b80b647d-9f68-43c0-91b3-cdcd3d26ab0a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:05.480599 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b80b647d-9f68-43c0-91b3-cdcd3d26ab0a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1222 microversion: 2.1 time: 0.237185 Jul 26 19:45:05.482142 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 225/483] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:05 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:05.492787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6e94f070-0388-4294-9a3c-4f642fe3bf95 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] Calling method '.version_select at 0x7f875761a0d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:05.553936 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6e94f070-0388-4294-9a3c-4f642fe3bf95 tempest-KeyPairsV210TestJSON-1669904264 tempest-KeyPairsV210TestJSON-1669904264-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-190804423?user_id=c016c7480afd436ea151b9f64e92551f" status: 204 len: 0 microversion: 2.10 time: 0.070428 Jul 26 19:45:05.555013 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 226/484] 10.222.0.58 () {60 vars in 1340 bytes} [Tue Jul 26 19:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-190804423?user_id=c016c7480afd436ea151b9f64e92551f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:45:05.563623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0eb8f515-2dff-4218-841a-e1488fdec5ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:05.566487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0eb8f515-2dff-4218-841a-e1488fdec5ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:05.586617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0eb8f515-2dff-4218-841a-e1488fdec5ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:05.587508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0eb8f515-2dff-4218-841a-e1488fdec5ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:05.588457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0eb8f515-2dff-4218-841a-e1488fdec5ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:05.589137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0eb8f515-2dff-4218-841a-e1488fdec5ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:05.799860 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9712f7fe-c45c-4df3-b57b-482e3a317aba tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.028642 Jul 26 19:45:05.801144 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 259/485] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:45:04 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:05.808159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f9bfb015-d270-47f1-9e16-7dd7354e3ddf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:05.809850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f9bfb015-d270-47f1-9e16-7dd7354e3ddf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:05.826258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9bfb015-d270-47f1-9e16-7dd7354e3ddf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:05.826951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9bfb015-d270-47f1-9e16-7dd7354e3ddf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:05.828079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9bfb015-d270-47f1-9e16-7dd7354e3ddf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:05.833484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9bfb015-d270-47f1-9e16-7dd7354e3ddf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:06.097409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f9bfb015-d270-47f1-9e16-7dd7354e3ddf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:06.106895 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f9bfb015-d270-47f1-9e16-7dd7354e3ddf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1317 microversion: 2.1 time: 0.303247 Jul 26 19:45:06.107488 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 260/486] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:05 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:06.120260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2a295259-2be1-415c-9354-6083df86e86a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:06.121259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2a295259-2be1-415c-9354-6083df86e86a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:06.137485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a295259-2be1-415c-9354-6083df86e86a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:06.138147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a295259-2be1-415c-9354-6083df86e86a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:06.141329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a295259-2be1-415c-9354-6083df86e86a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:06.142004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a295259-2be1-415c-9354-6083df86e86a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:06.296176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2a295259-2be1-415c-9354-6083df86e86a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:06.314812 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2a295259-2be1-415c-9354-6083df86e86a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1280 microversion: 2.1 time: 0.203025 Jul 26 19:45:06.320148 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 261/487] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:06 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:06.375874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0eb8f515-2dff-4218-841a-e1488fdec5ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:06.379640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:06.394573 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0eb8f515-2dff-4218-841a-e1488fdec5ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 0.837307 Jul 26 19:45:06.395970 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 227/488] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:05 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:06.511383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-658ec561-b59e-4a8b-b496-495462ca60b0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:06.511383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-658ec561-b59e-4a8b-b496-495462ca60b0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:06.525557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-658ec561-b59e-4a8b-b496-495462ca60b0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:06.526016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-658ec561-b59e-4a8b-b496-495462ca60b0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:06.538913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-658ec561-b59e-4a8b-b496-495462ca60b0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:06.539497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-658ec561-b59e-4a8b-b496-495462ca60b0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:06.720814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-658ec561-b59e-4a8b-b496-495462ca60b0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:06.729839 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-658ec561-b59e-4a8b-b496-495462ca60b0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1278 microversion: 2.1 time: 0.230430 Jul 26 19:45:06.740420 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 228/489] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:06 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:06.749937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-073e325e-42e5-45e7-9e2d-29da82df4a50 tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] Action: 'create', calling method: .version_select at 0x7f87641254c0>, body: {"security_group": {"name": "tempest-securitygroup-1402169503", "description": "tempest-description-29318683"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:07.134104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b1954398-e8e4-4cda-84d7-fed21ab08318 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:07.135498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b1954398-e8e4-4cda-84d7-fed21ab08318 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:07.142778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1954398-e8e4-4cda-84d7-fed21ab08318 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:07.143780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1954398-e8e4-4cda-84d7-fed21ab08318 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:07.145001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1954398-e8e4-4cda-84d7-fed21ab08318 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:07.145648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1954398-e8e4-4cda-84d7-fed21ab08318 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:07.604835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b1954398-e8e4-4cda-84d7-fed21ab08318 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:07.628705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b1954398-e8e4-4cda-84d7-fed21ab08318 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1317 microversion: 2.1 time: 0.498360 Jul 26 19:45:07.630730 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 229/490] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:07 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:07.678576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-94790a4a-541f-42cb-bf4c-84007eafebbb tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:07.681471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-94790a4a-541f-42cb-bf4c-84007eafebbb tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:07.689539 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-073e325e-42e5-45e7-9e2d-29da82df4a50 tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.367867 Jul 26 19:45:07.691326 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 262/491] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:45:06 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:07.698238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90b85184-1133-4d5f-9b38-67ca4fc6fd0f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:07.699161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90b85184-1133-4d5f-9b38-67ca4fc6fd0f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:07.701942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94790a4a-541f-42cb-bf4c-84007eafebbb tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:07.707259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94790a4a-541f-42cb-bf4c-84007eafebbb tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:07.708891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94790a4a-541f-42cb-bf4c-84007eafebbb tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:07.710761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94790a4a-541f-42cb-bf4c-84007eafebbb tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:07.714401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90b85184-1133-4d5f-9b38-67ca4fc6fd0f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:07.723513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90b85184-1133-4d5f-9b38-67ca4fc6fd0f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:07.724914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90b85184-1133-4d5f-9b38-67ca4fc6fd0f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:07.726033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90b85184-1133-4d5f-9b38-67ca4fc6fd0f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:08.085634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90b85184-1133-4d5f-9b38-67ca4fc6fd0f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:08.094538 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90b85184-1133-4d5f-9b38-67ca4fc6fd0f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 0.401336 Jul 26 19:45:08.095166 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 263/492] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:07 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:08.103147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9fe3c2ab-4cd5-48f5-bd76-320058c9c745 tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] Action: 'create', calling method: .version_select at 0x7f876417faf0>, body: {"security_group": {"name": "tempest-securitygroup-207018958", "description": "tempest-description-2017253060"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:08.289728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-94790a4a-541f-42cb-bf4c-84007eafebbb tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:08.298055 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-94790a4a-541f-42cb-bf4c-84007eafebbb tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 0.665241 Jul 26 19:45:08.299053 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 230/493] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:07 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:08.304081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c4e366d-3a96-4fb4-8998-691667dc4537 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:08.304826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3c4e366d-3a96-4fb4-8998-691667dc4537 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:08.312639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c4e366d-3a96-4fb4-8998-691667dc4537 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:08.313098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c4e366d-3a96-4fb4-8998-691667dc4537 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:08.313903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c4e366d-3a96-4fb4-8998-691667dc4537 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:08.314395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c4e366d-3a96-4fb4-8998-691667dc4537 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:08.633344 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9fe3c2ab-4cd5-48f5-bd76-320058c9c745 tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.535924 Jul 26 19:45:08.636512 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 264/494] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:45:08 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:08.647792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7fc0c9b1-e3db-4291-b920-8fea6326a9a7 req-30843fe3-92cc-456d-af88-6be53cc6b046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7", "name": "network-vif-plugged", "status": "completed", "tag": "74ed0b59-4c6e-42f4-b1fd-f295f3338802"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:08.693728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7fc0c9b1-e3db-4291-b920-8fea6326a9a7 req-30843fe3-92cc-456d-af88-6be53cc6b046 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:08.694964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7fc0c9b1-e3db-4291-b920-8fea6326a9a7 req-30843fe3-92cc-456d-af88-6be53cc6b046 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:08.700843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:08.712931 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7fc0c9b1-e3db-4291-b920-8fea6326a9a7 req-30843fe3-92cc-456d-af88-6be53cc6b046 service nova] Creating event network-vif-plugged:74ed0b59-4c6e-42f4-b1fd-f295f3338802 for instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 on n-h2-708768-8 Jul 26 19:45:08.732494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c4e366d-3a96-4fb4-8998-691667dc4537 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:08.735995 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7fc0c9b1-e3db-4291-b920-8fea6326a9a7 req-30843fe3-92cc-456d-af88-6be53cc6b046 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094643 Jul 26 19:45:08.736525 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 265/495] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:08.767716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-febcd509-e506-4e39-bcdc-a806f715a537 req-493f6abd-70cf-4c9d-bb1e-94dffe01a70c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c80442-0e57-4d48-bc28-6682ae824154", "tag": "5efeb5a3-cff9-410e-bd6a-591e1fce4666"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:08.774006 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c4e366d-3a96-4fb4-8998-691667dc4537 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1318 microversion: 2.1 time: 0.468273 Jul 26 19:45:08.774278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:08.775487 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 231/496] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:08 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:08.795090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-febcd509-e506-4e39-bcdc-a806f715a537 req-493f6abd-70cf-4c9d-bb1e-94dffe01a70c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:08.795823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-febcd509-e506-4e39-bcdc-a806f715a537 req-493f6abd-70cf-4c9d-bb1e-94dffe01a70c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:08.799012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fb2a766a-f829-48a7-84ca-dd5303ddc2b7 tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] Calling method '.version_select at 0x7f87575dbd30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:08.808942 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-febcd509-e506-4e39-bcdc-a806f715a537 req-493f6abd-70cf-4c9d-bb1e-94dffe01a70c service nova] Creating event network-changed:5efeb5a3-cff9-410e-bd6a-591e1fce4666 for instance 46c80442-0e57-4d48-bc28-6682ae824154 on n-h1-708768-8 Jul 26 19:45:08.822281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-febcd509-e506-4e39-bcdc-a806f715a537 req-493f6abd-70cf-4c9d-bb1e-94dffe01a70c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080315 Jul 26 19:45:08.825664 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 266/497] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:08.842050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-781b1448-2eb5-46c4-8066-b04024d2f2bf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:08.843040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-781b1448-2eb5-46c4-8066-b04024d2f2bf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:08.850623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-781b1448-2eb5-46c4-8066-b04024d2f2bf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:08.851552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-781b1448-2eb5-46c4-8066-b04024d2f2bf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:08.852529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-781b1448-2eb5-46c4-8066-b04024d2f2bf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:08.853747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-781b1448-2eb5-46c4-8066-b04024d2f2bf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:09.376953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-781b1448-2eb5-46c4-8066-b04024d2f2bf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:09.386371 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-781b1448-2eb5-46c4-8066-b04024d2f2bf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1317 microversion: 2.1 time: 0.556886 Jul 26 19:45:09.386952 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 267/498] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:08 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:09.400090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a64c7c61-a9ab-4f28-a3c0-12df00671ecc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:09.403249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a64c7c61-a9ab-4f28-a3c0-12df00671ecc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:09.412237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a64c7c61-a9ab-4f28-a3c0-12df00671ecc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:09.412685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a64c7c61-a9ab-4f28-a3c0-12df00671ecc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:09.427510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a64c7c61-a9ab-4f28-a3c0-12df00671ecc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:09.428505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a64c7c61-a9ab-4f28-a3c0-12df00671ecc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:10.065583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a64c7c61-a9ab-4f28-a3c0-12df00671ecc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:10.080879 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a64c7c61-a9ab-4f28-a3c0-12df00671ecc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1313 microversion: 2.1 time: 0.686021 Jul 26 19:45:10.091806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 268/499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:09 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:10.091806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85e63f51-4786-457e-ab4b-35e27bfaac65 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:10.091806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-85e63f51-4786-457e-ab4b-35e27bfaac65 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:10.097347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85e63f51-4786-457e-ab4b-35e27bfaac65 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:10.097347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85e63f51-4786-457e-ab4b-35e27bfaac65 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:10.097347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85e63f51-4786-457e-ab4b-35e27bfaac65 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:10.097347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85e63f51-4786-457e-ab4b-35e27bfaac65 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:10.477795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-85e63f51-4786-457e-ab4b-35e27bfaac65 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:10.491640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85e63f51-4786-457e-ab4b-35e27bfaac65 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 0.402944 Jul 26 19:45:10.493613 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 269/500] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:10 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:10.500660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9cb3b01a-0a83-417f-96a4-087f7cac1a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:10.511304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9cb3b01a-0a83-417f-96a4-087f7cac1a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:10.527212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cb3b01a-0a83-417f-96a4-087f7cac1a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:10.527700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cb3b01a-0a83-417f-96a4-087f7cac1a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:10.528681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cb3b01a-0a83-417f-96a4-087f7cac1a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:10.529149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cb3b01a-0a83-417f-96a4-087f7cac1a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:10.756114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9cb3b01a-0a83-417f-96a4-087f7cac1a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:10.763705 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9cb3b01a-0a83-417f-96a4-087f7cac1a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1318 microversion: 2.1 time: 0.268828 Jul 26 19:45:10.766990 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 270/501] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:10 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:10.785357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3d8cd4a-3df5-456c-abff-089268056797 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:10.786554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a3d8cd4a-3df5-456c-abff-089268056797 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:10.805500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3d8cd4a-3df5-456c-abff-089268056797 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:10.806200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3d8cd4a-3df5-456c-abff-089268056797 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:10.807182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3d8cd4a-3df5-456c-abff-089268056797 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:10.807815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3d8cd4a-3df5-456c-abff-089268056797 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:11.101595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3d8cd4a-3df5-456c-abff-089268056797 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:11.111179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3d8cd4a-3df5-456c-abff-089268056797 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1317 microversion: 2.1 time: 0.339176 Jul 26 19:45:11.111688 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 271/502] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:10 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:11.124595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2089557537", "imageRef": "4395b68b-ef26-49b2-a820-d56899c75e16", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3ea9a99f-64df-49be-aa0a-1dd213fd9a95"}], "security_groups": [{"name": "tempest-securitygroup--886159470"}], "key_name": "tempest-keypair-1968079449", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:11.308067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] validate_networks() for [('3ea9a99f-64df-49be-aa0a-1dd213fd9a95', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:11.783884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:11.784304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:11.784764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:11.786025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:11.786772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:11.795836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:11.796280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:11.797065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:11.797494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:11.814295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Getting quotas for project fbe6b28ebe6e4d06b4455356d52e6973. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:11.820575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Getting quotas for user 43d0674f08c34d19b6e6be8760ee7b34 and project fbe6b28ebe6e4d06b4455356d52e6973. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:11.833444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:11.835811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4395b68b-ef26-49b2-a820-d56899c75e16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:11.882920 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4a2de0ef-7260-459c-85af-491ff13b818b tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.766109 Jul 26 19:45:11.884052 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 272/503] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:45:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:45:11.888662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0af4d5f5-7501-4036-8048-72791b2f6cfb req-03252164-aa99-4095-888b-e4a7791a614c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c814f3cd-1c30-41a1-9f98-13fdf07d945b", "tag": "1ab14c84-9e1b-410d-9b20-37f88e91a89b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:11.899226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0af4d5f5-7501-4036-8048-72791b2f6cfb req-03252164-aa99-4095-888b-e4a7791a614c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:11.899697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0af4d5f5-7501-4036-8048-72791b2f6cfb req-03252164-aa99-4095-888b-e4a7791a614c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:11.916059 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0af4d5f5-7501-4036-8048-72791b2f6cfb req-03252164-aa99-4095-888b-e4a7791a614c service nova] Creating event network-changed:1ab14c84-9e1b-410d-9b20-37f88e91a89b for instance c814f3cd-1c30-41a1-9f98-13fdf07d945b on n-h1-708768-8 Jul 26 19:45:11.922328 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0af4d5f5-7501-4036-8048-72791b2f6cfb req-03252164-aa99-4095-888b-e4a7791a614c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036901 Jul 26 19:45:11.922935 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 273/504] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:11.929505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-613ad191-fa9e-4602-bcc1-c28f86aaa8f5 req-56a2ce01-ce27-4657-a2d4-31d7dfd45b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef27307f-bc06-4095-80df-d383826007e6", "tag": "0013623d-d448-4a03-8343-38ebe74bb534"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:11.939889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-613ad191-fa9e-4602-bcc1-c28f86aaa8f5 req-56a2ce01-ce27-4657-a2d4-31d7dfd45b36 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:11.940518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-613ad191-fa9e-4602-bcc1-c28f86aaa8f5 req-56a2ce01-ce27-4657-a2d4-31d7dfd45b36 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:11.953586 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-613ad191-fa9e-4602-bcc1-c28f86aaa8f5 req-56a2ce01-ce27-4657-a2d4-31d7dfd45b36 service nova] Creating event network-changed:0013623d-d448-4a03-8343-38ebe74bb534 for instance ef27307f-bc06-4095-80df-d383826007e6 on n-h2-708768-8 Jul 26 19:45:11.964385 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-613ad191-fa9e-4602-bcc1-c28f86aaa8f5 req-56a2ce01-ce27-4657-a2d4-31d7dfd45b36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039770 Jul 26 19:45:11.965250 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 274/505] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:11.974160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-40fffe22-9b9b-4ed5-b4ed-c34eb5986146 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:11.974943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40fffe22-9b9b-4ed5-b4ed-c34eb5986146 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:11.983941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40fffe22-9b9b-4ed5-b4ed-c34eb5986146 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:11.984285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40fffe22-9b9b-4ed5-b4ed-c34eb5986146 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:11.985134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40fffe22-9b9b-4ed5-b4ed-c34eb5986146 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:11.985635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40fffe22-9b9b-4ed5-b4ed-c34eb5986146 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:12.159801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-40fffe22-9b9b-4ed5-b4ed-c34eb5986146 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:12.170266 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-40fffe22-9b9b-4ed5-b4ed-c34eb5986146 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1462 microversion: 2.1 time: 0.202914 Jul 26 19:45:12.171051 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 275/506] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:11 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1462 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:12.177047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1cb2082b-dbb5-4a8f-8b30-639af7c8da46 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:12.177880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1cb2082b-dbb5-4a8f-8b30-639af7c8da46 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:12.183958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cb2082b-dbb5-4a8f-8b30-639af7c8da46 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:12.184694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cb2082b-dbb5-4a8f-8b30-639af7c8da46 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:12.185648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cb2082b-dbb5-4a8f-8b30-639af7c8da46 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:12.186580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cb2082b-dbb5-4a8f-8b30-639af7c8da46 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:12.376319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1cb2082b-dbb5-4a8f-8b30-639af7c8da46 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:12.390562 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1cb2082b-dbb5-4a8f-8b30-639af7c8da46 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 0.218210 Jul 26 19:45:12.391413 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 276/507] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:12 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:12.421889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5350166-274c-483c-aef5-d9a95b6d20ce tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:12.422524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a5350166-274c-483c-aef5-d9a95b6d20ce tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:12.438936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5350166-274c-483c-aef5-d9a95b6d20ce tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:12.439388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5350166-274c-483c-aef5-d9a95b6d20ce tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:12.444665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5350166-274c-483c-aef5-d9a95b6d20ce tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:12.445545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5350166-274c-483c-aef5-d9a95b6d20ce tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:12.737767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a5350166-274c-483c-aef5-d9a95b6d20ce tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:12.756505 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5350166-274c-483c-aef5-d9a95b6d20ce tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1318 microversion: 2.1 time: 0.349155 Jul 26 19:45:12.771390 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 277/508] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:12 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:12.777444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d3b9f9d-2e53-471d-a517-f09a84bf42b8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:12.778578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9d3b9f9d-2e53-471d-a517-f09a84bf42b8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:12.790522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d3b9f9d-2e53-471d-a517-f09a84bf42b8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:12.791386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d3b9f9d-2e53-471d-a517-f09a84bf42b8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:12.792416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d3b9f9d-2e53-471d-a517-f09a84bf42b8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:12.793063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d3b9f9d-2e53-471d-a517-f09a84bf42b8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:12.883895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9d3b9f9d-2e53-471d-a517-f09a84bf42b8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:12.894120 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9d3b9f9d-2e53-471d-a517-f09a84bf42b8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1298 microversion: 2.1 time: 0.121447 Jul 26 19:45:12.896026 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 278/509] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:12 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:12.901798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f8af5e3-7441-4e88-a469-940759bea755 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:12.902670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4f8af5e3-7441-4e88-a469-940759bea755 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:12.912125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f8af5e3-7441-4e88-a469-940759bea755 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:12.913169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f8af5e3-7441-4e88-a469-940759bea755 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:12.914162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f8af5e3-7441-4e88-a469-940759bea755 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:12.915280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f8af5e3-7441-4e88-a469-940759bea755 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:13.322334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4f8af5e3-7441-4e88-a469-940759bea755 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:13.339544 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4f8af5e3-7441-4e88-a469-940759bea755 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1317 microversion: 2.1 time: 0.438790 Jul 26 19:45:13.341184 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 279/510] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:12 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:13.352242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b397287-6001-4cae-b3f0-498170516669 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:13.356578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b397287-6001-4cae-b3f0-498170516669 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:13.391539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b397287-6001-4cae-b3f0-498170516669 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:13.392351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b397287-6001-4cae-b3f0-498170516669 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:13.393420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b397287-6001-4cae-b3f0-498170516669 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:13.394061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b397287-6001-4cae-b3f0-498170516669 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:13.663553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6b397287-6001-4cae-b3f0-498170516669 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:13.664004 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fb2a766a-f829-48a7-84ca-dd5303ddc2b7 tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10988 microversion: 2.1 time: 4.886731 Jul 26 19:45:13.664598 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 232/511] 10.222.0.58 () {58 vars in 1191 bytes} [Tue Jul 26 19:45:08 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10988 bytes in 4888 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:45:13.678193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-90068cc9-b632-4546-8310-df369d373f49 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:13.678884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-90068cc9-b632-4546-8310-df369d373f49 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:13.686518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90068cc9-b632-4546-8310-df369d373f49 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:13.686975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90068cc9-b632-4546-8310-df369d373f49 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:13.694177 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b397287-6001-4cae-b3f0-498170516669 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1464 microversion: 2.1 time: 0.350379 Jul 26 19:45:13.694782 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 280/512] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:13 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1464 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:13.708452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90068cc9-b632-4546-8310-df369d373f49 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:13.711881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90068cc9-b632-4546-8310-df369d373f49 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:13.731411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0aa60c5e-88e0-4281-a63d-26fedbeff855 tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] Calling method '.version_select at 0x7f876413bb80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:13.986349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:14.005503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-90068cc9-b632-4546-8310-df369d373f49 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:14.017478 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-90068cc9-b632-4546-8310-df369d373f49 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 0.351745 Jul 26 19:45:14.017996 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 233/513] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:13 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:14.045498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3a233ca9-bc53-449f-bc80-382d09623e01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:14.048808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3a233ca9-bc53-449f-bc80-382d09623e01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:14.053598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=18 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:14.060720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a233ca9-bc53-449f-bc80-382d09623e01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:14.061929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a233ca9-bc53-449f-bc80-382d09623e01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:14.063520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a233ca9-bc53-449f-bc80-382d09623e01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:14.064136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a233ca9-bc53-449f-bc80-382d09623e01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:14.356582 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0aa60c5e-88e0-4281-a63d-26fedbeff855 tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.630230 Jul 26 19:45:14.368489 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 281/514] 10.222.0.58 () {58 vars in 1191 bytes} [Tue Jul 26 19:45:13 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:14.375023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe95eb0a-0ad8-4cfa-bdc7-890d82128230 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:14.388437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe95eb0a-0ad8-4cfa-bdc7-890d82128230 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:14.400805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe95eb0a-0ad8-4cfa-bdc7-890d82128230 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:14.401341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe95eb0a-0ad8-4cfa-bdc7-890d82128230 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:14.402180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe95eb0a-0ad8-4cfa-bdc7-890d82128230 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:14.402612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe95eb0a-0ad8-4cfa-bdc7-890d82128230 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:14.561407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3a233ca9-bc53-449f-bc80-382d09623e01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:14.570962 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3a233ca9-bc53-449f-bc80-382d09623e01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1318 microversion: 2.1 time: 0.551858 Jul 26 19:45:14.574613 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 234/515] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:14 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:14.581550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1031934045", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "21e71b9a-35b2-4a19-af94-4917b75573bb"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:14.698580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:14.711581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fe95eb0a-0ad8-4cfa-bdc7-890d82128230 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:14.721404 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe95eb0a-0ad8-4cfa-bdc7-890d82128230 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1304 microversion: 2.1 time: 0.350979 Jul 26 19:45:14.737341 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 282/516] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:14 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1304 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:14.745198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c6847fba-de82-4247-a02e-d3279458ceb1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:14.751959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c6847fba-de82-4247-a02e-d3279458ceb1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:14.775913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6847fba-de82-4247-a02e-d3279458ceb1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:14.776372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6847fba-de82-4247-a02e-d3279458ceb1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:14.788651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6847fba-de82-4247-a02e-d3279458ceb1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:14.789041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6847fba-de82-4247-a02e-d3279458ceb1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:15.304843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c6847fba-de82-4247-a02e-d3279458ceb1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:15.313195 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c6847fba-de82-4247-a02e-d3279458ceb1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1317 microversion: 2.1 time: 0.574415 Jul 26 19:45:15.333987 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 283/517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:14 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:15.339049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2de36471-2730-4656-a255-4dbc18849983 tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] Calling method '.version_select at 0x7f876405b670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:15.800200 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2de36471-2730-4656-a255-4dbc18849983 tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/4e250a0a-7d26-405d-8686-94693d8d8b9e" status: 202 len: 0 microversion: 2.1 time: 0.464711 Jul 26 19:45:15.800835 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 284/518] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:45:15 2022] DELETE /compute/v2.1/os-security-groups/4e250a0a-7d26-405d-8686-94693d8d8b9e => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:15.808753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75c0e79c-3885-48fd-8066-d9cfaed8197b tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:15.811212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-75c0e79c-3885-48fd-8066-d9cfaed8197b tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:15.830363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75c0e79c-3885-48fd-8066-d9cfaed8197b tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:15.831888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75c0e79c-3885-48fd-8066-d9cfaed8197b tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:15.833283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75c0e79c-3885-48fd-8066-d9cfaed8197b tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:15.838330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75c0e79c-3885-48fd-8066-d9cfaed8197b tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:15.859802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:15.860353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:15.860722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:15.861128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:15.861935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:15.902043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:15.905360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:15.906604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:15.916336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:15.992094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Getting quotas for project aa4bbc1be55b4513a8010a7bc71fbdf5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:16.006169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Getting quotas for user cb09db7f39f24139a8b9a50bb21c4a3d and project aa4bbc1be55b4513a8010a7bc71fbdf5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:16.057952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:16.068093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:16.239164 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5a401dc-5c62-4f56-9243-ab23c521f45c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660842 Jul 26 19:45:16.241775 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 235/519] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:45:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:45:16.247418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2e0ce153-8ad3-44e2-9209-06a88a91d1a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:16.248081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2e0ce153-8ad3-44e2-9209-06a88a91d1a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:16.255988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e0ce153-8ad3-44e2-9209-06a88a91d1a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:16.256198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e0ce153-8ad3-44e2-9209-06a88a91d1a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:16.257338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e0ce153-8ad3-44e2-9209-06a88a91d1a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:16.257756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e0ce153-8ad3-44e2-9209-06a88a91d1a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:16.876582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-75c0e79c-3885-48fd-8066-d9cfaed8197b tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:16.891981 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-75c0e79c-3885-48fd-8066-d9cfaed8197b tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 1.088740 Jul 26 19:45:16.896536 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 285/520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:15 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:16.912764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2a2eb613-5bd5-4dce-b04d-5dc054a68a1c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:16.915093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2a2eb613-5bd5-4dce-b04d-5dc054a68a1c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:16.935289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a2eb613-5bd5-4dce-b04d-5dc054a68a1c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:16.940107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a2eb613-5bd5-4dce-b04d-5dc054a68a1c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:16.941405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a2eb613-5bd5-4dce-b04d-5dc054a68a1c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:16.949435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2e0ce153-8ad3-44e2-9209-06a88a91d1a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:16.958554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a2eb613-5bd5-4dce-b04d-5dc054a68a1c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:16.972564 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2e0ce153-8ad3-44e2-9209-06a88a91d1a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1318 microversion: 2.1 time: 0.726177 Jul 26 19:45:16.982719 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 236/521] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:16 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1318 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:17.006707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f5b0b0b-e59b-422b-ab60-30221842e8fc tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] Calling method '.version_select at 0x7f875753d310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:17.428413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2a2eb613-5bd5-4dce-b04d-5dc054a68a1c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:17.439288 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2a2eb613-5bd5-4dce-b04d-5dc054a68a1c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.541018 Jul 26 19:45:17.444314 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 286/522] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:16 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:17.452907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d531ad68-b295-4a8c-85cf-a73c7ff8ab53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:17.453527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d531ad68-b295-4a8c-85cf-a73c7ff8ab53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:17.469220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d531ad68-b295-4a8c-85cf-a73c7ff8ab53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:17.469677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d531ad68-b295-4a8c-85cf-a73c7ff8ab53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:17.470468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d531ad68-b295-4a8c-85cf-a73c7ff8ab53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:17.473987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d531ad68-b295-4a8c-85cf-a73c7ff8ab53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:17.483604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:17.624274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d531ad68-b295-4a8c-85cf-a73c7ff8ab53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:17.641552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d531ad68-b295-4a8c-85cf-a73c7ff8ab53 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1210 microversion: 2.1 time: 0.195039 Jul 26 19:45:17.644140 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 287/523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:17 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1210 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:17.662241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d26a4bf0-bfbf-40d6-8057-1cb397bea072 req-24730a82-e28f-4bd5-a113-a6c18967ec64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c80442-0e57-4d48-bc28-6682ae824154", "name": "network-vif-plugged", "status": "completed", "tag": "5efeb5a3-cff9-410e-bd6a-591e1fce4666"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:17.680109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d26a4bf0-bfbf-40d6-8057-1cb397bea072 req-24730a82-e28f-4bd5-a113-a6c18967ec64 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:17.682790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d26a4bf0-bfbf-40d6-8057-1cb397bea072 req-24730a82-e28f-4bd5-a113-a6c18967ec64 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:17.717824 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d26a4bf0-bfbf-40d6-8057-1cb397bea072 req-24730a82-e28f-4bd5-a113-a6c18967ec64 service nova] Creating event network-vif-plugged:5efeb5a3-cff9-410e-bd6a-591e1fce4666 for instance 46c80442-0e57-4d48-bc28-6682ae824154 on n-h1-708768-8 Jul 26 19:45:17.736972 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d26a4bf0-bfbf-40d6-8057-1cb397bea072 req-24730a82-e28f-4bd5-a113-a6c18967ec64 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086348 Jul 26 19:45:17.737880 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 288/524] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:17.752810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9a58b56b-2dfb-4207-8573-9da55c108236 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:17.755164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9a58b56b-2dfb-4207-8573-9da55c108236 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:17.774333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a58b56b-2dfb-4207-8573-9da55c108236 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:17.775236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a58b56b-2dfb-4207-8573-9da55c108236 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:17.776454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a58b56b-2dfb-4207-8573-9da55c108236 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:17.777134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a58b56b-2dfb-4207-8573-9da55c108236 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:18.424594 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f5b0b0b-e59b-422b-ab60-30221842e8fc tempest-SecurityGroupsTestAdminJSON-685373421 tempest-SecurityGroupsTestAdminJSON-685373421-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/4e39d436-5f78-4cc6-9c8e-959bda82bfec" status: 202 len: 0 microversion: 2.1 time: 1.439044 Jul 26 19:45:18.425478 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 237/525] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:45:16 2022] DELETE /compute/v2.1/os-security-groups/4e39d436-5f78-4cc6-9c8e-959bda82bfec => generated 0 bytes in 1442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:18.430836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9abe19d6-63a7-4287-9804-e4d226659bed tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:18.431453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9abe19d6-63a7-4287-9804-e4d226659bed tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:18.462566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abe19d6-63a7-4287-9804-e4d226659bed tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:18.465620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abe19d6-63a7-4287-9804-e4d226659bed tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:18.468460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abe19d6-63a7-4287-9804-e4d226659bed tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:18.475029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abe19d6-63a7-4287-9804-e4d226659bed tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:18.796454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a58b56b-2dfb-4207-8573-9da55c108236 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:18.805741 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9a58b56b-2dfb-4207-8573-9da55c108236 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1317 microversion: 2.1 time: 1.064371 Jul 26 19:45:18.809033 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 289/526] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:17 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1317 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:18.818193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa2810a8-f2ab-4389-8dec-8f0ea5fe235f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:18.820613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa2810a8-f2ab-4389-8dec-8f0ea5fe235f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:18.830256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa2810a8-f2ab-4389-8dec-8f0ea5fe235f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:18.831535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa2810a8-f2ab-4389-8dec-8f0ea5fe235f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:18.833212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa2810a8-f2ab-4389-8dec-8f0ea5fe235f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:18.834113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa2810a8-f2ab-4389-8dec-8f0ea5fe235f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:19.119117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa2810a8-f2ab-4389-8dec-8f0ea5fe235f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:19.130298 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa2810a8-f2ab-4389-8dec-8f0ea5fe235f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1318 microversion: 2.1 time: 0.318732 Jul 26 19:45:19.136912 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 290/527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:18 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:19.141945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ff66fda-6253-4ab3-aceb-d32fadc8af92 tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] Calling method '.version_select at 0x7f876405ba60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:19.203285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9abe19d6-63a7-4287-9804-e4d226659bed tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:19.211536 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9abe19d6-63a7-4287-9804-e4d226659bed tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 0.784353 Jul 26 19:45:19.217532 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 238/528] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:18 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:19.222591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e3a96ef-faad-4c4c-a221-f73e0f67074d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:19.237849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e3a96ef-faad-4c4c-a221-f73e0f67074d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:19.256184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e3a96ef-faad-4c4c-a221-f73e0f67074d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:19.256731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e3a96ef-faad-4c4c-a221-f73e0f67074d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:19.257439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e3a96ef-faad-4c4c-a221-f73e0f67074d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:19.257882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e3a96ef-faad-4c4c-a221-f73e0f67074d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:19.599992 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8ff66fda-6253-4ab3-aceb-d32fadc8af92 tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/ac23eda5-f4a6-406a-9708-7aa228d158b6" status: 202 len: 0 microversion: 2.1 time: 0.461584 Jul 26 19:45:19.600698 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 291/529] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:45:19 2022] DELETE /compute/v2.1/os-security-groups/ac23eda5-f4a6-406a-9708-7aa228d158b6 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:19.605419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-191d7ed0-b759-4d49-bf10-51a7de273a63 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:19.606144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-191d7ed0-b759-4d49-bf10-51a7de273a63 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:19.628004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-191d7ed0-b759-4d49-bf10-51a7de273a63 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:19.634588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-191d7ed0-b759-4d49-bf10-51a7de273a63 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:19.635851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-191d7ed0-b759-4d49-bf10-51a7de273a63 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:19.636549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-191d7ed0-b759-4d49-bf10-51a7de273a63 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:19.803228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-191d7ed0-b759-4d49-bf10-51a7de273a63 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:19.815830 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-191d7ed0-b759-4d49-bf10-51a7de273a63 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1272 microversion: 2.1 time: 0.211490 Jul 26 19:45:19.818074 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 292/530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:19 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:19.830122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b2765ed0-c181-4667-b7f7-e119b6768fe2 req-9b500ba1-a4d0-4317-a428-a79a0b4f35ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94ef3743-f705-4e52-bb3c-e5891eab0512", "tag": "3d99ffec-3261-4711-ad8b-3f9d9b36eec8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:19.854510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b2765ed0-c181-4667-b7f7-e119b6768fe2 req-9b500ba1-a4d0-4317-a428-a79a0b4f35ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:19.857702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b2765ed0-c181-4667-b7f7-e119b6768fe2 req-9b500ba1-a4d0-4317-a428-a79a0b4f35ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:19.883265 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b2765ed0-c181-4667-b7f7-e119b6768fe2 req-9b500ba1-a4d0-4317-a428-a79a0b4f35ca service nova] Creating event network-changed:3d99ffec-3261-4711-ad8b-3f9d9b36eec8 for instance 94ef3743-f705-4e52-bb3c-e5891eab0512 on n-h2-708768-8 Jul 26 19:45:19.896171 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b2765ed0-c181-4667-b7f7-e119b6768fe2 req-9b500ba1-a4d0-4317-a428-a79a0b4f35ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073833 Jul 26 19:45:19.901423 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 293/531] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:19.912778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7038acad-9b40-460e-ad3e-6d4f78d94276 tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] Calling method '.version_select at 0x7f876415a9d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:20.242758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e3a96ef-faad-4c4c-a221-f73e0f67074d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:20.256456 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e3a96ef-faad-4c4c-a221-f73e0f67074d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 1.037441 Jul 26 19:45:20.261391 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 239/532] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:19 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:20.282340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9d142b6c-941f-4e42-9735-d0018cad5288 req-96c49444-3947-41c2-a8f6-160fd84702f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef27307f-bc06-4095-80df-d383826007e6", "name": "network-vif-plugged", "status": "completed", "tag": "0013623d-d448-4a03-8343-38ebe74bb534"}, {"server_uuid": "c814f3cd-1c30-41a1-9f98-13fdf07d945b", "name": "network-vif-plugged", "status": "completed", "tag": "1ab14c84-9e1b-410d-9b20-37f88e91a89b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:20.313999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9d142b6c-941f-4e42-9735-d0018cad5288 req-96c49444-3947-41c2-a8f6-160fd84702f0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:20.315604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9d142b6c-941f-4e42-9735-d0018cad5288 req-96c49444-3947-41c2-a8f6-160fd84702f0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:20.341699 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7038acad-9b40-460e-ad3e-6d4f78d94276 tempest-SecurityGroupsTestAdminJSON-1720174685 tempest-SecurityGroupsTestAdminJSON-1720174685-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b8bbb883-0af1-4cb6-9990-6c275a7081e9" status: 202 len: 0 microversion: 2.1 time: 0.438752 Jul 26 19:45:20.342802 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 294/533] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:45:19 2022] DELETE /compute/v2.1/os-security-groups/b8bbb883-0af1-4cb6-9990-6c275a7081e9 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:20.354641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f44017b8-f516-4e67-abc4-bcaa5bde0a7f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:20.356503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f44017b8-f516-4e67-abc4-bcaa5bde0a7f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:20.360727 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9d142b6c-941f-4e42-9735-d0018cad5288 req-96c49444-3947-41c2-a8f6-160fd84702f0 service nova] Creating event network-vif-plugged:0013623d-d448-4a03-8343-38ebe74bb534 for instance ef27307f-bc06-4095-80df-d383826007e6 on n-h2-708768-8 Jul 26 19:45:20.361779 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9d142b6c-941f-4e42-9735-d0018cad5288 req-96c49444-3947-41c2-a8f6-160fd84702f0 service nova] Creating event network-vif-plugged:1ab14c84-9e1b-410d-9b20-37f88e91a89b for instance c814f3cd-1c30-41a1-9f98-13fdf07d945b on n-h1-708768-8 Jul 26 19:45:20.399458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f44017b8-f516-4e67-abc4-bcaa5bde0a7f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:20.405808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f44017b8-f516-4e67-abc4-bcaa5bde0a7f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:20.408989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f44017b8-f516-4e67-abc4-bcaa5bde0a7f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:20.414372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f44017b8-f516-4e67-abc4-bcaa5bde0a7f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:20.429552 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9d142b6c-941f-4e42-9735-d0018cad5288 req-96c49444-3947-41c2-a8f6-160fd84702f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.162450 Jul 26 19:45:20.441954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 240/534] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:20.466527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49a3f34b-821f-4ebd-9e78-d2f50530577a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:20.467343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-49a3f34b-821f-4ebd-9e78-d2f50530577a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:20.488349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49a3f34b-821f-4ebd-9e78-d2f50530577a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:20.490835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49a3f34b-821f-4ebd-9e78-d2f50530577a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:20.493475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49a3f34b-821f-4ebd-9e78-d2f50530577a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:20.495333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49a3f34b-821f-4ebd-9e78-d2f50530577a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:21.131961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f44017b8-f516-4e67-abc4-bcaa5bde0a7f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:21.162305 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f44017b8-f516-4e67-abc4-bcaa5bde0a7f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1467 microversion: 2.1 time: 0.818267 Jul 26 19:45:21.163474 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 295/535] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:20 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1467 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:21.173148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3d583e55-4b93-4398-beda-94169ec4a422 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:21.176383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3d583e55-4b93-4398-beda-94169ec4a422 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:21.192630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d583e55-4b93-4398-beda-94169ec4a422 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:21.195151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d583e55-4b93-4398-beda-94169ec4a422 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:21.196191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d583e55-4b93-4398-beda-94169ec4a422 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:21.198014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d583e55-4b93-4398-beda-94169ec4a422 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:21.609012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3d583e55-4b93-4398-beda-94169ec4a422 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:21.624641 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3d583e55-4b93-4398-beda-94169ec4a422 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 0.456051 Jul 26 19:45:21.628622 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 296/536] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:21 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:21.641316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e22cf65-fe6f-4d58-b1c7-7edd791ff803 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:21.643089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2e22cf65-fe6f-4d58-b1c7-7edd791ff803 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:21.658477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e22cf65-fe6f-4d58-b1c7-7edd791ff803 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:21.661337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e22cf65-fe6f-4d58-b1c7-7edd791ff803 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:21.662958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e22cf65-fe6f-4d58-b1c7-7edd791ff803 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:21.665351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e22cf65-fe6f-4d58-b1c7-7edd791ff803 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:21.792965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e22cf65-fe6f-4d58-b1c7-7edd791ff803 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:21.802982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e22cf65-fe6f-4d58-b1c7-7edd791ff803 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1272 microversion: 2.1 time: 0.171967 Jul 26 19:45:21.808418 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 297/537] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:21 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:21.823641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:21.828964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=24 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:21.981595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-49a3f34b-821f-4ebd-9e78-d2f50530577a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:21.990121 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-49a3f34b-821f-4ebd-9e78-d2f50530577a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1318 microversion: 2.1 time: 1.542398 Jul 26 19:45:22.009080 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 241/538] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:20 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1318 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:22.013391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0cc0447e-a7d1-4ae4-a588-b7bc93d70686 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:22.038362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0cc0447e-a7d1-4ae4-a588-b7bc93d70686 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:22.064759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cc0447e-a7d1-4ae4-a588-b7bc93d70686 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:22.065260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cc0447e-a7d1-4ae4-a588-b7bc93d70686 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:22.066128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cc0447e-a7d1-4ae4-a588-b7bc93d70686 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:22.066612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cc0447e-a7d1-4ae4-a588-b7bc93d70686 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:22.389078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e58fc2e1-8d92-444f-88e3-c680170a7d9d tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:22.389696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e58fc2e1-8d92-444f-88e3-c680170a7d9d tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:22.399477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e58fc2e1-8d92-444f-88e3-c680170a7d9d tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:22.400385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e58fc2e1-8d92-444f-88e3-c680170a7d9d tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:22.401411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e58fc2e1-8d92-444f-88e3-c680170a7d9d tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:22.402002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e58fc2e1-8d92-444f-88e3-c680170a7d9d tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:22.956880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0cc0447e-a7d1-4ae4-a588-b7bc93d70686 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:22.966178 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0cc0447e-a7d1-4ae4-a588-b7bc93d70686 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.965852 Jul 26 19:45:22.966767 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 242/539] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:21 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:23.009164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-577393fb-77b5-486b-950e-cfbee3fa3d5a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:23.017358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-577393fb-77b5-486b-950e-cfbee3fa3d5a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:23.032923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-577393fb-77b5-486b-950e-cfbee3fa3d5a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:23.037697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-577393fb-77b5-486b-950e-cfbee3fa3d5a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:23.039293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-577393fb-77b5-486b-950e-cfbee3fa3d5a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:23.041837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-577393fb-77b5-486b-950e-cfbee3fa3d5a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:23.377934 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e58fc2e1-8d92-444f-88e3-c680170a7d9d tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1618 microversion: 2.1 time: 1.568270 Jul 26 19:45:23.382105 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 298/540] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:21 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1618 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:23.414485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-96ac41ce-af5e-4990-ab74-eea0c84d50d3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:23.417348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-96ac41ce-af5e-4990-ab74-eea0c84d50d3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:23.435181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96ac41ce-af5e-4990-ab74-eea0c84d50d3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:23.435881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96ac41ce-af5e-4990-ab74-eea0c84d50d3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:23.438115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96ac41ce-af5e-4990-ab74-eea0c84d50d3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:23.439494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96ac41ce-af5e-4990-ab74-eea0c84d50d3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:23.572747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-577393fb-77b5-486b-950e-cfbee3fa3d5a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:23.584956 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-577393fb-77b5-486b-950e-cfbee3fa3d5a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 0.591920 Jul 26 19:45:23.590815 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 243/541] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:22 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:23.605906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-93602196-8b71-444a-b576-15a4c09c0d9d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:23.610258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-93602196-8b71-444a-b576-15a4c09c0d9d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:23.625248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93602196-8b71-444a-b576-15a4c09c0d9d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:23.638172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93602196-8b71-444a-b576-15a4c09c0d9d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:23.639212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93602196-8b71-444a-b576-15a4c09c0d9d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:23.639847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93602196-8b71-444a-b576-15a4c09c0d9d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:23.793165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-96ac41ce-af5e-4990-ab74-eea0c84d50d3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:23.800747 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-96ac41ce-af5e-4990-ab74-eea0c84d50d3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1314 microversion: 2.1 time: 0.417310 Jul 26 19:45:23.801447 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 299/542] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:23 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:23.806118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4bb1cb7f-cede-4a43-80ce-76944220d593 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Action: 'create', calling method: .version_select at 0x7f876405b040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-53809535", "policies": ["affinity"]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:23.853520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4bb1cb7f-cede-4a43-80ce-76944220d593 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:23.859323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4bb1cb7f-cede-4a43-80ce-76944220d593 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:23.943239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4bb1cb7f-cede-4a43-80ce-76944220d593 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:23.949118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4bb1cb7f-cede-4a43-80ce-76944220d593 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:23.954263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:23.968821 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4bb1cb7f-cede-4a43-80ce-76944220d593 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.166250 Jul 26 19:45:23.984605 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 300/543] 10.222.0.58 () {60 vars in 1174 bytes} [Tue Jul 26 19:45:23 2022] POST /compute/v2.1/os-server-groups => generated 186 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:24.003934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-51c4b5e6-5d57-4c23-a795-943a7bde4637 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:24.006763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-51c4b5e6-5d57-4c23-a795-943a7bde4637 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:24.045959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51c4b5e6-5d57-4c23-a795-943a7bde4637 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:24.046967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51c4b5e6-5d57-4c23-a795-943a7bde4637 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:24.048058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51c4b5e6-5d57-4c23-a795-943a7bde4637 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:24.048730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51c4b5e6-5d57-4c23-a795-943a7bde4637 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:24.090905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-93602196-8b71-444a-b576-15a4c09c0d9d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:24.110969 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-93602196-8b71-444a-b576-15a4c09c0d9d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1508 microversion: 2.1 time: 0.518652 Jul 26 19:45:24.112544 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 244/544] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:23 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1508 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:24.160428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-568f1956-3810-424e-ad2f-e49bed6b91c7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:24.162577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-568f1956-3810-424e-ad2f-e49bed6b91c7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:24.184101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-568f1956-3810-424e-ad2f-e49bed6b91c7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:24.186351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-568f1956-3810-424e-ad2f-e49bed6b91c7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:24.188725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-568f1956-3810-424e-ad2f-e49bed6b91c7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:24.197219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-568f1956-3810-424e-ad2f-e49bed6b91c7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:24.437068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-51c4b5e6-5d57-4c23-a795-943a7bde4637 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:24.448875 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-51c4b5e6-5d57-4c23-a795-943a7bde4637 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.460370 Jul 26 19:45:24.465296 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 301/545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:23 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:24.491122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-443065268", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "bc722a98-7f2f-4f50-9e6f-6a5af61a22e2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:24.625851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:25.029658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-568f1956-3810-424e-ad2f-e49bed6b91c7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:25.041246 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-568f1956-3810-424e-ad2f-e49bed6b91c7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1508 microversion: 2.1 time: 0.911498 Jul 26 19:45:25.047413 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 245/546] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:24 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1508 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:25.062318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f2f7ab1-9db4-4775-b2d1-d194bd247fc0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:25.063349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f2f7ab1-9db4-4775-b2d1-d194bd247fc0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:25.073052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:25.073471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:25.073940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:25.074519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:25.075140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:25.085441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f2f7ab1-9db4-4775-b2d1-d194bd247fc0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:25.085889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f2f7ab1-9db4-4775-b2d1-d194bd247fc0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:25.086667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f2f7ab1-9db4-4775-b2d1-d194bd247fc0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:25.087208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f2f7ab1-9db4-4775-b2d1-d194bd247fc0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:25.108593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:25.109167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:25.110265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:25.110920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:25.134761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:25.140700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:25.156123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Going to run 2 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:25.159525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:25.210186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125963) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 26 19:45:25.234756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:25.240163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:25.292001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:25.309186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:25.332918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=0dc83fe1-fbb9-470d-91fa-cc759b3092b8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:25.400715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:25.407749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:25.454373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:25.461113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:25.515714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a8302c47-e42a-4c4c-9dc7-98eabd2aa9ce tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.048738 Jul 26 19:45:25.521544 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 302/547] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:45:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:45:25.529596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1657c63b-d625-44dd-8034-02445341d1b0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:25.530531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1657c63b-d625-44dd-8034-02445341d1b0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:25.539081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1657c63b-d625-44dd-8034-02445341d1b0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:25.545224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1657c63b-d625-44dd-8034-02445341d1b0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:25.546318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1657c63b-d625-44dd-8034-02445341d1b0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:25.546945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1657c63b-d625-44dd-8034-02445341d1b0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:25.585846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f2f7ab1-9db4-4775-b2d1-d194bd247fc0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:25.601968 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f2f7ab1-9db4-4775-b2d1-d194bd247fc0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1322 microversion: 2.1 time: 0.546967 Jul 26 19:45:25.607074 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 246/548] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:25 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:25.613736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:25.627170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:25.638641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:25.640922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:25.642114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:25.642920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:25.789103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:25.825542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:25.827153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:25.830752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:25.831403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:25.835336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:26.023182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:26.034966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:26.079095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:26.103811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.105138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.107084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.112609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.156204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1657c63b-d625-44dd-8034-02445341d1b0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:26.170298 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1657c63b-d625-44dd-8034-02445341d1b0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1314 microversion: 2.1 time: 0.646320 Jul 26 19:45:26.171436 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 303/549] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:25 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:26.179905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-062a343a-b5e5-436c-a2eb-f9f6a3bc1b23 req-d9a2a28c-2ca5-4cc1-b837-af5c02cb073d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "518653ad-beb2-4d83-8815-4de5fb8cfa13", "tag": "6f7bfc36-0441-48fa-a682-56cb3652edc3"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:26.202483 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-95def780-652d-4d70-8dfc-2919fdfa5ab5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "POST /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b/action" status: 202 len: 1110 microversion: 2.1 time: 0.585365 Jul 26 19:45:26.203497 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 247/550] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:25 2022] POST /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b/action => generated 1110 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 19:45:26.226136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c88757c-79b2-4304-8073-c3588a90a8e1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:26.226757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2c88757c-79b2-4304-8073-c3588a90a8e1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:26.235372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-062a343a-b5e5-436c-a2eb-f9f6a3bc1b23 req-d9a2a28c-2ca5-4cc1-b837-af5c02cb073d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.237415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-062a343a-b5e5-436c-a2eb-f9f6a3bc1b23 req-d9a2a28c-2ca5-4cc1-b837-af5c02cb073d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.249081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c88757c-79b2-4304-8073-c3588a90a8e1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.249782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c88757c-79b2-4304-8073-c3588a90a8e1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.250910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c88757c-79b2-4304-8073-c3588a90a8e1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.251580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c88757c-79b2-4304-8073-c3588a90a8e1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.299951 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-062a343a-b5e5-436c-a2eb-f9f6a3bc1b23 req-d9a2a28c-2ca5-4cc1-b837-af5c02cb073d service nova] Creating event network-changed:6f7bfc36-0441-48fa-a682-56cb3652edc3 for instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 on n-h1-708768-8 Jul 26 19:45:26.325581 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-062a343a-b5e5-436c-a2eb-f9f6a3bc1b23 req-d9a2a28c-2ca5-4cc1-b837-af5c02cb073d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152845 Jul 26 19:45:26.330346 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 304/551] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:26.362341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:26.384543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:26.396793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Searching by: {'deleted': False, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:26.438973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.452149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.453302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.456867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.494177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c88757c-79b2-4304-8073-c3588a90a8e1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:26.506036 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c88757c-79b2-4304-8073-c3588a90a8e1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.295918 Jul 26 19:45:26.508717 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 248/552] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:26 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:26.513844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85b289bf-daf3-4a90-a51c-cd203766a6a8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:26.514843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85b289bf-daf3-4a90-a51c-cd203766a6a8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:26.522088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85b289bf-daf3-4a90-a51c-cd203766a6a8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.522840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85b289bf-daf3-4a90-a51c-cd203766a6a8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.524113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85b289bf-daf3-4a90-a51c-cd203766a6a8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.524753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85b289bf-daf3-4a90-a51c-cd203766a6a8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.632820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:45:26.710550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85b289bf-daf3-4a90-a51c-cd203766a6a8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:26.719268 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85b289bf-daf3-4a90-a51c-cd203766a6a8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.209192 Jul 26 19:45:26.719806 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 249/553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:26 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:26.743463 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8960f5f4-6903-41dd-b781-2c1708cec0db tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.408471 Jul 26 19:45:26.744807 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 305/554] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 19:45:26 2022] GET /compute/v2.1/servers => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:26.751571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f81a99c-0dc8-41da-9229-961445611cb7 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:26.752594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f81a99c-0dc8-41da-9229-961445611cb7 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:26.759171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f81a99c-0dc8-41da-9229-961445611cb7 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.760315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f81a99c-0dc8-41da-9229-961445611cb7 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:26.761457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f81a99c-0dc8-41da-9229-961445611cb7 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:26.761902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f81a99c-0dc8-41da-9229-961445611cb7 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.062981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6f81a99c-0dc8-41da-9229-961445611cb7 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:27.078772 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f81a99c-0dc8-41da-9229-961445611cb7 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1472 microversion: 2.1 time: 0.326885 Jul 26 19:45:27.079648 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 306/555] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:26 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:27.090588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cca55aae-8bf2-4514-940f-82ed86d67c61 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:27.091221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cca55aae-8bf2-4514-940f-82ed86d67c61 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:27.116477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cca55aae-8bf2-4514-940f-82ed86d67c61 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.118567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cca55aae-8bf2-4514-940f-82ed86d67c61 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.119460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cca55aae-8bf2-4514-940f-82ed86d67c61 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.119930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cca55aae-8bf2-4514-940f-82ed86d67c61 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.166879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Action: 'update', calling method: .version_select at 0x7f87574910d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:27.170084 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:27.170084 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:45:27.171309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.171799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.230822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.232785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.252267 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] HTTP exception thrown: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Request method failure captured: Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde HTTP/1.1 Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 56 Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ERWG1wxyw-41a9Krto5iEvh0icS6j8yf0NQUrHmX22AZWdG4-X_9wmNH1m8p6eCRusQ5QY7twlZBa9iuF8EvXjJqiYdJmy_VP5udrNeq_Vc-DfvDQjQ3TKxXTjSjY_-TAmtIbaFLMVGaI3khJOVQyrBYfTsLL9mZM3aJccMETPXMZ4 Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 25852b32e4eb4b0ca8c1fa0039960145 Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:45:27.262233 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25852b32e4eb4b0ca8c1fa0039960145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25852b32e4eb4b0ca8c1fa0039960145"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25852b32e4eb4b0ca8c1fa0039960145", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25852b32e4eb4b0ca8c1fa0039960145"}]}] Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 25852b32e4eb4b0ca8c1fa0039960145 Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 68985284a31b41f5a02c33d5da12ba9f Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:45:27.264036 n-d-708768-8 devstack@n-api.service[125964]: exception: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a6a8442a-ce8e-487e-bc85-1ec92761abde', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.270242 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:27.271952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:27.274682 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:27.274682 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.274682 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.274682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Returning 404 to user: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:27.274682 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29d74673-bca8-40a9-888f-f454da7628cb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde" status: 404 len: 110 microversion: 2.53 time: 0.542836 Jul 26 19:45:27.274682 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 250/556] 10.222.0.58 () {62 vars in 1309 bytes} [Tue Jul 26 19:45:26 2022] PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde => generated 110 bytes in 544 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:45:27.462465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cca55aae-8bf2-4514-940f-82ed86d67c61 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:27.482704 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cca55aae-8bf2-4514-940f-82ed86d67c61 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1222 microversion: 2.1 time: 0.400455 Jul 26 19:45:27.485451 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 307/557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:27 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1222 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:27.496861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38e27007-6830-40a0-bf1a-429966fd8cc1 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:27.499038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-38e27007-6830-40a0-bf1a-429966fd8cc1 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:27.530605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38e27007-6830-40a0-bf1a-429966fd8cc1 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.531078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38e27007-6830-40a0-bf1a-429966fd8cc1 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.532664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38e27007-6830-40a0-bf1a-429966fd8cc1 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.534090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38e27007-6830-40a0-bf1a-429966fd8cc1 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.608108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-781f4f20-4719-49cd-9bec-d0d85d21e092 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:27.608693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-781f4f20-4719-49cd-9bec-d0d85d21e092 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] [instance: 554bc146-71d0-4d73-a48f-45438948b286] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:27.621453 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-781f4f20-4719-49cd-9bec-d0d85d21e092 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] HTTP exception thrown: Instance 554bc146-71d0-4d73-a48f-45438948b286 could not be found. Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-781f4f20-4719-49cd-9bec-d0d85d21e092 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Request method failure captured: Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/554bc146-71d0-4d73-a48f-45438948b286/action HTTP/1.1 Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 15 Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ7lCLfnyJkeIgTaBKjL-CnWR2yIlGy_hFuyUS5zibzmnIX8Glnw4d7tq0msi82i8CaFUU7156xCqT9BFAbtdOSGlEtzTmhIUzh-jMNOGqg7aXuk1b-NDhPmq02hn0CP9D2gYayKvC4WkE5qJp44Vu5SedOxk8i4JUA_8jqxeIxszk Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:45:27.623036 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b865e79ae79d4b2ba625b9a613942785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}] Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ceecf9c151284d4a8f28e690cda29942 Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: {"migrate": {}} Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:45:27.624481 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 554bc146-71d0-4d73-a48f-45438948b286 could not be found. Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '554bc146-71d0-4d73-a48f-45438948b286', 'body': {'migrate': {}}} Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554bc146-71d0-4d73-a48f-45438948b286 could not be found. Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:27.625353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554bc146-71d0-4d73-a48f-45438948b286 could not be found. Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554bc146-71d0-4d73-a48f-45438948b286 could not be found. Jul 26 19:45:27.626586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.627773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-781f4f20-4719-49cd-9bec-d0d85d21e092 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Returning 404 to user: Instance 554bc146-71d0-4d73-a48f-45438948b286 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:27.627773 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-781f4f20-4719-49cd-9bec-d0d85d21e092 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/554bc146-71d0-4d73-a48f-45438948b286/action" status: 404 len: 111 microversion: 2.1 time: 0.358433 Jul 26 19:45:27.661211 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 251/558] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:27 2022] POST /compute/v2.1/servers/554bc146-71d0-4d73-a48f-45438948b286/action => generated 111 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:45:27.686453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Action: 'update', calling method: .version_select at 0x7f875755f670>, body: {"status": "disabled"} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:27.727158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.728078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.750736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.751586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.767586 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] HTTP exception thrown: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Request method failure captured: Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde HTTP/1.1 Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 22 Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ERWG1wxyw-41a9Krto5iEvh0icS6j8yf0NQUrHmX22AZWdG4-X_9wmNH1m8p6eCRusQ5QY7twlZBa9iuF8EvXjJqiYdJmy_VP5udrNeq_Vc-DfvDQjQ3TKxXTjSjY_-TAmtIbaFLMVGaI3khJOVQyrBYfTsLL9mZM3aJccMETPXMZ4 Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 25852b32e4eb4b0ca8c1fa0039960145 Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:45:27.774623 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25852b32e4eb4b0ca8c1fa0039960145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25852b32e4eb4b0ca8c1fa0039960145"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25852b32e4eb4b0ca8c1fa0039960145", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25852b32e4eb4b0ca8c1fa0039960145"}]}] Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 25852b32e4eb4b0ca8c1fa0039960145 Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 68985284a31b41f5a02c33d5da12ba9f Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: {"status": "disabled"} Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: exception: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.776112 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a6a8442a-ce8e-487e-bc85-1ec92761abde', 'body': {'status': 'disabled'}} Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.777031 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:27.778266 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:27.779443 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:27.779443 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:27.783595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Returning 404 to user: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:27.787431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-108c8593-e294-4b24-b10a-71884fc173a5 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde" status: 404 len: 110 microversion: 2.53 time: 0.123688 Jul 26 19:45:27.789625 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 252/559] 10.222.0.58 () {62 vars in 1309 bytes} [Tue Jul 26 19:45:27 2022] PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde => generated 110 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:45:27.817488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-427dc2bc-09eb-4b10-963c-f01f634433a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:27.818841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-427dc2bc-09eb-4b10-963c-f01f634433a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:27.839130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-427dc2bc-09eb-4b10-963c-f01f634433a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.840764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-427dc2bc-09eb-4b10-963c-f01f634433a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:27.842648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-427dc2bc-09eb-4b10-963c-f01f634433a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:27.844333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-427dc2bc-09eb-4b10-963c-f01f634433a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:28.255918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-38e27007-6830-40a0-bf1a-429966fd8cc1 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:28.258099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-427dc2bc-09eb-4b10-963c-f01f634433a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:28.291708 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-427dc2bc-09eb-4b10-963c-f01f634433a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.491463 Jul 26 19:45:28.297224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-38e27007-6830-40a0-bf1a-429966fd8cc1 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1314 microversion: 2.1 time: 0.810313 Jul 26 19:45:28.307679 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 253/561] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:27 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:28.307998 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 308/561] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:27 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:28.308095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-62da3c3f-5304-45c8-ac62-62039ac077b6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:28.308095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-62da3c3f-5304-45c8-ac62-62039ac077b6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:28.313215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Action: 'update', calling method: .version_select at 0x7f875f6024c0>, body: {"status": "enabled"} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:28.320555 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:28.320555 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:45:28.322269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:28.322968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:28.323099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62da3c3f-5304-45c8-ac62-62039ac077b6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:28.323475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62da3c3f-5304-45c8-ac62-62039ac077b6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:28.324678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62da3c3f-5304-45c8-ac62-62039ac077b6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:28.325115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62da3c3f-5304-45c8-ac62-62039ac077b6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:28.362041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:28.363634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:28.381504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:28.399778 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] HTTP exception thrown: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Request method failure captured: Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde HTTP/1.1 Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 21 Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERWG1wxyw-41a9Krto5iEvh0icS6j8yf0NQUrHmX22AZWdG4-X_9wmNH1m8p6eCRusQ5QY7twlZBa9iuF8EvXjJqiYdJmy_VP5udrNeq_Vc-DfvDQjQ3TKxXTjSjY_-TAmtIbaFLMVGaI3khJOVQyrBYfTsLL9mZM3aJccMETPXMZ4 Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 25852b32e4eb4b0ca8c1fa0039960145 Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:45:28.408047 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25852b32e4eb4b0ca8c1fa0039960145"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25852b32e4eb4b0ca8c1fa0039960145"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25852b32e4eb4b0ca8c1fa0039960145", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25852b32e4eb4b0ca8c1fa0039960145"}]}] Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 25852b32e4eb4b0ca8c1fa0039960145 Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876 Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 68985284a31b41f5a02c33d5da12ba9f Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: {"status": "enabled"} Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: exception: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:28.409725 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a6a8442a-ce8e-487e-bc85-1ec92761abde', 'body': {'status': 'enabled'}} Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:28.411323 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:28.412986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:28.414399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. Jul 26 19:45:28.414399 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:28.415375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Returning 404 to user: Service a6a8442a-ce8e-487e-bc85-1ec92761abde could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:28.418391 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0ce8ca2-828a-44b7-89b5-1f85c5d8278c tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde" status: 404 len: 110 microversion: 2.53 time: 0.116901 Jul 26 19:45:28.425565 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 309/562] 10.222.0.58 () {62 vars in 1309 bytes} [Tue Jul 26 19:45:28 2022] PUT /compute/v2.1/os-services/a6a8442a-ce8e-487e-bc85-1ec92761abde => generated 110 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:45:28.438872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-525467678", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:28.569661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:28.872825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62da3c3f-5304-45c8-ac62-62039ac077b6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:28.892058 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-62da3c3f-5304-45c8-ac62-62039ac077b6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.586493 Jul 26 19:45:28.896058 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 254/563] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:28 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:28.910924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-01bb3730-53c8-4779-8a87-031307d7c7b6 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:28.914596 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:28.914596 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:45:28.916726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01bb3730-53c8-4779-8a87-031307d7c7b6 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:28.917546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01bb3730-53c8-4779-8a87-031307d7c7b6 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:28.918538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01bb3730-53c8-4779-8a87-031307d7c7b6 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:28.919134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01bb3730-53c8-4779-8a87-031307d7c7b6 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:28.965608 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-01bb3730-53c8-4779-8a87-031307d7c7b6 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.068005 Jul 26 19:45:28.967125 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 255/564] 10.222.0.58 () {60 vars in 1178 bytes} [Tue Jul 26 19:45:28 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:28.978076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-929523b2-5b13-4d0d-b8e6-bc1e4f983f57 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:28.978698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-929523b2-5b13-4d0d-b8e6-bc1e4f983f57 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:28.984942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-929523b2-5b13-4d0d-b8e6-bc1e4f983f57 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:28.985397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-929523b2-5b13-4d0d-b8e6-bc1e4f983f57 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:28.986180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-929523b2-5b13-4d0d-b8e6-bc1e4f983f57 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:28.986624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-929523b2-5b13-4d0d-b8e6-bc1e4f983f57 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:29.530199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-929523b2-5b13-4d0d-b8e6-bc1e4f983f57 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:29.543417 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-929523b2-5b13-4d0d-b8e6-bc1e4f983f57 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1276 microversion: 2.1 time: 0.574579 Jul 26 19:45:29.544558 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 256/565] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:28 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1276 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:29.549610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45a965ef-60b2-46a3-b719-a86f25c3c344 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:29.557126 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:29.557126 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:45:29.563112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45a965ef-60b2-46a3-b719-a86f25c3c344 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:29.565849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45a965ef-60b2-46a3-b719-a86f25c3c344 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:29.569025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45a965ef-60b2-46a3-b719-a86f25c3c344 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:29.569763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45a965ef-60b2-46a3-b719-a86f25c3c344 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:29.632415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45a965ef-60b2-46a3-b719-a86f25c3c344 tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.086018 Jul 26 19:45:29.633716 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 257/566] 10.222.0.58 () {60 vars in 1211 bytes} [Tue Jul 26 19:45:29 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:29.650809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-901f4a82-cc27-474d-8191-f651db9f6341 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:29.659856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-901f4a82-cc27-474d-8191-f651db9f6341 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:29.683343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-901f4a82-cc27-474d-8191-f651db9f6341 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:29.683912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-901f4a82-cc27-474d-8191-f651db9f6341 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:29.684717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-901f4a82-cc27-474d-8191-f651db9f6341 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:29.685349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-901f4a82-cc27-474d-8191-f651db9f6341 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:29.974371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-901f4a82-cc27-474d-8191-f651db9f6341 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:29.991583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-901f4a82-cc27-474d-8191-f651db9f6341 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1314 microversion: 2.1 time: 0.352293 Jul 26 19:45:29.998569 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 258/567] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:29 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:30.005736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b6ee9b4-8ca0-432a-98b7-e75a005e394f tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:30.006615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1b6ee9b4-8ca0-432a-98b7-e75a005e394f tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:30.025078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b6ee9b4-8ca0-432a-98b7-e75a005e394f tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.026668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b6ee9b4-8ca0-432a-98b7-e75a005e394f tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.029701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b6ee9b4-8ca0-432a-98b7-e75a005e394f tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.030326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b6ee9b4-8ca0-432a-98b7-e75a005e394f tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.119092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:30.119637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:30.120231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:30.120874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:30.121903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:30.136685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.137570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.140080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.140842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.227440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Getting quotas for project b48045503d694e099175d17a83f0d4fa. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:30.233271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Getting quotas for user 9c4a54c0a0134fd0b636ff057c200b61 and project b48045503d694e099175d17a83f0d4fa. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:30.243767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:30.265022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:30.268100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:30.344380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5bf00a4b-647f-46c7-b138-374b636fdd92 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.910641 Jul 26 19:45:30.345338 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 310/568] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:45:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:45:30.357204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a7ae2cff-209b-4a91-b820-42eb747a63ab tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:30.366720 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:30.366720 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:45:30.368837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7ae2cff-209b-4a91-b820-42eb747a63ab tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.370937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7ae2cff-209b-4a91-b820-42eb747a63ab tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.373397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7ae2cff-209b-4a91-b820-42eb747a63ab tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.381656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7ae2cff-209b-4a91-b820-42eb747a63ab tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.451349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a7ae2cff-209b-4a91-b820-42eb747a63ab tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.101052 Jul 26 19:45:30.460487 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 311/569] 10.222.0.58 () {60 vars in 1178 bytes} [Tue Jul 26 19:45:30 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:30.465792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a2b9ef9-3db2-4657-8765-82cf26c62a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:30.466758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a2b9ef9-3db2-4657-8765-82cf26c62a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:30.482917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a2b9ef9-3db2-4657-8765-82cf26c62a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.483713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a2b9ef9-3db2-4657-8765-82cf26c62a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.484815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a2b9ef9-3db2-4657-8765-82cf26c62a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.485467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a2b9ef9-3db2-4657-8765-82cf26c62a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.580293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1b6ee9b4-8ca0-432a-98b7-e75a005e394f tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:30.590749 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b6ee9b4-8ca0-432a-98b7-e75a005e394f tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.590604 Jul 26 19:45:30.592071 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 259/570] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:29 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:30.600091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0033d3df-a90d-48de-9449-73864d835bf5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:30.601040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0033d3df-a90d-48de-9449-73864d835bf5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:30.821162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a2b9ef9-3db2-4657-8765-82cf26c62a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:30.829844 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a2b9ef9-3db2-4657-8765-82cf26c62a8d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.367848 Jul 26 19:45:30.830436 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 312/571] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:30 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:30.847322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45c75c6e-ab66-4275-961b-bc4def1cc9eb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:30.850125 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:30.850125 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:45:30.851505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45c75c6e-ab66-4275-961b-bc4def1cc9eb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.852429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45c75c6e-ab66-4275-961b-bc4def1cc9eb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.853274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45c75c6e-ab66-4275-961b-bc4def1cc9eb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.853679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45c75c6e-ab66-4275-961b-bc4def1cc9eb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.876267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0033d3df-a90d-48de-9449-73864d835bf5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:30.893356 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0033d3df-a90d-48de-9449-73864d835bf5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1221 microversion: 2.1 time: 0.298179 Jul 26 19:45:30.894134 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 260/572] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:30 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1221 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:30.914578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8bba1849-1fe7-400a-a73d-95e086fa2dd1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:30.928764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8bba1849-1fe7-400a-a73d-95e086fa2dd1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:30.931870 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45c75c6e-ab66-4275-961b-bc4def1cc9eb tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-708768-8&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.100021 Jul 26 19:45:30.933043 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 313/573] 10.222.0.58 () {60 vars in 1235 bytes} [Tue Jul 26 19:45:30 2022] GET /compute/v2.1/os-services?host=n-d-708768-8&binary=xxx => generated 16 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:30.944068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8bba1849-1fe7-400a-a73d-95e086fa2dd1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.948249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3b6d716-3a41-4052-9bc9-4665a0e0288a tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:30.956726 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:30.956726 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:45:30.958175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3b6d716-3a41-4052-9bc9-4665a0e0288a tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.958862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8bba1849-1fe7-400a-a73d-95e086fa2dd1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.961840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3b6d716-3a41-4052-9bc9-4665a0e0288a tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.962862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8bba1849-1fe7-400a-a73d-95e086fa2dd1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.963386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8bba1849-1fe7-400a-a73d-95e086fa2dd1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:30.964713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3b6d716-3a41-4052-9bc9-4665a0e0288a tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:30.965756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3b6d716-3a41-4052-9bc9-4665a0e0288a tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:31.032052 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3b6d716-3a41-4052-9bc9-4665a0e0288a tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.091152 Jul 26 19:45:31.041149 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 314/574] 10.222.0.58 () {60 vars in 1178 bytes} [Tue Jul 26 19:45:30 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:31.048867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85fd413b-2465-4105-8329-d8f148c9520d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:31.054574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-85fd413b-2465-4105-8329-d8f148c9520d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:31.067904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85fd413b-2465-4105-8329-d8f148c9520d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:31.073425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85fd413b-2465-4105-8329-d8f148c9520d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:31.074435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85fd413b-2465-4105-8329-d8f148c9520d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:31.076108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85fd413b-2465-4105-8329-d8f148c9520d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:31.355145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8bba1849-1fe7-400a-a73d-95e086fa2dd1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:31.383462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8bba1849-1fe7-400a-a73d-95e086fa2dd1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1318 microversion: 2.1 time: 0.487261 Jul 26 19:45:31.392973 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 261/575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:30 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:31.417161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe298e46-de87-41a5-bc12-f67cf59f6e2d tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:31.421231 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:31.421231 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:45:31.424184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe298e46-de87-41a5-bc12-f67cf59f6e2d tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:31.425864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe298e46-de87-41a5-bc12-f67cf59f6e2d tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:31.427642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe298e46-de87-41a5-bc12-f67cf59f6e2d tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:31.428452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe298e46-de87-41a5-bc12-f67cf59f6e2d tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:31.452615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:31.466325 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe298e46-de87-41a5-bc12-f67cf59f6e2d tempest-ServicesAdminNegativeV253TestJSON-2044390876 tempest-ServicesAdminNegativeV253TestJSON-2044390876-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.071149 Jul 26 19:45:31.476770 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 262/576] 10.222.0.58 () {60 vars in 1239 bytes} [Tue Jul 26 19:45:31 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:31.683741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ed0dcb5-0c91-4ad0-83ee-90828607de2b tempest-ServicesAdminNegativeV253TestJSON-128533086 tempest-ServicesAdminNegativeV253TestJSON-128533086-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:31.686659 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:31.686659 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:45:31.689527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ed0dcb5-0c91-4ad0-83ee-90828607de2b tempest-ServicesAdminNegativeV253TestJSON-128533086 tempest-ServicesAdminNegativeV253TestJSON-128533086-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e6763e448bef413eb0bda7e71a044900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8937a4a5591349888a21da42ae46846d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ed0dcb5-0c91-4ad0-83ee-90828607de2b tempest-ServicesAdminNegativeV253TestJSON-128533086 tempest-ServicesAdminNegativeV253TestJSON-128533086-project] Request method failure captured: Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ERV1j9AiHytv3ezPxFfr5m7wBW3go_THelALvfqe6jJUQViB37mDsmVjQoCOS95_NCtRPDBLPzhgB6hwHvKOwzEozA7QmRihs6Vr19cD_c-O5O2nCpWymqTP5AeMZQpvKwXEEn85mxRr692GOXr1kiPjARM-nO897R_6_xSk433Vv8 Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 8937a4a5591349888a21da42ae46846d Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-128533086 Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:45:31.692124 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8937a4a5591349888a21da42ae46846d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8937a4a5591349888a21da42ae46846d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8937a4a5591349888a21da42ae46846d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8937a4a5591349888a21da42ae46846d"}]}] Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-128533086 Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 8937a4a5591349888a21da42ae46846d Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-128533086 Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServicesAdminNegativeV253TestJSON-128533086-project Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: e6763e448bef413eb0bda7e71a044900 Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-128533086-project Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 19:45:31.693808 n-d-708768-8 devstack@n-api.service[125964]: action_args: {} Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:45:31.694690 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 19:45:31.696153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:31.698811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ed0dcb5-0c91-4ad0-83ee-90828607de2b tempest-ServicesAdminNegativeV253TestJSON-128533086 tempest-ServicesAdminNegativeV253TestJSON-128533086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:31.700181 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ed0dcb5-0c91-4ad0-83ee-90828607de2b tempest-ServicesAdminNegativeV253TestJSON-128533086 tempest-ServicesAdminNegativeV253TestJSON-128533086-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.221911 Jul 26 19:45:31.700890 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 263/577] 10.222.0.58 () {60 vars in 1178 bytes} [Tue Jul 26 19:45:31 2022] GET /compute/v2.1/os-services => generated 112 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:45:31.705790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c077bfb6-f757-4305-999e-8545a891ed78 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:31.708885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c077bfb6-f757-4305-999e-8545a891ed78 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:31.726347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c077bfb6-f757-4305-999e-8545a891ed78 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:31.726987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c077bfb6-f757-4305-999e-8545a891ed78 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:31.728222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c077bfb6-f757-4305-999e-8545a891ed78 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:31.732141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c077bfb6-f757-4305-999e-8545a891ed78 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:31.831321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-85fd413b-2465-4105-8329-d8f148c9520d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:31.848606 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85fd413b-2465-4105-8329-d8f148c9520d tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1314 microversion: 2.1 time: 0.804031 Jul 26 19:45:31.850651 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 315/578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:31 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:31.875296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31cfa034-b60d-4fa7-9c7b-071e6e06a095 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:31.882334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-31cfa034-b60d-4fa7-9c7b-071e6e06a095 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:31.939867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31cfa034-b60d-4fa7-9c7b-071e6e06a095 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:31.943794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31cfa034-b60d-4fa7-9c7b-071e6e06a095 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:31.959359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31cfa034-b60d-4fa7-9c7b-071e6e06a095 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:31.960225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31cfa034-b60d-4fa7-9c7b-071e6e06a095 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:32.241347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c077bfb6-f757-4305-999e-8545a891ed78 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:32.256567 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c077bfb6-f757-4305-999e-8545a891ed78 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.552078 Jul 26 19:45:32.258950 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 264/579] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:31 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:32.283493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5a2ed784-d499-4cfa-b540-73e234e015c0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:32.284567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a2ed784-d499-4cfa-b540-73e234e015c0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:32.297941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a2ed784-d499-4cfa-b540-73e234e015c0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:32.298915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a2ed784-d499-4cfa-b540-73e234e015c0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:32.299958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a2ed784-d499-4cfa-b540-73e234e015c0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:32.304074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a2ed784-d499-4cfa-b540-73e234e015c0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:32.422001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5a2ed784-d499-4cfa-b540-73e234e015c0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:32.431116 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5a2ed784-d499-4cfa-b540-73e234e015c0 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1291 microversion: 2.1 time: 0.167816 Jul 26 19:45:32.431707 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 265/580] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:32 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1291 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:32.444980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f0de0fe-df37-4ea6-9302-1a234eb6cc52 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:32.445596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f0de0fe-df37-4ea6-9302-1a234eb6cc52 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:32.460354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f0de0fe-df37-4ea6-9302-1a234eb6cc52 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:32.461325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f0de0fe-df37-4ea6-9302-1a234eb6cc52 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:32.462118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f0de0fe-df37-4ea6-9302-1a234eb6cc52 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:32.462737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f0de0fe-df37-4ea6-9302-1a234eb6cc52 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:32.652050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-31cfa034-b60d-4fa7-9c7b-071e6e06a095 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:32.662198 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31cfa034-b60d-4fa7-9c7b-071e6e06a095 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.792732 Jul 26 19:45:32.663540 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 316/581] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:31 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:32.710780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d897fc6f-f139-46ef-9dad-3b3e25241dba req-1e07b2ef-d551-496f-a156-3dd8a78280ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b429ee74-71db-44cc-90d7-640d054b87e7", "tag": "a4f5599c-3151-46aa-986e-d0150a19caf0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:32.730014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d897fc6f-f139-46ef-9dad-3b3e25241dba req-1e07b2ef-d551-496f-a156-3dd8a78280ff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:32.731656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d897fc6f-f139-46ef-9dad-3b3e25241dba req-1e07b2ef-d551-496f-a156-3dd8a78280ff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:32.754995 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d897fc6f-f139-46ef-9dad-3b3e25241dba req-1e07b2ef-d551-496f-a156-3dd8a78280ff service nova] Creating event network-changed:a4f5599c-3151-46aa-986e-d0150a19caf0 for instance b429ee74-71db-44cc-90d7-640d054b87e7 on n-h2-708768-8 Jul 26 19:45:32.761564 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d897fc6f-f139-46ef-9dad-3b3e25241dba req-1e07b2ef-d551-496f-a156-3dd8a78280ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056101 Jul 26 19:45:32.762717 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 317/582] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:32.827284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f0de0fe-df37-4ea6-9302-1a234eb6cc52 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:32.836423 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f0de0fe-df37-4ea6-9302-1a234eb6cc52 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1318 microversion: 2.1 time: 0.400298 Jul 26 19:45:32.840820 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 266/583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:32 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:32.898532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41111dc1-5ad4-4f61-976e-8ca8335e0c15 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:32.899863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41111dc1-5ad4-4f61-976e-8ca8335e0c15 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:32.913824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41111dc1-5ad4-4f61-976e-8ca8335e0c15 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:32.917530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41111dc1-5ad4-4f61-976e-8ca8335e0c15 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:32.918519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41111dc1-5ad4-4f61-976e-8ca8335e0c15 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:32.919029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41111dc1-5ad4-4f61-976e-8ca8335e0c15 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:33.264636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e6d1ce6b-ed14-4949-a2cc-f5a702da2c36 req-b93ae204-5967-4ef2-bb21-08f31d70aaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518653ad-beb2-4d83-8815-4de5fb8cfa13", "name": "network-vif-plugged", "status": "completed", "tag": "6f7bfc36-0441-48fa-a682-56cb3652edc3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:33.273371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-41111dc1-5ad4-4f61-976e-8ca8335e0c15 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:33.288290 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41111dc1-5ad4-4f61-976e-8ca8335e0c15 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1314 microversion: 2.1 time: 0.415564 Jul 26 19:45:33.289522 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 318/584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:32 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:33.293483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e6d1ce6b-ed14-4949-a2cc-f5a702da2c36 req-b93ae204-5967-4ef2-bb21-08f31d70aaa3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:33.294221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e6d1ce6b-ed14-4949-a2cc-f5a702da2c36 req-b93ae204-5967-4ef2-bb21-08f31d70aaa3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:33.305129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e45d1e50-6105-4121-8c1c-b98ff4c2734e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:33.307876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e45d1e50-6105-4121-8c1c-b98ff4c2734e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:33.323933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e45d1e50-6105-4121-8c1c-b98ff4c2734e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:33.329988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e45d1e50-6105-4121-8c1c-b98ff4c2734e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:33.330942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e45d1e50-6105-4121-8c1c-b98ff4c2734e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:33.333580 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e6d1ce6b-ed14-4949-a2cc-f5a702da2c36 req-b93ae204-5967-4ef2-bb21-08f31d70aaa3 service nova] Creating event network-vif-plugged:6f7bfc36-0441-48fa-a682-56cb3652edc3 for instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 on n-h1-708768-8 Jul 26 19:45:33.334046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e45d1e50-6105-4121-8c1c-b98ff4c2734e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:33.346185 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e6d1ce6b-ed14-4949-a2cc-f5a702da2c36 req-b93ae204-5967-4ef2-bb21-08f31d70aaa3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085721 Jul 26 19:45:33.366672 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 267/585] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:45:33.454745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b7a3d1e-e53e-4cc9-bfe7-ca6dac0382bc tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:33.456374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b7a3d1e-e53e-4cc9-bfe7-ca6dac0382bc tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:33.465317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b7a3d1e-e53e-4cc9-bfe7-ca6dac0382bc tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:33.466150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b7a3d1e-e53e-4cc9-bfe7-ca6dac0382bc tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:33.467832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b7a3d1e-e53e-4cc9-bfe7-ca6dac0382bc tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:33.471216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b7a3d1e-e53e-4cc9-bfe7-ca6dac0382bc tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:33.604599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b7a3d1e-e53e-4cc9-bfe7-ca6dac0382bc tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:33.621156 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b7a3d1e-e53e-4cc9-bfe7-ca6dac0382bc tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1279 microversion: 2.1 time: 0.170826 Jul 26 19:45:33.636564 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 268/586] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:33 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:33.685445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d8ebc3ab-a26e-41fd-91be-43e1dd70c285 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:33.686346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d8ebc3ab-a26e-41fd-91be-43e1dd70c285 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:33.744880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8ebc3ab-a26e-41fd-91be-43e1dd70c285 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:33.748126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8ebc3ab-a26e-41fd-91be-43e1dd70c285 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:33.754647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8ebc3ab-a26e-41fd-91be-43e1dd70c285 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:33.760011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8ebc3ab-a26e-41fd-91be-43e1dd70c285 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:33.858386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:34.081313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e45d1e50-6105-4121-8c1c-b98ff4c2734e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:34.094718 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e45d1e50-6105-4121-8c1c-b98ff4c2734e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.800948 Jul 26 19:45:34.097876 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 319/587] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:33 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:34.103174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d8721e9-651a-4e2c-a472-08d180a3b674 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:34.106371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9d8721e9-651a-4e2c-a472-08d180a3b674 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:34.123378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d8721e9-651a-4e2c-a472-08d180a3b674 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:34.123941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d8721e9-651a-4e2c-a472-08d180a3b674 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:34.124722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d8721e9-651a-4e2c-a472-08d180a3b674 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:34.125157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d8721e9-651a-4e2c-a472-08d180a3b674 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:34.320592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d8ebc3ab-a26e-41fd-91be-43e1dd70c285 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:34.329831 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d8ebc3ab-a26e-41fd-91be-43e1dd70c285 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.649048 Jul 26 19:45:34.330277 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 269/588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:33 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:34.344712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7135c026-10a1-424d-b144-1026f15e63eb req-a0d50ead-339b-4d15-9663-e0870fd6862c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc83fe1-fbb9-470d-91fa-cc759b3092b8", "tag": "96ea90af-6318-4941-8fef-4b941cfc947a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:34.363518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7135c026-10a1-424d-b144-1026f15e63eb req-a0d50ead-339b-4d15-9663-e0870fd6862c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:34.364261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7135c026-10a1-424d-b144-1026f15e63eb req-a0d50ead-339b-4d15-9663-e0870fd6862c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:34.386996 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7135c026-10a1-424d-b144-1026f15e63eb req-a0d50ead-339b-4d15-9663-e0870fd6862c service nova] Creating event network-changed:96ea90af-6318-4941-8fef-4b941cfc947a for instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 on n-h2-708768-8 Jul 26 19:45:34.401399 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7135c026-10a1-424d-b144-1026f15e63eb req-a0d50ead-339b-4d15-9663-e0870fd6862c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069888 Jul 26 19:45:34.402021 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 270/589] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:34.403458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9d8721e9-651a-4e2c-a472-08d180a3b674 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:34.414138 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9d8721e9-651a-4e2c-a472-08d180a3b674 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1318 microversion: 2.1 time: 0.314079 Jul 26 19:45:34.416005 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 320/590] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:34 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:34.417076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7a22ed4a-c3b3-48f4-a71d-78c3c939c018 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:34.417809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7a22ed4a-c3b3-48f4-a71d-78c3c939c018 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:34.424405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a22ed4a-c3b3-48f4-a71d-78c3c939c018 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:34.427156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a22ed4a-c3b3-48f4-a71d-78c3c939c018 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:34.428333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a22ed4a-c3b3-48f4-a71d-78c3c939c018 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:34.429016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a22ed4a-c3b3-48f4-a71d-78c3c939c018 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:34.648183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4edd7123-a0c6-4d18-8442-3c4552faf10f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:34.649908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4edd7123-a0c6-4d18-8442-3c4552faf10f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:34.657137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4edd7123-a0c6-4d18-8442-3c4552faf10f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:34.657993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4edd7123-a0c6-4d18-8442-3c4552faf10f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:34.659020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4edd7123-a0c6-4d18-8442-3c4552faf10f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:34.660026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4edd7123-a0c6-4d18-8442-3c4552faf10f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:34.852570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4edd7123-a0c6-4d18-8442-3c4552faf10f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:34.861513 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4edd7123-a0c6-4d18-8442-3c4552faf10f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1321 microversion: 2.1 time: 0.218901 Jul 26 19:45:34.904141 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 321/591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:34 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:35.044024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a22ed4a-c3b3-48f4-a71d-78c3c939c018 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:35.054746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7a22ed4a-c3b3-48f4-a71d-78c3c939c018 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1314 microversion: 2.1 time: 0.650269 Jul 26 19:45:35.072490 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 271/592] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:34 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:35.120889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-808f2d2d-0408-48fd-a113-013725ee3bb8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:35.122155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-808f2d2d-0408-48fd-a113-013725ee3bb8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:35.129592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-808f2d2d-0408-48fd-a113-013725ee3bb8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.130534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-808f2d2d-0408-48fd-a113-013725ee3bb8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:35.131664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-808f2d2d-0408-48fd-a113-013725ee3bb8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.132362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-808f2d2d-0408-48fd-a113-013725ee3bb8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:35.356979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2742303b-4c86-410b-a698-5365f37bea8e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:35.357904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2742303b-4c86-410b-a698-5365f37bea8e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:35.366999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2742303b-4c86-410b-a698-5365f37bea8e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.367802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2742303b-4c86-410b-a698-5365f37bea8e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:35.369607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2742303b-4c86-410b-a698-5365f37bea8e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.370558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2742303b-4c86-410b-a698-5365f37bea8e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:35.469935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-808f2d2d-0408-48fd-a113-013725ee3bb8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:35.479261 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-808f2d2d-0408-48fd-a113-013725ee3bb8 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.362190 Jul 26 19:45:35.493175 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 322/593] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:35 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:35.503816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ed80a7c3-e8a4-4708-8901-4ab2bc173312 req-798fde09-7329-489a-940d-55c5807bc15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ef3743-f705-4e52-bb3c-e5891eab0512", "name": "network-vif-plugged", "status": "completed", "tag": "3d99ffec-3261-4711-ad8b-3f9d9b36eec8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:35.517801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ed80a7c3-e8a4-4708-8901-4ab2bc173312 req-798fde09-7329-489a-940d-55c5807bc15d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.518469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ed80a7c3-e8a4-4708-8901-4ab2bc173312 req-798fde09-7329-489a-940d-55c5807bc15d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:35.535018 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ed80a7c3-e8a4-4708-8901-4ab2bc173312 req-798fde09-7329-489a-940d-55c5807bc15d service nova] Creating event network-vif-plugged:3d99ffec-3261-4711-ad8b-3f9d9b36eec8 for instance 94ef3743-f705-4e52-bb3c-e5891eab0512 on n-h2-708768-8 Jul 26 19:45:35.541558 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ed80a7c3-e8a4-4708-8901-4ab2bc173312 req-798fde09-7329-489a-940d-55c5807bc15d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046500 Jul 26 19:45:35.542553 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 323/594] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:35.552302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-502181b9-fbd1-4e27-862e-e419571f7e27 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:35.553311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-502181b9-fbd1-4e27-862e-e419571f7e27 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:35.560655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-502181b9-fbd1-4e27-862e-e419571f7e27 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.561468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-502181b9-fbd1-4e27-862e-e419571f7e27 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:35.562472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-502181b9-fbd1-4e27-862e-e419571f7e27 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.563147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-502181b9-fbd1-4e27-862e-e419571f7e27 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:35.885284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2742303b-4c86-410b-a698-5365f37bea8e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:35.890599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-502181b9-fbd1-4e27-862e-e419571f7e27 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:35.894625 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2742303b-4c86-410b-a698-5365f37bea8e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.543868 Jul 26 19:45:35.898517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-502181b9-fbd1-4e27-862e-e419571f7e27 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1318 microversion: 2.1 time: 0.353248 Jul 26 19:45:35.899639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 324/595] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:35 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:35.905009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b88bb80-c287-4c5f-a238-db698237a1e5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:35.905872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9b88bb80-c287-4c5f-a238-db698237a1e5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:35.911394 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 272/596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:35 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:35.922891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b88bb80-c287-4c5f-a238-db698237a1e5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.923463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b88bb80-c287-4c5f-a238-db698237a1e5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:35.924490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b88bb80-c287-4c5f-a238-db698237a1e5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:35.925283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b88bb80-c287-4c5f-a238-db698237a1e5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:36.080923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ecf010a5-172b-40bb-b96d-7699fedf3b7b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:36.081731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ecf010a5-172b-40bb-b96d-7699fedf3b7b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:36.108264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecf010a5-172b-40bb-b96d-7699fedf3b7b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:36.110036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecf010a5-172b-40bb-b96d-7699fedf3b7b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:36.113005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecf010a5-172b-40bb-b96d-7699fedf3b7b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:36.115658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecf010a5-172b-40bb-b96d-7699fedf3b7b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:36.128793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9b88bb80-c287-4c5f-a238-db698237a1e5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:36.138968 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9b88bb80-c287-4c5f-a238-db698237a1e5 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1321 microversion: 2.1 time: 0.237936 Jul 26 19:45:36.151769 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 325/597] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:35 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:36.506307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45299ad8-1363-4138-a572-9354b995f40d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:36.508117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-45299ad8-1363-4138-a572-9354b995f40d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:36.521859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45299ad8-1363-4138-a572-9354b995f40d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:36.522506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45299ad8-1363-4138-a572-9354b995f40d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:36.523788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45299ad8-1363-4138-a572-9354b995f40d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:36.525509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45299ad8-1363-4138-a572-9354b995f40d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:36.673451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ecf010a5-172b-40bb-b96d-7699fedf3b7b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:36.688162 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ecf010a5-172b-40bb-b96d-7699fedf3b7b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1463 microversion: 2.1 time: 0.613261 Jul 26 19:45:36.698790 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 273/598] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:36 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1463 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:36.840342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-45299ad8-1363-4138-a572-9354b995f40d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:36.849770 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45299ad8-1363-4138-a572-9354b995f40d tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1371 microversion: 2.1 time: 0.349145 Jul 26 19:45:36.853836 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 326/599] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:36 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:36.875530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-72e69a2a-b714-4814-8264-41803115c93d req-a5fd885e-f1d1-4220-a9c8-0abaed774bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb4bb85-05be-4add-898f-be82c0375754", "tag": "718edf50-d6e3-4c55-8013-d795ca6662f9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:36.896564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-72e69a2a-b714-4814-8264-41803115c93d req-a5fd885e-f1d1-4220-a9c8-0abaed774bf5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:36.897929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-72e69a2a-b714-4814-8264-41803115c93d req-a5fd885e-f1d1-4220-a9c8-0abaed774bf5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:36.933969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-72e69a2a-b714-4814-8264-41803115c93d req-a5fd885e-f1d1-4220-a9c8-0abaed774bf5 service nova] Creating event network-changed:718edf50-d6e3-4c55-8013-d795ca6662f9 for instance 8cb4bb85-05be-4add-898f-be82c0375754 on n-h1-708768-8 Jul 26 19:45:36.943079 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-72e69a2a-b714-4814-8264-41803115c93d req-a5fd885e-f1d1-4220-a9c8-0abaed774bf5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083222 Jul 26 19:45:36.944254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 327/600] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:36.950066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a7bccc3-dbf6-4394-ab46-17ef9d98c0fa tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:36.951175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a7bccc3-dbf6-4394-ab46-17ef9d98c0fa tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:36.958750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7bccc3-dbf6-4394-ab46-17ef9d98c0fa tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:36.959524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7bccc3-dbf6-4394-ab46-17ef9d98c0fa tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:36.960514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7bccc3-dbf6-4394-ab46-17ef9d98c0fa tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:36.961979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7bccc3-dbf6-4394-ab46-17ef9d98c0fa tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.265953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5a6f630c-f994-4d83-96f6-36c787d3ab8f tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:37.269453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1a7bccc3-dbf6-4394-ab46-17ef9d98c0fa tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:37.272405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a6f630c-f994-4d83-96f6-36c787d3ab8f tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Searching by: {'deleted': False, 'project_id': 'e58f36b8d630448e9fb2b5ed99e0c95c'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:37.278416 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a7bccc3-dbf6-4394-ab46-17ef9d98c0fa tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1318 microversion: 2.1 time: 0.332107 Jul 26 19:45:37.278933 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 328/601] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:36 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:37.291688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a6f630c-f994-4d83-96f6-36c787d3ab8f tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.294991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a6f630c-f994-4d83-96f6-36c787d3ab8f tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.298469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a6f630c-f994-4d83-96f6-36c787d3ab8f tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.300481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a6f630c-f994-4d83-96f6-36c787d3ab8f tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.305955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b28d145-3a22-4c44-8e95-9c9294b40ecf tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:37.306566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b28d145-3a22-4c44-8e95-9c9294b40ecf tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:37.321960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b28d145-3a22-4c44-8e95-9c9294b40ecf tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.322416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b28d145-3a22-4c44-8e95-9c9294b40ecf tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.323218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b28d145-3a22-4c44-8e95-9c9294b40ecf tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.323668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b28d145-3a22-4c44-8e95-9c9294b40ecf tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.513688 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5a6f630c-f994-4d83-96f6-36c787d3ab8f tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.801903 Jul 26 19:45:37.514282 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 274/602] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:45:36 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 19:45:37.522465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df528929-45e5-4b5f-ad6a-214e56072182 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:37.525013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df528929-45e5-4b5f-ad6a-214e56072182 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:37.531568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df528929-45e5-4b5f-ad6a-214e56072182 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.532287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df528929-45e5-4b5f-ad6a-214e56072182 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.533095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df528929-45e5-4b5f-ad6a-214e56072182 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.533515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df528929-45e5-4b5f-ad6a-214e56072182 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.562416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2b28d145-3a22-4c44-8e95-9c9294b40ecf tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:37.572840 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b28d145-3a22-4c44-8e95-9c9294b40ecf tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.275966 Jul 26 19:45:37.573726 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 329/603] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:37 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:37.698801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9570895e-e2de-4923-92a5-2a26a2a2d29b tempest-FlavorsV2NegativeTest-1144175568 tempest-FlavorsV2NegativeTest-1144175568-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:37.707668 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9570895e-e2de-4923-92a5-2a26a2a2d29b tempest-FlavorsV2NegativeTest-1144175568 tempest-FlavorsV2NegativeTest-1144175568-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.131694 Jul 26 19:45:37.714238 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 330/604] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:45:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:37.718542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:37.728299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Searching by: {'deleted': False} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:37.743986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.744568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.745611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.746951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:37.892396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:45:37.964925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:37.997491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:37.998198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:38.093152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-df528929-45e5-4b5f-ad6a-214e56072182 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:38.107998 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df528929-45e5-4b5f-ad6a-214e56072182 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1321 microversion: 2.1 time: 0.592262 Jul 26 19:45:38.135706 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 275/605] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:37 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:38.143892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f0471f6a-b827-4cc4-83b9-463f7aea0dc9 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:38.144500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f0471f6a-b827-4cc4-83b9-463f7aea0dc9 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:38.176896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0471f6a-b827-4cc4-83b9-463f7aea0dc9 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:38.177387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0471f6a-b827-4cc4-83b9-463f7aea0dc9 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:38.178239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0471f6a-b827-4cc4-83b9-463f7aea0dc9 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:38.178674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0471f6a-b827-4cc4-83b9-463f7aea0dc9 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:38.496933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4bdd64c8-0052-441a-90d1-8f7207a713e3 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17625 microversion: 2.1 time: 0.786746 Jul 26 19:45:38.497639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 331/606] 10.222.0.58 () {58 vars in 1171 bytes} [Tue Jul 26 19:45:37 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17625 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:45:38.535550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e165037a-f8cd-48be-b192-70855b3da902 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:38.536297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e165037a-f8cd-48be-b192-70855b3da902 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:38.561858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e165037a-f8cd-48be-b192-70855b3da902 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:38.562556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e165037a-f8cd-48be-b192-70855b3da902 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:38.563328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e165037a-f8cd-48be-b192-70855b3da902 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:38.563961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e165037a-f8cd-48be-b192-70855b3da902 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:38.711590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e165037a-f8cd-48be-b192-70855b3da902 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:38.723656 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e165037a-f8cd-48be-b192-70855b3da902 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1318 microversion: 2.1 time: 0.209798 Jul 26 19:45:38.724865 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 332/607] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:38 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:38.730762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3702bf70-a73c-4355-a88f-4347addce319 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:38.731524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f0471f6a-b827-4cc4-83b9-463f7aea0dc9 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:38.736978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3702bf70-a73c-4355-a88f-4347addce319 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Searching by: {'deleted': False, 'project_id': 'e58f36b8d630448e9fb2b5ed99e0c95c'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:38.743297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3702bf70-a73c-4355-a88f-4347addce319 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:38.743826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3702bf70-a73c-4355-a88f-4347addce319 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:38.744504 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f0471f6a-b827-4cc4-83b9-463f7aea0dc9 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1557 microversion: 2.1 time: 0.607295 Jul 26 19:45:38.744663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3702bf70-a73c-4355-a88f-4347addce319 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:38.745083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3702bf70-a73c-4355-a88f-4347addce319 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:38.745761 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 276/608] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:38 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1557 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:38.760087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56f643ca-8593-4d80-bdbd-c5246e5c9193 tempest-FlavorsV2NegativeTest-1144175568 tempest-FlavorsV2NegativeTest-1144175568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1423894898", "imageRef": "6a75b47a-0385-4bfa-a7cd-324d3effa35a", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:38.831840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-56f643ca-8593-4d80-bdbd-c5246e5c9193 tempest-FlavorsV2NegativeTest-1144175568 tempest-FlavorsV2NegativeTest-1144175568-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:38.877528 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3702bf70-a73c-4355-a88f-4347addce319 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?tenant_id=aa4bbc1be55b4513a8010a7bc71fbdf5" status: 200 len: 15 microversion: 2.1 time: 0.151437 Jul 26 19:45:38.880550 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 333/609] 10.222.0.58 () {58 vars in 1231 bytes} [Tue Jul 26 19:45:38 2022] GET /compute/v2.1/servers/detail?tenant_id=aa4bbc1be55b4513a8010a7bc71fbdf5 => generated 15 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:45:38.884218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ed2ed4c2-ec86-48a0-9c0f-11c9c0366654 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:38.884935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ed2ed4c2-ec86-48a0-9c0f-11c9c0366654 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:38.898353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed2ed4c2-ec86-48a0-9c0f-11c9c0366654 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:38.899984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed2ed4c2-ec86-48a0-9c0f-11c9c0366654 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:38.901102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed2ed4c2-ec86-48a0-9c0f-11c9c0366654 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:38.902052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed2ed4c2-ec86-48a0-9c0f-11c9c0366654 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.057377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ed2ed4c2-ec86-48a0-9c0f-11c9c0366654 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:39.065971 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ed2ed4c2-ec86-48a0-9c0f-11c9c0366654 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.186003 Jul 26 19:45:39.067384 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 334/610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:38 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:39.073505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ff66156-1606-491a-aa0c-d1a31cf3238e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:39.074289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8ff66156-1606-491a-aa0c-d1a31cf3238e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:39.083604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ff66156-1606-491a-aa0c-d1a31cf3238e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.084133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ff66156-1606-491a-aa0c-d1a31cf3238e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.085129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ff66156-1606-491a-aa0c-d1a31cf3238e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.085670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ff66156-1606-491a-aa0c-d1a31cf3238e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.166638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8ff66156-1606-491a-aa0c-d1a31cf3238e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097779 Jul 26 19:45:39.167415 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 335/611] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:45:39 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:39.178462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:39.185507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Searching by: {'tenant_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'deleted': False} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:39.191332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.192791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.193878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.195275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.212665 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-56f643ca-8593-4d80-bdbd-c5246e5c9193 tempest-FlavorsV2NegativeTest-1144175568 tempest-FlavorsV2NegativeTest-1144175568-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56f643ca-8593-4d80-bdbd-c5246e5c9193 tempest-FlavorsV2NegativeTest-1144175568 tempest-FlavorsV2NegativeTest-1144175568-project] Request method failure captured: Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 143 Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ERh7cym_K48DspoyIk83T7IzZZ3FlIfTFWM2AIt1JZipj3lv7-0HxszxC2vCMQ_oh54yGY8l3dTCDBymQV1M0ZrRIgbKWMS06gU-_jmwmo4l2zBzcSoH5Gqp6DHON8Gs4c6d63hrTBtiWsnR96FWb3HbnC3ylF6Niz-L5a0elceuY0 Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f960971517f9448dacec7a5d7b205402 Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FlavorsV2NegativeTest-1144175568 Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:45:39.214782 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f960971517f9448dacec7a5d7b205402"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f960971517f9448dacec7a5d7b205402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f960971517f9448dacec7a5d7b205402", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f960971517f9448dacec7a5d7b205402"}]}] Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FlavorsV2NegativeTest-1144175568 Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f960971517f9448dacec7a5d7b205402 Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1144175568 Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FlavorsV2NegativeTest-1144175568-project Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: d3dfabf4151a4a06903feb036a00ac39 Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FlavorsV2NegativeTest-1144175568-project Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1423894898", "imageRef": "6a75b47a-0385-4bfa-a7cd-324d3effa35a", "flavorRef": "452"}} Jul 26 19:45:39.216301 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: exception: Flavor's memory is too small for requested image. Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1423894898', 'imageRef': '6a75b47a-0385-4bfa-a7cd-324d3effa35a', 'flavorRef': '452'}}} Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:39.217034 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:39.221485 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56f643ca-8593-4d80-bdbd-c5246e5c9193 tempest-FlavorsV2NegativeTest-1144175568 tempest-FlavorsV2NegativeTest-1144175568-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56f643ca-8593-4d80-bdbd-c5246e5c9193 tempest-FlavorsV2NegativeTest-1144175568 tempest-FlavorsV2NegativeTest-1144175568-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.460892 Jul 26 19:45:39.223711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 277/612] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:45:38 2022] POST /compute/v2.1/servers => generated 93 bytes in 472 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:45:39.229378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e6dfa03-e1ff-4230-adf6-c0518611f523 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:39.230324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e6dfa03-e1ff-4230-adf6-c0518611f523 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:39.239648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e6dfa03-e1ff-4230-adf6-c0518611f523 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.240296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e6dfa03-e1ff-4230-adf6-c0518611f523 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.241487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:45:39.242543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e6dfa03-e1ff-4230-adf6-c0518611f523 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.242989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e6dfa03-e1ff-4230-adf6-c0518611f523 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.387095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.387547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.527189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3e6dfa03-e1ff-4230-adf6-c0518611f523 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:39.542848 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e6dfa03-e1ff-4230-adf6-c0518611f523 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1321 microversion: 2.1 time: 0.323357 Jul 26 19:45:39.543507 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 278/613] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:39 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:39.624595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1938271814", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "ca7f5c97-fec0-4b42-bad4-1e41226d1325"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:39.635139 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bd7a5777-8f42-4a43-be5f-85b2c5f82f08 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=aa4bbc1be55b4513a8010a7bc71fbdf5" status: 200 len: 4825 microversion: 2.1 time: 0.462155 Jul 26 19:45:39.656088 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 336/614] 10.222.0.58 () {58 vars in 1257 bytes} [Tue Jul 26 19:45:39 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=aa4bbc1be55b4513a8010a7bc71fbdf5 => generated 4825 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:39.661515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a2b39677-1ff1-4d88-b112-6d56b55c3c07 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:39.668074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a2b39677-1ff1-4d88-b112-6d56b55c3c07 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Searching by: {'tenant_id': 'e58f36b8d630448e9fb2b5ed99e0c95c', 'deleted': False} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:39.680866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2b39677-1ff1-4d88-b112-6d56b55c3c07 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.686494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2b39677-1ff1-4d88-b112-6d56b55c3c07 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.687959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2b39677-1ff1-4d88-b112-6d56b55c3c07 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.688397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2b39677-1ff1-4d88-b112-6d56b55c3c07 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.705554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] validate_networks() for [('ca7f5c97-fec0-4b42-bad4-1e41226d1325', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:39.724779 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a2b39677-1ff1-4d88-b112-6d56b55c3c07 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e58f36b8d630448e9fb2b5ed99e0c95c" status: 200 len: 15 microversion: 2.1 time: 0.067215 Jul 26 19:45:39.725711 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 337/615] 10.222.0.58 () {58 vars in 1257 bytes} [Tue Jul 26 19:45:39 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e58f36b8d630448e9fb2b5ed99e0c95c => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:45:39.750635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-abc7c95b-820f-4bdb-bc0b-5d6bfd570d01 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:39.760893 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-abc7c95b-820f-4bdb-bc0b-5d6bfd570d01 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.016274 Jul 26 19:45:39.765913 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 338/616] 10.222.0.58 () {58 vars in 1189 bytes} [Tue Jul 26 19:45:39 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 19:45:39.781275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad58f6f5-f233-44e9-876f-bd76a641ebbe tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:39.783084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ad58f6f5-f233-44e9-876f-bd76a641ebbe tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:39.793624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad58f6f5-f233-44e9-876f-bd76a641ebbe tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.794348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad58f6f5-f233-44e9-876f-bd76a641ebbe tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:39.795400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad58f6f5-f233-44e9-876f-bd76a641ebbe tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:39.796027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad58f6f5-f233-44e9-876f-bd76a641ebbe tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.288248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ad58f6f5-f233-44e9-876f-bd76a641ebbe tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:40.304142 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ad58f6f5-f233-44e9-876f-bd76a641ebbe tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1318 microversion: 2.1 time: 0.528464 Jul 26 19:45:40.306191 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 339/617] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:39 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:40.323275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c2baecd-16f6-4a06-bc1d-ee8e99d940bd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:40.326597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5c2baecd-16f6-4a06-bc1d-ee8e99d940bd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:40.342398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c2baecd-16f6-4a06-bc1d-ee8e99d940bd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.345629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c2baecd-16f6-4a06-bc1d-ee8e99d940bd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.349196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c2baecd-16f6-4a06-bc1d-ee8e99d940bd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.350408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c2baecd-16f6-4a06-bc1d-ee8e99d940bd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.564040 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5c2baecd-16f6-4a06-bc1d-ee8e99d940bd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action" status: 202 len: 0 microversion: 2.1 time: 0.255672 Jul 26 19:45:40.565301 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 340/618] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:40 2022] POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:40.572645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-8e066ec2-d9d1-4f9c-ba70-d6df9a54c426 req-7975c379-57a4-4abd-a343-37a002360435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b429ee74-71db-44cc-90d7-640d054b87e7", "name": "network-vif-plugged", "status": "completed", "tag": "a4f5599c-3151-46aa-986e-d0150a19caf0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:40.589081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8e066ec2-d9d1-4f9c-ba70-d6df9a54c426 req-7975c379-57a4-4abd-a343-37a002360435 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.590061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8e066ec2-d9d1-4f9c-ba70-d6df9a54c426 req-7975c379-57a4-4abd-a343-37a002360435 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.608542 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-8e066ec2-d9d1-4f9c-ba70-d6df9a54c426 req-7975c379-57a4-4abd-a343-37a002360435 service nova] Creating event network-vif-plugged:a4f5599c-3151-46aa-986e-d0150a19caf0 for instance b429ee74-71db-44cc-90d7-640d054b87e7 on n-h2-708768-8 Jul 26 19:45:40.616862 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-8e066ec2-d9d1-4f9c-ba70-d6df9a54c426 req-7975c379-57a4-4abd-a343-37a002360435 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049616 Jul 26 19:45:40.621109 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 341/619] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:40.628897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-edf61dc2-e617-40c3-9cae-8e4c92524628 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:40.629966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-edf61dc2-e617-40c3-9cae-8e4c92524628 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:40.638242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edf61dc2-e617-40c3-9cae-8e4c92524628 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.638911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edf61dc2-e617-40c3-9cae-8e4c92524628 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.639444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edf61dc2-e617-40c3-9cae-8e4c92524628 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.640554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edf61dc2-e617-40c3-9cae-8e4c92524628 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.652377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:40.653894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:40.654610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:40.656102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:40.657187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:40.677270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.677744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.678557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.685937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.763127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for project 3d10540a08974fd0854fea20ae5c216b. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:40.781263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for user ccd551ea4e0641a0bf17d669481136fa and project 3d10540a08974fd0854fea20ae5c216b. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:40.811438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:40.816950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:40.915853 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-938ea584-a666-4889-a18f-95186ee001ed tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.370981 Jul 26 19:45:40.925221 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 279/620] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:45:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 19:45:40.934722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-01e298ee-06be-4494-bf99-ef555c6f1145 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:40.935737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-01e298ee-06be-4494-bf99-ef555c6f1145 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:40.953533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01e298ee-06be-4494-bf99-ef555c6f1145 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.953907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01e298ee-06be-4494-bf99-ef555c6f1145 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:40.954701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01e298ee-06be-4494-bf99-ef555c6f1145 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:40.955137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01e298ee-06be-4494-bf99-ef555c6f1145 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:41.237012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-edf61dc2-e617-40c3-9cae-8e4c92524628 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:41.256527 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-edf61dc2-e617-40c3-9cae-8e4c92524628 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.633492 Jul 26 19:45:41.257132 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 342/621] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:40 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:41.272263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:41.283321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:41.284182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:41.302029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:41.302561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:41.303404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:41.303820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:41.479769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-01e298ee-06be-4494-bf99-ef555c6f1145 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:41.492640 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-01e298ee-06be-4494-bf99-ef555c6f1145 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1321 microversion: 2.1 time: 0.565943 Jul 26 19:45:41.519536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:45:41.534442 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 280/622] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:40 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1321 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:41.551726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca8a79dc-82f1-4abd-92b3-7d845e1fb35b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:41.552588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca8a79dc-82f1-4abd-92b3-7d845e1fb35b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:41.657945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca8a79dc-82f1-4abd-92b3-7d845e1fb35b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:41.675830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca8a79dc-82f1-4abd-92b3-7d845e1fb35b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:41.681096 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b49c6ca5-1809-45b3-8e90-bcac2a605e1e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.421122 Jul 26 19:45:41.682073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca8a79dc-82f1-4abd-92b3-7d845e1fb35b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:41.683447 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca8a79dc-82f1-4abd-92b3-7d845e1fb35b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1262 microversion: 2.25 time: 0.147615 Jul 26 19:45:41.683807 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 343/623] 10.222.0.58 () {58 vars in 1150 bytes} [Tue Jul 26 19:45:41 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:41.697364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e1a2e99-affa-45d7-959d-fcc2a5b38a9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:41.698291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2e1a2e99-affa-45d7-959d-fcc2a5b38a9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:41.703321 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 281/624] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:41 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:41.709509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bda2f062-06ab-4aa3-b79c-9c8ccb54a948 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:41.711740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e1a2e99-affa-45d7-959d-fcc2a5b38a9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:41.712284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bda2f062-06ab-4aa3-b79c-9c8ccb54a948 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:41.714099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e1a2e99-affa-45d7-959d-fcc2a5b38a9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:41.715005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e1a2e99-affa-45d7-959d-fcc2a5b38a9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:41.718121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e1a2e99-affa-45d7-959d-fcc2a5b38a9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:41.725224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bda2f062-06ab-4aa3-b79c-9c8ccb54a948 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:41.725964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bda2f062-06ab-4aa3-b79c-9c8ccb54a948 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:41.727020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bda2f062-06ab-4aa3-b79c-9c8ccb54a948 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:41.729039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bda2f062-06ab-4aa3-b79c-9c8ccb54a948 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:41.848995 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bda2f062-06ab-4aa3-b79c-9c8ccb54a948 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action" status: 202 len: 0 microversion: 2.1 time: 0.142979 Jul 26 19:45:41.850580 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 282/625] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:41 2022] POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:41.860265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fdc318e7-16ce-4a18-8a36-394690a73693 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:41.861200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fdc318e7-16ce-4a18-8a36-394690a73693 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:41.870806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdc318e7-16ce-4a18-8a36-394690a73693 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:41.871779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdc318e7-16ce-4a18-8a36-394690a73693 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:41.872971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdc318e7-16ce-4a18-8a36-394690a73693 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:41.873814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdc318e7-16ce-4a18-8a36-394690a73693 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.114615 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fdc318e7-16ce-4a18-8a36-394690a73693 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1615 microversion: 2.1 time: 0.258964 Jul 26 19:45:42.115849 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 283/626] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:41 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1615 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:42.142206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe8af20c-c448-489c-9422-4d10723363dd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:42.143212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fe8af20c-c448-489c-9422-4d10723363dd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:42.156198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe8af20c-c448-489c-9422-4d10723363dd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.158659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe8af20c-c448-489c-9422-4d10723363dd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.159553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe8af20c-c448-489c-9422-4d10723363dd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.162933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe8af20c-c448-489c-9422-4d10723363dd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.397589 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe8af20c-c448-489c-9422-4d10723363dd tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1615 microversion: 2.1 time: 0.260404 Jul 26 19:45:42.399530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 284/627] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:42 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1615 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:42.404659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-221fcdd6-8915-4664-8d97-e57607322487 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:42.405539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-221fcdd6-8915-4664-8d97-e57607322487 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:42.412455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-221fcdd6-8915-4664-8d97-e57607322487 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.413156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-221fcdd6-8915-4664-8d97-e57607322487 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.414011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-221fcdd6-8915-4664-8d97-e57607322487 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.414444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-221fcdd6-8915-4664-8d97-e57607322487 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.513963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e1a2e99-affa-45d7-959d-fcc2a5b38a9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:42.524033 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e1a2e99-affa-45d7-959d-fcc2a5b38a9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1318 microversion: 2.1 time: 0.838908 Jul 26 19:45:42.530094 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 344/628] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:41 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1318 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:42.548565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bff8f44-c286-440a-9713-27654484b20d tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:42.569381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0bff8f44-c286-440a-9713-27654484b20d tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Searching by: {'host': 'n-h1-708768-8', 'deleted': False} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:42.574948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bff8f44-c286-440a-9713-27654484b20d tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.575643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bff8f44-c286-440a-9713-27654484b20d tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.577256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bff8f44-c286-440a-9713-27654484b20d tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.582275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bff8f44-c286-440a-9713-27654484b20d tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.678378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-221fcdd6-8915-4664-8d97-e57607322487 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:42.689369 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-221fcdd6-8915-4664-8d97-e57607322487 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.288649 Jul 26 19:45:42.703645 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 285/629] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:42 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:42.703863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-09a95630-3885-489c-94f7-83a6fb26c37f req-5844db8e-d34d-49b0-8002-1e5c17b3a1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94ef3743-f705-4e52-bb3c-e5891eab0512", "tag": "3d99ffec-3261-4711-ad8b-3f9d9b36eec8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:42.727880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-09a95630-3885-489c-94f7-83a6fb26c37f req-5844db8e-d34d-49b0-8002-1e5c17b3a1e0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.727880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-09a95630-3885-489c-94f7-83a6fb26c37f req-5844db8e-d34d-49b0-8002-1e5c17b3a1e0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.763753 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-09a95630-3885-489c-94f7-83a6fb26c37f req-5844db8e-d34d-49b0-8002-1e5c17b3a1e0 service nova] Creating event network-changed:3d99ffec-3261-4711-ad8b-3f9d9b36eec8 for instance 94ef3743-f705-4e52-bb3c-e5891eab0512 on n-h2-708768-8 Jul 26 19:45:42.776138 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-09a95630-3885-489c-94f7-83a6fb26c37f req-5844db8e-d34d-49b0-8002-1e5c17b3a1e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081228 Jul 26 19:45:42.778232 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 286/630] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:42.792754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17f74272-f3ea-4788-9cc9-d5774c17de91 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:42.793149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-17f74272-f3ea-4788-9cc9-d5774c17de91 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:42.831182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17f74272-f3ea-4788-9cc9-d5774c17de91 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.831791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17f74272-f3ea-4788-9cc9-d5774c17de91 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:42.833179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17f74272-f3ea-4788-9cc9-d5774c17de91 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:42.839006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17f74272-f3ea-4788-9cc9-d5774c17de91 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.246159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-0bff8f44-c286-440a-9713-27654484b20d tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:45:43.314061 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0bff8f44-c286-440a-9713-27654484b20d tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=n-h1-708768-8&all_tenants=1" status: 200 len: 1993 microversion: 2.1 time: 0.769560 Jul 26 19:45:43.314978 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 345/631] 10.222.0.58 () {58 vars in 1190 bytes} [Tue Jul 26 19:45:42 2022] GET /compute/v2.1/servers?host=n-h1-708768-8&all_tenants=1 => generated 1993 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:43.327692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:43.328322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:43.336717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:43.337171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.337977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:43.338418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.422111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:43.432056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:43.433511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:43.434666 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90937847-05c9-4710-ab4f-5a252ebad01c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1320 microversion: 2.25 time: 0.118739 Jul 26 19:45:43.435227 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 346/632] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:43 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1320 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:43.652914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91c044f2-1a22-4a52-88f1-758580ad922a tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Calling method '.version_select at 0x7f8764349e50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:43.703314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-17f74272-f3ea-4788-9cc9-d5774c17de91 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:43.715581 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-91c044f2-1a22-4a52-88f1-758580ad922a tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] HTTP exception thrown: Image not found. Jul 26 19:45:43.715910 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-17f74272-f3ea-4788-9cc9-d5774c17de91 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1321 microversion: 2.1 time: 0.936339 Jul 26 19:45:43.716491 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 287/633] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:42 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1321 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:43.727992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ceec8a0-e1ae-4b5e-bf46-15dd4b3fec69 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:43.735506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ceec8a0-e1ae-4b5e-bf46-15dd4b3fec69 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91c044f2-1a22-4a52-88f1-758580ad922a tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Request method failure captured: Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/5e0b8339-46c4-4176-b403-5ce2ffa2dd4f/metadata/os_distro HTTP/1.1 Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERmkicgz0Cg6myK5iN516O0iN8-1vihBN2R-dhLcx2MdhB3Ckgo8eKbt8qJ9igImXAavwSebTpFo1DSSW3pVrL7vTNQSbgGNw3ja6XsNUeffgGedma1SDT7hu-S_ZkHxkn0wlof2wc_4QlwFYOL8QW_ew6kym8P8RGXXIY_LyD6qpk Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:43.740437 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7faa80eda4b545df98b0ceda08d82a40", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}] Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9bc91a31b20a47e2b514f9f794356737 Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'image_id': '5e0b8339-46c4-4176-b403-5ce2ffa2dd4f', 'id': 'os_distro'} Jul 26 19:45:43.741796 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:43.742610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5e0b8339-46c4-4176-b403-5ce2ffa2dd4f Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:43.744652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e0b8339-46c4-4176-b403-5ce2ffa2dd4f could not be found. Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:43.745903 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:43.747602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91c044f2-1a22-4a52-88f1-758580ad922a tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:43.750299 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91c044f2-1a22-4a52-88f1-758580ad922a tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] 10.222.0.58 "DELETE /compute/v2.1/images/5e0b8339-46c4-4176-b403-5ce2ffa2dd4f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.301016 Jul 26 19:45:43.750299 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 347/634] 10.222.0.58 () {58 vars in 1293 bytes} [Tue Jul 26 19:45:43 2022] DELETE /compute/v2.1/images/5e0b8339-46c4-4176-b403-5ce2ffa2dd4f/metadata/os_distro => generated 62 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:45:43.753548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ceec8a0-e1ae-4b5e-bf46-15dd4b3fec69 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:43.753783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ceec8a0-e1ae-4b5e-bf46-15dd4b3fec69 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.755266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ceec8a0-e1ae-4b5e-bf46-15dd4b3fec69 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:43.756203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-be4053d7-c76a-4c2a-87a2-c5d76e77a554 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:43.757033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-be4053d7-c76a-4c2a-87a2-c5d76e77a554 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:43.760914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ceec8a0-e1ae-4b5e-bf46-15dd4b3fec69 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.770332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be4053d7-c76a-4c2a-87a2-c5d76e77a554 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:43.770884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be4053d7-c76a-4c2a-87a2-c5d76e77a554 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.772939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be4053d7-c76a-4c2a-87a2-c5d76e77a554 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:43.773412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be4053d7-c76a-4c2a-87a2-c5d76e77a554 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.856355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ceec8a0-e1ae-4b5e-bf46-15dd4b3fec69 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.138798 Jul 26 19:45:43.857496 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 288/635] 10.222.0.58 () {58 vars in 1196 bytes} [Tue Jul 26 19:45:43 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:45:43.864870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b454b087-7f0f-40e3-83d3-048bd1910bd4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:43.867573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b454b087-7f0f-40e3-83d3-048bd1910bd4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:43.880634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b454b087-7f0f-40e3-83d3-048bd1910bd4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:43.881723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b454b087-7f0f-40e3-83d3-048bd1910bd4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.882947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b454b087-7f0f-40e3-83d3-048bd1910bd4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:43.883501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b454b087-7f0f-40e3-83d3-048bd1910bd4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:43.997466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-be4053d7-c76a-4c2a-87a2-c5d76e77a554 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:44.007423 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-be4053d7-c76a-4c2a-87a2-c5d76e77a554 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1467 microversion: 2.1 time: 0.263878 Jul 26 19:45:44.008292 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 348/636] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:43 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1467 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:44.017994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0cbbd528-2dff-4eef-a98e-24eb7e595133 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Calling method '.version_select at 0x7f876413b940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:44.059309 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0cbbd528-2dff-4eef-a98e-24eb7e595133 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] HTTP exception thrown: Image not found. Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0cbbd528-2dff-4eef-a98e-24eb7e595133 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Request method failure captured: Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/images/a4070149-5b00-4096-90ad-d94d30169eb2/metadata/os_version HTTP/1.1 Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERmkicgz0Cg6myK5iN516O0iN8-1vihBN2R-dhLcx2MdhB3Ckgo8eKbt8qJ9igImXAavwSebTpFo1DSSW3pVrL7vTNQSbgGNw3ja6XsNUeffgGedma1SDT7hu-S_ZkHxkn0wlof2wc_4QlwFYOL8QW_ew6kym8P8RGXXIY_LyD6qpk Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:44.064179 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7faa80eda4b545df98b0ceda08d82a40", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}] Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9bc91a31b20a47e2b514f9f794356737 Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'image_id': 'a4070149-5b00-4096-90ad-d94d30169eb2', 'id': 'os_version'} Jul 26 19:45:44.065723 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.067209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a4070149-5b00-4096-90ad-d94d30169eb2 Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.068984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4070149-5b00-4096-90ad-d94d30169eb2 could not be found. Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:44.071257 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:45:44.073410 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.078190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0cbbd528-2dff-4eef-a98e-24eb7e595133 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:44.078714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0cbbd528-2dff-4eef-a98e-24eb7e595133 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] 10.222.0.58 "GET /compute/v2.1/images/a4070149-5b00-4096-90ad-d94d30169eb2/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.062538 Jul 26 19:45:44.080525 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 349/637] 10.222.0.58 () {58 vars in 1293 bytes} [Tue Jul 26 19:45:44 2022] GET /compute/v2.1/images/a4070149-5b00-4096-90ad-d94d30169eb2/metadata/os_version => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:45:44.087749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e1b359d0-82cb-4ea2-9a85-d1bbbc32c4bb tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:44.091341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e1b359d0-82cb-4ea2-9a85-d1bbbc32c4bb tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:44.102579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1b359d0-82cb-4ea2-9a85-d1bbbc32c4bb tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.103879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1b359d0-82cb-4ea2-9a85-d1bbbc32c4bb tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.105151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1b359d0-82cb-4ea2-9a85-d1bbbc32c4bb tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.105785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1b359d0-82cb-4ea2-9a85-d1bbbc32c4bb tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.132338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:44.186469 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e1b359d0-82cb-4ea2-9a85-d1bbbc32c4bb tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action" status: 202 len: 0 microversion: 2.1 time: 0.104095 Jul 26 19:45:44.190761 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 350/638] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:44 2022] POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:44.193212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-797dc76e-f010-475b-9c69-510f4b7dd085 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:44.193821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-797dc76e-f010-475b-9c69-510f4b7dd085 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:44.200013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-797dc76e-f010-475b-9c69-510f4b7dd085 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.200618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-797dc76e-f010-475b-9c69-510f4b7dd085 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.201407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-797dc76e-f010-475b-9c69-510f4b7dd085 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.201827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-797dc76e-f010-475b-9c69-510f4b7dd085 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.232099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b454b087-7f0f-40e3-83d3-048bd1910bd4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:44.236579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:44.244997 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b454b087-7f0f-40e3-83d3-048bd1910bd4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.386300 Jul 26 19:45:44.246181 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 289/639] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:43 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:44.257859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02336697-3088-4be5-aed4-83689d3bd7c8 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Calling method '.version_select at 0x7f875743e0d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:44.297657 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-02336697-3088-4be5-aed4-83689d3bd7c8 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] HTTP exception thrown: Image not found. Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02336697-3088-4be5-aed4-83689d3bd7c8 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Request method failure captured: Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/images/53ca7756-152e-49c0-b8a7-7bf64fab6a1f/metadata HTTP/1.1 Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ERmkicgz0Cg6myK5iN516O0iN8-1vihBN2R-dhLcx2MdhB3Ckgo8eKbt8qJ9igImXAavwSebTpFo1DSSW3pVrL7vTNQSbgGNw3ja6XsNUeffgGedma1SDT7hu-S_ZkHxkn0wlof2wc_4QlwFYOL8QW_ew6kym8P8RGXXIY_LyD6qpk Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:45:44.302569 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7faa80eda4b545df98b0ceda08d82a40", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}] Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9bc91a31b20a47e2b514f9f794356737 Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: exception: Image not found. Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'image_id': '53ca7756-152e-49c0-b8a7-7bf64fab6a1f'} Jul 26 19:45:44.304219 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.304996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 53ca7756-152e-49c0-b8a7-7bf64fab6a1f Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.306015 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53ca7756-152e-49c0-b8a7-7bf64fab6a1f could not be found. Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:44.307624 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.309804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02336697-3088-4be5-aed4-83689d3bd7c8 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Returning 404 to user: Image not found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:44.312087 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02336697-3088-4be5-aed4-83689d3bd7c8 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] 10.222.0.58 "GET /compute/v2.1/images/53ca7756-152e-49c0-b8a7-7bf64fab6a1f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.063102 Jul 26 19:45:44.312379 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 290/640] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 19:45:44 2022] GET /compute/v2.1/images/53ca7756-152e-49c0-b8a7-7bf64fab6a1f/metadata => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:45:44.326440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:44.329456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:44.336788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.341718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.342660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.343182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.365617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-797dc76e-f010-475b-9c69-510f4b7dd085 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:44.378097 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-797dc76e-f010-475b-9c69-510f4b7dd085 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1318 microversion: 2.1 time: 0.189159 Jul 26 19:45:44.379478 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 351/641] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:44 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:44.385018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33eeb21e-ef53-41b8-beea-850e536fce14 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Action: 'update_all', calling method: .version_select at 0x7f87643b78b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:44.417470 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-33eeb21e-ef53-41b8-beea-850e536fce14 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] HTTP exception thrown: Image not found. Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33eeb21e-ef53-41b8-beea-850e536fce14 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Request method failure captured: Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/images/3be18962-0240-4628-8825-c47b9b832c5e/metadata HTTP/1.1 Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 57 Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERmkicgz0Cg6myK5iN516O0iN8-1vihBN2R-dhLcx2MdhB3Ckgo8eKbt8qJ9igImXAavwSebTpFo1DSSW3pVrL7vTNQSbgGNw3ja6XsNUeffgGedma1SDT7hu-S_ZkHxkn0wlof2wc_4QlwFYOL8QW_ew6kym8P8RGXXIY_LyD6qpk Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:44.420105 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7faa80eda4b545df98b0ceda08d82a40", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}] Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9bc91a31b20a47e2b514f9f794356737 Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:45:44.421384 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'image_id': '3be18962-0240-4628-8825-c47b9b832c5e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.422263 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3be18962-0240-4628-8825-c47b9b832c5e Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.423319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3be18962-0240-4628-8825-c47b9b832c5e could not be found. Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:44.424483 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:45:44.425593 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.427576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33eeb21e-ef53-41b8-beea-850e536fce14 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:44.427576 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-33eeb21e-ef53-41b8-beea-850e536fce14 tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] 10.222.0.58 "PUT /compute/v2.1/images/3be18962-0240-4628-8825-c47b9b832c5e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041179 Jul 26 19:45:44.427576 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 352/642] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:45:44 2022] PUT /compute/v2.1/images/3be18962-0240-4628-8825-c47b9b832c5e/metadata => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:45:44.435378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bee255de-8133-4fa0-8774-b8f720cdcc3d tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Action: 'update', calling method: .version_select at 0x7f875f43cd30>, body: {"meta": {"os_distro": "alt"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:44.448226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:44.448914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:44.450149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:44.450717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:44.451297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:44.476104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-bee255de-8133-4fa0-8774-b8f720cdcc3d tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] HTTP exception thrown: Image not found. Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bee255de-8133-4fa0-8774-b8f720cdcc3d tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Request method failure captured: Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/images/896dc985-0467-4e54-936e-a5196a8b7ed7/metadata/os_distro HTTP/1.1 Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 30 Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERmkicgz0Cg6myK5iN516O0iN8-1vihBN2R-dhLcx2MdhB3Ckgo8eKbt8qJ9igImXAavwSebTpFo1DSSW3pVrL7vTNQSbgGNw3ja6XsNUeffgGedma1SDT7hu-S_ZkHxkn0wlof2wc_4QlwFYOL8QW_ew6kym8P8RGXXIY_LyD6qpk Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:44.478294 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7faa80eda4b545df98b0ceda08d82a40", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}] Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9bc91a31b20a47e2b514f9f794356737 Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: {"meta": {"os_distro": "alt"}} Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:45:44.479585 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'image_id': '896dc985-0467-4e54-936e-a5196a8b7ed7', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.480453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 896dc985-0467-4e54-936e-a5196a8b7ed7 Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.481488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 896dc985-0467-4e54-936e-a5196a8b7ed7 could not be found. Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:44.482591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:45:44.484468 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.486842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bee255de-8133-4fa0-8774-b8f720cdcc3d tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:44.486842 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bee255de-8133-4fa0-8774-b8f720cdcc3d tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] 10.222.0.58 "PUT /compute/v2.1/images/896dc985-0467-4e54-936e-a5196a8b7ed7/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.049185 Jul 26 19:45:44.486842 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 353/643] 10.222.0.58 () {60 vars in 1310 bytes} [Tue Jul 26 19:45:44 2022] PUT /compute/v2.1/images/896dc985-0467-4e54-936e-a5196a8b7ed7/metadata/os_distro => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:45:44.492868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:44.493578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:44.500309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.500871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.501991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.502695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.543809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:44.550764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.551976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.553086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.553834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.592379 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bab3a473-9980-41cf-904d-247a0fdf418f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action" status: 202 len: 1068 microversion: 2.1 time: 0.273483 Jul 26 19:45:44.600746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:44.608182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 291/644] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:44 2022] POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action => generated 1068 bytes in 295 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 19:45:44.615838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:44.616362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0def17a9-294b-4c5b-93a4-8c04e758129e tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Action: 'create', calling method: .version_select at 0x7f875730cf70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:44.617941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:44.619178 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9cdc36ff-23a2-4b5d-9fa1-f6914657d78e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1320 microversion: 2.25 time: 0.130769 Jul 26 19:45:44.620202 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 354/645] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:44 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1320 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:44.632844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91ef84b1-459a-49cc-8a9b-15cb5e9f2c40 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:44.633776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-91ef84b1-459a-49cc-8a9b-15cb5e9f2c40 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:44.642660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91ef84b1-459a-49cc-8a9b-15cb5e9f2c40 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.643446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91ef84b1-459a-49cc-8a9b-15cb5e9f2c40 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.644823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91ef84b1-459a-49cc-8a9b-15cb5e9f2c40 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.647767 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-0def17a9-294b-4c5b-93a4-8c04e758129e tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] HTTP exception thrown: Image not found. Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0def17a9-294b-4c5b-93a4-8c04e758129e tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Request method failure captured: Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/images/1b859fef-605b-4d83-943f-d67ebbce1732/metadata HTTP/1.1 Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 57 Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ERmkicgz0Cg6myK5iN516O0iN8-1vihBN2R-dhLcx2MdhB3Ckgo8eKbt8qJ9igImXAavwSebTpFo1DSSW3pVrL7vTNQSbgGNw3ja6XsNUeffgGedma1SDT7hu-S_ZkHxkn0wlof2wc_4QlwFYOL8QW_ew6kym8P8RGXXIY_LyD6qpk Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:45:44.650170 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7faa80eda4b545df98b0ceda08d82a40", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7faa80eda4b545df98b0ceda08d82a40"}]}] Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 7faa80eda4b545df98b0ceda08d82a40 Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-578852391 Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9bc91a31b20a47e2b514f9f794356737 Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-578852391-project Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: exception: Image not found. Jul 26 19:45:44.651519 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'image_id': '1b859fef-605b-4d83-943f-d67ebbce1732', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.652415 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1b859fef-605b-4d83-943f-d67ebbce1732 Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:45:44.653484 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b859fef-605b-4d83-943f-d67ebbce1732 could not be found. Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:44.654629 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:45:44.657445 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:44.661693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0def17a9-294b-4c5b-93a4-8c04e758129e tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] Returning 404 to user: Image not found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:44.661693 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0def17a9-294b-4c5b-93a4-8c04e758129e tempest-ImagesMetadataNegativeTestJSON-578852391 tempest-ImagesMetadataNegativeTestJSON-578852391-project] 10.222.0.58 "POST /compute/v2.1/images/1b859fef-605b-4d83-943f-d67ebbce1732/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041975 Jul 26 19:45:44.661693 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 292/646] 10.222.0.58 () {60 vars in 1281 bytes} [Tue Jul 26 19:45:44 2022] POST /compute/v2.1/images/1b859fef-605b-4d83-943f-d67ebbce1732/metadata => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:45:44.666252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91ef84b1-459a-49cc-8a9b-15cb5e9f2c40 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.742512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8119fc54-5098-4a23-9cb5-317e285adbc6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:44.743130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8119fc54-5098-4a23-9cb5-317e285adbc6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:44.789011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8119fc54-5098-4a23-9cb5-317e285adbc6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.789469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8119fc54-5098-4a23-9cb5-317e285adbc6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.790251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8119fc54-5098-4a23-9cb5-317e285adbc6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:44.791190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8119fc54-5098-4a23-9cb5-317e285adbc6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:44.960287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-91ef84b1-459a-49cc-8a9b-15cb5e9f2c40 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:44.980058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91ef84b1-459a-49cc-8a9b-15cb5e9f2c40 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.358401 Jul 26 19:45:44.980463 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 355/647] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:44 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:45.163156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8119fc54-5098-4a23-9cb5-317e285adbc6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:45.175760 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8119fc54-5098-4a23-9cb5-317e285adbc6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1321 microversion: 2.1 time: 0.440875 Jul 26 19:45:45.177543 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 293/648] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:44 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:45.267935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8889f42d-c049-4654-810c-e411365f4b3b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:45.269045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8889f42d-c049-4654-810c-e411365f4b3b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:45.276457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:45.280162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8889f42d-c049-4654-810c-e411365f4b3b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:45.280917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8889f42d-c049-4654-810c-e411365f4b3b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:45.282415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8889f42d-c049-4654-810c-e411365f4b3b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:45.283113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8889f42d-c049-4654-810c-e411365f4b3b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:45.402677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b1adf081-8605-484c-b1cf-ef62e17983a3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:45.403426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b1adf081-8605-484c-b1cf-ef62e17983a3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:45.414943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1adf081-8605-484c-b1cf-ef62e17983a3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:45.415402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1adf081-8605-484c-b1cf-ef62e17983a3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:45.416321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1adf081-8605-484c-b1cf-ef62e17983a3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:45.417178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1adf081-8605-484c-b1cf-ef62e17983a3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:45.490216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8889f42d-c049-4654-810c-e411365f4b3b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:45.498197 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8889f42d-c049-4654-810c-e411365f4b3b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.235320 Jul 26 19:45:45.498968 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 356/649] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:45 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:45.518179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-beadc673-d3ce-44a7-9d43-aa1110dd3da2 req-9e9f9124-04fa-48b1-82f7-8c6ea9e58c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb4bb85-05be-4add-898f-be82c0375754", "name": "network-vif-plugged", "status": "completed", "tag": "718edf50-d6e3-4c55-8013-d795ca6662f9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:45.529072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-beadc673-d3ce-44a7-9d43-aa1110dd3da2 req-9e9f9124-04fa-48b1-82f7-8c6ea9e58c68 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:45.529520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-beadc673-d3ce-44a7-9d43-aa1110dd3da2 req-9e9f9124-04fa-48b1-82f7-8c6ea9e58c68 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:45.540602 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-beadc673-d3ce-44a7-9d43-aa1110dd3da2 req-9e9f9124-04fa-48b1-82f7-8c6ea9e58c68 service nova] Creating event network-vif-plugged:718edf50-d6e3-4c55-8013-d795ca6662f9 for instance 8cb4bb85-05be-4add-898f-be82c0375754 on n-h1-708768-8 Jul 26 19:45:45.546017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-beadc673-d3ce-44a7-9d43-aa1110dd3da2 req-9e9f9124-04fa-48b1-82f7-8c6ea9e58c68 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036553 Jul 26 19:45:45.546630 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 357/650] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:45.642853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:45.643854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:45.650952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:45.651706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:45.656458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:45.657288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:45.800193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b1adf081-8605-484c-b1cf-ef62e17983a3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:45.809842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b1adf081-8605-484c-b1cf-ef62e17983a3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1318 microversion: 2.1 time: 0.411208 Jul 26 19:45:45.830199 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 294/651] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:45 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:45.854349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:45.877882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:45.883284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:45.885706 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-999bf383-68c3-45a7-9618-2c8165ef6e75 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1362 microversion: 2.25 time: 0.247268 Jul 26 19:45:45.886366 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 358/652] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:45 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:45:46.014003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-381b6241-4074-4640-983a-e5bc62af1a43 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:46.016405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-381b6241-4074-4640-983a-e5bc62af1a43 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:46.023431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-381b6241-4074-4640-983a-e5bc62af1a43 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.023907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-381b6241-4074-4640-983a-e5bc62af1a43 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.024950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-381b6241-4074-4640-983a-e5bc62af1a43 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.025386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-381b6241-4074-4640-983a-e5bc62af1a43 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.083268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-172116cb-a19c-4bb1-b0a4-4d10c5da0df7 req-fdf7ce44-78c7-4fa8-9e1f-25f637b47888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c305d3d-37c5-4ee8-81cc-3ff8f2998d52", "tag": "8b554828-b715-42fe-9f30-38b72c6f49f2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:46.095786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-172116cb-a19c-4bb1-b0a4-4d10c5da0df7 req-fdf7ce44-78c7-4fa8-9e1f-25f637b47888 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.096522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-172116cb-a19c-4bb1-b0a4-4d10c5da0df7 req-fdf7ce44-78c7-4fa8-9e1f-25f637b47888 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.112375 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-172116cb-a19c-4bb1-b0a4-4d10c5da0df7 req-fdf7ce44-78c7-4fa8-9e1f-25f637b47888 service nova] Creating event network-changed:8b554828-b715-42fe-9f30-38b72c6f49f2 for instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 on n-h1-708768-8 Jul 26 19:45:46.128525 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-172116cb-a19c-4bb1-b0a4-4d10c5da0df7 req-fdf7ce44-78c7-4fa8-9e1f-25f637b47888 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056193 Jul 26 19:45:46.131640 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 359/653] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:45:46.199992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-665b882c-f8aa-4e57-91f4-e969f9a6da7f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:46.200693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-665b882c-f8aa-4e57-91f4-e969f9a6da7f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:46.208971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-665b882c-f8aa-4e57-91f4-e969f9a6da7f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.209676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-665b882c-f8aa-4e57-91f4-e969f9a6da7f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.210257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-665b882c-f8aa-4e57-91f4-e969f9a6da7f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.210831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-665b882c-f8aa-4e57-91f4-e969f9a6da7f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.401304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-665b882c-f8aa-4e57-91f4-e969f9a6da7f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:46.406908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-381b6241-4074-4640-983a-e5bc62af1a43 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:46.411571 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-665b882c-f8aa-4e57-91f4-e969f9a6da7f tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1321 microversion: 2.1 time: 0.215997 Jul 26 19:45:46.412630 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 360/654] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:46 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:46.422182 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-381b6241-4074-4640-983a-e5bc62af1a43 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.424061 Jul 26 19:45:46.422758 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 295/655] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:45 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:46.523100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ca316ee-a493-4ccf-bb3e-a9ac96ad16e6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:46.523998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ca316ee-a493-4ccf-bb3e-a9ac96ad16e6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:46.530408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ca316ee-a493-4ccf-bb3e-a9ac96ad16e6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.530887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ca316ee-a493-4ccf-bb3e-a9ac96ad16e6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.531676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ca316ee-a493-4ccf-bb3e-a9ac96ad16e6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.532110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ca316ee-a493-4ccf-bb3e-a9ac96ad16e6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.678273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ca316ee-a493-4ccf-bb3e-a9ac96ad16e6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:46.686729 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ca316ee-a493-4ccf-bb3e-a9ac96ad16e6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.168317 Jul 26 19:45:46.697325 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 361/656] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:46 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:46.838521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-29558fad-895d-4683-af30-163eb78f2c8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:46.839135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-29558fad-895d-4683-af30-163eb78f2c8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:46.846566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29558fad-895d-4683-af30-163eb78f2c8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.847010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29558fad-895d-4683-af30-163eb78f2c8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.847944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29558fad-895d-4683-af30-163eb78f2c8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.848594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29558fad-895d-4683-af30-163eb78f2c8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.946107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3ddab46-415f-46c6-8d4d-a95f6c0aeb5f tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Calling method '.version_select at 0x7f875753de50>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:46.959545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3ddab46-415f-46c6-8d4d-a95f6c0aeb5f tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.960412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3ddab46-415f-46c6-8d4d-a95f6c0aeb5f tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.961420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3ddab46-415f-46c6-8d4d-a95f6c0aeb5f tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:46.962177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3ddab46-415f-46c6-8d4d-a95f6c0aeb5f tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:46.982871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3ddab46-415f-46c6-8d4d-a95f6c0aeb5f tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.174189 Jul 26 19:45:46.984189 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 296/657] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Jul 26 19:45:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:46.989052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:46.989647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:46.999493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.000488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.003674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.004914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.018780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-29558fad-895d-4683-af30-163eb78f2c8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:47.042421 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-29558fad-895d-4683-af30-163eb78f2c8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1318 microversion: 2.1 time: 0.207651 Jul 26 19:45:47.043019 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 362/658] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:46 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:47.057099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3e7df38-d088-451b-83b4-647c3295f99d tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-699658891", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:47.121792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-a3e7df38-d088-451b-83b4-647c3295f99d tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:47.148763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:47.157033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:47.158543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:47.159654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c7633b59-7490-49c5-b6e6-5db1c42c7cde tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1362 microversion: 2.25 time: 0.174315 Jul 26 19:45:47.160211 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 297/659] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:46 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:47.341158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a3e7df38-d088-451b-83b4-647c3295f99d tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Getting quotas for project 799244838fed40e78ed16f7cab42f7c7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:47.346149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a3e7df38-d088-451b-83b4-647c3295f99d tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Getting quotas for user 6d6b5418b89148c6aa44b5898c733802 and project 799244838fed40e78ed16f7cab42f7c7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:47.358471 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-a3e7df38-d088-451b-83b4-647c3295f99d tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3e7df38-d088-451b-83b4-647c3295f99d tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Request method failure captured: Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 1751 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERqP4-cvpjvVL6u-XNe4HMr05qkKyfJwJ_NtEi2Yg0NlvHAqJVOVk3oCchctbzi5xpY-M1MJ3G8jrufSxrqf_NkIUAzSsrHuQyV6osOIjrkMW2ZcrOikh5eITPGDDACwcQqXR5HC-iL0HcNBs9Pdg1Uco-nBXUWD0jejYRpMKYssE4 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 799244838fed40e78ed16f7cab42f7c7 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-599712763 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/799244838fed40e78ed16f7cab42f7c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/799244838fed40e78ed16f7cab42f7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_799244838fed40e78ed16f7cab42f7c7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/799244838fed40e78ed16f7cab42f7c7"}]}] Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-599712763 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 799244838fed40e78ed16f7cab42f7c7 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-599712763 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-599712763-project Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6d6b5418b89148c6aa44b5898c733802 Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-599712763-project Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-699658891", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:45:47.360542 n-d-708768-8 devstack@n-api.service[125963]: exception: Maximum number of metadata items exceeds 128 Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-699658891', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:47.362988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3e7df38-d088-451b-83b4-647c3295f99d tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3e7df38-d088-451b-83b4-647c3295f99d tempest-AbsoluteLimitsNegativeTestJSON-599712763 tempest-AbsoluteLimitsNegativeTestJSON-599712763-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.309013 Jul 26 19:45:47.366587 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 363/660] 10.222.0.58 () {60 vars in 1148 bytes} [Tue Jul 26 19:45:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 310 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Jul 26 19:45:47.436093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ee737e2-5989-4dbf-b20e-9f6c19cb66d3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:47.436700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ee737e2-5989-4dbf-b20e-9f6c19cb66d3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:47.442953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ee737e2-5989-4dbf-b20e-9f6c19cb66d3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.443739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ee737e2-5989-4dbf-b20e-9f6c19cb66d3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.444357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8f757daf-cee3-4c54-b2e0-cf76c8e10c04 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:47.444913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ee737e2-5989-4dbf-b20e-9f6c19cb66d3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.445801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ee737e2-5989-4dbf-b20e-9f6c19cb66d3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.445932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8f757daf-cee3-4c54-b2e0-cf76c8e10c04 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:47.452513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f757daf-cee3-4c54-b2e0-cf76c8e10c04 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.452965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f757daf-cee3-4c54-b2e0-cf76c8e10c04 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.454045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f757daf-cee3-4c54-b2e0-cf76c8e10c04 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.454487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f757daf-cee3-4c54-b2e0-cf76c8e10c04 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.612025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ee737e2-5989-4dbf-b20e-9f6c19cb66d3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:47.617344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8f757daf-cee3-4c54-b2e0-cf76c8e10c04 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:47.620984 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ee737e2-5989-4dbf-b20e-9f6c19cb66d3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1470 microversion: 2.1 time: 0.188380 Jul 26 19:45:47.621563 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 298/661] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:47 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:47.627179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3507acc3-a4ab-4668-ad0e-4146ce09b6b5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:47.627828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3507acc3-a4ab-4668-ad0e-4146ce09b6b5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:47.635405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3507acc3-a4ab-4668-ad0e-4146ce09b6b5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.636158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3507acc3-a4ab-4668-ad0e-4146ce09b6b5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.637091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3507acc3-a4ab-4668-ad0e-4146ce09b6b5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.637683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3507acc3-a4ab-4668-ad0e-4146ce09b6b5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.643870 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8f757daf-cee3-4c54-b2e0-cf76c8e10c04 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.204680 Jul 26 19:45:47.646690 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 364/662] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:47 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:47.652162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-da186b03-a4f5-4af0-b6a3-51efdad05a9b req-fbb912c2-ad34-4d9f-88c1-9acce33669fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc83fe1-fbb9-470d-91fa-cc759b3092b8", "name": "network-vif-plugged", "status": "completed", "tag": "96ea90af-6318-4941-8fef-4b941cfc947a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:47.664856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-da186b03-a4f5-4af0-b6a3-51efdad05a9b req-fbb912c2-ad34-4d9f-88c1-9acce33669fd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.665778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-da186b03-a4f5-4af0-b6a3-51efdad05a9b req-fbb912c2-ad34-4d9f-88c1-9acce33669fd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.671361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3507acc3-a4ab-4668-ad0e-4146ce09b6b5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:45:47.681728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-da186b03-a4f5-4af0-b6a3-51efdad05a9b req-fbb912c2-ad34-4d9f-88c1-9acce33669fd service nova] Creating event network-vif-plugged:96ea90af-6318-4941-8fef-4b941cfc947a for instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 on n-h2-708768-8 Jul 26 19:45:47.688324 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-da186b03-a4f5-4af0-b6a3-51efdad05a9b req-fbb912c2-ad34-4d9f-88c1-9acce33669fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040199 Jul 26 19:45:47.689014 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 365/663] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:47.695823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0fb3e83b-515c-457a-a27f-6f1ca682f6d2 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:47.696433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0fb3e83b-515c-457a-a27f-6f1ca682f6d2 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:47.703955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0fb3e83b-515c-457a-a27f-6f1ca682f6d2 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.704396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0fb3e83b-515c-457a-a27f-6f1ca682f6d2 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.705166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0fb3e83b-515c-457a-a27f-6f1ca682f6d2 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.705586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0fb3e83b-515c-457a-a27f-6f1ca682f6d2 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.736199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-0fb3e83b-515c-457a-a27f-6f1ca682f6d2 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lazy-loading 'flavor' on Instance uuid 8cb4bb85-05be-4add-898f-be82c0375754 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:45:47.765930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:47.773871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3507acc3-a4ab-4668-ad0e-4146ce09b6b5 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "DELETE /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 204 len: 0 microversion: 2.1 time: 0.151040 Jul 26 19:45:47.774986 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 299/664] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:45:47 2022] DELETE /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:45:47.781054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8f83e7f5-51c1-4453-ac30-72b16f21738d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:47.781820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8f83e7f5-51c1-4453-ac30-72b16f21738d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:47.789749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f83e7f5-51c1-4453-ac30-72b16f21738d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.790199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f83e7f5-51c1-4453-ac30-72b16f21738d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.791197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f83e7f5-51c1-4453-ac30-72b16f21738d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.791656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f83e7f5-51c1-4453-ac30-72b16f21738d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.817520 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0fb3e83b-515c-457a-a27f-6f1ca682f6d2 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754/action" status: 202 len: 0 microversion: 2.1 time: 0.126365 Jul 26 19:45:47.818385 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 366/665] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:47 2022] POST /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:47.823900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ff32939-707a-4f5c-917d-9b8a63e0d99d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:47.824600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ff32939-707a-4f5c-917d-9b8a63e0d99d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:47.832967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ff32939-707a-4f5c-917d-9b8a63e0d99d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.833529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ff32939-707a-4f5c-917d-9b8a63e0d99d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.835217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ff32939-707a-4f5c-917d-9b8a63e0d99d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:47.835859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ff32939-707a-4f5c-917d-9b8a63e0d99d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:47.989141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9ff32939-707a-4f5c-917d-9b8a63e0d99d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:47.997909 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ff32939-707a-4f5c-917d-9b8a63e0d99d tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1710 microversion: 2.1 time: 0.178092 Jul 26 19:45:47.998484 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 367/666] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:47 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:48.002807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32546bc4-8d36-4646-9be4-98b1257ea8a0 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:48.003409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32546bc4-8d36-4646-9be4-98b1257ea8a0 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:48.009510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32546bc4-8d36-4646-9be4-98b1257ea8a0 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:48.009939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32546bc4-8d36-4646-9be4-98b1257ea8a0 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:48.010897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32546bc4-8d36-4646-9be4-98b1257ea8a0 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:48.011329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32546bc4-8d36-4646-9be4-98b1257ea8a0 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:48.041792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f83e7f5-51c1-4453-ac30-72b16f21738d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:48.052904 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8f83e7f5-51c1-4453-ac30-72b16f21738d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.276321 Jul 26 19:45:48.054454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 300/667] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:47 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:48.081081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a6727e8-8723-4348-b8ff-22f7cb11ea93 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:48.081991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a6727e8-8723-4348-b8ff-22f7cb11ea93 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:48.089211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a6727e8-8723-4348-b8ff-22f7cb11ea93 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:48.089652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a6727e8-8723-4348-b8ff-22f7cb11ea93 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:48.090490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a6727e8-8723-4348-b8ff-22f7cb11ea93 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:48.090872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a6727e8-8723-4348-b8ff-22f7cb11ea93 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:48.293156 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32546bc4-8d36-4646-9be4-98b1257ea8a0 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1629 microversion: 2.1 time: 0.293553 Jul 26 19:45:48.293685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 368/668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:47 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1629 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:48.296984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a6727e8-8723-4348-b8ff-22f7cb11ea93 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:48.298166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:48.298772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:48.311559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:48.312042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:48.312817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:48.313249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:48.314997 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a6727e8-8723-4348-b8ff-22f7cb11ea93 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1318 microversion: 2.1 time: 0.240844 Jul 26 19:45:48.315430 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 301/669] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:48 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:48.322992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:48.461075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:48.469379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:48.471176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:48.475174 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2614eb65-7fc6-47f1-8ae1-bc42698580ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1362 microversion: 2.25 time: 0.177423 Jul 26 19:45:48.488512 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 369/670] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:48 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:48.669025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-daaf843a-208f-4c64-b891-685d991c7495 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:48.669691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-daaf843a-208f-4c64-b891-685d991c7495 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:48.676193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daaf843a-208f-4c64-b891-685d991c7495 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:48.677037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daaf843a-208f-4c64-b891-685d991c7495 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:48.677735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daaf843a-208f-4c64-b891-685d991c7495 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:48.678168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daaf843a-208f-4c64-b891-685d991c7495 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.022146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a05bfab-db61-47d6-8e42-50f85cfe279a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:49.023531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a05bfab-db61-47d6-8e42-50f85cfe279a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:49.034576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a05bfab-db61-47d6-8e42-50f85cfe279a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.036123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a05bfab-db61-47d6-8e42-50f85cfe279a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.041470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a05bfab-db61-47d6-8e42-50f85cfe279a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.041940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a05bfab-db61-47d6-8e42-50f85cfe279a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.126887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-daaf843a-208f-4c64-b891-685d991c7495 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:49.135064 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-daaf843a-208f-4c64-b891-685d991c7495 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.469948 Jul 26 19:45:49.135658 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 302/671] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:48 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:49.140388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-33afe100-e40e-4ab9-9493-6302f7940b05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:49.141237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-33afe100-e40e-4ab9-9493-6302f7940b05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:49.147809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33afe100-e40e-4ab9-9493-6302f7940b05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.148484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33afe100-e40e-4ab9-9493-6302f7940b05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.149729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33afe100-e40e-4ab9-9493-6302f7940b05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.150167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33afe100-e40e-4ab9-9493-6302f7940b05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.222397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a05bfab-db61-47d6-8e42-50f85cfe279a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:49.233868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a05bfab-db61-47d6-8e42-50f85cfe279a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1710 microversion: 2.1 time: 0.216974 Jul 26 19:45:49.234446 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 370/672] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:49 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1710 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:49.316645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8b1f80f-19b7-42c0-9657-dc40ce9d7e24 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:49.317246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8b1f80f-19b7-42c0-9657-dc40ce9d7e24 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:49.323805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b1f80f-19b7-42c0-9657-dc40ce9d7e24 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.324247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b1f80f-19b7-42c0-9657-dc40ce9d7e24 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.325016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b1f80f-19b7-42c0-9657-dc40ce9d7e24 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.325442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b1f80f-19b7-42c0-9657-dc40ce9d7e24 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.377804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-33afe100-e40e-4ab9-9493-6302f7940b05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:49.387931 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-33afe100-e40e-4ab9-9493-6302f7940b05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.250979 Jul 26 19:45:49.388524 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 303/673] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:49 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:49.393899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-617874b6-a680-4300-841b-2d308cf20aa9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:49.394727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-617874b6-a680-4300-841b-2d308cf20aa9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:49.401870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-617874b6-a680-4300-841b-2d308cf20aa9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.402656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-617874b6-a680-4300-841b-2d308cf20aa9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.403545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-617874b6-a680-4300-841b-2d308cf20aa9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.404096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-617874b6-a680-4300-841b-2d308cf20aa9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.607680 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8b1f80f-19b7-42c0-9657-dc40ce9d7e24 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1612 microversion: 2.1 time: 0.294531 Jul 26 19:45:49.608907 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 371/674] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:49 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1612 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:49.614329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:49.615192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:49.628469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.630021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.630931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.631431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.641466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-617874b6-a680-4300-841b-2d308cf20aa9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:49.662930 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-617874b6-a680-4300-841b-2d308cf20aa9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1318 microversion: 2.1 time: 0.273088 Jul 26 19:45:49.666374 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 304/675] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:49 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:49.676117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:49.677033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:49.685193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.685893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.686907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.687544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.771369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:49.783038 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] HTTP exception thrown: Cannot 'migrate' instance 8cb4bb85-05be-4add-898f-be82c0375754 while it is in vm_state suspended Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Request method failure captured: Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754/action HTTP/1.1 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 15 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ7lCLfnyJkeIgTaBKjL-CnWR2yIlGy_hFuyUS5zibzmnIX8Glnw4d7tq0msi82i8CaFUU7156xCqT9BFAbtdOSGlEtzTmhIUzh-jMNOGqg7aXuk1b-NDhPmq02hn0CP9D2gYayKvC4WkE5qJp44Vu5SedOxk8i4JUA_8jqxeIxszk Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b865e79ae79d4b2ba625b9a613942785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}] Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ceecf9c151284d4a8f28e690cda29942 Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: {"migrate": {}} Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'migrate' instance 8cb4bb85-05be-4add-898f-be82c0375754 while it is in vm_state suspended Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '8cb4bb85-05be-4add-898f-be82c0375754', 'body': {'migrate': {}}} Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8cb4bb85-05be-4add-898f-be82c0375754 in vm_state suspended. Cannot resize while the instance is in this state. Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:49.784802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 8cb4bb85-05be-4add-898f-be82c0375754 while it is in vm_state suspended Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 8cb4bb85-05be-4add-898f-be82c0375754 while it is in vm_state suspended Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Returning 409 to user: Cannot 'migrate' instance 8cb4bb85-05be-4add-898f-be82c0375754 while it is in vm_state suspended {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c93c941-8e77-4481-ad17-e10d22654812 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754/action" status: 409 len: 148 microversion: 2.1 time: 0.118569 Jul 26 19:45:49.789431 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 305/676] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:49 2022] POST /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754/action => generated 148 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:45:49.801829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d774397a-e3fe-417d-8c73-bd79ca86ceae tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d774397a-e3fe-417d-8c73-bd79ca86ceae tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Request method failure captured: Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6/action HTTP/1.1 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 39 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ7lCLfnyJkeIgTaBKjL-CnWR2yIlGy_hFuyUS5zibzmnIX8Glnw4d7tq0msi82i8CaFUU7156xCqT9BFAbtdOSGlEtzTmhIUzh-jMNOGqg7aXuk1b-NDhPmq02hn0CP9D2gYayKvC4WkE5qJp44Vu5SedOxk8i4JUA_8jqxeIxszk Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b865e79ae79d4b2ba625b9a613942785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}] Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ceecf9c151284d4a8f28e690cda29942 Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: {"os-resetState": {"state": "invalid"}} Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ef27307f-bc06-4095-80df-d383826007e6', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:45:49.807030 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d774397a-e3fe-417d-8c73-bd79ca86ceae tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d774397a-e3fe-417d-8c73-bd79ca86ceae tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6/action" status: 400 len: 144 microversion: 2.1 time: 0.012210 Jul 26 19:45:49.810920 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 306/677] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:49 2022] POST /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6/action => generated 144 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:45:49.819405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a2b8890-3c19-484b-be70-b239b023bf88 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a2b8890-3c19-484b-be70-b239b023bf88 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Request method failure captured: Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6/action HTTP/1.1 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 31 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ7lCLfnyJkeIgTaBKjL-CnWR2yIlGy_hFuyUS5zibzmnIX8Glnw4d7tq0msi82i8CaFUU7156xCqT9BFAbtdOSGlEtzTmhIUzh-jMNOGqg7aXuk1b-NDhPmq02hn0CP9D2gYayKvC4WkE5qJp44Vu5SedOxk8i4JUA_8jqxeIxszk Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b865e79ae79d4b2ba625b9a613942785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}] Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ceecf9c151284d4a8f28e690cda29942 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: {"os-resetState": {"state": 1}} Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ef27307f-bc06-4095-80df-d383826007e6', 'body': {'os-resetState': {'state': 1}}} Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 1 Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 19:45:49.825264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a2b8890-3c19-484b-be70-b239b023bf88 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a2b8890-3c19-484b-be70-b239b023bf88 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6/action" status: 400 len: 120 microversion: 2.1 time: 0.011719 Jul 26 19:45:49.829708 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 307/678] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:45:49 2022] POST /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:45:49.838415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22a59e65-2889-4759-922d-4329b6e93682 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:49.840549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-22a59e65-2889-4759-922d-4329b6e93682 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Failed to fetch instance by id 999 {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 19:45:49.841064 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-22a59e65-2889-4759-922d-4329b6e93682 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22a59e65-2889-4759-922d-4329b6e93682 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Request method failure captured: Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 37 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ7lCLfnyJkeIgTaBKjL-CnWR2yIlGy_hFuyUS5zibzmnIX8Glnw4d7tq0msi82i8CaFUU7156xCqT9BFAbtdOSGlEtzTmhIUzh-jMNOGqg7aXuk1b-NDhPmq02hn0CP9D2gYayKvC4WkE5qJp44Vu5SedOxk8i4JUA_8jqxeIxszk Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b865e79ae79d4b2ba625b9a613942785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b865e79ae79d4b2ba625b9a613942785"}]}] Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: b865e79ae79d4b2ba625b9a613942785 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1143561070 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ceecf9c151284d4a8f28e690cda29942 Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1143561070-project-admin Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: {"os-resetState": {"state": "error"}} Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 999 could not be found. Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:49.845858 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:49.850353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:49.850353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 26 19:45:49.850353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:49.850353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22a59e65-2889-4759-922d-4329b6e93682 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:49.850353 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22a59e65-2889-4759-922d-4329b6e93682 tempest-ServersAdminNegativeTestJSON-1143561070 tempest-ServersAdminNegativeTestJSON-1143561070-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.014613 Jul 26 19:45:49.850353 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 308/679] 10.222.0.58 () {60 vars in 1179 bytes} [Tue Jul 26 19:45:49 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:45:49.860913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf3e2cb2-e0c5-4b60-957b-1421a01d09c8 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:49.861338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf3e2cb2-e0c5-4b60-957b-1421a01d09c8 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:49.869379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf3e2cb2-e0c5-4b60-957b-1421a01d09c8 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.869829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf3e2cb2-e0c5-4b60-957b-1421a01d09c8 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.870609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf3e2cb2-e0c5-4b60-957b-1421a01d09c8 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:49.871042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf3e2cb2-e0c5-4b60-957b-1421a01d09c8 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:49.896599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf3e2cb2-e0c5-4b60-957b-1421a01d09c8 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:45:49.937322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:49.978881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:49.980550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:49.981906 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d7d9d2a3-5eae-4014-a064-53f548f368a3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1362 microversion: 2.25 time: 0.371800 Jul 26 19:45:49.995979 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 372/680] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:49 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:50.005906 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf3e2cb2-e0c5-4b60-957b-1421a01d09c8 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 204 len: 0 microversion: 2.1 time: 0.150976 Jul 26 19:45:50.012189 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 309/681] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:45:49 2022] DELETE /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:45:50.021090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7924a7c2-5e3b-47b3-aca4-45e52915f8f9 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:50.022046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7924a7c2-5e3b-47b3-aca4-45e52915f8f9 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:50.035872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7924a7c2-5e3b-47b3-aca4-45e52915f8f9 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.037871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7924a7c2-5e3b-47b3-aca4-45e52915f8f9 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.038843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7924a7c2-5e3b-47b3-aca4-45e52915f8f9 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.039347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7924a7c2-5e3b-47b3-aca4-45e52915f8f9 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.157143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-da5c4f11-0e21-4e69-a0d4-3fd91435bc8b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:50.157995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-da5c4f11-0e21-4e69-a0d4-3fd91435bc8b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:50.165008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da5c4f11-0e21-4e69-a0d4-3fd91435bc8b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.165447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da5c4f11-0e21-4e69-a0d4-3fd91435bc8b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.166442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da5c4f11-0e21-4e69-a0d4-3fd91435bc8b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.167069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da5c4f11-0e21-4e69-a0d4-3fd91435bc8b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.209070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7924a7c2-5e3b-47b3-aca4-45e52915f8f9 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:50.217638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7924a7c2-5e3b-47b3-aca4-45e52915f8f9 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1467 microversion: 2.1 time: 0.204077 Jul 26 19:45:50.218605 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 373/682] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:50 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1467 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:50.259821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c2c499e9-70ac-4024-b06b-d25e225922aa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:50.261202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c2c499e9-70ac-4024-b06b-d25e225922aa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:50.268288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2c499e9-70ac-4024-b06b-d25e225922aa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.270356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2c499e9-70ac-4024-b06b-d25e225922aa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.271475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2c499e9-70ac-4024-b06b-d25e225922aa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.272155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2c499e9-70ac-4024-b06b-d25e225922aa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.419977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c2c499e9-70ac-4024-b06b-d25e225922aa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:50.421691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-da5c4f11-0e21-4e69-a0d4-3fd91435bc8b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:50.429802 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c2c499e9-70ac-4024-b06b-d25e225922aa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1710 microversion: 2.1 time: 0.174755 Jul 26 19:45:50.430975 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 374/683] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:50 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:50.437779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ec9ef6f9-d355-4f53-8c08-4116d79d920a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:50.438787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ec9ef6f9-d355-4f53-8c08-4116d79d920a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:50.445210 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-da5c4f11-0e21-4e69-a0d4-3fd91435bc8b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.278005 Jul 26 19:45:50.446013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec9ef6f9-d355-4f53-8c08-4116d79d920a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.446663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec9ef6f9-d355-4f53-8c08-4116d79d920a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.447000 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 310/684] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:50 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:50.447907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec9ef6f9-d355-4f53-8c08-4116d79d920a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.448521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec9ef6f9-d355-4f53-8c08-4116d79d920a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.593037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ec9ef6f9-d355-4f53-8c08-4116d79d920a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:50.601564 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ec9ef6f9-d355-4f53-8c08-4116d79d920a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.169262 Jul 26 19:45:50.602492 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 375/685] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:50 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:50.688203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f03c580a-ff4f-4d7e-afa0-b3ddb9f2e96c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:50.688503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f03c580a-ff4f-4d7e-afa0-b3ddb9f2e96c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:50.700169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f03c580a-ff4f-4d7e-afa0-b3ddb9f2e96c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.700619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f03c580a-ff4f-4d7e-afa0-b3ddb9f2e96c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.701635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f03c580a-ff4f-4d7e-afa0-b3ddb9f2e96c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:50.702277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f03c580a-ff4f-4d7e-afa0-b3ddb9f2e96c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:50.962695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f03c580a-ff4f-4d7e-afa0-b3ddb9f2e96c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:50.973967 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f03c580a-ff4f-4d7e-afa0-b3ddb9f2e96c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1318 microversion: 2.1 time: 0.290107 Jul 26 19:45:50.974842 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 311/686] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:50 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:51.073175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:51.073950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:51.081806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.082977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.084187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.084624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.241532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ebd59ff8-4cea-4c26-94c9-1dbdbefa34e3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:51.242141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ebd59ff8-4cea-4c26-94c9-1dbdbefa34e3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:51.253105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ebd59ff8-4cea-4c26-94c9-1dbdbefa34e3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.254074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ebd59ff8-4cea-4c26-94c9-1dbdbefa34e3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.256065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ebd59ff8-4cea-4c26-94c9-1dbdbefa34e3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.256485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:51.256878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ebd59ff8-4cea-4c26-94c9-1dbdbefa34e3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.267197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:51.270422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:51.272489 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87d8a298-d51b-4721-9b02-730233649336 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1362 microversion: 2.25 time: 0.204534 Jul 26 19:45:51.299085 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 376/687] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:51 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:51.452754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9c5cf9c9-f3cc-4301-a37a-ac95d3badb9f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:51.453395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9c5cf9c9-f3cc-4301-a37a-ac95d3badb9f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:51.474339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c5cf9c9-f3cc-4301-a37a-ac95d3badb9f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.474745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c5cf9c9-f3cc-4301-a37a-ac95d3badb9f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.475544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c5cf9c9-f3cc-4301-a37a-ac95d3badb9f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.476006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c5cf9c9-f3cc-4301-a37a-ac95d3badb9f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.618910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9c5cf9c9-f3cc-4301-a37a-ac95d3badb9f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:51.628298 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9c5cf9c9-f3cc-4301-a37a-ac95d3badb9f tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1710 microversion: 2.1 time: 0.179749 Jul 26 19:45:51.643757 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 377/688] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:51 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1710 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:51.649387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7b9dcad9-8c02-4ef1-a82e-8dcb4e6bf210 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:51.650386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7b9dcad9-8c02-4ef1-a82e-8dcb4e6bf210 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:51.657485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b9dcad9-8c02-4ef1-a82e-8dcb4e6bf210 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.658021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b9dcad9-8c02-4ef1-a82e-8dcb4e6bf210 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.658901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b9dcad9-8c02-4ef1-a82e-8dcb4e6bf210 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.659415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b9dcad9-8c02-4ef1-a82e-8dcb4e6bf210 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.698690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ebd59ff8-4cea-4c26-94c9-1dbdbefa34e3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:51.706455 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ebd59ff8-4cea-4c26-94c9-1dbdbefa34e3 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1467 microversion: 2.1 time: 0.470368 Jul 26 19:45:51.707033 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 312/689] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:51 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1467 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:51.720193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d49586f6-b52c-4162-a34d-7ab9813b683b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:51.721086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d49586f6-b52c-4162-a34d-7ab9813b683b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:51.729654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d49586f6-b52c-4162-a34d-7ab9813b683b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.730359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d49586f6-b52c-4162-a34d-7ab9813b683b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.732282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d49586f6-b52c-4162-a34d-7ab9813b683b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:51.733596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d49586f6-b52c-4162-a34d-7ab9813b683b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:51.864558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b9dcad9-8c02-4ef1-a82e-8dcb4e6bf210 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:51.872784 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7b9dcad9-8c02-4ef1-a82e-8dcb4e6bf210 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.227504 Jul 26 19:45:51.873791 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 378/690] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:51 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:51.995806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6395afb9-1cbd-4bea-a1e8-087995fc71ed tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:51.996990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6395afb9-1cbd-4bea-a1e8-087995fc71ed tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:52.003764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6395afb9-1cbd-4bea-a1e8-087995fc71ed tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.005169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6395afb9-1cbd-4bea-a1e8-087995fc71ed tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.006058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6395afb9-1cbd-4bea-a1e8-087995fc71ed tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.006572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6395afb9-1cbd-4bea-a1e8-087995fc71ed tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.159285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6395afb9-1cbd-4bea-a1e8-087995fc71ed tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:52.174697 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6395afb9-1cbd-4bea-a1e8-087995fc71ed tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1468 microversion: 2.1 time: 0.182865 Jul 26 19:45:52.175283 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 379/691] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:51 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1468 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:52.196319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:52.203389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:52.204297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Searching by: {'reservation_id': 'r-0ghkk5fb', 'deleted': False, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:52.209872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.210267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.211707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.212330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.244714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=27 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:52.406408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:45:52.479274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=45 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:52.487354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:52.495365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.495902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.499672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d49586f6-b52c-4162-a34d-7ab9813b683b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:52.508412 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d49586f6-b52c-4162-a34d-7ab9813b683b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.797036 Jul 26 19:45:52.510356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 313/692] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:51 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:52.527299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:52.528050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:52.545552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.545999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.546784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.547217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.658177 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-acb08494-1e45-473a-872f-7e1f536f6538 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-0ghkk5fb" status: 200 len: 2928 microversion: 2.1 time: 0.465672 Jul 26 19:45:52.658800 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 380/693] 10.222.0.58 () {58 vars in 1197 bytes} [Tue Jul 26 19:45:52 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0ghkk5fb => generated 2928 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:52.663948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd8c494e-0668-4ddb-96b3-433287407f9a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:52.664553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bd8c494e-0668-4ddb-96b3-433287407f9a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:52.671004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd8c494e-0668-4ddb-96b3-433287407f9a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.671447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd8c494e-0668-4ddb-96b3-433287407f9a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.672260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd8c494e-0668-4ddb-96b3-433287407f9a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.672718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd8c494e-0668-4ddb-96b3-433287407f9a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.823385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd8c494e-0668-4ddb-96b3-433287407f9a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:52.835430 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bd8c494e-0668-4ddb-96b3-433287407f9a tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1710 microversion: 2.1 time: 0.175611 Jul 26 19:45:52.836060 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 381/694] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:52 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:52.849107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a450f0a9-c95a-4721-ad78-554341171fd6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:52.867826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.compute.server_groups [None req-a450f0a9-c95a-4721-ad78-554341171fd6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Querying cell 0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) for 2 instances {{(pid=125963) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 19:45:52.868624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a450f0a9-c95a-4721-ad78-554341171fd6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.869134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a450f0a9-c95a-4721-ad78-554341171fd6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.908213 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a450f0a9-c95a-4721-ad78-554341171fd6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/bc722a98-7f2f-4f50-9e6f-6a5af61a22e2" status: 200 len: 264 microversion: 2.1 time: 0.067870 Jul 26 19:45:52.909003 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 382/695] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:45:52 2022] GET /compute/v2.1/os-server-groups/bc722a98-7f2f-4f50-9e6f-6a5af61a22e2 => generated 264 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:52.916574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e9921680-7fa6-4d7d-99eb-30ee7e48ccec tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:52.917282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e9921680-7fa6-4d7d-99eb-30ee7e48ccec tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:52.923901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9921680-7fa6-4d7d-99eb-30ee7e48ccec tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.924351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9921680-7fa6-4d7d-99eb-30ee7e48ccec tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.925125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9921680-7fa6-4d7d-99eb-30ee7e48ccec tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:52.925823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9921680-7fa6-4d7d-99eb-30ee7e48ccec tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:52.984446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:53.001287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:53.005409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:53.006743 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4b842fbb-2403-43f3-8e89-2c692cf3ed5f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1362 microversion: 2.25 time: 0.490326 Jul 26 19:45:53.007318 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 314/696] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:52 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:53.020456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-203b322f-97b4-4c28-8f18-b8cdfeea82dc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:53.021311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-203b322f-97b4-4c28-8f18-b8cdfeea82dc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:53.041266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-203b322f-97b4-4c28-8f18-b8cdfeea82dc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.041748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-203b322f-97b4-4c28-8f18-b8cdfeea82dc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.042625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-203b322f-97b4-4c28-8f18-b8cdfeea82dc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.043043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-203b322f-97b4-4c28-8f18-b8cdfeea82dc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.090579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e9921680-7fa6-4d7d-99eb-30ee7e48ccec tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:53.100488 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e9921680-7fa6-4d7d-99eb-30ee7e48ccec tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1467 microversion: 2.1 time: 0.186851 Jul 26 19:45:53.102715 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 383/697] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:52 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1467 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:53.107254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d0da4b14-f172-43e4-95a7-535b341ecff1 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:53.107887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d0da4b14-f172-43e4-95a7-535b341ecff1 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:53.116521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0da4b14-f172-43e4-95a7-535b341ecff1 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.117149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0da4b14-f172-43e4-95a7-535b341ecff1 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.118007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0da4b14-f172-43e4-95a7-535b341ecff1 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.118476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0da4b14-f172-43e4-95a7-535b341ecff1 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.308581 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d0da4b14-f172-43e4-95a7-535b341ecff1 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1619 microversion: 2.1 time: 0.203152 Jul 26 19:45:53.325753 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 384/698] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:53 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1619 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:53.345113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e4a1c7c9-9d95-4af7-86a9-41a2bea6f51f req-0743ccf4-a454-4049-8796-38bda2dc26d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c305d3d-37c5-4ee8-81cc-3ff8f2998d52", "name": "network-vif-plugged", "status": "completed", "tag": "8b554828-b715-42fe-9f30-38b72c6f49f2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:53.357762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e4a1c7c9-9d95-4af7-86a9-41a2bea6f51f req-0743ccf4-a454-4049-8796-38bda2dc26d4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.358633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e4a1c7c9-9d95-4af7-86a9-41a2bea6f51f req-0743ccf4-a454-4049-8796-38bda2dc26d4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.388333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-203b322f-97b4-4c28-8f18-b8cdfeea82dc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:53.388567 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e4a1c7c9-9d95-4af7-86a9-41a2bea6f51f req-0743ccf4-a454-4049-8796-38bda2dc26d4 service nova] Creating event network-vif-plugged:8b554828-b715-42fe-9f30-38b72c6f49f2 for instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 on n-h1-708768-8 Jul 26 19:45:53.398243 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-203b322f-97b4-4c28-8f18-b8cdfeea82dc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.389598 Jul 26 19:45:53.399507 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e4a1c7c9-9d95-4af7-86a9-41a2bea6f51f req-0743ccf4-a454-4049-8796-38bda2dc26d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076074 Jul 26 19:45:53.400673 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 385/699] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:53.402838 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 315/700] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:53 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:53.461044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4778e34f-b572-4a64-a0d7-e381a2c1fc69 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:53.464446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4778e34f-b572-4a64-a0d7-e381a2c1fc69 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:53.487925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4778e34f-b572-4a64-a0d7-e381a2c1fc69 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.488154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4778e34f-b572-4a64-a0d7-e381a2c1fc69 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.491689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4778e34f-b572-4a64-a0d7-e381a2c1fc69 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.492325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4778e34f-b572-4a64-a0d7-e381a2c1fc69 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.503755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:53.534873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87805f35-b583-4c3d-abaa-cc573a339791 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:53.536242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-87805f35-b583-4c3d-abaa-cc573a339791 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:53.543038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87805f35-b583-4c3d-abaa-cc573a339791 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.543711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87805f35-b583-4c3d-abaa-cc573a339791 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.557094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87805f35-b583-4c3d-abaa-cc573a339791 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.557785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87805f35-b583-4c3d-abaa-cc573a339791 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.817956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4778e34f-b572-4a64-a0d7-e381a2c1fc69 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 200 len: 1618 microversion: 2.1 time: 0.415557 Jul 26 19:45:53.818551 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 386/701] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:53 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 1618 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:53.827874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-8da5137b-1efb-4184-9af0-b8055724ecff req-f5970775-8329-4f3f-a3f7-8f9651685bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb4bb85-05be-4add-898f-be82c0375754", "name": "network-vif-deleted", "tag": "718edf50-d6e3-4c55-8013-d795ca6662f9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:53.845487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8da5137b-1efb-4184-9af0-b8055724ecff req-f5970775-8329-4f3f-a3f7-8f9651685bc8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:53.846485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8da5137b-1efb-4184-9af0-b8055724ecff req-f5970775-8329-4f3f-a3f7-8f9651685bc8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:53.863030 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-8da5137b-1efb-4184-9af0-b8055724ecff req-f5970775-8329-4f3f-a3f7-8f9651685bc8 service nova] Creating event network-vif-deleted:718edf50-d6e3-4c55-8013-d795ca6662f9 for instance 8cb4bb85-05be-4add-898f-be82c0375754 on n-h1-708768-8 Jul 26 19:45:53.868962 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-8da5137b-1efb-4184-9af0-b8055724ecff req-f5970775-8329-4f3f-a3f7-8f9651685bc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049304 Jul 26 19:45:53.869867 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 387/702] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:53.875046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdbf2f01-464b-41fd-a64b-3f92f3dc9765 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Action: 'create', calling method: .version_select at 0x7f875f3fbee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1825447003", "policies": ["anti-affinity"]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:53.895050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cdbf2f01-464b-41fd-a64b-3f92f3dc9765 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:53.900829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cdbf2f01-464b-41fd-a64b-3f92f3dc9765 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:53.948677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cdbf2f01-464b-41fd-a64b-3f92f3dc9765 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:53.954907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cdbf2f01-464b-41fd-a64b-3f92f3dc9765 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:53.974585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:53.975526 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cdbf2f01-464b-41fd-a64b-3f92f3dc9765 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.104445 Jul 26 19:45:53.976612 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 388/703] 10.222.0.58 () {60 vars in 1174 bytes} [Tue Jul 26 19:45:53 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:53.981662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-615cb930-0d98-4550-9432-ef4e967ae39e tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:53.982396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-615cb930-0d98-4550-9432-ef4e967ae39e tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:53.993586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-87805f35-b583-4c3d-abaa-cc573a339791 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:54.009501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-87805f35-b583-4c3d-abaa-cc573a339791 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.470723 Jul 26 19:45:54.010011 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 316/704] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:53 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:45:54.013731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-615cb930-0d98-4550-9432-ef4e967ae39e tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.014186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-615cb930-0d98-4550-9432-ef4e967ae39e tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.014964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-615cb930-0d98-4550-9432-ef4e967ae39e tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.015483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-615cb930-0d98-4550-9432-ef4e967ae39e tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.029366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:54.032353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:54.053354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.054043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.057499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.060103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.191307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-615cb930-0d98-4550-9432-ef4e967ae39e tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7836e60170f1440c9d82b730e8d03344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5112c2e993b44756a068fe8782e68681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:54.220263 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-615cb930-0d98-4550-9432-ef4e967ae39e tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 200 len: 1346 microversion: 2.1 time: 0.239770 Jul 26 19:45:54.221711 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 389/705] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:53 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 1346 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:54.231954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:54.232799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:54.241777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.243061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.245719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.247289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.304982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.305356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.305809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lazy-loading 'fault' on Instance uuid 8cb4bb85-05be-4add-898f-be82c0375754 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:45:54.346004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:54.358772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:54.361029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:54.362158 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b1262dfa-a40e-4d4a-980a-63582a18d15e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1362 microversion: 2.25 time: 0.336766 Jul 26 19:45:54.363224 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 317/706] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:54 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:54.370490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-84262302", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "61c8def5-9717-4b35-a648-b792587e3675"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:54.407000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:54.417730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e02b00c0-7380-4e5f-a891-d59000335942 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 200 len: 1311 microversion: 2.1 time: 0.193473 Jul 26 19:45:54.428458 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 390/707] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:54 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:54.445573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1e63f8ec-5117-4765-b9df-ec3886d9ae96 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:54.446193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1e63f8ec-5117-4765-b9df-ec3886d9ae96 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:54.467637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:45:54.468343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e63f8ec-5117-4765-b9df-ec3886d9ae96 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.469071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e63f8ec-5117-4765-b9df-ec3886d9ae96 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.470380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e63f8ec-5117-4765-b9df-ec3886d9ae96 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.471119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e63f8ec-5117-4765-b9df-ec3886d9ae96 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.747669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1e63f8ec-5117-4765-b9df-ec3886d9ae96 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:54.758234 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1e63f8ec-5117-4765-b9df-ec3886d9ae96 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.327424 Jul 26 19:45:54.764938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 391/708] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:54 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:54.914843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:45:54.915447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:45:54.915739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:45:54.916209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:45:54.916621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:45:54.978002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.978706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:54.979899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:54.980529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.008682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:55.033700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-427c9df7-6fe0-4d63-b1ed-db96a7c00614 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:55.034271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-427c9df7-6fe0-4d63-b1ed-db96a7c00614 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:55.045566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:55.061423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-427c9df7-6fe0-4d63-b1ed-db96a7c00614 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.062282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-427c9df7-6fe0-4d63-b1ed-db96a7c00614 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.069372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Going to run 2 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:45:55.069992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-427c9df7-6fe0-4d63-b1ed-db96a7c00614 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.072465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:55.072756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-427c9df7-6fe0-4d63-b1ed-db96a7c00614 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.141861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125964) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 26 19:45:55.187685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:55.196464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:55.261461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:55.268833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:55.286420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=75655c2a-2978-4096-920f-f4c6786cacf0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:45:55.379552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:55.385815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:55.425383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:55.438490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:45:55.450502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:45:55.459338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-427c9df7-6fe0-4d63-b1ed-db96a7c00614 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:55.474141 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-427c9df7-6fe0-4d63-b1ed-db96a7c00614 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.446646 Jul 26 19:45:55.476064 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 392/709] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:55 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:55.487681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:55.487681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:55.500053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.500767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.501874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.502521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.529554 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] HTTP exception thrown: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Request method failure captured: Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f HTTP/1.1 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPJr6E1ZuBsTgfrkqqyVKh5WqSyEMiWzHoALiaPkAT1CC9AJ4XFY4JoJfFDYvvgiL1Pt1PLlP7wkEEywrRmb1d4zJmVbIGywLL4dszfxF5aY8W-5RVKaJ26wfAr2mc1FMDd5-LreIXtVqZe4L4oR1yotl3TsemvfHwEqE7YoI7wTEU Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5112c2e993b44756a068fe8782e68681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5112c2e993b44756a068fe8782e68681", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}] Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7836e60170f1440c9d82b730e8d03344 Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '091be344-7214-4348-bfc5-f6189853bc9f'} Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.532751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:55.538193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.538193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.538193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:55.538193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:55.538193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:55.538193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:55.538193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:45:55.538193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.546239 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-651e9f48-83f8-41ab-97fa-88182c748323 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.181860 Jul 26 19:45:55.547561 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 318/710] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:45:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:45:55.555135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:55.556113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:55.572310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Returning 404 to user: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:55.573392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.573949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.576906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.577349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa364705-ffb1-4cfa-aa36-0bf8624c93fa tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 404 len: 111 microversion: 2.1 time: 0.095583 Jul 26 19:45:55.577747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.578324 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 393/711] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:55 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:45:55.592297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:55.593203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: 8cb4bb85-05be-4add-898f-be82c0375754] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:55.603621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.604742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.615299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.616199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.638698 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] HTTP exception thrown: Instance 8cb4bb85-05be-4add-898f-be82c0375754 could not be found. Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Request method failure captured: Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 HTTP/1.1 Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ6uWi-Ui7JR-nsBA0iTDSIlVKe6OUpHJOGiWDPUbvN840WsqsLolWoZk7Tq03D1hDK91dLBaBFH0PPbssp6_AMyd9rddA3fM_W9VI_I5ePQj8PiotB15hLPJqL3L4Acw0O3WFDdYMunT49FOjjbLo01WdUiITjnNWYv5eQVfIhAwU Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: b48045503d694e099175d17a83f0d4fa Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1920591570 Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b48045503d694e099175d17a83f0d4fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b48045503d694e099175d17a83f0d4fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b48045503d694e099175d17a83f0d4fa", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b48045503d694e099175d17a83f0d4fa"}]}] Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1920591570 Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: b48045503d694e099175d17a83f0d4fa Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1920591570 Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersAdminNegativeTestJSON-1920591570-project Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c4a54c0a0134fd0b636ff057c200b61 Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1920591570-project Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 8cb4bb85-05be-4add-898f-be82c0375754 could not be found. Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8cb4bb85-05be-4add-898f-be82c0375754'} Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb4bb85-05be-4add-898f-be82c0375754 could not be found. Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb4bb85-05be-4add-898f-be82c0375754 could not be found. Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.641707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:55.646348 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.646348 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.646348 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:55.646348 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:55.646348 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:55.646348 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:55.646348 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb4bb85-05be-4add-898f-be82c0375754 could not be found. Jul 26 19:45:55.646348 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.648316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Returning 404 to user: Instance 8cb4bb85-05be-4add-898f-be82c0375754 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:55.652482 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a4cd632-4a5f-4f0b-a4d7-6f87d4287894 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754" status: 404 len: 111 microversion: 2.1 time: 0.069967 Jul 26 19:45:55.659954 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 394/712] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:55 2022] GET /compute/v2.1/servers/8cb4bb85-05be-4add-898f-be82c0375754 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:45:55.671173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:55.701557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:55.705590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Searching by: {'deleted': False, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:45:55.743181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.743659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.744478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.746902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.800032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:45:55.871037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:55.883990 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3be2510a-fed7-4a6d-ac41-ae07f35e56f3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1660 microversion: 2.1 time: 0.217091 Jul 26 19:45:55.884930 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 395/713] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 19:45:55 2022] GET /compute/v2.1/servers => generated 1660 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:55.888441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:55.898391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:55.903235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:55.904912 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3f1cee2c-86dd-455d-b149-e39ff61f3bb2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1557 microversion: 2.25 time: 0.352652 Jul 26 19:45:55.906086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:55.907850 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 319/714] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:55 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1557 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:55.922169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1493620b-1268-43c0-9cae-ad9765b06609 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:55.923842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1493620b-1268-43c0-9cae-ad9765b06609 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:55.925087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.925519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.929836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.930295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.936715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1493620b-1268-43c0-9cae-ad9765b06609 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.937101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1493620b-1268-43c0-9cae-ad9765b06609 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.940530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1493620b-1268-43c0-9cae-ad9765b06609 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.940816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1493620b-1268-43c0-9cae-ad9765b06609 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.956656 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] HTTP exception thrown: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Request method failure captured: Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 HTTP/1.1 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPJr6E1ZuBsTgfrkqqyVKh5WqSyEMiWzHoALiaPkAT1CC9AJ4XFY4JoJfFDYvvgiL1Pt1PLlP7wkEEywrRmb1d4zJmVbIGywLL4dszfxF5aY8W-5RVKaJ26wfAr2mc1FMDd5-LreIXtVqZe4L4oR1yotl3TsemvfHwEqE7YoI7wTEU Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5112c2e993b44756a068fe8782e68681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5112c2e993b44756a068fe8782e68681", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}] Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7836e60170f1440c9d82b730e8d03344 Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '50a4a582-0699-43a9-89f9-19b22e0cda22'} Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:45:55.959891 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:55.964298 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:55.967213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Returning 404 to user: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:55.968768 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0977a833-3db9-4731-bc47-b3a5703017b2 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "DELETE /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 404 len: 111 microversion: 2.1 time: 0.082348 Jul 26 19:45:55.969505 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 396/715] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:45:55 2022] DELETE /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:45:55.974794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03975b14-0f5b-4e6e-adaf-5f8a4cb9a60a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:55.975845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03975b14-0f5b-4e6e-adaf-5f8a4cb9a60a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:55.993077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03975b14-0f5b-4e6e-adaf-5f8a4cb9a60a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.993852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03975b14-0f5b-4e6e-adaf-5f8a4cb9a60a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:55.996973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03975b14-0f5b-4e6e-adaf-5f8a4cb9a60a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:55.998347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03975b14-0f5b-4e6e-adaf-5f8a4cb9a60a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.004586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1493620b-1268-43c0-9cae-ad9765b06609 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:45:56.141660 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1493620b-1268-43c0-9cae-ad9765b06609 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 204 len: 0 microversion: 2.1 time: 0.232368 Jul 26 19:45:56.146485 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 320/716] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:45:55 2022] DELETE /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:45:56.153591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-90c33444-0b47-4c25-8e0a-bbaca62d5b47 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:56.154621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-90c33444-0b47-4c25-8e0a-bbaca62d5b47 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:56.227268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-90c33444-0b47-4c25-8e0a-bbaca62d5b47 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:56.230109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=35 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:56.236340 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-90c33444-0b47-4c25-8e0a-bbaca62d5b47 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1217 microversion: 2.1 time: 0.088170 Jul 26 19:45:56.237221 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 321/717] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:56 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:56.242777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1c01e95c-ffc0-4d59-9ee3-35868895b234 req-97b79471-83ce-4b37-9d86-0c27dcb1eb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091be344-7214-4348-bfc5-f6189853bc9f", "name": "network-vif-deleted", "tag": "c766a17e-7fca-4fdb-9ff8-b81a156f4a06"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:56.257342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1c01e95c-ffc0-4d59-9ee3-35868895b234 req-97b79471-83ce-4b37-9d86-0c27dcb1eb5b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.257867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1c01e95c-ffc0-4d59-9ee3-35868895b234 req-97b79471-83ce-4b37-9d86-0c27dcb1eb5b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.274553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1c01e95c-ffc0-4d59-9ee3-35868895b234 req-97b79471-83ce-4b37-9d86-0c27dcb1eb5b service nova] Creating event network-vif-deleted:c766a17e-7fca-4fdb-9ff8-b81a156f4a06 for instance 091be344-7214-4348-bfc5-f6189853bc9f on n-h2-708768-8 Jul 26 19:45:56.280052 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1c01e95c-ffc0-4d59-9ee3-35868895b234 req-97b79471-83ce-4b37-9d86-0c27dcb1eb5b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041059 Jul 26 19:45:56.280909 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 322/718] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:56.327364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03975b14-0f5b-4e6e-adaf-5f8a4cb9a60a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:56.342615 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03975b14-0f5b-4e6e-adaf-5f8a4cb9a60a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1472 microversion: 2.1 time: 0.371530 Jul 26 19:45:56.345576 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 397/719] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:55 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:56.350303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:56.351207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:56.385193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.385654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.386417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.386853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.414320 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] HTTP exception thrown: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Request method failure captured: Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 HTTP/1.1 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPJr6E1ZuBsTgfrkqqyVKh5WqSyEMiWzHoALiaPkAT1CC9AJ4XFY4JoJfFDYvvgiL1Pt1PLlP7wkEEywrRmb1d4zJmVbIGywLL4dszfxF5aY8W-5RVKaJ26wfAr2mc1FMDd5-LreIXtVqZe4L4oR1yotl3TsemvfHwEqE7YoI7wTEU Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5112c2e993b44756a068fe8782e68681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5112c2e993b44756a068fe8782e68681", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}] Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7836e60170f1440c9d82b730e8d03344 Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '50a4a582-0699-43a9-89f9-19b22e0cda22'} Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:56.416234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:56.420857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:56.420857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:56.420857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:56.420857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:56.420857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:56.420857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:56.420857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:45:56.420857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:45:56.424134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Returning 404 to user: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:56.427753 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d9cac961-5b73-464f-94a1-5078d2404d78 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 404 len: 111 microversion: 2.1 time: 0.081577 Jul 26 19:45:56.429207 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 398/720] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:56 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:45:56.444695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d47a8fa-5e07-4834-86eb-45b7b922237a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:56.445947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8d47a8fa-5e07-4834-86eb-45b7b922237a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:56.454646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d47a8fa-5e07-4834-86eb-45b7b922237a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.456004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d47a8fa-5e07-4834-86eb-45b7b922237a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.457623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d47a8fa-5e07-4834-86eb-45b7b922237a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.458332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d47a8fa-5e07-4834-86eb-45b7b922237a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.555809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-639a7db8-809e-4ec0-b982-63fd1465657f tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:56.556822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-639a7db8-809e-4ec0-b982-63fd1465657f tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:56.564564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-639a7db8-809e-4ec0-b982-63fd1465657f tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.565180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-639a7db8-809e-4ec0-b982-63fd1465657f tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.566078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-639a7db8-809e-4ec0-b982-63fd1465657f tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.567560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-639a7db8-809e-4ec0-b982-63fd1465657f tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.757528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-639a7db8-809e-4ec0-b982-63fd1465657f tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:45:56.840761 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-639a7db8-809e-4ec0-b982-63fd1465657f tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 2050 microversion: 2.25 time: 0.558342 Jul 26 19:45:56.848297 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 323/721] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:56 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 2050 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:56.854361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b59fb602-cebc-4901-90c9-a23c29e80a16 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '.version_select at 0x7f875753daf0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:56.906303 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b59fb602-cebc-4901-90c9-a23c29e80a16 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996243959" status: 202 len: 0 microversion: 2.1 time: 0.056176 Jul 26 19:45:56.909495 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 324/722] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 19:45:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996243959 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:56.921616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-80f7b060-2417-4db0-90a8-1796ca938b25 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:56.922505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-80f7b060-2417-4db0-90a8-1796ca938b25 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:56.931230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80f7b060-2417-4db0-90a8-1796ca938b25 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.932017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80f7b060-2417-4db0-90a8-1796ca938b25 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.932811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80f7b060-2417-4db0-90a8-1796ca938b25 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:56.933248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80f7b060-2417-4db0-90a8-1796ca938b25 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:56.942219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:45:57.125389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8d47a8fa-5e07-4834-86eb-45b7b922237a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:57.136631 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d47a8fa-5e07-4834-86eb-45b7b922237a tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1478 microversion: 2.1 time: 0.705615 Jul 26 19:45:57.137168 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 399/723] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:56 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1478 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:57.155717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e3ee693-1a11-408f-95ce-93bec5a2c10e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:57.157455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e3ee693-1a11-408f-95ce-93bec5a2c10e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:57.168556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e3ee693-1a11-408f-95ce-93bec5a2c10e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.169215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e3ee693-1a11-408f-95ce-93bec5a2c10e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.170352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e3ee693-1a11-408f-95ce-93bec5a2c10e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.175204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e3ee693-1a11-408f-95ce-93bec5a2c10e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.316897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-80f7b060-2417-4db0-90a8-1796ca938b25 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:57.330870 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-80f7b060-2417-4db0-90a8-1796ca938b25 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.417230 Jul 26 19:45:57.335675 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 325/724] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:56 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:57.345865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e9f2e0c-93f0-4656-9ff8-2503316fc3df tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:57.346954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e9f2e0c-93f0-4656-9ff8-2503316fc3df tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:57.359828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e9f2e0c-93f0-4656-9ff8-2503316fc3df tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.360417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e9f2e0c-93f0-4656-9ff8-2503316fc3df tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.361304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e9f2e0c-93f0-4656-9ff8-2503316fc3df tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.362074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e9f2e0c-93f0-4656-9ff8-2503316fc3df tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.459767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-8e3ee693-1a11-408f-95ce-93bec5a2c10e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:45:57.474373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e9f2e0c-93f0-4656-9ff8-2503316fc3df tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:57.484292 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e9f2e0c-93f0-4656-9ff8-2503316fc3df tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1213 microversion: 2.1 time: 0.146922 Jul 26 19:45:57.486181 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 326/725] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:57 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:57.493514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e9faac4a-3dbb-4021-a074-f29f9501b20f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:57.494907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e9faac4a-3dbb-4021-a074-f29f9501b20f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:57.523217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9faac4a-3dbb-4021-a074-f29f9501b20f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.523217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9faac4a-3dbb-4021-a074-f29f9501b20f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.524024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9faac4a-3dbb-4021-a074-f29f9501b20f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.524466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9faac4a-3dbb-4021-a074-f29f9501b20f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.545714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e3ee693-1a11-408f-95ce-93bec5a2c10e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 2050 microversion: 2.25 time: 0.407485 Jul 26 19:45:57.547098 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 400/726] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:45:57 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 2050 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:45:57.570845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-339266ba-51a3-4bc2-a4fc-d248058aadc6 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:57.575291 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:57.575291 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:45:57.577216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-339266ba-51a3-4bc2-a4fc-d248058aadc6 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.578497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-339266ba-51a3-4bc2-a4fc-d248058aadc6 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.580047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-339266ba-51a3-4bc2-a4fc-d248058aadc6 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.580706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-339266ba-51a3-4bc2-a4fc-d248058aadc6 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.618056 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-339266ba-51a3-4bc2-a4fc-d248058aadc6 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051077 Jul 26 19:45:57.618744 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 401/727] 10.222.0.58 () {60 vars in 1217 bytes} [Tue Jul 26 19:45:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:45:57.631545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-708768-8", "block_migration": "auto"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:45:57.634244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:57.647665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.648109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.648901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:57.649339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:57.678497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'flavor' on Instance uuid 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:45:57.693839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Going to try to live migrate instance to n-h2-708768-8 {{(pid=125963) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:45:57.831340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e9faac4a-3dbb-4021-a074-f29f9501b20f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:57.850782 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e9faac4a-3dbb-4021-a074-f29f9501b20f tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1478 microversion: 2.1 time: 0.363309 Jul 26 19:45:57.871815 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 327/728] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:57 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1478 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:57.965948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab299e8a-4036-4ff6-92f7-ff548c86d8ed tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Calling method '.version_select at 0x7f875733f790>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:58.005187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-ab299e8a-4036-4ff6-92f7-ff548c86d8ed tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 does not exist", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:45:58.006069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.security_group_api [None req-ab299e8a-4036-4ff6-92f7-ff548c86d8ed tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Neutron security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 not found {{(pid=125964) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:45:58.006599 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ab299e8a-4036-4ff6-92f7-ff548c86d8ed tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] HTTP exception thrown: Security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 does not exist Jul 26 19:45:58.006599 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-adce99bd-f425-4939-96ef-804212878b21'] Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab299e8a-4036-4ff6-92f7-ff548c86d8ed tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Request method failure captured: Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-security-groups/94fc3eda-8e7a-4b7d-b34d-26b7085017d1 HTTP/1.1 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ER14kAbXdxRqkwjiS8wC6ygkrWP0ISIKL9k4uOCXmLpMKgKo17qZLQ6Qh2GVHIbsbjljq5doI7CKG6213dIproLBwna7l0j1JrSJhbh4UQqwmIwxeSTHTPyO3AVm2ndw8UtZL6nchnIxIe4o2KxjjmBrwTPV5tLu_xncmppf6R-1ZI Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: c7bb379f687743d59e0d8459255ef66f Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7bb379f687743d59e0d8459255ef66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7bb379f687743d59e0d8459255ef66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7bb379f687743d59e0d8459255ef66f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7bb379f687743d59e0d8459255ef66f"}]}] Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: c7bb379f687743d59e0d8459255ef66f Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsNegativeTestJSON-1636900794-project Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 44265c77ff7042058d8357db5c044f13 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794-project Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: exception: Security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 does not exist Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-adce99bd-f425-4939-96ef-804212878b21'] Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '94fc3eda-8e7a-4b7d-b34d-26b7085017d1'} Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:45:58.008677 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 does not exist Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adce99bd-f425-4939-96ef-804212878b21'] Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 does not exist Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adce99bd-f425-4939-96ef-804212878b21'] Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 does not exist Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adce99bd-f425-4939-96ef-804212878b21'] Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 does not exist Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adce99bd-f425-4939-96ef-804212878b21'] Jul 26 19:45:58.012939 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:58.017172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab299e8a-4036-4ff6-92f7-ff548c86d8ed tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Returning 404 to user: Security group 94fc3eda-8e7a-4b7d-b34d-26b7085017d1 does not exist Jul 26 19:45:58.017172 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-adce99bd-f425-4939-96ef-804212878b21'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:58.018911 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ab299e8a-4036-4ff6-92f7-ff548c86d8ed tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/94fc3eda-8e7a-4b7d-b34d-26b7085017d1" status: 404 len: 194 microversion: 2.1 time: 0.145694 Jul 26 19:45:58.020514 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 328/729] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:45:57 2022] DELETE /compute/v2.1/os-security-groups/94fc3eda-8e7a-4b7d-b34d-26b7085017d1 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:45:58.032713 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3838bdf-5963-4b94-b367-3e3fa8233230 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005690 Jul 26 19:45:58.042342 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 329/730] 10.222.0.58 () {58 vars in 1164 bytes} [Tue Jul 26 19:45:58 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 26 19:45:58.047358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17d0c6e9-b9da-4d47-9343-c7d430b3cec7 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Calling method '.version_select at 0x7f87572f4700>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:58.492283 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-17d0c6e9-b9da-4d47-9343-c7d430b3cec7 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.447741 Jul 26 19:45:58.493239 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 330/731] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:45:58 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:45:58.501305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4ed6cdd-686a-4d51-a87b-e137f79f15a2 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:58.502894 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:45:58.502894 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:45:58.528557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4ed6cdd-686a-4d51-a87b-e137f79f15a2 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1571137765" status: 202 len: 0 microversion: 2.1 time: 0.034177 Jul 26 19:45:58.532136 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 331/732] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:45:58 2022] DELETE /compute/v2.1/flavors/1571137765 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:45:58.540256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5542eb6-1245-47e0-9d5e-d8f5defd97d6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:58.540885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b5542eb6-1245-47e0-9d5e-d8f5defd97d6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:58.561148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5542eb6-1245-47e0-9d5e-d8f5defd97d6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:58.561611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5542eb6-1245-47e0-9d5e-d8f5defd97d6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:58.567293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5542eb6-1245-47e0-9d5e-d8f5defd97d6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:58.570698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5542eb6-1245-47e0-9d5e-d8f5defd97d6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:58.868731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b5542eb6-1245-47e0-9d5e-d8f5defd97d6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4a54c0a0134fd0b636ff057c200b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48045503d694e099175d17a83f0d4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:58.879979 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b5542eb6-1245-47e0-9d5e-d8f5defd97d6 tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 200 len: 1478 microversion: 2.1 time: 0.348903 Jul 26 19:45:58.881103 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 332/733] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:58 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 1478 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:58.891442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5992ff5-113e-4407-85e9-e7d44e06c9a3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:58.893768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b5992ff5-113e-4407-85e9-e7d44e06c9a3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:58.907060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5992ff5-113e-4407-85e9-e7d44e06c9a3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:58.908563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5992ff5-113e-4407-85e9-e7d44e06c9a3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:58.911231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5992ff5-113e-4407-85e9-e7d44e06c9a3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:58.912700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5992ff5-113e-4407-85e9-e7d44e06c9a3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:59.272201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b5992ff5-113e-4407-85e9-e7d44e06c9a3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:59.283913 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b5992ff5-113e-4407-85e9-e7d44e06c9a3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1515 microversion: 2.1 time: 0.400159 Jul 26 19:45:59.285062 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 333/734] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:58 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:59.313191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6aa35735-a413-425c-bf04-7a6fa662f9fc tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Calling method '.version_select at 0x7f875756aca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:59.491011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-6aa35735-a413-425c-bf04-7a6fa662f9fc tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:45:59.491747 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-6aa35735-a413-425c-bf04-7a6fa662f9fc tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 26 19:45:59.491747 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-f3c5ff06-c510-4b6d-94a8-ac09e5294f3f'] Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6aa35735-a413-425c-bf04-7a6fa662f9fc tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Request method failure captured: Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-security-groups/936e39d1-b9bd-413f-92b2-6b81affb6ec5 HTTP/1.1 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ER14kAbXdxRqkwjiS8wC6ygkrWP0ISIKL9k4uOCXmLpMKgKo17qZLQ6Qh2GVHIbsbjljq5doI7CKG6213dIproLBwna7l0j1JrSJhbh4UQqwmIwxeSTHTPyO3AVm2ndw8UtZL6nchnIxIe4o2KxjjmBrwTPV5tLu_xncmppf6R-1ZI Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: c7bb379f687743d59e0d8459255ef66f Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7bb379f687743d59e0d8459255ef66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7bb379f687743d59e0d8459255ef66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7bb379f687743d59e0d8459255ef66f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7bb379f687743d59e0d8459255ef66f"}]}] Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: c7bb379f687743d59e0d8459255ef66f Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsNegativeTestJSON-1636900794-project Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 44265c77ff7042058d8357db5c044f13 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794-project Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: exception: Insufficient rights for removing default security group. Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-f3c5ff06-c510-4b6d-94a8-ac09e5294f3f'] Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '936e39d1-b9bd-413f-92b2-6b81affb6ec5'} Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:45:59.493580 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3c5ff06-c510-4b6d-94a8-ac09e5294f3f'] Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3c5ff06-c510-4b6d-94a8-ac09e5294f3f'] Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3c5ff06-c510-4b6d-94a8-ac09e5294f3f'] Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3c5ff06-c510-4b6d-94a8-ac09e5294f3f'] Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6aa35735-a413-425c-bf04-7a6fa662f9fc tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-f3c5ff06-c510-4b6d-94a8-ac09e5294f3f'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6aa35735-a413-425c-bf04-7a6fa662f9fc tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/936e39d1-b9bd-413f-92b2-6b81affb6ec5" status: 400 len: 182 microversion: 2.1 time: 0.186605 Jul 26 19:45:59.497293 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 334/735] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:45:59 2022] DELETE /compute/v2.1/os-security-groups/936e39d1-b9bd-413f-92b2-6b81affb6ec5 => generated 182 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:45:59.527239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f895fe5c-57da-4750-bd7c-d8106358055f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:59.529362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f895fe5c-57da-4750-bd7c-d8106358055f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:59.539862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f895fe5c-57da-4750-bd7c-d8106358055f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:59.540313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f895fe5c-57da-4750-bd7c-d8106358055f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:59.541087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f895fe5c-57da-4750-bd7c-d8106358055f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:59.542846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f895fe5c-57da-4750-bd7c-d8106358055f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:59.727140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f895fe5c-57da-4750-bd7c-d8106358055f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:45:59.744133 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f895fe5c-57da-4750-bd7c-d8106358055f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1269 microversion: 2.1 time: 0.246169 Jul 26 19:45:59.748420 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 335/736] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:59 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1269 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:59.761950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-740ab81a-d6da-4355-8838-f4d20acb36d6 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:59.830874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-740ab81a-d6da-4355-8838-f4d20acb36d6 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5399 microversion: 2.1 time: 0.080459 Jul 26 19:45:59.833208 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 336/737] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:45:59 2022] GET /compute/v2.1/flavors/detail => generated 5399 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:45:59.841016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-717ba892-97e8-4f43-8cc0-d25bb71a0d85 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:45:59.841842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-717ba892-97e8-4f43-8cc0-d25bb71a0d85 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:45:59.850231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-717ba892-97e8-4f43-8cc0-d25bb71a0d85 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:59.851576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-717ba892-97e8-4f43-8cc0-d25bb71a0d85 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:45:59.852945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-717ba892-97e8-4f43-8cc0-d25bb71a0d85 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:45:59.853643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-717ba892-97e8-4f43-8cc0-d25bb71a0d85 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:00.143922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-717ba892-97e8-4f43-8cc0-d25bb71a0d85 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:00.155734 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-717ba892-97e8-4f43-8cc0-d25bb71a0d85 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1478 microversion: 2.1 time: 0.320703 Jul 26 19:46:00.159690 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 337/738] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:45:59 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1478 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:00.169329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b814a4b5-ce4d-4df6-b065-f3bde7191ebf req-4a353216-e534-4a00-ab05-b4e361f5af42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef27307f-bc06-4095-80df-d383826007e6", "name": "network-vif-deleted", "tag": "0013623d-d448-4a03-8343-38ebe74bb534"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:00.198316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b814a4b5-ce4d-4df6-b065-f3bde7191ebf req-4a353216-e534-4a00-ab05-b4e361f5af42 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:00.198759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b814a4b5-ce4d-4df6-b065-f3bde7191ebf req-4a353216-e534-4a00-ab05-b4e361f5af42 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:00.226466 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b814a4b5-ce4d-4df6-b065-f3bde7191ebf req-4a353216-e534-4a00-ab05-b4e361f5af42 service nova] Creating event network-vif-deleted:0013623d-d448-4a03-8343-38ebe74bb534 for instance ef27307f-bc06-4095-80df-d383826007e6 on n-h2-708768-8 Jul 26 19:46:00.237645 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b814a4b5-ce4d-4df6-b065-f3bde7191ebf req-4a353216-e534-4a00-ab05-b4e361f5af42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076489 Jul 26 19:46:00.238302 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 338/739] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:00.259904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db36f6a6-6564-4d16-8191-776ec4256ddf tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Calling method '.version_select at 0x7f875733fc10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:00.302951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-db36f6a6-6564-4d16-8191-776ec4256ddf tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc does not exist", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:46:00.303666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.security_group_api [None req-db36f6a6-6564-4d16-8191-776ec4256ddf tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Neutron security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc not found {{(pid=125964) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:46:00.304152 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-db36f6a6-6564-4d16-8191-776ec4256ddf tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] HTTP exception thrown: Security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc does not exist Jul 26 19:46:00.304152 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-914aad3a-36d7-440e-914f-ef702b3fee6c'] Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db36f6a6-6564-4d16-8191-776ec4256ddf tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Request method failure captured: Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-security-groups/cefddcd2-2fa4-4cec-a7fc-aad6673d14cc HTTP/1.1 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ER14kAbXdxRqkwjiS8wC6ygkrWP0ISIKL9k4uOCXmLpMKgKo17qZLQ6Qh2GVHIbsbjljq5doI7CKG6213dIproLBwna7l0j1JrSJhbh4UQqwmIwxeSTHTPyO3AVm2ndw8UtZL6nchnIxIe4o2KxjjmBrwTPV5tLu_xncmppf6R-1ZI Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: c7bb379f687743d59e0d8459255ef66f Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7bb379f687743d59e0d8459255ef66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7bb379f687743d59e0d8459255ef66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7bb379f687743d59e0d8459255ef66f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7bb379f687743d59e0d8459255ef66f"}]}] Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: c7bb379f687743d59e0d8459255ef66f Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsNegativeTestJSON-1636900794-project Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 44265c77ff7042058d8357db5c044f13 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794-project Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: exception: Security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc does not exist Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-914aad3a-36d7-440e-914f-ef702b3fee6c'] Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'cefddcd2-2fa4-4cec-a7fc-aad6673d14cc'} Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:46:00.306189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc does not exist Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-914aad3a-36d7-440e-914f-ef702b3fee6c'] Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc does not exist Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-914aad3a-36d7-440e-914f-ef702b3fee6c'] Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc does not exist Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-914aad3a-36d7-440e-914f-ef702b3fee6c'] Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc does not exist Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-914aad3a-36d7-440e-914f-ef702b3fee6c'] Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db36f6a6-6564-4d16-8191-776ec4256ddf tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Returning 404 to user: Security group cefddcd2-2fa4-4cec-a7fc-aad6673d14cc does not exist Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-914aad3a-36d7-440e-914f-ef702b3fee6c'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db36f6a6-6564-4d16-8191-776ec4256ddf tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/cefddcd2-2fa4-4cec-a7fc-aad6673d14cc" status: 404 len: 194 microversion: 2.1 time: 0.062820 Jul 26 19:46:00.309902 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 339/740] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:46:00 2022] GET /compute/v2.1/os-security-groups/cefddcd2-2fa4-4cec-a7fc-aad6673d14cc => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:00.318266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12ff1ed7-6fdf-46c5-bda1-ccc528ebc204 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:00.319414 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:00.319414 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:46:00.349118 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-12ff1ed7-6fdf-46c5-bda1-ccc528ebc204 tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/48274083" status: 202 len: 0 microversion: 2.1 time: 0.038660 Jul 26 19:46:00.350209 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 340/741] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:46:00 2022] DELETE /compute/v2.1/flavors/48274083 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:46:00.356681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:00.357706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] [instance: ef27307f-bc06-4095-80df-d383826007e6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:00.368846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:00.370362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:00.371459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:00.372911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:00.391455 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] HTTP exception thrown: Instance ef27307f-bc06-4095-80df-d383826007e6 could not be found. Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Request method failure captured: Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 HTTP/1.1 Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ6uWi-Ui7JR-nsBA0iTDSIlVKe6OUpHJOGiWDPUbvN840WsqsLolWoZk7Tq03D1hDK91dLBaBFH0PPbssp6_AMyd9rddA3fM_W9VI_I5ePQj8PiotB15hLPJqL3L4Acw0O3WFDdYMunT49FOjjbLo01WdUiITjnNWYv5eQVfIhAwU Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: b48045503d694e099175d17a83f0d4fa Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1920591570 Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b48045503d694e099175d17a83f0d4fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b48045503d694e099175d17a83f0d4fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b48045503d694e099175d17a83f0d4fa", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b48045503d694e099175d17a83f0d4fa"}]}] Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1920591570 Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: b48045503d694e099175d17a83f0d4fa Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1920591570 Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersAdminNegativeTestJSON-1920591570-project Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9c4a54c0a0134fd0b636ff057c200b61 Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1920591570-project Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance ef27307f-bc06-4095-80df-d383826007e6 could not be found. Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ef27307f-bc06-4095-80df-d383826007e6'} Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef27307f-bc06-4095-80df-d383826007e6 could not be found. Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef27307f-bc06-4095-80df-d383826007e6 could not be found. Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.394342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:00.398898 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.398898 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.398898 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:00.398898 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:00.398898 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:00.398898 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:00.398898 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef27307f-bc06-4095-80df-d383826007e6 could not be found. Jul 26 19:46:00.398898 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.400930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] Returning 404 to user: Instance ef27307f-bc06-4095-80df-d383826007e6 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:00.404489 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-10266981-84e6-44d5-a271-72cdb0487fef tempest-ServersAdminNegativeTestJSON-1920591570 tempest-ServersAdminNegativeTestJSON-1920591570-project] 10.222.0.58 "GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6" status: 404 len: 111 microversion: 2.1 time: 0.052207 Jul 26 19:46:00.408078 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 341/742] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:00 2022] GET /compute/v2.1/servers/ef27307f-bc06-4095-80df-d383826007e6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:00.419385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-779d31e3-c3f5-49b7-8f88-6e35af492eea tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:00.420119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-779d31e3-c3f5-49b7-8f88-6e35af492eea tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:00.428309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-779d31e3-c3f5-49b7-8f88-6e35af492eea tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:00.429206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-779d31e3-c3f5-49b7-8f88-6e35af492eea tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:00.430211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-779d31e3-c3f5-49b7-8f88-6e35af492eea tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:00.430973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-779d31e3-c3f5-49b7-8f88-6e35af492eea tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:00.760072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-779d31e3-c3f5-49b7-8f88-6e35af492eea tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:00.788866 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-779d31e3-c3f5-49b7-8f88-6e35af492eea tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1533 microversion: 2.1 time: 0.379063 Jul 26 19:46:00.789598 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 342/743] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:00 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1533 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:00.804216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87b0d776-de5b-439c-9152-dad785192e67 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Action: 'update', calling method: .version_select at 0x7f875733fa60>, body: {"security_group": {"name": "tempest-sg-1634831135", "description": "tempest-description-246143241"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:00.875814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-87b0d776-de5b-439c-9152-dad785192e67 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f2cebc3-df68-41c6-9030-973132fc025d does not exist", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:46:00.876513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.security_group_api [None req-87b0d776-de5b-439c-9152-dad785192e67 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Neutron security group 5f2cebc3-df68-41c6-9030-973132fc025d not found {{(pid=125964) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:46:00.878033 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-87b0d776-de5b-439c-9152-dad785192e67 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] HTTP exception thrown: Security group 5f2cebc3-df68-41c6-9030-973132fc025d does not exist Jul 26 19:46:00.878033 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-9f1e9c04-474c-473a-bd22-c090eea96a05'] Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87b0d776-de5b-439c-9152-dad785192e67 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Request method failure captured: Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/os-security-groups/5f2cebc3-df68-41c6-9030-973132fc025d HTTP/1.1 Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 101 Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ER14kAbXdxRqkwjiS8wC6ygkrWP0ISIKL9k4uOCXmLpMKgKo17qZLQ6Qh2GVHIbsbjljq5doI7CKG6213dIproLBwna7l0j1JrSJhbh4UQqwmIwxeSTHTPyO3AVm2ndw8UtZL6nchnIxIe4o2KxjjmBrwTPV5tLu_xncmppf6R-1ZI Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: c7bb379f687743d59e0d8459255ef66f Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c7bb379f687743d59e0d8459255ef66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7bb379f687743d59e0d8459255ef66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c7bb379f687743d59e0d8459255ef66f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c7bb379f687743d59e0d8459255ef66f"}]}] Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: c7bb379f687743d59e0d8459255ef66f Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794 Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsNegativeTestJSON-1636900794-project Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 44265c77ff7042058d8357db5c044f13 Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1636900794-project Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: {"security_group": {"name": "tempest-sg-1634831135", "description": "tempest-description-246143241"}} Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: exception: Security group 5f2cebc3-df68-41c6-9030-973132fc025d does not exist Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-9f1e9c04-474c-473a-bd22-c090eea96a05'] Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5f2cebc3-df68-41c6-9030-973132fc025d', 'body': {'security_group': {'name': 'tempest-sg-1634831135', 'description': 'tempest-description-246143241'}}} Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:46:00.880756 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f2cebc3-df68-41c6-9030-973132fc025d does not exist Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f1e9c04-474c-473a-bd22-c090eea96a05'] Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f2cebc3-df68-41c6-9030-973132fc025d does not exist Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f1e9c04-474c-473a-bd22-c090eea96a05'] Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f2cebc3-df68-41c6-9030-973132fc025d does not exist Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f1e9c04-474c-473a-bd22-c090eea96a05'] Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f2cebc3-df68-41c6-9030-973132fc025d does not exist Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f1e9c04-474c-473a-bd22-c090eea96a05'] Jul 26 19:46:00.885100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:00.890874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87b0d776-de5b-439c-9152-dad785192e67 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] Returning 404 to user: Security group 5f2cebc3-df68-41c6-9030-973132fc025d does not exist Jul 26 19:46:00.890874 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-9f1e9c04-474c-473a-bd22-c090eea96a05'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:00.893389 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-87b0d776-de5b-439c-9152-dad785192e67 tempest-SecurityGroupsNegativeTestJSON-1636900794 tempest-SecurityGroupsNegativeTestJSON-1636900794-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/5f2cebc3-df68-41c6-9030-973132fc025d" status: 404 len: 194 microversion: 2.1 time: 0.100486 Jul 26 19:46:00.894559 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 343/744] 10.222.0.58 () {60 vars in 1290 bytes} [Tue Jul 26 19:46:00 2022] PUT /compute/v2.1/os-security-groups/5f2cebc3-df68-41c6-9030-973132fc025d => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:00.928509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c8882b6e-edbe-4944-894a-f435e4e6d13a tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:01.032499 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c8882b6e-edbe-4944-894a-f435e4e6d13a tempest-ServersWithSpecificFlavorTestJSON-1377894324 tempest-ServersWithSpecificFlavorTestJSON-1377894324-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.124397 Jul 26 19:46:01.047733 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 344/745] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:46:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:01.081912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd017f19-6c3a-4815-aa79-030367744128 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:01.084060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd017f19-6c3a-4815-aa79-030367744128 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:01.101177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd017f19-6c3a-4815-aa79-030367744128 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:01.102799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd017f19-6c3a-4815-aa79-030367744128 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:01.103604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd017f19-6c3a-4815-aa79-030367744128 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:01.105366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd017f19-6c3a-4815-aa79-030367744128 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:01.845265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd017f19-6c3a-4815-aa79-030367744128 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:01.856889 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd017f19-6c3a-4815-aa79-030367744128 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1275 microversion: 2.1 time: 0.807725 Jul 26 19:46:01.858030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 345/746] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:01 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1275 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:01.895583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:01.897148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:01.906583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:01.907274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:01.908282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:01.908876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:01.930776 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] HTTP exception thrown: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Request method failure captured: Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f HTTP/1.1 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPJr6E1ZuBsTgfrkqqyVKh5WqSyEMiWzHoALiaPkAT1CC9AJ4XFY4JoJfFDYvvgiL1Pt1PLlP7wkEEywrRmb1d4zJmVbIGywLL4dszfxF5aY8W-5RVKaJ26wfAr2mc1FMDd5-LreIXtVqZe4L4oR1yotl3TsemvfHwEqE7YoI7wTEU Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5112c2e993b44756a068fe8782e68681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5112c2e993b44756a068fe8782e68681", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}] Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 7836e60170f1440c9d82b730e8d03344 Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '091be344-7214-4348-bfc5-f6189853bc9f'} Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:46:01.932727 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:01.937397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:01.941369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Returning 404 to user: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:01.943051 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c11886f8-40b3-4b04-87fb-9081e9eb4a23 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "DELETE /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 404 len: 111 microversion: 2.1 time: 0.083842 Jul 26 19:46:01.943831 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 346/747] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:01 2022] DELETE /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:01.948963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de076b23-d264-4af3-bcb1-89a34b45f7cc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:01.949799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de076b23-d264-4af3-bcb1-89a34b45f7cc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:01.956536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de076b23-d264-4af3-bcb1-89a34b45f7cc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:01.957084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de076b23-d264-4af3-bcb1-89a34b45f7cc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:01.958669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de076b23-d264-4af3-bcb1-89a34b45f7cc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:01.959121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de076b23-d264-4af3-bcb1-89a34b45f7cc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.227109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-de076b23-d264-4af3-bcb1-89a34b45f7cc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:02.234483 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de076b23-d264-4af3-bcb1-89a34b45f7cc tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1464 microversion: 2.1 time: 0.289449 Jul 26 19:46:02.235063 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 347/748] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:01 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1464 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:02.240413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7d69b89d-ec82-46dd-96d9-e22646fc9ccf req-a3c44bc9-482b-489a-985d-dd9477725953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e71b9a-35b2-4a19-af94-4917b75573bb", "name": "network-vif-plugged", "status": "completed", "tag": "598edcf8-27c7-440a-9784-4e95c216149d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:02.251131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7d69b89d-ec82-46dd-96d9-e22646fc9ccf req-a3c44bc9-482b-489a-985d-dd9477725953 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.251835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7d69b89d-ec82-46dd-96d9-e22646fc9ccf req-a3c44bc9-482b-489a-985d-dd9477725953 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.266315 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7d69b89d-ec82-46dd-96d9-e22646fc9ccf req-a3c44bc9-482b-489a-985d-dd9477725953 service nova] Creating event network-vif-plugged:598edcf8-27c7-440a-9784-4e95c216149d for instance 21e71b9a-35b2-4a19-af94-4917b75573bb on n-h1-708768-8 Jul 26 19:46:02.272153 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7d69b89d-ec82-46dd-96d9-e22646fc9ccf req-a3c44bc9-482b-489a-985d-dd9477725953 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 Jul 26 19:46:02.273599 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 348/749] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:02.282469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a0567c75-a99b-48d8-b60e-06de4d1ba54d req-b8d9eda9-54e4-4f8b-a2bb-8d65bdfb673e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75655c2a-2978-4096-920f-f4c6786cacf0", "tag": "e16de01d-5776-43e1-9e4a-5f7d843c8e7a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:02.297488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a0567c75-a99b-48d8-b60e-06de4d1ba54d req-b8d9eda9-54e4-4f8b-a2bb-8d65bdfb673e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.298062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a0567c75-a99b-48d8-b60e-06de4d1ba54d req-b8d9eda9-54e4-4f8b-a2bb-8d65bdfb673e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.319049 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a0567c75-a99b-48d8-b60e-06de4d1ba54d req-b8d9eda9-54e4-4f8b-a2bb-8d65bdfb673e service nova] Creating event network-changed:e16de01d-5776-43e1-9e4a-5f7d843c8e7a for instance 75655c2a-2978-4096-920f-f4c6786cacf0 on n-h2-708768-8 Jul 26 19:46:02.325733 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a0567c75-a99b-48d8-b60e-06de4d1ba54d req-b8d9eda9-54e4-4f8b-a2bb-8d65bdfb673e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050363 Jul 26 19:46:02.327132 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 349/750] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:02.335774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eec4d4ab-3301-44da-94c3-a859624707c0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:02.336912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eec4d4ab-3301-44da-94c3-a859624707c0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:02.344098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eec4d4ab-3301-44da-94c3-a859624707c0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.345020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eec4d4ab-3301-44da-94c3-a859624707c0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.346210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eec4d4ab-3301-44da-94c3-a859624707c0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.346866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eec4d4ab-3301-44da-94c3-a859624707c0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.561859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eec4d4ab-3301-44da-94c3-a859624707c0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:02.571035 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eec4d4ab-3301-44da-94c3-a859624707c0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1521 microversion: 2.1 time: 0.242364 Jul 26 19:46:02.572021 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 350/751] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:02 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:02.576422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:02.577108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 091be344-7214-4348-bfc5-f6189853bc9f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:02.589409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.589634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.590398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.591097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.607387 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] HTTP exception thrown: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Request method failure captured: Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f HTTP/1.1 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPJr6E1ZuBsTgfrkqqyVKh5WqSyEMiWzHoALiaPkAT1CC9AJ4XFY4JoJfFDYvvgiL1Pt1PLlP7wkEEywrRmb1d4zJmVbIGywLL4dszfxF5aY8W-5RVKaJ26wfAr2mc1FMDd5-LreIXtVqZe4L4oR1yotl3TsemvfHwEqE7YoI7wTEU Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5112c2e993b44756a068fe8782e68681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5112c2e993b44756a068fe8782e68681", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}] Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 7836e60170f1440c9d82b730e8d03344 Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '091be344-7214-4348-bfc5-f6189853bc9f'} Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.609211 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Returning 404 to user: Instance 091be344-7214-4348-bfc5-f6189853bc9f could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b5099b7-5183-4af3-aa20-297bc8c5daf3 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f" status: 404 len: 111 microversion: 2.1 time: 0.037817 Jul 26 19:46:02.617564 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 351/752] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:02 2022] GET /compute/v2.1/servers/091be344-7214-4348-bfc5-f6189853bc9f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:02.620916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e672153a-0c5a-447a-8717-c75f12e626ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:02.620916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e672153a-0c5a-447a-8717-c75f12e626ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:02.627138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e672153a-0c5a-447a-8717-c75f12e626ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.628738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e672153a-0c5a-447a-8717-c75f12e626ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.628738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e672153a-0c5a-447a-8717-c75f12e626ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.629019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e672153a-0c5a-447a-8717-c75f12e626ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.827869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e672153a-0c5a-447a-8717-c75f12e626ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:02.845061 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e672153a-0c5a-447a-8717-c75f12e626ae tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1464 microversion: 2.1 time: 0.228829 Jul 26 19:46:02.847438 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 352/753] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:02 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1464 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:02.868161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:02.868681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:02.878148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.878560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.879940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.880639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.898017 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] HTTP exception thrown: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Request method failure captured: Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 HTTP/1.1 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EPJr6E1ZuBsTgfrkqqyVKh5WqSyEMiWzHoALiaPkAT1CC9AJ4XFY4JoJfFDYvvgiL1Pt1PLlP7wkEEywrRmb1d4zJmVbIGywLL4dszfxF5aY8W-5RVKaJ26wfAr2mc1FMDd5-LreIXtVqZe4L4oR1yotl3TsemvfHwEqE7YoI7wTEU Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5112c2e993b44756a068fe8782e68681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5112c2e993b44756a068fe8782e68681", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}] Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 7836e60170f1440c9d82b730e8d03344 Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '50a4a582-0699-43a9-89f9-19b22e0cda22'} Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:46:02.900346 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:02.904950 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:02.906745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Returning 404 to user: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:02.908007 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9dc4fd46-13fd-4cc4-8b6c-76e1c588db41 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "DELETE /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 404 len: 111 microversion: 2.1 time: 0.057014 Jul 26 19:46:02.909083 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 353/754] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:02 2022] DELETE /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:02.916972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:02.920262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:02.930752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.931697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:02.932996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:02.934421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.067195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:03.067809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:03.068393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:03.068939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:03.069992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:03.174461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:03.188607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.189787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.193645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.195875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.262611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:03.270509 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f4123129-19e2-464c-8093-55cd0937b958 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action" status: 202 len: 1068 microversion: 2.1 time: 0.359972 Jul 26 19:46:03.274193 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 354/755] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:46:02 2022] POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action => generated 1068 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 19:46:03.283531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2330eac9-d02c-47e3-bb02-c6135ebb4429 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:03.284939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2330eac9-d02c-47e3-bb02-c6135ebb4429 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:03.309984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2330eac9-d02c-47e3-bb02-c6135ebb4429 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.311396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2330eac9-d02c-47e3-bb02-c6135ebb4429 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.315855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2330eac9-d02c-47e3-bb02-c6135ebb4429 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.317234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2330eac9-d02c-47e3-bb02-c6135ebb4429 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.345453 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1ebd0dfa-032e-4fc6-9b05-d976c99840ee tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52/action" status: 202 len: 0 microversion: 2.25 time: 5.717739 Jul 26 19:46:03.346547 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 402/756] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 19:45:57 2022] POST /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52/action => generated 0 bytes in 5720 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:46:03.364560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:03.365181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] [instance: 50a4a582-0699-43a9-89f9-19b22e0cda22] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:03.409659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.410927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.421100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.423183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.478362 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] HTTP exception thrown: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Request method failure captured: Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 HTTP/1.1 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EPJr6E1ZuBsTgfrkqqyVKh5WqSyEMiWzHoALiaPkAT1CC9AJ4XFY4JoJfFDYvvgiL1Pt1PLlP7wkEEywrRmb1d4zJmVbIGywLL4dszfxF5aY8W-5RVKaJ26wfAr2mc1FMDd5-LreIXtVqZe4L4oR1yotl3TsemvfHwEqE7YoI7wTEU Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5112c2e993b44756a068fe8782e68681"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5112c2e993b44756a068fe8782e68681", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5112c2e993b44756a068fe8782e68681"}]}] Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5112c2e993b44756a068fe8782e68681 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7836e60170f1440c9d82b730e8d03344 Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-891096064-project Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '50a4a582-0699-43a9-89f9-19b22e0cda22'} Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:03.487474 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:03.492894 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:03.492894 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:03.492894 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:03.492894 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:03.492894 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:03.492894 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:03.492894 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. Jul 26 19:46:03.492894 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:03.496012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] Returning 404 to user: Instance 50a4a582-0699-43a9-89f9-19b22e0cda22 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:03.497516 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-633cd823-237e-44eb-a59f-be0fe4b4de89 tempest-ServersWithSpecificFlavorTestJSON-891096064 tempest-ServersWithSpecificFlavorTestJSON-891096064-project] 10.222.0.58 "GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22" status: 404 len: 111 microversion: 2.1 time: 0.149910 Jul 26 19:46:03.498214 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 403/757] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:03 2022] GET /compute/v2.1/servers/50a4a582-0699-43a9-89f9-19b22e0cda22 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:03.521650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-202338ab-2552-4d7c-9227-bc341181b9c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:03.529003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-202338ab-2552-4d7c-9227-bc341181b9c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:03.546457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-202338ab-2552-4d7c-9227-bc341181b9c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.549234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-202338ab-2552-4d7c-9227-bc341181b9c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.556315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-202338ab-2552-4d7c-9227-bc341181b9c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.556711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-202338ab-2552-4d7c-9227-bc341181b9c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.763677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2330eac9-d02c-47e3-bb02-c6135ebb4429 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:03.773326 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2330eac9-d02c-47e3-bb02-c6135ebb4429 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.497572 Jul 26 19:46:03.777663 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 355/758] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:03 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:03.792685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:03.793897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:03.802635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.803170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.804880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:03.804880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:03.966924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=9 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:04.115283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-202338ab-2552-4d7c-9227-bc341181b9c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:04.126391 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-202338ab-2552-4d7c-9227-bc341181b9c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.621200 Jul 26 19:46:04.129577 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 404/759] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:03 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:04.143125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b991ff3e-f164-4c9c-9549-f033eaa3ee6b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:04.144010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b991ff3e-f164-4c9c-9549-f033eaa3ee6b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:04.166948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b991ff3e-f164-4c9c-9549-f033eaa3ee6b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:04.170580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b991ff3e-f164-4c9c-9549-f033eaa3ee6b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:04.171645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b991ff3e-f164-4c9c-9549-f033eaa3ee6b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:04.172018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b991ff3e-f164-4c9c-9549-f033eaa3ee6b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:04.234659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:04.283944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:04.299566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:04.304510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:04.309727 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-24347701-b9dc-4f11-a303-581695983f0d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.528207 Jul 26 19:46:04.310930 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 356/760] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:03 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:04.685487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b991ff3e-f164-4c9c-9549-f033eaa3ee6b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:04.700349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b991ff3e-f164-4c9c-9549-f033eaa3ee6b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1521 microversion: 2.1 time: 0.561005 Jul 26 19:46:04.701032 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 405/761] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:04 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1521 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:04.801118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e02bb880-03bf-40c0-84ef-86aead262983 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:04.802812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e02bb880-03bf-40c0-84ef-86aead262983 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:04.822654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e02bb880-03bf-40c0-84ef-86aead262983 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:04.825810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e02bb880-03bf-40c0-84ef-86aead262983 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:04.826940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e02bb880-03bf-40c0-84ef-86aead262983 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:04.827435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e02bb880-03bf-40c0-84ef-86aead262983 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:04.996718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=20 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:05.096746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e02bb880-03bf-40c0-84ef-86aead262983 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:05.107030 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e02bb880-03bf-40c0-84ef-86aead262983 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.311232 Jul 26 19:46:05.110757 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 357/762] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:04 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:05.152356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bd878f1-28a3-419b-85da-5493518cc460 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:05.153069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0bd878f1-28a3-419b-85da-5493518cc460 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:05.165531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bd878f1-28a3-419b-85da-5493518cc460 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:05.165993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bd878f1-28a3-419b-85da-5493518cc460 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:05.168296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bd878f1-28a3-419b-85da-5493518cc460 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:05.173397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bd878f1-28a3-419b-85da-5493518cc460 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:05.334919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:05.335539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:05.338866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:05.350014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:05.350727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:05.352771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:05.353431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:05.682713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0bd878f1-28a3-419b-85da-5493518cc460 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:05.697737 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0bd878f1-28a3-419b-85da-5493518cc460 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.549722 Jul 26 19:46:05.704096 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 406/763] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:05 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:05.722337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d99548c5-8b2b-4175-b9cc-9c4d007d4b66 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:05.723489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d99548c5-8b2b-4175-b9cc-9c4d007d4b66 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:05.730006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d99548c5-8b2b-4175-b9cc-9c4d007d4b66 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:05.730461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d99548c5-8b2b-4175-b9cc-9c4d007d4b66 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:05.731240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d99548c5-8b2b-4175-b9cc-9c4d007d4b66 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:05.731813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d99548c5-8b2b-4175-b9cc-9c4d007d4b66 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:05.980778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:06.000491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:06.003201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:06.013168 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa745cd4-a062-4645-8f83-aebaaab9c041 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.678375 Jul 26 19:46:06.014113 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 358/764] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:05 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:46:06.131622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f48bcee3-912b-44f1-80f0-a504bd73d635 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:06.132397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f48bcee3-912b-44f1-80f0-a504bd73d635 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:06.143770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f48bcee3-912b-44f1-80f0-a504bd73d635 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:06.148787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f48bcee3-912b-44f1-80f0-a504bd73d635 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:06.150582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f48bcee3-912b-44f1-80f0-a504bd73d635 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:06.151542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f48bcee3-912b-44f1-80f0-a504bd73d635 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:06.234017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:06.422094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d99548c5-8b2b-4175-b9cc-9c4d007d4b66 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:06.433829 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d99548c5-8b2b-4175-b9cc-9c4d007d4b66 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1521 microversion: 2.1 time: 0.715221 Jul 26 19:46:06.435230 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 407/765] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:05 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1521 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:06.661709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b945630b-7d16-4c37-b2a1-bb62d35ee64c tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:06.664335 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:06.664335 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:46:06.665614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b945630b-7d16-4c37-b2a1-bb62d35ee64c tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:06.666069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b945630b-7d16-4c37-b2a1-bb62d35ee64c tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:06.666886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b945630b-7d16-4c37-b2a1-bb62d35ee64c tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:06.667322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b945630b-7d16-4c37-b2a1-bb62d35ee64c tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:06.748930 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b945630b-7d16-4c37-b2a1-bb62d35ee64c tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.312239 Jul 26 19:46:06.749477 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 408/766] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:46:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:06.762454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ac81cc5a-5623-469e-b8fb-50ed54f4725f req-a3b5c1c7-d339-4a2c-8986-87e067d6b34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c814f3cd-1c30-41a1-9f98-13fdf07d945b", "name": "network-vif-plugged", "status": "completed", "tag": "1ab14c84-9e1b-410d-9b20-37f88e91a89b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:06.780140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ac81cc5a-5623-469e-b8fb-50ed54f4725f req-a3b5c1c7-d339-4a2c-8986-87e067d6b34a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:06.780736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ac81cc5a-5623-469e-b8fb-50ed54f4725f req-a3b5c1c7-d339-4a2c-8986-87e067d6b34a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:06.803074 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ac81cc5a-5623-469e-b8fb-50ed54f4725f req-a3b5c1c7-d339-4a2c-8986-87e067d6b34a service nova] Creating event network-vif-plugged:1ab14c84-9e1b-410d-9b20-37f88e91a89b for instance c814f3cd-1c30-41a1-9f98-13fdf07d945b on n-h1-708768-8 Jul 26 19:46:06.809312 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ac81cc5a-5623-469e-b8fb-50ed54f4725f req-a3b5c1c7-d339-4a2c-8986-87e067d6b34a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058619 Jul 26 19:46:06.811921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 409/767] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:06.827029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-10d3ab53-9252-4f23-ab25-79a89cfb4c96 req-3d5833ca-520d-408e-b33d-aa8b8e6a5809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c", "tag": "651ff982-65c6-44db-bd21-d948b1ec5a50"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:06.839435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-10d3ab53-9252-4f23-ab25-79a89cfb4c96 req-3d5833ca-520d-408e-b33d-aa8b8e6a5809 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:06.839924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-10d3ab53-9252-4f23-ab25-79a89cfb4c96 req-3d5833ca-520d-408e-b33d-aa8b8e6a5809 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:06.871879 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-10d3ab53-9252-4f23-ab25-79a89cfb4c96 req-3d5833ca-520d-408e-b33d-aa8b8e6a5809 service nova] Creating event network-changed:651ff982-65c6-44db-bd21-d948b1ec5a50 for instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c on n-h1-708768-8 Jul 26 19:46:06.897355 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-10d3ab53-9252-4f23-ab25-79a89cfb4c96 req-3d5833ca-520d-408e-b33d-aa8b8e6a5809 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084007 Jul 26 19:46:06.898661 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 410/768] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:06.914730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3eac967-d43a-491f-8ea6-78d2e11611be tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:06.915995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3eac967-d43a-491f-8ea6-78d2e11611be tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:06.924445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3eac967-d43a-491f-8ea6-78d2e11611be tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:06.924898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3eac967-d43a-491f-8ea6-78d2e11611be tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:06.925697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3eac967-d43a-491f-8ea6-78d2e11611be tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:06.929422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3eac967-d43a-491f-8ea6-78d2e11611be tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.084051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f48bcee3-912b-44f1-80f0-a504bd73d635 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:07.096107 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f48bcee3-912b-44f1-80f0-a504bd73d635 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.969413 Jul 26 19:46:07.097452 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 359/769] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:06 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:07.104265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e51387d9-d74e-4011-8aa9-237646bbcaa1 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:07.117895 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:07.117895 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:46:07.119806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51387d9-d74e-4011-8aa9-237646bbcaa1 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.120504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51387d9-d74e-4011-8aa9-237646bbcaa1 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.129659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51387d9-d74e-4011-8aa9-237646bbcaa1 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.130409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51387d9-d74e-4011-8aa9-237646bbcaa1 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.170552 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e51387d9-d74e-4011-8aa9-237646bbcaa1 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.069880 Jul 26 19:46:07.171796 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 360/770] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Jul 26 19:46:07 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:07.179273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:07.182008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:07.188769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.189543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.190490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.191087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.424790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3eac967-d43a-491f-8ea6-78d2e11611be tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:07.436853 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3eac967-d43a-491f-8ea6-78d2e11611be tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.533448 Jul 26 19:46:07.437752 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 411/771] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:06 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:07.443819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-faf95fb3-508f-4005-b0ae-60d95fd56665 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:07.446791 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:07.446791 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:46:07.448309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faf95fb3-508f-4005-b0ae-60d95fd56665 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.448931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faf95fb3-508f-4005-b0ae-60d95fd56665 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.450622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faf95fb3-508f-4005-b0ae-60d95fd56665 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.451235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faf95fb3-508f-4005-b0ae-60d95fd56665 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.479079 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-faf95fb3-508f-4005-b0ae-60d95fd56665 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039996 Jul 26 19:46:07.479722 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 412/772] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:46:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:07.484309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8aac5973-b90b-402f-9eec-0a258ad5eebe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:07.485094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8aac5973-b90b-402f-9eec-0a258ad5eebe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:07.493707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8aac5973-b90b-402f-9eec-0a258ad5eebe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.494146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8aac5973-b90b-402f-9eec-0a258ad5eebe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.495118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8aac5973-b90b-402f-9eec-0a258ad5eebe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.495559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8aac5973-b90b-402f-9eec-0a258ad5eebe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.606101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:07.616990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:07.619727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:07.623117 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85c13dca-e3a0-4964-818c-ca6eeef87ba2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.449620 Jul 26 19:46:07.625548 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 361/773] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:07 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:07.633356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-81fb628a-25a2-4acc-9e88-2135d4d69583 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:07.636855 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:07.636855 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:46:07.638768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81fb628a-25a2-4acc-9e88-2135d4d69583 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.639492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81fb628a-25a2-4acc-9e88-2135d4d69583 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.640562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81fb628a-25a2-4acc-9e88-2135d4d69583 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.641554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81fb628a-25a2-4acc-9e88-2135d4d69583 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.668529 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-81fb628a-25a2-4acc-9e88-2135d4d69583 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-708768-8&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.041232 Jul 26 19:46:07.669861 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 362/774] 10.222.0.58 () {58 vars in 1194 bytes} [Tue Jul 26 19:46:07 2022] GET /compute/v2.1/os-services?host=n-d-708768-8&binary=xxx => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:46:07.685016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e9f261ff-ca6e-43b6-b0e7-f0154d2cac53 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:07.688864 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:07.688864 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:46:07.691195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9f261ff-ca6e-43b6-b0e7-f0154d2cac53 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.693381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9f261ff-ca6e-43b6-b0e7-f0154d2cac53 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.694608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9f261ff-ca6e-43b6-b0e7-f0154d2cac53 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.695164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9f261ff-ca6e-43b6-b0e7-f0154d2cac53 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.726551 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e9f261ff-ca6e-43b6-b0e7-f0154d2cac53 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047668 Jul 26 19:46:07.730700 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 363/775] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:46:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:46:07.751727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-93559a3a-c74d-419a-b40d-dc6a9d75b818 req-7972cf11-83ce-4f45-8183-cf3dafec41f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c305d3d-37c5-4ee8-81cc-3ff8f2998d52", "name": "network-vif-unplugged", "status": "completed", "tag": "8b554828-b715-42fe-9f30-38b72c6f49f2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:07.767910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-93559a3a-c74d-419a-b40d-dc6a9d75b818 req-7972cf11-83ce-4f45-8183-cf3dafec41f3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.768445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-93559a3a-c74d-419a-b40d-dc6a9d75b818 req-7972cf11-83ce-4f45-8183-cf3dafec41f3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.777746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8aac5973-b90b-402f-9eec-0a258ad5eebe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:07.781845 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-93559a3a-c74d-419a-b40d-dc6a9d75b818 req-7972cf11-83ce-4f45-8183-cf3dafec41f3 service nova] Creating event network-vif-unplugged:8b554828-b715-42fe-9f30-38b72c6f49f2 for instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 on n-h1-708768-8 Jul 26 19:46:07.791999 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8aac5973-b90b-402f-9eec-0a258ad5eebe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1521 microversion: 2.1 time: 0.311011 Jul 26 19:46:07.792737 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 413/776] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:07 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:07.793540 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-93559a3a-c74d-419a-b40d-dc6a9d75b818 req-7972cf11-83ce-4f45-8183-cf3dafec41f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062751 Jul 26 19:46:07.794617 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 364/777] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:07.818285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38516f8b-82bd-4aa2-a95d-6b6f0cc3bd93 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:07.824037 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:07.824037 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:46:07.828436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38516f8b-82bd-4aa2-a95d-6b6f0cc3bd93 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.829926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38516f8b-82bd-4aa2-a95d-6b6f0cc3bd93 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.833133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38516f8b-82bd-4aa2-a95d-6b6f0cc3bd93 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:07.835011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38516f8b-82bd-4aa2-a95d-6b6f0cc3bd93 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:07.888933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-38516f8b-82bd-4aa2-a95d-6b6f0cc3bd93 tempest-ServicesAdminNegativeTestJSON-786793340 tempest-ServicesAdminNegativeTestJSON-786793340-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.088131 Jul 26 19:46:07.895349 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 414/778] 10.222.0.58 () {58 vars in 1198 bytes} [Tue Jul 26 19:46:07 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:46:08.086524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5d89bab-8c96-4468-8bbd-c34e817cc7e3 tempest-ServicesAdminNegativeTestJSON-1727626047 tempest-ServicesAdminNegativeTestJSON-1727626047-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:08.092379 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:08.092379 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:46:08.094356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c5d89bab-8c96-4468-8bbd-c34e817cc7e3 tempest-ServicesAdminNegativeTestJSON-1727626047 tempest-ServicesAdminNegativeTestJSON-1727626047-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a462a65338ea41119bfb0a23e815c42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b036c1b2d0be4985b1e24bc70ea1b926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5d89bab-8c96-4468-8bbd-c34e817cc7e3 tempest-ServicesAdminNegativeTestJSON-1727626047 tempest-ServicesAdminNegativeTestJSON-1727626047-project] Request method failure captured: Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ER9hpJ-SPSJAd-tPV0lTlbcfaAmd6PFdB627Er2lNLkGBdvrY1KLBBdryyJ6jn_Cwi55fBtwdtBekgW1xT2QbeOz7Dfr3ZhMAfosZit_LYTjVwnFrDvsNwXHX1fZXmLRBOYrGjFofbeeoxDQk_B6epVzZUzr9B-6pzwvrUORbr78Fs Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: b036c1b2d0be4985b1e24bc70ea1b926 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1727626047 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b036c1b2d0be4985b1e24bc70ea1b926"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b036c1b2d0be4985b1e24bc70ea1b926"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b036c1b2d0be4985b1e24bc70ea1b926", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b036c1b2d0be4985b1e24bc70ea1b926"}]}] Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1727626047 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: b036c1b2d0be4985b1e24bc70ea1b926 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1727626047 Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServicesAdminNegativeTestJSON-1727626047-project Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a462a65338ea41119bfb0a23e815c42c Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1727626047-project Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: action_args: {} Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 19:46:08.097471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:08.102737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5d89bab-8c96-4468-8bbd-c34e817cc7e3 tempest-ServicesAdminNegativeTestJSON-1727626047 tempest-ServicesAdminNegativeTestJSON-1727626047-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:08.103753 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5d89bab-8c96-4468-8bbd-c34e817cc7e3 tempest-ServicesAdminNegativeTestJSON-1727626047 tempest-ServicesAdminNegativeTestJSON-1727626047-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.199176 Jul 26 19:46:08.105361 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 365/779] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:46:07 2022] GET /compute/v2.1/os-services => generated 112 bytes in 203 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:08.121991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7512845b-c82a-492c-9dc0-32788514ba05 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:08.122749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7512845b-c82a-492c-9dc0-32788514ba05 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:08.131529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7512845b-c82a-492c-9dc0-32788514ba05 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:08.135964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7512845b-c82a-492c-9dc0-32788514ba05 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:08.138393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7512845b-c82a-492c-9dc0-32788514ba05 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:08.138927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7512845b-c82a-492c-9dc0-32788514ba05 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:08.460853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fdd551fd-fa93-4a45-b9bb-6c5323182095 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:08.461792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fdd551fd-fa93-4a45-b9bb-6c5323182095 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:08.491331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdd551fd-fa93-4a45-b9bb-6c5323182095 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:08.497088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdd551fd-fa93-4a45-b9bb-6c5323182095 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:08.502545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdd551fd-fa93-4a45-b9bb-6c5323182095 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:08.503699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdd551fd-fa93-4a45-b9bb-6c5323182095 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:08.662768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7512845b-c82a-492c-9dc0-32788514ba05 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:08.680664 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7512845b-c82a-492c-9dc0-32788514ba05 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.566789 Jul 26 19:46:08.683463 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 415/780] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:08 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:08.703286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:08.704617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:08.713911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:08.715021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:08.720488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:08.721173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:08.933089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fdd551fd-fa93-4a45-b9bb-6c5323182095 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:08.944719 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fdd551fd-fa93-4a45-b9bb-6c5323182095 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.489418 Jul 26 19:46:08.945545 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 366/781] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:08 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:08.971487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bafc3386-37da-46c2-ba1d-9059d0ed0ffc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:08.972508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bafc3386-37da-46c2-ba1d-9059d0ed0ffc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:08.980168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bafc3386-37da-46c2-ba1d-9059d0ed0ffc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:08.980971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bafc3386-37da-46c2-ba1d-9059d0ed0ffc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:08.981972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bafc3386-37da-46c2-ba1d-9059d0ed0ffc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:08.982630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bafc3386-37da-46c2-ba1d-9059d0ed0ffc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:09.392331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:09.409153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:09.412188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:09.420143 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9508a827-1f7d-4847-bf4d-61e7c16f3ad0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.726684 Jul 26 19:46:09.421487 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 416/782] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:08 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:09.431632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bf170329-1a65-4159-a6f8-6a497464f1a2 req-7c71c6e8-bd75-45f8-af8d-9ef030b15d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75655c2a-2978-4096-920f-f4c6786cacf0", "name": "network-vif-plugged", "status": "completed", "tag": "e16de01d-5776-43e1-9e4a-5f7d843c8e7a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:09.453088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bf170329-1a65-4159-a6f8-6a497464f1a2 req-7c71c6e8-bd75-45f8-af8d-9ef030b15d8c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:09.454944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bf170329-1a65-4159-a6f8-6a497464f1a2 req-7c71c6e8-bd75-45f8-af8d-9ef030b15d8c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:09.485250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bafc3386-37da-46c2-ba1d-9059d0ed0ffc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:09.489086 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bf170329-1a65-4159-a6f8-6a497464f1a2 req-7c71c6e8-bd75-45f8-af8d-9ef030b15d8c service nova] Creating event network-vif-plugged:e16de01d-5776-43e1-9e4a-5f7d843c8e7a for instance 75655c2a-2978-4096-920f-f4c6786cacf0 on n-h2-708768-8 Jul 26 19:46:09.493532 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bafc3386-37da-46c2-ba1d-9059d0ed0ffc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1521 microversion: 2.1 time: 0.541921 Jul 26 19:46:09.494108 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 367/783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:08 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:09.507847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bf170329-1a65-4159-a6f8-6a497464f1a2 req-7c71c6e8-bd75-45f8-af8d-9ef030b15d8c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074906 Jul 26 19:46:09.507847 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 417/784] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:09.706601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60372c2d-799e-4037-8211-eef267d40b9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:09.707686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60372c2d-799e-4037-8211-eef267d40b9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:09.728264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60372c2d-799e-4037-8211-eef267d40b9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:09.733070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60372c2d-799e-4037-8211-eef267d40b9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:09.742579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60372c2d-799e-4037-8211-eef267d40b9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:09.743216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60372c2d-799e-4037-8211-eef267d40b9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:09.847435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9191f086-f0c0-42cf-bbbe-8ff08467d310 req-bd698061-a17c-460c-a70b-ff28de05c944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c305d3d-37c5-4ee8-81cc-3ff8f2998d52", "tag": "8b554828-b715-42fe-9f30-38b72c6f49f2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:09.875490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9191f086-f0c0-42cf-bbbe-8ff08467d310 req-bd698061-a17c-460c-a70b-ff28de05c944 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:09.876256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9191f086-f0c0-42cf-bbbe-8ff08467d310 req-bd698061-a17c-460c-a70b-ff28de05c944 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:09.930387 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9191f086-f0c0-42cf-bbbe-8ff08467d310 req-bd698061-a17c-460c-a70b-ff28de05c944 service nova] Creating event network-changed:8b554828-b715-42fe-9f30-38b72c6f49f2 for instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 on n-h1-708768-8 Jul 26 19:46:09.937504 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9191f086-f0c0-42cf-bbbe-8ff08467d310 req-bd698061-a17c-460c-a70b-ff28de05c944 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094103 Jul 26 19:46:09.938702 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 368/785] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:46:09.968335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08f99695-5efc-465a-b6b3-86b4f9fbbfde tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:09.969061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-08f99695-5efc-465a-b6b3-86b4f9fbbfde tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:09.988788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08f99695-5efc-465a-b6b3-86b4f9fbbfde tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:09.989720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08f99695-5efc-465a-b6b3-86b4f9fbbfde tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:09.990544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08f99695-5efc-465a-b6b3-86b4f9fbbfde tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:09.996107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08f99695-5efc-465a-b6b3-86b4f9fbbfde tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:10.246966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-08f99695-5efc-465a-b6b3-86b4f9fbbfde tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:10.255542 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-08f99695-5efc-465a-b6b3-86b4f9fbbfde tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.292686 Jul 26 19:46:10.256150 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 369/786] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:09 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:10.295339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60372c2d-799e-4037-8211-eef267d40b9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:10.311166 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60372c2d-799e-4037-8211-eef267d40b9b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.609412 Jul 26 19:46:10.324584 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 418/787] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:09 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:10.448391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:10.449009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:10.456769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:10.457803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:10.459142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:10.459967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:10.516666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ecf4ffb-624c-4965-a572-b829fb69bf11 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:10.518075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ecf4ffb-624c-4965-a572-b829fb69bf11 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:10.540272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ecf4ffb-624c-4965-a572-b829fb69bf11 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:10.541151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ecf4ffb-624c-4965-a572-b829fb69bf11 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:10.543837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ecf4ffb-624c-4965-a572-b829fb69bf11 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:10.544542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ecf4ffb-624c-4965-a572-b829fb69bf11 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:11.022554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:11.042201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:11.048826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:11.050459 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cda05e7e-5a7b-4093-8f12-2475733bace4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.607144 Jul 26 19:46:11.053318 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 370/788] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:10 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:11.282430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66847f73-9dd3-4859-80d3-32a2eb8e066a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:11.284091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66847f73-9dd3-4859-80d3-32a2eb8e066a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:11.300047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66847f73-9dd3-4859-80d3-32a2eb8e066a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:11.301461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66847f73-9dd3-4859-80d3-32a2eb8e066a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:11.304272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66847f73-9dd3-4859-80d3-32a2eb8e066a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:11.305546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66847f73-9dd3-4859-80d3-32a2eb8e066a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:11.588750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9ecf4ffb-624c-4965-a572-b829fb69bf11 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:11.618263 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ecf4ffb-624c-4965-a572-b829fb69bf11 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1506 microversion: 2.1 time: 1.103995 Jul 26 19:46:11.636513 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 419/789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:10 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1506 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:11.646980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46cbf549-b955-4724-bc2f-2829e5f911fb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:11.648090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-46cbf549-b955-4724-bc2f-2829e5f911fb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:11.659535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46cbf549-b955-4724-bc2f-2829e5f911fb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:11.663430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46cbf549-b955-4724-bc2f-2829e5f911fb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:11.664588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46cbf549-b955-4724-bc2f-2829e5f911fb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:11.665145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46cbf549-b955-4724-bc2f-2829e5f911fb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:11.898520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-66847f73-9dd3-4859-80d3-32a2eb8e066a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:11.909130 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66847f73-9dd3-4859-80d3-32a2eb8e066a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.635115 Jul 26 19:46:11.911235 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 371/790] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:11 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:11.921373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c6c9e055-4ef5-46c1-b0a3-d813cbc2606d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:11.922700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c6c9e055-4ef5-46c1-b0a3-d813cbc2606d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:11.934883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6c9e055-4ef5-46c1-b0a3-d813cbc2606d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:11.935265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6c9e055-4ef5-46c1-b0a3-d813cbc2606d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:11.936778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6c9e055-4ef5-46c1-b0a3-d813cbc2606d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:11.937420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6c9e055-4ef5-46c1-b0a3-d813cbc2606d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:12.053340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-46cbf549-b955-4724-bc2f-2829e5f911fb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:12.070073 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-46cbf549-b955-4724-bc2f-2829e5f911fb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.431223 Jul 26 19:46:12.084344 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 420/791] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:11 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:12.089551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:12.090559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:12.097676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:12.098520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:12.099524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:12.100803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:12.226802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c6c9e055-4ef5-46c1-b0a3-d813cbc2606d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:12.237786 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c6c9e055-4ef5-46c1-b0a3-d813cbc2606d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 200 len: 1506 microversion: 2.1 time: 0.324915 Jul 26 19:46:12.240646 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 372/792] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:11 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:12.261487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38fba7e1-7c3b-4cd8-af8c-93a10a2100b5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:12.262163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38fba7e1-7c3b-4cd8-af8c-93a10a2100b5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:12.270173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38fba7e1-7c3b-4cd8-af8c-93a10a2100b5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:12.271397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38fba7e1-7c3b-4cd8-af8c-93a10a2100b5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:12.272412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38fba7e1-7c3b-4cd8-af8c-93a10a2100b5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:12.273053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38fba7e1-7c3b-4cd8-af8c-93a10a2100b5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:12.307306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38fba7e1-7c3b-4cd8-af8c-93a10a2100b5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:46:12.389773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:12.425967 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38fba7e1-7c3b-4cd8-af8c-93a10a2100b5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 204 len: 0 microversion: 2.1 time: 0.168472 Jul 26 19:46:12.431822 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 373/793] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:12 2022] DELETE /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:12.483767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:12.493429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:12.494952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:12.496210 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ebb20f1-ac95-45b5-ab5c-c8a313296ee1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.410472 Jul 26 19:46:12.512520 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 421/794] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:12 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:12.575900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1876494140", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "90a80e65-c3c4-4058-b8fa-aa7f6384a3b0"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:12.666020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] validate_networks() for [('90a80e65-c3c4-4058-b8fa-aa7f6384a3b0', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:46:12.936600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-425dc119-7514-4ace-afd6-1ab4e294d73e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:12.938631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-425dc119-7514-4ace-afd6-1ab4e294d73e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:12.950275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-425dc119-7514-4ace-afd6-1ab4e294d73e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:12.950963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-425dc119-7514-4ace-afd6-1ab4e294d73e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:12.952708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-425dc119-7514-4ace-afd6-1ab4e294d73e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:12.954367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-425dc119-7514-4ace-afd6-1ab4e294d73e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:13.130031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-425dc119-7514-4ace-afd6-1ab4e294d73e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:13.141663 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-425dc119-7514-4ace-afd6-1ab4e294d73e tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.211490 Jul 26 19:46:13.142257 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 422/795] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:12 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:13.149725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e4d9d25-35f2-462a-b0b8-90af87af20d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:13.151041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e4d9d25-35f2-462a-b0b8-90af87af20d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:13.157284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e4d9d25-35f2-462a-b0b8-90af87af20d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:13.158013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e4d9d25-35f2-462a-b0b8-90af87af20d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:13.158993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e4d9d25-35f2-462a-b0b8-90af87af20d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:13.159539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e4d9d25-35f2-462a-b0b8-90af87af20d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:13.409430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e4d9d25-35f2-462a-b0b8-90af87af20d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:13.412588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:13.414710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:13.416086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:13.416721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:13.417382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:13.422491 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e4d9d25-35f2-462a-b0b8-90af87af20d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.278893 Jul 26 19:46:13.423632 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 423/796] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:13 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:13.451901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:13.453302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:13.454414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:13.454979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:13.466806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0c23ba5b-4c5f-45ad-b887-78fb000901f0 req-0ac49292-0b00-421c-9107-b486edaf5f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c", "name": "network-vif-plugged", "status": "completed", "tag": "651ff982-65c6-44db-bd21-d948b1ec5a50"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:13.485395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0c23ba5b-4c5f-45ad-b887-78fb000901f0 req-0ac49292-0b00-421c-9107-b486edaf5f7c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:13.485616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Getting quotas for project 88d10cfa367f4bf591a86719352723d6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:46:13.485843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0c23ba5b-4c5f-45ad-b887-78fb000901f0 req-0ac49292-0b00-421c-9107-b486edaf5f7c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:13.492833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Getting quotas for user 4faef4f5be5941fc961c149905589902 and project 88d10cfa367f4bf591a86719352723d6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:46:13.507329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:46:13.510931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:46:13.516364 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0c23ba5b-4c5f-45ad-b887-78fb000901f0 req-0ac49292-0b00-421c-9107-b486edaf5f7c service nova] Creating event network-vif-plugged:651ff982-65c6-44db-bd21-d948b1ec5a50 for instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c on n-h1-708768-8 Jul 26 19:46:13.527746 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0c23ba5b-4c5f-45ad-b887-78fb000901f0 req-0ac49292-0b00-421c-9107-b486edaf5f7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064503 Jul 26 19:46:13.529132 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 424/797] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:13.536488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:13.537975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:13.556186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:13.556999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:13.558150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:13.559408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:13.588663 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63860e57-5310-4820-9df8-aeb050252a74 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022427 Jul 26 19:46:13.590155 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 374/798] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:46:13.601010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7555701c-7964-48ea-a254-80d961739446 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:13.601969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7555701c-7964-48ea-a254-80d961739446 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:13.702350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7555701c-7964-48ea-a254-80d961739446 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:13.710843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7555701c-7964-48ea-a254-80d961739446 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1218 microversion: 2.1 time: 0.113875 Jul 26 19:46:13.712035 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 375/799] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:13 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:13.877624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:13.942175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:13.958381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:13.962854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab46cbe4-dcae-470d-9e55-04f8cac3b928 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.432213 Jul 26 19:46:13.963820 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 425/800] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:13 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:14.166667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66b3ab76-699b-40ba-ae01-a404ff24d09b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:14.168080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66b3ab76-699b-40ba-ae01-a404ff24d09b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:14.176493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66b3ab76-699b-40ba-ae01-a404ff24d09b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:14.177344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66b3ab76-699b-40ba-ae01-a404ff24d09b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:14.178350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66b3ab76-699b-40ba-ae01-a404ff24d09b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:14.179027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66b3ab76-699b-40ba-ae01-a404ff24d09b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:14.451250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a681308c-e42b-4ae3-b1a9-888bade27890 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:14.451921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a681308c-e42b-4ae3-b1a9-888bade27890 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:14.468369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a681308c-e42b-4ae3-b1a9-888bade27890 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:14.468871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a681308c-e42b-4ae3-b1a9-888bade27890 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:14.470846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a681308c-e42b-4ae3-b1a9-888bade27890 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:14.471357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a681308c-e42b-4ae3-b1a9-888bade27890 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:14.638567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-66b3ab76-699b-40ba-ae01-a404ff24d09b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:14.651486 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66b3ab76-699b-40ba-ae01-a404ff24d09b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.488640 Jul 26 19:46:14.652679 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 376/801] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:14 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:14.732818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cb3e66e7-7b20-45fe-b746-1f2ae6d37932 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:14.733672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cb3e66e7-7b20-45fe-b746-1f2ae6d37932 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:14.740685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb3e66e7-7b20-45fe-b746-1f2ae6d37932 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:14.741126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb3e66e7-7b20-45fe-b746-1f2ae6d37932 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:14.742142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb3e66e7-7b20-45fe-b746-1f2ae6d37932 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:14.742579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb3e66e7-7b20-45fe-b746-1f2ae6d37932 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:14.751910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a681308c-e42b-4ae3-b1a9-888bade27890 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:14.757178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:14.771451 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a681308c-e42b-4ae3-b1a9-888bade27890 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.325805 Jul 26 19:46:14.772322 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 426/802] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:14 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:14.980176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cb3e66e7-7b20-45fe-b746-1f2ae6d37932 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:14.992295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cb3e66e7-7b20-45fe-b746-1f2ae6d37932 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1270 microversion: 2.1 time: 0.263914 Jul 26 19:46:14.992884 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 377/803] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:14 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1270 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:14.993218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:14.993907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:15.002783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:15.005704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:15.008005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:15.009344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:15.355899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:15.367976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:15.370521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:15.372725 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6eb73bb3-7194-4fd4-a049-4ed553733220 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.383901 Jul 26 19:46:15.387658 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 427/804] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:14 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:15.678966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fd81309b-4ac4-4c7b-8a94-45283365bece tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:15.681744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fd81309b-4ac4-4c7b-8a94-45283365bece tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:15.702238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fd81309b-4ac4-4c7b-8a94-45283365bece tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:15.703013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fd81309b-4ac4-4c7b-8a94-45283365bece tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:15.706393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fd81309b-4ac4-4c7b-8a94-45283365bece tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:15.719031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fd81309b-4ac4-4c7b-8a94-45283365bece tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:15.792844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e3cfb38-4573-452a-b133-ecbb51e982b6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:15.793446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e3cfb38-4573-452a-b133-ecbb51e982b6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:15.803729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e3cfb38-4573-452a-b133-ecbb51e982b6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:15.804385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e3cfb38-4573-452a-b133-ecbb51e982b6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:15.807157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e3cfb38-4573-452a-b133-ecbb51e982b6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:15.820412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e3cfb38-4573-452a-b133-ecbb51e982b6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:16.243492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fd81309b-4ac4-4c7b-8a94-45283365bece tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:16.257579 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fd81309b-4ac4-4c7b-8a94-45283365bece tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.585981 Jul 26 19:46:16.258829 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 378/805] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:15 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:16.268696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-52b0cc8e-0dcf-4d06-9c05-24a26ffe2648 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:16.271844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-52b0cc8e-0dcf-4d06-9c05-24a26ffe2648 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:16.282153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52b0cc8e-0dcf-4d06-9c05-24a26ffe2648 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:16.283439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52b0cc8e-0dcf-4d06-9c05-24a26ffe2648 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:16.284426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52b0cc8e-0dcf-4d06-9c05-24a26ffe2648 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:16.285058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52b0cc8e-0dcf-4d06-9c05-24a26ffe2648 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:16.492102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-52b0cc8e-0dcf-4d06-9c05-24a26ffe2648 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:16.507851 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-52b0cc8e-0dcf-4d06-9c05-24a26ffe2648 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1276 microversion: 2.1 time: 0.247137 Jul 26 19:46:16.508640 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 379/806] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:16 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:16.516359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:16.516973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:16.538452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:16.539215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:16.540503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:16.541204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:16.735530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4e3cfb38-4573-452a-b133-ecbb51e982b6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:16.750475 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e3cfb38-4573-452a-b133-ecbb51e982b6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1317 microversion: 2.1 time: 0.961223 Jul 26 19:46:16.751094 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 428/807] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:15 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1317 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:17.099733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-be367d00-9cf1-41da-9448-8ea4145e0445 req-128b9dd2-edf2-4277-b423-72eaac0afe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c814f3cd-1c30-41a1-9f98-13fdf07d945b", "name": "network-vif-deleted", "tag": "1ab14c84-9e1b-410d-9b20-37f88e91a89b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:17.147569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-be367d00-9cf1-41da-9448-8ea4145e0445 req-128b9dd2-edf2-4277-b423-72eaac0afe5f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:17.148662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-be367d00-9cf1-41da-9448-8ea4145e0445 req-128b9dd2-edf2-4277-b423-72eaac0afe5f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:17.194250 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-be367d00-9cf1-41da-9448-8ea4145e0445 req-128b9dd2-edf2-4277-b423-72eaac0afe5f service nova] Creating event network-vif-deleted:1ab14c84-9e1b-410d-9b20-37f88e91a89b for instance c814f3cd-1c30-41a1-9f98-13fdf07d945b on n-h1-708768-8 Jul 26 19:46:17.209129 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-be367d00-9cf1-41da-9448-8ea4145e0445 req-128b9dd2-edf2-4277-b423-72eaac0afe5f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116299 Jul 26 19:46:17.209766 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 429/808] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:17.281106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54646038-40a3-493c-9cf0-bcdd81228ec3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:17.281821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54646038-40a3-493c-9cf0-bcdd81228ec3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:17.299774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54646038-40a3-493c-9cf0-bcdd81228ec3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:17.300446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54646038-40a3-493c-9cf0-bcdd81228ec3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:17.302123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54646038-40a3-493c-9cf0-bcdd81228ec3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:17.302731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54646038-40a3-493c-9cf0-bcdd81228ec3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:17.331847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:17.345145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:17.352313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:17.354833 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-306f701d-ccab-422d-9063-96a1d33570cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.845226 Jul 26 19:46:17.372429 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 380/809] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:16 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:17.529655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff9c041c-e8d9-43ae-a4ef-6ef7f9148f3e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:17.530635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff9c041c-e8d9-43ae-a4ef-6ef7f9148f3e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:17.540120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff9c041c-e8d9-43ae-a4ef-6ef7f9148f3e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:17.542711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff9c041c-e8d9-43ae-a4ef-6ef7f9148f3e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:17.545729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff9c041c-e8d9-43ae-a4ef-6ef7f9148f3e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:17.546871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff9c041c-e8d9-43ae-a4ef-6ef7f9148f3e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:17.752697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff9c041c-e8d9-43ae-a4ef-6ef7f9148f3e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:17.764690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff9c041c-e8d9-43ae-a4ef-6ef7f9148f3e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1276 microversion: 2.1 time: 0.240194 Jul 26 19:46:17.768466 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 381/810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:17 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:17.776428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cad760bb-f1d6-43f9-b56e-9168299bc5ae tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:17.783040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cad760bb-f1d6-43f9-b56e-9168299bc5ae tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:17.794865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cad760bb-f1d6-43f9-b56e-9168299bc5ae tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:17.798702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cad760bb-f1d6-43f9-b56e-9168299bc5ae tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:17.800206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cad760bb-f1d6-43f9-b56e-9168299bc5ae tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:17.804353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cad760bb-f1d6-43f9-b56e-9168299bc5ae tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:17.852587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=11 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:17.948137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-54646038-40a3-493c-9cf0-bcdd81228ec3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:17.955856 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54646038-40a3-493c-9cf0-bcdd81228ec3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.678940 Jul 26 19:46:17.975108 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 430/811] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:17 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:18.108514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-61603d67-1e5c-4a53-8ddf-955ea7e38ed5 req-a9e0c5c5-ac5b-44fa-97c4-92a199f66786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c305d3d-37c5-4ee8-81cc-3ff8f2998d52", "name": "network-vif-unplugged", "status": "completed", "tag": "8b554828-b715-42fe-9f30-38b72c6f49f2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:18.125932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-61603d67-1e5c-4a53-8ddf-955ea7e38ed5 req-a9e0c5c5-ac5b-44fa-97c4-92a199f66786 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:18.126650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-61603d67-1e5c-4a53-8ddf-955ea7e38ed5 req-a9e0c5c5-ac5b-44fa-97c4-92a199f66786 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:18.160870 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-61603d67-1e5c-4a53-8ddf-955ea7e38ed5 req-a9e0c5c5-ac5b-44fa-97c4-92a199f66786 service nova] Creating event network-vif-unplugged:8b554828-b715-42fe-9f30-38b72c6f49f2 for instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 on n-h1-708768-8 Jul 26 19:46:18.167232 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-61603d67-1e5c-4a53-8ddf-955ea7e38ed5 req-a9e0c5c5-ac5b-44fa-97c4-92a199f66786 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062022 Jul 26 19:46:18.168088 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 431/812] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:46:18.388320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:18.389344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:18.398632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:18.406350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:18.407037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:18.408134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:18.408772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:18.462888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cad760bb-f1d6-43f9-b56e-9168299bc5ae tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:18.477929 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cad760bb-f1d6-43f9-b56e-9168299bc5ae tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1467 microversion: 2.1 time: 0.708073 Jul 26 19:46:18.490506 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 382/813] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:17 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1467 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:18.504588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af42f031-e7cc-4904-ba07-fa69a8081746 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:18.505449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-af42f031-e7cc-4904-ba07-fa69a8081746 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:18.515284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af42f031-e7cc-4904-ba07-fa69a8081746 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:18.523091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af42f031-e7cc-4904-ba07-fa69a8081746 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:18.524649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af42f031-e7cc-4904-ba07-fa69a8081746 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:18.525250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af42f031-e7cc-4904-ba07-fa69a8081746 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:19.176980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:19.188524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:19.196424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:19.198927 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-183439a7-5f9c-4ae0-a78c-3bba95754245 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.814714 Jul 26 19:46:19.200013 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 432/814] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:18 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:46:19.220826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-44d6a159-a1af-4e1a-8132-06c044ea232c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:19.221566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-44d6a159-a1af-4e1a-8132-06c044ea232c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:19.229932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44d6a159-a1af-4e1a-8132-06c044ea232c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:19.230454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44d6a159-a1af-4e1a-8132-06c044ea232c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:19.232639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44d6a159-a1af-4e1a-8132-06c044ea232c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:19.233152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44d6a159-a1af-4e1a-8132-06c044ea232c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:19.580069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af42f031-e7cc-4904-ba07-fa69a8081746 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:19.600167 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-af42f031-e7cc-4904-ba07-fa69a8081746 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0" status: 200 len: 1466 microversion: 2.1 time: 1.093772 Jul 26 19:46:19.601099 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 383/815] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:18 2022] GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0 => generated 1466 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:19.606315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99fea255-9642-4395-a3fe-ff102fe2bb4c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:19.609390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-99fea255-9642-4395-a3fe-ff102fe2bb4c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:19.621193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99fea255-9642-4395-a3fe-ff102fe2bb4c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:19.622050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99fea255-9642-4395-a3fe-ff102fe2bb4c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:19.622429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99fea255-9642-4395-a3fe-ff102fe2bb4c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:19.622904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99fea255-9642-4395-a3fe-ff102fe2bb4c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:20.006605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-99fea255-9642-4395-a3fe-ff102fe2bb4c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:20.041881 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-99fea255-9642-4395-a3fe-ff102fe2bb4c tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.439446 Jul 26 19:46:20.044716 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 384/816] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:19 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:20.052957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:20.059001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:20.060514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Searching by: {'reservation_id': 'r-z3fj83dq', 'deleted': False, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:46:20.081380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:20.082345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:20.083748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:20.084424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:20.296756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:46:20.480092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:20.489580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:20.490132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:20.626090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-44d6a159-a1af-4e1a-8132-06c044ea232c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:20.654607 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-44d6a159-a1af-4e1a-8132-06c044ea232c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1318 microversion: 2.1 time: 1.441299 Jul 26 19:46:20.664028 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 433/817] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:19 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1318 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:20.687729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:20.688806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:20.697013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:20.698986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:20.700381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:20.701001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:20.823521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ddd8f5ce-9b0a-4cbb-9c5a-79b77086b688 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-z3fj83dq" status: 200 len: 2926 microversion: 2.1 time: 0.777289 Jul 26 19:46:20.824448 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 385/818] 10.222.0.58 () {58 vars in 1197 bytes} [Tue Jul 26 19:46:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-z3fj83dq => generated 2926 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:20.852532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7fa5090a-45b9-4229-9e53-69fb69248014 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:20.892455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.server_groups [None req-7fa5090a-45b9-4229-9e53-69fb69248014 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Querying cell 0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) for 2 instances {{(pid=125964) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 19:46:20.893572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fa5090a-45b9-4229-9e53-69fb69248014 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:20.893702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fa5090a-45b9-4229-9e53-69fb69248014 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:20.964899 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7fa5090a-45b9-4229-9e53-69fb69248014 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/61c8def5-9717-4b35-a648-b792587e3675" status: 200 len: 271 microversion: 2.1 time: 0.118039 Jul 26 19:46:20.971187 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 386/819] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:46:20 2022] GET /compute/v2.1/os-server-groups/61c8def5-9717-4b35-a648-b792587e3675 => generated 271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:46:20.981709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b388c5c5-8eca-4f82-a0c1-3abe04a792de tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:20.985706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b388c5c5-8eca-4f82-a0c1-3abe04a792de tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:20.999820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b388c5c5-8eca-4f82-a0c1-3abe04a792de tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.000573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b388c5c5-8eca-4f82-a0c1-3abe04a792de tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.001571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b388c5c5-8eca-4f82-a0c1-3abe04a792de tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.002190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b388c5c5-8eca-4f82-a0c1-3abe04a792de tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.296805 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b388c5c5-8eca-4f82-a0c1-3abe04a792de tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0" status: 200 len: 1617 microversion: 2.1 time: 0.323902 Jul 26 19:46:21.323302 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 387/820] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:20 2022] GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0 => generated 1617 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:21.328387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16fa2d8c-fb42-46c6-ba32-c82393530ad5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:21.328998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-16fa2d8c-fb42-46c6-ba32-c82393530ad5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:21.331999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:21.337176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16fa2d8c-fb42-46c6-ba32-c82393530ad5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.337618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16fa2d8c-fb42-46c6-ba32-c82393530ad5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.338405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16fa2d8c-fb42-46c6-ba32-c82393530ad5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.338818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16fa2d8c-fb42-46c6-ba32-c82393530ad5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.340686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:21.342214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:21.343387 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-38f0002c-a71d-490d-9e5c-b801d56eab1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.661390 Jul 26 19:46:21.352204 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 434/821] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:20 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:21.363170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2fdb0e82-7409-44d7-9b5e-b0780978874a tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:21.371856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2fdb0e82-7409-44d7-9b5e-b0780978874a tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:21.393400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fdb0e82-7409-44d7-9b5e-b0780978874a tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.393855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fdb0e82-7409-44d7-9b5e-b0780978874a tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.394668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fdb0e82-7409-44d7-9b5e-b0780978874a tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.403709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fdb0e82-7409-44d7-9b5e-b0780978874a tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.806920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-16fa2d8c-fb42-46c6-ba32-c82393530ad5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:21.823484 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16fa2d8c-fb42-46c6-ba32-c82393530ad5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.498915 Jul 26 19:46:21.825236 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 388/822] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:21 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:21.831554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe5cc39d-9b3b-496b-af97-74d4ad077b1c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:21.833445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fe5cc39d-9b3b-496b-af97-74d4ad077b1c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:21.853125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe5cc39d-9b3b-496b-af97-74d4ad077b1c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.853621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe5cc39d-9b3b-496b-af97-74d4ad077b1c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.855156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe5cc39d-9b3b-496b-af97-74d4ad077b1c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.855850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe5cc39d-9b3b-496b-af97-74d4ad077b1c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.884600 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2fdb0e82-7409-44d7-9b5e-b0780978874a tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1618 microversion: 2.1 time: 0.530976 Jul 26 19:46:21.891304 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 435/823] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:21 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1618 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:21.902359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-da1a3b42-f677-4de5-8dac-2e77b1c86e2a req-9246249c-fe76-4d5d-a341-eb50c9bb0b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca9a3004-dc44-4bfc-926a-3f0ed3e29227", "tag": "d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:21.932400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-da1a3b42-f677-4de5-8dac-2e77b1c86e2a req-9246249c-fe76-4d5d-a341-eb50c9bb0b85 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:21.932828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-da1a3b42-f677-4de5-8dac-2e77b1c86e2a req-9246249c-fe76-4d5d-a341-eb50c9bb0b85 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:21.952840 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-da1a3b42-f677-4de5-8dac-2e77b1c86e2a req-9246249c-fe76-4d5d-a341-eb50c9bb0b85 service nova] Creating event network-changed:d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134 for instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 on n-h2-708768-8 Jul 26 19:46:21.980884 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-da1a3b42-f677-4de5-8dac-2e77b1c86e2a req-9246249c-fe76-4d5d-a341-eb50c9bb0b85 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077434 Jul 26 19:46:21.982024 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 436/824] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:22.076965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1643631513", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "46c80442-0e57-4d48-bc28-6682ae824154"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:22.189932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:46:22.278992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fe5cc39d-9b3b-496b-af97-74d4ad077b1c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:22.287904 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe5cc39d-9b3b-496b-af97-74d4ad077b1c tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1318 microversion: 2.1 time: 0.460716 Jul 26 19:46:22.289736 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 389/825] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:21 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:22.380422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:22.381052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:22.390451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:22.390904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:22.391720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:22.398374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:23.080901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:23.081396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:23.081783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:23.082278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:23.082810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:23.097352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:23.097548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:23.100122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:23.105408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:23.145142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:46:23.151194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:46:23.156824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:23.172201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:23.173735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:23.174895 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e7352e90-6b6d-4faa-8437-0990b225f063 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1567 microversion: 2.25 time: 0.798736 Jul 26 19:46:23.175473 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 390/826] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:22 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1567 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:46:23.184450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:46:23.187125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:46:23.196712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca946106-7c80-48f0-860c-3b465eb2ebe8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:23.197601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca946106-7c80-48f0-860c-3b465eb2ebe8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:23.210998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca946106-7c80-48f0-860c-3b465eb2ebe8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:23.212576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca946106-7c80-48f0-860c-3b465eb2ebe8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:23.215410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca946106-7c80-48f0-860c-3b465eb2ebe8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:23.216181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca946106-7c80-48f0-860c-3b465eb2ebe8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:23.251422 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-286754d0-171a-463d-80c1-24c9f2da06a4 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178802 Jul 26 19:46:23.252119 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 437/827] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:46:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:46:23.263807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c5c432d-6e8f-458a-b7cb-e94fb029df0c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:23.267558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c5c432d-6e8f-458a-b7cb-e94fb029df0c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:23.442860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c5c432d-6e8f-458a-b7cb-e94fb029df0c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:23.450781 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c5c432d-6e8f-458a-b7cb-e94fb029df0c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1217 microversion: 2.1 time: 0.190917 Jul 26 19:46:23.451769 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 438/828] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:23 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:23.456490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-376f2ba6-04be-4cc3-8b2f-2b0134e99109 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:23.457094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-376f2ba6-04be-4cc3-8b2f-2b0134e99109 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:23.483568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-376f2ba6-04be-4cc3-8b2f-2b0134e99109 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:23.484054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-376f2ba6-04be-4cc3-8b2f-2b0134e99109 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:23.484835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-376f2ba6-04be-4cc3-8b2f-2b0134e99109 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:23.485275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-376f2ba6-04be-4cc3-8b2f-2b0134e99109 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:23.689645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca946106-7c80-48f0-860c-3b465eb2ebe8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:23.689645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:23.694189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca946106-7c80-48f0-860c-3b465eb2ebe8 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.502626 Jul 26 19:46:23.695346 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 391/829] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:23 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:23.919564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-376f2ba6-04be-4cc3-8b2f-2b0134e99109 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:23.928518 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-376f2ba6-04be-4cc3-8b2f-2b0134e99109 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1318 microversion: 2.1 time: 0.475540 Jul 26 19:46:23.931335 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 439/830] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:23 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:24.199557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:24.201037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:24.215326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.217595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:24.220289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.220979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:24.478014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-77a69061-0549-4505-bf20-cd0fa16f76ec tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:24.480383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-77a69061-0549-4505-bf20-cd0fa16f76ec tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:24.501200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77a69061-0549-4505-bf20-cd0fa16f76ec tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.501799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77a69061-0549-4505-bf20-cd0fa16f76ec tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:24.502655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77a69061-0549-4505-bf20-cd0fa16f76ec tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.503162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77a69061-0549-4505-bf20-cd0fa16f76ec tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:24.614420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-77a69061-0549-4505-bf20-cd0fa16f76ec tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:24.625344 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-77a69061-0549-4505-bf20-cd0fa16f76ec tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1221 microversion: 2.1 time: 0.151313 Jul 26 19:46:24.641559 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 440/831] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:24 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1221 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:24.684213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:24.710418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:24.720229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e383b9fe-1dfa-4eda-9036-7a3f58b7ccaa tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:24.720483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:24.721669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e383b9fe-1dfa-4eda-9036-7a3f58b7ccaa tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:24.722599 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d9281f4b-2ac8-4672-8582-9b6310f310c0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1557 microversion: 2.25 time: 0.527730 Jul 26 19:46:24.726314 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 392/832] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:24 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1557 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:24.731118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e383b9fe-1dfa-4eda-9036-7a3f58b7ccaa tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.731848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e383b9fe-1dfa-4eda-9036-7a3f58b7ccaa tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:24.736180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e383b9fe-1dfa-4eda-9036-7a3f58b7ccaa tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.737255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e383b9fe-1dfa-4eda-9036-7a3f58b7ccaa tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:24.762630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b58050c-fffb-4b63-9798-0f3bbd8726ca tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '.version_select at 0x7f87574d7af0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:24.781026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b58050c-fffb-4b63-9798-0f3bbd8726ca tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.781583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b58050c-fffb-4b63-9798-0f3bbd8726ca tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:24.834751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b58050c-fffb-4b63-9798-0f3bbd8726ca tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.079275 Jul 26 19:46:24.842981 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 393/833] 10.222.0.58 () {60 vars in 1184 bytes} [Tue Jul 26 19:46:24 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:46:24.856621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-869bce90-d11f-42e8-8a7c-3bd0a5f102ff tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:24.857264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-869bce90-d11f-42e8-8a7c-3bd0a5f102ff tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:24.879581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:24.898667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-869bce90-d11f-42e8-8a7c-3bd0a5f102ff tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.899520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-869bce90-d11f-42e8-8a7c-3bd0a5f102ff tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:24.900566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-869bce90-d11f-42e8-8a7c-3bd0a5f102ff tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:24.903438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-869bce90-d11f-42e8-8a7c-3bd0a5f102ff tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:25.300118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-869bce90-d11f-42e8-8a7c-3bd0a5f102ff tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:25.347284 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-869bce90-d11f-42e8-8a7c-3bd0a5f102ff tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 2050 microversion: 2.25 time: 0.495503 Jul 26 19:46:25.348200 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 394/834] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:24 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 2050 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:46:25.364584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a84a2b6-0d6c-43c5-971c-95dce42dfb77 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:25.365588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8a84a2b6-0d6c-43c5-971c-95dce42dfb77 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:25.374034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a84a2b6-0d6c-43c5-971c-95dce42dfb77 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:25.378929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a84a2b6-0d6c-43c5-971c-95dce42dfb77 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:25.384362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a84a2b6-0d6c-43c5-971c-95dce42dfb77 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:25.385003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a84a2b6-0d6c-43c5-971c-95dce42dfb77 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:25.796872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a84a2b6-0d6c-43c5-971c-95dce42dfb77 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:25.807421 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a84a2b6-0d6c-43c5-971c-95dce42dfb77 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1318 microversion: 2.1 time: 0.457782 Jul 26 19:46:25.808413 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 395/835] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:25 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:25.836595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-439162725", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "ca7f5c97-fec0-4b42-bad4-1e41226d1325"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:25.939215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e383b9fe-1dfa-4eda-9036-7a3f58b7ccaa tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:25.947038 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e383b9fe-1dfa-4eda-9036-7a3f58b7ccaa tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 1.233926 Jul 26 19:46:25.968894 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 441/836] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:24 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:25.985211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46b6f02e-7d78-47c8-aee7-807a390c8de7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:25.985938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-46b6f02e-7d78-47c8-aee7-807a390c8de7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:26.008002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46b6f02e-7d78-47c8-aee7-807a390c8de7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:26.015776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46b6f02e-7d78-47c8-aee7-807a390c8de7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:26.020513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46b6f02e-7d78-47c8-aee7-807a390c8de7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:26.023036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46b6f02e-7d78-47c8-aee7-807a390c8de7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:26.034206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] validate_networks() for [('ca7f5c97-fec0-4b42-bad4-1e41226d1325', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:46:26.383243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-46b6f02e-7d78-47c8-aee7-807a390c8de7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:26.390872 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-46b6f02e-7d78-47c8-aee7-807a390c8de7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1277 microversion: 2.1 time: 0.420834 Jul 26 19:46:26.391455 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 442/837] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:25 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1277 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:26.703147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1648267908", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "faacc758-f7cd-4415-a920-940b8213555c"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:26.793083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] validate_networks() for [('faacc758-f7cd-4415-a920-940b8213555c', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:46:27.653422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:27.655423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:27.656433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:27.657036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:27.658936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:27.687004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:27.687451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:27.690147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:27.690823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:27.742132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Getting quotas for project 20bfe22d09cc4c7fba9cceb0b6532fc0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:46:27.753305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Getting quotas for user 6cb1eb1903e84b65bbaf60a89f626f47 and project 20bfe22d09cc4c7fba9cceb0b6532fc0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:46:27.777518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:46:27.780170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:46:27.890345 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6cbe2f3f-9fda-4704-9130-09b3c9271a44 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493976 Jul 26 19:46:27.891668 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 443/838] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:46:27.939087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-046aa0ae-fb7c-4ef6-91ab-a0fd5582179d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:27.950843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-046aa0ae-fb7c-4ef6-91ab-a0fd5582179d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:27.979784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-046aa0ae-fb7c-4ef6-91ab-a0fd5582179d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:27.982395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-046aa0ae-fb7c-4ef6-91ab-a0fd5582179d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:27.985782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-046aa0ae-fb7c-4ef6-91ab-a0fd5582179d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:27.988500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-046aa0ae-fb7c-4ef6-91ab-a0fd5582179d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:28.380331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-046aa0ae-fb7c-4ef6-91ab-a0fd5582179d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:28.397687 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-046aa0ae-fb7c-4ef6-91ab-a0fd5582179d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1318 microversion: 2.1 time: 0.499836 Jul 26 19:46:28.409356 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 444/839] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:27 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:28.424477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc771c5e-4765-46ae-ba89-1f10032b7fe0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:28.428291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc771c5e-4765-46ae-ba89-1f10032b7fe0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:28.448383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc771c5e-4765-46ae-ba89-1f10032b7fe0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:28.456314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc771c5e-4765-46ae-ba89-1f10032b7fe0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:28.457503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc771c5e-4765-46ae-ba89-1f10032b7fe0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:28.458467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc771c5e-4765-46ae-ba89-1f10032b7fe0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:28.842800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc771c5e-4765-46ae-ba89-1f10032b7fe0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:28.853253 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc771c5e-4765-46ae-ba89-1f10032b7fe0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.436544 Jul 26 19:46:28.854752 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 445/840] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:28 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:28.867898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64908a65-02b2-4b37-aca0-cea26e292bf6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:28.874632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64908a65-02b2-4b37-aca0-cea26e292bf6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:28.894280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64908a65-02b2-4b37-aca0-cea26e292bf6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:28.896850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64908a65-02b2-4b37-aca0-cea26e292bf6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:28.899366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64908a65-02b2-4b37-aca0-cea26e292bf6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:28.901682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64908a65-02b2-4b37-aca0-cea26e292bf6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:29.056212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64908a65-02b2-4b37-aca0-cea26e292bf6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:29.073107 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64908a65-02b2-4b37-aca0-cea26e292bf6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1275 microversion: 2.1 time: 0.214486 Jul 26 19:46:29.074524 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 446/841] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:28 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:29.081102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e638fae3-c9a1-440c-90b0-2fcf7a55c441 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:29.081753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e638fae3-c9a1-440c-90b0-2fcf7a55c441 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:29.089552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e638fae3-c9a1-440c-90b0-2fcf7a55c441 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:29.090312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e638fae3-c9a1-440c-90b0-2fcf7a55c441 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:29.091327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e638fae3-c9a1-440c-90b0-2fcf7a55c441 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:29.103977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e638fae3-c9a1-440c-90b0-2fcf7a55c441 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:29.191196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e638fae3-c9a1-440c-90b0-2fcf7a55c441 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:29.195838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:29.202393 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e638fae3-c9a1-440c-90b0-2fcf7a55c441 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1229 microversion: 2.1 time: 0.127291 Jul 26 19:46:29.204846 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 447/842] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:29 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:29.319687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:29.321515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:29.322142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:29.322694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:29.323259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:29.342666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:29.343377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:29.344374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:29.348036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:29.393983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for project 3d10540a08974fd0854fea20ae5c216b. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:46:29.408313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for user ccd551ea4e0641a0bf17d669481136fa and project 3d10540a08974fd0854fea20ae5c216b. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:46:29.456491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:46:29.463442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:46:29.620458 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e04f1ef8-eacf-4fa5-8b1b-f184f8054a9d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.785005 Jul 26 19:46:29.631045 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 396/843] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3800 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 19:46:29.646169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-92044aed-897d-4ff7-b44f-4b74b221ca05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:29.646808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92044aed-897d-4ff7-b44f-4b74b221ca05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:29.670498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92044aed-897d-4ff7-b44f-4b74b221ca05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:29.670961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92044aed-897d-4ff7-b44f-4b74b221ca05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:29.683518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92044aed-897d-4ff7-b44f-4b74b221ca05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:29.684040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92044aed-897d-4ff7-b44f-4b74b221ca05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:29.705772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1142533163", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d609008d-caf9-4f78-8a5e-41e510179ad2"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:29.847350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] validate_networks() for [('d609008d-caf9-4f78-8a5e-41e510179ad2', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:46:30.110405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-92044aed-897d-4ff7-b44f-4b74b221ca05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:30.119843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-92044aed-897d-4ff7-b44f-4b74b221ca05 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1318 microversion: 2.1 time: 0.487427 Jul 26 19:46:30.124481 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 397/844] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:29 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:30.135897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b0d3a0ed-c60a-4c9b-ade3-33063161cd13 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:30.139234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b0d3a0ed-c60a-4c9b-ade3-33063161cd13 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:30.272300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0d3a0ed-c60a-4c9b-ade3-33063161cd13 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:30.290978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0d3a0ed-c60a-4c9b-ade3-33063161cd13 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:30.297822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0d3a0ed-c60a-4c9b-ade3-33063161cd13 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:30.303941 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b0d3a0ed-c60a-4c9b-ade3-33063161cd13 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1261 microversion: 2.25 time: 0.171992 Jul 26 19:46:30.306897 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 398/845] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:30 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:30.337182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-78410f47-13d4-4402-a425-83938415ad02 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bcce208-f078-48e1-9355-74105d85341e"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:30.344883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-78410f47-13d4-4402-a425-83938415ad02 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:30.370205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78410f47-13d4-4402-a425-83938415ad02 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:30.372012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78410f47-13d4-4402-a425-83938415ad02 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:30.374456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78410f47-13d4-4402-a425-83938415ad02 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:30.379696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78410f47-13d4-4402-a425-83938415ad02 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:31.065058 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-78410f47-13d4-4402-a425-83938415ad02 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "POST /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740499 Jul 26 19:46:31.080302 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 399/846] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 19:46:30 2022] POST /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:31.098580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02897a6e-8d71-487b-9598-1e9e2948e5c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:31.099303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02897a6e-8d71-487b-9598-1e9e2948e5c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:31.126149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02897a6e-8d71-487b-9598-1e9e2948e5c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:31.127030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02897a6e-8d71-487b-9598-1e9e2948e5c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:31.137182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02897a6e-8d71-487b-9598-1e9e2948e5c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:31.137716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02897a6e-8d71-487b-9598-1e9e2948e5c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:31.803490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:31.804221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:31.804777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:31.805458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:31.805944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:31.823189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:31.824077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:31.825931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:31.826720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:31.872827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:46:31.882510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for user 4e8808ff2c4341eca66334700ec25a82 and project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:46:31.919575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:46:31.927216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:46:32.014904 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-046249a6-e374-4599-a3cb-be86292e3a76 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.806829 Jul 26 19:46:32.017364 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 448/847] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:46:32.027892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-001e56df-1c45-4c45-b746-2ff8646e98dd tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:32.033028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-001e56df-1c45-4c45-b746-2ff8646e98dd tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:32.048527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-001e56df-1c45-4c45-b746-2ff8646e98dd tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:32.049344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-001e56df-1c45-4c45-b746-2ff8646e98dd tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:32.050340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-001e56df-1c45-4c45-b746-2ff8646e98dd tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:32.051056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-001e56df-1c45-4c45-b746-2ff8646e98dd tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:32.063788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02897a6e-8d71-487b-9598-1e9e2948e5c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:32.076442 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02897a6e-8d71-487b-9598-1e9e2948e5c2 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.994234 Jul 26 19:46:32.077240 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 400/848] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:31 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:32.088548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5dd42235-6119-45fa-b503-061b29172501 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:32.089167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5dd42235-6119-45fa-b503-061b29172501 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:32.132681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dd42235-6119-45fa-b503-061b29172501 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:32.133613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dd42235-6119-45fa-b503-061b29172501 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:32.134626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dd42235-6119-45fa-b503-061b29172501 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:32.135234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dd42235-6119-45fa-b503-061b29172501 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:32.377551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5dd42235-6119-45fa-b503-061b29172501 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:32.388622 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5dd42235-6119-45fa-b503-061b29172501 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1283 microversion: 2.1 time: 0.303750 Jul 26 19:46:32.389225 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 401/849] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:32 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1283 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:32.494300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-001e56df-1c45-4c45-b746-2ff8646e98dd tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:32.502513 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-001e56df-1c45-4c45-b746-2ff8646e98dd tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1317 microversion: 2.1 time: 0.483273 Jul 26 19:46:32.503103 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 449/850] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:32 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:32.518386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-910b8fbc-7546-4cfc-8eea-c2c140b2c5c6 req-0189d8e6-fdf6-4dd3-b5c9-0e79062224e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9a3004-dc44-4bfc-926a-3f0ed3e29227", "name": "network-vif-plugged", "status": "completed", "tag": "d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:32.548314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-910b8fbc-7546-4cfc-8eea-c2c140b2c5c6 req-0189d8e6-fdf6-4dd3-b5c9-0e79062224e5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:32.549934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-910b8fbc-7546-4cfc-8eea-c2c140b2c5c6 req-0189d8e6-fdf6-4dd3-b5c9-0e79062224e5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:32.584490 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-910b8fbc-7546-4cfc-8eea-c2c140b2c5c6 req-0189d8e6-fdf6-4dd3-b5c9-0e79062224e5 service nova] Creating event network-vif-plugged:d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134 for instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 on n-h2-708768-8 Jul 26 19:46:32.591347 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-910b8fbc-7546-4cfc-8eea-c2c140b2c5c6 req-0189d8e6-fdf6-4dd3-b5c9-0e79062224e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083692 Jul 26 19:46:32.592606 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 450/851] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:32.610856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5dfa5fbd-df21-48fa-a549-b1b7883246c1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:32.612549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5dfa5fbd-df21-48fa-a549-b1b7883246c1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:32.636660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dfa5fbd-df21-48fa-a549-b1b7883246c1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:32.638502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dfa5fbd-df21-48fa-a549-b1b7883246c1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:32.639526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dfa5fbd-df21-48fa-a549-b1b7883246c1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:32.643196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dfa5fbd-df21-48fa-a549-b1b7883246c1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:32.684595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-433045935", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:32.826341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:46:33.287001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5dfa5fbd-df21-48fa-a549-b1b7883246c1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:33.311747 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5dfa5fbd-df21-48fa-a549-b1b7883246c1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1318 microversion: 2.1 time: 0.716983 Jul 26 19:46:33.316719 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 451/852] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:32 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:33.336126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:33.338720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:33.352394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.352867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.353632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.354066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.524342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:33.535231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:33.537472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:33.539111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:33.539648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:33.540232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:33.540736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:33.541246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:33.545380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5128c651-0591-4d3b-b3f5-82952e2285be tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1319 microversion: 2.25 time: 0.226876 Jul 26 19:46:33.558766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.559410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.560023 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 452/853] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:33 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:33.560640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.561084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.568377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d66de714-c80b-449c-b534-c249460db1f6 req-dd70e1d2-5fa7-442e-a3db-9500e30b2555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d333b0d1-5d1d-4fca-b799-4c09de618fe5", "tag": "6b7fa96b-4af3-4be9-907a-4439a733da62"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:33.579468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d66de714-c80b-449c-b534-c249460db1f6 req-dd70e1d2-5fa7-442e-a3db-9500e30b2555 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.580275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d66de714-c80b-449c-b534-c249460db1f6 req-dd70e1d2-5fa7-442e-a3db-9500e30b2555 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.600193 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d66de714-c80b-449c-b534-c249460db1f6 req-dd70e1d2-5fa7-442e-a3db-9500e30b2555 service nova] Creating event network-changed:6b7fa96b-4af3-4be9-907a-4439a733da62 for instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 on n-h2-708768-8 Jul 26 19:46:33.603979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Getting quotas for project 6113ee63ec934bc0b5d4eb9964635785. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:46:33.606676 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d66de714-c80b-449c-b534-c249460db1f6 req-dd70e1d2-5fa7-442e-a3db-9500e30b2555 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044671 Jul 26 19:46:33.609014 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 453/854] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:33.618247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Getting quotas for user ee2737b46af94ceea33cdd0255db0c7a and project 6113ee63ec934bc0b5d4eb9964635785. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:46:33.622646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3f0ed23-ec4c-4872-a24c-ea4afe85ec49 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:33.624905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a3f0ed23-ec4c-4872-a24c-ea4afe85ec49 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:33.638430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3f0ed23-ec4c-4872-a24c-ea4afe85ec49 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.641554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3f0ed23-ec4c-4872-a24c-ea4afe85ec49 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.642619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3f0ed23-ec4c-4872-a24c-ea4afe85ec49 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.645876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3f0ed23-ec4c-4872-a24c-ea4afe85ec49 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.649875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:46:33.652511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:46:33.749212 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0241833c-2ab8-4a63-adef-3853e59d2188 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358910 Jul 26 19:46:33.752214 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 402/855] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:46:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:46:33.763389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d823326-c765-48a2-9efc-98e22221e455 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:33.772595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d823326-c765-48a2-9efc-98e22221e455 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:33.802961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d823326-c765-48a2-9efc-98e22221e455 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.804030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d823326-c765-48a2-9efc-98e22221e455 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.807079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d823326-c765-48a2-9efc-98e22221e455 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.809250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d823326-c765-48a2-9efc-98e22221e455 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.828520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3f0ed23-ec4c-4872-a24c-ea4afe85ec49 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:33.838051 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3f0ed23-ec4c-4872-a24c-ea4afe85ec49 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1267 microversion: 2.1 time: 0.227577 Jul 26 19:46:33.838649 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 454/856] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:33 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:33.848871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-527b5ee5-9c6e-4b79-bdcd-6b90919445e6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:33.854019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-527b5ee5-9c6e-4b79-bdcd-6b90919445e6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:33.868689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-527b5ee5-9c6e-4b79-bdcd-6b90919445e6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.869538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-527b5ee5-9c6e-4b79-bdcd-6b90919445e6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:33.870532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-527b5ee5-9c6e-4b79-bdcd-6b90919445e6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:33.871205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-527b5ee5-9c6e-4b79-bdcd-6b90919445e6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:34.291640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-527b5ee5-9c6e-4b79-bdcd-6b90919445e6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:34.311476 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-527b5ee5-9c6e-4b79-bdcd-6b90919445e6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.460678 Jul 26 19:46:34.312166 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 455/857] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:33 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:34.328651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0f09f657-9728-4bed-bc80-8473905f440d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:34.329289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0f09f657-9728-4bed-bc80-8473905f440d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:34.352884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f09f657-9728-4bed-bc80-8473905f440d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:34.358526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f09f657-9728-4bed-bc80-8473905f440d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:34.359465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f09f657-9728-4bed-bc80-8473905f440d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:34.359941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f09f657-9728-4bed-bc80-8473905f440d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:34.424925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d823326-c765-48a2-9efc-98e22221e455 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:34.434221 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d823326-c765-48a2-9efc-98e22221e455 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1473 microversion: 2.1 time: 0.675433 Jul 26 19:46:34.450162 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 403/858] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:33 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1473 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:34.458099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c52247e9-c77c-490f-9b73-cd6e455c917d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:34.472644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c52247e9-c77c-490f-9b73-cd6e455c917d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:34.650348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c52247e9-c77c-490f-9b73-cd6e455c917d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:34.662533 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c52247e9-c77c-490f-9b73-cd6e455c917d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1219 microversion: 2.1 time: 0.207639 Jul 26 19:46:34.663660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 404/859] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:34 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:34.677950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e780966e-bdaf-48a3-a0e0-453b2ab9abb3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:34.681004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e780966e-bdaf-48a3-a0e0-453b2ab9abb3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:34.702720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e780966e-bdaf-48a3-a0e0-453b2ab9abb3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:34.705440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e780966e-bdaf-48a3-a0e0-453b2ab9abb3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:34.709708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e780966e-bdaf-48a3-a0e0-453b2ab9abb3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:34.710163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e780966e-bdaf-48a3-a0e0-453b2ab9abb3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:34.784302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0f09f657-9728-4bed-bc80-8473905f440d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:34.795826 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0f09f657-9728-4bed-bc80-8473905f440d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1317 microversion: 2.1 time: 0.482418 Jul 26 19:46:34.799389 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 456/860] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:34 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:34.819744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:34.820389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:34.836883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:34.837339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:34.838128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:34.838567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:34.967705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e780966e-bdaf-48a3-a0e0-453b2ab9abb3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:34.981882 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e780966e-bdaf-48a3-a0e0-453b2ab9abb3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1318 microversion: 2.1 time: 0.316918 Jul 26 19:46:34.986246 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 405/861] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:34 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:34.993367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5ddf8a49-c473-48f2-94b4-555819d945b2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:34.993923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5ddf8a49-c473-48f2-94b4-555819d945b2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:35.003924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ddf8a49-c473-48f2-94b4-555819d945b2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:35.005235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ddf8a49-c473-48f2-94b4-555819d945b2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:35.006387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ddf8a49-c473-48f2-94b4-555819d945b2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:35.006995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ddf8a49-c473-48f2-94b4-555819d945b2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:35.096525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5ddf8a49-c473-48f2-94b4-555819d945b2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:35.108810 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5ddf8a49-c473-48f2-94b4-555819d945b2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1285 microversion: 2.1 time: 0.121425 Jul 26 19:46:35.109792 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 406/862] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:34 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:35.138753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:35.153429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b0150fb3-d27c-45bb-9fd9-f5c58e76cce0 req-574ea030-9a7a-40e5-a631-8e6247d34bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f91a2c0b-cbe3-4c61-ae77-6878c69fd643", "tag": "36b30dac-cbda-4a1f-8d27-44b3ec8f9014"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:35.157533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:35.159977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:35.161938 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-800d633d-6a37-4779-85c6-05f7af5c257e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.361293 Jul 26 19:46:35.163091 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 457/863] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:34 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:35.194667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b0150fb3-d27c-45bb-9fd9-f5c58e76cce0 req-574ea030-9a7a-40e5-a631-8e6247d34bd4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:35.195372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b0150fb3-d27c-45bb-9fd9-f5c58e76cce0 req-574ea030-9a7a-40e5-a631-8e6247d34bd4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:35.228485 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b0150fb3-d27c-45bb-9fd9-f5c58e76cce0 req-574ea030-9a7a-40e5-a631-8e6247d34bd4 service nova] Creating event network-changed:36b30dac-cbda-4a1f-8d27-44b3ec8f9014 for instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 on n-h1-708768-8 Jul 26 19:46:35.246579 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b0150fb3-d27c-45bb-9fd9-f5c58e76cce0 req-574ea030-9a7a-40e5-a631-8e6247d34bd4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134755 Jul 26 19:46:35.253404 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 407/864] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:35.339930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-35443587-8111-43e3-9629-85ffc3015946 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:35.342459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-35443587-8111-43e3-9629-85ffc3015946 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:35.368741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35443587-8111-43e3-9629-85ffc3015946 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:35.369389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35443587-8111-43e3-9629-85ffc3015946 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:35.370338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35443587-8111-43e3-9629-85ffc3015946 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:35.370883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35443587-8111-43e3-9629-85ffc3015946 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:35.469837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5df50450-c2a2-4f92-889c-93cbb2d1369b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:35.470792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5df50450-c2a2-4f92-889c-93cbb2d1369b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:35.484142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5df50450-c2a2-4f92-889c-93cbb2d1369b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:35.484848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5df50450-c2a2-4f92-889c-93cbb2d1369b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:35.485834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5df50450-c2a2-4f92-889c-93cbb2d1369b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:35.486455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5df50450-c2a2-4f92-889c-93cbb2d1369b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.072317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-35443587-8111-43e3-9629-85ffc3015946 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.081961 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-35443587-8111-43e3-9629-85ffc3015946 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.748287 Jul 26 19:46:36.083551 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 458/865] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:35 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:36.088820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24771b2f-d4a9-4c5d-9cd5-0968dcbde858 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:36.089734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-24771b2f-d4a9-4c5d-9cd5-0968dcbde858 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:36.096781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24771b2f-d4a9-4c5d-9cd5-0968dcbde858 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.097821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24771b2f-d4a9-4c5d-9cd5-0968dcbde858 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.098961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24771b2f-d4a9-4c5d-9cd5-0968dcbde858 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.099279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24771b2f-d4a9-4c5d-9cd5-0968dcbde858 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.169190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24771b2f-d4a9-4c5d-9cd5-0968dcbde858 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.177851 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-24771b2f-d4a9-4c5d-9cd5-0968dcbde858 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1271 microversion: 2.1 time: 0.092945 Jul 26 19:46:36.178737 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 459/866] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:36 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:36.196446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d92bf481-f3a9-4771-90b2-f93aa0e294bb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:36.197167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d92bf481-f3a9-4771-90b2-f93aa0e294bb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:36.199629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:36.209408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d92bf481-f3a9-4771-90b2-f93aa0e294bb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.209969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d92bf481-f3a9-4771-90b2-f93aa0e294bb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.210824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d92bf481-f3a9-4771-90b2-f93aa0e294bb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.212379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d92bf481-f3a9-4771-90b2-f93aa0e294bb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.430790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d92bf481-f3a9-4771-90b2-f93aa0e294bb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.439935 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d92bf481-f3a9-4771-90b2-f93aa0e294bb tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1317 microversion: 2.1 time: 0.259665 Jul 26 19:46:36.440715 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 460/867] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:36 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:36.456626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1c9585c-46ed-49dd-80f9-fdb1e0c78db5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:36.457799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1c9585c-46ed-49dd-80f9-fdb1e0c78db5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:36.467898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c9585c-46ed-49dd-80f9-fdb1e0c78db5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.468563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c9585c-46ed-49dd-80f9-fdb1e0c78db5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.469503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c9585c-46ed-49dd-80f9-fdb1e0c78db5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.470092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c9585c-46ed-49dd-80f9-fdb1e0c78db5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.517664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5df50450-c2a2-4f92-889c-93cbb2d1369b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.531462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5df50450-c2a2-4f92-889c-93cbb2d1369b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1491 microversion: 2.1 time: 1.065975 Jul 26 19:46:36.539189 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 408/868] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:35 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1491 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:36.544461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-512e7d88-aa32-4745-acc6-be1a71c0893e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:36.545299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-512e7d88-aa32-4745-acc6-be1a71c0893e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:36.564456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-512e7d88-aa32-4745-acc6-be1a71c0893e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.569121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-512e7d88-aa32-4745-acc6-be1a71c0893e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.570314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-512e7d88-aa32-4745-acc6-be1a71c0893e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.580314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-512e7d88-aa32-4745-acc6-be1a71c0893e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.645114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1c9585c-46ed-49dd-80f9-fdb1e0c78db5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.653995 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1c9585c-46ed-49dd-80f9-fdb1e0c78db5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1507 microversion: 2.1 time: 0.211831 Jul 26 19:46:36.655153 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 461/869] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:36 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:36.661366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:36.662358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:36.669434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.670098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.671035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.672173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.744901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-512e7d88-aa32-4745-acc6-be1a71c0893e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.758224 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-512e7d88-aa32-4745-acc6-be1a71c0893e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1273 microversion: 2.1 time: 0.213780 Jul 26 19:46:36.758853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 409/870] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:36 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:36.776743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-830c1ff3-4d81-47a9-82f3-aae0ccfd7c17 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:36.780962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-830c1ff3-4d81-47a9-82f3-aae0ccfd7c17 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:36.799823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-830c1ff3-4d81-47a9-82f3-aae0ccfd7c17 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.800318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-830c1ff3-4d81-47a9-82f3-aae0ccfd7c17 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.803303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-830c1ff3-4d81-47a9-82f3-aae0ccfd7c17 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:36.803783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-830c1ff3-4d81-47a9-82f3-aae0ccfd7c17 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:36.943795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.964510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.966864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:36.968751 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dee2dd9c-bd92-45a8-a666-9797a18c52cc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.312223 Jul 26 19:46:36.984746 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 462/871] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:36 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:37.105369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9876b9ea-8b1d-4c1d-bafe-552b5611dca2 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:37.105954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9876b9ea-8b1d-4c1d-bafe-552b5611dca2 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:37.115055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9876b9ea-8b1d-4c1d-bafe-552b5611dca2 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.115923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9876b9ea-8b1d-4c1d-bafe-552b5611dca2 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.116301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9876b9ea-8b1d-4c1d-bafe-552b5611dca2 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.116732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9876b9ea-8b1d-4c1d-bafe-552b5611dca2 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.410193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-830c1ff3-4d81-47a9-82f3-aae0ccfd7c17 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:37.424156 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-830c1ff3-4d81-47a9-82f3-aae0ccfd7c17 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1507 microversion: 2.1 time: 0.662003 Jul 26 19:46:37.425447 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 410/872] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:36 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1507 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:37.438426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a98063a-3c20-4925-8ce4-32907bf186d6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:37.442035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a98063a-3c20-4925-8ce4-32907bf186d6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:37.458104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a98063a-3c20-4925-8ce4-32907bf186d6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.459284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a98063a-3c20-4925-8ce4-32907bf186d6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.460429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a98063a-3c20-4925-8ce4-32907bf186d6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.461924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a98063a-3c20-4925-8ce4-32907bf186d6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.499443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:37.577580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9876b9ea-8b1d-4c1d-bafe-552b5611dca2 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:37.587955 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9876b9ea-8b1d-4c1d-bafe-552b5611dca2 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.486449 Jul 26 19:46:37.588542 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 463/873] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:37 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:37.594293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-71a7e746-17e1-4cc4-9a2b-2d17654a1d93 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:37.600363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-71a7e746-17e1-4cc4-9a2b-2d17654a1d93 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:37.605382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9a98063a-3c20-4925-8ce4-32907bf186d6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:37.617869 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a98063a-3c20-4925-8ce4-32907bf186d6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1277 microversion: 2.1 time: 0.189795 Jul 26 19:46:37.619034 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 411/874] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:37 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:37.622051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71a7e746-17e1-4cc4-9a2b-2d17654a1d93 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.622506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71a7e746-17e1-4cc4-9a2b-2d17654a1d93 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.623299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71a7e746-17e1-4cc4-9a2b-2d17654a1d93 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.623776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71a7e746-17e1-4cc4-9a2b-2d17654a1d93 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.629827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8f6862bf-1da9-4ed3-8673-ac048f42b87f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:37.632045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8f6862bf-1da9-4ed3-8673-ac048f42b87f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:37.649834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f6862bf-1da9-4ed3-8673-ac048f42b87f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.650512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f6862bf-1da9-4ed3-8673-ac048f42b87f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.651732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f6862bf-1da9-4ed3-8673-ac048f42b87f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.652398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f6862bf-1da9-4ed3-8673-ac048f42b87f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.742031 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-71a7e746-17e1-4cc4-9a2b-2d17654a1d93 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "PUT /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1079 microversion: 2.1 time: 0.152180 Jul 26 19:46:37.742694 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 464/875] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 19:46:37 2022] PUT /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1079 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:37.757261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b87f0613-366c-474e-9339-7187bfd86272 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:37.757892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b87f0613-366c-474e-9339-7187bfd86272 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:37.772454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b87f0613-366c-474e-9339-7187bfd86272 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.773126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b87f0613-366c-474e-9339-7187bfd86272 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:37.775135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b87f0613-366c-474e-9339-7187bfd86272 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:37.777028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b87f0613-366c-474e-9339-7187bfd86272 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.061491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f6862bf-1da9-4ed3-8673-ac048f42b87f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:38.073535 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8f6862bf-1da9-4ed3-8673-ac048f42b87f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1317 microversion: 2.1 time: 0.451013 Jul 26 19:46:38.074081 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 412/876] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:37 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:38.080293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ee3fa37-969c-4161-a20a-961e439ffdfa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:38.080293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ee3fa37-969c-4161-a20a-961e439ffdfa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:38.087341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ee3fa37-969c-4161-a20a-961e439ffdfa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.087861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ee3fa37-969c-4161-a20a-961e439ffdfa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.088618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ee3fa37-969c-4161-a20a-961e439ffdfa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.089058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ee3fa37-969c-4161-a20a-961e439ffdfa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.096797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b87f0613-366c-474e-9339-7187bfd86272 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:38.100472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:38.105537 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b87f0613-366c-474e-9339-7187bfd86272 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1479 microversion: 2.1 time: 0.357727 Jul 26 19:46:38.115038 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 465/877] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:37 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1479 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:38.123095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ebdf1b47-e87d-4f58-8797-2b77ca274550 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:38.123732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ebdf1b47-e87d-4f58-8797-2b77ca274550 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:38.142270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebdf1b47-e87d-4f58-8797-2b77ca274550 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.142730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebdf1b47-e87d-4f58-8797-2b77ca274550 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.147456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebdf1b47-e87d-4f58-8797-2b77ca274550 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.148134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebdf1b47-e87d-4f58-8797-2b77ca274550 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.373108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ebdf1b47-e87d-4f58-8797-2b77ca274550 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:38.387086 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ebdf1b47-e87d-4f58-8797-2b77ca274550 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.269855 Jul 26 19:46:38.387919 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 466/878] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:38 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:38.393723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f0c67c89-988a-46a9-bed2-2eeae5942e5a req-d7ca828e-90f8-4ab7-9055-f09b48b1bbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d333b0d1-5d1d-4fca-b799-4c09de618fe5", "name": "network-vif-plugged", "status": "completed", "tag": "6b7fa96b-4af3-4be9-907a-4439a733da62"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:38.421367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f0c67c89-988a-46a9-bed2-2eeae5942e5a req-d7ca828e-90f8-4ab7-9055-f09b48b1bbf6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.432407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f0c67c89-988a-46a9-bed2-2eeae5942e5a req-d7ca828e-90f8-4ab7-9055-f09b48b1bbf6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.455047 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f0c67c89-988a-46a9-bed2-2eeae5942e5a req-d7ca828e-90f8-4ab7-9055-f09b48b1bbf6 service nova] Creating event network-vif-plugged:6b7fa96b-4af3-4be9-907a-4439a733da62 for instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 on n-h2-708768-8 Jul 26 19:46:38.465480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ee3fa37-969c-4161-a20a-961e439ffdfa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:38.468085 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f0c67c89-988a-46a9-bed2-2eeae5942e5a req-d7ca828e-90f8-4ab7-9055-f09b48b1bbf6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078751 Jul 26 19:46:38.468889 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 467/879] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:38.475090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:38.481148 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ee3fa37-969c-4161-a20a-961e439ffdfa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1505 microversion: 2.1 time: 0.405992 Jul 26 19:46:38.483842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:38.492319 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 413/880] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:38 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:38.494323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.497349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.498330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.498770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.522036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fcaa73c1-501b-476e-9367-df660d04a571 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:38.523530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fcaa73c1-501b-476e-9367-df660d04a571 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:38.553939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fcaa73c1-501b-476e-9367-df660d04a571 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.555219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fcaa73c1-501b-476e-9367-df660d04a571 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.555931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fcaa73c1-501b-476e-9367-df660d04a571 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.556520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fcaa73c1-501b-476e-9367-df660d04a571 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.837775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:38.858550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:38.860902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:38.871541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-503765e3-9fe1-4775-a27d-9aff6c09e3e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.401182 Jul 26 19:46:38.872862 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 468/881] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:38 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:38.878423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f9ccfca7-fb18-44e6-a446-6f839ffbd7a7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:38.879711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f9ccfca7-fb18-44e6-a446-6f839ffbd7a7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:38.888640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9ccfca7-fb18-44e6-a446-6f839ffbd7a7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.889344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9ccfca7-fb18-44e6-a446-6f839ffbd7a7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:38.891873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9ccfca7-fb18-44e6-a446-6f839ffbd7a7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:38.892587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9ccfca7-fb18-44e6-a446-6f839ffbd7a7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.007052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fcaa73c1-501b-476e-9367-df660d04a571 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:39.015819 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fcaa73c1-501b-476e-9367-df660d04a571 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1505 microversion: 2.1 time: 0.507194 Jul 26 19:46:39.016806 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 414/882] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:38 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:39.022739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1fa088cb-3c42-410b-8151-074122bb662e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:39.023571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1fa088cb-3c42-410b-8151-074122bb662e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:39.033036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fa088cb-3c42-410b-8151-074122bb662e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.033695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fa088cb-3c42-410b-8151-074122bb662e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.034663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fa088cb-3c42-410b-8151-074122bb662e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.035097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fa088cb-3c42-410b-8151-074122bb662e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.210861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f9ccfca7-fb18-44e6-a446-6f839ffbd7a7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:39.238327 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f9ccfca7-fb18-44e6-a446-6f839ffbd7a7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.364125 Jul 26 19:46:39.239459 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 469/883] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:38 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:39.244105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7857a6ab-607b-4328-94ec-11df5852b371 req-f605a62d-82f3-4eb5-9b3a-188c1f8dacd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3", "tag": "3f861fc9-a37c-4773-a6a3-1162bda6dcd8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:39.259475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7857a6ab-607b-4328-94ec-11df5852b371 req-f605a62d-82f3-4eb5-9b3a-188c1f8dacd0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.259958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7857a6ab-607b-4328-94ec-11df5852b371 req-f605a62d-82f3-4eb5-9b3a-188c1f8dacd0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.288653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7857a6ab-607b-4328-94ec-11df5852b371 req-f605a62d-82f3-4eb5-9b3a-188c1f8dacd0 service nova] Creating event network-changed:3f861fc9-a37c-4773-a6a3-1162bda6dcd8 for instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 on n-h1-708768-8 Jul 26 19:46:39.301939 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7857a6ab-607b-4328-94ec-11df5852b371 req-f605a62d-82f3-4eb5-9b3a-188c1f8dacd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060528 Jul 26 19:46:39.303102 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 470/884] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:39.311044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:39.315702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:39.325026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.325706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.326642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.327230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.520101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:39.520741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:39.521405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:39.522694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:39.523267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:39.552008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1fa088cb-3c42-410b-8151-074122bb662e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:39.562862 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1fa088cb-3c42-410b-8151-074122bb662e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1319 microversion: 2.1 time: 0.544820 Jul 26 19:46:39.565791 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 415/885] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:39 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:39.577565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b28e6b3d-d053-4e5d-9332-0574adbaa926 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:39.578367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b28e6b3d-d053-4e5d-9332-0574adbaa926 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:39.591372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b28e6b3d-d053-4e5d-9332-0574adbaa926 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.594375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b28e6b3d-d053-4e5d-9332-0574adbaa926 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.595359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b28e6b3d-d053-4e5d-9332-0574adbaa926 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.596969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b28e6b3d-d053-4e5d-9332-0574adbaa926 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.633981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:39.652298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.653815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.655758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.657679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.747687 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0622d7e-f624-47d5-ac0f-90e010d247a2 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "POST /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227/action" status: 202 len: 1111 microversion: 2.1 time: 0.436176 Jul 26 19:46:39.748216 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 471/886] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:46:39 2022] POST /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227/action => generated 1111 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 19:46:39.760727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd216200-e220-40f3-8480-7ee6bb4e7075 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:39.769334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd216200-e220-40f3-8480-7ee6bb4e7075 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:39.796491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd216200-e220-40f3-8480-7ee6bb4e7075 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.797032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd216200-e220-40f3-8480-7ee6bb4e7075 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:39.797876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd216200-e220-40f3-8480-7ee6bb4e7075 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:39.798324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd216200-e220-40f3-8480-7ee6bb4e7075 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.039896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b28e6b3d-d053-4e5d-9332-0574adbaa926 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:40.048864 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b28e6b3d-d053-4e5d-9332-0574adbaa926 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1317 microversion: 2.1 time: 0.481840 Jul 26 19:46:40.064256 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 416/887] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:39 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:40.075556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ffcb5117-ef11-4e45-8c32-bcea929ee590 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:40.078035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ffcb5117-ef11-4e45-8c32-bcea929ee590 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:40.095360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffcb5117-ef11-4e45-8c32-bcea929ee590 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:40.096029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffcb5117-ef11-4e45-8c32-bcea929ee590 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.099450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffcb5117-ef11-4e45-8c32-bcea929ee590 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:40.100259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffcb5117-ef11-4e45-8c32-bcea929ee590 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.343484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd216200-e220-40f3-8480-7ee6bb4e7075 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:40.368169 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd216200-e220-40f3-8480-7ee6bb4e7075 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1464 microversion: 2.1 time: 0.613846 Jul 26 19:46:40.368815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 472/888] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:39 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1464 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:40.388546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d990b2d2-6f3b-4c01-8c22-5a2cfeae8f4a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:40.389441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d990b2d2-6f3b-4c01-8c22-5a2cfeae8f4a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:40.401173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d990b2d2-6f3b-4c01-8c22-5a2cfeae8f4a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:40.405595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d990b2d2-6f3b-4c01-8c22-5a2cfeae8f4a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.406422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d990b2d2-6f3b-4c01-8c22-5a2cfeae8f4a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:40.406864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d990b2d2-6f3b-4c01-8c22-5a2cfeae8f4a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.633794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ffcb5117-ef11-4e45-8c32-bcea929ee590 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:40.665281 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ffcb5117-ef11-4e45-8c32-bcea929ee590 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.596952 Jul 26 19:46:40.666849 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 417/889] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:40 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:40.682579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d990b2d2-6f3b-4c01-8c22-5a2cfeae8f4a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:40.692521 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d990b2d2-6f3b-4c01-8c22-5a2cfeae8f4a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.319960 Jul 26 19:46:40.692924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 473/890] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:40 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:40.707923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54e3014e-0eb5-49c0-849a-4017537ead3f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:40.708966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54e3014e-0eb5-49c0-849a-4017537ead3f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:40.716656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:40.717343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:40.719337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54e3014e-0eb5-49c0-849a-4017537ead3f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:40.725820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54e3014e-0eb5-49c0-849a-4017537ead3f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.728789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54e3014e-0eb5-49c0-849a-4017537ead3f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:40.729280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54e3014e-0eb5-49c0-849a-4017537ead3f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.738269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:40.740247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.740904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:40.745018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:40.983556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-54e3014e-0eb5-49c0-849a-4017537ead3f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:41.000270 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54e3014e-0eb5-49c0-849a-4017537ead3f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.306092 Jul 26 19:46:41.001329 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 474/891] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:40 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:41.007002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f74deda-b4a4-431c-865b-be0fb2e1e0cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:41.011910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5f74deda-b4a4-431c-865b-be0fb2e1e0cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:41.033339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f74deda-b4a4-431c-865b-be0fb2e1e0cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.034538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f74deda-b4a4-431c-865b-be0fb2e1e0cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.037058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f74deda-b4a4-431c-865b-be0fb2e1e0cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.038521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f74deda-b4a4-431c-865b-be0fb2e1e0cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.158147 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f74deda-b4a4-431c-865b-be0fb2e1e0cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action" status: 202 len: 0 microversion: 2.1 time: 0.155490 Jul 26 19:46:41.162814 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 475/892] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:46:41 2022] POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:46:41.173132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0bebf226-efe1-41b4-89e7-ac84c93bf028 req-7a58ac1a-69bd-46b3-a05b-3081b8bd8767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e71b9a-35b2-4a19-af94-4917b75573bb", "name": "network-vif-unplugged", "status": "completed", "tag": "598edcf8-27c7-440a-9784-4e95c216149d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:41.185107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0bebf226-efe1-41b4-89e7-ac84c93bf028 req-7a58ac1a-69bd-46b3-a05b-3081b8bd8767 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.185457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0bebf226-efe1-41b4-89e7-ac84c93bf028 req-7a58ac1a-69bd-46b3-a05b-3081b8bd8767 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.200243 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0bebf226-efe1-41b4-89e7-ac84c93bf028 req-7a58ac1a-69bd-46b3-a05b-3081b8bd8767 service nova] Creating event network-vif-unplugged:598edcf8-27c7-440a-9784-4e95c216149d for instance 21e71b9a-35b2-4a19-af94-4917b75573bb on n-h1-708768-8 Jul 26 19:46:41.208690 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0bebf226-efe1-41b4-89e7-ac84c93bf028 req-7a58ac1a-69bd-46b3-a05b-3081b8bd8767 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044156 Jul 26 19:46:41.214364 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 476/893] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:41.220375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1544fa45-34e1-46dd-bd18-37a3ba4f069a tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:41.221451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1544fa45-34e1-46dd-bd18-37a3ba4f069a tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:41.234747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1544fa45-34e1-46dd-bd18-37a3ba4f069a tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.235499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1544fa45-34e1-46dd-bd18-37a3ba4f069a tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.236391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1544fa45-34e1-46dd-bd18-37a3ba4f069a tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.237066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1544fa45-34e1-46dd-bd18-37a3ba4f069a tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.293332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:41.302681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:41.304259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:41.305564 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a99404b0-9357-44fd-8220-c7c95fdd383e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.635592 Jul 26 19:46:41.306129 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 418/894] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:40 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:41.311067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2abc852e-e906-4b71-abda-64526981ac8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:41.311954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2abc852e-e906-4b71-abda-64526981ac8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:41.318577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2abc852e-e906-4b71-abda-64526981ac8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.320218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2abc852e-e906-4b71-abda-64526981ac8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.322257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2abc852e-e906-4b71-abda-64526981ac8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.322949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2abc852e-e906-4b71-abda-64526981ac8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.390552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1544fa45-34e1-46dd-bd18-37a3ba4f069a tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:41.399054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1544fa45-34e1-46dd-bd18-37a3ba4f069a tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1319 microversion: 2.1 time: 0.183178 Jul 26 19:46:41.399974 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 477/895] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:41 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:41.415249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:41.416155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:41.433512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.433974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.434761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.435254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.480308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2abc852e-e906-4b71-abda-64526981ac8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:41.483930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.483930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.484436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lazy-loading 'fault' on Instance uuid 21e71b9a-35b2-4a19-af94-4917b75573bb {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:41.487899 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2abc852e-e906-4b71-abda-64526981ac8d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1467 microversion: 2.1 time: 0.180586 Jul 26 19:46:41.489553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 419/896] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:41 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1467 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:41.494239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-da7805e6-b798-4d85-b8a3-404d842a3826 req-f45c9859-4aac-47b4-926b-1338374ee8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4cd623-5130-4132-8131-104c912de596", "tag": "94413dac-8742-4fca-bf3d-1477ac482021"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:41.503925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-da7805e6-b798-4d85-b8a3-404d842a3826 req-f45c9859-4aac-47b4-926b-1338374ee8fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.504966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-da7805e6-b798-4d85-b8a3-404d842a3826 req-f45c9859-4aac-47b4-926b-1338374ee8fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.517714 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-da7805e6-b798-4d85-b8a3-404d842a3826 req-f45c9859-4aac-47b4-926b-1338374ee8fe service nova] Creating event network-changed:94413dac-8742-4fca-bf3d-1477ac482021 for instance fb4cd623-5130-4132-8131-104c912de596 on n-h1-708768-8 Jul 26 19:46:41.522736 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-da7805e6-b798-4d85-b8a3-404d842a3826 req-f45c9859-4aac-47b4-926b-1338374ee8fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031771 Jul 26 19:46:41.523711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 420/897] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:41.528983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-23ff62d5-e967-4f88-b284-bd0cdfc8a6bb req-ede72a56-4040-4d84-86bb-b622f2f55902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fe3d9a-2c77-474b-b76c-18e646136479", "tag": "e911674c-dd59-4561-9287-90324fc2f2e7"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:41.538914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-23ff62d5-e967-4f88-b284-bd0cdfc8a6bb req-ede72a56-4040-4d84-86bb-b622f2f55902 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.539576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-23ff62d5-e967-4f88-b284-bd0cdfc8a6bb req-ede72a56-4040-4d84-86bb-b622f2f55902 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.551852 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-23ff62d5-e967-4f88-b284-bd0cdfc8a6bb req-ede72a56-4040-4d84-86bb-b622f2f55902 service nova] Creating event network-changed:e911674c-dd59-4561-9287-90324fc2f2e7 for instance f8fe3d9a-2c77-474b-b76c-18e646136479 on n-h1-708768-8 Jul 26 19:46:41.557161 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-23ff62d5-e967-4f88-b284-bd0cdfc8a6bb req-ede72a56-4040-4d84-86bb-b622f2f55902 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032148 Jul 26 19:46:41.559967 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 421/898] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:41.566674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e72825dc-e701-4f3e-a6fa-6418305abf53 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:41.567913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e72825dc-e701-4f3e-a6fa-6418305abf53 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:41.575387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e72825dc-e701-4f3e-a6fa-6418305abf53 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.576014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e72825dc-e701-4f3e-a6fa-6418305abf53 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.577300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e72825dc-e701-4f3e-a6fa-6418305abf53 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.577730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e72825dc-e701-4f3e-a6fa-6418305abf53 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.630828 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-50800329-c14c-4af4-bd56-112184d256be tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1598 microversion: 2.1 time: 0.229296 Jul 26 19:46:41.631382 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 478/899] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:41 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1598 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:41.662606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-783d5cfb-4fb7-4725-8394-49f777f531cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:41.665106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-783d5cfb-4fb7-4725-8394-49f777f531cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:41.672081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-783d5cfb-4fb7-4725-8394-49f777f531cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.672940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-783d5cfb-4fb7-4725-8394-49f777f531cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.675800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-783d5cfb-4fb7-4725-8394-49f777f531cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.676516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-783d5cfb-4fb7-4725-8394-49f777f531cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.741415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e72825dc-e701-4f3e-a6fa-6418305abf53 tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1618 microversion: 2.1 time: 0.180186 Jul 26 19:46:41.744354 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 422/900] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:41 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1618 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:41.751765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-62864ff4-4fa5-4c95-a155-9ae76a5684af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:41.757716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-62864ff4-4fa5-4c95-a155-9ae76a5684af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:41.781991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62864ff4-4fa5-4c95-a155-9ae76a5684af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.782495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62864ff4-4fa5-4c95-a155-9ae76a5684af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.784681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:41.789837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62864ff4-4fa5-4c95-a155-9ae76a5684af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.790323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62864ff4-4fa5-4c95-a155-9ae76a5684af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.838915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:41.850134 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-783d5cfb-4fb7-4725-8394-49f777f531cf tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action" status: 202 len: 0 microversion: 2.1 time: 0.196985 Jul 26 19:46:41.852029 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 479/901] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:46:41 2022] POST /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:46:41.870911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-25c50b0d-1e25-40a0-b511-e5c0e78c6e76 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:41.876589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-25c50b0d-1e25-40a0-b511-e5c0e78c6e76 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:41.895534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=20 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:41.904491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25c50b0d-1e25-40a0-b511-e5c0e78c6e76 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.907107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25c50b0d-1e25-40a0-b511-e5c0e78c6e76 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:41.908408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25c50b0d-1e25-40a0-b511-e5c0e78c6e76 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:41.911497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25c50b0d-1e25-40a0-b511-e5c0e78c6e76 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:42.314762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62864ff4-4fa5-4c95-a155-9ae76a5684af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:42.329029 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-62864ff4-4fa5-4c95-a155-9ae76a5684af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.582857 Jul 26 19:46:42.342681 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 423/902] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:41 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:42.342681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7e63720d-42ac-4c9d-826f-2ff6f887ce30 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:42.342681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7e63720d-42ac-4c9d-826f-2ff6f887ce30 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:42.356779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e63720d-42ac-4c9d-826f-2ff6f887ce30 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:42.357425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e63720d-42ac-4c9d-826f-2ff6f887ce30 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:42.358295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e63720d-42ac-4c9d-826f-2ff6f887ce30 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:42.358737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e63720d-42ac-4c9d-826f-2ff6f887ce30 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:42.424960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-25c50b0d-1e25-40a0-b511-e5c0e78c6e76 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:42.434151 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-25c50b0d-1e25-40a0-b511-e5c0e78c6e76 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.580874 Jul 26 19:46:42.448040 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 480/903] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:41 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:42.453048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1545206203", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["46c80442-0e57-4d48-bc28-6682ae824154"]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:42.517613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:46:42.661697 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7e63720d-42ac-4c9d-826f-2ff6f887ce30 tempest-ServersAdminTestJSON-9676956 tempest-ServersAdminTestJSON-9676956-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1615 microversion: 2.1 time: 0.328486 Jul 26 19:46:42.662922 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 424/904] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:42 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1615 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:42.670883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bb4bec60-3c9e-4ba4-9f57-82dd827affbc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:42.673539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bb4bec60-3c9e-4ba4-9f57-82dd827affbc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:42.684123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb4bec60-3c9e-4ba4-9f57-82dd827affbc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:42.686134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb4bec60-3c9e-4ba4-9f57-82dd827affbc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:42.687336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb4bec60-3c9e-4ba4-9f57-82dd827affbc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:42.688880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb4bec60-3c9e-4ba4-9f57-82dd827affbc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.004449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bb4bec60-3c9e-4ba4-9f57-82dd827affbc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.012717 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bb4bec60-3c9e-4ba4-9f57-82dd827affbc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.348300 Jul 26 19:46:43.013398 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 425/905] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:42 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:43.018298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:43.019157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:43.030900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.032248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.034039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.034481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.074159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:43.074680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:43.075251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:43.076704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:43.077849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:43.089447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.090403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.091835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.092639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.113190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:46:43.118811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:46:43.133603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:46:43.139140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:46:43.192541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-10620031-1add-480f-9c3a-95e161d6e7d9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742596 Jul 26 19:46:43.198843 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 481/906] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:46:43.198843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af2e1211-a815-4f7e-bb01-410e48de72b0 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:43.199303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af2e1211-a815-4f7e-bb01-410e48de72b0 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:43.205827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af2e1211-a815-4f7e-bb01-410e48de72b0 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.206265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af2e1211-a815-4f7e-bb01-410e48de72b0 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.207033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af2e1211-a815-4f7e-bb01-410e48de72b0 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.207738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af2e1211-a815-4f7e-bb01-410e48de72b0 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.256142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.265543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.267045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.268201 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9dee7e08-66a3-4890-a114-e673524567dc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.253590 Jul 26 19:46:43.268958 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 426/907] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:43 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:43.273906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b2e91437-3bd7-4fa9-96f3-cf929b44f10a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:43.274568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b2e91437-3bd7-4fa9-96f3-cf929b44f10a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:43.281521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2e91437-3bd7-4fa9-96f3-cf929b44f10a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.282165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2e91437-3bd7-4fa9-96f3-cf929b44f10a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.283094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2e91437-3bd7-4fa9-96f3-cf929b44f10a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.283711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2e91437-3bd7-4fa9-96f3-cf929b44f10a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.310315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b2e91437-3bd7-4fa9-96f3-cf929b44f10a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:46:43.364229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:43.368530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-af2e1211-a815-4f7e-bb01-410e48de72b0 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.381127 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af2e1211-a815-4f7e-bb01-410e48de72b0 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1319 microversion: 2.1 time: 0.186270 Jul 26 19:46:43.384492 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 482/908] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:43 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:43.389637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:43.396336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-71021df1-c656-4be6-bf78-dad507abc092 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:43.397467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-71021df1-c656-4be6-bf78-dad507abc092 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:43.414046 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b2e91437-3bd7-4fa9-96f3-cf929b44f10a tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "DELETE /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 204 len: 0 microversion: 2.1 time: 0.143854 Jul 26 19:46:43.414655 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 427/909] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:43 2022] DELETE /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:43.419660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-80ccd2d2-ad38-49b8-a399-9847b03134bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:43.420305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-80ccd2d2-ad38-49b8-a399-9847b03134bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:43.438835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80ccd2d2-ad38-49b8-a399-9847b03134bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.439394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80ccd2d2-ad38-49b8-a399-9847b03134bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.440308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80ccd2d2-ad38-49b8-a399-9847b03134bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.440872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80ccd2d2-ad38-49b8-a399-9847b03134bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.497431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-71021df1-c656-4be6-bf78-dad507abc092 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.504872 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-71021df1-c656-4be6-bf78-dad507abc092 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1217 microversion: 2.1 time: 0.119147 Jul 26 19:46:43.506583 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 483/910] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:43 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:43.511522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-204d4a92-bc82-4cae-908f-228f74bf38c5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:43.512600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-204d4a92-bc82-4cae-908f-228f74bf38c5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:43.519486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-204d4a92-bc82-4cae-908f-228f74bf38c5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.520876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-204d4a92-bc82-4cae-908f-228f74bf38c5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.522031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-204d4a92-bc82-4cae-908f-228f74bf38c5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.522678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-204d4a92-bc82-4cae-908f-228f74bf38c5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.575302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=14 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:43.611657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-80ccd2d2-ad38-49b8-a399-9847b03134bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.619860 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-80ccd2d2-ad38-49b8-a399-9847b03134bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.203983 Jul 26 19:46:43.631660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 428/911] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:43 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:43.631660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9cbaf01f-8083-4db0-a652-dbf70f164396 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:43.631660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9cbaf01f-8083-4db0-a652-dbf70f164396 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:43.635247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cbaf01f-8083-4db0-a652-dbf70f164396 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.638415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cbaf01f-8083-4db0-a652-dbf70f164396 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.639637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cbaf01f-8083-4db0-a652-dbf70f164396 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.640076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cbaf01f-8083-4db0-a652-dbf70f164396 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.772846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-204d4a92-bc82-4cae-908f-228f74bf38c5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.790360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-204d4a92-bc82-4cae-908f-228f74bf38c5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1469 microversion: 2.1 time: 0.282531 Jul 26 19:46:43.791271 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 484/912] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:43 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:43.800239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-22b04136-70ea-4fdb-97cb-1b74fdba069d req-cc898964-8b16-4181-813d-016fe52e12f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e71b9a-35b2-4a19-af94-4917b75573bb", "name": "network-vif-plugged", "status": "completed", "tag": "598edcf8-27c7-440a-9784-4e95c216149d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:43.813612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-22b04136-70ea-4fdb-97cb-1b74fdba069d req-cc898964-8b16-4181-813d-016fe52e12f3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:43.814293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-22b04136-70ea-4fdb-97cb-1b74fdba069d req-cc898964-8b16-4181-813d-016fe52e12f3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:43.816075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9cbaf01f-8083-4db0-a652-dbf70f164396 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:43.826677 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-22b04136-70ea-4fdb-97cb-1b74fdba069d req-cc898964-8b16-4181-813d-016fe52e12f3 service nova] Creating event network-vif-plugged:598edcf8-27c7-440a-9784-4e95c216149d for instance 21e71b9a-35b2-4a19-af94-4917b75573bb on n-h1-708768-8 Jul 26 19:46:43.828412 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9cbaf01f-8083-4db0-a652-dbf70f164396 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.206007 Jul 26 19:46:43.829374 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 429/913] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:43 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:43.849469 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-22b04136-70ea-4fdb-97cb-1b74fdba069d req-cc898964-8b16-4181-813d-016fe52e12f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056931 Jul 26 19:46:43.850409 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 485/914] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:44.037646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0edc1260-b8a1-4a2b-a491-c36a38b96995 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:44.038465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0edc1260-b8a1-4a2b-a491-c36a38b96995 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:44.045074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0edc1260-b8a1-4a2b-a491-c36a38b96995 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.045531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0edc1260-b8a1-4a2b-a491-c36a38b96995 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.046309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0edc1260-b8a1-4a2b-a491-c36a38b96995 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.046765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0edc1260-b8a1-4a2b-a491-c36a38b96995 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.235883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0edc1260-b8a1-4a2b-a491-c36a38b96995 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:44.246727 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0edc1260-b8a1-4a2b-a491-c36a38b96995 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.214043 Jul 26 19:46:44.247723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 430/915] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:44 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:44.294350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:44.295127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:44.303305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.303791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.304657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.305093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.404238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-234e22c5-e351-46fc-bc94-9e2ce4e7fb9f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:44.404910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-234e22c5-e351-46fc-bc94-9e2ce4e7fb9f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:44.412058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-234e22c5-e351-46fc-bc94-9e2ce4e7fb9f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.412532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-234e22c5-e351-46fc-bc94-9e2ce4e7fb9f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.413400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-234e22c5-e351-46fc-bc94-9e2ce4e7fb9f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.413858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-234e22c5-e351-46fc-bc94-9e2ce4e7fb9f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.459199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:44.468252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:44.469997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:44.471755 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1dc38cb-c5b4-480a-8fa2-66d7f46ce423 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.182298 Jul 26 19:46:44.473639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 486/916] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:44 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:44.527159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ba48ede-4d69-4508-a3e7-48e8b99868b5 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:44.528515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ba48ede-4d69-4508-a3e7-48e8b99868b5 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:44.534611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ba48ede-4d69-4508-a3e7-48e8b99868b5 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.535053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ba48ede-4d69-4508-a3e7-48e8b99868b5 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.536575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ba48ede-4d69-4508-a3e7-48e8b99868b5 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.537187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ba48ede-4d69-4508-a3e7-48e8b99868b5 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.605346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ba48ede-4d69-4508-a3e7-48e8b99868b5 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:44.612773 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ba48ede-4d69-4508-a3e7-48e8b99868b5 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1275 microversion: 2.1 time: 0.089695 Jul 26 19:46:44.613343 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 487/917] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:44 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:44.641309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-234e22c5-e351-46fc-bc94-9e2ce4e7fb9f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:44.642578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c5e4c61-dc05-4b0f-8c7c-eed2e5faa052 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:44.643448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6c5e4c61-dc05-4b0f-8c7c-eed2e5faa052 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:44.650097 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-234e22c5-e351-46fc-bc94-9e2ce4e7fb9f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1319 microversion: 2.1 time: 0.250480 Jul 26 19:46:44.653593 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 431/918] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:44 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:44.653741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c5e4c61-dc05-4b0f-8c7c-eed2e5faa052 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.653741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c5e4c61-dc05-4b0f-8c7c-eed2e5faa052 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.653741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c5e4c61-dc05-4b0f-8c7c-eed2e5faa052 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.653741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c5e4c61-dc05-4b0f-8c7c-eed2e5faa052 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.793964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c5e4c61-dc05-4b0f-8c7c-eed2e5faa052 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:44.801562 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c5e4c61-dc05-4b0f-8c7c-eed2e5faa052 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.162868 Jul 26 19:46:44.802366 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 488/919] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:44 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:44.814987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad48b056-880c-4aa0-a653-ac3ca519014b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:44.814987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad48b056-880c-4aa0-a653-ac3ca519014b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:44.816440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=26 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:44.823528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad48b056-880c-4aa0-a653-ac3ca519014b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.824033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad48b056-880c-4aa0-a653-ac3ca519014b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.824831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad48b056-880c-4aa0-a653-ac3ca519014b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.825259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad48b056-880c-4aa0-a653-ac3ca519014b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.852739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-98c0893b-ba09-44ad-8fb4-6da3102459a5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:44.853346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-98c0893b-ba09-44ad-8fb4-6da3102459a5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:44.859381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-98c0893b-ba09-44ad-8fb4-6da3102459a5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.859872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-98c0893b-ba09-44ad-8fb4-6da3102459a5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.860629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-98c0893b-ba09-44ad-8fb4-6da3102459a5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:44.861224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-98c0893b-ba09-44ad-8fb4-6da3102459a5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:44.996719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-98c0893b-ba09-44ad-8fb4-6da3102459a5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:45.004539 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-98c0893b-ba09-44ad-8fb4-6da3102459a5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.155644 Jul 26 19:46:45.005387 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 489/920] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:44 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:45.052974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad48b056-880c-4aa0-a653-ac3ca519014b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:45.060468 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad48b056-880c-4aa0-a653-ac3ca519014b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1469 microversion: 2.1 time: 0.251940 Jul 26 19:46:45.061045 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 432/921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:44 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:45.278643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e3e0e01-7e4d-4fad-87f1-28f4fc83fe11 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:45.279556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9e3e0e01-7e4d-4fad-87f1-28f4fc83fe11 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:45.287256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e3e0e01-7e4d-4fad-87f1-28f4fc83fe11 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.288138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e3e0e01-7e4d-4fad-87f1-28f4fc83fe11 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.289020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e3e0e01-7e4d-4fad-87f1-28f4fc83fe11 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.290131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e3e0e01-7e4d-4fad-87f1-28f4fc83fe11 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.451040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e3e0e01-7e4d-4fad-87f1-28f4fc83fe11 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:45.459988 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e3e0e01-7e4d-4fad-87f1-28f4fc83fe11 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.196025 Jul 26 19:46:45.460685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 490/922] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:45 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:45.494574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:45.495189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:45.501405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.501853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.502847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.503667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.649059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18d5c5fb-c9d2-44ab-b00b-83983266b24e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:45.650568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18d5c5fb-c9d2-44ab-b00b-83983266b24e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:45.653517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:45.657232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18d5c5fb-c9d2-44ab-b00b-83983266b24e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.657717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18d5c5fb-c9d2-44ab-b00b-83983266b24e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.658606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18d5c5fb-c9d2-44ab-b00b-83983266b24e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.659079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18d5c5fb-c9d2-44ab-b00b-83983266b24e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.665832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:45.668099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:45.669655 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9177f13-ceb7-4562-ab60-8c6ea0a7f515 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.179065 Jul 26 19:46:45.670294 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 433/923] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:45 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:45.676749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-529f2968-b029-4300-910a-d5c9483a57b9 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:45.677734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-529f2968-b029-4300-910a-d5c9483a57b9 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:45.684898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-529f2968-b029-4300-910a-d5c9483a57b9 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.685646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-529f2968-b029-4300-910a-d5c9483a57b9 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.686661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-529f2968-b029-4300-910a-d5c9483a57b9 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.687158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-529f2968-b029-4300-910a-d5c9483a57b9 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.817584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18d5c5fb-c9d2-44ab-b00b-83983266b24e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:45.825321 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18d5c5fb-c9d2-44ab-b00b-83983266b24e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.188290 Jul 26 19:46:45.826206 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 491/924] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:45 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:45.831113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4797311f-3ce7-41e6-81aa-de0d17afcc37 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:45.835785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-529f2968-b029-4300-910a-d5c9483a57b9 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:45.836466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4797311f-3ce7-41e6-81aa-de0d17afcc37 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:45.843859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4797311f-3ce7-41e6-81aa-de0d17afcc37 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.844520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4797311f-3ce7-41e6-81aa-de0d17afcc37 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.845300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4797311f-3ce7-41e6-81aa-de0d17afcc37 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.845474 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-529f2968-b029-4300-910a-d5c9483a57b9 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1319 microversion: 2.1 time: 0.173907 Jul 26 19:46:45.845739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4797311f-3ce7-41e6-81aa-de0d17afcc37 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.846570 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 434/925] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:45 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:45.889065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ba89a2a4-2d26-4b90-978b-1168df146b92 req-3ae16288-f96c-4f5c-945f-17266466e4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91a2c0b-cbe3-4c61-ae77-6878c69fd643", "name": "network-vif-plugged", "status": "completed", "tag": "36b30dac-cbda-4a1f-8d27-44b3ec8f9014"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:45.900565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ba89a2a4-2d26-4b90-978b-1168df146b92 req-3ae16288-f96c-4f5c-945f-17266466e4e9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:45.901108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ba89a2a4-2d26-4b90-978b-1168df146b92 req-3ae16288-f96c-4f5c-945f-17266466e4e9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:45.915144 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ba89a2a4-2d26-4b90-978b-1168df146b92 req-3ae16288-f96c-4f5c-945f-17266466e4e9 service nova] Creating event network-vif-plugged:36b30dac-cbda-4a1f-8d27-44b3ec8f9014 for instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 on n-h1-708768-8 Jul 26 19:46:45.920759 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ba89a2a4-2d26-4b90-978b-1168df146b92 req-3ae16288-f96c-4f5c-945f-17266466e4e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036757 Jul 26 19:46:45.921520 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 435/926] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:45.992890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4797311f-3ce7-41e6-81aa-de0d17afcc37 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:46.000593 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4797311f-3ce7-41e6-81aa-de0d17afcc37 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.173235 Jul 26 19:46:46.001359 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 492/927] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:45 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:46.030363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2580edb3-23db-4366-8eae-5a4899c3cd97 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:46.031151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2580edb3-23db-4366-8eae-5a4899c3cd97 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:46.040291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2580edb3-23db-4366-8eae-5a4899c3cd97 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.040741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2580edb3-23db-4366-8eae-5a4899c3cd97 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.041535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2580edb3-23db-4366-8eae-5a4899c3cd97 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.041968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2580edb3-23db-4366-8eae-5a4899c3cd97 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.083202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b7432b69-7414-405f-984b-a2c6457ccf73 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:46.084248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b7432b69-7414-405f-984b-a2c6457ccf73 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:46.091468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7432b69-7414-405f-984b-a2c6457ccf73 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.092097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7432b69-7414-405f-984b-a2c6457ccf73 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.092967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7432b69-7414-405f-984b-a2c6457ccf73 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.093465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7432b69-7414-405f-984b-a2c6457ccf73 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.189627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2580edb3-23db-4366-8eae-5a4899c3cd97 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:46.198602 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2580edb3-23db-4366-8eae-5a4899c3cd97 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.173162 Jul 26 19:46:46.199461 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 436/928] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:46 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:46.235754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b7432b69-7414-405f-984b-a2c6457ccf73 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:46.244046 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b7432b69-7414-405f-984b-a2c6457ccf73 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1469 microversion: 2.1 time: 0.165876 Jul 26 19:46:46.244640 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 493/929] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:46 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:46.480833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-24a8848f-0c1b-4ffc-bdee-20284ffb231e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:46.481445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-24a8848f-0c1b-4ffc-bdee-20284ffb231e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:46.487429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24a8848f-0c1b-4ffc-bdee-20284ffb231e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.487904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24a8848f-0c1b-4ffc-bdee-20284ffb231e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.489238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24a8848f-0c1b-4ffc-bdee-20284ffb231e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.489676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24a8848f-0c1b-4ffc-bdee-20284ffb231e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.628725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-24a8848f-0c1b-4ffc-bdee-20284ffb231e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:46.636570 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-24a8848f-0c1b-4ffc-bdee-20284ffb231e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.159613 Jul 26 19:46:46.637392 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 437/930] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:46 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:46.696039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:46.696834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:46.703905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.704460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.705310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.705802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.838555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:46.846235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61ab24ea-dc6c-4c3e-9f0e-dfd4984d75c6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:46.846843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:46.846989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61ab24ea-dc6c-4c3e-9f0e-dfd4984d75c6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:46.849679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:46.850799 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2bfe171e-b0f3-498f-8f7a-b7479df2d26b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.160377 Jul 26 19:46:46.851363 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 494/931] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:46 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:46.853726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61ab24ea-dc6c-4c3e-9f0e-dfd4984d75c6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.854170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61ab24ea-dc6c-4c3e-9f0e-dfd4984d75c6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.854934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61ab24ea-dc6c-4c3e-9f0e-dfd4984d75c6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.855370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61ab24ea-dc6c-4c3e-9f0e-dfd4984d75c6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.866544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11d28894-53cf-41a8-a208-454e1a5e5f1f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:46.867151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11d28894-53cf-41a8-a208-454e1a5e5f1f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:46.873270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11d28894-53cf-41a8-a208-454e1a5e5f1f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.873720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11d28894-53cf-41a8-a208-454e1a5e5f1f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:46.874620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11d28894-53cf-41a8-a208-454e1a5e5f1f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:46.875056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11d28894-53cf-41a8-a208-454e1a5e5f1f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.069095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61ab24ea-dc6c-4c3e-9f0e-dfd4984d75c6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:47.077427 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61ab24ea-dc6c-4c3e-9f0e-dfd4984d75c6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.235029 Jul 26 19:46:47.091833 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 438/932] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:46 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:47.096963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-825f2bbb-1718-484c-96b6-9642fedf5078 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:47.097580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-825f2bbb-1718-484c-96b6-9642fedf5078 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:47.104499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-825f2bbb-1718-484c-96b6-9642fedf5078 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.104972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-825f2bbb-1718-484c-96b6-9642fedf5078 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.105804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-825f2bbb-1718-484c-96b6-9642fedf5078 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.106247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-825f2bbb-1718-484c-96b6-9642fedf5078 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.147692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-11d28894-53cf-41a8-a208-454e1a5e5f1f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:47.162277 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11d28894-53cf-41a8-a208-454e1a5e5f1f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1319 microversion: 2.1 time: 0.299521 Jul 26 19:46:47.164926 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 495/933] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:46 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:47.221456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9a61d73c-e24f-4022-bb8f-b5ee239dbf55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:47.222086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9a61d73c-e24f-4022-bb8f-b5ee239dbf55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:47.230852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a61d73c-e24f-4022-bb8f-b5ee239dbf55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.231352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a61d73c-e24f-4022-bb8f-b5ee239dbf55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.232312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a61d73c-e24f-4022-bb8f-b5ee239dbf55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.232765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a61d73c-e24f-4022-bb8f-b5ee239dbf55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.572160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a61d73c-e24f-4022-bb8f-b5ee239dbf55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:47.588206 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9a61d73c-e24f-4022-bb8f-b5ee239dbf55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.370983 Jul 26 19:46:47.602224 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 496/934] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:47 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:47.602224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd4bbaad-221d-4053-a760-f3527d6e2c84 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:47.602224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd4bbaad-221d-4053-a760-f3527d6e2c84 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:47.602224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd4bbaad-221d-4053-a760-f3527d6e2c84 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.602224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd4bbaad-221d-4053-a760-f3527d6e2c84 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.602224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd4bbaad-221d-4053-a760-f3527d6e2c84 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.602817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd4bbaad-221d-4053-a760-f3527d6e2c84 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.612700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-825f2bbb-1718-484c-96b6-9642fedf5078 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:47.625366 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-825f2bbb-1718-484c-96b6-9642fedf5078 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.532104 Jul 26 19:46:47.625952 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 439/935] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:47 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:47.658097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2870d2c-0d29-4b28-bfbc-2578b889671c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:47.658761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c2870d2c-0d29-4b28-bfbc-2578b889671c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:47.677934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2870d2c-0d29-4b28-bfbc-2578b889671c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.678385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2870d2c-0d29-4b28-bfbc-2578b889671c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.679172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2870d2c-0d29-4b28-bfbc-2578b889671c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.679646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2870d2c-0d29-4b28-bfbc-2578b889671c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.940932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c2870d2c-0d29-4b28-bfbc-2578b889671c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:47.949011 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c2870d2c-0d29-4b28-bfbc-2578b889671c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1325 microversion: 2.1 time: 0.294878 Jul 26 19:46:47.951097 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 440/936] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:47 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:47.956116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:47.956992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:47.963362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.964199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:47.965181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:47.965824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.012746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd4bbaad-221d-4053-a760-f3527d6e2c84 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:48.021985 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd4bbaad-221d-4053-a760-f3527d6e2c84 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1469 microversion: 2.1 time: 0.431767 Jul 26 19:46:48.037482 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 497/937] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:47 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1469 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:48.044011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3351c4a6-4252-4bdb-b40a-aacda33d9178 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:48.046321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3351c4a6-4252-4bdb-b40a-aacda33d9178 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:48.057378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3351c4a6-4252-4bdb-b40a-aacda33d9178 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.057825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3351c4a6-4252-4bdb-b40a-aacda33d9178 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.058605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3351c4a6-4252-4bdb-b40a-aacda33d9178 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.059044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3351c4a6-4252-4bdb-b40a-aacda33d9178 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.063090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:48.095744 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3351c4a6-4252-4bdb-b40a-aacda33d9178 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056619 Jul 26 19:46:48.096553 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 498/938] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:46:48 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:48.108411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-42f693f7-3709-4274-97b0-3c4811422e92 req-05bbcc49-c34b-479a-b687-1d9597aa1d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3", "name": "network-vif-plugged", "status": "completed", "tag": "3f861fc9-a37c-4773-a6a3-1162bda6dcd8"}, {"server_uuid": "fb4cd623-5130-4132-8131-104c912de596", "name": "network-vif-plugged", "status": "completed", "tag": "94413dac-8742-4fca-bf3d-1477ac482021"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:48.121138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:48.126275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-42f693f7-3709-4274-97b0-3c4811422e92 req-05bbcc49-c34b-479a-b687-1d9597aa1d11 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.126910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-42f693f7-3709-4274-97b0-3c4811422e92 req-05bbcc49-c34b-479a-b687-1d9597aa1d11 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.146131 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-42f693f7-3709-4274-97b0-3c4811422e92 req-05bbcc49-c34b-479a-b687-1d9597aa1d11 service nova] Creating event network-vif-plugged:3f861fc9-a37c-4773-a6a3-1162bda6dcd8 for instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 on n-h1-708768-8 Jul 26 19:46:48.147248 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-42f693f7-3709-4274-97b0-3c4811422e92 req-05bbcc49-c34b-479a-b687-1d9597aa1d11 service nova] Creating event network-vif-plugged:94413dac-8742-4fca-bf3d-1477ac482021 for instance fb4cd623-5130-4132-8131-104c912de596 on n-h1-708768-8 Jul 26 19:46:48.155923 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-42f693f7-3709-4274-97b0-3c4811422e92 req-05bbcc49-c34b-479a-b687-1d9597aa1d11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050744 Jul 26 19:46:48.157878 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 499/939] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:48.163275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0738a90a-7fee-406a-bfef-bddd8256cff7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:48.164237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0738a90a-7fee-406a-bfef-bddd8256cff7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:48.171952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0738a90a-7fee-406a-bfef-bddd8256cff7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.172528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0738a90a-7fee-406a-bfef-bddd8256cff7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.174464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0738a90a-7fee-406a-bfef-bddd8256cff7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.174915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0738a90a-7fee-406a-bfef-bddd8256cff7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.201636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:48.210872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:48.212399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:48.216142 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79213b65-9546-4c74-8192-5eaf8e26097b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.263720 Jul 26 19:46:48.220766 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 441/940] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:47 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:48.235000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2556ba86-373f-4313-b0fe-bec7614d67f1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:48.235731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2556ba86-373f-4313-b0fe-bec7614d67f1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:48.252399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2556ba86-373f-4313-b0fe-bec7614d67f1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.254958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2556ba86-373f-4313-b0fe-bec7614d67f1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.256129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2556ba86-373f-4313-b0fe-bec7614d67f1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.256736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2556ba86-373f-4313-b0fe-bec7614d67f1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.435706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-2556ba86-373f-4313-b0fe-bec7614d67f1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lazy-loading 'services' on Instance uuid 94ef3743-f705-4e52-bb3c-e5891eab0512 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:48.468236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0738a90a-7fee-406a-bfef-bddd8256cff7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:48.478599 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0738a90a-7fee-406a-bfef-bddd8256cff7 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.319414 Jul 26 19:46:48.492331 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 500/941] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:48 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:48.497403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-83a4b75e-ca37-47e6-b917-4990fd1b90bd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:48.499769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-83a4b75e-ca37-47e6-b917-4990fd1b90bd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:48.518651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83a4b75e-ca37-47e6-b917-4990fd1b90bd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.519105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83a4b75e-ca37-47e6-b917-4990fd1b90bd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.520148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83a4b75e-ca37-47e6-b917-4990fd1b90bd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.523455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83a4b75e-ca37-47e6-b917-4990fd1b90bd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.636507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2556ba86-373f-4313-b0fe-bec7614d67f1 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "DELETE /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments/3bcce208-f078-48e1-9355-74105d85341e" status: 202 len: 0 microversion: 2.1 time: 0.414143 Jul 26 19:46:48.641268 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 442/942] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 19:46:48 2022] DELETE /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments/3bcce208-f078-48e1-9355-74105d85341e => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:46:48.687395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-47c7b159-3f83-4f95-a1a1-e48d10d1ce72 req-145cc5fd-f2f8-43e7-94fe-cf3cf9061fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518653ad-beb2-4d83-8815-4de5fb8cfa13", "name": "network-vif-deleted", "tag": "6f7bfc36-0441-48fa-a682-56cb3652edc3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:48.734226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-47c7b159-3f83-4f95-a1a1-e48d10d1ce72 req-145cc5fd-f2f8-43e7-94fe-cf3cf9061fe9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.734691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-47c7b159-3f83-4f95-a1a1-e48d10d1ce72 req-145cc5fd-f2f8-43e7-94fe-cf3cf9061fe9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.773565 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-47c7b159-3f83-4f95-a1a1-e48d10d1ce72 req-145cc5fd-f2f8-43e7-94fe-cf3cf9061fe9 service nova] Creating event network-vif-deleted:6f7bfc36-0441-48fa-a682-56cb3652edc3 for instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 on n-h1-708768-8 Jul 26 19:46:48.780070 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-47c7b159-3f83-4f95-a1a1-e48d10d1ce72 req-145cc5fd-f2f8-43e7-94fe-cf3cf9061fe9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137002 Jul 26 19:46:48.781563 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 443/943] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:48.788864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f7956d1-a4ee-4594-a925-4d5c193ea1d1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:48.790372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f7956d1-a4ee-4594-a925-4d5c193ea1d1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:48.799064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f7956d1-a4ee-4594-a925-4d5c193ea1d1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.799786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f7956d1-a4ee-4594-a925-4d5c193ea1d1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.803485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f7956d1-a4ee-4594-a925-4d5c193ea1d1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.804406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f7956d1-a4ee-4594-a925-4d5c193ea1d1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.938578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-83a4b75e-ca37-47e6-b917-4990fd1b90bd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:48.948223 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-83a4b75e-ca37-47e6-b917-4990fd1b90bd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1319 microversion: 2.1 time: 0.464639 Jul 26 19:46:48.958944 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 501/944] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:48 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:48.958944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91e949f9-0128-49c1-a6e0-d7165b58483e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:48.958944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-91e949f9-0128-49c1-a6e0-d7165b58483e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:48.962515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91e949f9-0128-49c1-a6e0-d7165b58483e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.963148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91e949f9-0128-49c1-a6e0-d7165b58483e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:48.963956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91e949f9-0128-49c1-a6e0-d7165b58483e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:48.964596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91e949f9-0128-49c1-a6e0-d7165b58483e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.027423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f7956d1-a4ee-4594-a925-4d5c193ea1d1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.036491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f7956d1-a4ee-4594-a925-4d5c193ea1d1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.252707 Jul 26 19:46:49.037068 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 444/945] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:48 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:49.041859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e2c321a4-a91e-42a5-bbea-ae307bf34deb req-5873e43d-5bc8-480c-aa3f-2c9b7857b6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484a1fc2-81bf-49dc-9ebb-bc32fe409a8a", "tag": "d81ba563-1d5c-4679-a3fe-6c199155f7a7"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:49.052765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e2c321a4-a91e-42a5-bbea-ae307bf34deb req-5873e43d-5bc8-480c-aa3f-2c9b7857b6d0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.053452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e2c321a4-a91e-42a5-bbea-ae307bf34deb req-5873e43d-5bc8-480c-aa3f-2c9b7857b6d0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.058146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:49.066205 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e2c321a4-a91e-42a5-bbea-ae307bf34deb req-5873e43d-5bc8-480c-aa3f-2c9b7857b6d0 service nova] Creating event network-changed:d81ba563-1d5c-4679-a3fe-6c199155f7a7 for instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a on n-h2-708768-8 Jul 26 19:46:49.071512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e2c321a4-a91e-42a5-bbea-ae307bf34deb req-5873e43d-5bc8-480c-aa3f-2c9b7857b6d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033082 Jul 26 19:46:49.072432 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 445/946] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:49.078368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd96b161-567e-42ac-9152-6d8ceb705e71 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:49.079063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd96b161-567e-42ac-9152-6d8ceb705e71 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:49.086585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd96b161-567e-42ac-9152-6d8ceb705e71 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.087033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd96b161-567e-42ac-9152-6d8ceb705e71 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.087836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd96b161-567e-42ac-9152-6d8ceb705e71 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.088315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd96b161-567e-42ac-9152-6d8ceb705e71 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.125723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-91e949f9-0128-49c1-a6e0-d7165b58483e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.138633 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91e949f9-0128-49c1-a6e0-d7165b58483e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.188277 Jul 26 19:46:49.141499 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 502/947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:48 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:49.146694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:49.147305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:49.153922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.154369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.155139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.155579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.195823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.196275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.196747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lazy-loading 'fault' on Instance uuid 518653ad-beb2-4d83-8815-4de5fb8cfa13 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:49.244736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.244995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd96b161-567e-42ac-9152-6d8ceb705e71 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.252816 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-028f4b24-a2db-4071-9888-da58747d4938 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 200 len: 1304 microversion: 2.1 time: 0.110178 Jul 26 19:46:49.252983 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd96b161-567e-42ac-9152-6d8ceb705e71 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.179067 Jul 26 19:46:49.267192 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 503/948] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:49 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:49.267887 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 446/949] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:49 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:49.277507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:49.278134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:49.285530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.285908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.286698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.287385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.303087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-860eb0c6-c79a-4d04-aec9-1964c062e208 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:49.304027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-860eb0c6-c79a-4d04-aec9-1964c062e208 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:49.320213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-860eb0c6-c79a-4d04-aec9-1964c062e208 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.320920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-860eb0c6-c79a-4d04-aec9-1964c062e208 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.321863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-860eb0c6-c79a-4d04-aec9-1964c062e208 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.322463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-860eb0c6-c79a-4d04-aec9-1964c062e208 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.479577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.487517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.489070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-860eb0c6-c79a-4d04-aec9-1964c062e208 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.489668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.490807 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a54e4a4-8f9c-4908-ad60-0b4222a97ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.226906 Jul 26 19:46:49.491371 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 504/950] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:49 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:49.496729 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-860eb0c6-c79a-4d04-aec9-1964c062e208 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.223354 Jul 26 19:46:49.497296 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 447/951] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:49 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:49.505008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e187cbc3-6a2d-407c-9164-7e65382f86f9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:49.505764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e187cbc3-6a2d-407c-9164-7e65382f86f9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:49.511918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e187cbc3-6a2d-407c-9164-7e65382f86f9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.512508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e187cbc3-6a2d-407c-9164-7e65382f86f9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.513433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e187cbc3-6a2d-407c-9164-7e65382f86f9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.513958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e187cbc3-6a2d-407c-9164-7e65382f86f9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.519319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-894dc034-9694-4678-8f69-d90a87517016 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-6413477", "metadata": {"": ""}}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-894dc034-9694-4678-8f69-d90a87517016 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action HTTP/1.1 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 104 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-6413477", "metadata": {"": ""}}} Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f91a2c0b-cbe3-4c61-ae77-6878c69fd643', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-6413477', 'metadata': {'': ''}}}} Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'': ''} Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:46:49.522391 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-894dc034-9694-4678-8f69-d90a87517016 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-894dc034-9694-4678-8f69-d90a87517016 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action" status: 400 len: 170 microversion: 2.1 time: 0.010042 Jul 26 19:46:49.527766 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 448/952] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jul 26 19:46:49 2022] POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action => generated 170 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 19:46:49.537482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dc9ee542-f4d6-46ab-9641-d651c88c8f83 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:49.538164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dc9ee542-f4d6-46ab-9641-d651c88c8f83 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:49.545047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc9ee542-f4d6-46ab-9641-d651c88c8f83 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.545598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc9ee542-f4d6-46ab-9641-d651c88c8f83 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.546457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc9ee542-f4d6-46ab-9641-d651c88c8f83 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.546906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc9ee542-f4d6-46ab-9641-d651c88c8f83 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.648043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e187cbc3-6a2d-407c-9164-7e65382f86f9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.656680 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e187cbc3-6a2d-407c-9164-7e65382f86f9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.156064 Jul 26 19:46:49.657809 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 505/953] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:49 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:49.698582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dc9ee542-f4d6-46ab-9641-d651c88c8f83 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.717779 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dc9ee542-f4d6-46ab-9641-d651c88c8f83 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.183816 Jul 26 19:46:49.721075 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 449/954] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:49 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:49.744871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-626d7708-6b19-47be-b53a-39c6fa1a5900 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:49.745662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-626d7708-6b19-47be-b53a-39c6fa1a5900 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:49.752519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-626d7708-6b19-47be-b53a-39c6fa1a5900 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.752960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-626d7708-6b19-47be-b53a-39c6fa1a5900 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.753738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-626d7708-6b19-47be-b53a-39c6fa1a5900 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.754219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-626d7708-6b19-47be-b53a-39c6fa1a5900 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.967468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-626d7708-6b19-47be-b53a-39c6fa1a5900 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:49.971170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e395def3-e0ed-4c81-a8af-b42c2285e297 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:49.971328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e395def3-e0ed-4c81-a8af-b42c2285e297 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:49.976380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-626d7708-6b19-47be-b53a-39c6fa1a5900 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.235629 Jul 26 19:46:49.977800 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 506/955] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:49 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:49.981069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e395def3-e0ed-4c81-a8af-b42c2285e297 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.981521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e395def3-e0ed-4c81-a8af-b42c2285e297 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:49.982305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e395def3-e0ed-4c81-a8af-b42c2285e297 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:49.982740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e395def3-e0ed-4c81-a8af-b42c2285e297 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.000138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-720c7e2a-332e-40d6-9a58-bf7d3172af98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1901755879", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-720c7e2a-332e-40d6-9a58-bf7d3172af98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action HTTP/1.1 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 619 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1901755879", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f91a2c0b-cbe3-4c61-ae77-6878c69fd643', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1901755879', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:46:50.009460 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 19:46:50.012673 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.016558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-720c7e2a-332e-40d6-9a58-bf7d3172af98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:50.018179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-720c7e2a-332e-40d6-9a58-bf7d3172af98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action" status: 400 len: 938 microversion: 2.1 time: 0.023812 Jul 26 19:46:50.019233 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 507/956] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jul 26 19:46:49 2022] POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action => generated 938 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:46:50.029487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00059fdf-1531-4572-a10f-5205c1aa4b56 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.030486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00059fdf-1531-4572-a10f-5205c1aa4b56 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.039371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00059fdf-1531-4572-a10f-5205c1aa4b56 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.039845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00059fdf-1531-4572-a10f-5205c1aa4b56 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.040854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00059fdf-1531-4572-a10f-5205c1aa4b56 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.041272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00059fdf-1531-4572-a10f-5205c1aa4b56 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.139929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e395def3-e0ed-4c81-a8af-b42c2285e297 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.148705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e395def3-e0ed-4c81-a8af-b42c2285e297 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1319 microversion: 2.1 time: 0.182200 Jul 26 19:46:50.149285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 450/957] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:49 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:50.154599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7868325b-0ea9-493c-8c4d-52ac76502f5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.154836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7868325b-0ea9-493c-8c4d-52ac76502f5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.166105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7868325b-0ea9-493c-8c4d-52ac76502f5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.166920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7868325b-0ea9-493c-8c4d-52ac76502f5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.169942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7868325b-0ea9-493c-8c4d-52ac76502f5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.169942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7868325b-0ea9-493c-8c4d-52ac76502f5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.207689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00059fdf-1531-4572-a10f-5205c1aa4b56 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.215641 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00059fdf-1531-4572-a10f-5205c1aa4b56 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.191222 Jul 26 19:46:50.216510 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 508/958] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:50.236690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a69d3d12-1fe7-403a-81e2-4c2714b8836d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.237956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a69d3d12-1fe7-403a-81e2-4c2714b8836d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.244494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a69d3d12-1fe7-403a-81e2-4c2714b8836d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.245073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a69d3d12-1fe7-403a-81e2-4c2714b8836d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.245935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a69d3d12-1fe7-403a-81e2-4c2714b8836d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.246441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a69d3d12-1fe7-403a-81e2-4c2714b8836d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.388639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a69d3d12-1fe7-403a-81e2-4c2714b8836d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.397351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a69d3d12-1fe7-403a-81e2-4c2714b8836d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.164427 Jul 26 19:46:50.398152 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 509/959] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:50.407494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7868325b-0ea9-493c-8c4d-52ac76502f5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.417010 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7868325b-0ea9-493c-8c4d-52ac76502f5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.266670 Jul 26 19:46:50.420031 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 451/960] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:50.421103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-aaa59a91-3703-49a6-af95-c03808490583 req-43b43bd6-a0fc-499e-87a7-de34f255afdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fe3d9a-2c77-474b-b76c-18e646136479", "name": "network-vif-plugged", "status": "completed", "tag": "e911674c-dd59-4561-9287-90324fc2f2e7"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:50.429979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-899f0d86-feb5-4707-ad71-c94a953645e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.431403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-899f0d86-feb5-4707-ad71-c94a953645e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.433888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aaa59a91-3703-49a6-af95-c03808490583 req-43b43bd6-a0fc-499e-87a7-de34f255afdf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.434790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aaa59a91-3703-49a6-af95-c03808490583 req-43b43bd6-a0fc-499e-87a7-de34f255afdf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.438043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-899f0d86-feb5-4707-ad71-c94a953645e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.438693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-899f0d86-feb5-4707-ad71-c94a953645e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.439507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-899f0d86-feb5-4707-ad71-c94a953645e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.439959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-899f0d86-feb5-4707-ad71-c94a953645e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.459264 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aaa59a91-3703-49a6-af95-c03808490583 req-43b43bd6-a0fc-499e-87a7-de34f255afdf service nova] Creating event network-vif-plugged:e911674c-dd59-4561-9287-90324fc2f2e7 for instance f8fe3d9a-2c77-474b-b76c-18e646136479 on n-h1-708768-8 Jul 26 19:46:50.464837 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-aaa59a91-3703-49a6-af95-c03808490583 req-43b43bd6-a0fc-499e-87a7-de34f255afdf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047960 Jul 26 19:46:50.465456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 510/961] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:50.471180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.471907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 518653ad-beb2-4d83-8815-4de5fb8cfa13] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.478818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.479266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.480070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.480509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.495031 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] HTTP exception thrown: Instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 could not be found. Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Request method failure captured: Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 HTTP/1.1 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQlrFzSdB4wwJ0pid0A93p7dr-UK8MOU--CiHNUBlql-A-6bP5SKbrSoJgtDMxSFVobi-Gq8VVO3ou5yr8gobZ4dDDCTes6kA7eh4nTgcY0OAzrY2Z68QEPWzfF5VNI6PxvLF4QqbT2Fc3L5eiOjN4MYCPb7F0QK-E_OR7gEX08Wdc Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: aa4bbc1be55b4513a8010a7bc71fbdf5 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aa4bbc1be55b4513a8010a7bc71fbdf5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}] Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: aa4bbc1be55b4513a8010a7bc71fbdf5 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersAdminTestJSON-1989259508-project Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cb09db7f39f24139a8b9a50bb21c4a3d Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersAdminTestJSON-1989259508-project Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 could not be found. Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '518653ad-beb2-4d83-8815-4de5fb8cfa13'} Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 could not be found. Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 could not be found. Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:50.496714 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 could not be found. Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Returning 404 to user: Instance 518653ad-beb2-4d83-8815-4de5fb8cfa13 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8128ed9-511b-412b-b5ab-5d59a3a67c47 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13" status: 404 len: 111 microversion: 2.1 time: 0.031512 Jul 26 19:46:50.501395 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 511/962] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/518653ad-beb2-4d83-8815-4de5fb8cfa13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:50.506764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cafaa749-ed83-4382-975f-fa082bafa4f3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.507272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cafaa749-ed83-4382-975f-fa082bafa4f3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.514737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cafaa749-ed83-4382-975f-fa082bafa4f3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.515195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cafaa749-ed83-4382-975f-fa082bafa4f3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.516013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cafaa749-ed83-4382-975f-fa082bafa4f3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.516454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cafaa749-ed83-4382-975f-fa082bafa4f3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.549162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cafaa749-ed83-4382-975f-fa082bafa4f3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:46:50.588977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-899f0d86-feb5-4707-ad71-c94a953645e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.599211 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-899f0d86-feb5-4707-ad71-c94a953645e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.176928 Jul 26 19:46:50.599849 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 452/963] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:50.611779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.611779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.618092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.618092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.618092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.618092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.653168 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cafaa749-ed83-4382-975f-fa082bafa4f3 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 204 len: 0 microversion: 2.1 time: 0.149382 Jul 26 19:46:50.654417 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 512/964] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:50 2022] DELETE /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:50.662355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bff64875-4208-4f3f-aab4-20f270f8acbd tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bff64875-4208-4f3f-aab4-20f270f8acbd tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action HTTP/1.1 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 285 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f91a2c0b-cbe3-4c61-ae77-6878c69fd643', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.668668 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bff64875-4208-4f3f-aab4-20f270f8acbd tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bff64875-4208-4f3f-aab4-20f270f8acbd tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action" status: 400 len: 619 microversion: 2.1 time: 0.014079 Jul 26 19:46:50.675547 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 513/965] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jul 26 19:46:50 2022] POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:46:50.677623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7f5ee409-cf44-4e8e-a470-d7d4494bf0af tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.677623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7f5ee409-cf44-4e8e-a470-d7d4494bf0af tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.693280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f5ee409-cf44-4e8e-a470-d7d4494bf0af tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.694249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f5ee409-cf44-4e8e-a470-d7d4494bf0af tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.695160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f5ee409-cf44-4e8e-a470-d7d4494bf0af tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.695747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f5ee409-cf44-4e8e-a470-d7d4494bf0af tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.807168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.819237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.822187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.823431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d189e56-1610-4807-8012-63e274369e68 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1361 microversion: 2.25 time: 0.222592 Jul 26 19:46:50.824551 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 453/966] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:50.829499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1484881d-407d-4171-a315-53809b89fb6f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.830110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1484881d-407d-4171-a315-53809b89fb6f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.838526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1484881d-407d-4171-a315-53809b89fb6f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.838847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1484881d-407d-4171-a315-53809b89fb6f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.839814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1484881d-407d-4171-a315-53809b89fb6f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.840403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1484881d-407d-4171-a315-53809b89fb6f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.913928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7f5ee409-cf44-4e8e-a470-d7d4494bf0af tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:50.924176 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7f5ee409-cf44-4e8e-a470-d7d4494bf0af tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1468 microversion: 2.1 time: 0.252150 Jul 26 19:46:50.926927 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 514/967] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1468 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:50.939095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9bf13131-a631-45be-a8ce-bc31cc1f237b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:50.947835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9bf13131-a631-45be-a8ce-bc31cc1f237b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:50.956354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bf13131-a631-45be-a8ce-bc31cc1f237b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.956896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bf13131-a631-45be-a8ce-bc31cc1f237b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:50.958470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bf13131-a631-45be-a8ce-bc31cc1f237b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:50.959182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bf13131-a631-45be-a8ce-bc31cc1f237b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.015006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1484881d-407d-4171-a315-53809b89fb6f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:51.038109 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1484881d-407d-4171-a315-53809b89fb6f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.212554 Jul 26 19:46:51.052894 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 454/968] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:51.138669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9bf13131-a631-45be-a8ce-bc31cc1f237b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:51.146623 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9bf13131-a631-45be-a8ce-bc31cc1f237b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.218166 Jul 26 19:46:51.147200 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 515/969] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:50 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:51.168082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e315a6b-f6ee-44fb-91fa-5f1a8153269f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:51.168716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e315a6b-f6ee-44fb-91fa-5f1a8153269f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.170402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-759701bf-6ecc-4ded-8f2f-043dd26edcdd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:51.171429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-759701bf-6ecc-4ded-8f2f-043dd26edcdd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.177507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e315a6b-f6ee-44fb-91fa-5f1a8153269f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.178034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e315a6b-f6ee-44fb-91fa-5f1a8153269f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.178487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-759701bf-6ecc-4ded-8f2f-043dd26edcdd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.178934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e315a6b-f6ee-44fb-91fa-5f1a8153269f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.179049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-759701bf-6ecc-4ded-8f2f-043dd26edcdd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.179481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e315a6b-f6ee-44fb-91fa-5f1a8153269f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.179730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-759701bf-6ecc-4ded-8f2f-043dd26edcdd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.180171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-759701bf-6ecc-4ded-8f2f-043dd26edcdd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.317599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-759701bf-6ecc-4ded-8f2f-043dd26edcdd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:51.318280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3e315a6b-f6ee-44fb-91fa-5f1a8153269f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:51.322121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:51.326847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-759701bf-6ecc-4ded-8f2f-043dd26edcdd tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1468 microversion: 2.1 time: 0.160656 Jul 26 19:46:51.327639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 516/970] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:51 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1468 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:51.328560 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e315a6b-f6ee-44fb-91fa-5f1a8153269f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.164950 Jul 26 19:46:51.329385 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 455/971] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:51 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:51.349398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23576e03-c35b-4566-a18f-f3cecea22248 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1093877448"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:51.352712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-23576e03-c35b-4566-a18f-f3cecea22248 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.358802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23576e03-c35b-4566-a18f-f3cecea22248 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.359256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23576e03-c35b-4566-a18f-f3cecea22248 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.360080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23576e03-c35b-4566-a18f-f3cecea22248 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.360519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23576e03-c35b-4566-a18f-f3cecea22248 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.405384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdde5ac6-df00-4421-a229-09d93351bc4f tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:51.405925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cdde5ac6-df00-4421-a229-09d93351bc4f tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.413131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdde5ac6-df00-4421-a229-09d93351bc4f tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.413131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdde5ac6-df00-4421-a229-09d93351bc4f tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.413837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdde5ac6-df00-4421-a229-09d93351bc4f tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.415042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdde5ac6-df00-4421-a229-09d93351bc4f tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.443807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cdde5ac6-df00-4421-a229-09d93351bc4f tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] [instance: fb4cd623-5130-4132-8131-104c912de596] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:46:51.532241 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cdde5ac6-df00-4421-a229-09d93351bc4f tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 204 len: 0 microversion: 2.1 time: 0.187779 Jul 26 19:46:51.533938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 517/972] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:51 2022] DELETE /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:46:51.540190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad17245e-8265-49df-b099-4db4efc9ac01 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:51.540932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ad17245e-8265-49df-b099-4db4efc9ac01 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.546934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad17245e-8265-49df-b099-4db4efc9ac01 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.547388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad17245e-8265-49df-b099-4db4efc9ac01 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.548202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad17245e-8265-49df-b099-4db4efc9ac01 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.548636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad17245e-8265-49df-b099-4db4efc9ac01 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.588583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23576e03-c35b-4566-a18f-f3cecea22248 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action" status: 202 len: 0 microversion: 2.1 time: 0.243265 Jul 26 19:46:51.589568 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 456/973] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:46:51 2022] POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 26 19:46:51.594981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5c11e158-20f9-42f2-af76-c4d43d2325de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:51.595727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5c11e158-20f9-42f2-af76-c4d43d2325de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.603241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c11e158-20f9-42f2-af76-c4d43d2325de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.603725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c11e158-20f9-42f2-af76-c4d43d2325de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.604508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c11e158-20f9-42f2-af76-c4d43d2325de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.604947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c11e158-20f9-42f2-af76-c4d43d2325de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.699921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ad17245e-8265-49df-b099-4db4efc9ac01 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:51.709413 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ad17245e-8265-49df-b099-4db4efc9ac01 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.173711 Jul 26 19:46:51.717111 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 518/974] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:51 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:51.717111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64935577-d3a8-413d-bbfb-705cbedfee5c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:51.726039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64935577-d3a8-413d-bbfb-705cbedfee5c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.741254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64935577-d3a8-413d-bbfb-705cbedfee5c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.741676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64935577-d3a8-413d-bbfb-705cbedfee5c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.742946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64935577-d3a8-413d-bbfb-705cbedfee5c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.743388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64935577-d3a8-413d-bbfb-705cbedfee5c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.812491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c11e158-20f9-42f2-af76-c4d43d2325de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:51.821728 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5c11e158-20f9-42f2-af76-c4d43d2325de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.230873 Jul 26 19:46:51.822657 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 457/975] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:51 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:51.827216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-419513448"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:51.829620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.840805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.841250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.842120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.842559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.879646 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Cannot 'createImage' instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 while it is in task_state image_snapshot_pending Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action HTTP/1.1 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 84 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-419513448"}} Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'createImage' instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 while it is in task_state image_snapshot_pending Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f91a2c0b-cbe3-4c61-ae77-6878c69fd643', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-419513448'}}} Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 19:46:51.881379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 while it is in task_state image_snapshot_pending Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 while it is in task_state image_snapshot_pending Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 409 to user: Cannot 'createImage' instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 while it is in task_state image_snapshot_pending {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88403da0-8f3a-4576-8e52-de5cf8eab3a4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action" status: 409 len: 167 microversion: 2.1 time: 0.059394 Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 458/976] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:46:51 2022] POST /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643/action => generated 167 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:46:51.889711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:51.890666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:51.898289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64935577-d3a8-413d-bbfb-705cbedfee5c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:51.898864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.899319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.900265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:51.900567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:51.908068 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64935577-d3a8-413d-bbfb-705cbedfee5c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1474 microversion: 2.1 time: 0.195506 Jul 26 19:46:51.908833 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 519/977] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:51 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1474 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:51.914383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ed6d901d-56c3-43b7-a221-9caa6067bc16 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '.version_select at 0x7f875f06b700>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.059279 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ed6d901d-56c3-43b7-a221-9caa6067bc16 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/images/683da6a3-921f-4858-b8f4-357a478c2498" status: 204 len: 0 microversion: 2.1 time: 0.149476 Jul 26 19:46:52.060078 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 520/978] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:51 2022] DELETE /compute/v2.1/images/683da6a3-921f-4858-b8f4-357a478c2498 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:52.068358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90a0f8bf-2f6f-4dda-8bad-49cea32833e9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.069071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90a0f8bf-2f6f-4dda-8bad-49cea32833e9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.075248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90a0f8bf-2f6f-4dda-8bad-49cea32833e9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.075860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90a0f8bf-2f6f-4dda-8bad-49cea32833e9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.076847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90a0f8bf-2f6f-4dda-8bad-49cea32833e9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.077355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90a0f8bf-2f6f-4dda-8bad-49cea32833e9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.091282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:52.100372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:52.101892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:52.103074 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d3544acd-1a64-4a9c-944e-46994ce9c395 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1557 microversion: 2.25 time: 0.217989 Jul 26 19:46:52.103652 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 459/979] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:51 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:52.108326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-464a98cc-9af4-4cae-8174-3448813e91e1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.108972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-464a98cc-9af4-4cae-8174-3448813e91e1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.115647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-464a98cc-9af4-4cae-8174-3448813e91e1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.116104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-464a98cc-9af4-4cae-8174-3448813e91e1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.116887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-464a98cc-9af4-4cae-8174-3448813e91e1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.117328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-464a98cc-9af4-4cae-8174-3448813e91e1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.222053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90a0f8bf-2f6f-4dda-8bad-49cea32833e9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:52.229977 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90a0f8bf-2f6f-4dda-8bad-49cea32833e9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1468 microversion: 2.1 time: 0.165545 Jul 26 19:46:52.230881 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 521/980] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1468 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:52.235415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af3f482d-5538-4295-89b0-fd415bebad95 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.236200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af3f482d-5538-4295-89b0-fd415bebad95 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.242533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af3f482d-5538-4295-89b0-fd415bebad95 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.243251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af3f482d-5538-4295-89b0-fd415bebad95 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.244188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af3f482d-5538-4295-89b0-fd415bebad95 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.244731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af3f482d-5538-4295-89b0-fd415bebad95 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.255593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-464a98cc-9af4-4cae-8174-3448813e91e1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:52.263989 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-464a98cc-9af4-4cae-8174-3448813e91e1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.159050 Jul 26 19:46:52.265356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 460/981] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:52.276013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7a117990-4d4d-4c72-bf4f-e623d626380b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.277227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7a117990-4d4d-4c72-bf4f-e623d626380b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.283964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a117990-4d4d-4c72-bf4f-e623d626380b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.284410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a117990-4d4d-4c72-bf4f-e623d626380b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.285203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a117990-4d4d-4c72-bf4f-e623d626380b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.285670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a117990-4d4d-4c72-bf4f-e623d626380b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.383474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-af3f482d-5538-4295-89b0-fd415bebad95 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:52.391141 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af3f482d-5538-4295-89b0-fd415bebad95 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1543 microversion: 2.1 time: 0.159277 Jul 26 19:46:52.395670 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 522/982] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1543 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:52.425007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-7a117990-4d4d-4c72-bf4f-e623d626380b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:52.428876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:52.440587 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7a117990-4d4d-4c72-bf4f-e623d626380b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 2049 microversion: 2.25 time: 0.172592 Jul 26 19:46:52.441187 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 461/983] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 2049 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:52.463732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d870da53-2ec2-436e-996a-95a5bb565093 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.464637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d870da53-2ec2-436e-996a-95a5bb565093 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.470794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d870da53-2ec2-436e-996a-95a5bb565093 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.471323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d870da53-2ec2-436e-996a-95a5bb565093 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.472184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d870da53-2ec2-436e-996a-95a5bb565093 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.472677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d870da53-2ec2-436e-996a-95a5bb565093 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.601270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-d870da53-2ec2-436e-996a-95a5bb565093 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:52.617953 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d870da53-2ec2-436e-996a-95a5bb565093 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 2049 microversion: 2.25 time: 0.157944 Jul 26 19:46:52.618847 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 523/984] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 2049 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:52.641285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-80454a1e-525c-4e8d-aab0-966f775223dc tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.644048 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:46:52.644048 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:46:52.646011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80454a1e-525c-4e8d-aab0-966f775223dc tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.646528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80454a1e-525c-4e8d-aab0-966f775223dc tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.647395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80454a1e-525c-4e8d-aab0-966f775223dc tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.647927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80454a1e-525c-4e8d-aab0-966f775223dc tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.672788 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-80454a1e-525c-4e8d-aab0-966f775223dc tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.035517 Jul 26 19:46:52.673378 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 462/985] 10.222.0.58 () {60 vars in 1217 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:46:52.685142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d064a97c-93ba-4af9-8c90-a2dd28123a37 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:52.685671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d064a97c-93ba-4af9-8c90-a2dd28123a37 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.691802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d064a97c-93ba-4af9-8c90-a2dd28123a37 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.692379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d064a97c-93ba-4af9-8c90-a2dd28123a37 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.693201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d064a97c-93ba-4af9-8c90-a2dd28123a37 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.693580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d064a97c-93ba-4af9-8c90-a2dd28123a37 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.735167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fee92e89-244d-4331-ad09-06e85580c343 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.735859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fee92e89-244d-4331-ad09-06e85580c343 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.744764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fee92e89-244d-4331-ad09-06e85580c343 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.745684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fee92e89-244d-4331-ad09-06e85580c343 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.746740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fee92e89-244d-4331-ad09-06e85580c343 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.747371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fee92e89-244d-4331-ad09-06e85580c343 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.763950 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d064a97c-93ba-4af9-8c90-a2dd28123a37 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3/action" status: 202 len: 0 microversion: 2.25 time: 0.082233 Jul 26 19:46:52.764750 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 524/986] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 19:46:52 2022] POST /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:52.773691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e1fa2bf2-53a9-46c5-abd4-cee9dba6bd51 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.774391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e1fa2bf2-53a9-46c5-abd4-cee9dba6bd51 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.782527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1fa2bf2-53a9-46c5-abd4-cee9dba6bd51 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.782986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1fa2bf2-53a9-46c5-abd4-cee9dba6bd51 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.783784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1fa2bf2-53a9-46c5-abd4-cee9dba6bd51 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.784278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1fa2bf2-53a9-46c5-abd4-cee9dba6bd51 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.913964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fee92e89-244d-4331-ad09-06e85580c343 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:52.921669 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fee92e89-244d-4331-ad09-06e85580c343 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1315 microversion: 2.1 time: 0.192402 Jul 26 19:46:52.936330 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 463/987] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:52.941015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-411102f7-2b29-4efc-953d-23697feb87a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.942174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-411102f7-2b29-4efc-953d-23697feb87a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.943504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-e1fa2bf2-53a9-46c5-abd4-cee9dba6bd51 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:52.948940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-411102f7-2b29-4efc-953d-23697feb87a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.949379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-411102f7-2b29-4efc-953d-23697feb87a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.950144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-411102f7-2b29-4efc-953d-23697feb87a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.950568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-411102f7-2b29-4efc-953d-23697feb87a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.958728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e1fa2bf2-53a9-46c5-abd4-cee9dba6bd51 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 2054 microversion: 2.25 time: 0.189667 Jul 26 19:46:52.959458 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 525/988] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 2054 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:46:52.971848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73ef16cf-47b7-40e8-8d3f-cb6774b69806 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:52.971848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73ef16cf-47b7-40e8-8d3f-cb6774b69806 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:52.977810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73ef16cf-47b7-40e8-8d3f-cb6774b69806 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.978254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73ef16cf-47b7-40e8-8d3f-cb6774b69806 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:52.979045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73ef16cf-47b7-40e8-8d3f-cb6774b69806 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:52.979474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73ef16cf-47b7-40e8-8d3f-cb6774b69806 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.102884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:53.138299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-73ef16cf-47b7-40e8-8d3f-cb6774b69806 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:53.146815 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73ef16cf-47b7-40e8-8d3f-cb6774b69806 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1474 microversion: 2.1 time: 0.182921 Jul 26 19:46:53.147385 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 526/989] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1474 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:53.189628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-411102f7-2b29-4efc-953d-23697feb87a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:53.197968 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-411102f7-2b29-4efc-953d-23697feb87a6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.260628 Jul 26 19:46:53.198796 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 464/990] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:52 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:53.251469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-53af63cd-272a-4205-a2ca-8625a8d0adc5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:53.252123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-53af63cd-272a-4205-a2ca-8625a8d0adc5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:53.258720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53af63cd-272a-4205-a2ca-8625a8d0adc5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.259164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53af63cd-272a-4205-a2ca-8625a8d0adc5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.259967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53af63cd-272a-4205-a2ca-8625a8d0adc5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.260402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53af63cd-272a-4205-a2ca-8625a8d0adc5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.286532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f844ab1-0fb8-49c7-90e5-67889b67368e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:53.287153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4f844ab1-0fb8-49c7-90e5-67889b67368e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:53.293763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f844ab1-0fb8-49c7-90e5-67889b67368e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.294220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f844ab1-0fb8-49c7-90e5-67889b67368e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.295009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f844ab1-0fb8-49c7-90e5-67889b67368e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.295451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f844ab1-0fb8-49c7-90e5-67889b67368e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.440009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-53af63cd-272a-4205-a2ca-8625a8d0adc5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:53.450727 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-53af63cd-272a-4205-a2ca-8625a8d0adc5 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1468 microversion: 2.1 time: 0.203145 Jul 26 19:46:53.466000 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 527/991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:53 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1468 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:53.471131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-663da690-8566-4ff8-8da5-01a5daa7b5b3 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:53.471771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-663da690-8566-4ff8-8da5-01a5daa7b5b3 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:53.478036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-663da690-8566-4ff8-8da5-01a5daa7b5b3 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.478481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-663da690-8566-4ff8-8da5-01a5daa7b5b3 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.479255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-663da690-8566-4ff8-8da5-01a5daa7b5b3 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.479789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-663da690-8566-4ff8-8da5-01a5daa7b5b3 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.502274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:53.516637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4f844ab1-0fb8-49c7-90e5-67889b67368e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:53.525187 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f844ab1-0fb8-49c7-90e5-67889b67368e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.242853 Jul 26 19:46:53.533910 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 465/992] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:53 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:53.875826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-663da690-8566-4ff8-8da5-01a5daa7b5b3 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:53.886317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-663da690-8566-4ff8-8da5-01a5daa7b5b3 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1535 microversion: 2.1 time: 0.418981 Jul 26 19:46:53.886904 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 528/993] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:53 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1535 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:53.942778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d3146b9-5bfd-4369-b55c-851b4e48d816 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:53.943498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d3146b9-5bfd-4369-b55c-851b4e48d816 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:53.953082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d3146b9-5bfd-4369-b55c-851b4e48d816 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.954798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d3146b9-5bfd-4369-b55c-851b4e48d816 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.955720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d3146b9-5bfd-4369-b55c-851b4e48d816 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.956880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d3146b9-5bfd-4369-b55c-851b4e48d816 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.982280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-efe414ea-ec39-44b2-8266-65c3a4f69ac0 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:53.983067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-efe414ea-ec39-44b2-8266-65c3a4f69ac0 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:53.995264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-efe414ea-ec39-44b2-8266-65c3a4f69ac0 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.996152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-efe414ea-ec39-44b2-8266-65c3a4f69ac0 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:53.997150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-efe414ea-ec39-44b2-8266-65c3a4f69ac0 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:53.997799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-efe414ea-ec39-44b2-8266-65c3a4f69ac0 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.240638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d3146b9-5bfd-4369-b55c-851b4e48d816 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:54.255537 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d3146b9-5bfd-4369-b55c-851b4e48d816 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1501 microversion: 2.1 time: 0.313653 Jul 26 19:46:54.267930 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 466/994] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:53 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:54.273044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38680188-4f60-4313-96a3-2b12cb82dcaa tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:54.273929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38680188-4f60-4313-96a3-2b12cb82dcaa tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:54.280868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38680188-4f60-4313-96a3-2b12cb82dcaa tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.281918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38680188-4f60-4313-96a3-2b12cb82dcaa tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.282783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38680188-4f60-4313-96a3-2b12cb82dcaa tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.283235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38680188-4f60-4313-96a3-2b12cb82dcaa tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.482141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38680188-4f60-4313-96a3-2b12cb82dcaa tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:54.495501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38680188-4f60-4313-96a3-2b12cb82dcaa tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1474 microversion: 2.1 time: 0.237812 Jul 26 19:46:54.496699 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 467/995] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:54 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1474 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:54.502851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a7864b2d-8185-4bd6-a6f7-bc7851221148 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:54.503858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a7864b2d-8185-4bd6-a6f7-bc7851221148 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:54.515134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7864b2d-8185-4bd6-a6f7-bc7851221148 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.515933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7864b2d-8185-4bd6-a6f7-bc7851221148 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.516976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7864b2d-8185-4bd6-a6f7-bc7851221148 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.517585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7864b2d-8185-4bd6-a6f7-bc7851221148 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.640987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-efe414ea-ec39-44b2-8266-65c3a4f69ac0 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:54.680541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-efe414ea-ec39-44b2-8266-65c3a4f69ac0 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 2034 microversion: 2.25 time: 0.701497 Jul 26 19:46:54.682110 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 529/996] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:46:53 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 2034 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:46:54.688742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5d91ef10-9537-4684-baa5-5e22f46a60f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:54.689268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5d91ef10-9537-4684-baa5-5e22f46a60f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:54.694674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a7864b2d-8185-4bd6-a6f7-bc7851221148 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:54.705960 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a7864b2d-8185-4bd6-a6f7-bc7851221148 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.207918 Jul 26 19:46:54.706609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d91ef10-9537-4684-baa5-5e22f46a60f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.707067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d91ef10-9537-4684-baa5-5e22f46a60f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.708367 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 468/997] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:54 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:54.708964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d91ef10-9537-4684-baa5-5e22f46a60f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.709459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d91ef10-9537-4684-baa5-5e22f46a60f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.716760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-64baae54-23cd-4ae5-9dff-3f22aeb9f234 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:54.718068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-64baae54-23cd-4ae5-9dff-3f22aeb9f234 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:54.725172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64baae54-23cd-4ae5-9dff-3f22aeb9f234 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.726107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64baae54-23cd-4ae5-9dff-3f22aeb9f234 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.727093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64baae54-23cd-4ae5-9dff-3f22aeb9f234 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.727745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64baae54-23cd-4ae5-9dff-3f22aeb9f234 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.750190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5d91ef10-9537-4684-baa5-5e22f46a60f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:46:54.753425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:54.855933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5d91ef10-9537-4684-baa5-5e22f46a60f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 204 len: 0 microversion: 2.1 time: 0.172929 Jul 26 19:46:54.857118 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 530/998] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:54 2022] DELETE /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:54.863290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-359dd62b-b673-40f3-99f9-44a17b3d142d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:54.865062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-359dd62b-b673-40f3-99f9-44a17b3d142d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:54.871729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-359dd62b-b673-40f3-99f9-44a17b3d142d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.872180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-359dd62b-b673-40f3-99f9-44a17b3d142d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.873006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-359dd62b-b673-40f3-99f9-44a17b3d142d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.873436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-359dd62b-b673-40f3-99f9-44a17b3d142d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.898715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-64baae54-23cd-4ae5-9dff-3f22aeb9f234 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:54.914385 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-64baae54-23cd-4ae5-9dff-3f22aeb9f234 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 200 len: 1468 microversion: 2.1 time: 0.203625 Jul 26 19:46:54.927649 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 469/999] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:54 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 1468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:54.935879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-708768-8", "block_migration": "auto"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:54.936690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:54.949615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.950853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.951879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:54.952392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:54.980966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'flavor' on Instance uuid 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:55.002249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Going to try to live migrate instance to n-h2-708768-8 {{(pid=125964) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:46:55.210359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-359dd62b-b673-40f3-99f9-44a17b3d142d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:55.225805 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-359dd62b-b673-40f3-99f9-44a17b3d142d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.367305 Jul 26 19:46:55.226853 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 531/1000] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:54 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:55.231844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e61260ac-96c1-41cb-a3ee-6e19be87d740 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:55.232660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e61260ac-96c1-41cb-a3ee-6e19be87d740 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:55.239386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e61260ac-96c1-41cb-a3ee-6e19be87d740 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.240298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e61260ac-96c1-41cb-a3ee-6e19be87d740 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.241373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e61260ac-96c1-41cb-a3ee-6e19be87d740 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.241927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e61260ac-96c1-41cb-a3ee-6e19be87d740 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.493440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e61260ac-96c1-41cb-a3ee-6e19be87d740 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:55.501922 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e61260ac-96c1-41cb-a3ee-6e19be87d740 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1507 microversion: 2.1 time: 0.274022 Jul 26 19:46:55.503807 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 532/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:55 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:55.509327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-96013d74-f337-4e7d-92c7-f2faebbae2f8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:55.510005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-96013d74-f337-4e7d-92c7-f2faebbae2f8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:55.518875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96013d74-f337-4e7d-92c7-f2faebbae2f8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.519409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96013d74-f337-4e7d-92c7-f2faebbae2f8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.521511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96013d74-f337-4e7d-92c7-f2faebbae2f8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.522068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96013d74-f337-4e7d-92c7-f2faebbae2f8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.681281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-96013d74-f337-4e7d-92c7-f2faebbae2f8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:55.690001 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-96013d74-f337-4e7d-92c7-f2faebbae2f8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1535 microversion: 2.1 time: 0.184352 Jul 26 19:46:55.704599 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 533/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:55 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1535 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:55.714182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f157506d-7523-47cf-baf2-a7528774ab75 req-9bdce350-8dad-4951-aaf1-594bb2394bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7", "name": "network-vif-deleted", "tag": "74ed0b59-4c6e-42f4-b1fd-f295f3338802"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:55.731890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f157506d-7523-47cf-baf2-a7528774ab75 req-9bdce350-8dad-4951-aaf1-594bb2394bf3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.732964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f157506d-7523-47cf-baf2-a7528774ab75 req-9bdce350-8dad-4951-aaf1-594bb2394bf3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.748046 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f157506d-7523-47cf-baf2-a7528774ab75 req-9bdce350-8dad-4951-aaf1-594bb2394bf3 service nova] Creating event network-vif-deleted:74ed0b59-4c6e-42f4-b1fd-f295f3338802 for instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 on n-h2-708768-8 Jul 26 19:46:55.754973 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f157506d-7523-47cf-baf2-a7528774ab75 req-9bdce350-8dad-4951-aaf1-594bb2394bf3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049145 Jul 26 19:46:55.755975 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 534/1003] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:55.762174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-851f709a-f671-4b5d-b8dc-e5f23d4b1148 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:55.764694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-851f709a-f671-4b5d-b8dc-e5f23d4b1148 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:55.772104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-851f709a-f671-4b5d-b8dc-e5f23d4b1148 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.772551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-851f709a-f671-4b5d-b8dc-e5f23d4b1148 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.773508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-851f709a-f671-4b5d-b8dc-e5f23d4b1148 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.774189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-851f709a-f671-4b5d-b8dc-e5f23d4b1148 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.811257 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-851f709a-f671-4b5d-b8dc-e5f23d4b1148 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053848 Jul 26 19:46:55.811873 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 535/1004] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:46:55 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:46:55.822660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a87cd5de-d874-40bb-93f1-f6be6fc038d8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:55.823686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a87cd5de-d874-40bb-93f1-f6be6fc038d8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:55.830157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a87cd5de-d874-40bb-93f1-f6be6fc038d8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.830609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a87cd5de-d874-40bb-93f1-f6be6fc038d8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.831393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a87cd5de-d874-40bb-93f1-f6be6fc038d8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.831870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a87cd5de-d874-40bb-93f1-f6be6fc038d8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.919068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a87cd5de-d874-40bb-93f1-f6be6fc038d8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:55.927449 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a87cd5de-d874-40bb-93f1-f6be6fc038d8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1432 microversion: 2.1 time: 0.108626 Jul 26 19:46:55.931837 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 536/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:55 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1432 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:55.933520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b489ec19-2997-4b10-a907-51a5c45f0bb0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:55.934855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b489ec19-2997-4b10-a907-51a5c45f0bb0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:55.941289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b489ec19-2997-4b10-a907-51a5c45f0bb0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.942420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b489ec19-2997-4b10-a907-51a5c45f0bb0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:55.943341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b489ec19-2997-4b10-a907-51a5c45f0bb0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:55.943818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b489ec19-2997-4b10-a907-51a5c45f0bb0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.077303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b489ec19-2997-4b10-a907-51a5c45f0bb0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:56.085321 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b489ec19-2997-4b10-a907-51a5c45f0bb0 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.155871 Jul 26 19:46:56.085893 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 537/1006] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:55 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:56.090569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d77093b6-2700-4c83-aec2-033d8e2a2c9e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:56.092835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d77093b6-2700-4c83-aec2-033d8e2a2c9e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:56.098713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d77093b6-2700-4c83-aec2-033d8e2a2c9e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.099167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d77093b6-2700-4c83-aec2-033d8e2a2c9e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.099976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d77093b6-2700-4c83-aec2-033d8e2a2c9e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.100418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d77093b6-2700-4c83-aec2-033d8e2a2c9e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.128290 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d77093b6-2700-4c83-aec2-033d8e2a2c9e tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041393 Jul 26 19:46:56.128876 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 538/1007] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:46:56 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:46:56.134087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-254467b5-b9b0-420b-836d-e76313f660d0 req-5d41ce8c-8920-4485-a1c3-83013041881a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484a1fc2-81bf-49dc-9ebb-bc32fe409a8a", "name": "network-vif-plugged", "status": "completed", "tag": "d81ba563-1d5c-4679-a3fe-6c199155f7a7"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:56.143551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-254467b5-b9b0-420b-836d-e76313f660d0 req-5d41ce8c-8920-4485-a1c3-83013041881a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.144043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-254467b5-b9b0-420b-836d-e76313f660d0 req-5d41ce8c-8920-4485-a1c3-83013041881a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.156093 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-254467b5-b9b0-420b-836d-e76313f660d0 req-5d41ce8c-8920-4485-a1c3-83013041881a service nova] Creating event network-vif-plugged:d81ba563-1d5c-4679-a3fe-6c199155f7a7 for instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a on n-h2-708768-8 Jul 26 19:46:56.161109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-254467b5-b9b0-420b-836d-e76313f660d0 req-5d41ce8c-8920-4485-a1c3-83013041881a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030379 Jul 26 19:46:56.161728 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 539/1008] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:56.166931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:56.167655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:56.173943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.174390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.175159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.175594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.192433 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] HTTP exception thrown: Instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 could not be found. Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Request method failure captured: Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 HTTP/1.1 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQlrFzSdB4wwJ0pid0A93p7dr-UK8MOU--CiHNUBlql-A-6bP5SKbrSoJgtDMxSFVobi-Gq8VVO3ou5yr8gobZ4dDDCTes6kA7eh4nTgcY0OAzrY2Z68QEPWzfF5VNI6PxvLF4QqbT2Fc3L5eiOjN4MYCPb7F0QK-E_OR7gEX08Wdc Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: aa4bbc1be55b4513a8010a7bc71fbdf5 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aa4bbc1be55b4513a8010a7bc71fbdf5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}] Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: aa4bbc1be55b4513a8010a7bc71fbdf5 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersAdminTestJSON-1989259508-project Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: cb09db7f39f24139a8b9a50bb21c4a3d Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersAdminTestJSON-1989259508-project Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 could not be found. Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7'} Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 could not be found. Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 could not be found. Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:56.194375 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 could not be found. Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Returning 404 to user: Instance 3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5daf55f3-cb74-4052-8d9e-c2a7a2a04cd0 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7" status: 404 len: 111 microversion: 2.1 time: 0.032822 Jul 26 19:46:56.198722 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 540/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:56 2022] GET /compute/v2.1/servers/3b1bd4ff-6014-4ffe-9b99-4a67feb7a8c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:56.201708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df8d4785-e29b-47a9-bb85-68700855d63a tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:56.202199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-df8d4785-e29b-47a9-bb85-68700855d63a tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:56.208851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df8d4785-e29b-47a9-bb85-68700855d63a tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.209355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df8d4785-e29b-47a9-bb85-68700855d63a tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.210128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df8d4785-e29b-47a9-bb85-68700855d63a tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.210577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df8d4785-e29b-47a9-bb85-68700855d63a tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.242073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-df8d4785-e29b-47a9-bb85-68700855d63a tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:46:56.303916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:56.328125 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df8d4785-e29b-47a9-bb85-68700855d63a tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "DELETE /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 204 len: 0 microversion: 2.1 time: 0.125744 Jul 26 19:46:56.328724 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 541/1010] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:56 2022] DELETE /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:56.336405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68a91891-98d7-4e7f-b05d-05b694134412 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:56.337161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68a91891-98d7-4e7f-b05d-05b694134412 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:56.349652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68a91891-98d7-4e7f-b05d-05b694134412 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.350123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68a91891-98d7-4e7f-b05d-05b694134412 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.350900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68a91891-98d7-4e7f-b05d-05b694134412 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.351329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68a91891-98d7-4e7f-b05d-05b694134412 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.376792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68a91891-98d7-4e7f-b05d-05b694134412 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:46:56.453587 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68a91891-98d7-4e7f-b05d-05b694134412 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "DELETE /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 204 len: 0 microversion: 2.1 time: 0.123040 Jul 26 19:46:56.453947 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 542/1011] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:46:56 2022] DELETE /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:56.459545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-77db9415-2a23-4c5a-a69d-a5cd9a7f0907 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:56.460275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-77db9415-2a23-4c5a-a69d-a5cd9a7f0907 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:56.466491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77db9415-2a23-4c5a-a69d-a5cd9a7f0907 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.466981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77db9415-2a23-4c5a-a69d-a5cd9a7f0907 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.467804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77db9415-2a23-4c5a-a69d-a5cd9a7f0907 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.468238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77db9415-2a23-4c5a-a69d-a5cd9a7f0907 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.605102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-77db9415-2a23-4c5a-a69d-a5cd9a7f0907 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:56.612499 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-77db9415-2a23-4c5a-a69d-a5cd9a7f0907 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.157454 Jul 26 19:46:56.613064 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 543/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:56 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:56.618092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ceb36158-726c-4975-9c6a-355b82f6de71 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:56.618694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ceb36158-726c-4975-9c6a-355b82f6de71 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:56.624410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ceb36158-726c-4975-9c6a-355b82f6de71 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.624861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ceb36158-726c-4975-9c6a-355b82f6de71 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.625619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ceb36158-726c-4975-9c6a-355b82f6de71 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.626054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ceb36158-726c-4975-9c6a-355b82f6de71 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.644041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:46:56.758482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ceb36158-726c-4975-9c6a-355b82f6de71 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:56.765988 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ceb36158-726c-4975-9c6a-355b82f6de71 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1680 microversion: 2.1 time: 0.151402 Jul 26 19:46:56.766554 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 544/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:56 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:56.771266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-65bef6a6-4bb5-4777-aab4-26ffbc2406b9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:56.771891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-65bef6a6-4bb5-4777-aab4-26ffbc2406b9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:56.778593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65bef6a6-4bb5-4777-aab4-26ffbc2406b9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.779047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65bef6a6-4bb5-4777-aab4-26ffbc2406b9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.779873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65bef6a6-4bb5-4777-aab4-26ffbc2406b9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.780309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65bef6a6-4bb5-4777-aab4-26ffbc2406b9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.922572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-65bef6a6-4bb5-4777-aab4-26ffbc2406b9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:56.931227 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-65bef6a6-4bb5-4777-aab4-26ffbc2406b9 tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1470 microversion: 2.1 time: 0.163707 Jul 26 19:46:56.931832 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 545/1014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:56 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:56.936417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c37b56cd-d410-4121-8ece-80f8255a7b52 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:56.937013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c37b56cd-d410-4121-8ece-80f8255a7b52 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:56.942811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c37b56cd-d410-4121-8ece-80f8255a7b52 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.943260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c37b56cd-d410-4121-8ece-80f8255a7b52 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:56.944130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c37b56cd-d410-4121-8ece-80f8255a7b52 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:56.944564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c37b56cd-d410-4121-8ece-80f8255a7b52 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.074974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c37b56cd-d410-4121-8ece-80f8255a7b52 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:57.082933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c37b56cd-d410-4121-8ece-80f8255a7b52 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1507 microversion: 2.1 time: 0.149637 Jul 26 19:46:57.083465 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 546/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:56 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:57.087883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e05f677-dbfb-4651-9d73-20efde531e37 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:57.088483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e05f677-dbfb-4651-9d73-20efde531e37 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:57.094043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e05f677-dbfb-4651-9d73-20efde531e37 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.094488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e05f677-dbfb-4651-9d73-20efde531e37 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.095245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e05f677-dbfb-4651-9d73-20efde531e37 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.095706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e05f677-dbfb-4651-9d73-20efde531e37 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.222011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4e05f677-dbfb-4651-9d73-20efde531e37 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:57.230013 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e05f677-dbfb-4651-9d73-20efde531e37 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1541 microversion: 2.1 time: 0.145591 Jul 26 19:46:57.230582 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 547/1016] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:57 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1541 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:57.234992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:57.235589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:57.241137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.241583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.242340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.242776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.272951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.273393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.273918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lazy-loading 'fault' on Instance uuid fb4cd623-5130-4132-8131-104c912de596 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:46:57.317301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:57.324724 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-75612c2e-541e-4311-81d3-3198f363b7a1 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 200 len: 1309 microversion: 2.1 time: 0.093216 Jul 26 19:46:57.325292 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 548/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:57 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:57.329902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73ea04c4-e211-4d88-8bbe-66d1dafb9b5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:57.330498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73ea04c4-e211-4d88-8bbe-66d1dafb9b5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:57.336586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73ea04c4-e211-4d88-8bbe-66d1dafb9b5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.337033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73ea04c4-e211-4d88-8bbe-66d1dafb9b5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.337795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73ea04c4-e211-4d88-8bbe-66d1dafb9b5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.338227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73ea04c4-e211-4d88-8bbe-66d1dafb9b5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.465441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-73ea04c4-e211-4d88-8bbe-66d1dafb9b5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:57.473024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73ea04c4-e211-4d88-8bbe-66d1dafb9b5e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.146801 Jul 26 19:46:57.473592 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 549/1018] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:57 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:57.634581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5b44fa59-eec4-4441-8902-657d64a53dd9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:57.635134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5b44fa59-eec4-4441-8902-657d64a53dd9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:57.641213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b44fa59-eec4-4441-8902-657d64a53dd9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.641658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b44fa59-eec4-4441-8902-657d64a53dd9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.642419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b44fa59-eec4-4441-8902-657d64a53dd9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.642875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b44fa59-eec4-4441-8902-657d64a53dd9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.778769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5b44fa59-eec4-4441-8902-657d64a53dd9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:57.787458 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5b44fa59-eec4-4441-8902-657d64a53dd9 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.156748 Jul 26 19:46:57.788168 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 550/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:57 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:46:57.792467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-aba7dc0f-3f55-4519-a8b8-889f1626e5d5 req-3c62db0a-3d71-42b2-876d-e1db5af395dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4cd623-5130-4132-8131-104c912de596", "name": "network-vif-deleted", "tag": "94413dac-8742-4fca-bf3d-1477ac482021"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:57.803278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aba7dc0f-3f55-4519-a8b8-889f1626e5d5 req-3c62db0a-3d71-42b2-876d-e1db5af395dd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.803748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aba7dc0f-3f55-4519-a8b8-889f1626e5d5 req-3c62db0a-3d71-42b2-876d-e1db5af395dd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.814706 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aba7dc0f-3f55-4519-a8b8-889f1626e5d5 req-3c62db0a-3d71-42b2-876d-e1db5af395dd service nova] Creating event network-vif-deleted:94413dac-8742-4fca-bf3d-1477ac482021 for instance fb4cd623-5130-4132-8131-104c912de596 on n-h1-708768-8 Jul 26 19:46:57.821477 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-aba7dc0f-3f55-4519-a8b8-889f1626e5d5 req-3c62db0a-3d71-42b2-876d-e1db5af395dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032173 Jul 26 19:46:57.822336 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 551/1020] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:57.828174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ec6f48b-37b4-4237-bd19-0d0e139467f5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:57.830091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ec6f48b-37b4-4237-bd19-0d0e139467f5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:57.837059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ec6f48b-37b4-4237-bd19-0d0e139467f5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.837585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ec6f48b-37b4-4237-bd19-0d0e139467f5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:57.838435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ec6f48b-37b4-4237-bd19-0d0e139467f5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:57.838933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ec6f48b-37b4-4237-bd19-0d0e139467f5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.002501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ec6f48b-37b4-4237-bd19-0d0e139467f5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:58.011411 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ec6f48b-37b4-4237-bd19-0d0e139467f5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1680 microversion: 2.1 time: 0.187476 Jul 26 19:46:58.012063 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 552/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:57 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:58.016415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ffd6ea9-4c34-4a3a-b436-a5f635b1af1b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:58.017005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ffd6ea9-4c34-4a3a-b436-a5f635b1af1b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:58.023355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ffd6ea9-4c34-4a3a-b436-a5f635b1af1b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.024231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ffd6ea9-4c34-4a3a-b436-a5f635b1af1b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.025000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ffd6ea9-4c34-4a3a-b436-a5f635b1af1b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.025532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ffd6ea9-4c34-4a3a-b436-a5f635b1af1b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.159397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ffd6ea9-4c34-4a3a-b436-a5f635b1af1b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb09db7f39f24139a8b9a50bb21c4a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bbc1be55b4513a8010a7bc71fbdf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:58.167524 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ffd6ea9-4c34-4a3a-b436-a5f635b1af1b tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 200 len: 1470 microversion: 2.1 time: 0.154510 Jul 26 19:46:58.168231 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 553/1022] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:58 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:58.172731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6375b46c-705b-4064-85eb-e5c1c6c7b3e5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:58.173413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6375b46c-705b-4064-85eb-e5c1c6c7b3e5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:58.179651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6375b46c-705b-4064-85eb-e5c1c6c7b3e5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.180177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6375b46c-705b-4064-85eb-e5c1c6c7b3e5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.181067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6375b46c-705b-4064-85eb-e5c1c6c7b3e5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.181521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6375b46c-705b-4064-85eb-e5c1c6c7b3e5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.451435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6375b46c-705b-4064-85eb-e5c1c6c7b3e5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:58.465772 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6375b46c-705b-4064-85eb-e5c1c6c7b3e5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1507 microversion: 2.1 time: 0.296404 Jul 26 19:46:58.480378 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 554/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:58 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:58.492457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab14220a-7cc4-476b-8558-0de74efaa72f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:58.494858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab14220a-7cc4-476b-8558-0de74efaa72f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:58.505236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab14220a-7cc4-476b-8558-0de74efaa72f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.505852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab14220a-7cc4-476b-8558-0de74efaa72f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.506705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab14220a-7cc4-476b-8558-0de74efaa72f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.507205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab14220a-7cc4-476b-8558-0de74efaa72f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.871529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab14220a-7cc4-476b-8558-0de74efaa72f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:58.881634 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab14220a-7cc4-476b-8558-0de74efaa72f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1536 microversion: 2.1 time: 0.399700 Jul 26 19:46:58.882249 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 555/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:58 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1536 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:58.887601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:58.888279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:58.901520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.902564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.903781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.904428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.924653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] HTTP exception thrown: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Request method failure captured: Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 HTTP/1.1 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESUw9Ab3sy7XFLAFENANa05FTRXa2luW19zn7QSjMB3hmj_gpYA1Ecv7AH41l5ntHy8NkDPjqdBlyDh4MR8VpKd9VkAyewujZS7O02XmjAI6e5nr5e3UYKHNBgGOd_ZbPgpAeF2afWY7EETTICQ6BWEa8dXvzP5MZ530GaFE1TS-gE Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6113ee63ec934bc0b5d4eb9964635785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}] Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ee2737b46af94ceea33cdd0255db0c7a Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'fb4cd623-5130-4132-8131-104c912de596'} Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:46:58.928461 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:58.934105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:46:58.934105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:46:58.934105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:46:58.934105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:46:58.934105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:46:58.934105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:46:58.934105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:46:58.934105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Returning 404 to user: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:46:58.935240 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08fbd46c-4417-4ccd-b922-6aa61b53435f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 404 len: 111 microversion: 2.1 time: 0.051684 Jul 26 19:46:58.936403 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 556/1025] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:58 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:46:58.942332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df4d34f0-ae9a-44a8-b0be-c6d9e60af82f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:58.943272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-df4d34f0-ae9a-44a8-b0be-c6d9e60af82f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:58.950881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df4d34f0-ae9a-44a8-b0be-c6d9e60af82f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.953426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df4d34f0-ae9a-44a8-b0be-c6d9e60af82f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:58.954457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df4d34f0-ae9a-44a8-b0be-c6d9e60af82f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:58.955116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df4d34f0-ae9a-44a8-b0be-c6d9e60af82f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:59.327416 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-427c6cc0-6b46-4d78-aea3-7420c9eb25d7 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3/action" status: 202 len: 0 microversion: 2.25 time: 4.408807 Jul 26 19:46:59.329069 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 470/1026] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 19:46:54 2022] POST /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3/action => generated 0 bytes in 4411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:46:59.335661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5f1388a-89bd-46e4-b3ed-570e075be804 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:59.336680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5f1388a-89bd-46e4-b3ed-570e075be804 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:59.357708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5f1388a-89bd-46e4-b3ed-570e075be804 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:59.358444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5f1388a-89bd-46e4-b3ed-570e075be804 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:59.359947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5f1388a-89bd-46e4-b3ed-570e075be804 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:59.360740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5f1388a-89bd-46e4-b3ed-570e075be804 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:59.374967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-df4d34f0-ae9a-44a8-b0be-c6d9e60af82f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:59.389825 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df4d34f0-ae9a-44a8-b0be-c6d9e60af82f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.450553 Jul 26 19:46:59.404101 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 557/1027] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:58 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:59.422211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b5121410-f132-4e6b-ad7b-ba718c31fc61 req-ad7e82f2-f80c-4206-9fbf-c54b17c25f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e71b9a-35b2-4a19-af94-4917b75573bb", "name": "network-vif-deleted", "tag": "598edcf8-27c7-440a-9784-4e95c216149d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:59.441062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b5121410-f132-4e6b-ad7b-ba718c31fc61 req-ad7e82f2-f80c-4206-9fbf-c54b17c25f5e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:59.441530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b5121410-f132-4e6b-ad7b-ba718c31fc61 req-ad7e82f2-f80c-4206-9fbf-c54b17c25f5e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:59.459480 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b5121410-f132-4e6b-ad7b-ba718c31fc61 req-ad7e82f2-f80c-4206-9fbf-c54b17c25f5e service nova] Creating event network-vif-deleted:598edcf8-27c7-440a-9784-4e95c216149d for instance 21e71b9a-35b2-4a19-af94-4917b75573bb on n-h1-708768-8 Jul 26 19:46:59.467281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b5121410-f132-4e6b-ad7b-ba718c31fc61 req-ad7e82f2-f80c-4206-9fbf-c54b17c25f5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048395 Jul 26 19:46:59.468339 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 558/1028] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:46:59.476609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-716795482", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:46:59.558455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:46:59.700750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c5f1388a-89bd-46e4-b3ed-570e075be804 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:46:59.723603 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5f1388a-89bd-46e4-b3ed-570e075be804 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1317 microversion: 2.1 time: 0.392995 Jul 26 19:46:59.732479 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 471/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:59 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:46:59.737690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d0b904b8-6d0f-4ba6-85ba-7e57aee72fc5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:46:59.738788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d0b904b8-6d0f-4ba6-85ba-7e57aee72fc5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:46:59.750250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0b904b8-6d0f-4ba6-85ba-7e57aee72fc5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:59.755652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0b904b8-6d0f-4ba6-85ba-7e57aee72fc5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:59.756772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0b904b8-6d0f-4ba6-85ba-7e57aee72fc5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:59.757449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0b904b8-6d0f-4ba6-85ba-7e57aee72fc5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:59.963080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:46:59.963596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:46:59.963982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:46:59.964572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:46:59.965129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:46:59.975032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:59.975920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:46:59.976896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:46:59.977503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.000914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Getting quotas for project 6113ee63ec934bc0b5d4eb9964635785. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:00.007183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Getting quotas for user ee2737b46af94ceea33cdd0255db0c7a and project 6113ee63ec934bc0b5d4eb9964635785. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:00.012361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d0b904b8-6d0f-4ba6-85ba-7e57aee72fc5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:00.019743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:47:00.025607 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d0b904b8-6d0f-4ba6-85ba-7e57aee72fc5 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1680 microversion: 2.1 time: 0.286052 Jul 26 19:47:00.025607 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 472/1030] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:46:59 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:00.028995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:00.033659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] [instance: 21e71b9a-35b2-4a19-af94-4917b75573bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:00.046557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.048363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:47:00.056457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.057323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.057773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.087841 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] HTTP exception thrown: Instance 21e71b9a-35b2-4a19-af94-4917b75573bb could not be found. Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Request method failure captured: Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb HTTP/1.1 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQlrFzSdB4wwJ0pid0A93p7dr-UK8MOU--CiHNUBlql-A-6bP5SKbrSoJgtDMxSFVobi-Gq8VVO3ou5yr8gobZ4dDDCTes6kA7eh4nTgcY0OAzrY2Z68QEPWzfF5VNI6PxvLF4QqbT2Fc3L5eiOjN4MYCPb7F0QK-E_OR7gEX08Wdc Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: aa4bbc1be55b4513a8010a7bc71fbdf5 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aa4bbc1be55b4513a8010a7bc71fbdf5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aa4bbc1be55b4513a8010a7bc71fbdf5"}]}] Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: aa4bbc1be55b4513a8010a7bc71fbdf5 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersAdminTestJSON-1989259508 Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersAdminTestJSON-1989259508-project Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: cb09db7f39f24139a8b9a50bb21c4a3d Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersAdminTestJSON-1989259508-project Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 21e71b9a-35b2-4a19-af94-4917b75573bb could not be found. Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '21e71b9a-35b2-4a19-af94-4917b75573bb'} Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e71b9a-35b2-4a19-af94-4917b75573bb could not be found. Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e71b9a-35b2-4a19-af94-4917b75573bb could not be found. Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:00.089399 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e71b9a-35b2-4a19-af94-4917b75573bb could not be found. Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] Returning 404 to user: Instance 21e71b9a-35b2-4a19-af94-4917b75573bb could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:00.094553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6951803d-2bc7-4b41-b4bf-b1c8c7ae2dab tempest-ServersAdminTestJSON-1989259508 tempest-ServersAdminTestJSON-1989259508-project] 10.222.0.58 "GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb" status: 404 len: 111 microversion: 2.1 time: 0.065855 Jul 26 19:47:00.104293 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 473/1031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:00 2022] GET /compute/v2.1/servers/21e71b9a-35b2-4a19-af94-4917b75573bb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:00.119966 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e51b30b-8520-4f72-b9f9-314decf8ac88 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648795 Jul 26 19:47:00.120428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:00.122389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:00.127958 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 559/1032] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:47:00.134017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:00.134885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:00.142389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:00.146508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.147043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.147822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.148260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.179753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.188236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.189306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.191221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.282639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.283460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.284855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lazy-loading 'fault' on Instance uuid f8fe3d9a-2c77-474b-b76c-18e646136479 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:00.450936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:00.469005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:00.472325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:00.475143 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f2f22996-af3b-49ad-8f9f-384d1d4e2c28 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1567 microversion: 2.25 time: 0.369396 Jul 26 19:47:00.476547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 474/1033] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:00 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1567 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:00.482556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2150d746-26ac-4f61-a213-2599d76ada18 req-5d583598-c000-4b2b-90e6-e49ddd0ab66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fe3d9a-2c77-474b-b76c-18e646136479", "name": "network-vif-deleted", "tag": "e911674c-dd59-4561-9287-90324fc2f2e7"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:00.497837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2150d746-26ac-4f61-a213-2599d76ada18 req-5d583598-c000-4b2b-90e6-e49ddd0ab66a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.498785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2150d746-26ac-4f61-a213-2599d76ada18 req-5d583598-c000-4b2b-90e6-e49ddd0ab66a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.514561 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2150d746-26ac-4f61-a213-2599d76ada18 req-5d583598-c000-4b2b-90e6-e49ddd0ab66a service nova] Creating event network-vif-deleted:e911674c-dd59-4561-9287-90324fc2f2e7 for instance f8fe3d9a-2c77-474b-b76c-18e646136479 on n-h1-708768-8 Jul 26 19:47:00.524409 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2150d746-26ac-4f61-a213-2599d76ada18 req-5d583598-c000-4b2b-90e6-e49ddd0ab66a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045027 Jul 26 19:47:00.526447 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 475/1034] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:00.537564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ca8f12f-2f19-4653-a256-91a3c9a8f1d9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:00.539878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ca8f12f-2f19-4653-a256-91a3c9a8f1d9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:00.552970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ca8f12f-2f19-4653-a256-91a3c9a8f1d9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.554911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ca8f12f-2f19-4653-a256-91a3c9a8f1d9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.555864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ca8f12f-2f19-4653-a256-91a3c9a8f1d9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.556821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ca8f12f-2f19-4653-a256-91a3c9a8f1d9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.659451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:00.671217 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-912df99c-1113-4d09-b876-3a3835345583 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 200 len: 1305 microversion: 2.1 time: 0.541431 Jul 26 19:47:00.672111 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 560/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:00 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 1305 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:00.684192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-57c6aedc-5156-4df8-8ff6-14d225a7d673 req-a36703ce-9326-4c5d-a13b-26e98bce03e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91a2c0b-cbe3-4c61-ae77-6878c69fd643", "name": "network-vif-plugged", "status": "completed", "tag": "36b30dac-cbda-4a1f-8d27-44b3ec8f9014"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:00.725466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-57c6aedc-5156-4df8-8ff6-14d225a7d673 req-a36703ce-9326-4c5d-a13b-26e98bce03e9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.726179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-57c6aedc-5156-4df8-8ff6-14d225a7d673 req-a36703ce-9326-4c5d-a13b-26e98bce03e9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.750622 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-57c6aedc-5156-4df8-8ff6-14d225a7d673 req-a36703ce-9326-4c5d-a13b-26e98bce03e9 service nova] Creating event network-vif-plugged:36b30dac-cbda-4a1f-8d27-44b3ec8f9014 for instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 on n-h1-708768-8 Jul 26 19:47:00.759736 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-57c6aedc-5156-4df8-8ff6-14d225a7d673 req-a36703ce-9326-4c5d-a13b-26e98bce03e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083687 Jul 26 19:47:00.760520 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 561/1036] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:00.769279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c3aaaf9-9a33-4fb4-88bc-9bed43835f92 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:00.770888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8c3aaaf9-9a33-4fb4-88bc-9bed43835f92 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:00.850767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8c3aaaf9-9a33-4fb4-88bc-9bed43835f92 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:00.861880 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c3aaaf9-9a33-4fb4-88bc-9bed43835f92 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1219 microversion: 2.1 time: 0.098328 Jul 26 19:47:00.862230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ca8f12f-2f19-4653-a256-91a3c9a8f1d9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:00.868163 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 562/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:00 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:00.870779 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ca8f12f-2f19-4653-a256-91a3c9a8f1d9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1523 microversion: 2.1 time: 0.342687 Jul 26 19:47:00.881476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22ef8f07-d8d3-46c6-9755-27a6b0645696 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:00.882476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-22ef8f07-d8d3-46c6-9755-27a6b0645696 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:00.884479 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 476/1038] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:00 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:00.889578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-009b85b2-2dd0-4164-ac6e-f30c762cd2b1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:00.890187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-009b85b2-2dd0-4164-ac6e-f30c762cd2b1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:00.897055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-009b85b2-2dd0-4164-ac6e-f30c762cd2b1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.898336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-009b85b2-2dd0-4164-ac6e-f30c762cd2b1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.899416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-009b85b2-2dd0-4164-ac6e-f30c762cd2b1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.900191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-009b85b2-2dd0-4164-ac6e-f30c762cd2b1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.913559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22ef8f07-d8d3-46c6-9755-27a6b0645696 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.915294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22ef8f07-d8d3-46c6-9755-27a6b0645696 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:00.928898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22ef8f07-d8d3-46c6-9755-27a6b0645696 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:00.930424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22ef8f07-d8d3-46c6-9755-27a6b0645696 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.201484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-009b85b2-2dd0-4164-ac6e-f30c762cd2b1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:01.212699 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-009b85b2-2dd0-4164-ac6e-f30c762cd2b1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1467 microversion: 2.1 time: 0.325811 Jul 26 19:47:01.214344 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 477/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:00 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:01.224945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e3fe808a-1c6c-432a-bb75-f84a57b627c4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:01.226888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e3fe808a-1c6c-432a-bb75-f84a57b627c4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:01.229096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22ef8f07-d8d3-46c6-9755-27a6b0645696 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:01.236766 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22ef8f07-d8d3-46c6-9755-27a6b0645696 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.366945 Jul 26 19:47:01.237875 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 563/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:00 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:01.242622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3fe808a-1c6c-432a-bb75-f84a57b627c4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.243369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:01.244183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:01.246394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3fe808a-1c6c-432a-bb75-f84a57b627c4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.247191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3fe808a-1c6c-432a-bb75-f84a57b627c4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.247832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3fe808a-1c6c-432a-bb75-f84a57b627c4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.250692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.251311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.252285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.252879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.281231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:01.290062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e3fe808a-1c6c-432a-bb75-f84a57b627c4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:01.347386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.348459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.351151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lazy-loading 'fault' on Instance uuid 94ef3743-f705-4e52-bb3c-e5891eab0512 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:01.357045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:01.377559 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e3fe808a-1c6c-432a-bb75-f84a57b627c4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 204 len: 0 microversion: 2.1 time: 0.160366 Jul 26 19:47:01.378636 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 478/1041] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:01 2022] DELETE /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:01.384826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a53a887-f99b-41e6-bd3c-c9bf2b37008c tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:01.385790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a53a887-f99b-41e6-bd3c-c9bf2b37008c tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:01.393229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a53a887-f99b-41e6-bd3c-c9bf2b37008c tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.393965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a53a887-f99b-41e6-bd3c-c9bf2b37008c tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.395177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a53a887-f99b-41e6-bd3c-c9bf2b37008c tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.395853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a53a887-f99b-41e6-bd3c-c9bf2b37008c tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.452845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0674f08c34d19b6e6be8760ee7b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6b28ebe6e4d06b4455356d52e6973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:01.473750 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-81059b19-1a03-453c-a430-5c08d628226c tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 200 len: 1332 microversion: 2.1 time: 0.232672 Jul 26 19:47:01.484948 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 564/1042] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:01 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 1332 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:01.497195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41a1c447-7c19-4011-b662-e3eca63a1fcf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:01.497782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41a1c447-7c19-4011-b662-e3eca63a1fcf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:01.509863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41a1c447-7c19-4011-b662-e3eca63a1fcf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.510764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41a1c447-7c19-4011-b662-e3eca63a1fcf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.511972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41a1c447-7c19-4011-b662-e3eca63a1fcf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.513008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41a1c447-7c19-4011-b662-e3eca63a1fcf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.803893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-41a1c447-7c19-4011-b662-e3eca63a1fcf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:01.814303 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41a1c447-7c19-4011-b662-e3eca63a1fcf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1529 microversion: 2.1 time: 0.327682 Jul 26 19:47:01.818495 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 565/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:01 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1529 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:01.835978 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a53a887-f99b-41e6-bd3c-c9bf2b37008c tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1618 microversion: 2.1 time: 0.455192 Jul 26 19:47:01.843247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:01.843947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:01.852099 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 479/1044] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:01 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1618 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:01.867319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.867958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.868754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.869220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.877447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e782a7d0-2f87-44a7-8d12-aec2ce4aaa2c req-f5561f84-31a9-4e01-b85b-2c9bb7c017d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3", "name": "network-vif-unplugged", "status": "completed", "tag": "3f861fc9-a37c-4773-a6a3-1162bda6dcd8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:01.892502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e782a7d0-2f87-44a7-8d12-aec2ce4aaa2c req-f5561f84-31a9-4e01-b85b-2c9bb7c017d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.892956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e782a7d0-2f87-44a7-8d12-aec2ce4aaa2c req-f5561f84-31a9-4e01-b85b-2c9bb7c017d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.925732 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e782a7d0-2f87-44a7-8d12-aec2ce4aaa2c req-f5561f84-31a9-4e01-b85b-2c9bb7c017d1 service nova] Creating event network-vif-unplugged:3f861fc9-a37c-4773-a6a3-1162bda6dcd8 for instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 on n-h1-708768-8 Jul 26 19:47:01.931196 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e782a7d0-2f87-44a7-8d12-aec2ce4aaa2c req-f5561f84-31a9-4e01-b85b-2c9bb7c017d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076942 Jul 26 19:47:01.935969 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 480/1045] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:01.941239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:01.942500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:01.959947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.960402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.961197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:01.961637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:01.995210 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 HTTP/1.1 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f8fe3d9a-2c77-474b-b76c-18e646136479'} Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:01.997214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:02.002181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:02.002181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:02.002181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:02.002181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:02.002181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:02.002181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:47:02.002181 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:02.003579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:02.005481 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-177b005b-1db5-4b90-a08a-4939348273df tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 404 len: 111 microversion: 2.1 time: 0.068083 Jul 26 19:47:02.017574 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 481/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:01 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:02.024185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c6c472f3-d5a1-4574-a31b-52b88c179769 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:02.025215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c6c472f3-d5a1-4574-a31b-52b88c179769 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:02.032184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6c472f3-d5a1-4574-a31b-52b88c179769 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:02.033045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6c472f3-d5a1-4574-a31b-52b88c179769 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:02.034075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6c472f3-d5a1-4574-a31b-52b88c179769 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:02.034748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6c472f3-d5a1-4574-a31b-52b88c179769 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:02.177759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:02.188425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:02.190107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:02.191323 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55d2f8c8-f7b7-467e-9822-f51d119a15e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1567 microversion: 2.25 time: 0.371912 Jul 26 19:47:02.203640 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 566/1047] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:01 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1567 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:02.203640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1321204702", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "46c80442-0e57-4d48-bc28-6682ae824154"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:02.228694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c6c472f3-d5a1-4574-a31b-52b88c179769 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:02.243143 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c6c472f3-d5a1-4574-a31b-52b88c179769 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1279 microversion: 2.1 time: 0.222227 Jul 26 19:47:02.245151 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 482/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:02 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:02.256780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:47:02.259968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1447011319", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d609008d-caf9-4f78-8a5e-41e510179ad2"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:02.331891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] validate_networks() for [('d609008d-caf9-4f78-8a5e-41e510179ad2', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:47:02.549051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:47:02.549739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:47:02.550536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:47:02.551949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:47:02.552597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:47:02.569517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:02.570630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:02.572357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:02.573013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:02.614077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:02.643521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Getting quotas for user 0bf1dac22e284b15b0e93146dc756338 and project 5b66d3923b4a4d3dacfa2c53f5af1ac1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:02.653857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:02.675364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:47:02.678641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:47:02.787044 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b0134b8-ae72-4bbf-a732-d3d4663d3c02 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592914 Jul 26 19:47:02.809322 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 567/1049] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:47:02.814820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa8f95ca-ee28-417b-8b30-1c8bad9b6cca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:02.815449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fa8f95ca-ee28-417b-8b30-1c8bad9b6cca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:02.842488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:02.860601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa8f95ca-ee28-417b-8b30-1c8bad9b6cca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:02.861335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa8f95ca-ee28-417b-8b30-1c8bad9b6cca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:02.863337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa8f95ca-ee28-417b-8b30-1c8bad9b6cca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:02.881322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa8f95ca-ee28-417b-8b30-1c8bad9b6cca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.233851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fa8f95ca-ee28-417b-8b30-1c8bad9b6cca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:03.248670 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa8f95ca-ee28-417b-8b30-1c8bad9b6cca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.437489 Jul 26 19:47:03.251707 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 568/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:02 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:03.258376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:03.261498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:03.281635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.283231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.284534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.285562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.307795 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] HTTP exception thrown: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Request method failure captured: Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 HTTP/1.1 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQHuR1E5E_AZU656iQ9lK8hXwxEGGLy6IPIInEp_qgEsvZ-Ibh4mKbQjATuD-2m_8PFexD4uUNOzGx8FvUfXT9AzV5G1dAAkU0zgfWlKafsEqHT2qOaFVlBn_E_XkXkoOH_ElvzXjO8KVogcTibbIgvotG5Llbrs_dYSFTpZMr3iAA Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fbe6b28ebe6e4d06b4455356d52e6973 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fbe6b28ebe6e4d06b4455356d52e6973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe6b28ebe6e4d06b4455356d52e6973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fbe6b28ebe6e4d06b4455356d52e6973", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe6b28ebe6e4d06b4455356d52e6973"}]}] Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fbe6b28ebe6e4d06b4455356d52e6973 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachSCSIVolumeTestJSON-783765905-project Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 43d0674f08c34d19b6e6be8760ee7b34 Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-783765905-project Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '94ef3743-f705-4e52-bb3c-e5891eab0512'} Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:03.311187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:03.315307 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:03.315307 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:03.315307 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:03.315307 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:03.315307 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:03.315307 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:03.315307 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:03.319157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Returning 404 to user: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:03.321614 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41f92932-352b-4cd1-8073-f0cd30a70c48 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 404 len: 111 microversion: 2.1 time: 0.067907 Jul 26 19:47:03.322778 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 569/1051] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:03 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:03.331540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-557f37ca-0217-4f37-8c93-0a4fe3a90001 req-cf0b324a-4a5b-434e-a488-8e26e2507213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ef3743-f705-4e52-bb3c-e5891eab0512", "name": "network-vif-deleted", "tag": "3d99ffec-3261-4711-ad8b-3f9d9b36eec8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:03.346157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-557f37ca-0217-4f37-8c93-0a4fe3a90001 req-cf0b324a-4a5b-434e-a488-8e26e2507213 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.348486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-557f37ca-0217-4f37-8c93-0a4fe3a90001 req-cf0b324a-4a5b-434e-a488-8e26e2507213 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.372633 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-557f37ca-0217-4f37-8c93-0a4fe3a90001 req-cf0b324a-4a5b-434e-a488-8e26e2507213 service nova] Creating event network-vif-deleted:3d99ffec-3261-4711-ad8b-3f9d9b36eec8 for instance 94ef3743-f705-4e52-bb3c-e5891eab0512 on n-h2-708768-8 Jul 26 19:47:03.381771 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-557f37ca-0217-4f37-8c93-0a4fe3a90001 req-cf0b324a-4a5b-434e-a488-8e26e2507213 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056577 Jul 26 19:47:03.383509 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 570/1052] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:03.389448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4c88ae0-c7a3-49c8-86ac-25d420d2986a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:03.390760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4c88ae0-c7a3-49c8-86ac-25d420d2986a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:03.536069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:47:03.536758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:47:03.537153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:47:03.537656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:47:03.538159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:47:03.550920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.557306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.557306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.557306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.585276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a4c88ae0-c7a3-49c8-86ac-25d420d2986a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:03.594534 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4c88ae0-c7a3-49c8-86ac-25d420d2986a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1217 microversion: 2.1 time: 0.209507 Jul 26 19:47:03.598926 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 571/1053] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:03 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1217 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:03.604785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e09353cf-f51e-4981-88b0-c8d735cc1258 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:03.605600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e09353cf-f51e-4981-88b0-c8d735cc1258 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:03.620397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:03.620569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e09353cf-f51e-4981-88b0-c8d735cc1258 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.620870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e09353cf-f51e-4981-88b0-c8d735cc1258 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.625117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e09353cf-f51e-4981-88b0-c8d735cc1258 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.628435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e09353cf-f51e-4981-88b0-c8d735cc1258 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.635191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for user 4e8808ff2c4341eca66334700ec25a82 and project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:03.673722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:47:03.676376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:47:03.790514 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2df1b1b0-3f15-4658-9155-980b76ca6dbc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538699 Jul 26 19:47:03.793923 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 483/1054] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:47:03.825215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-12abcf52-597f-4002-81dc-785bf9171ab5 req-121694c8-7f39-4c22-a79f-c5f01df1bbfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91a2c0b-cbe3-4c61-ae77-6878c69fd643", "name": "network-vif-unplugged", "status": "completed", "tag": "36b30dac-cbda-4a1f-8d27-44b3ec8f9014"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:03.846043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-12abcf52-597f-4002-81dc-785bf9171ab5 req-121694c8-7f39-4c22-a79f-c5f01df1bbfb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.848089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-12abcf52-597f-4002-81dc-785bf9171ab5 req-121694c8-7f39-4c22-a79f-c5f01df1bbfb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.869276 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-12abcf52-597f-4002-81dc-785bf9171ab5 req-121694c8-7f39-4c22-a79f-c5f01df1bbfb service nova] Creating event network-vif-unplugged:36b30dac-cbda-4a1f-8d27-44b3ec8f9014 for instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 on n-h1-708768-8 Jul 26 19:47:03.878368 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-12abcf52-597f-4002-81dc-785bf9171ab5 req-121694c8-7f39-4c22-a79f-c5f01df1bbfb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074964 Jul 26 19:47:03.880269 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 484/1055] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:03.888409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:03.889374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:03.903399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.903885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.905146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:03.905146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:03.972638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e09353cf-f51e-4981-88b0-c8d735cc1258 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:03.991497 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e09353cf-f51e-4981-88b0-c8d735cc1258 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1529 microversion: 2.1 time: 0.391201 Jul 26 19:47:03.992187 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 572/1056] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:03 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1529 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:04.010794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7dec13f9-3186-4353-8754-a6cbc15aa4c6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:04.011453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7dec13f9-3186-4353-8754-a6cbc15aa4c6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:04.021317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7dec13f9-3186-4353-8754-a6cbc15aa4c6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:04.022058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7dec13f9-3186-4353-8754-a6cbc15aa4c6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:04.023158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7dec13f9-3186-4353-8754-a6cbc15aa4c6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:04.023860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7dec13f9-3186-4353-8754-a6cbc15aa4c6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:04.121949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7dec13f9-3186-4353-8754-a6cbc15aa4c6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:04.138944 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7dec13f9-3186-4353-8754-a6cbc15aa4c6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1277 microversion: 2.1 time: 0.142372 Jul 26 19:47:04.139731 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 573/1057] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:03 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:04.146811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18914c29-3bf0-4a32-ae84-59886f59b1a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '.version_select at 0x7f875ef94790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:04.189814 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18914c29-3bf0-4a32-ae84-59886f59b1a4 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1968079449" status: 202 len: 0 microversion: 2.1 time: 0.047879 Jul 26 19:47:04.190420 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 574/1058] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 19:47:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1968079449 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:04.198299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7ee417e3-f883-4b10-8ff4-c5f122740878 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:04.199122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7ee417e3-f883-4b10-8ff4-c5f122740878 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:04.249706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:04.265689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:04.273792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:04.278952 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-542e313b-da09-43cf-87f7-dbb6524eaffa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1567 microversion: 2.25 time: 0.396936 Jul 26 19:47:04.281640 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 485/1059] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:03 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1567 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:04.291833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-cb786732-670e-4e7e-8482-fd4365866918 req-d446d0b1-9f83-4eac-9bf4-0a531456bad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3", "tag": "3f861fc9-a37c-4773-a6a3-1162bda6dcd8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:04.309436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ee417e3-f883-4b10-8ff4-c5f122740878 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:04.326374 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7ee417e3-f883-4b10-8ff4-c5f122740878 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1215 microversion: 2.1 time: 0.134535 Jul 26 19:47:04.327250 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 575/1060] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:04 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:04.329708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cb786732-670e-4e7e-8482-fd4365866918 req-d446d0b1-9f83-4eac-9bf4-0a531456bad6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:04.330412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cb786732-670e-4e7e-8482-fd4365866918 req-d446d0b1-9f83-4eac-9bf4-0a531456bad6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:04.366116 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-cb786732-670e-4e7e-8482-fd4365866918 req-d446d0b1-9f83-4eac-9bf4-0a531456bad6 service nova] Creating event network-changed:3f861fc9-a37c-4773-a6a3-1162bda6dcd8 for instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 on n-h1-708768-8 Jul 26 19:47:04.376744 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-cb786732-670e-4e7e-8482-fd4365866918 req-d446d0b1-9f83-4eac-9bf4-0a531456bad6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092381 Jul 26 19:47:04.377494 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 486/1061] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:04.403078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e4783ab5-5a8c-4bc4-8cb3-d37d0acb6598 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:04.406305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e4783ab5-5a8c-4bc4-8cb3-d37d0acb6598 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:04.416075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4783ab5-5a8c-4bc4-8cb3-d37d0acb6598 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:04.416805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4783ab5-5a8c-4bc4-8cb3-d37d0acb6598 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:04.417762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4783ab5-5a8c-4bc4-8cb3-d37d0acb6598 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:04.418348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4783ab5-5a8c-4bc4-8cb3-d37d0acb6598 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:04.521944 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22b967cb-4ff9-4e02-9a47-caa3b4b69d67 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] 10.222.0.58 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.190198 Jul 26 19:47:04.522492 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 576/1062] 10.222.0.58 () {58 vars in 1128 bytes} [Tue Jul 26 19:47:04 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 19:47:04.532895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6eed54da-beea-4225-b543-97d96969aadf tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Calling method '.version_select at 0x7f875efc2ca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:04.602491 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-6eed54da-beea-4225-b543-97d96969aadf tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] HTTP exception thrown: Image not found. Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6eed54da-beea-4225-b543-97d96969aadf tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Request method failure captured: Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ES36ztgU7e_rkMkwye9yaVQKoFwRVjYtJeGWphSHBkPrXU3q7svdcV4bjHj-VBiazAQdR7x1CntT2zjYReUZ9ky8QlfSJOU0OL-MI8WgNQ_vECPrB1LIk8L6C1rTXUZFXvMlPGfnQIa_96PpnDA01Jw3pJvppTofR1HQJyet_NdNVg Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3246a1e232b423095f6cb4508eab8a7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}] Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 47d5c19e393648fca78764ad1d44389d Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '-1'} Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:04.612915 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:47:04.619541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:04.624185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6eed54da-beea-4225-b543-97d96969aadf tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:04.626148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6eed54da-beea-4225-b543-97d96969aadf tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] 10.222.0.58 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.096976 Jul 26 19:47:04.631631 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 577/1063] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Jul 26 19:47:04 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:47:04.641713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-009de2c5-b53c-40ad-aa36-b78f8446edee tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:04.642643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-009de2c5-b53c-40ad-aa36-b78f8446edee tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:04.652760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-009de2c5-b53c-40ad-aa36-b78f8446edee tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:04.654289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-009de2c5-b53c-40ad-aa36-b78f8446edee tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:04.655400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-009de2c5-b53c-40ad-aa36-b78f8446edee tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:04.656112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-009de2c5-b53c-40ad-aa36-b78f8446edee tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:04.950803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-009de2c5-b53c-40ad-aa36-b78f8446edee tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:04.962247 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-009de2c5-b53c-40ad-aa36-b78f8446edee tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1275 microversion: 2.1 time: 0.327653 Jul 26 19:47:04.964707 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 578/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:04 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1275 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:04.978307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37fa921f-9242-4a11-aa32-c8fd5818b777 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Calling method '.version_select at 0x7f875efdd3a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.008976 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-37fa921f-9242-4a11-aa32-c8fd5818b777 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] HTTP exception thrown: Image not found. Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37fa921f-9242-4a11-aa32-c8fd5818b777 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Request method failure captured: Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/65d0eb35-fee9-4366-8623-30591936d0dj HTTP/1.1 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ES36ztgU7e_rkMkwye9yaVQKoFwRVjYtJeGWphSHBkPrXU3q7svdcV4bjHj-VBiazAQdR7x1CntT2zjYReUZ9ky8QlfSJOU0OL-MI8WgNQ_vECPrB1LIk8L6C1rTXUZFXvMlPGfnQIa_96PpnDA01Jw3pJvppTofR1HQJyet_NdNVg Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3246a1e232b423095f6cb4508eab8a7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}] Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 47d5c19e393648fca78764ad1d44389d Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '65d0eb35-fee9-4366-8623-30591936d0dj'} Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 65d0eb35-fee9-4366-8623-30591936d0dj to delete Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65d0eb35-fee9-4366-8623-30591936d0dj could not be found. Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.015124 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:47:05.020034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.023057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37fa921f-9242-4a11-aa32-c8fd5818b777 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:05.024174 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37fa921f-9242-4a11-aa32-c8fd5818b777 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] 10.222.0.58 "DELETE /compute/v2.1/images/65d0eb35-fee9-4366-8623-30591936d0dj" status: 404 len: 62 microversion: 2.1 time: 0.058131 Jul 26 19:47:05.030999 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 579/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:04 2022] DELETE /compute/v2.1/images/65d0eb35-fee9-4366-8623-30591936d0dj => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:47:05.039897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.040678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:05.049091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.049802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.050754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.051937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.095818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.096516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.097169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lazy-loading 'fault' on Instance uuid f91a2c0b-cbe3-4c61-ae77-6878c69fd643 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:05.107699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e4783ab5-5a8c-4bc4-8cb3-d37d0acb6598 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:05.118616 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e4783ab5-5a8c-4bc4-8cb3-d37d0acb6598 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.739611 Jul 26 19:47:05.119301 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 487/1066] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:04 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:05.124979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-464d7225-3ba3-419c-926d-f599063bc349 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Calling method '.version_select at 0x7f8756fbf0d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.163425 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-464d7225-3ba3-419c-926d-f599063bc349 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] HTTP exception thrown: Image not found. Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-464d7225-3ba3-419c-926d-f599063bc349 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Request method failure captured: Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/images/05ae0fe8-61f2-4abe-b60c-32fe3577aedf1 HTTP/1.1 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ES36ztgU7e_rkMkwye9yaVQKoFwRVjYtJeGWphSHBkPrXU3q7svdcV4bjHj-VBiazAQdR7x1CntT2zjYReUZ9ky8QlfSJOU0OL-MI8WgNQ_vECPrB1LIk8L6C1rTXUZFXvMlPGfnQIa_96PpnDA01Jw3pJvppTofR1HQJyet_NdNVg Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3246a1e232b423095f6cb4508eab8a7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}] Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 47d5c19e393648fca78764ad1d44389d Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: exception: Image not found. Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '05ae0fe8-61f2-4abe-b60c-32fe3577aedf1'} Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 05ae0fe8-61f2-4abe-b60c-32fe3577aedf1 to delete Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 05ae0fe8-61f2-4abe-b60c-32fe3577aedf1 could not be found. Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.165763 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:47:05.169996 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.173065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-464d7225-3ba3-419c-926d-f599063bc349 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Returning 404 to user: Image not found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:05.174146 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-464d7225-3ba3-419c-926d-f599063bc349 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] 10.222.0.58 "DELETE /compute/v2.1/images/05ae0fe8-61f2-4abe-b60c-32fe3577aedf1" status: 404 len: 62 microversion: 2.1 time: 0.053441 Jul 26 19:47:05.180906 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 488/1067] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:05 2022] DELETE /compute/v2.1/images/05ae0fe8-61f2-4abe-b60c-32fe3577aedf1 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:47:05.186142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-72238fda-84fd-4d6e-994a-1a92cd2dd5f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.186976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-72238fda-84fd-4d6e-994a-1a92cd2dd5f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:05.198265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72238fda-84fd-4d6e-994a-1a92cd2dd5f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.199028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72238fda-84fd-4d6e-994a-1a92cd2dd5f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.200061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72238fda-84fd-4d6e-994a-1a92cd2dd5f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.200684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72238fda-84fd-4d6e-994a-1a92cd2dd5f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.207012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:05.219915 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0bab85d3-77a5-4d8c-8d21-5554ee23d601 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 200 len: 1315 microversion: 2.1 time: 0.185923 Jul 26 19:47:05.221920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 580/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:05 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:05.232995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df0a1862-3847-4f2c-9a98-0aed1a1c9eba tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Calling method '.version_select at 0x7f875efdd550>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.265684 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-df0a1862-3847-4f2c-9a98-0aed1a1c9eba tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] HTTP exception thrown: Image not found. Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df0a1862-3847-4f2c-9a98-0aed1a1c9eba tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Request method failure captured: Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/tempest-invalid-1254214848 HTTP/1.1 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ES36ztgU7e_rkMkwye9yaVQKoFwRVjYtJeGWphSHBkPrXU3q7svdcV4bjHj-VBiazAQdR7x1CntT2zjYReUZ9ky8QlfSJOU0OL-MI8WgNQ_vECPrB1LIk8L6C1rTXUZFXvMlPGfnQIa_96PpnDA01Jw3pJvppTofR1HQJyet_NdNVg Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3246a1e232b423095f6cb4508eab8a7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}] Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 47d5c19e393648fca78764ad1d44389d Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'tempest-invalid-1254214848'} Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1254214848 to delete Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1254214848 could not be found. Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.268435 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.273017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df0a1862-3847-4f2c-9a98-0aed1a1c9eba tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:05.283173 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df0a1862-3847-4f2c-9a98-0aed1a1c9eba tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] 10.222.0.58 "DELETE /compute/v2.1/images/tempest-invalid-1254214848" status: 404 len: 62 microversion: 2.1 time: 0.048109 Jul 26 19:47:05.284238 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 581/1069] 10.222.0.58 () {58 vars in 1206 bytes} [Tue Jul 26 19:47:05 2022] DELETE /compute/v2.1/images/tempest-invalid-1254214848 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:47:05.293427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60b7b920-3ae0-4fe7-ad4b-c6321378af60 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Calling method '.version_select at 0x7f8764349ee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.333395 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-60b7b920-3ae0-4fe7-ad4b-c6321378af60 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] HTTP exception thrown: Image not found. Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60b7b920-3ae0-4fe7-ad4b-c6321378af60 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Request method failure captured: Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/df18cf1b-325c-4802-9027-52ae5fbbd3d9 HTTP/1.1 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ES36ztgU7e_rkMkwye9yaVQKoFwRVjYtJeGWphSHBkPrXU3q7svdcV4bjHj-VBiazAQdR7x1CntT2zjYReUZ9ky8QlfSJOU0OL-MI8WgNQ_vECPrB1LIk8L6C1rTXUZFXvMlPGfnQIa_96PpnDA01Jw3pJvppTofR1HQJyet_NdNVg Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3246a1e232b423095f6cb4508eab8a7", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3246a1e232b423095f6cb4508eab8a7"}]}] Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f3246a1e232b423095f6cb4508eab8a7 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403 Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 47d5c19e393648fca78764ad1d44389d Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1953951403-project Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'df18cf1b-325c-4802-9027-52ae5fbbd3d9'} Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image df18cf1b-325c-4802-9027-52ae5fbbd3d9 to delete Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df18cf1b-325c-4802-9027-52ae5fbbd3d9 could not be found. Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.337372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:47:05.342847 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:05.347801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60b7b920-3ae0-4fe7-ad4b-c6321378af60 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:05.349927 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60b7b920-3ae0-4fe7-ad4b-c6321378af60 tempest-ImagesDeleteNegativeTestJSON-1953951403 tempest-ImagesDeleteNegativeTestJSON-1953951403-project] 10.222.0.58 "DELETE /compute/v2.1/images/df18cf1b-325c-4802-9027-52ae5fbbd3d9" status: 404 len: 62 microversion: 2.1 time: 0.060342 Jul 26 19:47:05.350958 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 582/1070] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:05 2022] DELETE /compute/v2.1/images/df18cf1b-325c-4802-9027-52ae5fbbd3d9 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:47:05.360005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.360845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:05.369485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.370231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.371207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.372237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.634818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-72238fda-84fd-4d6e-994a-1a92cd2dd5f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:05.643573 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-72238fda-84fd-4d6e-994a-1a92cd2dd5f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1319 microversion: 2.1 time: 0.461237 Jul 26 19:47:05.648245 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 489/1071] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:05 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:05.657303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82ada474-76f7-4b43-82d7-b354c8490458 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.658636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82ada474-76f7-4b43-82d7-b354c8490458 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:05.671528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82ada474-76f7-4b43-82d7-b354c8490458 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.672011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82ada474-76f7-4b43-82d7-b354c8490458 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.672796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82ada474-76f7-4b43-82d7-b354c8490458 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.673230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82ada474-76f7-4b43-82d7-b354c8490458 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.900711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82ada474-76f7-4b43-82d7-b354c8490458 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:05.921140 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82ada474-76f7-4b43-82d7-b354c8490458 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1273 microversion: 2.1 time: 0.270828 Jul 26 19:47:05.922798 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 490/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:05 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:05.964714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:05.975178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:05.977061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:05.978434 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90fe7f58-1268-4aac-9796-c26357383a1e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1567 microversion: 2.25 time: 0.626261 Jul 26 19:47:05.979298 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 583/1073] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:05 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1567 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:05.989222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f148052d-470a-4f49-90f2-7c52fa2e76cc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:05.990733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f148052d-470a-4f49-90f2-7c52fa2e76cc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:05.998013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f148052d-470a-4f49-90f2-7c52fa2e76cc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:05.998809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f148052d-470a-4f49-90f2-7c52fa2e76cc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:05.999978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f148052d-470a-4f49-90f2-7c52fa2e76cc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.000649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f148052d-470a-4f49-90f2-7c52fa2e76cc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.141594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-964a6280-f009-48a9-819d-144d1b65c8b4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:06.142541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-964a6280-f009-48a9-819d-144d1b65c8b4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:06.150676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-964a6280-f009-48a9-819d-144d1b65c8b4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.151224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-964a6280-f009-48a9-819d-144d1b65c8b4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.152208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-964a6280-f009-48a9-819d-144d1b65c8b4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.153207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-964a6280-f009-48a9-819d-144d1b65c8b4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.194753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f148052d-470a-4f49-90f2-7c52fa2e76cc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:06.212124 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f148052d-470a-4f49-90f2-7c52fa2e76cc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1275 microversion: 2.1 time: 0.227675 Jul 26 19:47:06.213184 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 491/1074] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:05 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:06.242750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:06.245271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:06.266769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.268819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.274137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.274918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.293822 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 HTTP/1.1 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f91a2c0b-cbe3-4c61-ae77-6878c69fd643'} Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:06.296083 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:06.300119 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3652c7e6-6ae9-4926-9334-52e11762deae tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 404 len: 111 microversion: 2.1 time: 0.059973 Jul 26 19:47:06.303757 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 492/1075] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:06 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:06.316968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a888a07-2e4e-4e24-a931-ddf27b761991 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'create', calling method: .version_select at 0x7f8756f45dc0>, body: {"keypair": {"name": "tempest-keypair-823063453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkHbdVv+nyWAkSEJkKgLvlgoFEYyI81jF/nQonyV9IN0L/RWrkiX/7XCFhiGf+eyakj5baCAd8JZjsoLDC9PDuMQYKUVT5LEaVpry6qY3jvJXuUEJDxvpbMoaU/oT7QcQ=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:06.334922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8a888a07-2e4e-4e24-a931-ddf27b761991 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Getting quotas for project 20bfe22d09cc4c7fba9cceb0b6532fc0. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:06.341406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8a888a07-2e4e-4e24-a931-ddf27b761991 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Getting quotas for user 6cb1eb1903e84b65bbaf60a89f626f47 and project 20bfe22d09cc4c7fba9cceb0b6532fc0. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:06.372122 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a888a07-2e4e-4e24-a931-ddf27b761991 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064908 Jul 26 19:47:06.373111 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 493/1076] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:47:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:06.413622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6c9620b2-3cb4-4623-83f6-a57227c473d0 req-920d23b6-ebf2-42c9-8dfe-134e93234689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91a2c0b-cbe3-4c61-ae77-6878c69fd643", "name": "network-vif-deleted", "tag": "36b30dac-cbda-4a1f-8d27-44b3ec8f9014"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:06.426536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6c9620b2-3cb4-4623-83f6-a57227c473d0 req-920d23b6-ebf2-42c9-8dfe-134e93234689 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.426806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6c9620b2-3cb4-4623-83f6-a57227c473d0 req-920d23b6-ebf2-42c9-8dfe-134e93234689 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.443631 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6c9620b2-3cb4-4623-83f6-a57227c473d0 req-920d23b6-ebf2-42c9-8dfe-134e93234689 service nova] Creating event network-vif-deleted:36b30dac-cbda-4a1f-8d27-44b3ec8f9014 for instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 on n-h1-708768-8 Jul 26 19:47:06.449989 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6c9620b2-3cb4-4623-83f6-a57227c473d0 req-920d23b6-ebf2-42c9-8dfe-134e93234689 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042166 Jul 26 19:47:06.452655 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 494/1077] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:06.536615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-964a6280-f009-48a9-819d-144d1b65c8b4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:06.554084 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-964a6280-f009-48a9-819d-144d1b65c8b4 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.413227 Jul 26 19:47:06.555601 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 584/1078] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:06 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:06.667493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03383229-2bf7-4c98-9bdf-df9a808b9a9e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:06.668580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03383229-2bf7-4c98-9bdf-df9a808b9a9e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:06.676536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03383229-2bf7-4c98-9bdf-df9a808b9a9e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.677361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03383229-2bf7-4c98-9bdf-df9a808b9a9e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.679015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03383229-2bf7-4c98-9bdf-df9a808b9a9e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.680511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03383229-2bf7-4c98-9bdf-df9a808b9a9e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.757609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6d9724a2-fb93-4eb3-b5a3-dd1613c9c334 req-cc14f1a0-41a7-403e-80ae-4236d04d8dbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49f71d5-ce26-4218-95e0-2c29a1daa4d6", "tag": "98e9c29f-1acb-4957-8bff-2009cc1583ee"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:06.774580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6d9724a2-fb93-4eb3-b5a3-dd1613c9c334 req-cc14f1a0-41a7-403e-80ae-4236d04d8dbb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.775629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6d9724a2-fb93-4eb3-b5a3-dd1613c9c334 req-cc14f1a0-41a7-403e-80ae-4236d04d8dbb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.799818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6d9724a2-fb93-4eb3-b5a3-dd1613c9c334 req-cc14f1a0-41a7-403e-80ae-4236d04d8dbb service nova] Creating event network-changed:98e9c29f-1acb-4957-8bff-2009cc1583ee for instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 on n-h1-708768-8 Jul 26 19:47:06.806123 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6d9724a2-fb93-4eb3-b5a3-dd1613c9c334 req-cc14f1a0-41a7-403e-80ae-4236d04d8dbb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056370 Jul 26 19:47:06.806913 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 585/1079] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:06.952315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c98bbdc1-77b6-491e-ac7f-088572dacd50 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:06.952856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c98bbdc1-77b6-491e-ac7f-088572dacd50 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:06.966881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c98bbdc1-77b6-491e-ac7f-088572dacd50 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.967292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c98bbdc1-77b6-491e-ac7f-088572dacd50 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:06.970547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c98bbdc1-77b6-491e-ac7f-088572dacd50 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:06.971009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c98bbdc1-77b6-491e-ac7f-088572dacd50 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:07.711012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03383229-2bf7-4c98-9bdf-df9a808b9a9e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:07.737016 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03383229-2bf7-4c98-9bdf-df9a808b9a9e tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1319 microversion: 2.1 time: 1.074989 Jul 26 19:47:07.756139 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 495/1080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:06 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1319 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:07.770951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:07.782742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:07.814029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:07.819026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:07.822424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:07.824685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:08.161550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c98bbdc1-77b6-491e-ac7f-088572dacd50 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:08.172868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c98bbdc1-77b6-491e-ac7f-088572dacd50 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 1.232711 Jul 26 19:47:08.175973 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 586/1081] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:06 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:08.188501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22e85061-1c1a-434d-8ada-02545bf963d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:08.193068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-22e85061-1c1a-434d-8ada-02545bf963d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:08.203756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e85061-1c1a-434d-8ada-02545bf963d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:08.209658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e85061-1c1a-434d-8ada-02545bf963d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:08.210737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e85061-1c1a-434d-8ada-02545bf963d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:08.211339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e85061-1c1a-434d-8ada-02545bf963d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:08.512165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:08.528515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:08.530230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:08.531653 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0c31973-ec50-4379-8918-80dfe1d201a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1567 microversion: 2.25 time: 0.774103 Jul 26 19:47:08.533296 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 496/1082] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:07 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1567 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:08.538550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-989a3e73-3e38-4e49-a13c-ca8c63254d55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:08.552706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-989a3e73-3e38-4e49-a13c-ca8c63254d55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:08.559023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-989a3e73-3e38-4e49-a13c-ca8c63254d55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:08.559736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-989a3e73-3e38-4e49-a13c-ca8c63254d55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:08.560722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-989a3e73-3e38-4e49-a13c-ca8c63254d55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:08.561522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-989a3e73-3e38-4e49-a13c-ca8c63254d55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:08.957565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22e85061-1c1a-434d-8ada-02545bf963d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:08.993444 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22e85061-1c1a-434d-8ada-02545bf963d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1317 microversion: 2.1 time: 0.813970 Jul 26 19:47:08.994837 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 587/1083] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:08 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:09.002969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6994ab2e-edc6-498b-aadb-c968f54cb67f req-fdbe1038-5554-4f36-9714-75ffa6791e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3", "name": "network-vif-unplugged", "status": "completed", "tag": "3f861fc9-a37c-4773-a6a3-1162bda6dcd8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:09.017451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6994ab2e-edc6-498b-aadb-c968f54cb67f req-fdbe1038-5554-4f36-9714-75ffa6791e00 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:09.019086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6994ab2e-edc6-498b-aadb-c968f54cb67f req-fdbe1038-5554-4f36-9714-75ffa6791e00 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:09.036047 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6994ab2e-edc6-498b-aadb-c968f54cb67f req-fdbe1038-5554-4f36-9714-75ffa6791e00 service nova] Creating event network-vif-unplugged:3f861fc9-a37c-4773-a6a3-1162bda6dcd8 for instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 on n-h1-708768-8 Jul 26 19:47:09.049919 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6994ab2e-edc6-498b-aadb-c968f54cb67f req-fdbe1038-5554-4f36-9714-75ffa6791e00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052789 Jul 26 19:47:09.050792 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 588/1084] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:09.057772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0d050a0f-f25a-4d72-ad2f-f77288e25b33 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:09.058737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0d050a0f-f25a-4d72-ad2f-f77288e25b33 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:09.066281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d050a0f-f25a-4d72-ad2f-f77288e25b33 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:09.067153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d050a0f-f25a-4d72-ad2f-f77288e25b33 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:09.068685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d050a0f-f25a-4d72-ad2f-f77288e25b33 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:09.069357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d050a0f-f25a-4d72-ad2f-f77288e25b33 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:09.462981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0d050a0f-f25a-4d72-ad2f-f77288e25b33 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:09.479002 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0d050a0f-f25a-4d72-ad2f-f77288e25b33 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1319 microversion: 2.1 time: 0.422648 Jul 26 19:47:09.483774 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 589/1085] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:09 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:09.487854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-989a3e73-3e38-4e49-a13c-ca8c63254d55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:09.489457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-40a2d6f6-8100-434a-bb0e-7be72727effb req-9a5f0864-1c0f-471b-84e3-faf8fd18292e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3", "name": "network-vif-unplugged", "status": "completed", "tag": "3f861fc9-a37c-4773-a6a3-1162bda6dcd8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:09.506470 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-989a3e73-3e38-4e49-a13c-ca8c63254d55 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.971904 Jul 26 19:47:09.507066 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 497/1086] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:08 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:09.511733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a1cbfd1-6279-499a-9e1f-e3c6e541d608 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:09.512507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a1cbfd1-6279-499a-9e1f-e3c6e541d608 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:09.519329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-40a2d6f6-8100-434a-bb0e-7be72727effb req-9a5f0864-1c0f-471b-84e3-faf8fd18292e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:09.519843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-40a2d6f6-8100-434a-bb0e-7be72727effb req-9a5f0864-1c0f-471b-84e3-faf8fd18292e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:09.523438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a1cbfd1-6279-499a-9e1f-e3c6e541d608 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:09.524413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a1cbfd1-6279-499a-9e1f-e3c6e541d608 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:09.524679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a1cbfd1-6279-499a-9e1f-e3c6e541d608 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:09.529939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a1cbfd1-6279-499a-9e1f-e3c6e541d608 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:09.560066 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-40a2d6f6-8100-434a-bb0e-7be72727effb req-9a5f0864-1c0f-471b-84e3-faf8fd18292e service nova] Creating event network-vif-unplugged:3f861fc9-a37c-4773-a6a3-1162bda6dcd8 for instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 on n-h1-708768-8 Jul 26 19:47:09.578343 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-40a2d6f6-8100-434a-bb0e-7be72727effb req-9a5f0864-1c0f-471b-84e3-faf8fd18292e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092389 Jul 26 19:47:09.580276 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 590/1087] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:09.586209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:09.589803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:09.606992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:09.607888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:09.608897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:09.609496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:10.070334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:10.090743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:10.102963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:10.107027 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0722b720-4430-4410-9fe1-a17c297b3875 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1567 microversion: 2.25 time: 0.523973 Jul 26 19:47:10.121069 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 591/1088] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:09 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1567 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:10.136900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dd126492-b521-4219-85b1-0107f698890c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:10.137483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dd126492-b521-4219-85b1-0107f698890c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:10.152355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd126492-b521-4219-85b1-0107f698890c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:10.156757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd126492-b521-4219-85b1-0107f698890c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:10.158737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd126492-b521-4219-85b1-0107f698890c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:10.159197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd126492-b521-4219-85b1-0107f698890c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:10.658097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a1cbfd1-6279-499a-9e1f-e3c6e541d608 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:10.674087 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a1cbfd1-6279-499a-9e1f-e3c6e541d608 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 1.165755 Jul 26 19:47:10.679492 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 498/1089] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:09 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:10.687305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4cb41a39-1584-4142-8649-f0fcad910a6f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:10.691847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4cb41a39-1584-4142-8649-f0fcad910a6f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:10.709019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cb41a39-1584-4142-8649-f0fcad910a6f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:10.709733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cb41a39-1584-4142-8649-f0fcad910a6f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:10.711076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cb41a39-1584-4142-8649-f0fcad910a6f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:10.711777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cb41a39-1584-4142-8649-f0fcad910a6f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:10.774635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dd126492-b521-4219-85b1-0107f698890c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:10.782311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:10.785312 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dd126492-b521-4219-85b1-0107f698890c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1317 microversion: 2.1 time: 0.663103 Jul 26 19:47:10.810694 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 592/1090] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:10 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:10.815666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-444fcc2a-234e-4761-99eb-22ba8c753e48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:10.816293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-444fcc2a-234e-4761-99eb-22ba8c753e48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:10.826504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-444fcc2a-234e-4761-99eb-22ba8c753e48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:10.841611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-444fcc2a-234e-4761-99eb-22ba8c753e48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:10.842565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-444fcc2a-234e-4761-99eb-22ba8c753e48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:10.843026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-444fcc2a-234e-4761-99eb-22ba8c753e48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:11.492934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4cb41a39-1584-4142-8649-f0fcad910a6f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:11.516101 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4cb41a39-1584-4142-8649-f0fcad910a6f tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1319 microversion: 2.1 time: 0.829517 Jul 26 19:47:11.538023 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 499/1091] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:10 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1319 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:11.546678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5bc4a6b6-d89c-4271-a87d-316bba45aa8f req-0a6a695d-8ad2-4098-a56f-0d1938a621f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b0264e-b656-49c4-b9cf-ff371219e527", "tag": "db8dc067-ea7b-48a2-9e5c-e0b4db210b25"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:11.560673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5bc4a6b6-d89c-4271-a87d-316bba45aa8f req-0a6a695d-8ad2-4098-a56f-0d1938a621f0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:11.561366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5bc4a6b6-d89c-4271-a87d-316bba45aa8f req-0a6a695d-8ad2-4098-a56f-0d1938a621f0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:11.566160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:11.581077 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5bc4a6b6-d89c-4271-a87d-316bba45aa8f req-0a6a695d-8ad2-4098-a56f-0d1938a621f0 service nova] Creating event network-changed:db8dc067-ea7b-48a2-9e5c-e0b4db210b25 for instance d2b0264e-b656-49c4-b9cf-ff371219e527 on n-h2-708768-8 Jul 26 19:47:11.588451 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5bc4a6b6-d89c-4271-a87d-316bba45aa8f req-0a6a695d-8ad2-4098-a56f-0d1938a621f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047199 Jul 26 19:47:11.589613 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 500/1092] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:11.595431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:11.596504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:11.607009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:11.607894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:11.608915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:11.609608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:11.688400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-444fcc2a-234e-4761-99eb-22ba8c753e48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:11.699669 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-444fcc2a-234e-4761-99eb-22ba8c753e48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.887503 Jul 26 19:47:11.700985 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 593/1093] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:10 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:11.709477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-045fa554-9109-421b-b691-5e69558dd568 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:11.711046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-045fa554-9109-421b-b691-5e69558dd568 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:11.736294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-045fa554-9109-421b-b691-5e69558dd568 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:11.737864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-045fa554-9109-421b-b691-5e69558dd568 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:11.744791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-045fa554-9109-421b-b691-5e69558dd568 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:11.746359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-045fa554-9109-421b-b691-5e69558dd568 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:11.964696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:11.973465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:11.974968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:11.980278 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f51cfb4-9479-426d-aacc-c204a6818b7f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1567 microversion: 2.25 time: 0.384987 Jul 26 19:47:11.985980 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 501/1094] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:11 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1567 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:11.991757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e863da40-edba-4dea-a289-4658ed0aa874 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:11.992374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e863da40-edba-4dea-a289-4658ed0aa874 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:12.004678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e863da40-edba-4dea-a289-4658ed0aa874 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.006399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e863da40-edba-4dea-a289-4658ed0aa874 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.008025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e863da40-edba-4dea-a289-4658ed0aa874 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.008702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e863da40-edba-4dea-a289-4658ed0aa874 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.112334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-045fa554-9109-421b-b691-5e69558dd568 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:12.120922 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-045fa554-9109-421b-b691-5e69558dd568 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 0.418424 Jul 26 19:47:12.131876 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 594/1095] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:11 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:12.287405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e863da40-edba-4dea-a289-4658ed0aa874 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:12.305166 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e863da40-edba-4dea-a289-4658ed0aa874 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1317 microversion: 2.1 time: 0.317492 Jul 26 19:47:12.305378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:12.305667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:12.308380 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 502/1096] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:11 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:12.328802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.329994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.331710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.333098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.353480 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] HTTP exception thrown: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Request method failure captured: Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 HTTP/1.1 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQHuR1E5E_AZU656iQ9lK8hXwxEGGLy6IPIInEp_qgEsvZ-Ibh4mKbQjATuD-2m_8PFexD4uUNOzGx8FvUfXT9AzV5G1dAAkU0zgfWlKafsEqHT2qOaFVlBn_E_XkXkoOH_ElvzXjO8KVogcTibbIgvotG5Llbrs_dYSFTpZMr3iAA Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fbe6b28ebe6e4d06b4455356d52e6973 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fbe6b28ebe6e4d06b4455356d52e6973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe6b28ebe6e4d06b4455356d52e6973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fbe6b28ebe6e4d06b4455356d52e6973", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe6b28ebe6e4d06b4455356d52e6973"}]}] Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fbe6b28ebe6e4d06b4455356d52e6973 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachSCSIVolumeTestJSON-783765905-project Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 43d0674f08c34d19b6e6be8760ee7b34 Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-783765905-project Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '94ef3743-f705-4e52-bb3c-e5891eab0512'} Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:12.356370 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.361225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.362835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Returning 404 to user: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:12.364071 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eac40947-d701-4b6f-b82b-bb80ee9d6609 tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "DELETE /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 404 len: 111 microversion: 2.1 time: 0.063864 Jul 26 19:47:12.365660 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 595/1097] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:12 2022] DELETE /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:47:12.374264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:12.374874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] [instance: 94ef3743-f705-4e52-bb3c-e5891eab0512] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:12.385709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.386698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.394452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.395408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.420972 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] HTTP exception thrown: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Request method failure captured: Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 HTTP/1.1 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQHuR1E5E_AZU656iQ9lK8hXwxEGGLy6IPIInEp_qgEsvZ-Ibh4mKbQjATuD-2m_8PFexD4uUNOzGx8FvUfXT9AzV5G1dAAkU0zgfWlKafsEqHT2qOaFVlBn_E_XkXkoOH_ElvzXjO8KVogcTibbIgvotG5Llbrs_dYSFTpZMr3iAA Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fbe6b28ebe6e4d06b4455356d52e6973 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fbe6b28ebe6e4d06b4455356d52e6973"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe6b28ebe6e4d06b4455356d52e6973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fbe6b28ebe6e4d06b4455356d52e6973", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fbe6b28ebe6e4d06b4455356d52e6973"}]}] Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fbe6b28ebe6e4d06b4455356d52e6973 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-783765905 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachSCSIVolumeTestJSON-783765905-project Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 43d0674f08c34d19b6e6be8760ee7b34 Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-783765905-project Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '94ef3743-f705-4e52-bb3c-e5891eab0512'} Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:12.423471 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.428953 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:12.428953 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:12.428953 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:12.428953 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:12.428953 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:12.428953 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. Jul 26 19:47:12.428953 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:12.428953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] Returning 404 to user: Instance 94ef3743-f705-4e52-bb3c-e5891eab0512 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:12.430315 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4b4277c-f862-49b5-8e7e-63d9cdec0deb tempest-AttachSCSIVolumeTestJSON-783765905 tempest-AttachSCSIVolumeTestJSON-783765905-project] 10.222.0.58 "GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512" status: 404 len: 111 microversion: 2.1 time: 0.059783 Jul 26 19:47:12.431858 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 503/1098] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:12 2022] GET /compute/v2.1/servers/94ef3743-f705-4e52-bb3c-e5891eab0512 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:12.544867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5d839a02-a49a-413f-9487-e081324fe91c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:12.545466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5d839a02-a49a-413f-9487-e081324fe91c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:12.553400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d839a02-a49a-413f-9487-e081324fe91c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.557643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d839a02-a49a-413f-9487-e081324fe91c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.559984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d839a02-a49a-413f-9487-e081324fe91c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.560677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d839a02-a49a-413f-9487-e081324fe91c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.602551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:12.724976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6a872c74-bccf-4c6a-9cd6-abbf4195724a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:12.726043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6a872c74-bccf-4c6a-9cd6-abbf4195724a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:12.737347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a872c74-bccf-4c6a-9cd6-abbf4195724a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.738106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a872c74-bccf-4c6a-9cd6-abbf4195724a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:12.748625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a872c74-bccf-4c6a-9cd6-abbf4195724a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:12.749398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a872c74-bccf-4c6a-9cd6-abbf4195724a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:13.050430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6a872c74-bccf-4c6a-9cd6-abbf4195724a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:13.063786 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6a872c74-bccf-4c6a-9cd6-abbf4195724a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1516 microversion: 2.1 time: 0.345476 Jul 26 19:47:13.076401 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 504/1099] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:12 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1516 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:13.089672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:13.090301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:13.117232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:13.117682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:13.118464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:13.118900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:13.123055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5d839a02-a49a-413f-9487-e081324fe91c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:13.137073 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5d839a02-a49a-413f-9487-e081324fe91c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1319 microversion: 2.1 time: 0.591218 Jul 26 19:47:13.138692 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 596/1100] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:12 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:13.143548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90c0de9c-e8fc-4f29-bfbd-ad78aa918366 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:13.144025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90c0de9c-e8fc-4f29-bfbd-ad78aa918366 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:13.162926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90c0de9c-e8fc-4f29-bfbd-ad78aa918366 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:13.163380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90c0de9c-e8fc-4f29-bfbd-ad78aa918366 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:13.164354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90c0de9c-e8fc-4f29-bfbd-ad78aa918366 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:13.164835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90c0de9c-e8fc-4f29-bfbd-ad78aa918366 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:13.542695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90c0de9c-e8fc-4f29-bfbd-ad78aa918366 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:13.559347 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90c0de9c-e8fc-4f29-bfbd-ad78aa918366 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 0.419556 Jul 26 19:47:13.562582 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 597/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:13 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:13.570897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:13.583808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1765478939", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:13.696577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] validate_networks() for [('faacc758-f7cd-4415-a920-940b8213555c', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:47:13.755337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:13.770903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:13.772714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:13.776252 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-05f8e579-aad4-4903-a91b-e1099c15c21e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1567 microversion: 2.25 time: 0.698762 Jul 26 19:47:13.779143 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 505/1102] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:13 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1567 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:13.784022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f849518-52f2-4228-a3b4-55393ae806d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:13.787347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2f849518-52f2-4228-a3b4-55393ae806d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:13.804560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f849518-52f2-4228-a3b4-55393ae806d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:13.805092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f849518-52f2-4228-a3b4-55393ae806d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:13.805914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f849518-52f2-4228-a3b4-55393ae806d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:13.806368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f849518-52f2-4228-a3b4-55393ae806d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.083729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f849518-52f2-4228-a3b4-55393ae806d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:14.097606 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f849518-52f2-4228-a3b4-55393ae806d6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1317 microversion: 2.1 time: 0.317096 Jul 26 19:47:14.098729 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 506/1103] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:13 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:14.115832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b637ca00-39a0-4e71-9e1c-10cc3778b2c6 req-4627d1ed-815e-4131-bf50-4d2f13ba6534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e11c63b9-a4d7-4d28-ad47-7dbb5059bce7", "tag": "10e38cd6-9336-4305-a145-1a2539c3a12e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:14.127970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b637ca00-39a0-4e71-9e1c-10cc3778b2c6 req-4627d1ed-815e-4131-bf50-4d2f13ba6534 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:14.128656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b637ca00-39a0-4e71-9e1c-10cc3778b2c6 req-4627d1ed-815e-4131-bf50-4d2f13ba6534 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.144518 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b637ca00-39a0-4e71-9e1c-10cc3778b2c6 req-4627d1ed-815e-4131-bf50-4d2f13ba6534 service nova] Creating event network-changed:10e38cd6-9336-4305-a145-1a2539c3a12e for instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 on n-h1-708768-8 Jul 26 19:47:14.151364 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b637ca00-39a0-4e71-9e1c-10cc3778b2c6 req-4627d1ed-815e-4131-bf50-4d2f13ba6534 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041385 Jul 26 19:47:14.152025 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 507/1104] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:14.157857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-960b2981-5fa3-45e3-9fee-7bc3229648ee req-6dac0589-9c8e-48a5-a6a6-359fb9aaab71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49f71d5-ce26-4218-95e0-2c29a1daa4d6", "name": "network-vif-plugged", "status": "completed", "tag": "98e9c29f-1acb-4957-8bff-2009cc1583ee"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:14.169285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-960b2981-5fa3-45e3-9fee-7bc3229648ee req-6dac0589-9c8e-48a5-a6a6-359fb9aaab71 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:14.170024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-960b2981-5fa3-45e3-9fee-7bc3229648ee req-6dac0589-9c8e-48a5-a6a6-359fb9aaab71 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.184469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-960b2981-5fa3-45e3-9fee-7bc3229648ee req-6dac0589-9c8e-48a5-a6a6-359fb9aaab71 service nova] Creating event network-vif-plugged:98e9c29f-1acb-4957-8bff-2009cc1583ee for instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 on n-h1-708768-8 Jul 26 19:47:14.189535 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-960b2981-5fa3-45e3-9fee-7bc3229648ee req-6dac0589-9c8e-48a5-a6a6-359fb9aaab71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035787 Jul 26 19:47:14.190871 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 508/1105] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:14.201633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4146819c-0daa-466b-bea7-1a19b93c7089 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:14.202673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4146819c-0daa-466b-bea7-1a19b93c7089 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:14.232897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4146819c-0daa-466b-bea7-1a19b93c7089 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:14.233365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4146819c-0daa-466b-bea7-1a19b93c7089 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.234168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4146819c-0daa-466b-bea7-1a19b93c7089 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:14.236943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4146819c-0daa-466b-bea7-1a19b93c7089 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.314306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=18 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:14.525762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:47:14.528041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:47:14.528804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:47:14.529961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:47:14.530617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:47:14.545326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:14.546336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.547596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:14.548907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.584586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Getting quotas for project 20bfe22d09cc4c7fba9cceb0b6532fc0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:14.591578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Getting quotas for user 6cb1eb1903e84b65bbaf60a89f626f47 and project 20bfe22d09cc4c7fba9cceb0b6532fc0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:14.606366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:47:14.609131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:47:14.665281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-71faccfe-79a8-4b7f-a47b-5f84e7bc3f04 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.099454 Jul 26 19:47:14.672132 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 598/1106] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:47:14.677719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-52b0c06e-e054-48d7-8284-bff2c5e3455b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:14.678339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-52b0c06e-e054-48d7-8284-bff2c5e3455b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:14.687248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52b0c06e-e054-48d7-8284-bff2c5e3455b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:14.688016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52b0c06e-e054-48d7-8284-bff2c5e3455b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.689282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52b0c06e-e054-48d7-8284-bff2c5e3455b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:14.689882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52b0c06e-e054-48d7-8284-bff2c5e3455b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:14.978788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4146819c-0daa-466b-bea7-1a19b93c7089 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:14.988066 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4146819c-0daa-466b-bea7-1a19b93c7089 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1522 microversion: 2.1 time: 0.795697 Jul 26 19:47:14.989928 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 509/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:14 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1522 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:15.009564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-396ba0a7-82af-4beb-bda0-aa5c39483629 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:15.010568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-396ba0a7-82af-4beb-bda0-aa5c39483629 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:15.016625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:15.018583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-396ba0a7-82af-4beb-bda0-aa5c39483629 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:15.019293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-396ba0a7-82af-4beb-bda0-aa5c39483629 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:15.021108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-396ba0a7-82af-4beb-bda0-aa5c39483629 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:15.021805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-396ba0a7-82af-4beb-bda0-aa5c39483629 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:15.161546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-52b0c06e-e054-48d7-8284-bff2c5e3455b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:15.171819 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-52b0c06e-e054-48d7-8284-bff2c5e3455b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1319 microversion: 2.1 time: 0.498652 Jul 26 19:47:15.172348 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 599/1108] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:14 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:15.193414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a64198e-dc38-410d-8369-90b970639c01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:15.194110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a64198e-dc38-410d-8369-90b970639c01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:15.410849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-396ba0a7-82af-4beb-bda0-aa5c39483629 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:15.421807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1a64198e-dc38-410d-8369-90b970639c01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:15.426770 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-396ba0a7-82af-4beb-bda0-aa5c39483629 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 0.424833 Jul 26 19:47:15.427384 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 510/1109] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:14 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:15.433420 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a64198e-dc38-410d-8369-90b970639c01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1225 microversion: 2.1 time: 0.260034 Jul 26 19:47:15.434236 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 600/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:15 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1225 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:15.443340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f40f0c54-61ae-490f-a2b6-f8f6f2ef8ac6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:15.445636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:15.446490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:15.447287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f40f0c54-61ae-490f-a2b6-f8f6f2ef8ac6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:15.454269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:15.455218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:15.456257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:15.456957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:15.466313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f40f0c54-61ae-490f-a2b6-f8f6f2ef8ac6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:15.466832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f40f0c54-61ae-490f-a2b6-f8f6f2ef8ac6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:15.467701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f40f0c54-61ae-490f-a2b6-f8f6f2ef8ac6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:15.468211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f40f0c54-61ae-490f-a2b6-f8f6f2ef8ac6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:15.825334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f40f0c54-61ae-490f-a2b6-f8f6f2ef8ac6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:15.837904 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f40f0c54-61ae-490f-a2b6-f8f6f2ef8ac6 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1317 microversion: 2.1 time: 0.399995 Jul 26 19:47:15.839183 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 601/1111] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:15 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:15.934686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:15.944880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:15.951402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:15.953043 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba29e533-bc30-4ac6-b5e2-e99e2778d72b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1542 microversion: 2.25 time: 0.511429 Jul 26 19:47:15.956116 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 511/1112] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:15 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1542 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:15.979740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8eb93326-7932-475f-985c-b829191bcaa2 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '.version_select at 0x7f875f0c33a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:15.985175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8eb93326-7932-475f-985c-b829191bcaa2 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:15.985890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8eb93326-7932-475f-985c-b829191bcaa2 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:16.006458 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8eb93326-7932-475f-985c-b829191bcaa2 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.029260 Jul 26 19:47:16.017092 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 602/1113] 10.222.0.58 () {60 vars in 1184 bytes} [Tue Jul 26 19:47:15 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:16.022303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-690d5741-02f3-4f38-ad83-2e5f0e664d37 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:16.023087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-690d5741-02f3-4f38-ad83-2e5f0e664d37 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:16.024560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c202ee76-e478-490b-a24e-f512082e94e9 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:16.025383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c202ee76-e478-490b-a24e-f512082e94e9 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:16.032613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c202ee76-e478-490b-a24e-f512082e94e9 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:16.033265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c202ee76-e478-490b-a24e-f512082e94e9 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:16.036565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-690d5741-02f3-4f38-ad83-2e5f0e664d37 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:16.037875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-690d5741-02f3-4f38-ad83-2e5f0e664d37 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:16.038275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c202ee76-e478-490b-a24e-f512082e94e9 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:16.038898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c202ee76-e478-490b-a24e-f512082e94e9 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:16.042007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-690d5741-02f3-4f38-ad83-2e5f0e664d37 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:16.042586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-690d5741-02f3-4f38-ad83-2e5f0e664d37 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:16.352183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:16.396741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-690d5741-02f3-4f38-ad83-2e5f0e664d37 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:16.416322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-690d5741-02f3-4f38-ad83-2e5f0e664d37 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1522 microversion: 2.1 time: 0.398344 Jul 26 19:47:16.418289 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 512/1114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:16 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:16.427016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e42f686-8dcc-41d9-a29a-187b277de4be tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:16.428597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e42f686-8dcc-41d9-a29a-187b277de4be tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:16.441425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e42f686-8dcc-41d9-a29a-187b277de4be tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:16.443878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e42f686-8dcc-41d9-a29a-187b277de4be tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:16.445541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e42f686-8dcc-41d9-a29a-187b277de4be tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:16.446548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e42f686-8dcc-41d9-a29a-187b277de4be tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:16.935109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e42f686-8dcc-41d9-a29a-187b277de4be tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:16.947647 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e42f686-8dcc-41d9-a29a-187b277de4be tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1469 microversion: 2.1 time: 0.527796 Jul 26 19:47:16.948683 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 513/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:16 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1469 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:16.955225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-398e78cc-4037-40e5-a3b1-e529cb242295 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:16.956051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-398e78cc-4037-40e5-a3b1-e529cb242295 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:16.963464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-398e78cc-4037-40e5-a3b1-e529cb242295 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:16.964261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-398e78cc-4037-40e5-a3b1-e529cb242295 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:16.967940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-398e78cc-4037-40e5-a3b1-e529cb242295 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:16.968993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-398e78cc-4037-40e5-a3b1-e529cb242295 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.059486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-c202ee76-e478-490b-a24e-f512082e94e9 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:17.090112 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c202ee76-e478-490b-a24e-f512082e94e9 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 2034 microversion: 2.25 time: 1.071113 Jul 26 19:47:17.110853 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 603/1116] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:16 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 2034 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:17.123594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c86c1e3-d535-4edf-99f1-c9e86c3c5d01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:17.124493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5c86c1e3-d535-4edf-99f1-c9e86c3c5d01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:17.135562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c86c1e3-d535-4edf-99f1-c9e86c3c5d01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.142906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c86c1e3-d535-4edf-99f1-c9e86c3c5d01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.143960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c86c1e3-d535-4edf-99f1-c9e86c3c5d01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.144472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c86c1e3-d535-4edf-99f1-c9e86c3c5d01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.276607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-398e78cc-4037-40e5-a3b1-e529cb242295 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:17.286936 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-398e78cc-4037-40e5-a3b1-e529cb242295 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 0.336544 Jul 26 19:47:17.288258 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 514/1117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:16 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:17.306030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f29a0859-7ddb-4b77-8fb9-34bf7e8839b5 req-219b2b9d-022b-432c-9248-e675ed60e893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9a3004-dc44-4bfc-926a-3f0ed3e29227", "name": "network-vif-unplugged", "status": "completed", "tag": "d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:17.325293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f29a0859-7ddb-4b77-8fb9-34bf7e8839b5 req-219b2b9d-022b-432c-9248-e675ed60e893 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.326025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f29a0859-7ddb-4b77-8fb9-34bf7e8839b5 req-219b2b9d-022b-432c-9248-e675ed60e893 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.335523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5c86c1e3-d535-4edf-99f1-c9e86c3c5d01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:17.341345 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f29a0859-7ddb-4b77-8fb9-34bf7e8839b5 req-219b2b9d-022b-432c-9248-e675ed60e893 service nova] Creating event network-vif-unplugged:d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134 for instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 on n-h2-708768-8 Jul 26 19:47:17.346771 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f29a0859-7ddb-4b77-8fb9-34bf7e8839b5 req-219b2b9d-022b-432c-9248-e675ed60e893 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044403 Jul 26 19:47:17.348630 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 515/1118] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:17.353896 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5c86c1e3-d535-4edf-99f1-c9e86c3c5d01 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1283 microversion: 2.1 time: 0.241504 Jul 26 19:47:17.355641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d37749d-a325-4f4a-849a-0f17c5bb8997 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:17.356064 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 604/1119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:17 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1283 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:17.356845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d37749d-a325-4f4a-849a-0f17c5bb8997 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:17.365205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d37749d-a325-4f4a-849a-0f17c5bb8997 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.365910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d37749d-a325-4f4a-849a-0f17c5bb8997 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.366903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d37749d-a325-4f4a-849a-0f17c5bb8997 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.367583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d37749d-a325-4f4a-849a-0f17c5bb8997 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.368593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6a278972-14d0-430d-9d65-2bffa69af9a0 tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:17.375080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6a278972-14d0-430d-9d65-2bffa69af9a0 tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:17.399365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a278972-14d0-430d-9d65-2bffa69af9a0 tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.399864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a278972-14d0-430d-9d65-2bffa69af9a0 tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.400666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a278972-14d0-430d-9d65-2bffa69af9a0 tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.401107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a278972-14d0-430d-9d65-2bffa69af9a0 tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.570623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6d37749d-a325-4f4a-849a-0f17c5bb8997 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:17.580955 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d37749d-a325-4f4a-849a-0f17c5bb8997 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1317 microversion: 2.1 time: 0.230753 Jul 26 19:47:17.582896 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 516/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:17 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:17.589419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bcf3b454-977f-418b-9935-7b6444cee1df tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Action: 'create', calling method: .version_select at 0x7f8756f381f0>, body: {"keypair": {"name": "tempest-keypair-698021275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0JnLN5bNTZd5dEGDhI6v6S2JUtuh6wFPXONiAs7Wu8q3FWi9jZPTyRZvUy8VYuBy6CvEBMeo5b0VDzlfZsUnXeeq+35zfCqBTSArJnEVtTodptASExF07cwK6ynTa8ww=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:17.603769 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6a278972-14d0-430d-9d65-2bffa69af9a0 tempest-DeleteServersAdminTestJSON-962412402 tempest-DeleteServersAdminTestJSON-962412402-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6/action" status: 202 len: 0 microversion: 2.1 time: 0.246536 Jul 26 19:47:17.604782 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 605/1121] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:47:17 2022] POST /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:17.609677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-bcf3b454-977f-418b-9935-7b6444cee1df tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for project 3d10540a08974fd0854fea20ae5c216b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:17.616607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-bcf3b454-977f-418b-9935-7b6444cee1df tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for user ccd551ea4e0641a0bf17d669481136fa and project 3d10540a08974fd0854fea20ae5c216b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:17.620477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09dc75a2-f3be-4455-9d88-c6b25b3420fb tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:17.621103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-09dc75a2-f3be-4455-9d88-c6b25b3420fb tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:17.629874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09dc75a2-f3be-4455-9d88-c6b25b3420fb tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.632514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09dc75a2-f3be-4455-9d88-c6b25b3420fb tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.633344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09dc75a2-f3be-4455-9d88-c6b25b3420fb tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.633794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09dc75a2-f3be-4455-9d88-c6b25b3420fb tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.652140 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bcf3b454-977f-418b-9935-7b6444cee1df tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.067640 Jul 26 19:47:17.654278 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 517/1122] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 19:47:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 19:47:17.659746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:17.660650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:17.669525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.670143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.671085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.671938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.719033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:17.719958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:17.720761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lazy-loading 'fault' on Instance uuid a49f71d5-ce26-4218-95e0-2c29a1daa4d6 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:17.960866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:17.976783 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-69797df8-453b-4c39-aef3-0c6a2f431b23 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1452 microversion: 2.1 time: 0.315206 Jul 26 19:47:17.977557 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 518/1123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:17 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1452 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:17.999771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b791438c-a127-4d59-99e0-c9dbae99570b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:18.000323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b791438c-a127-4d59-99e0-c9dbae99570b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:18.011070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b791438c-a127-4d59-99e0-c9dbae99570b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.011529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b791438c-a127-4d59-99e0-c9dbae99570b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.012399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b791438c-a127-4d59-99e0-c9dbae99570b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.023820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b791438c-a127-4d59-99e0-c9dbae99570b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.069761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b791438c-a127-4d59-99e0-c9dbae99570b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:18.153779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:18.224978 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b791438c-a127-4d59-99e0-c9dbae99570b tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 204 len: 0 microversion: 2.1 time: 0.229700 Jul 26 19:47:18.226211 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 519/1124] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:17 2022] DELETE /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:18.238349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:18.239869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:18.249458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.250599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.251734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.252368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.281845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09dc75a2-f3be-4455-9d88-c6b25b3420fb tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:18.302102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.302682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.303150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lazy-loading 'fault' on Instance uuid a49f71d5-ce26-4218-95e0-2c29a1daa4d6 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:18.321415 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09dc75a2-f3be-4455-9d88-c6b25b3420fb tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1522 microversion: 2.1 time: 0.715456 Jul 26 19:47:18.326703 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 606/1125] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:17 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1522 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:18.347031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2ab399a1-47aa-4552-aaec-dd27828d3027 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:18.350239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2ab399a1-47aa-4552-aaec-dd27828d3027 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:18.358458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2ab399a1-47aa-4552-aaec-dd27828d3027 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.359389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2ab399a1-47aa-4552-aaec-dd27828d3027 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.360575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2ab399a1-47aa-4552-aaec-dd27828d3027 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.361231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2ab399a1-47aa-4552-aaec-dd27828d3027 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.508471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:18.521732 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f9326f5a-7676-4fae-98bf-cc87589f1b4d tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1458 microversion: 2.1 time: 0.288711 Jul 26 19:47:18.522500 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 520/1126] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:18 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1458 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:18.533319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c578d7f-1d47-4ce8-9712-b20320e7dd5d tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:18.534100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2c578d7f-1d47-4ce8-9712-b20320e7dd5d tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:18.542642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c578d7f-1d47-4ce8-9712-b20320e7dd5d tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.543096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c578d7f-1d47-4ce8-9712-b20320e7dd5d tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.544221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c578d7f-1d47-4ce8-9712-b20320e7dd5d tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.544698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c578d7f-1d47-4ce8-9712-b20320e7dd5d tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.738200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c578d7f-1d47-4ce8-9712-b20320e7dd5d tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:18.751350 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c578d7f-1d47-4ce8-9712-b20320e7dd5d tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1283 microversion: 2.1 time: 0.225996 Jul 26 19:47:18.756151 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 521/1127] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:18 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:18.761992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4637bdc2-b4be-4762-afba-b5a692f0f381 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:18.762481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4637bdc2-b4be-4762-afba-b5a692f0f381 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:18.780018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4637bdc2-b4be-4762-afba-b5a692f0f381 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.780474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4637bdc2-b4be-4762-afba-b5a692f0f381 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.781274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4637bdc2-b4be-4762-afba-b5a692f0f381 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:18.781713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4637bdc2-b4be-4762-afba-b5a692f0f381 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:18.937170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2ab399a1-47aa-4552-aaec-dd27828d3027 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:18.962305 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2ab399a1-47aa-4552-aaec-dd27828d3027 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 0.634148 Jul 26 19:47:18.980615 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 607/1128] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:18 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:19.064574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4637bdc2-b4be-4762-afba-b5a692f0f381 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:19.074083 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4637bdc2-b4be-4762-afba-b5a692f0f381 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1317 microversion: 2.1 time: 0.317543 Jul 26 19:47:19.074670 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 522/1129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:18 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:19.359136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e59aeb6-ea9a-4e10-8d4e-8bbb0fcfd49a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:19.360502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5e59aeb6-ea9a-4e10-8d4e-8bbb0fcfd49a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:19.370630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e59aeb6-ea9a-4e10-8d4e-8bbb0fcfd49a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:19.372148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e59aeb6-ea9a-4e10-8d4e-8bbb0fcfd49a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:19.373243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e59aeb6-ea9a-4e10-8d4e-8bbb0fcfd49a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:19.373907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e59aeb6-ea9a-4e10-8d4e-8bbb0fcfd49a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:19.408998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ef9dc6c0-b58d-4097-b63b-984bc81572b5 req-b41769c1-57e1-410d-a437-33d1cad13582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e11c63b9-a4d7-4d28-ad47-7dbb5059bce7", "name": "network-vif-plugged", "status": "completed", "tag": "10e38cd6-9336-4305-a145-1a2539c3a12e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:19.436979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ef9dc6c0-b58d-4097-b63b-984bc81572b5 req-b41769c1-57e1-410d-a437-33d1cad13582 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:19.437427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ef9dc6c0-b58d-4097-b63b-984bc81572b5 req-b41769c1-57e1-410d-a437-33d1cad13582 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:19.464773 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ef9dc6c0-b58d-4097-b63b-984bc81572b5 req-b41769c1-57e1-410d-a437-33d1cad13582 service nova] Creating event network-vif-plugged:10e38cd6-9336-4305-a145-1a2539c3a12e for instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 on n-h1-708768-8 Jul 26 19:47:19.473550 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ef9dc6c0-b58d-4097-b63b-984bc81572b5 req-b41769c1-57e1-410d-a437-33d1cad13582 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067601 Jul 26 19:47:19.479014 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 523/1130] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:19.543367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:19.544106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:19.555926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:19.556374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:19.557166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:19.557598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:19.652814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:19.656248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:19.656904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lazy-loading 'fault' on Instance uuid a49f71d5-ce26-4218-95e0-2c29a1daa4d6 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:20.039269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:20.047966 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f90ed1cc-9f08-4b28-8c69-a136ece261f8 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1458 microversion: 2.1 time: 0.508755 Jul 26 19:47:20.048937 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 524/1131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:19 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1458 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:20.051022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5e59aeb6-ea9a-4e10-8d4e-8bbb0fcfd49a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:20.054315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0098cfbe-ee62-4efe-a3e1-8dbf85403dfe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:20.055205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0098cfbe-ee62-4efe-a3e1-8dbf85403dfe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:20.059585 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5e59aeb6-ea9a-4e10-8d4e-8bbb0fcfd49a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1522 microversion: 2.1 time: 0.713142 Jul 26 19:47:20.060754 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 608/1132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:19 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1522 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:20.066318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-605f292e-c50c-45db-809f-16dde9ebdc87 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:20.067997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-605f292e-c50c-45db-809f-16dde9ebdc87 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:20.073387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0098cfbe-ee62-4efe-a3e1-8dbf85403dfe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:20.073948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0098cfbe-ee62-4efe-a3e1-8dbf85403dfe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:20.075236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-605f292e-c50c-45db-809f-16dde9ebdc87 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:20.075937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-605f292e-c50c-45db-809f-16dde9ebdc87 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:20.076992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-605f292e-c50c-45db-809f-16dde9ebdc87 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:20.077657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-605f292e-c50c-45db-809f-16dde9ebdc87 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:20.077880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0098cfbe-ee62-4efe-a3e1-8dbf85403dfe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:20.078339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0098cfbe-ee62-4efe-a3e1-8dbf85403dfe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:20.329954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0098cfbe-ee62-4efe-a3e1-8dbf85403dfe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:20.366095 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0098cfbe-ee62-4efe-a3e1-8dbf85403dfe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1325 microversion: 2.1 time: 0.315697 Jul 26 19:47:20.370437 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 525/1133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:20 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:20.386190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-730cde5a-a215-4b75-871a-542e5ce7546c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:20.389614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-730cde5a-a215-4b75-871a-542e5ce7546c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:20.408673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730cde5a-a215-4b75-871a-542e5ce7546c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:20.411952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730cde5a-a215-4b75-871a-542e5ce7546c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:20.415927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730cde5a-a215-4b75-871a-542e5ce7546c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:20.416625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730cde5a-a215-4b75-871a-542e5ce7546c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:20.646159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-605f292e-c50c-45db-809f-16dde9ebdc87 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:20.658236 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-605f292e-c50c-45db-809f-16dde9ebdc87 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 0.596276 Jul 26 19:47:20.659517 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 609/1134] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:20 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:20.661310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-730cde5a-a215-4b75-871a-542e5ce7546c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:20.669595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-306269465", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "ca7f5c97-fec0-4b42-bad4-1e41226d1325"}], "security_groups": [{"name": "tempest-securitygroup--593188679"}], "key_name": "tempest-keypair-698021275", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:20.674011 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-730cde5a-a215-4b75-871a-542e5ce7546c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1317 microversion: 2.1 time: 0.302369 Jul 26 19:47:20.676971 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 526/1135] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:20 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:21.051729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] validate_networks() for [('ca7f5c97-fec0-4b42-bad4-1e41226d1325', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:47:21.070661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:21.072041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:21.081695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:21.083054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:21.084174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:21.084773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:21.124587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:21.125406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:21.126032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lazy-loading 'fault' on Instance uuid a49f71d5-ce26-4218-95e0-2c29a1daa4d6 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:21.353017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2737b46af94ceea33cdd0255db0c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ee63ec934bc0b5d4eb9964635785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:21.361513 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff377efb-7ea3-4269-af09-9da72a9f90a6 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 200 len: 1458 microversion: 2.1 time: 0.296061 Jul 26 19:47:21.376686 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 527/1136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:21 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 1458 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:21.383001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-372e9d31-a161-41c3-885f-81d72ea0d6ef tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:21.385648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-372e9d31-a161-41c3-885f-81d72ea0d6ef tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:21.393571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-372e9d31-a161-41c3-885f-81d72ea0d6ef tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:21.394377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-372e9d31-a161-41c3-885f-81d72ea0d6ef tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:21.395530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-372e9d31-a161-41c3-885f-81d72ea0d6ef tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:21.396621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-372e9d31-a161-41c3-885f-81d72ea0d6ef tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:21.605990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-372e9d31-a161-41c3-885f-81d72ea0d6ef tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:21.615273 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-372e9d31-a161-41c3-885f-81d72ea0d6ef tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1522 microversion: 2.1 time: 0.236658 Jul 26 19:47:21.630528 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 528/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:21 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:21.635938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2546083e-012f-404a-8b89-bf5157db6f46 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:21.636761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2546083e-012f-404a-8b89-bf5157db6f46 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:21.643464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2546083e-012f-404a-8b89-bf5157db6f46 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:21.644204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2546083e-012f-404a-8b89-bf5157db6f46 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:21.645760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2546083e-012f-404a-8b89-bf5157db6f46 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:21.646419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2546083e-012f-404a-8b89-bf5157db6f46 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.065118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2546083e-012f-404a-8b89-bf5157db6f46 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:22.077138 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2546083e-012f-404a-8b89-bf5157db6f46 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1325 microversion: 2.1 time: 0.443215 Jul 26 19:47:22.077745 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 529/1138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:21 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1325 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:22.095000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d7a4eceb-1957-465e-bbe2-06cba5262231 req-1a4ca76a-9755-4d80-b23a-e112666b39e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b0264e-b656-49c4-b9cf-ff371219e527", "name": "network-vif-plugged", "status": "completed", "tag": "db8dc067-ea7b-48a2-9e5c-e0b4db210b25"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:22.115242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d7a4eceb-1957-465e-bbe2-06cba5262231 req-1a4ca76a-9755-4d80-b23a-e112666b39e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:22.115875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d7a4eceb-1957-465e-bbe2-06cba5262231 req-1a4ca76a-9755-4d80-b23a-e112666b39e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.128888 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d7a4eceb-1957-465e-bbe2-06cba5262231 req-1a4ca76a-9755-4d80-b23a-e112666b39e2 service nova] Creating event network-vif-plugged:db8dc067-ea7b-48a2-9e5c-e0b4db210b25 for instance d2b0264e-b656-49c4-b9cf-ff371219e527 on n-h2-708768-8 Jul 26 19:47:22.134301 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d7a4eceb-1957-465e-bbe2-06cba5262231 req-1a4ca76a-9755-4d80-b23a-e112666b39e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052778 Jul 26 19:47:22.136146 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 530/1139] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:22.160883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a401c96b-8afc-43e4-b15e-08ea60d7d0b0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:22.162074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a401c96b-8afc-43e4-b15e-08ea60d7d0b0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:22.171102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a401c96b-8afc-43e4-b15e-08ea60d7d0b0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:22.171947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a401c96b-8afc-43e4-b15e-08ea60d7d0b0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.173511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a401c96b-8afc-43e4-b15e-08ea60d7d0b0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:22.174176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a401c96b-8afc-43e4-b15e-08ea60d7d0b0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.676166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a401c96b-8afc-43e4-b15e-08ea60d7d0b0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:22.691985 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a401c96b-8afc-43e4-b15e-08ea60d7d0b0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 0.553382 Jul 26 19:47:22.693347 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 531/1140] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:22 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:22.700018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a425fb8-395f-45c7-8969-bb327ae45c11 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:22.701352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8a425fb8-395f-45c7-8969-bb327ae45c11 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:22.715434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a425fb8-395f-45c7-8969-bb327ae45c11 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:22.716168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a425fb8-395f-45c7-8969-bb327ae45c11 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.717164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a425fb8-395f-45c7-8969-bb327ae45c11 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:22.717806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a425fb8-395f-45c7-8969-bb327ae45c11 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.921133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:47:22.922481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:47:22.923070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:47:22.923646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:47:22.924272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:47:22.927536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a425fb8-395f-45c7-8969-bb327ae45c11 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:22.929244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:22.937135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a425fb8-395f-45c7-8969-bb327ae45c11 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1467 microversion: 2.1 time: 0.242518 Jul 26 19:47:22.938382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 532/1141] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:22 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1467 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:22.940063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:22.940845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.942373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:22.943190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.944821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0af85bd3-373b-44a1-b2da-57ef4a422927 req-70871631-a20f-43b6-ada6-49e24fd30661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49f71d5-ce26-4218-95e0-2c29a1daa4d6", "name": "network-vif-deleted", "tag": "98e9c29f-1acb-4957-8bff-2009cc1583ee"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:22.965061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0af85bd3-373b-44a1-b2da-57ef4a422927 req-70871631-a20f-43b6-ada6-49e24fd30661 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:22.965974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0af85bd3-373b-44a1-b2da-57ef4a422927 req-70871631-a20f-43b6-ada6-49e24fd30661 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:22.966266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for project 3d10540a08974fd0854fea20ae5c216b. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:22.972552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for user ccd551ea4e0641a0bf17d669481136fa and project 3d10540a08974fd0854fea20ae5c216b. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:22.987581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:47:22.990074 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0af85bd3-373b-44a1-b2da-57ef4a422927 req-70871631-a20f-43b6-ada6-49e24fd30661 service nova] Creating event network-vif-deleted:98e9c29f-1acb-4957-8bff-2009cc1583ee for instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 on n-h1-708768-8 Jul 26 19:47:22.991265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:47:22.997128 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0af85bd3-373b-44a1-b2da-57ef4a422927 req-70871631-a20f-43b6-ada6-49e24fd30661 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057038 Jul 26 19:47:22.998237 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 533/1142] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:23.009989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:23.010511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:23.042830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.043202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.050696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.051195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.101388 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] HTTP exception thrown: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Request method failure captured: Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 HTTP/1.1 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUw9Ab3sy7XFLAFENANa05FTRXa2luW19zn7QSjMB3hmj_gpYA1Ecv7AH41l5ntHy8NkDPjqdBlyDh4MR8VpKd9VkAyewujZS7O02XmjAI6e5nr5e3UYKHNBgGOd_ZbPgpAeF2afWY7EETTICQ6BWEa8dXvzP5MZ530GaFE1TS-gE Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6113ee63ec934bc0b5d4eb9964635785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}] Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ee2737b46af94ceea33cdd0255db0c7a Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a49f71d5-ce26-4218-95e0-2c29a1daa4d6'} Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:23.109028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.114838 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:23.114838 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:23.114838 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:23.114838 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:23.114838 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:23.114838 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.114838 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.118697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Returning 404 to user: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:23.122005 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed0128f7-e064-47b9-b8f7-88d0c12de716 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 404 len: 111 microversion: 2.1 time: 0.122324 Jul 26 19:47:23.127974 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 534/1143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:22 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:23.136123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47008b67-dddc-4ae8-b125-62835217e764 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:23.136413 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-834e0e82-de18-4baa-9790-673121ef072d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.471338 Jul 26 19:47:23.144196 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 610/1144] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:47:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 19:47:23.147576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47008b67-dddc-4ae8-b125-62835217e764 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:23.157008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d6c715e-a3aa-4f21-8a9a-a2c1f5a725ce tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:23.158488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d6c715e-a3aa-4f21-8a9a-a2c1f5a725ce tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:23.167361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47008b67-dddc-4ae8-b125-62835217e764 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.180026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47008b67-dddc-4ae8-b125-62835217e764 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.180872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47008b67-dddc-4ae8-b125-62835217e764 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.184934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47008b67-dddc-4ae8-b125-62835217e764 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.206234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d6c715e-a3aa-4f21-8a9a-a2c1f5a725ce tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.207175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d6c715e-a3aa-4f21-8a9a-a2c1f5a725ce tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.215237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d6c715e-a3aa-4f21-8a9a-a2c1f5a725ce tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.216187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d6c715e-a3aa-4f21-8a9a-a2c1f5a725ce tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.254920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:23.639384 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d6c715e-a3aa-4f21-8a9a-a2c1f5a725ce tempest-ServersOnMultiNodesTest-1267937602 tempest-ServersOnMultiNodesTest-1267937602-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1618 microversion: 2.1 time: 0.493371 Jul 26 19:47:23.646546 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 611/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:23 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1618 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:23.653939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-611aadac-60d2-4f5d-8e70-63197dffc1ee tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:23.654557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-611aadac-60d2-4f5d-8e70-63197dffc1ee tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:23.663595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-611aadac-60d2-4f5d-8e70-63197dffc1ee tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.664337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-611aadac-60d2-4f5d-8e70-63197dffc1ee tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.665440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-611aadac-60d2-4f5d-8e70-63197dffc1ee tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.666084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-611aadac-60d2-4f5d-8e70-63197dffc1ee tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.722704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47008b67-dddc-4ae8-b125-62835217e764 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:23.741198 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47008b67-dddc-4ae8-b125-62835217e764 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1522 microversion: 2.1 time: 0.611560 Jul 26 19:47:23.741861 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 535/1146] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:23 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:23.759479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:23.767032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:23.779339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.779849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.780651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:23.781763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:23.799315 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] HTTP exception thrown: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Request method failure captured: Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 HTTP/1.1 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUw9Ab3sy7XFLAFENANa05FTRXa2luW19zn7QSjMB3hmj_gpYA1Ecv7AH41l5ntHy8NkDPjqdBlyDh4MR8VpKd9VkAyewujZS7O02XmjAI6e5nr5e3UYKHNBgGOd_ZbPgpAeF2afWY7EETTICQ6BWEa8dXvzP5MZ530GaFE1TS-gE Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6113ee63ec934bc0b5d4eb9964635785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}] Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ee2737b46af94ceea33cdd0255db0c7a Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a49f71d5-ce26-4218-95e0-2c29a1daa4d6'} Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:23.802609 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Returning 404 to user: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f99c9ce0-8786-4263-890b-0d6cda946455 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 404 len: 111 microversion: 2.1 time: 0.053437 Jul 26 19:47:23.807813 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 536/1147] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:23 2022] DELETE /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:23.814126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-35762e82-6be7-4d63-be53-632881f82c0a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:23.815042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-35762e82-6be7-4d63-be53-632881f82c0a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:23.959956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-611aadac-60d2-4f5d-8e70-63197dffc1ee tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:23.974431 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-611aadac-60d2-4f5d-8e70-63197dffc1ee tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1325 microversion: 2.1 time: 0.325551 Jul 26 19:47:23.975485 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 612/1148] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:23 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:23.995766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-35762e82-6be7-4d63-be53-632881f82c0a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:24.009535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-35762e82-6be7-4d63-be53-632881f82c0a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:24.017232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-35762e82-6be7-4d63-be53-632881f82c0a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:24.018845 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-35762e82-6be7-4d63-be53-632881f82c0a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1284 microversion: 2.25 time: 0.212307 Jul 26 19:47:24.019637 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 537/1149] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:23 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:24.032987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5ca4df3-a3f5-435c-832f-c9fc6294ac0d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:24.039401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5ca4df3-a3f5-435c-832f-c9fc6294ac0d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:24.067365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5ca4df3-a3f5-435c-832f-c9fc6294ac0d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.067843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5ca4df3-a3f5-435c-832f-c9fc6294ac0d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:24.068717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5ca4df3-a3f5-435c-832f-c9fc6294ac0d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.071997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5ca4df3-a3f5-435c-832f-c9fc6294ac0d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:24.157683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5ca4df3-a3f5-435c-832f-c9fc6294ac0d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:24.252149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:24.289775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-490832752", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "b68afadd-edc6-44a4-b2fb-0aa29390b4aa"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:24.322404 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5ca4df3-a3f5-435c-832f-c9fc6294ac0d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 204 len: 0 microversion: 2.1 time: 0.292557 Jul 26 19:47:24.323396 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 538/1150] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:24 2022] DELETE /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:24.329463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4bb91e54-5d58-4a38-b48c-c23ddf9bf7d8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:24.330373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4bb91e54-5d58-4a38-b48c-c23ddf9bf7d8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:24.337382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bb91e54-5d58-4a38-b48c-c23ddf9bf7d8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.338080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bb91e54-5d58-4a38-b48c-c23ddf9bf7d8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:24.339025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bb91e54-5d58-4a38-b48c-c23ddf9bf7d8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.339689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bb91e54-5d58-4a38-b48c-c23ddf9bf7d8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:24.412636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] validate_networks() for [('b68afadd-edc6-44a4-b2fb-0aa29390b4aa', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:47:24.777864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4bb91e54-5d58-4a38-b48c-c23ddf9bf7d8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:24.792808 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4bb91e54-5d58-4a38-b48c-c23ddf9bf7d8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1315 microversion: 2.1 time: 0.467864 Jul 26 19:47:24.807758 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 539/1151] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:24 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:24.820780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:24.823161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: a49f71d5-ce26-4218-95e0-2c29a1daa4d6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:24.831875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.833217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:24.834452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.835110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:24.866214 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] HTTP exception thrown: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Request method failure captured: Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 HTTP/1.1 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUw9Ab3sy7XFLAFENANa05FTRXa2luW19zn7QSjMB3hmj_gpYA1Ecv7AH41l5ntHy8NkDPjqdBlyDh4MR8VpKd9VkAyewujZS7O02XmjAI6e5nr5e3UYKHNBgGOd_ZbPgpAeF2afWY7EETTICQ6BWEa8dXvzP5MZ530GaFE1TS-gE Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6113ee63ec934bc0b5d4eb9964635785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}] Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ee2737b46af94ceea33cdd0255db0c7a Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a49f71d5-ce26-4218-95e0-2c29a1daa4d6'} Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:24.868104 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:24.872904 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:24.872904 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:24.872904 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:24.872904 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:24.872904 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:24.872904 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. Jul 26 19:47:24.872904 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:24.873837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Returning 404 to user: Instance a49f71d5-ce26-4218-95e0-2c29a1daa4d6 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:24.875011 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa4917c9-68c7-44ce-bc64-6c7bee83cee2 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6" status: 404 len: 111 microversion: 2.1 time: 0.065950 Jul 26 19:47:24.876229 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 540/1152] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:24 2022] GET /compute/v2.1/servers/a49f71d5-ce26-4218-95e0-2c29a1daa4d6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:24.881887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-813b2bc1-40cd-4e62-8c13-0972f2d39727 req-75f01e9f-d99a-41de-8c61-60c6f3bbd298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9a3004-dc44-4bfc-926a-3f0ed3e29227", "name": "network-vif-plugged", "status": "completed", "tag": "d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:24.892689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-813b2bc1-40cd-4e62-8c13-0972f2d39727 req-75f01e9f-d99a-41de-8c61-60c6f3bbd298 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.893302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-813b2bc1-40cd-4e62-8c13-0972f2d39727 req-75f01e9f-d99a-41de-8c61-60c6f3bbd298 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:24.911376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-813b2bc1-40cd-4e62-8c13-0972f2d39727 req-75f01e9f-d99a-41de-8c61-60c6f3bbd298 service nova] Creating event network-vif-plugged:d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134 for instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 on n-h2-708768-8 Jul 26 19:47:24.916599 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-813b2bc1-40cd-4e62-8c13-0972f2d39727 req-75f01e9f-d99a-41de-8c61-60c6f3bbd298 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038900 Jul 26 19:47:24.917903 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 541/1153] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:24.924379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-396bc774-5ac5-49a7-96d3-027ce836531a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:24.925333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-396bc774-5ac5-49a7-96d3-027ce836531a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:24.939258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-396bc774-5ac5-49a7-96d3-027ce836531a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.943205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-396bc774-5ac5-49a7-96d3-027ce836531a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:24.944327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-396bc774-5ac5-49a7-96d3-027ce836531a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:24.945103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-396bc774-5ac5-49a7-96d3-027ce836531a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.148937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:47:25.149502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:47:25.150092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:47:25.150498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:47:25.150905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:47:25.161092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.161591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.162326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.162755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.215103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Getting quotas for project be611136e6fb4e76a8c09eeca8c680e1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:25.227678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Getting quotas for user e0d53a02dff7419faf17fb9ef0e0ad2d and project be611136e6fb4e76a8c09eeca8c680e1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:25.252576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:47:25.261986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:47:25.290242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-396bc774-5ac5-49a7-96d3-027ce836531a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:25.300449 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-396bc774-5ac5-49a7-96d3-027ce836531a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1473 microversion: 2.1 time: 0.380349 Jul 26 19:47:25.301275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 542/1154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:24 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:25.308300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-723b6644-1d2a-444e-bcb7-ae5bf87f088d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:25.309107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-723b6644-1d2a-444e-bcb7-ae5bf87f088d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:25.319909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-723b6644-1d2a-444e-bcb7-ae5bf87f088d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.321131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-723b6644-1d2a-444e-bcb7-ae5bf87f088d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.322193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-723b6644-1d2a-444e-bcb7-ae5bf87f088d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.322855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-723b6644-1d2a-444e-bcb7-ae5bf87f088d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.350747 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85517a0e-5ac9-4c9e-ae50-95fe0cf0bfc9 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372880 Jul 26 19:47:25.351414 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 613/1155] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:47:25.362307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:25.362967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:25.370158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.370771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.372925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.374344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.424672 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] HTTP exception thrown: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Request method failure captured: Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 HTTP/1.1 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESUw9Ab3sy7XFLAFENANa05FTRXa2luW19zn7QSjMB3hmj_gpYA1Ecv7AH41l5ntHy8NkDPjqdBlyDh4MR8VpKd9VkAyewujZS7O02XmjAI6e5nr5e3UYKHNBgGOd_ZbPgpAeF2afWY7EETTICQ6BWEa8dXvzP5MZ530GaFE1TS-gE Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6113ee63ec934bc0b5d4eb9964635785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}] Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ee2737b46af94ceea33cdd0255db0c7a Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'fb4cd623-5130-4132-8131-104c912de596'} Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:25.427581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.431664 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.434727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Returning 404 to user: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:25.435737 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a6913843-ed78-448e-bb13-3002d61fae4c tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 404 len: 111 microversion: 2.1 time: 0.077917 Jul 26 19:47:25.437830 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 614/1156] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:25 2022] DELETE /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:25.461804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1c90ee84-4701-4234-8164-b4dd8ceb6eb7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:25.465226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1c90ee84-4701-4234-8164-b4dd8ceb6eb7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:25.479397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c90ee84-4701-4234-8164-b4dd8ceb6eb7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.480274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c90ee84-4701-4234-8164-b4dd8ceb6eb7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.485538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c90ee84-4701-4234-8164-b4dd8ceb6eb7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.486297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c90ee84-4701-4234-8164-b4dd8ceb6eb7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.611549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-723b6644-1d2a-444e-bcb7-ae5bf87f088d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:25.620515 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-723b6644-1d2a-444e-bcb7-ae5bf87f088d tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1522 microversion: 2.1 time: 0.317584 Jul 26 19:47:25.621229 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 543/1157] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:25 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:25.648717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:25.649332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:25.664852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:25.666491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.671001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.671563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.672038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.693017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1c90ee84-4701-4234-8164-b4dd8ceb6eb7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:25.701040 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1c90ee84-4701-4234-8164-b4dd8ceb6eb7 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1325 microversion: 2.1 time: 0.259455 Jul 26 19:47:25.712126 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 615/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:25 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:25.722754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ee9e4bb5-b809-484c-af46-1132104b7320 req-601d3faa-b3db-4f6e-b2cf-61b5c64d3173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d3b0f0-e8fa-4d5c-9156-5b440407583e", "tag": "f5276e87-c9b2-43c8-8745-91203cdf9e27"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:25.735021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ee9e4bb5-b809-484c-af46-1132104b7320 req-601d3faa-b3db-4f6e-b2cf-61b5c64d3173 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.735562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ee9e4bb5-b809-484c-af46-1132104b7320 req-601d3faa-b3db-4f6e-b2cf-61b5c64d3173 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.749973 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ee9e4bb5-b809-484c-af46-1132104b7320 req-601d3faa-b3db-4f6e-b2cf-61b5c64d3173 service nova] Creating event network-changed:f5276e87-c9b2-43c8-8745-91203cdf9e27 for instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e on n-h1-708768-8 Jul 26 19:47:25.756125 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ee9e4bb5-b809-484c-af46-1132104b7320 req-601d3faa-b3db-4f6e-b2cf-61b5c64d3173 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037313 Jul 26 19:47:25.757315 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 616/1159] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:25.764650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6d71d9ea-9450-491a-bddf-c71e4ead0b59 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:25.765589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6d71d9ea-9450-491a-bddf-c71e4ead0b59 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:25.802308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:25.813612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:25.815131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:25.816311 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4c43cfe-a16e-4663-a9d6-ba887f50e194 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1336 microversion: 2.25 time: 0.175553 Jul 26 19:47:25.816923 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 544/1160] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:25 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1336 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:25.826593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:25.827203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] [instance: fb4cd623-5130-4132-8131-104c912de596] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:25.834489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6d71d9ea-9450-491a-bddf-c71e4ead0b59 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:25.842543 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6d71d9ea-9450-491a-bddf-c71e4ead0b59 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1215 microversion: 2.1 time: 0.083848 Jul 26 19:47:25.846708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.847264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.849390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.849910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.861523 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 617/1161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:25 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:25.867641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b96a8d5a-2f21-40e8-8d2a-7a96461f8584 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:25.868464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b96a8d5a-2f21-40e8-8d2a-7a96461f8584 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:25.871595 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] HTTP exception thrown: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Request method failure captured: Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 HTTP/1.1 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUw9Ab3sy7XFLAFENANa05FTRXa2luW19zn7QSjMB3hmj_gpYA1Ecv7AH41l5ntHy8NkDPjqdBlyDh4MR8VpKd9VkAyewujZS7O02XmjAI6e5nr5e3UYKHNBgGOd_ZbPgpAeF2afWY7EETTICQ6BWEa8dXvzP5MZ530GaFE1TS-gE Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6113ee63ec934bc0b5d4eb9964635785", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6113ee63ec934bc0b5d4eb9964635785"}]}] Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6113ee63ec934bc0b5d4eb9964635785 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-860605474 Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ee2737b46af94ceea33cdd0255db0c7a Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersAdminTestJSON-860605474-project Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'fb4cd623-5130-4132-8131-104c912de596'} Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:25.873418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.878239 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:25.878239 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:25.878239 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:25.878239 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:25.878239 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:25.878239 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. Jul 26 19:47:25.878239 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:25.879896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] Returning 404 to user: Instance fb4cd623-5130-4132-8131-104c912de596 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:25.880884 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-caf6bbeb-8db2-4865-b514-6fd43c71e236 tempest-DeleteServersAdminTestJSON-860605474 tempest-DeleteServersAdminTestJSON-860605474-project] 10.222.0.58 "GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596" status: 404 len: 111 microversion: 2.1 time: 0.057993 Jul 26 19:47:25.881859 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 545/1162] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:25 2022] GET /compute/v2.1/servers/fb4cd623-5130-4132-8131-104c912de596 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:25.887331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b96a8d5a-2f21-40e8-8d2a-7a96461f8584 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.887851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b96a8d5a-2f21-40e8-8d2a-7a96461f8584 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:25.888723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b96a8d5a-2f21-40e8-8d2a-7a96461f8584 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:25.889181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b96a8d5a-2f21-40e8-8d2a-7a96461f8584 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:26.237115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b96a8d5a-2f21-40e8-8d2a-7a96461f8584 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:26.248867 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b96a8d5a-2f21-40e8-8d2a-7a96461f8584 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1501 microversion: 2.1 time: 0.386173 Jul 26 19:47:26.251738 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 618/1163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:25 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1501 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:26.323390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-439fde1b-15e9-4621-a9a2-206fecca6849 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:26.324868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-439fde1b-15e9-4621-a9a2-206fecca6849 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:26.339281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-439fde1b-15e9-4621-a9a2-206fecca6849 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:26.340012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-439fde1b-15e9-4621-a9a2-206fecca6849 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:26.341014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-439fde1b-15e9-4621-a9a2-206fecca6849 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:26.343428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-439fde1b-15e9-4621-a9a2-206fecca6849 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:26.600292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-439fde1b-15e9-4621-a9a2-206fecca6849 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:26.618372 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-439fde1b-15e9-4621-a9a2-206fecca6849 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1473 microversion: 2.1 time: 0.299307 Jul 26 19:47:26.620286 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 546/1164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:26 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:26.645629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26e7a9aa-9c1a-45ea-af08-5fceba9e7765 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:26.646475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-26e7a9aa-9c1a-45ea-af08-5fceba9e7765 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:26.662961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26e7a9aa-9c1a-45ea-af08-5fceba9e7765 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:26.663805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26e7a9aa-9c1a-45ea-af08-5fceba9e7765 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:26.673768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26e7a9aa-9c1a-45ea-af08-5fceba9e7765 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:26.679982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26e7a9aa-9c1a-45ea-af08-5fceba9e7765 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:26.727421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec985dc5-c099-4cd4-bbf1-9892446bd2a8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:26.730254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ec985dc5-c099-4cd4-bbf1-9892446bd2a8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:26.747248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec985dc5-c099-4cd4-bbf1-9892446bd2a8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:26.751096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec985dc5-c099-4cd4-bbf1-9892446bd2a8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:26.751974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec985dc5-c099-4cd4-bbf1-9892446bd2a8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:26.752427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec985dc5-c099-4cd4-bbf1-9892446bd2a8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:27.078688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ec985dc5-c099-4cd4-bbf1-9892446bd2a8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:27.096481 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ec985dc5-c099-4cd4-bbf1-9892446bd2a8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1325 microversion: 2.1 time: 0.374106 Jul 26 19:47:27.098770 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 547/1165] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:26 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1325 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:27.109354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:27.109987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:27.134956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:27.135766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:27.136937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:27.137453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:27.213503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:27.227165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:27.229162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:27.230771 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7588f638-ee57-4a4b-8920-8c902fb35537 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1342 microversion: 2.25 time: 0.130945 Jul 26 19:47:27.232176 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 548/1166] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:27 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1342 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:27.238254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e35008b9-5a63-408d-9942-ff76cfc4fbed tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:27.239748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e35008b9-5a63-408d-9942-ff76cfc4fbed tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:27.246406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e35008b9-5a63-408d-9942-ff76cfc4fbed tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:27.247102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e35008b9-5a63-408d-9942-ff76cfc4fbed tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:27.248079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e35008b9-5a63-408d-9942-ff76cfc4fbed tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:27.248809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e35008b9-5a63-408d-9942-ff76cfc4fbed tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:27.407760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e35008b9-5a63-408d-9942-ff76cfc4fbed tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:27.420821 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e35008b9-5a63-408d-9942-ff76cfc4fbed tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1267 microversion: 2.1 time: 0.184554 Jul 26 19:47:27.425667 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 549/1167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:27 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:27.645629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02b2cd04-b29c-49e4-9d6d-f624b2695283 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:27.646687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02b2cd04-b29c-49e4-9d6d-f624b2695283 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:27.656358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02b2cd04-b29c-49e4-9d6d-f624b2695283 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:27.656813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02b2cd04-b29c-49e4-9d6d-f624b2695283 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:27.657597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02b2cd04-b29c-49e4-9d6d-f624b2695283 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:27.658037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02b2cd04-b29c-49e4-9d6d-f624b2695283 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:27.856101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-26e7a9aa-9c1a-45ea-af08-5fceba9e7765 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:27.866222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26e7a9aa-9c1a-45ea-af08-5fceba9e7765 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1522 microversion: 2.1 time: 1.225361 Jul 26 19:47:27.872462 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 619/1168] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:26 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1522 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:28.132323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14f9d71b-3d22-4b15-85bd-9dd05d886f98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:28.133410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14f9d71b-3d22-4b15-85bd-9dd05d886f98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:28.143272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14f9d71b-3d22-4b15-85bd-9dd05d886f98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:28.144147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14f9d71b-3d22-4b15-85bd-9dd05d886f98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:28.145611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14f9d71b-3d22-4b15-85bd-9dd05d886f98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:28.147112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14f9d71b-3d22-4b15-85bd-9dd05d886f98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:28.338108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02b2cd04-b29c-49e4-9d6d-f624b2695283 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:28.345856 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02b2cd04-b29c-49e4-9d6d-f624b2695283 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1473 microversion: 2.1 time: 0.705283 Jul 26 19:47:28.364511 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 550/1169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:27 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1473 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:28.369457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:28.379679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:28.394803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:28.396914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:28.398847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:28.401156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:28.552743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:28.564157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:28.566103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:28.567777 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7a3416c1-6f85-44fe-9260-58c49f698c2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1342 microversion: 2.25 time: 0.202140 Jul 26 19:47:28.580697 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 551/1170] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:28 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:28.594055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-976236bf-3365-48fc-b0fd-7f7580120c01 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:28.595081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-976236bf-3365-48fc-b0fd-7f7580120c01 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:28.602827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-976236bf-3365-48fc-b0fd-7f7580120c01 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:28.603706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-976236bf-3365-48fc-b0fd-7f7580120c01 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:28.605010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-976236bf-3365-48fc-b0fd-7f7580120c01 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:28.605687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-976236bf-3365-48fc-b0fd-7f7580120c01 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:28.761538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-976236bf-3365-48fc-b0fd-7f7580120c01 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:28.783603 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-976236bf-3365-48fc-b0fd-7f7580120c01 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1273 microversion: 2.1 time: 0.201250 Jul 26 19:47:28.786819 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 552/1171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:28 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:28.894775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-13924e33-ea81-45e8-be15-5fed53d74169 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:28.895591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-13924e33-ea81-45e8-be15-5fed53d74169 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:28.908239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-13924e33-ea81-45e8-be15-5fed53d74169 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:28.909328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-13924e33-ea81-45e8-be15-5fed53d74169 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:28.910159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-13924e33-ea81-45e8-be15-5fed53d74169 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:28.911441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-13924e33-ea81-45e8-be15-5fed53d74169 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:28.985529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14f9d71b-3d22-4b15-85bd-9dd05d886f98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:28.997169 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14f9d71b-3d22-4b15-85bd-9dd05d886f98 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1325 microversion: 2.1 time: 0.879254 Jul 26 19:47:28.999688 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 620/1172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:28 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1325 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:29.126646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-eddefc49-02e0-490a-85ec-b07141d9df23 req-bdc49afc-c419-4846-8865-93c494eb1c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e11c63b9-a4d7-4d28-ad47-7dbb5059bce7", "name": "network-vif-deleted", "tag": "10e38cd6-9336-4305-a145-1a2539c3a12e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:29.150184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-eddefc49-02e0-490a-85ec-b07141d9df23 req-bdc49afc-c419-4846-8865-93c494eb1c4d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.150644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-eddefc49-02e0-490a-85ec-b07141d9df23 req-bdc49afc-c419-4846-8865-93c494eb1c4d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.185138 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-eddefc49-02e0-490a-85ec-b07141d9df23 req-bdc49afc-c419-4846-8865-93c494eb1c4d service nova] Creating event network-vif-deleted:10e38cd6-9336-4305-a145-1a2539c3a12e for instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 on n-h1-708768-8 Jul 26 19:47:29.194783 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-eddefc49-02e0-490a-85ec-b07141d9df23 req-bdc49afc-c419-4846-8865-93c494eb1c4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071773 Jul 26 19:47:29.196239 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 621/1173] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:29.219292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1c7f8ca-0831-418f-a87b-20ac3682873a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0297dd50-13d1-432f-a45a-464f1240dbe2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:29.222022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1c7f8ca-0831-418f-a87b-20ac3682873a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:29.237482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8ca-0831-418f-a87b-20ac3682873a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.246389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8ca-0831-418f-a87b-20ac3682873a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.247432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8ca-0831-418f-a87b-20ac3682873a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.248168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c7f8ca-0831-418f-a87b-20ac3682873a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.475496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-13924e33-ea81-45e8-be15-5fed53d74169 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:29.486487 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-13924e33-ea81-45e8-be15-5fed53d74169 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1507 microversion: 2.1 time: 0.595955 Jul 26 19:47:29.487360 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 553/1174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:28 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1507 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:29.493877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:29.494750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:29.512575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.513218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.514762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.515366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.559442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.559442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.560137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lazy-loading 'fault' on Instance uuid e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:29.676425 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1c7f8ca-0831-418f-a87b-20ac3682873a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458372 Jul 26 19:47:29.683554 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 622/1175] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 19:47:29 2022] POST /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:29.698424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-29057e9f-7744-489e-8eea-a7574a10a27f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:29.701618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-29057e9f-7744-489e-8eea-a7574a10a27f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:29.722584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29057e9f-7744-489e-8eea-a7574a10a27f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.724107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29057e9f-7744-489e-8eea-a7574a10a27f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.727248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29057e9f-7744-489e-8eea-a7574a10a27f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.729212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29057e9f-7744-489e-8eea-a7574a10a27f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.811727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:29.831594 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0bb62144-9c86-4cd0-890a-118a5160e7d3 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 200 len: 1307 microversion: 2.1 time: 0.342935 Jul 26 19:47:29.849338 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 554/1176] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:29 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:29.860331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:29.861301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:29.876962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.877857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:29.882508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:29.883217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:30.088915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-29057e9f-7744-489e-8eea-a7574a10a27f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:30.100521 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-29057e9f-7744-489e-8eea-a7574a10a27f tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 200 len: 1507 microversion: 2.1 time: 0.413750 Jul 26 19:47:30.101463 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 623/1177] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:29 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:30.116127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-06ab3edf-b51b-4424-ab7f-addd347f8521 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:30.116127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-06ab3edf-b51b-4424-ab7f-addd347f8521 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:30.117720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06ab3edf-b51b-4424-ab7f-addd347f8521 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:30.118284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06ab3edf-b51b-4424-ab7f-addd347f8521 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:30.120152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06ab3edf-b51b-4424-ab7f-addd347f8521 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:30.120878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06ab3edf-b51b-4424-ab7f-addd347f8521 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:30.488633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-06ab3edf-b51b-4424-ab7f-addd347f8521 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:30.504960 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-06ab3edf-b51b-4424-ab7f-addd347f8521 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.397693 Jul 26 19:47:30.512740 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 624/1178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:30 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:30.524117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-496f2512-81c0-4a05-8c8e-571a5b0ddce1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:30.524736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-496f2512-81c0-4a05-8c8e-571a5b0ddce1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:30.549030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-496f2512-81c0-4a05-8c8e-571a5b0ddce1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:30.549486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-496f2512-81c0-4a05-8c8e-571a5b0ddce1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:30.550274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-496f2512-81c0-4a05-8c8e-571a5b0ddce1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:30.551120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-496f2512-81c0-4a05-8c8e-571a5b0ddce1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:30.698497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:30.704621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:30.709902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:30.713890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:30.718186 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63bafbd6-d8ed-47e0-8259-61b9a6361713 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.867013 Jul 26 19:47:30.720401 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 555/1179] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:29 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:30.731921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5e5b7fe9-e869-413c-aced-ee541a998203 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:30.732436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5e5b7fe9-e869-413c-aced-ee541a998203 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:30.769427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e5b7fe9-e869-413c-aced-ee541a998203 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:30.770867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e5b7fe9-e869-413c-aced-ee541a998203 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:30.771700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e5b7fe9-e869-413c-aced-ee541a998203 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:30.772139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e5b7fe9-e869-413c-aced-ee541a998203 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:30.889260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5e5b7fe9-e869-413c-aced-ee541a998203 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:30.961076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-496f2512-81c0-4a05-8c8e-571a5b0ddce1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:30.971886 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-496f2512-81c0-4a05-8c8e-571a5b0ddce1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1325 microversion: 2.1 time: 0.457925 Jul 26 19:47:30.978973 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 625/1180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:30 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1325 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:30.999001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:30.999692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: e11c63b9-a4d7-4d28-ad47-7dbb5059bce7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:31.012614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:31.013102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:31.016475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:31.019220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:31.055789 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] HTTP exception thrown: Instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 could not be found. Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Request method failure captured: Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 HTTP/1.1 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ2UfAQCIvAOR-VBpEt0CgxFkMSC4ya3OMI2F7uC_6k3uRL_tRT-Sj98az4J8FgRnLpBCJeiBErA5lPIMgNG1YKhBi2K7o7DAE4I9_dn3Dyp-6IV2D4HTt-cFaeMFXt3G53NcilHVMXJRO5YCu47A4f17lB2cUQUbo5p7jAaxPlkPY Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b66d3923b4a4d3dacfa2c53f5af1ac1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}] Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 0bf1dac22e284b15b0e93146dc756338 Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 could not be found. Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e11c63b9-a4d7-4d28-ad47-7dbb5059bce7'} Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 could not be found. Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 could not be found. Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:31.060480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:31.065940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:31.065940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:31.065940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:31.065940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:31.065940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:31.065940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 could not be found. Jul 26 19:47:31.065940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:31.068544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Returning 404 to user: Instance e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:31.079152 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-166d91a7-c90a-411a-b218-d81dc8b22442 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7" status: 404 len: 111 microversion: 2.1 time: 0.092916 Jul 26 19:47:31.083727 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 626/1181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:30 2022] GET /compute/v2.1/servers/e11c63b9-a4d7-4d28-ad47-7dbb5059bce7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:31.098879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-41c580dd-dec9-45fb-b723-7419c6bcee7f req-512a9bbc-bc1f-4373-a7b4-df766e96cd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d3b0f0-e8fa-4d5c-9156-5b440407583e", "name": "network-vif-plugged", "status": "completed", "tag": "f5276e87-c9b2-43c8-8745-91203cdf9e27"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:31.124100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-41c580dd-dec9-45fb-b723-7419c6bcee7f req-512a9bbc-bc1f-4373-a7b4-df766e96cd6c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:31.127022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-41c580dd-dec9-45fb-b723-7419c6bcee7f req-512a9bbc-bc1f-4373-a7b4-df766e96cd6c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:31.159351 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5e5b7fe9-e869-413c-aced-ee541a998203 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 204 len: 0 microversion: 2.1 time: 0.437476 Jul 26 19:47:31.165006 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 556/1182] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:30 2022] DELETE /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:31.180023 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-41c580dd-dec9-45fb-b723-7419c6bcee7f req-512a9bbc-bc1f-4373-a7b4-df766e96cd6c service nova] Creating event network-vif-plugged:f5276e87-c9b2-43c8-8745-91203cdf9e27 for instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e on n-h1-708768-8 Jul 26 19:47:31.192451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d742c2b-eea4-404a-90fc-ef2b9c0d3518 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:31.194620 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-41c580dd-dec9-45fb-b723-7419c6bcee7f req-512a9bbc-bc1f-4373-a7b4-df766e96cd6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109389 Jul 26 19:47:31.194911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9d742c2b-eea4-404a-90fc-ef2b9c0d3518 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:31.196137 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 627/1183] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:31.213483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d742c2b-eea4-404a-90fc-ef2b9c0d3518 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:31.214974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d742c2b-eea4-404a-90fc-ef2b9c0d3518 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:31.216230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d742c2b-eea4-404a-90fc-ef2b9c0d3518 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:31.217878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d742c2b-eea4-404a-90fc-ef2b9c0d3518 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:31.283019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9d742c2b-eea4-404a-90fc-ef2b9c0d3518 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:31.407815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2120516102", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "90a80e65-c3c4-4058-b8fa-aa7f6384a3b0"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:31.475505 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9d742c2b-eea4-404a-90fc-ef2b9c0d3518 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 204 len: 0 microversion: 2.1 time: 0.297370 Jul 26 19:47:31.478953 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 557/1184] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:31 2022] DELETE /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:31.491142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-81317f01-3a8e-4d5a-bc01-823f8d512e29 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:31.492592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-81317f01-3a8e-4d5a-bc01-823f8d512e29 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:31.507128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81317f01-3a8e-4d5a-bc01-823f8d512e29 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:31.507588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81317f01-3a8e-4d5a-bc01-823f8d512e29 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:31.509749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] validate_networks() for [('90a80e65-c3c4-4058-b8fa-aa7f6384a3b0', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:47:31.515345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81317f01-3a8e-4d5a-bc01-823f8d512e29 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:31.515866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81317f01-3a8e-4d5a-bc01-823f8d512e29 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:31.931652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-81317f01-3a8e-4d5a-bc01-823f8d512e29 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:31.944726 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-81317f01-3a8e-4d5a-bc01-823f8d512e29 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1473 microversion: 2.1 time: 0.458365 Jul 26 19:47:31.946179 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 558/1185] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:31 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1473 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:31.974515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-330371cb-0603-4938-a5bb-9b4a219010bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:31.981550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-330371cb-0603-4938-a5bb-9b4a219010bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:32.000874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-330371cb-0603-4938-a5bb-9b4a219010bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:32.003216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-330371cb-0603-4938-a5bb-9b4a219010bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:32.009797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-330371cb-0603-4938-a5bb-9b4a219010bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:32.010692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-330371cb-0603-4938-a5bb-9b4a219010bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:32.348270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:47:32.349365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:47:32.350083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:47:32.350836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:47:32.352060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:47:32.373480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:32.374519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:32.375574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:32.376305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:32.403022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Getting quotas for project 88d10cfa367f4bf591a86719352723d6. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:32.412640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Getting quotas for user 4faef4f5be5941fc961c149905589902 and project 88d10cfa367f4bf591a86719352723d6. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:32.430357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-330371cb-0603-4938-a5bb-9b4a219010bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:32.444916 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-330371cb-0603-4938-a5bb-9b4a219010bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.495842 Jul 26 19:47:32.450126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:47:32.453106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:47:32.461976 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 559/1186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:31 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:32.474091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:32.475422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:32.493961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:32.496855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:32.498100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:32.498832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:32.544007 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f83b1677-42bd-466c-af60-99f5be8c270e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.142461 Jul 26 19:47:32.553859 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 628/1187] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:47:32.561110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a77e081-be1a-4762-b8e6-f6e1feea6ca9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:32.591708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a77e081-be1a-4762-b8e6-f6e1feea6ca9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:32.601809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a77e081-be1a-4762-b8e6-f6e1feea6ca9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:32.602273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a77e081-be1a-4762-b8e6-f6e1feea6ca9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:32.603074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a77e081-be1a-4762-b8e6-f6e1feea6ca9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:32.603516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a77e081-be1a-4762-b8e6-f6e1feea6ca9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:33.017274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a77e081-be1a-4762-b8e6-f6e1feea6ca9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:33.050831 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a77e081-be1a-4762-b8e6-f6e1feea6ca9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1325 microversion: 2.1 time: 0.486681 Jul 26 19:47:33.054283 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 629/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:32 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1325 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:33.079834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c7e5bda-d3a5-45bf-a34a-6284ebad1754 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:33.080976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c7e5bda-d3a5-45bf-a34a-6284ebad1754 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:33.103598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:33.117868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:33.119676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:33.123481 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d2dd57c-22db-4a58-8d46-4836c814f490 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.660339 Jul 26 19:47:33.128228 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 560/1189] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:32 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:33.133056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d541b1b-deb8-4874-acbf-365055cffb09 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:33.133672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d541b1b-deb8-4874-acbf-365055cffb09 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:33.152934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d541b1b-deb8-4874-acbf-365055cffb09 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:33.155151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d541b1b-deb8-4874-acbf-365055cffb09 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:33.156234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d541b1b-deb8-4874-acbf-365055cffb09 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:33.157530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d541b1b-deb8-4874-acbf-365055cffb09 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:33.180642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c7e5bda-d3a5-45bf-a34a-6284ebad1754 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:33.190479 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c7e5bda-d3a5-45bf-a34a-6284ebad1754 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1218 microversion: 2.1 time: 0.134494 Jul 26 19:47:33.192140 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 630/1190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:33 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:33.392041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6dfd54b2-9e14-4e31-92fb-c76339aadec2 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-854358850", "id": 754652502, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:33.396517 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:33.396517 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:33.455183 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6dfd54b2-9e14-4e31-92fb-c76339aadec2 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.261722 Jul 26 19:47:33.456254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 631/1191] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:33 2022] POST /compute/v2.1/flavors => generated 426 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:33.474163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7e2b6c44-432e-4de5-b385-3815593f1b0f req-a2b61de6-a276-4377-b142-f6aba935e032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f39e3c9-d789-460b-a36b-c5b9e3527888", "tag": "643df902-6645-4b6e-9c71-22da5df80018"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:33.506317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7e2b6c44-432e-4de5-b385-3815593f1b0f req-a2b61de6-a276-4377-b142-f6aba935e032 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:33.509814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7e2b6c44-432e-4de5-b385-3815593f1b0f req-a2b61de6-a276-4377-b142-f6aba935e032 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:33.542986 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7e2b6c44-432e-4de5-b385-3815593f1b0f req-a2b61de6-a276-4377-b142-f6aba935e032 service nova] Creating event network-changed:643df902-6645-4b6e-9c71-22da5df80018 for instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 on n-h1-708768-8 Jul 26 19:47:33.561027 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7e2b6c44-432e-4de5-b385-3815593f1b0f req-a2b61de6-a276-4377-b142-f6aba935e032 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102867 Jul 26 19:47:33.562510 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 632/1192] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:33.570605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-edd1d387-5171-493b-8640-b36004e335dd tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:33.572615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-edd1d387-5171-493b-8640-b36004e335dd tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:33.589264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edd1d387-5171-493b-8640-b36004e335dd tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:33.589831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edd1d387-5171-493b-8640-b36004e335dd tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:33.590982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edd1d387-5171-493b-8640-b36004e335dd tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:33.591419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edd1d387-5171-493b-8640-b36004e335dd tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:33.806948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-edd1d387-5171-493b-8640-b36004e335dd tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:33.814728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-edd1d387-5171-493b-8640-b36004e335dd tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.250623 Jul 26 19:47:33.818938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 633/1193] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:33 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:33.823572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c0fdf2f-0909-4c45-81b5-e0763b45ac93 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:33.831018 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:33.831018 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:33.846502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:33.853806 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c0fdf2f-0909-4c45-81b5-e0763b45ac93 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/754652502" status: 202 len: 0 microversion: 2.1 time: 0.033742 Jul 26 19:47:33.856111 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 634/1194] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:47:33 2022] DELETE /compute/v2.1/flavors/754652502 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:33.869085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15d441da-65d0-4455-b96c-84cd3e22e01e tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:33.890859 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15d441da-65d0-4455-b96c-84cd3e22e01e tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030798 Jul 26 19:47:33.891855 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 635/1195] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:33.914122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-963ad93e-e49c-4f77-a22c-b0d16fd47ae0 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1277127876", "id": 1296087183, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:33.917569 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:33.917569 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:33.936001 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-963ad93e-e49c-4f77-a22c-b0d16fd47ae0 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.026930 Jul 26 19:47:33.937295 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 636/1196] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:33 2022] POST /compute/v2.1/flavors => generated 417 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:33.948368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54798ae4-195d-4707-8383-57165d53bbcf tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:33.972192 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54798ae4-195d-4707-8383-57165d53bbcf tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.027303 Jul 26 19:47:33.973725 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 637/1197] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:33 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:33.993079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4a3ef57d-83e9-4e6e-8bc5-d19eed4586e2 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:34.001499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:34.036431 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4a3ef57d-83e9-4e6e-8bc5-d19eed4586e2 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1296087183" status: 202 len: 0 microversion: 2.1 time: 0.047553 Jul 26 19:47:34.038567 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 638/1198] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:47:33 2022] DELETE /compute/v2.1/flavors/1296087183 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:34.056231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc273ea1-8a13-43ef-8f0c-9194d605423a tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:34.097327 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc273ea1-8a13-43ef-8f0c-9194d605423a tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053554 Jul 26 19:47:34.103727 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 639/1199] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:34.108742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e5319d9-9947-48e8-aa71-3ecdb43fb8fe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:34.114513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2e5319d9-9947-48e8-aa71-3ecdb43fb8fe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:34.129578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e5319d9-9947-48e8-aa71-3ecdb43fb8fe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:34.130275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e5319d9-9947-48e8-aa71-3ecdb43fb8fe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:34.131227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e5319d9-9947-48e8-aa71-3ecdb43fb8fe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:34.133285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e5319d9-9947-48e8-aa71-3ecdb43fb8fe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:34.274603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d541b1b-deb8-4874-acbf-365055cffb09 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:34.284309 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d541b1b-deb8-4874-acbf-365055cffb09 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1473 microversion: 2.1 time: 1.154969 Jul 26 19:47:34.284893 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 561/1200] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:33 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1473 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:34.302949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79710b67-ebb9-435b-b4bc-babbe2bd0153 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-568265094", "id": 1585302991, "os-flavor-access:is_public": "True"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:34.308079 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:34.308079 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:34.337037 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79710b67-ebb9-435b-b4bc-babbe2bd0153 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.050536 Jul 26 19:47:34.340447 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 562/1201] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:34 2022] POST /compute/v2.1/flavors => generated 428 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:34.350234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:34.355358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:34.370429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:34.373340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:34.375187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:34.376383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:34.623543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e5319d9-9947-48e8-aa71-3ecdb43fb8fe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:34.636659 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e5319d9-9947-48e8-aa71-3ecdb43fb8fe tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1522 microversion: 2.1 time: 0.531583 Jul 26 19:47:34.652229 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 640/1202] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:34 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:34.661193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c343b51-9527-4b07-b264-3e260f38203a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:34.662221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3c343b51-9527-4b07-b264-3e260f38203a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:34.668705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c343b51-9527-4b07-b264-3e260f38203a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:34.669468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c343b51-9527-4b07-b264-3e260f38203a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:34.670415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c343b51-9527-4b07-b264-3e260f38203a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:34.671073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c343b51-9527-4b07-b264-3e260f38203a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:34.675013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:34.805322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c343b51-9527-4b07-b264-3e260f38203a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:34.815285 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c343b51-9527-4b07-b264-3e260f38203a tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1276 microversion: 2.1 time: 0.161892 Jul 26 19:47:34.827638 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 641/1203] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:34 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:34.836531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b44183dc-326b-4186-92e9-c280cf0972bf tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:34.838899 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:34.838899 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:34.865995 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b44183dc-326b-4186-92e9-c280cf0972bf tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1585302991" status: 202 len: 0 microversion: 2.1 time: 0.046951 Jul 26 19:47:34.869921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 642/1204] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:47:34 2022] DELETE /compute/v2.1/flavors/1585302991 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:34.875836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-65cf58c6-fc3b-4484-84e9-9dfb0053b81f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:34.876541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-65cf58c6-fc3b-4484-84e9-9dfb0053b81f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:34.885618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65cf58c6-fc3b-4484-84e9-9dfb0053b81f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:34.886152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65cf58c6-fc3b-4484-84e9-9dfb0053b81f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:34.887333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65cf58c6-fc3b-4484-84e9-9dfb0053b81f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:34.888199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65cf58c6-fc3b-4484-84e9-9dfb0053b81f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.008973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:35.032587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:35.034294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:35.035491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b5286883-b856-4dfc-b5b6-800048f75824 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.693523 Jul 26 19:47:35.051639 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 563/1205] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:34 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:35.058139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afb92fea-cc1d-41f0-a653-b49019e11b58 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:35.059987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-afb92fea-cc1d-41f0-a653-b49019e11b58 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:35.071548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afb92fea-cc1d-41f0-a653-b49019e11b58 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.072042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afb92fea-cc1d-41f0-a653-b49019e11b58 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.073666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afb92fea-cc1d-41f0-a653-b49019e11b58 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.074290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afb92fea-cc1d-41f0-a653-b49019e11b58 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.382169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-65cf58c6-fc3b-4484-84e9-9dfb0053b81f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:35.395822 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-65cf58c6-fc3b-4484-84e9-9dfb0053b81f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1522 microversion: 2.1 time: 0.518910 Jul 26 19:47:35.396514 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 643/1206] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:34 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:35.417999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7d5853da-12e8-4e38-a3ec-426596959d4e tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:35.439749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7d5853da-12e8-4e38-a3ec-426596959d4e tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030608 Jul 26 19:47:35.460123 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 644/1207] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:35.465110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4259b2e0-68a7-4c64-8efa-c12bf7af2891 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:35.465769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4259b2e0-68a7-4c64-8efa-c12bf7af2891 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:35.473875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4259b2e0-68a7-4c64-8efa-c12bf7af2891 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.474329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4259b2e0-68a7-4c64-8efa-c12bf7af2891 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.475111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4259b2e0-68a7-4c64-8efa-c12bf7af2891 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.475543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4259b2e0-68a7-4c64-8efa-c12bf7af2891 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.715280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afb92fea-cc1d-41f0-a653-b49019e11b58 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:35.729559 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afb92fea-cc1d-41f0-a653-b49019e11b58 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.686655 Jul 26 19:47:35.730451 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 564/1208] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:35 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:35.757332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9958979b-7dee-47c7-a9fc-964d5a4884e8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2091698205"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:35.764346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9958979b-7dee-47c7-a9fc-964d5a4884e8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:35.778941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9958979b-7dee-47c7-a9fc-964d5a4884e8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.779393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9958979b-7dee-47c7-a9fc-964d5a4884e8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.790013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9958979b-7dee-47c7-a9fc-964d5a4884e8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.790464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9958979b-7dee-47c7-a9fc-964d5a4884e8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.804119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4259b2e0-68a7-4c64-8efa-c12bf7af2891 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:35.812595 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4259b2e0-68a7-4c64-8efa-c12bf7af2891 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1473 microversion: 2.1 time: 0.351345 Jul 26 19:47:35.828423 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 645/1209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:35 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1473 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:35.833977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f9cb2c0f-3f5f-4134-af49-1b35d0e445e7 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2061493563", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:35.840269 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:35.840269 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:35.865924 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f9cb2c0f-3f5f-4134-af49-1b35d0e445e7 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.036130 Jul 26 19:47:35.866531 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 646/1210] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:35 2022] POST /compute/v2.1/flavors => generated 507 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:35.881382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5317e507-6adf-4d60-a87b-c5485585b36b req-b3d4aa2e-94a2-4475-aee8-399ec84a8112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9a3004-dc44-4bfc-926a-3f0ed3e29227", "name": "network-vif-deleted", "tag": "d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:35.906679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5317e507-6adf-4d60-a87b-c5485585b36b req-b3d4aa2e-94a2-4475-aee8-399ec84a8112 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.908515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5317e507-6adf-4d60-a87b-c5485585b36b req-b3d4aa2e-94a2-4475-aee8-399ec84a8112 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.932861 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5317e507-6adf-4d60-a87b-c5485585b36b req-b3d4aa2e-94a2-4475-aee8-399ec84a8112 service nova] Creating event network-vif-deleted:d3a07c82-4c0d-4c81-b11b-a4b2fbe1e134 for instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 on n-h2-708768-8 Jul 26 19:47:35.939763 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5317e507-6adf-4d60-a87b-c5485585b36b req-b3d4aa2e-94a2-4475-aee8-399ec84a8112 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067080 Jul 26 19:47:35.941478 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 647/1211] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:35.949189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e4638612-1657-49b3-9adc-09f1e3defbe3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:35.950617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e4638612-1657-49b3-9adc-09f1e3defbe3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:35.963989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4638612-1657-49b3-9adc-09f1e3defbe3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.968905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4638612-1657-49b3-9adc-09f1e3defbe3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:35.969963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4638612-1657-49b3-9adc-09f1e3defbe3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:35.970580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4638612-1657-49b3-9adc-09f1e3defbe3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:36.096842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e4638612-1657-49b3-9adc-09f1e3defbe3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:36.106092 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e4638612-1657-49b3-9adc-09f1e3defbe3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1276 microversion: 2.1 time: 0.162386 Jul 26 19:47:36.106705 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 648/1212] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:35 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:36.124294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ee567f4-c47d-4b83-91bb-e1f0e15a8ea1 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:36.125169 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:36.125169 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:36.180232 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ee567f4-c47d-4b83-91bb-e1f0e15a8ea1 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/c1f8290f-3bf3-4c97-ac33-fe177c838c67" status: 202 len: 0 microversion: 2.1 time: 0.069230 Jul 26 19:47:36.182738 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 649/1213] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:36 2022] DELETE /compute/v2.1/flavors/c1f8290f-3bf3-4c97-ac33-fe177c838c67 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:36.193633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e9fe2048-dcd9-42a2-b3fa-c6ec7ef419f7 req-90677664-4f39-4b11-beae-8d4c5716e4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a556b36-2d3e-4d9e-a117-e1f1a20175db", "tag": "8231c664-6893-44d2-a56d-a53c0dacdc59"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:36.205981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e9fe2048-dcd9-42a2-b3fa-c6ec7ef419f7 req-90677664-4f39-4b11-beae-8d4c5716e4b1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:36.206702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e9fe2048-dcd9-42a2-b3fa-c6ec7ef419f7 req-90677664-4f39-4b11-beae-8d4c5716e4b1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:36.223689 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e9fe2048-dcd9-42a2-b3fa-c6ec7ef419f7 req-90677664-4f39-4b11-beae-8d4c5716e4b1 service nova] Creating event network-changed:8231c664-6893-44d2-a56d-a53c0dacdc59 for instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db on n-h1-708768-8 Jul 26 19:47:36.229621 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e9fe2048-dcd9-42a2-b3fa-c6ec7ef419f7 req-90677664-4f39-4b11-beae-8d4c5716e4b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045439 Jul 26 19:47:36.230615 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 650/1214] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:36.232871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9958979b-7dee-47c7-a9fc-964d5a4884e8 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e/action" status: 202 len: 0 microversion: 2.1 time: 0.483869 Jul 26 19:47:36.237004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:36.237949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:36.239973 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 565/1215] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:47:35 2022] POST /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 19:47:36.246393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:36.247158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:36.248212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:36.248962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:36.255373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-449a297a-b9c6-4537-99db-22f901edd088 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:36.295798 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-449a297a-b9c6-4537-99db-22f901edd088 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044389 Jul 26 19:47:36.297019 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 566/1216] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:36.302082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cb883e7a-f650-48ae-9a81-254fa6d66538 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '.version_select at 0x7f8756ed6160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:36.590105 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cb883e7a-f650-48ae-9a81-254fa6d66538 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/images/0c61c4dd-a87f-4575-a2ad-133caff6e279" status: 204 len: 0 microversion: 2.1 time: 0.291722 Jul 26 19:47:36.590781 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 567/1217] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:36 2022] DELETE /compute/v2.1/images/0c61c4dd-a87f-4575-a2ad-133caff6e279 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:36.596037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5edefa44-841f-450b-819e-c2f01668c98f tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-204659378", "id": "5a93b43a-4317-4465-b678-2a53f2200008", "os-flavor-access:is_public": "True"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:36.602685 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:36.602685 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:36.636388 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5edefa44-841f-450b-819e-c2f01668c98f tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.039118 Jul 26 19:47:36.637332 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 568/1218] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:36 2022] POST /compute/v2.1/flavors => generated 506 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:36.647433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-037f1df5-735b-4e50-a3ee-8320be52f68e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '.version_select at 0x7f8756f94820>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:36.679701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:36.700871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-037f1df5-735b-4e50-a3ee-8320be52f68e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Image not found. Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-037f1df5-735b-4e50-a3ee-8320be52f68e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/images/0c61c4dd-a87f-4575-a2ad-133caff6e279 HTTP/1.1 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: exception: Image not found. Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '0c61c4dd-a87f-4575-a2ad-133caff6e279'} Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c61c4dd-a87f-4575-a2ad-133caff6e279 Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:47:36.703024 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c61c4dd-a87f-4575-a2ad-133caff6e279 could not be found. Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-037f1df5-735b-4e50-a3ee-8320be52f68e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Image not found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-037f1df5-735b-4e50-a3ee-8320be52f68e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/images/0c61c4dd-a87f-4575-a2ad-133caff6e279" status: 404 len: 62 microversion: 2.1 time: 0.066307 Jul 26 19:47:36.707568 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 569/1219] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:47:36 2022] GET /compute/v2.1/images/0c61c4dd-a87f-4575-a2ad-133caff6e279 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:47:36.710882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:36.710882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:36.711814 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1e28353-a94b-4441-9161-2c009f5eceb4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.479857 Jul 26 19:47:36.716025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-724f3684-b464-4f17-b437-3f61ab6c19dc tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:36.719572 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:36.719572 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:36.720527 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 651/1220] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:36 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:36.733404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03502d82-2b91-4b17-af78-6349dbb76429 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:36.748094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03502d82-2b91-4b17-af78-6349dbb76429 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:36.760037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03502d82-2b91-4b17-af78-6349dbb76429 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:36.765923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03502d82-2b91-4b17-af78-6349dbb76429 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:36.767034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03502d82-2b91-4b17-af78-6349dbb76429 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:36.767813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03502d82-2b91-4b17-af78-6349dbb76429 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:36.774014 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-724f3684-b464-4f17-b437-3f61ab6c19dc tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/5a93b43a-4317-4465-b678-2a53f2200008" status: 202 len: 0 microversion: 2.1 time: 0.065504 Jul 26 19:47:36.779915 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 570/1221] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:36 2022] DELETE /compute/v2.1/flavors/5a93b43a-4317-4465-b678-2a53f2200008 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:36.790979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ed06cf8-8ad3-44c6-93f6-f3e0a09b24af tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:36.792327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ed06cf8-8ad3-44c6-93f6-f3e0a09b24af tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:36.801976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ed06cf8-8ad3-44c6-93f6-f3e0a09b24af tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:36.802431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ed06cf8-8ad3-44c6-93f6-f3e0a09b24af tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:36.803451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ed06cf8-8ad3-44c6-93f6-f3e0a09b24af tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:36.804860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ed06cf8-8ad3-44c6-93f6-f3e0a09b24af tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:37.080579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ed06cf8-8ad3-44c6-93f6-f3e0a09b24af tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:37.097413 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ed06cf8-8ad3-44c6-93f6-f3e0a09b24af tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.315022 Jul 26 19:47:37.099245 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 571/1222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:36 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:37.104200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44cc16e1-9a35-4a6a-b322-e0d53692685b tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.128843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44cc16e1-9a35-4a6a-b322-e0d53692685b tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028192 Jul 26 19:47:37.143493 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 572/1223] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:37.155067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03502d82-2b91-4b17-af78-6349dbb76429 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:37.158055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.159044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:37.167729 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03502d82-2b91-4b17-af78-6349dbb76429 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1542 microversion: 2.1 time: 0.438116 Jul 26 19:47:37.168325 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 652/1224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:36 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1542 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:37.175299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37f2b621-d73f-4116-9e0a-60ad42417bd8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.176028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37f2b621-d73f-4116-9e0a-60ad42417bd8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:37.193433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:37.197759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:37.198813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:37.204630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:37.210768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37f2b621-d73f-4116-9e0a-60ad42417bd8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:37.211592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37f2b621-d73f-4116-9e0a-60ad42417bd8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:37.212976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37f2b621-d73f-4116-9e0a-60ad42417bd8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:37.214124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37f2b621-d73f-4116-9e0a-60ad42417bd8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:37.292331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:37.294238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:37.295988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lazy-loading 'fault' on Instance uuid 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:37.355136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:37.379708 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca06602e-f5ee-4fc6-8a93-6481d9306ded tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 200 len: 1307 microversion: 2.1 time: 0.234399 Jul 26 19:47:37.382845 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 573/1225] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:37 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:37.391898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cbdb4c3d-fb3c-45d5-bf79-2a52c1521488 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-623144366", "id": 1469642264, "os-flavor-access:is_public": "True"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:37.396568 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:37.396568 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:37.417853 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cbdb4c3d-fb3c-45d5-bf79-2a52c1521488 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.033230 Jul 26 19:47:37.418846 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 574/1226] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:37 2022] POST /compute/v2.1/flavors => generated 413 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:37.430506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3eda8007-b860-4b61-b996-4fb035f2d2e2 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.438416 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3eda8007-b860-4b61-b996-4fb035f2d2e2 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1469642264" status: 200 len: 413 microversion: 2.1 time: 0.012200 Jul 26 19:47:37.449042 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 575/1227] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:47:37 2022] GET /compute/v2.1/flavors/1469642264 => generated 413 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:37.562880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-37f2b621-d73f-4116-9e0a-60ad42417bd8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:37.571957 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37f2b621-d73f-4116-9e0a-60ad42417bd8 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1318 microversion: 2.1 time: 0.402578 Jul 26 19:47:37.573846 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 653/1228] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:37 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:37.707591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce5dff72-b758-4c45-877a-a19a3b583049 tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.733129 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce5dff72-b758-4c45-877a-a19a3b583049 tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.282818 Jul 26 19:47:37.734375 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 576/1229] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:37 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:37.752801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.753856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:37.755864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-58555890-d29c-4974-a10e-4b0899649f8d tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.756675 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:37.756675 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:37.764561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:37.765791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:37.766865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:37.767813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:37.789675 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-58555890-d29c-4974-a10e-4b0899649f8d tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1469642264" status: 202 len: 0 microversion: 2.1 time: 0.038076 Jul 26 19:47:37.790726 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 577/1230] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:47:37 2022] DELETE /compute/v2.1/flavors/1469642264 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:47:37.801628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c390b0f5-cddd-4750-8e8b-1c6e4291723e tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.840572 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c390b0f5-cddd-4750-8e8b-1c6e4291723e tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044594 Jul 26 19:47:37.841699 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 578/1231] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:37.861637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-97660a5c-096c-4740-ae76-1cef4c3a3e9f tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1058709255", "id": 773800542, "os-flavor-access:is_public": "False"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:37.905590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:37.913483 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-97660a5c-096c-4740-ae76-1cef4c3a3e9f tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.056251 Jul 26 19:47:37.914368 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 579/1232] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:37 2022] POST /compute/v2.1/flavors => generated 427 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:37.927218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1bf5768b-728f-44ae-9e08-3cadf1c582f7 tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "773800542"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:37.941370 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-1bf5768b-728f-44ae-9e08-3cadf1c582f7 tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] HTTP exception thrown: Flavor 773800542 could not be found. Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1bf5768b-728f-44ae-9e08-3cadf1c582f7 tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] Request method failure captured: Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 106 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ETTcbicZ_Kh6x7ANIntxyIbRe5YEIq4WlTN9LTha6GWts2mbgF9aoyatSIcBNn3vq_5IPeQAh2bVbJtKbr2yQQH0q5pFUBwCj6HTogDUCpmQjbMueaWS3UtzGGYRlDpKJDhqp7Kty-QImvrKwudILQqSj933ACLH1z8HavHFEcIISA Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: cc99425e98ba4a1c9c0a05da1907be29 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FlavorsAdminTestJSON-79348634 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cc99425e98ba4a1c9c0a05da1907be29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc99425e98ba4a1c9c0a05da1907be29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cc99425e98ba4a1c9c0a05da1907be29", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cc99425e98ba4a1c9c0a05da1907be29"}]}] Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FlavorsAdminTestJSON-79348634 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: cc99425e98ba4a1c9c0a05da1907be29 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-79348634 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FlavorsAdminTestJSON-79348634-project Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8ebd7e325fe345e2b972d05279123a77 Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FlavorsAdminTestJSON-79348634-project Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "test", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "773800542"}} Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: exception: Flavor 773800542 could not be found. Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '773800542'}}} Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 773800542 could not be found. Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:37.958655 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 773800542 could not be found. Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 773800542 could not be found. Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1bf5768b-728f-44ae-9e08-3cadf1c582f7 tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] Returning 400 to user: Flavor 773800542 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1bf5768b-728f-44ae-9e08-3cadf1c582f7 tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.037763 Jul 26 19:47:37.965427 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 580/1233] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:37 2022] POST /compute/v2.1/servers => generated 80 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:47:37.970164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79819d78-85d6-4b62-9b32-601738980066 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:37.995893 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79819d78-85d6-4b62-9b32-601738980066 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/773800542" status: 202 len: 0 microversion: 2.1 time: 0.030177 Jul 26 19:47:38.000853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 581/1234] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:47:37 2022] DELETE /compute/v2.1/flavors/773800542 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:38.009794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-94e891d3-5a4d-46c8-88f1-da136e6c1e2c tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:38.054949 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-94e891d3-5a4d-46c8-88f1-da136e6c1e2c tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052730 Jul 26 19:47:38.065182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 582/1235] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:38.075908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36a94331-17fb-48c3-b687-0dcbc51c8bb4 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1621478514", "id": 454799612, "os-flavor-access:is_public": "False"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:38.100780 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36a94331-17fb-48c3-b687-0dcbc51c8bb4 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.029717 Jul 26 19:47:38.102177 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 583/1236] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:38 2022] POST /compute/v2.1/flavors => generated 412 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:38.114434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-652a4df2-3ee5-441d-bf06-52a44b460e0c tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-753263692", "id": 190310273, "os-flavor-access:is_public": "True"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:38.136964 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-652a4df2-3ee5-441d-bf06-52a44b460e0c tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.026908 Jul 26 19:47:38.146282 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 584/1237] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:38 2022] POST /compute/v2.1/flavors => generated 410 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:38.153463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0974eead-1148-40f5-a619-aea420d50fef tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:38.155573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0974eead-1148-40f5-a619-aea420d50fef tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:38.166920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0974eead-1148-40f5-a619-aea420d50fef tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:38.167960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0974eead-1148-40f5-a619-aea420d50fef tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:38.168911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0974eead-1148-40f5-a619-aea420d50fef tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:38.169550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0974eead-1148-40f5-a619-aea420d50fef tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:38.205182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:38.517295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0974eead-1148-40f5-a619-aea420d50fef tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:38.526703 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0974eead-1148-40f5-a619-aea420d50fef tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.379071 Jul 26 19:47:38.531551 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 585/1238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:38 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:38.541917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bae323c7-4e76-4dff-84f8-dd25cb88b511 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:38.596232 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bae323c7-4e76-4dff-84f8-dd25cb88b511 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.063061 Jul 26 19:47:38.604907 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 586/1239] 10.222.0.58 () {58 vars in 1169 bytes} [Tue Jul 26 19:47:38 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:38.612895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c892ead7-b19b-42f7-b7ae-55f5b4834286 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:38.614734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c892ead7-b19b-42f7-b7ae-55f5b4834286 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:38.634096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c892ead7-b19b-42f7-b7ae-55f5b4834286 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:38.634418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c892ead7-b19b-42f7-b7ae-55f5b4834286 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:38.637144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c892ead7-b19b-42f7-b7ae-55f5b4834286 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:38.637602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c892ead7-b19b-42f7-b7ae-55f5b4834286 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:38.991203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:39.012828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:39.016951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:39.018446 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-27364e57-77d6-4a35-af1c-01120d62c45f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 1.273412 Jul 26 19:47:39.021528 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 654/1240] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:37 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:39.044303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6c9c5e24-469d-4d90-a17c-eb91a401a24d req-7189ff99-95f7-42ee-80a0-f85fe60f40d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484a1fc2-81bf-49dc-9ebb-bc32fe409a8a", "name": "network-vif-deleted", "tag": "d81ba563-1d5c-4679-a3fe-6c199155f7a7"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:39.059871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6c9c5e24-469d-4d90-a17c-eb91a401a24d req-7189ff99-95f7-42ee-80a0-f85fe60f40d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.060540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6c9c5e24-469d-4d90-a17c-eb91a401a24d req-7189ff99-95f7-42ee-80a0-f85fe60f40d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.081655 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6c9c5e24-469d-4d90-a17c-eb91a401a24d req-7189ff99-95f7-42ee-80a0-f85fe60f40d1 service nova] Creating event network-vif-deleted:d81ba563-1d5c-4679-a3fe-6c199155f7a7 for instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a on n-h2-708768-8 Jul 26 19:47:39.088541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6c9c5e24-469d-4d90-a17c-eb91a401a24d req-7189ff99-95f7-42ee-80a0-f85fe60f40d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051964 Jul 26 19:47:39.089738 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 655/1241] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:39.101218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.102167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:39.110017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.110743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.111763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.112393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.140754 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] HTTP exception thrown: Instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a could not be found. Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Request method failure captured: Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a HTTP/1.1 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ2UfAQCIvAOR-VBpEt0CgxFkMSC4ya3OMI2F7uC_6k3uRL_tRT-Sj98az4J8FgRnLpBCJeiBErA5lPIMgNG1YKhBi2K7o7DAE4I9_dn3Dyp-6IV2D4HTt-cFaeMFXt3G53NcilHVMXJRO5YCu47A4f17lB2cUQUbo5p7jAaxPlkPY Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b66d3923b4a4d3dacfa2c53f5af1ac1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}] Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 0bf1dac22e284b15b0e93146dc756338 Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a could not be found. Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '484a1fc2-81bf-49dc-9ebb-bc32fe409a8a'} Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a could not be found. Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a could not be found. Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:39.148242 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a could not be found. Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Returning 404 to user: Instance 484a1fc2-81bf-49dc-9ebb-bc32fe409a8a could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:39.152509 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c9c70ed-8cd6-4e82-b1ca-aefed435d1ff tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a" status: 404 len: 111 microversion: 2.1 time: 0.058654 Jul 26 19:47:39.155549 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 656/1242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/servers/484a1fc2-81bf-49dc-9ebb-bc32fe409a8a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:39.166181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3b9d5de8-fa51-4e14-9e47-be79e8743a01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.171766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3b9d5de8-fa51-4e14-9e47-be79e8743a01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:39.190006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b9d5de8-fa51-4e14-9e47-be79e8743a01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.192439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b9d5de8-fa51-4e14-9e47-be79e8743a01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.193721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b9d5de8-fa51-4e14-9e47-be79e8743a01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.195424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b9d5de8-fa51-4e14-9e47-be79e8743a01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.284537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c892ead7-b19b-42f7-b7ae-55f5b4834286 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:39.292831 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c892ead7-b19b-42f7-b7ae-55f5b4834286 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1534 microversion: 2.1 time: 0.694331 Jul 26 19:47:39.303983 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 587/1243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:38 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1534 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:39.315943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e99989f1-1c5e-4deb-a06c-0893713736ea tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.342599 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e99989f1-1c5e-4deb-a06c-0893713736ea tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.037186 Jul 26 19:47:39.343189 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 588/1244] 10.222.0.58 () {58 vars in 1177 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:39.352755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-878ea27c-d336-46ca-9c92-83dc38a5f88e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.353637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-878ea27c-d336-46ca-9c92-83dc38a5f88e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:39.363670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-878ea27c-d336-46ca-9c92-83dc38a5f88e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.364193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-878ea27c-d336-46ca-9c92-83dc38a5f88e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.367236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-878ea27c-d336-46ca-9c92-83dc38a5f88e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.367809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-878ea27c-d336-46ca-9c92-83dc38a5f88e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.411139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-878ea27c-d336-46ca-9c92-83dc38a5f88e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:39.591375 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-878ea27c-d336-46ca-9c92-83dc38a5f88e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 204 len: 0 microversion: 2.1 time: 0.246724 Jul 26 19:47:39.592177 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 589/1245] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:39 2022] DELETE /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:39.600815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d4e6ef8-3ade-473e-b90d-97d464bd4ee0 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.612200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9d4e6ef8-3ade-473e-b90d-97d464bd4ee0 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.015452 Jul 26 19:47:39.612988 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 590/1246] 10.222.0.58 () {58 vars in 1171 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:39.620435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a2404fe9-3072-451a-9368-255b36438703 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.621585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a2404fe9-3072-451a-9368-255b36438703 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:39.627300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3b9d5de8-fa51-4e14-9e47-be79e8743a01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:39.634114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2404fe9-3072-451a-9368-255b36438703 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.634918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2404fe9-3072-451a-9368-255b36438703 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.637158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2404fe9-3072-451a-9368-255b36438703 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.637982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2404fe9-3072-451a-9368-255b36438703 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.641871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3b9d5de8-fa51-4e14-9e47-be79e8743a01 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1318 microversion: 2.1 time: 0.483222 Jul 26 19:47:39.655703 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 657/1247] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:39.655703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ec157d9-c909-46b6-8f9e-1b4d0ba856d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.655703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ec157d9-c909-46b6-8f9e-1b4d0ba856d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:39.661422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ec157d9-c909-46b6-8f9e-1b4d0ba856d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.661873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ec157d9-c909-46b6-8f9e-1b4d0ba856d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.662651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ec157d9-c909-46b6-8f9e-1b4d0ba856d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.663083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ec157d9-c909-46b6-8f9e-1b4d0ba856d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.823121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a2404fe9-3072-451a-9368-255b36438703 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:39.831845 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a2404fe9-3072-451a-9368-255b36438703 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.217276 Jul 26 19:47:39.836333 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 591/1248] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:39.840396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03d89b83-b974-4449-84b1-7f6d886271f2 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.856419 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03d89b83-b974-4449-84b1-7f6d886271f2 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.022624 Jul 26 19:47:39.857182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 592/1249] 10.222.0.58 () {58 vars in 1169 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:39.870262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b747a4b-4910-47a2-a8b0-768760cee8a6 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.903376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b747a4b-4910-47a2-a8b0-768760cee8a6 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.036299 Jul 26 19:47:39.904471 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 593/1250] 10.222.0.58 () {58 vars in 1169 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:39.917744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-76c70035-8806-463c-b23a-24e5384cbc0a req-3cc29548-5f21-4d73-a730-936791e987e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc21891-611c-4e20-99d7-21b3b2c63ee7", "tag": "ad12e6a6-b47b-4eb7-a4ff-9d5e461e44e1"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:39.930573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-76c70035-8806-463c-b23a-24e5384cbc0a req-3cc29548-5f21-4d73-a730-936791e987e4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:39.931105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-76c70035-8806-463c-b23a-24e5384cbc0a req-3cc29548-5f21-4d73-a730-936791e987e4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:39.943604 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-76c70035-8806-463c-b23a-24e5384cbc0a req-3cc29548-5f21-4d73-a730-936791e987e4 service nova] Creating event network-changed:ad12e6a6-b47b-4eb7-a4ff-9d5e461e44e1 for instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 on n-h1-708768-8 Jul 26 19:47:39.948642 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-76c70035-8806-463c-b23a-24e5384cbc0a req-3cc29548-5f21-4d73-a730-936791e987e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035402 Jul 26 19:47:39.949823 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 594/1251] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:39.954902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3fea20ca-0146-49ed-9844-e26d222b95fd tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:39.977864 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3fea20ca-0146-49ed-9844-e26d222b95fd tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.026709 Jul 26 19:47:39.985117 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 595/1252] 10.222.0.58 () {58 vars in 1175 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.005993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b0e1a3a2-e768-4b73-82a0-70f98b6cb15b tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.034105 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b0e1a3a2-e768-4b73-82a0-70f98b6cb15b tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.034543 Jul 26 19:47:40.035035 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 596/1253] 10.222.0.58 () {58 vars in 1173 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.053231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-53c5dda2-a377-4a00-a2bf-3e2c59b4f469 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.081447 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-53c5dda2-a377-4a00-a2bf-3e2c59b4f469 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.032372 Jul 26 19:47:40.082437 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 597/1254] 10.222.0.58 () {58 vars in 1169 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:40.087410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.087944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:40.096152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.098488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.099545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.100005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.117308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ec157d9-c909-46b6-8f9e-1b4d0ba856d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:40.139114 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ec157d9-c909-46b6-8f9e-1b4d0ba856d1 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1473 microversion: 2.1 time: 0.495059 Jul 26 19:47:40.139734 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 658/1255] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:39 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1473 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.157733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8bdaadb6-21fc-4da0-b124-90306ce79807 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.164000 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:40.164000 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:40.202192 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8bdaadb6-21fc-4da0-b124-90306ce79807 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/190310273" status: 202 len: 0 microversion: 2.1 time: 0.058756 Jul 26 19:47:40.205144 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 659/1256] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:47:40 2022] DELETE /compute/v2.1/flavors/190310273 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:40.214645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd8c5ea7-5c01-49dd-bfae-110c7fd0f915 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.260911 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd8c5ea7-5c01-49dd-bfae-110c7fd0f915 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051145 Jul 26 19:47:40.276143 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 660/1257] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.283623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8343495b-f0e0-4ccb-a0c7-d4c1df969869 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.315045 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8343495b-f0e0-4ccb-a0c7-d4c1df969869 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/454799612" status: 202 len: 0 microversion: 2.1 time: 0.037637 Jul 26 19:47:40.316467 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 661/1258] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:47:40 2022] DELETE /compute/v2.1/flavors/454799612 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:40.327379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d6e02307-9456-4c50-93ca-e26fbceceaf9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.330918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d6e02307-9456-4c50-93ca-e26fbceceaf9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:40.344808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6e02307-9456-4c50-93ca-e26fbceceaf9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.345780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6e02307-9456-4c50-93ca-e26fbceceaf9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.351130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6e02307-9456-4c50-93ca-e26fbceceaf9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.351682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6e02307-9456-4c50-93ca-e26fbceceaf9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.367521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:40.382684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:40.388207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:40.389663 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7acd4f07-e548-476e-a13b-2f0c10d685ef tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.306079 Jul 26 19:47:40.390272 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 598/1259] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:40.400561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88e6de8f-782e-4a7e-8993-3b5a48479660 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.444268 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88e6de8f-782e-4a7e-8993-3b5a48479660 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052109 Jul 26 19:47:40.445367 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 599/1260] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.474087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87bc0e2b-1bd1-4545-8e2a-6b5fa4fc5af8 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1645517100", "id": 1543750538, "os-flavor-access:is_public": "False"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:40.477565 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:40.477565 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:40.501895 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-87bc0e2b-1bd1-4545-8e2a-6b5fa4fc5af8 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.034459 Jul 26 19:47:40.502815 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 600/1261] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:40 2022] POST /compute/v2.1/flavors => generated 415 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:40.519411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b26c7445-0534-4418-9429-5913446b4161 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.552754 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b26c7445-0534-4418-9429-5913446b4161 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041577 Jul 26 19:47:40.553760 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 601/1262] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:40.573633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cdfd542a-e311-4ee7-ba44-021b4e19b16d tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.619361 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cdfd542a-e311-4ee7-ba44-021b4e19b16d tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049146 Jul 26 19:47:40.620063 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 602/1263] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.640586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-75af0795-2164-4700-af32-0f8a33d64125 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.641611 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:40.641611 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:40.663990 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-75af0795-2164-4700-af32-0f8a33d64125 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1543750538" status: 202 len: 0 microversion: 2.1 time: 0.027030 Jul 26 19:47:40.669068 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 603/1264] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:47:40 2022] DELETE /compute/v2.1/flavors/1543750538 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:40.674110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d20cdc0-a5b7-4011-a038-f15708ce86c6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.674725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9d20cdc0-a5b7-4011-a038-f15708ce86c6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:40.682299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d20cdc0-a5b7-4011-a038-f15708ce86c6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.682748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d20cdc0-a5b7-4011-a038-f15708ce86c6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.683578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d20cdc0-a5b7-4011-a038-f15708ce86c6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.684059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d20cdc0-a5b7-4011-a038-f15708ce86c6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.808457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d6e02307-9456-4c50-93ca-e26fbceceaf9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:40.820879 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d6e02307-9456-4c50-93ca-e26fbceceaf9 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1540 microversion: 2.1 time: 0.501882 Jul 26 19:47:40.824487 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 662/1265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1540 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.843342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-281950dd-9a87-40c7-8a11-893b9df6a939 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.905125 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-281950dd-9a87-40c7-8a11-893b9df6a939 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075658 Jul 26 19:47:40.905770 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 663/1266] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.926561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-75aeae10-0507-4277-8d35-5c6da04b04ab req-4998e670-09de-424a-9e24-f82a61bb8298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a556b36-2d3e-4d9e-a117-e1f1a20175db", "name": "network-vif-plugged", "status": "completed", "tag": "8231c664-6893-44d2-a56d-a53c0dacdc59"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:40.927518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9d20cdc0-a5b7-4011-a038-f15708ce86c6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:40.936021 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9d20cdc0-a5b7-4011-a038-f15708ce86c6 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1318 microversion: 2.1 time: 0.265793 Jul 26 19:47:40.950738 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 604/1267] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:40.950955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-75aeae10-0507-4277-8d35-5c6da04b04ab req-4998e670-09de-424a-9e24-f82a61bb8298 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.952029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-75aeae10-0507-4277-8d35-5c6da04b04ab req-4998e670-09de-424a-9e24-f82a61bb8298 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.958432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cecbd315-f118-4ded-9fb8-7528735c539b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:40.959281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cecbd315-f118-4ded-9fb8-7528735c539b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:40.967896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cecbd315-f118-4ded-9fb8-7528735c539b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.968097 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-75aeae10-0507-4277-8d35-5c6da04b04ab req-4998e670-09de-424a-9e24-f82a61bb8298 service nova] Creating event network-vif-plugged:8231c664-6893-44d2-a56d-a53c0dacdc59 for instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db on n-h1-708768-8 Jul 26 19:47:40.968350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cecbd315-f118-4ded-9fb8-7528735c539b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.969188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cecbd315-f118-4ded-9fb8-7528735c539b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:40.970190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cecbd315-f118-4ded-9fb8-7528735c539b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:40.975546 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-75aeae10-0507-4277-8d35-5c6da04b04ab req-4998e670-09de-424a-9e24-f82a61bb8298 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060095 Jul 26 19:47:40.976488 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 664/1268] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:40.982770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-96e13e54-fc66-4288-977b-93303b3f2baf tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1062295787", "id": 927013458, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:40.986333 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:40.986333 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:41.011284 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-96e13e54-fc66-4288-977b-93303b3f2baf tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.031544 Jul 26 19:47:41.012362 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 665/1269] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:40 2022] POST /compute/v2.1/flavors => generated 411 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:41.033060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eeee68d1-74c9-44be-920d-59ff4270e5aa tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:41.060360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eeee68d1-74c9-44be-920d-59ff4270e5aa tempest-FlavorsAdminTestJSON-79348634 tempest-FlavorsAdminTestJSON-79348634-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.038837 Jul 26 19:47:41.071635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 666/1270] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:41 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:41.081108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f20866c-eb79-4440-85c1-23bc8ffc9bfd tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:41.081928 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:41.081928 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:41.098784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:DELETE=17 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:41.103738 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f20866c-eb79-4440-85c1-23bc8ffc9bfd tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/927013458" status: 202 len: 0 microversion: 2.1 time: 0.026886 Jul 26 19:47:41.109909 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 667/1271] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:47:41 2022] DELETE /compute/v2.1/flavors/927013458 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:47:41.126922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-66ab2f0f-a233-456f-b67d-18da57585d08 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:41.157730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-66ab2f0f-a233-456f-b67d-18da57585d08 tempest-FlavorsAdminTestJSON-1424015639 tempest-FlavorsAdminTestJSON-1424015639-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046297 Jul 26 19:47:41.173374 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 668/1272] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:47:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:41.179154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ac82963-fb40-4706-929d-4dfd47fe0e7d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:41.181296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5ac82963-fb40-4706-929d-4dfd47fe0e7d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:41.189072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ac82963-fb40-4706-929d-4dfd47fe0e7d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:41.189627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ac82963-fb40-4706-929d-4dfd47fe0e7d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:41.190371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ac82963-fb40-4706-929d-4dfd47fe0e7d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:41.190810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ac82963-fb40-4706-929d-4dfd47fe0e7d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:41.472373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cecbd315-f118-4ded-9fb8-7528735c539b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:41.491963 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cecbd315-f118-4ded-9fb8-7528735c539b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.536821 Jul 26 19:47:41.499934 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 605/1273] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:40 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:41.506821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:41.507440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:41.507578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ac82963-fb40-4706-929d-4dfd47fe0e7d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:41.516322 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ac82963-fb40-4706-929d-4dfd47fe0e7d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 200 len: 1473 microversion: 2.1 time: 0.341427 Jul 26 19:47:41.517766 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 669/1274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:41 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 1473 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:41.552916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:41.554305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:41.555758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:41.562485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:41.815990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:41.829462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:41.831359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:41.833544 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5e006bfe-0a0b-4e20-9dbc-fe38764fe08b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.332264 Jul 26 19:47:41.834533 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 606/1275] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:41 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:41.853897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ce315e8b-098f-43a5-ad60-e147917e40bf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:41.855496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ce315e8b-098f-43a5-ad60-e147917e40bf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:41.861770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce315e8b-098f-43a5-ad60-e147917e40bf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:41.862436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce315e8b-098f-43a5-ad60-e147917e40bf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:41.863437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce315e8b-098f-43a5-ad60-e147917e40bf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:41.864062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce315e8b-098f-43a5-ad60-e147917e40bf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:41.970132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6673094d-8d55-42af-b830-d3f43d574ccd tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:41.980638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6673094d-8d55-42af-b830-d3f43d574ccd tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:42.025364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6673094d-8d55-42af-b830-d3f43d574ccd tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.030080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6673094d-8d55-42af-b830-d3f43d574ccd tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.040582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6673094d-8d55-42af-b830-d3f43d574ccd tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.040736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6673094d-8d55-42af-b830-d3f43d574ccd tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.134402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ce315e8b-098f-43a5-ad60-e147917e40bf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:42.152223 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ce315e8b-098f-43a5-ad60-e147917e40bf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1522 microversion: 2.1 time: 0.302528 Jul 26 19:47:42.152816 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 670/1276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:41 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:42.157750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-8535b8b4-e6fc-4b59-bcd7-0d6ffd8cf72b req-aaf6145d-7f1a-421d-9270-824aefef69e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d333b0d1-5d1d-4fca-b799-4c09de618fe5", "name": "network-vif-deleted", "tag": "6b7fa96b-4af3-4be9-907a-4439a733da62"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:42.177117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8535b8b4-e6fc-4b59-bcd7-0d6ffd8cf72b req-aaf6145d-7f1a-421d-9270-824aefef69e7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.180814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8535b8b4-e6fc-4b59-bcd7-0d6ffd8cf72b req-aaf6145d-7f1a-421d-9270-824aefef69e7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.200985 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-8535b8b4-e6fc-4b59-bcd7-0d6ffd8cf72b req-aaf6145d-7f1a-421d-9270-824aefef69e7 service nova] Creating event network-vif-deleted:6b7fa96b-4af3-4be9-907a-4439a733da62 for instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 on n-h2-708768-8 Jul 26 19:47:42.218045 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-8535b8b4-e6fc-4b59-bcd7-0d6ffd8cf72b req-aaf6145d-7f1a-421d-9270-824aefef69e7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063740 Jul 26 19:47:42.220208 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 671/1277] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:42.230478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-122cceb6-4aba-4358-98ed-c2ba9fe0c89a tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:42.239712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-122cceb6-4aba-4358-98ed-c2ba9fe0c89a tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:42.253403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-122cceb6-4aba-4358-98ed-c2ba9fe0c89a tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.254203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-122cceb6-4aba-4358-98ed-c2ba9fe0c89a tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.256029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-122cceb6-4aba-4358-98ed-c2ba9fe0c89a tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.256667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-122cceb6-4aba-4358-98ed-c2ba9fe0c89a tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.315917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-122cceb6-4aba-4358-98ed-c2ba9fe0c89a tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:42.399191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:42.400644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:42.429799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6673094d-8d55-42af-b830-d3f43d574ccd tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:42.459869 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6673094d-8d55-42af-b830-d3f43d574ccd tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1318 microversion: 2.1 time: 0.505767 Jul 26 19:47:42.460163 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-122cceb6-4aba-4358-98ed-c2ba9fe0c89a tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 204 len: 0 microversion: 2.1 time: 0.237822 Jul 26 19:47:42.460486 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 607/1278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:41 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:42.461477 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 672/1279] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:42 2022] DELETE /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:42.492466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be7802e5-3b0e-4e25-bd9f-26f01dab67ec tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:42.493200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-be7802e5-3b0e-4e25-bd9f-26f01dab67ec tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:42.521246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be7802e5-3b0e-4e25-bd9f-26f01dab67ec tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.521246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be7802e5-3b0e-4e25-bd9f-26f01dab67ec tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.521246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be7802e5-3b0e-4e25-bd9f-26f01dab67ec tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.521246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be7802e5-3b0e-4e25-bd9f-26f01dab67ec tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.526426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-958b6bf4-97c7-4afb-9188-adf7fe20a2bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:42.527594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-958b6bf4-97c7-4afb-9188-adf7fe20a2bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:42.536194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-958b6bf4-97c7-4afb-9188-adf7fe20a2bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.536999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-958b6bf4-97c7-4afb-9188-adf7fe20a2bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.537987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-958b6bf4-97c7-4afb-9188-adf7fe20a2bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:42.538650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-958b6bf4-97c7-4afb-9188-adf7fe20a2bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:42.981222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-be7802e5-3b0e-4e25-bd9f-26f01dab67ec tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:42.995394 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-be7802e5-3b0e-4e25-bd9f-26f01dab67ec tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1528 microversion: 2.1 time: 0.519390 Jul 26 19:47:43.018317 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 608/1280] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:42 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1528 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:43.031289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:43.032298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: d333b0d1-5d1d-4fca-b799-4c09de618fe5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:43.044711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.045158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.045945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.046381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.063955 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] HTTP exception thrown: Instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 could not be found. Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Request method failure captured: Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 HTTP/1.1 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ2UfAQCIvAOR-VBpEt0CgxFkMSC4ya3OMI2F7uC_6k3uRL_tRT-Sj98az4J8FgRnLpBCJeiBErA5lPIMgNG1YKhBi2K7o7DAE4I9_dn3Dyp-6IV2D4HTt-cFaeMFXt3G53NcilHVMXJRO5YCu47A4f17lB2cUQUbo5p7jAaxPlkPY Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b66d3923b4a4d3dacfa2c53f5af1ac1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}] Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 0bf1dac22e284b15b0e93146dc756338 Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 could not be found. Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd333b0d1-5d1d-4fca-b799-4c09de618fe5'} Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 could not be found. Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 could not be found. Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:43.065767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 could not be found. Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Returning 404 to user: Instance d333b0d1-5d1d-4fca-b799-4c09de618fe5 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-894bb16d-fa2b-4b2d-b08b-7295acde5a7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5" status: 404 len: 111 microversion: 2.1 time: 0.047679 Jul 26 19:47:43.075177 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 609/1281] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:43 2022] GET /compute/v2.1/servers/d333b0d1-5d1d-4fca-b799-4c09de618fe5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:43.086542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:43.087167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:43.096372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.096813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.097602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.098996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.187191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=30 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:43.316311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:43.325930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:43.331983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:43.338246 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c7ec7335-c567-47ea-8078-16e8bb3f6a45 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.268468 Jul 26 19:47:43.340361 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 610/1282] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:43 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:43.364199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f60ae7e-42b2-453c-9265-7be8e24d4104 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:43.364963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f60ae7e-42b2-453c-9265-7be8e24d4104 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:43.373201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f60ae7e-42b2-453c-9265-7be8e24d4104 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.373813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f60ae7e-42b2-453c-9265-7be8e24d4104 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.394676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f60ae7e-42b2-453c-9265-7be8e24d4104 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.396528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f60ae7e-42b2-453c-9265-7be8e24d4104 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.404074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-958b6bf4-97c7-4afb-9188-adf7fe20a2bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:43.415768 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-958b6bf4-97c7-4afb-9188-adf7fe20a2bc tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.897924 Jul 26 19:47:43.416363 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 673/1283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:42 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:43.434557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f60ae7e-42b2-453c-9265-7be8e24d4104 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:43.481666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0256b58-6206-4388-bbb0-e08cf069e5de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:43.482287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a0256b58-6206-4388-bbb0-e08cf069e5de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:43.496646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0256b58-6206-4388-bbb0-e08cf069e5de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.500365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0256b58-6206-4388-bbb0-e08cf069e5de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.503472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0256b58-6206-4388-bbb0-e08cf069e5de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.503974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0256b58-6206-4388-bbb0-e08cf069e5de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.602180 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f60ae7e-42b2-453c-9265-7be8e24d4104 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0" status: 204 len: 0 microversion: 2.1 time: 0.243390 Jul 26 19:47:43.603950 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 611/1284] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:43 2022] DELETE /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:43.622425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45c82738-f7f9-46c8-864f-5d028870ce23 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:43.623318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45c82738-f7f9-46c8-864f-5d028870ce23 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:43.632916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45c82738-f7f9-46c8-864f-5d028870ce23 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.633550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45c82738-f7f9-46c8-864f-5d028870ce23 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.634624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45c82738-f7f9-46c8-864f-5d028870ce23 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.635325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45c82738-f7f9-46c8-864f-5d028870ce23 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.672678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45c82738-f7f9-46c8-864f-5d028870ce23 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:43.698633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:43.775420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:43.790060 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45c82738-f7f9-46c8-864f-5d028870ce23 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 204 len: 0 microversion: 2.1 time: 0.176265 Jul 26 19:47:43.791428 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 612/1285] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:43 2022] DELETE /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:43.800582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d714b5c-f013-40e2-8356-688dfe4adf5b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:43.801985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0d714b5c-f013-40e2-8356-688dfe4adf5b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:43.812891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d714b5c-f013-40e2-8356-688dfe4adf5b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.813993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d714b5c-f013-40e2-8356-688dfe4adf5b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.814781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d714b5c-f013-40e2-8356-688dfe4adf5b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:43.815781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d714b5c-f013-40e2-8356-688dfe4adf5b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:43.863101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a0256b58-6206-4388-bbb0-e08cf069e5de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:43.873687 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0256b58-6206-4388-bbb0-e08cf069e5de tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1318 microversion: 2.1 time: 0.396080 Jul 26 19:47:43.876801 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 674/1286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:43 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:44.031905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0d714b5c-f013-40e2-8356-688dfe4adf5b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:44.041326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5bfaf081-2e04-49e9-949a-c4f1588a46f1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:44.042146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5bfaf081-2e04-49e9-949a-c4f1588a46f1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:44.045456 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d714b5c-f013-40e2-8356-688dfe4adf5b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0" status: 200 len: 1472 microversion: 2.1 time: 0.249333 Jul 26 19:47:44.055789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5bfaf081-2e04-49e9-949a-c4f1588a46f1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.056163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5bfaf081-2e04-49e9-949a-c4f1588a46f1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:44.058053 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 613/1287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:43 2022] GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:44.058550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5bfaf081-2e04-49e9-949a-c4f1588a46f1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.059040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5bfaf081-2e04-49e9-949a-c4f1588a46f1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:44.370185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:44.370809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:44.391738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.391738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:44.392547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.392979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:44.398767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5bfaf081-2e04-49e9-949a-c4f1588a46f1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:44.415700 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5bfaf081-2e04-49e9-949a-c4f1588a46f1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1528 microversion: 2.1 time: 0.393867 Jul 26 19:47:44.429318 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 675/1288] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:44 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1528 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:44.460878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-849e1476-ce61-4229-8269-2fe4e77d0174 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:44.463406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-849e1476-ce61-4229-8269-2fe4e77d0174 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:44.481702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-849e1476-ce61-4229-8269-2fe4e77d0174 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.483954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-849e1476-ce61-4229-8269-2fe4e77d0174 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:44.485363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-849e1476-ce61-4229-8269-2fe4e77d0174 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.486072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-849e1476-ce61-4229-8269-2fe4e77d0174 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:44.838815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-849e1476-ce61-4229-8269-2fe4e77d0174 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:44.865253 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-849e1476-ce61-4229-8269-2fe4e77d0174 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.418232 Jul 26 19:47:44.872976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 676/1289] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:44 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:44.879121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f46a57a6-39d4-488e-b5c7-b27cda68cfe3 req-541ce215-9b37-4760-8687-57ee2037990d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d3b0f0-e8fa-4d5c-9156-5b440407583e", "name": "network-vif-plugged", "status": "completed", "tag": "f5276e87-c9b2-43c8-8745-91203cdf9e27"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:44.905393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f46a57a6-39d4-488e-b5c7-b27cda68cfe3 req-541ce215-9b37-4760-8687-57ee2037990d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.907740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f46a57a6-39d4-488e-b5c7-b27cda68cfe3 req-541ce215-9b37-4760-8687-57ee2037990d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:44.936885 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f46a57a6-39d4-488e-b5c7-b27cda68cfe3 req-541ce215-9b37-4760-8687-57ee2037990d service nova] Creating event network-vif-plugged:f5276e87-c9b2-43c8-8745-91203cdf9e27 for instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e on n-h1-708768-8 Jul 26 19:47:44.946929 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f46a57a6-39d4-488e-b5c7-b27cda68cfe3 req-541ce215-9b37-4760-8687-57ee2037990d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071932 Jul 26 19:47:44.948818 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 677/1290] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:44.958540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4a1e3530-1b68-4456-858f-2f644f9ae149 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:44.965935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4a1e3530-1b68-4456-858f-2f644f9ae149 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:44.983371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a1e3530-1b68-4456-858f-2f644f9ae149 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.984094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a1e3530-1b68-4456-858f-2f644f9ae149 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:44.986954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a1e3530-1b68-4456-858f-2f644f9ae149 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:44.988151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a1e3530-1b68-4456-858f-2f644f9ae149 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:45.122959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:45.137026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:45.138731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:45.140160 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c97a5175-2dd7-4496-a2ab-f2b8692e38fa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.774080 Jul 26 19:47:45.141315 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 614/1291] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:44 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:47:45.146720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ae14cf4b-5a67-463d-8b31-24958d036e87 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:45.147514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ae14cf4b-5a67-463d-8b31-24958d036e87 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:45.154319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae14cf4b-5a67-463d-8b31-24958d036e87 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:45.154759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae14cf4b-5a67-463d-8b31-24958d036e87 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:45.155767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae14cf4b-5a67-463d-8b31-24958d036e87 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:45.156363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae14cf4b-5a67-463d-8b31-24958d036e87 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:45.427370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4a1e3530-1b68-4456-858f-2f644f9ae149 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:45.438037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4a1e3530-1b68-4456-858f-2f644f9ae149 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1318 microversion: 2.1 time: 0.487729 Jul 26 19:47:45.442285 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 678/1292] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:44 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:45.456160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca86876b-84e9-49a9-a3bd-49c6783e80a5 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:45.456937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca86876b-84e9-49a9-a3bd-49c6783e80a5 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:45.471361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca86876b-84e9-49a9-a3bd-49c6783e80a5 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:45.472472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca86876b-84e9-49a9-a3bd-49c6783e80a5 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:45.473628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca86876b-84e9-49a9-a3bd-49c6783e80a5 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:45.481709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca86876b-84e9-49a9-a3bd-49c6783e80a5 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:45.588221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae14cf4b-5a67-463d-8b31-24958d036e87 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:45.600344 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ae14cf4b-5a67-463d-8b31-24958d036e87 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0" status: 200 len: 1472 microversion: 2.1 time: 0.457717 Jul 26 19:47:45.603420 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 615/1293] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:45 2022] GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0 => generated 1472 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:45.786534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9385439e-8d5e-4b2e-b4ee-b3eb00dd81e7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:45.787342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9385439e-8d5e-4b2e-b4ee-b3eb00dd81e7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:45.798275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9385439e-8d5e-4b2e-b4ee-b3eb00dd81e7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:45.798845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9385439e-8d5e-4b2e-b4ee-b3eb00dd81e7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:45.799762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9385439e-8d5e-4b2e-b4ee-b3eb00dd81e7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:45.804486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9385439e-8d5e-4b2e-b4ee-b3eb00dd81e7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:45.860046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9385439e-8d5e-4b2e-b4ee-b3eb00dd81e7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:45.945781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ca86876b-84e9-49a9-a3bd-49c6783e80a5 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:45.954606 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ca86876b-84e9-49a9-a3bd-49c6783e80a5 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1528 microversion: 2.1 time: 0.507632 Jul 26 19:47:45.959180 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 679/1294] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:45 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1528 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:45.965713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cda8ede5-7602-49e6-9e2d-ded67c019e24 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:45.972481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cda8ede5-7602-49e6-9e2d-ded67c019e24 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:45.985994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cda8ede5-7602-49e6-9e2d-ded67c019e24 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:45.987847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cda8ede5-7602-49e6-9e2d-ded67c019e24 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:45.989386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cda8ede5-7602-49e6-9e2d-ded67c019e24 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:45.992755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cda8ede5-7602-49e6-9e2d-ded67c019e24 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:46.062470 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9385439e-8d5e-4b2e-b4ee-b3eb00dd81e7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 204 len: 0 microversion: 2.1 time: 0.279615 Jul 26 19:47:46.067507 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 616/1295] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:45 2022] DELETE /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:46.084008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63dda83a-1203-475d-b584-92a6cff730a0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:46.085001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63dda83a-1203-475d-b584-92a6cff730a0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:46.097276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63dda83a-1203-475d-b584-92a6cff730a0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:46.099364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63dda83a-1203-475d-b584-92a6cff730a0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:46.100495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63dda83a-1203-475d-b584-92a6cff730a0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:46.101072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63dda83a-1203-475d-b584-92a6cff730a0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:46.475502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cda8ede5-7602-49e6-9e2d-ded67c019e24 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:46.489922 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cda8ede5-7602-49e6-9e2d-ded67c019e24 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1315 microversion: 2.1 time: 0.529267 Jul 26 19:47:46.491214 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 680/1296] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:45 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:46.504462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:46.512612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:46.525887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:46.526622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:46.527565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:46.528195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:46.730704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63dda83a-1203-475d-b584-92a6cff730a0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:46.742923 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63dda83a-1203-475d-b584-92a6cff730a0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1553 microversion: 2.1 time: 0.670348 Jul 26 19:47:46.749355 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 617/1297] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:46 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1553 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:46.758319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4ddfd655-70fe-4a37-a5f2-c7be976e0cf1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:46.759105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4ddfd655-70fe-4a37-a5f2-c7be976e0cf1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:46.775248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ddfd655-70fe-4a37-a5f2-c7be976e0cf1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:46.775918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ddfd655-70fe-4a37-a5f2-c7be976e0cf1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:46.777856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ddfd655-70fe-4a37-a5f2-c7be976e0cf1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:46.779260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ddfd655-70fe-4a37-a5f2-c7be976e0cf1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:46.801345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:46.812536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:46.814857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:46.816932 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-43daabc4-e3b5-4338-bfe6-7361123407af tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.316374 Jul 26 19:47:46.817680 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 681/1298] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:46 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:46.831867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dca2cd12-e5fd-4be3-bee7-8e51f5daff7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:46.833423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dca2cd12-e5fd-4be3-bee7-8e51f5daff7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:46.845521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dca2cd12-e5fd-4be3-bee7-8e51f5daff7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:46.846241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dca2cd12-e5fd-4be3-bee7-8e51f5daff7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:46.853133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dca2cd12-e5fd-4be3-bee7-8e51f5daff7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:46.853133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dca2cd12-e5fd-4be3-bee7-8e51f5daff7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:47.063557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dca2cd12-e5fd-4be3-bee7-8e51f5daff7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:47.077007 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dca2cd12-e5fd-4be3-bee7-8e51f5daff7e tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0" status: 200 len: 1472 microversion: 2.1 time: 0.258136 Jul 26 19:47:47.077961 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 682/1299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:46 2022] GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0 => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:47.201943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4ddfd655-70fe-4a37-a5f2-c7be976e0cf1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:47.210574 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4ddfd655-70fe-4a37-a5f2-c7be976e0cf1 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1318 microversion: 2.1 time: 0.465220 Jul 26 19:47:47.228408 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 618/1300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:46 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:47.237175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ae139dc-26ff-4603-aa44-bc1bdb27b968 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:47.237789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ae139dc-26ff-4603-aa44-bc1bdb27b968 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:47.260987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ae139dc-26ff-4603-aa44-bc1bdb27b968 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:47.261745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ae139dc-26ff-4603-aa44-bc1bdb27b968 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:47.265287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ae139dc-26ff-4603-aa44-bc1bdb27b968 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:47.268943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ae139dc-26ff-4603-aa44-bc1bdb27b968 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:47.310246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e5d0176-abcf-4c6b-b0bc-cdadb9bb0606 tempest-FlavorsV255TestJSON-134503117 tempest-FlavorsV255TestJSON-134503117-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1469003260", "id": 228759632, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:47.313812 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:47.313812 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:47:47.343956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e5d0176-abcf-4c6b-b0bc-cdadb9bb0606 tempest-FlavorsV255TestJSON-134503117 tempest-FlavorsV255TestJSON-134503117-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.264073 Jul 26 19:47:47.346008 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 683/1301] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:47:47 2022] POST /compute/v2.1/flavors => generated 446 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:47:47.355196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-35d70044-e592-49fa-a605-09e9840c6b65 req-7178de21-60c4-40ca-9dea-a260a945d559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f39e3c9-d789-460b-a36b-c5b9e3527888", "name": "network-vif-plugged", "status": "completed", "tag": "643df902-6645-4b6e-9c71-22da5df80018"}, {"server_uuid": "fcc21891-611c-4e20-99d7-21b3b2c63ee7", "name": "network-vif-plugged", "status": "completed", "tag": "ad12e6a6-b47b-4eb7-a4ff-9d5e461e44e1"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:47.373433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-35d70044-e592-49fa-a605-09e9840c6b65 req-7178de21-60c4-40ca-9dea-a260a945d559 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:47.373915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-35d70044-e592-49fa-a605-09e9840c6b65 req-7178de21-60c4-40ca-9dea-a260a945d559 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:47.396781 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-35d70044-e592-49fa-a605-09e9840c6b65 req-7178de21-60c4-40ca-9dea-a260a945d559 service nova] Creating event network-vif-plugged:643df902-6645-4b6e-9c71-22da5df80018 for instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 on n-h1-708768-8 Jul 26 19:47:47.398439 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-35d70044-e592-49fa-a605-09e9840c6b65 req-7178de21-60c4-40ca-9dea-a260a945d559 service nova] Creating event network-vif-plugged:ad12e6a6-b47b-4eb7-a4ff-9d5e461e44e1 for instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 on n-h1-708768-8 Jul 26 19:47:47.407929 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-35d70044-e592-49fa-a605-09e9840c6b65 req-7178de21-60c4-40ca-9dea-a260a945d559 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055559 Jul 26 19:47:47.408912 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 684/1302] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:47.722356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc753cfc-2254-4918-9cb5-d12af347c0cd tempest-FlavorsV255TestJSON-260372371 tempest-FlavorsV255TestJSON-260372371-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:47.742278 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc753cfc-2254-4918-9cb5-d12af347c0cd tempest-FlavorsV255TestJSON-260372371 tempest-FlavorsV255TestJSON-260372371-project] 10.222.0.58 "GET /compute/v2.1/flavors/228759632" status: 200 len: 446 microversion: 2.55 time: 0.327282 Jul 26 19:47:47.743420 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 685/1303] 10.222.0.58 () {60 vars in 1196 bytes} [Tue Jul 26 19:47:47 2022] GET /compute/v2.1/flavors/228759632 => generated 446 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:47:47.749509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8226a4d7-244b-43ef-baff-25ec507a5cf2 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:47.750378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8226a4d7-244b-43ef-baff-25ec507a5cf2 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:47.760157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8226a4d7-244b-43ef-baff-25ec507a5cf2 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:47.760772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8226a4d7-244b-43ef-baff-25ec507a5cf2 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:47.762161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8226a4d7-244b-43ef-baff-25ec507a5cf2 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:47.763322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8226a4d7-244b-43ef-baff-25ec507a5cf2 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.034401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ae139dc-26ff-4603-aa44-bc1bdb27b968 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:48.043979 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ae139dc-26ff-4603-aa44-bc1bdb27b968 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1528 microversion: 2.1 time: 0.814331 Jul 26 19:47:48.046150 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 619/1304] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:47 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1528 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:48.052273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cb85b30b-d21d-4575-82eb-ad7b99ed8299 tempest-FlavorsV255TestJSON-134503117 tempest-FlavorsV255TestJSON-134503117-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:48.055788 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:48.055788 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:48.087114 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cb85b30b-d21d-4575-82eb-ad7b99ed8299 tempest-FlavorsV255TestJSON-134503117 tempest-FlavorsV255TestJSON-134503117-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/228759632" status: 200 len: 447 microversion: 2.55 time: 0.039052 Jul 26 19:47:48.088696 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 620/1305] 10.222.0.58 () {62 vars in 1216 bytes} [Tue Jul 26 19:47:48 2022] PUT /compute/v2.1/flavors/228759632 => generated 447 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:47:48.115990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7c8d557e-18ea-42a0-9bdb-2aaba2d536ba req-3fb3ede3-3b4a-44bd-b8c9-7ca1d7dd44c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75655c2a-2978-4096-920f-f4c6786cacf0", "name": "network-vif-deleted", "tag": "e16de01d-5776-43e1-9e4a-5f7d843c8e7a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:48.146186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7c8d557e-18ea-42a0-9bdb-2aaba2d536ba req-3fb3ede3-3b4a-44bd-b8c9-7ca1d7dd44c4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.146754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7c8d557e-18ea-42a0-9bdb-2aaba2d536ba req-3fb3ede3-3b4a-44bd-b8c9-7ca1d7dd44c4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.170981 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7c8d557e-18ea-42a0-9bdb-2aaba2d536ba req-3fb3ede3-3b4a-44bd-b8c9-7ca1d7dd44c4 service nova] Creating event network-vif-deleted:e16de01d-5776-43e1-9e4a-5f7d843c8e7a for instance 75655c2a-2978-4096-920f-f4c6786cacf0 on n-h2-708768-8 Jul 26 19:47:48.188721 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7c8d557e-18ea-42a0-9bdb-2aaba2d536ba req-3fb3ede3-3b4a-44bd-b8c9-7ca1d7dd44c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095147 Jul 26 19:47:48.189417 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 621/1306] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:48.203954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-94123ec2-9ca4-4dd6-9156-fe11b5f4e292 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:48.205543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-94123ec2-9ca4-4dd6-9156-fe11b5f4e292 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:48.214634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94123ec2-9ca4-4dd6-9156-fe11b5f4e292 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.215631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94123ec2-9ca4-4dd6-9156-fe11b5f4e292 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.216718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94123ec2-9ca4-4dd6-9156-fe11b5f4e292 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.217367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94123ec2-9ca4-4dd6-9156-fe11b5f4e292 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.346140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8226a4d7-244b-43ef-baff-25ec507a5cf2 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:48.362203 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8226a4d7-244b-43ef-baff-25ec507a5cf2 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1503 microversion: 2.1 time: 0.616004 Jul 26 19:47:48.365757 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 686/1307] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:47 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1503 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:48.372112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:48.373552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:48.386622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.388148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.389247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.392790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.545274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-94123ec2-9ca4-4dd6-9156-fe11b5f4e292 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:48.567952 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-94123ec2-9ca4-4dd6-9156-fe11b5f4e292 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1553 microversion: 2.1 time: 0.374065 Jul 26 19:47:48.569830 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 622/1308] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:48 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1553 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:48.585561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:48.589296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 75655c2a-2978-4096-920f-f4c6786cacf0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:48.610291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.610752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.613012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.613548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.635961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:48.636653 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] HTTP exception thrown: Instance 75655c2a-2978-4096-920f-f4c6786cacf0 could not be found. Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Request method failure captured: Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0 HTTP/1.1 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ2UfAQCIvAOR-VBpEt0CgxFkMSC4ya3OMI2F7uC_6k3uRL_tRT-Sj98az4J8FgRnLpBCJeiBErA5lPIMgNG1YKhBi2K7o7DAE4I9_dn3Dyp-6IV2D4HTt-cFaeMFXt3G53NcilHVMXJRO5YCu47A4f17lB2cUQUbo5p7jAaxPlkPY Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b66d3923b4a4d3dacfa2c53f5af1ac1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}] Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 0bf1dac22e284b15b0e93146dc756338 Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 75655c2a-2978-4096-920f-f4c6786cacf0 could not be found. Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '75655c2a-2978-4096-920f-f4c6786cacf0'} Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75655c2a-2978-4096-920f-f4c6786cacf0 could not be found. Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75655c2a-2978-4096-920f-f4c6786cacf0 could not be found. Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:48.639982 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75655c2a-2978-4096-920f-f4c6786cacf0 could not be found. Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Returning 404 to user: Instance 75655c2a-2978-4096-920f-f4c6786cacf0 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06eb57da-36ad-4067-9fce-b2953ee02ca0 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0" status: 404 len: 111 microversion: 2.1 time: 0.070933 Jul 26 19:47:48.645193 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 623/1309] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:48 2022] GET /compute/v2.1/servers/75655c2a-2978-4096-920f-f4c6786cacf0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:48.649171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7da4b836-862a-4513-b12d-23e66eba351d tempest-FlavorsV255TestJSON-260372371 tempest-FlavorsV255TestJSON-260372371-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:48.652014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:48.654731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:48.663635 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-88c2223d-a1df-4882-90cf-02a1005f7940 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1409 microversion: 2.25 time: 0.296493 Jul 26 19:47:48.669126 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 687/1310] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:48 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1409 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:48.681584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1680b3a-8ab4-4a53-910c-9b079e3b4841 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:48.682452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1680b3a-8ab4-4a53-910c-9b079e3b4841 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:48.696965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1680b3a-8ab4-4a53-910c-9b079e3b4841 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.697757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1680b3a-8ab4-4a53-910c-9b079e3b4841 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.698717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1680b3a-8ab4-4a53-910c-9b079e3b4841 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.699487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1680b3a-8ab4-4a53-910c-9b079e3b4841 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.733294 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7da4b836-862a-4513-b12d-23e66eba351d tempest-FlavorsV255TestJSON-260372371 tempest-FlavorsV255TestJSON-260372371-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.089316 Jul 26 19:47:48.733824 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 624/1311] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:47:48 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:48.746225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-626f0117-6750-46c4-b04b-5b8b4082dc19 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:48.746789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-626f0117-6750-46c4-b04b-5b8b4082dc19 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:48.754659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-626f0117-6750-46c4-b04b-5b8b4082dc19 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.755111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-626f0117-6750-46c4-b04b-5b8b4082dc19 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.757420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-626f0117-6750-46c4-b04b-5b8b4082dc19 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.757906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-626f0117-6750-46c4-b04b-5b8b4082dc19 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.812020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-626f0117-6750-46c4-b04b-5b8b4082dc19 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:48.960861 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-626f0117-6750-46c4-b04b-5b8b4082dc19 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 204 len: 0 microversion: 2.1 time: 0.223124 Jul 26 19:47:48.961455 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 625/1312] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:48 2022] DELETE /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:48.966687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:48.967647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:48.981864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.982322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:48.983157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:48.983678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.058492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.059069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.059381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lazy-loading 'fault' on Instance uuid f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:49.122169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:49.136383 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ba04e98-67fd-4bb7-87de-a4a6c1799cca tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1307 microversion: 2.1 time: 0.173707 Jul 26 19:47:49.137205 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 626/1313] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:48 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:49.141637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c58eba74-43dd-4fd7-99c5-e82283289e3d tempest-FlavorsV255TestJSON-260372371 tempest-FlavorsV255TestJSON-260372371-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:49.171637 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c58eba74-43dd-4fd7-99c5-e82283289e3d tempest-FlavorsV255TestJSON-260372371 tempest-FlavorsV255TestJSON-260372371-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.033541 Jul 26 19:47:49.183685 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 627/1314] 10.222.0.58 () {60 vars in 1166 bytes} [Tue Jul 26 19:47:49 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:49.183685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-faf5058b-82aa-4aed-b8d0-42be607e5631 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:49.183685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-faf5058b-82aa-4aed-b8d0-42be607e5631 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:49.207739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf5058b-82aa-4aed-b8d0-42be607e5631 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.208860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf5058b-82aa-4aed-b8d0-42be607e5631 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.210697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf5058b-82aa-4aed-b8d0-42be607e5631 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.212795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faf5058b-82aa-4aed-b8d0-42be607e5631 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.445227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-faf5058b-82aa-4aed-b8d0-42be607e5631 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:49.448994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:49.454995 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-faf5058b-82aa-4aed-b8d0-42be607e5631 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1509 microversion: 2.1 time: 0.281038 Jul 26 19:47:49.474287 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 628/1315] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:49 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:49.483365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:49.484084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:49.495314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.495602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.496532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.496971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.536938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.537431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.537891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lazy-loading 'fault' on Instance uuid d4d3b0f0-e8fa-4d5c-9156-5b440407583e {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:49.586964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:49.595839 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-197b31d0-158f-493a-9c05-f656bad8bf9b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1315 microversion: 2.1 time: 0.120240 Jul 26 19:47:49.596789 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 629/1316] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:49 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1315 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:49.602280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1dee8e34-d361-4339-a009-66516384fbef tempest-FlavorsV255TestJSON-134503117 tempest-FlavorsV255TestJSON-134503117-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:49.603600 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:47:49.603600 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:47:49.647318 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1dee8e34-d361-4339-a009-66516384fbef tempest-FlavorsV255TestJSON-134503117 tempest-FlavorsV255TestJSON-134503117-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/228759632" status: 202 len: 0 microversion: 2.55 time: 0.047282 Jul 26 19:47:49.649002 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 630/1317] 10.222.0.58 () {60 vars in 1199 bytes} [Tue Jul 26 19:47:49 2022] DELETE /compute/v2.1/flavors/228759632 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:49.654465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34e65ebb-bcfc-4f29-a665-012d604c211f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:49.655083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34e65ebb-bcfc-4f29-a665-012d604c211f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:49.662978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34e65ebb-bcfc-4f29-a665-012d604c211f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.663623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34e65ebb-bcfc-4f29-a665-012d604c211f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.664594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34e65ebb-bcfc-4f29-a665-012d604c211f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.665350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34e65ebb-bcfc-4f29-a665-012d604c211f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.749192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34e65ebb-bcfc-4f29-a665-012d604c211f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:49.762731 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34e65ebb-bcfc-4f29-a665-012d604c211f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1346 microversion: 2.1 time: 0.112390 Jul 26 19:47:49.780356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 631/1318] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:49 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:49.788352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee92da4f-488a-40d2-9215-bfe6a606098d tempest-FlavorsV255TestJSON-134503117 tempest-FlavorsV255TestJSON-134503117-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:49.811739 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ee92da4f-488a-40d2-9215-bfe6a606098d tempest-FlavorsV255TestJSON-134503117 tempest-FlavorsV255TestJSON-134503117-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.028283 Jul 26 19:47:49.812628 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 632/1319] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:47:49 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:49.817745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:49.818523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:49.825722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.826383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.828742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:49.829375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:49.864885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1680b3a-8ab4-4a53-910c-9b079e3b4841 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:49.879695 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1680b3a-8ab4-4a53-910c-9b079e3b4841 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1318 microversion: 2.1 time: 1.207514 Jul 26 19:47:49.882036 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 688/1320] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:48 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1318 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:50.077787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:50.094360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:50.098611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:50.100528 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7e6e6c78-04c0-4e12-ba1e-086b330e29b4 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1605 microversion: 2.25 time: 0.286644 Jul 26 19:47:50.102429 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 633/1321] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:47:49 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1605 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:47:50.136026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b2e7673-f0dc-49a3-9a18-13c24a26bbaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:50.138327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b2e7673-f0dc-49a3-9a18-13c24a26bbaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:50.156284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b2e7673-f0dc-49a3-9a18-13c24a26bbaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.157202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b2e7673-f0dc-49a3-9a18-13c24a26bbaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.158201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b2e7673-f0dc-49a3-9a18-13c24a26bbaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.159110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b2e7673-f0dc-49a3-9a18-13c24a26bbaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.161653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:50.162414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:50.173001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.173001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.177266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.181350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.297413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.299580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.300224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lazy-loading 'fault' on Instance uuid f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:50.324658 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b2e7673-f0dc-49a3-9a18-13c24a26bbaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.204427 Jul 26 19:47:50.325471 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 689/1322] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Jul 26 19:47:50 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:47:50.336969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a5aa4426-023e-47d8-b2bd-65c16ad2afa6 req-794a5fda-f6cd-4ebb-a8ca-0b6d6c19e57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c", "name": "network-vif-deleted", "tag": "651ff982-65c6-44db-bd21-d948b1ec5a50"}, {"server_uuid": "d4d3b0f0-e8fa-4d5c-9156-5b440407583e", "name": "network-vif-deleted", "tag": "f5276e87-c9b2-43c8-8745-91203cdf9e27"}, {"server_uuid": "d2b0264e-b656-49c4-b9cf-ff371219e527", "name": "network-vif-deleted", "tag": "db8dc067-ea7b-48a2-9e5c-e0b4db210b25"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:50.362430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a5aa4426-023e-47d8-b2bd-65c16ad2afa6 req-794a5fda-f6cd-4ebb-a8ca-0b6d6c19e57d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.366767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a5aa4426-023e-47d8-b2bd-65c16ad2afa6 req-794a5fda-f6cd-4ebb-a8ca-0b6d6c19e57d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.415286 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a5aa4426-023e-47d8-b2bd-65c16ad2afa6 req-794a5fda-f6cd-4ebb-a8ca-0b6d6c19e57d service nova] Creating event network-vif-deleted:651ff982-65c6-44db-bd21-d948b1ec5a50 for instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c on n-h1-708768-8 Jul 26 19:47:50.416115 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a5aa4426-023e-47d8-b2bd-65c16ad2afa6 req-794a5fda-f6cd-4ebb-a8ca-0b6d6c19e57d service nova] Creating event network-vif-deleted:f5276e87-c9b2-43c8-8745-91203cdf9e27 for instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e on n-h1-708768-8 Jul 26 19:47:50.416798 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a5aa4426-023e-47d8-b2bd-65c16ad2afa6 req-794a5fda-f6cd-4ebb-a8ca-0b6d6c19e57d service nova] Creating event network-vif-deleted:db8dc067-ea7b-48a2-9e5c-e0b4db210b25 for instance d2b0264e-b656-49c4-b9cf-ff371219e527 on n-h2-708768-8 Jul 26 19:47:50.445989 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a5aa4426-023e-47d8-b2bd-65c16ad2afa6 req-794a5fda-f6cd-4ebb-a8ca-0b6d6c19e57d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.118815 Jul 26 19:47:50.447297 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 690/1323] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:50.452677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:50.462108 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bde3eb46-f665-4383-bad6-a6f68f2b983b tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 200 len: 1307 microversion: 2.1 time: 0.307198 Jul 26 19:47:50.469096 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 634/1324] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:50 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 1307 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:50.480798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4227d46f-f977-4351-ac14-7c3fa8e1d307 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:50.481798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4227d46f-f977-4351-ac14-7c3fa8e1d307 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:50.498431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4227d46f-f977-4351-ac14-7c3fa8e1d307 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.498880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4227d46f-f977-4351-ac14-7c3fa8e1d307 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.499777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4227d46f-f977-4351-ac14-7c3fa8e1d307 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.500103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4227d46f-f977-4351-ac14-7c3fa8e1d307 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.622595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:50.624869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:50.641793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.642351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.643225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.645347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.715149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.716307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.720020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lazy-loading 'fault' on Instance uuid d4d3b0f0-e8fa-4d5c-9156-5b440407583e {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:50.881056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:50.894121 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f136fcbe-7bc8-4d4e-8265-fd2267bbac99 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 200 len: 1315 microversion: 2.1 time: 0.271703 Jul 26 19:47:50.896133 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 635/1325] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:50 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:50.909498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2b059377-1dda-4d17-a915-9693c8aabd56 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:50.910135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2b059377-1dda-4d17-a915-9693c8aabd56 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:50.926953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b059377-1dda-4d17-a915-9693c8aabd56 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.927465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b059377-1dda-4d17-a915-9693c8aabd56 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:50.928622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b059377-1dda-4d17-a915-9693c8aabd56 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:50.929066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b059377-1dda-4d17-a915-9693c8aabd56 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.038639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4227d46f-f977-4351-ac14-7c3fa8e1d307 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:51.072064 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4227d46f-f977-4351-ac14-7c3fa8e1d307 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1509 microversion: 2.1 time: 0.589725 Jul 26 19:47:51.076044 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 691/1326] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:50 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1509 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:51.083501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e68c1a0-3e58-43be-83bd-e3a65c510cf7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:51.084159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e68c1a0-3e58-43be-83bd-e3a65c510cf7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:51.102701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e68c1a0-3e58-43be-83bd-e3a65c510cf7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:51.103157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e68c1a0-3e58-43be-83bd-e3a65c510cf7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.103982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e68c1a0-3e58-43be-83bd-e3a65c510cf7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:51.104426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e68c1a0-3e58-43be-83bd-e3a65c510cf7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.561133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b059377-1dda-4d17-a915-9693c8aabd56 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:51.576489 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2b059377-1dda-4d17-a915-9693c8aabd56 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1346 microversion: 2.1 time: 0.679124 Jul 26 19:47:51.580433 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 636/1327] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:50 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1346 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:51.599990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:51.601854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:51.614839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:51.619849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.621161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:51.622439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.654453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e68c1a0-3e58-43be-83bd-e3a65c510cf7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:51.656256 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] HTTP exception thrown: Instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c could not be found. Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Request method failure captured: Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c HTTP/1.1 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EQ2UfAQCIvAOR-VBpEt0CgxFkMSC4ya3OMI2F7uC_6k3uRL_tRT-Sj98az4J8FgRnLpBCJeiBErA5lPIMgNG1YKhBi2K7o7DAE4I9_dn3Dyp-6IV2D4HTt-cFaeMFXt3G53NcilHVMXJRO5YCu47A4f17lB2cUQUbo5p7jAaxPlkPY Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b66d3923b4a4d3dacfa2c53f5af1ac1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}] Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 0bf1dac22e284b15b0e93146dc756338 Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c could not be found. Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c'} Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c could not be found. Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c could not be found. Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:51.657928 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c could not be found. Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Returning 404 to user: Instance f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-09955f19-8e70-4fcf-9a87-a6cd82a46ecc tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c" status: 404 len: 111 microversion: 2.1 time: 0.077346 Jul 26 19:47:51.662862 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 637/1328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:51 2022] GET /compute/v2.1/servers/f61d4c14-2a65-4f0e-a20a-6bbfe35c2d6c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:51.671419 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e68c1a0-3e58-43be-83bd-e3a65c510cf7 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1507 microversion: 2.1 time: 0.594162 Jul 26 19:47:51.675178 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 692/1329] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:51 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:51.678741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5ed1de3-2b2d-45ce-82b2-a3838b4f239a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:51.698366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0bd30b9-94cc-4e3d-a99b-cdb50eb647ca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:51.699639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a0bd30b9-94cc-4e3d-a99b-cdb50eb647ca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:51.715009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0bd30b9-94cc-4e3d-a99b-cdb50eb647ca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:51.715780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0bd30b9-94cc-4e3d-a99b-cdb50eb647ca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.717138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0bd30b9-94cc-4e3d-a99b-cdb50eb647ca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:51.717769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0bd30b9-94cc-4e3d-a99b-cdb50eb647ca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.722398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:51.738078 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b5ed1de3-2b2d-45ce-82b2-a3838b4f239a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/61c8def5-9717-4b35-a648-b792587e3675" status: 204 len: 0 microversion: 2.1 time: 0.065186 Jul 26 19:47:51.740091 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 638/1330] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 19:47:51 2022] DELETE /compute/v2.1/os-server-groups/61c8def5-9717-4b35-a648-b792587e3675 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:51.753760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9cfc2b8c-2271-43be-90a0-ece286d84f48 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:51.754849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9cfc2b8c-2271-43be-90a0-ece286d84f48 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:51.772978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cfc2b8c-2271-43be-90a0-ece286d84f48 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:51.775576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cfc2b8c-2271-43be-90a0-ece286d84f48 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.776452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cfc2b8c-2271-43be-90a0-ece286d84f48 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:51.776902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cfc2b8c-2271-43be-90a0-ece286d84f48 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:51.837630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9cfc2b8c-2271-43be-90a0-ece286d84f48 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:52.022567 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9cfc2b8c-2271-43be-90a0-ece286d84f48 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 204 len: 0 microversion: 2.1 time: 0.277952 Jul 26 19:47:52.023164 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 639/1331] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:51 2022] DELETE /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:52.040313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:52.040703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:52.057953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:52.058404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:52.059318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:52.059781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:52.106595 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e HTTP/1.1 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd4d3b0f0-e8fa-4d5c-9156-5b440407583e'} Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:52.108317 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d036d2d2-4ac7-4988-8ab3-8c5abaabe16c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 404 len: 111 microversion: 2.1 time: 0.074961 Jul 26 19:47:52.113038 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 640/1332] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:52 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:52.115983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f0899ef-4542-453c-bca1-02d85ed93361 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:52.116474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f0899ef-4542-453c-bca1-02d85ed93361 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:52.153804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:DELETE=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:52.172319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f0899ef-4542-453c-bca1-02d85ed93361 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:52.178818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f0899ef-4542-453c-bca1-02d85ed93361 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:52.183661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f0899ef-4542-453c-bca1-02d85ed93361 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:52.184334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f0899ef-4542-453c-bca1-02d85ed93361 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:52.250533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f0899ef-4542-453c-bca1-02d85ed93361 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:52.429668 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f0899ef-4542-453c-bca1-02d85ed93361 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 204 len: 0 microversion: 2.1 time: 0.317888 Jul 26 19:47:52.435460 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 641/1333] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:52 2022] DELETE /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:52.452162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6fddc47d-5045-4020-98d4-7140fe1bb33d tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:52.453127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6fddc47d-5045-4020-98d4-7140fe1bb33d tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:52.470197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6fddc47d-5045-4020-98d4-7140fe1bb33d tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:52.470197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6fddc47d-5045-4020-98d4-7140fe1bb33d tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:52.474302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6fddc47d-5045-4020-98d4-7140fe1bb33d tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:52.474910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6fddc47d-5045-4020-98d4-7140fe1bb33d tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:52.620920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a0bd30b9-94cc-4e3d-a99b-cdb50eb647ca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:52.632304 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0bd30b9-94cc-4e3d-a99b-cdb50eb647ca tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1507 microversion: 2.1 time: 0.937693 Jul 26 19:47:52.634225 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 693/1334] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:51 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1507 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:52.641243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-79383941", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:52.744291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6fddc47d-5045-4020-98d4-7140fe1bb33d tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d53a02dff7419faf17fb9ef0e0ad2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be611136e6fb4e76a8c09eeca8c680e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:52.753711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] validate_networks() for [('faacc758-f7cd-4415-a920-940b8213555c', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:47:52.755914 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6fddc47d-5045-4020-98d4-7140fe1bb33d tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 200 len: 1467 microversion: 2.1 time: 0.316266 Jul 26 19:47:52.756864 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 642/1335] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:52 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 1467 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:52.784868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ff0664e-dafa-45b4-94a2-a2bf7fd06113 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:52.789636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ff0664e-dafa-45b4-94a2-a2bf7fd06113 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:52.802978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ff0664e-dafa-45b4-94a2-a2bf7fd06113 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:52.803430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ff0664e-dafa-45b4-94a2-a2bf7fd06113 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:52.804249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ff0664e-dafa-45b4-94a2-a2bf7fd06113 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:52.804691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ff0664e-dafa-45b4-94a2-a2bf7fd06113 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:53.752752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:47:53.753278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:47:53.753694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:47:53.754770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:47:53.755244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:47:53.776404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:53.777312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:53.781088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:53.781970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:53.843804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Getting quotas for project 20bfe22d09cc4c7fba9cceb0b6532fc0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:47:53.847182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ff0664e-dafa-45b4-94a2-a2bf7fd06113 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:53.850494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Getting quotas for user 6cb1eb1903e84b65bbaf60a89f626f47 and project 20bfe22d09cc4c7fba9cceb0b6532fc0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:47:53.867887 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ff0664e-dafa-45b4-94a2-a2bf7fd06113 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1474 microversion: 2.1 time: 1.100641 Jul 26 19:47:53.869559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:47:53.872815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:47:53.876870 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 643/1336] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:52 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1474 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:53.884489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4af583b6-d4eb-4367-b4cf-684f2fa5f136 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:53.886450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4af583b6-d4eb-4367-b4cf-684f2fa5f136 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:53.912043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4af583b6-d4eb-4367-b4cf-684f2fa5f136 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:53.913768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4af583b6-d4eb-4367-b4cf-684f2fa5f136 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:53.928366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4af583b6-d4eb-4367-b4cf-684f2fa5f136 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:53.929313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4af583b6-d4eb-4367-b4cf-684f2fa5f136 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:53.948091 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe93f8a7-270e-4d65-9b3e-1099cd0d233e tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.312589 Jul 26 19:47:53.949933 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 694/1337] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:47:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:47:53.956747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42dd91b1-0b4e-43a4-91db-debb2333be95 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:53.969691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-42dd91b1-0b4e-43a4-91db-debb2333be95 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:53.990993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42dd91b1-0b4e-43a4-91db-debb2333be95 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:53.991810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42dd91b1-0b4e-43a4-91db-debb2333be95 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:53.993433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42dd91b1-0b4e-43a4-91db-debb2333be95 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:53.994071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42dd91b1-0b4e-43a4-91db-debb2333be95 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.157839 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-42dd91b1-0b4e-43a4-91db-debb2333be95 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "PUT /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1079 microversion: 2.1 time: 0.206321 Jul 26 19:47:54.167118 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 695/1338] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 19:47:53 2022] PUT /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1079 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:54.170843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4af583b6-d4eb-4367-b4cf-684f2fa5f136 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:54.184778 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4af583b6-d4eb-4367-b4cf-684f2fa5f136 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1346 microversion: 2.1 time: 0.306408 Jul 26 19:47:54.185527 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 644/1339] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:53 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1346 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:54.197790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:54.199882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:54.200367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-aeb4db35-de03-42eb-bd77-2b3e5bf8cf98 req-e0e83e69-53a0-4a2b-9b4c-8a69f86a27d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a556b36-2d3e-4d9e-a117-e1f1a20175db", "name": "network-vif-deleted", "tag": "8231c664-6893-44d2-a56d-a53c0dacdc59"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:54.214540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aeb4db35-de03-42eb-bd77-2b3e5bf8cf98 req-e0e83e69-53a0-4a2b-9b4c-8a69f86a27d0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.215179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aeb4db35-de03-42eb-bd77-2b3e5bf8cf98 req-e0e83e69-53a0-4a2b-9b4c-8a69f86a27d0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.224883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.227259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.228262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.232935 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aeb4db35-de03-42eb-bd77-2b3e5bf8cf98 req-e0e83e69-53a0-4a2b-9b4c-8a69f86a27d0 service nova] Creating event network-vif-deleted:8231c664-6893-44d2-a56d-a53c0dacdc59 for instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db on n-h1-708768-8 Jul 26 19:47:54.238817 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-aeb4db35-de03-42eb-bd77-2b3e5bf8cf98 req-e0e83e69-53a0-4a2b-9b4c-8a69f86a27d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070003 Jul 26 19:47:54.240343 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 696/1340] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:54.241192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.258286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b76dee4d-70a0-428b-9669-100509025672 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:54.260361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b76dee4d-70a0-428b-9669-100509025672 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:54.289423 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] HTTP exception thrown: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Request method failure captured: Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db HTTP/1.1 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ETLXPns__o6NLCAtMGiMfTX7tLtQ3VLj1GL0cu7YhStM9bjbOjDatV6HwdLIQrppk3KFWq2PyEh7DkB4lpuD4I1GWzu4KGg0zdhXxa9nuCXv-tPgekpnTOCRec_uofjVixjL9p65AQ_5F_6Cg7Ewi4WQ6L4bVsQKoTWYo4eR-xW2cs Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be611136e6fb4e76a8c09eeca8c680e1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}] Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: e0d53a02dff7419faf17fb9ef0e0ad2d Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7a556b36-2d3e-4d9e-a117-e1f1a20175db'} Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.303073 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.308146 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.308146 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.308146 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.308146 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:54.308146 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:54.308146 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.308146 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.314114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Returning 404 to user: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:54.315291 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7537bceb-88ba-4cb6-adac-fa4157632542 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 404 len: 111 microversion: 2.1 time: 0.127792 Jul 26 19:47:54.316064 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 645/1341] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:54 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:54.323436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-53ad503b-0b3c-4892-b575-c70b2f216629 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:54.328470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-53ad503b-0b3c-4892-b575-c70b2f216629 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:54.347560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53ad503b-0b3c-4892-b575-c70b2f216629 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.349082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53ad503b-0b3c-4892-b575-c70b2f216629 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.350182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53ad503b-0b3c-4892-b575-c70b2f216629 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.350786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53ad503b-0b3c-4892-b575-c70b2f216629 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.411845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b76dee4d-70a0-428b-9669-100509025672 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:54.440441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b76dee4d-70a0-428b-9669-100509025672 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1223 microversion: 2.1 time: 0.194632 Jul 26 19:47:54.441238 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 697/1342] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:54 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1223 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:54.447561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1836425626", "metadata": {"image_type": "test"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:54.450623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:54.459350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.460149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.461122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.461740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.462105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:54.482097 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] HTTP exception thrown: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Request method failure captured: Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db/action HTTP/1.1 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 112 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ETLXPns__o6NLCAtMGiMfTX7tLtQ3VLj1GL0cu7YhStM9bjbOjDatV6HwdLIQrppk3KFWq2PyEh7DkB4lpuD4I1GWzu4KGg0zdhXxa9nuCXv-tPgekpnTOCRec_uofjVixjL9p65AQ_5F_6Cg7Ewi4WQ6L4bVsQKoTWYo4eR-xW2cs Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be611136e6fb4e76a8c09eeca8c680e1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}] Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e0d53a02dff7419faf17fb9ef0e0ad2d Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1836425626", "metadata": {"image_type": "test"}}} Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7a556b36-2d3e-4d9e-a117-e1f1a20175db', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1836425626', 'metadata': {'image_type': 'test'}}}} Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 19:47:54.484896 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.489802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.492727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Returning 404 to user: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:54.494212 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b2ccd6b-9149-4de8-bae7-97b6ec6c6c18 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "POST /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db/action" status: 404 len: 111 microversion: 2.1 time: 0.050416 Jul 26 19:47:54.495272 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 698/1343] 10.222.0.58 () {60 vars in 1279 bytes} [Tue Jul 26 19:47:54 2022] POST /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:54.515173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ecc91b2e-bcd5-49d3-b976-6e4c6890af5b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-91468949", "metadata": {"image_type": "test"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:54.518126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ecc91b2e-bcd5-49d3-b976-6e4c6890af5b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Failed to fetch instance by id tempest-invalid-1110453592 {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 19:47:54.519100 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ecc91b2e-bcd5-49d3-b976-6e4c6890af5b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] HTTP exception thrown: Instance tempest-invalid-1110453592 could not be found. Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ecc91b2e-bcd5-49d3-b976-6e4c6890af5b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Request method failure captured: Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/tempest-invalid-1110453592/action HTTP/1.1 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 110 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ETLXPns__o6NLCAtMGiMfTX7tLtQ3VLj1GL0cu7YhStM9bjbOjDatV6HwdLIQrppk3KFWq2PyEh7DkB4lpuD4I1GWzu4KGg0zdhXxa9nuCXv-tPgekpnTOCRec_uofjVixjL9p65AQ_5F_6Cg7Ewi4WQ6L4bVsQKoTWYo4eR-xW2cs Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be611136e6fb4e76a8c09eeca8c680e1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}] Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e0d53a02dff7419faf17fb9ef0e0ad2d Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-91468949", "metadata": {"image_type": "test"}}} Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance tempest-invalid-1110453592 could not be found. Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'tempest-invalid-1110453592', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-91468949', 'metadata': {'image_type': 'test'}}}} Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1110453592 could not be found. Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:54.522909 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1110453592 could not be found. Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1110453592 could not be found. Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.527800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ecc91b2e-bcd5-49d3-b976-6e4c6890af5b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Returning 404 to user: Instance tempest-invalid-1110453592 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:54.532195 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ecc91b2e-bcd5-49d3-b976-6e4c6890af5b tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "POST /compute/v2.1/servers/tempest-invalid-1110453592/action" status: 404 len: 101 microversion: 2.1 time: 0.023717 Jul 26 19:47:54.534812 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 699/1344] 10.222.0.58 () {60 vars in 1249 bytes} [Tue Jul 26 19:47:54 2022] POST /compute/v2.1/servers/tempest-invalid-1110453592/action => generated 101 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:54.573733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-256a39c8-9398-41a9-b521-a8c5df956602 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1850733512"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:54.589161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-256a39c8-9398-41a9-b521-a8c5df956602 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 19:47:54.589683 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-256a39c8-9398-41a9-b521-a8c5df956602 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-256a39c8-9398-41a9-b521-a8c5df956602 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Request method failure captured: Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 57 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ETLXPns__o6NLCAtMGiMfTX7tLtQ3VLj1GL0cu7YhStM9bjbOjDatV6HwdLIQrppk3KFWq2PyEh7DkB4lpuD4I1GWzu4KGg0zdhXxa9nuCXv-tPgekpnTOCRec_uofjVixjL9p65AQ_5F_6Cg7Ewi4WQ6L4bVsQKoTWYo4eR-xW2cs Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be611136e6fb4e76a8c09eeca8c680e1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}] Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e0d53a02dff7419faf17fb9ef0e0ad2d Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: {"createImage": {"name": "tempest-test-snap-1850733512"}} Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1850733512'}}} Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.591548 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.597051 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.600024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-256a39c8-9398-41a9-b521-a8c5df956602 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:54.601638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-256a39c8-9398-41a9-b521-a8c5df956602 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.059949 Jul 26 19:47:54.602781 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 700/1345] 10.222.0.58 () {60 vars in 1275 bytes} [Tue Jul 26 19:47:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:54.636072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0db55f67-1138-4789-96ca-e22b2ce6b2b8 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2128697984"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:54.639201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0db55f67-1138-4789-96ca-e22b2ce6b2b8 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 19:47:54.642956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0db55f67-1138-4789-96ca-e22b2ce6b2b8 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0db55f67-1138-4789-96ca-e22b2ce6b2b8 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Request method failure captured: Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 57 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ETLXPns__o6NLCAtMGiMfTX7tLtQ3VLj1GL0cu7YhStM9bjbOjDatV6HwdLIQrppk3KFWq2PyEh7DkB4lpuD4I1GWzu4KGg0zdhXxa9nuCXv-tPgekpnTOCRec_uofjVixjL9p65AQ_5F_6Cg7Ewi4WQ6L4bVsQKoTWYo4eR-xW2cs Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be611136e6fb4e76a8c09eeca8c680e1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}] Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e0d53a02dff7419faf17fb9ef0e0ad2d Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: {"createImage": {"name": "tempest-test-snap-2128697984"}} Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2128697984'}}} Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.644828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 19:47:54.650031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.656488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0db55f67-1138-4789-96ca-e22b2ce6b2b8 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:54.669140 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0db55f67-1138-4789-96ca-e22b2ce6b2b8 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.052192 Jul 26 19:47:54.669921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 701/1346] 10.222.0.58 () {60 vars in 1281 bytes} [Tue Jul 26 19:47:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:54.693773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:54.710712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:54.734063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.736281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.745086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.745669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.810653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] HTTP exception thrown: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Request method failure captured: Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db HTTP/1.1 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ETLXPns__o6NLCAtMGiMfTX7tLtQ3VLj1GL0cu7YhStM9bjbOjDatV6HwdLIQrppk3KFWq2PyEh7DkB4lpuD4I1GWzu4KGg0zdhXxa9nuCXv-tPgekpnTOCRec_uofjVixjL9p65AQ_5F_6Cg7Ewi4WQ6L4bVsQKoTWYo4eR-xW2cs Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be611136e6fb4e76a8c09eeca8c680e1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}] Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e0d53a02dff7419faf17fb9ef0e0ad2d Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7a556b36-2d3e-4d9e-a117-e1f1a20175db'} Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:54.817601 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Returning 404 to user: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:54.822670 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3092ea52-7da0-48a7-88c2-ae7a234224a1 tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 404 len: 111 microversion: 2.1 time: 0.129740 Jul 26 19:47:54.829798 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 702/1347] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:54 2022] DELETE /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:54.850920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:54.851685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] [instance: 7a556b36-2d3e-4d9e-a117-e1f1a20175db] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:54.868311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.874780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.876211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.878777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.927462 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] HTTP exception thrown: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Request method failure captured: Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db HTTP/1.1 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ETLXPns__o6NLCAtMGiMfTX7tLtQ3VLj1GL0cu7YhStM9bjbOjDatV6HwdLIQrppk3KFWq2PyEh7DkB4lpuD4I1GWzu4KGg0zdhXxa9nuCXv-tPgekpnTOCRec_uofjVixjL9p65AQ_5F_6Cg7Ewi4WQ6L4bVsQKoTWYo4eR-xW2cs Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_be611136e6fb4e76a8c09eeca8c680e1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/be611136e6fb4e76a8c09eeca8c680e1"}]}] Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: be611136e6fb4e76a8c09eeca8c680e1 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1269485877 Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e0d53a02dff7419faf17fb9ef0e0ad2d Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesNegativeTestJSON-1269485877-project Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7a556b36-2d3e-4d9e-a117-e1f1a20175db'} Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:54.937099 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.942384 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:54.942384 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:54.942384 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:54.942384 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:54.942384 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:54.942384 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. Jul 26 19:47:54.942384 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:54.945614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] Returning 404 to user: Instance 7a556b36-2d3e-4d9e-a117-e1f1a20175db could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:54.947777 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2ed2567a-e9ec-4a0d-970e-3cd018c7b5db tempest-ImagesNegativeTestJSON-1269485877 tempest-ImagesNegativeTestJSON-1269485877-project] 10.222.0.58 "GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db" status: 404 len: 111 microversion: 2.1 time: 0.115877 Jul 26 19:47:54.955044 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 703/1348] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:54 2022] GET /compute/v2.1/servers/7a556b36-2d3e-4d9e-a117-e1f1a20175db => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:54.967729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-066ea43d-fb4b-487f-8568-f82be5c8838d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:54.974486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-066ea43d-fb4b-487f-8568-f82be5c8838d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:54.988179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-066ea43d-fb4b-487f-8568-f82be5c8838d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.993239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-066ea43d-fb4b-487f-8568-f82be5c8838d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:54.994222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-066ea43d-fb4b-487f-8568-f82be5c8838d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:54.994668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-066ea43d-fb4b-487f-8568-f82be5c8838d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:55.369735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-53ad503b-0b3c-4892-b575-c70b2f216629 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:55.378505 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-53ad503b-0b3c-4892-b575-c70b2f216629 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1505 microversion: 2.1 time: 1.061188 Jul 26 19:47:55.387581 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 646/1349] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:54 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1505 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:55.410045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4c29f7d0-228f-4d7f-9103-a1ef7b5b7f73 req-6d925258-0dcc-4f40-a33b-a9bc1f906be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f39e3c9-d789-460b-a36b-c5b9e3527888", "tag": "643df902-6645-4b6e-9c71-22da5df80018"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:55.443076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4c29f7d0-228f-4d7f-9103-a1ef7b5b7f73 req-6d925258-0dcc-4f40-a33b-a9bc1f906be5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:55.443435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4c29f7d0-228f-4d7f-9103-a1ef7b5b7f73 req-6d925258-0dcc-4f40-a33b-a9bc1f906be5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:55.522426 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4c29f7d0-228f-4d7f-9103-a1ef7b5b7f73 req-6d925258-0dcc-4f40-a33b-a9bc1f906be5 service nova] Creating event network-changed:643df902-6645-4b6e-9c71-22da5df80018 for instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 on n-h1-708768-8 Jul 26 19:47:55.545183 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4c29f7d0-228f-4d7f-9103-a1ef7b5b7f73 req-6d925258-0dcc-4f40-a33b-a9bc1f906be5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146785 Jul 26 19:47:55.546123 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 647/1350] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:55.551968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f90baf3-f504-463e-b5b8-e559e88f797a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:55.552684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f90baf3-f504-463e-b5b8-e559e88f797a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:55.576555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f90baf3-f504-463e-b5b8-e559e88f797a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:55.577213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f90baf3-f504-463e-b5b8-e559e88f797a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:55.578187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f90baf3-f504-463e-b5b8-e559e88f797a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:55.578986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f90baf3-f504-463e-b5b8-e559e88f797a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:55.806011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f90baf3-f504-463e-b5b8-e559e88f797a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:55.837994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f90baf3-f504-463e-b5b8-e559e88f797a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1346 microversion: 2.1 time: 0.288931 Jul 26 19:47:55.844970 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 648/1351] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:55 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1346 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:55.865167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d6019721-99c5-4f8e-8f51-073f3b347941 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:55.866507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d6019721-99c5-4f8e-8f51-073f3b347941 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:55.879579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6019721-99c5-4f8e-8f51-073f3b347941 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:55.884383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6019721-99c5-4f8e-8f51-073f3b347941 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:55.887278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6019721-99c5-4f8e-8f51-073f3b347941 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:55.888108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6019721-99c5-4f8e-8f51-073f3b347941 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:55.908128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-066ea43d-fb4b-487f-8568-f82be5c8838d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:55.919508 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-066ea43d-fb4b-487f-8568-f82be5c8838d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1474 microversion: 2.1 time: 0.962996 Jul 26 19:47:55.927090 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 704/1352] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:54 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1474 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:55.946052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09fe2907-a73b-42f5-90ed-5826f9d6e1bc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:55.947226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-09fe2907-a73b-42f5-90ed-5826f9d6e1bc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:55.969552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09fe2907-a73b-42f5-90ed-5826f9d6e1bc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:55.972377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09fe2907-a73b-42f5-90ed-5826f9d6e1bc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:55.979473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09fe2907-a73b-42f5-90ed-5826f9d6e1bc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:55.980258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09fe2907-a73b-42f5-90ed-5826f9d6e1bc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:56.214217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09fe2907-a73b-42f5-90ed-5826f9d6e1bc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:56.240659 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09fe2907-a73b-42f5-90ed-5826f9d6e1bc tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1275 microversion: 2.1 time: 0.311032 Jul 26 19:47:56.242216 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 705/1353] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:55 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:56.835076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-67f334a2-276e-43fd-8e19-316898434356 req-52fcf8c6-6b15-4c36-a9e6-7a12b0506cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b429ee74-71db-44cc-90d7-640d054b87e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a4f5599c-3151-46aa-986e-d0150a19caf0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:56.850456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-67f334a2-276e-43fd-8e19-316898434356 req-52fcf8c6-6b15-4c36-a9e6-7a12b0506cfa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:56.850916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-67f334a2-276e-43fd-8e19-316898434356 req-52fcf8c6-6b15-4c36-a9e6-7a12b0506cfa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:56.880606 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-67f334a2-276e-43fd-8e19-316898434356 req-52fcf8c6-6b15-4c36-a9e6-7a12b0506cfa service nova] Creating event network-vif-unplugged:a4f5599c-3151-46aa-986e-d0150a19caf0 for instance b429ee74-71db-44cc-90d7-640d054b87e7 on n-h2-708768-8 Jul 26 19:47:56.891273 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-67f334a2-276e-43fd-8e19-316898434356 req-52fcf8c6-6b15-4c36-a9e6-7a12b0506cfa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059779 Jul 26 19:47:56.898127 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 706/1354] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:47:56.906975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1b4a942b-0654-4a0d-b7b0-224ce93252f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:56.911399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1b4a942b-0654-4a0d-b7b0-224ce93252f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:56.921653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:56.931033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b4a942b-0654-4a0d-b7b0-224ce93252f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:56.939967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b4a942b-0654-4a0d-b7b0-224ce93252f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:56.941903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b4a942b-0654-4a0d-b7b0-224ce93252f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:56.942526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b4a942b-0654-4a0d-b7b0-224ce93252f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:57.439975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1b4a942b-0654-4a0d-b7b0-224ce93252f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:57.453330 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1b4a942b-0654-4a0d-b7b0-224ce93252f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1346 microversion: 2.1 time: 0.553833 Jul 26 19:47:57.461681 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 707/1355] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:56 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1346 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:57.468572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-19f30b0d-c728-442e-b55b-53407fe3e39d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:57.469188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-19f30b0d-c728-442e-b55b-53407fe3e39d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:57.496159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19f30b0d-c728-442e-b55b-53407fe3e39d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:57.496625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19f30b0d-c728-442e-b55b-53407fe3e39d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:57.500945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19f30b0d-c728-442e-b55b-53407fe3e39d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:57.501456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19f30b0d-c728-442e-b55b-53407fe3e39d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:57.628999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d6019721-99c5-4f8e-8f51-073f3b347941 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:57.637517 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d6019721-99c5-4f8e-8f51-073f3b347941 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1505 microversion: 2.1 time: 1.789963 Jul 26 19:47:57.648218 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 649/1356] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:55 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1505 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:57.655218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:57.664693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:57.681589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:57.682140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:57.683005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:57.683517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:57.934589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:57.942674 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1281 microversion: 2.1 time: 0.292988 Jul 26 19:47:57.959330 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 650/1357] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:57 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1281 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:57.960886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:57.962062 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fcb0d6e5-180f-42de-a840-2e2601613569 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001528 Jul 26 19:47:57.962903 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 651/1358] 10.222.0.58 () {56 vars in 886 bytes} [Tue Jul 26 19:47:57 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 19:47:57.974118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6af705ce-be0f-437e-95a1-d6f9dc8698fe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:57.984491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6af705ce-be0f-437e-95a1-d6f9dc8698fe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:57.994726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6af705ce-be0f-437e-95a1-d6f9dc8698fe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:57.995695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6af705ce-be0f-437e-95a1-d6f9dc8698fe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.000840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6af705ce-be0f-437e-95a1-d6f9dc8698fe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.001699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6af705ce-be0f-437e-95a1-d6f9dc8698fe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.144377 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6af705ce-be0f-437e-95a1-d6f9dc8698fe tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "PUT /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1081 microversion: 2.1 time: 0.180049 Jul 26 19:47:58.158105 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 652/1359] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 19:47:57 2022] PUT /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1081 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:58.163720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-39efe45e-42d6-4799-b3d9-e0f6ede1aed2 req-40c1e467-1dfe-4476-abb2-9d9ebbd23d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b429ee74-71db-44cc-90d7-640d054b87e7", "name": "network-vif-deleted", "tag": "a4f5599c-3151-46aa-986e-d0150a19caf0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:58.176687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-39efe45e-42d6-4799-b3d9-e0f6ede1aed2 req-40c1e467-1dfe-4476-abb2-9d9ebbd23d20 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.177452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-39efe45e-42d6-4799-b3d9-e0f6ede1aed2 req-40c1e467-1dfe-4476-abb2-9d9ebbd23d20 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.190033 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-39efe45e-42d6-4799-b3d9-e0f6ede1aed2 req-40c1e467-1dfe-4476-abb2-9d9ebbd23d20 service nova] Creating event network-vif-deleted:a4f5599c-3151-46aa-986e-d0150a19caf0 for instance b429ee74-71db-44cc-90d7-640d054b87e7 on n-h2-708768-8 Jul 26 19:47:58.195687 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-39efe45e-42d6-4799-b3d9-e0f6ede1aed2 req-40c1e467-1dfe-4476-abb2-9d9ebbd23d20 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035797 Jul 26 19:47:58.196434 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 653/1360] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:58.202112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-994b2a27-4041-48bf-a726-a00d9963427e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:58.203079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-994b2a27-4041-48bf-a726-a00d9963427e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:58.210449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-994b2a27-4041-48bf-a726-a00d9963427e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.211265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-994b2a27-4041-48bf-a726-a00d9963427e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.212343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-994b2a27-4041-48bf-a726-a00d9963427e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.213123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-994b2a27-4041-48bf-a726-a00d9963427e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.437187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-994b2a27-4041-48bf-a726-a00d9963427e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:58.442881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-19f30b0d-c728-442e-b55b-53407fe3e39d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:58.452864 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-19f30b0d-c728-442e-b55b-53407fe3e39d tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 200 len: 1474 microversion: 2.1 time: 0.989992 Jul 26 19:47:58.459209 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-994b2a27-4041-48bf-a726-a00d9963427e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1507 microversion: 2.1 time: 0.261313 Jul 26 19:47:58.472027 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 708/1361] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:57 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 1474 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:58.475705 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 654/1362] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:58 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:58.496891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:58.498344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:58.507253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-750f982e-89a2-413c-add0-982574dc2b63 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:58.507909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-750f982e-89a2-413c-add0-982574dc2b63 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:58.515998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.516723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.518258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.518889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.529215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-750f982e-89a2-413c-add0-982574dc2b63 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.534534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-750f982e-89a2-413c-add0-982574dc2b63 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.535579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-750f982e-89a2-413c-add0-982574dc2b63 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.536235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-750f982e-89a2-413c-add0-982574dc2b63 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.588558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.589211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.589832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lazy-loading 'fault' on Instance uuid d2b0264e-b656-49c4-b9cf-ff371219e527 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:47:58.752452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:58.759853 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7f45f7d0-76fb-4ff9-9907-f57d3962220f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 200 len: 1305 microversion: 2.1 time: 0.274843 Jul 26 19:47:58.774687 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 709/1363] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:58 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 1305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:58.782709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-77685621-c8a5-4070-a4d3-61cf0451dffa req-80ab6033-e452-425f-aa3b-57c0d575c022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc83fe1-fbb9-470d-91fa-cc759b3092b8", "name": "network-vif-deleted", "tag": "96ea90af-6318-4941-8fef-4b941cfc947a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:47:58.810890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-77685621-c8a5-4070-a4d3-61cf0451dffa req-80ab6033-e452-425f-aa3b-57c0d575c022 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.813161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-77685621-c8a5-4070-a4d3-61cf0451dffa req-80ab6033-e452-425f-aa3b-57c0d575c022 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.833089 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-77685621-c8a5-4070-a4d3-61cf0451dffa req-80ab6033-e452-425f-aa3b-57c0d575c022 service nova] Creating event network-vif-deleted:96ea90af-6318-4941-8fef-4b941cfc947a for instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 on n-h2-708768-8 Jul 26 19:47:58.841063 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-77685621-c8a5-4070-a4d3-61cf0451dffa req-80ab6033-e452-425f-aa3b-57c0d575c022 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063548 Jul 26 19:47:58.845299 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 710/1364] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:47:58.886766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-750f982e-89a2-413c-add0-982574dc2b63 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:58.896831 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-750f982e-89a2-413c-add0-982574dc2b63 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1507 microversion: 2.1 time: 0.394148 Jul 26 19:47:58.900427 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 655/1365] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:58 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1507 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:58.926673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0d4ef1e8-f3b4-4875-9246-abeef98fa9f3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:58.927744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0d4ef1e8-f3b4-4875-9246-abeef98fa9f3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:58.946207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d4ef1e8-f3b4-4875-9246-abeef98fa9f3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.948221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d4ef1e8-f3b4-4875-9246-abeef98fa9f3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.949225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d4ef1e8-f3b4-4875-9246-abeef98fa9f3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.951137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d4ef1e8-f3b4-4875-9246-abeef98fa9f3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.968078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d1bd7fc0-b3bd-4c43-9ee5-302520d1cc8b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:58.968750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d1bd7fc0-b3bd-4c43-9ee5-302520d1cc8b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:58.988192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1bd7fc0-b3bd-4c43-9ee5-302520d1cc8b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.990263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1bd7fc0-b3bd-4c43-9ee5-302520d1cc8b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:58.993927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1bd7fc0-b3bd-4c43-9ee5-302520d1cc8b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:58.998615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1bd7fc0-b3bd-4c43-9ee5-302520d1cc8b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.058903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0d4ef1e8-f3b4-4875-9246-abeef98fa9f3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:59.166659 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0d4ef1e8-f3b4-4875-9246-abeef98fa9f3 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 204 len: 0 microversion: 2.1 time: 0.246397 Jul 26 19:47:59.167700 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 711/1366] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:58 2022] DELETE /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:59.178399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1bd7fc0-b3bd-4c43-9ee5-302520d1cc8b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:59.183491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:59.184234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:59.192466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.193024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.195149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.196074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.197513 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d1bd7fc0-b3bd-4c43-9ee5-302520d1cc8b tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1281 microversion: 2.1 time: 0.234603 Jul 26 19:47:59.221654 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 656/1367] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:58 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:47:59.249568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:59.307564 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.api [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Instance is already in deleting state, ignoring this request Jul 26 19:47:59.308514 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de479dbc-1fdc-470e-8a24-675f338cc2aa tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 204 len: 0 microversion: 2.1 time: 0.131235 Jul 26 19:47:59.309502 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 712/1368] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:59 2022] DELETE /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:59.317913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-04114957-4b32-4ed4-904d-376530d1baf5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:59.318813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-04114957-4b32-4ed4-904d-376530d1baf5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:59.329758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04114957-4b32-4ed4-904d-376530d1baf5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.330219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04114957-4b32-4ed4-904d-376530d1baf5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.334347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04114957-4b32-4ed4-904d-376530d1baf5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.334821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04114957-4b32-4ed4-904d-376530d1baf5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.482075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:59.483235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 0dc83fe1-fbb9-470d-91fa-cc759b3092b8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:59.491540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.492836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.493803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.494409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.522521 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] HTTP exception thrown: Instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 could not be found. Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Request method failure captured: Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 HTTP/1.1 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ2UfAQCIvAOR-VBpEt0CgxFkMSC4ya3OMI2F7uC_6k3uRL_tRT-Sj98az4J8FgRnLpBCJeiBErA5lPIMgNG1YKhBi2K7o7DAE4I9_dn3Dyp-6IV2D4HTt-cFaeMFXt3G53NcilHVMXJRO5YCu47A4f17lB2cUQUbo5p7jAaxPlkPY Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b66d3923b4a4d3dacfa2c53f5af1ac1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}] Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 0bf1dac22e284b15b0e93146dc756338 Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 could not be found. Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '0dc83fe1-fbb9-470d-91fa-cc759b3092b8'} Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 could not be found. Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 could not be found. Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:59.524302 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 could not be found. Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Returning 404 to user: Instance 0dc83fe1-fbb9-470d-91fa-cc759b3092b8 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:59.532252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14055933-0887-4b88-a06a-928a84440c6c tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8" status: 404 len: 111 microversion: 2.1 time: 0.048014 Jul 26 19:47:59.544016 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 713/1369] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:59 2022] GET /compute/v2.1/servers/0dc83fe1-fbb9-470d-91fa-cc759b3092b8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:59.548687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:59.549302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: b429ee74-71db-44cc-90d7-640d054b87e7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:59.570860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.571956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.573013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.573624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.591901 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] HTTP exception thrown: Instance b429ee74-71db-44cc-90d7-640d054b87e7 could not be found. Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Request method failure captured: Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 HTTP/1.1 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ2UfAQCIvAOR-VBpEt0CgxFkMSC4ya3OMI2F7uC_6k3uRL_tRT-Sj98az4J8FgRnLpBCJeiBErA5lPIMgNG1YKhBi2K7o7DAE4I9_dn3Dyp-6IV2D4HTt-cFaeMFXt3G53NcilHVMXJRO5YCu47A4f17lB2cUQUbo5p7jAaxPlkPY Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b66d3923b4a4d3dacfa2c53f5af1ac1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}] Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 0bf1dac22e284b15b0e93146dc756338 Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance b429ee74-71db-44cc-90d7-640d054b87e7 could not be found. Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'b429ee74-71db-44cc-90d7-640d054b87e7'} Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b429ee74-71db-44cc-90d7-640d054b87e7 could not be found. Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b429ee74-71db-44cc-90d7-640d054b87e7 could not be found. Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:59.593721 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.599065 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.599065 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:59.599065 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:59.599065 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:59.599065 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:59.599065 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b429ee74-71db-44cc-90d7-640d054b87e7 could not be found. Jul 26 19:47:59.599065 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.603220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Returning 404 to user: Instance b429ee74-71db-44cc-90d7-640d054b87e7 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:59.604785 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5bf8190-885b-4104-b239-4d068034a988 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7" status: 404 len: 111 microversion: 2.1 time: 0.059938 Jul 26 19:47:59.606011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 714/1370] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:59 2022] GET /compute/v2.1/servers/b429ee74-71db-44cc-90d7-640d054b87e7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:59.615729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8253025e-1614-4d0f-b1c3-969088a11469 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:59.661257 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8253025e-1614-4d0f-b1c3-969088a11469 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/bc722a98-7f2f-4f50-9e6f-6a5af61a22e2" status: 204 len: 0 microversion: 2.1 time: 0.050023 Jul 26 19:47:59.663261 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 715/1371] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 19:47:59 2022] DELETE /compute/v2.1/os-server-groups/bc722a98-7f2f-4f50-9e6f-6a5af61a22e2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:47:59.666705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-04114957-4b32-4ed4-904d-376530d1baf5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:47:59.672454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f425fba-b1f4-4d87-b2e4-bf5850e9332f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:59.673595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1f425fba-b1f4-4d87-b2e4-bf5850e9332f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:59.674439 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-04114957-4b32-4ed4-904d-376530d1baf5 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1513 microversion: 2.1 time: 0.360502 Jul 26 19:47:59.675025 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 657/1372] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:59 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1513 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:47:59.684346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f425fba-b1f4-4d87-b2e4-bf5850e9332f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.684939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f425fba-b1f4-4d87-b2e4-bf5850e9332f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.685929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f425fba-b1f4-4d87-b2e4-bf5850e9332f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.686614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f425fba-b1f4-4d87-b2e4-bf5850e9332f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.733661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1f425fba-b1f4-4d87-b2e4-bf5850e9332f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:47:59.738061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:47:59.782051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:59.783149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:59.804185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.805053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.807575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.809998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.877521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 HTTP/1.1 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd2b0264e-b656-49c4-b9cf-ff371219e527'} Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:47:59.882292 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.887921 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:47:59.887921 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:47:59.887921 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:47:59.887921 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:47:59.887921 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:47:59.887921 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:47:59.887921 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:47:59.887921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:47:59.896703 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef1cdd38-149d-488c-84a1-1c4577a6996d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 404 len: 111 microversion: 2.1 time: 0.105835 Jul 26 19:47:59.896703 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 658/1373] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:59 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:47:59.949767 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1f425fba-b1f4-4d87-b2e4-bf5850e9332f tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 204 len: 0 microversion: 2.1 time: 0.281374 Jul 26 19:47:59.952272 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 716/1374] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:47:59 2022] DELETE /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:47:59.960234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82adbe34-3d3b-4afe-b2cf-5e90e6227539 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:47:59.960854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82adbe34-3d3b-4afe-b2cf-5e90e6227539 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:47:59.970945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82adbe34-3d3b-4afe-b2cf-5e90e6227539 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.971408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82adbe34-3d3b-4afe-b2cf-5e90e6227539 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:47:59.972233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82adbe34-3d3b-4afe-b2cf-5e90e6227539 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:47:59.972655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82adbe34-3d3b-4afe-b2cf-5e90e6227539 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:00.111914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:00.117308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:00.126608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:00.127310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:00.129021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:00.130498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:00.150977 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527/os-volume_attachments HTTP/1.1 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': 'd2b0264e-b656-49c4-b9cf-ff371219e527'} Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:00.163243 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-88fa13e2-b750-4d71-8614-59aade81c067 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066788 Jul 26 19:48:00.167538 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 717/1375] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:48:00 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:48:00.226281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c440b3a-641c-4196-a019-f62806d80abf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:00.226952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6c440b3a-641c-4196-a019-f62806d80abf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:00.240824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c440b3a-641c-4196-a019-f62806d80abf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:00.240824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c440b3a-641c-4196-a019-f62806d80abf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:00.243267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c440b3a-641c-4196-a019-f62806d80abf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:00.243789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c440b3a-641c-4196-a019-f62806d80abf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:00.328270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82adbe34-3d3b-4afe-b2cf-5e90e6227539 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:00.337526 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82adbe34-3d3b-4afe-b2cf-5e90e6227539 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1473 microversion: 2.1 time: 0.381008 Jul 26 19:48:00.356833 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 659/1376] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:47:59 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1473 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:00.549429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1964274133", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d609008d-caf9-4f78-8a5e-41e510179ad2"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:00.673199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] validate_networks() for [('d609008d-caf9-4f78-8a5e-41e510179ad2', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:48:00.990130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c440b3a-641c-4196-a019-f62806d80abf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:01.041335 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c440b3a-641c-4196-a019-f62806d80abf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1323 microversion: 2.1 time: 0.798490 Jul 26 19:48:01.044399 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 718/1377] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:00 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1323 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:01.069092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f56f9cbe-3a8e-4744-88fc-d3c9f8009a2b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:01.072272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f56f9cbe-3a8e-4744-88fc-d3c9f8009a2b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:01.079705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f56f9cbe-3a8e-4744-88fc-d3c9f8009a2b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:01.080232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f56f9cbe-3a8e-4744-88fc-d3c9f8009a2b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:01.081100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f56f9cbe-3a8e-4744-88fc-d3c9f8009a2b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:01.081780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f56f9cbe-3a8e-4744-88fc-d3c9f8009a2b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:01.468341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f56f9cbe-3a8e-4744-88fc-d3c9f8009a2b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:01.484435 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f56f9cbe-3a8e-4744-88fc-d3c9f8009a2b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1513 microversion: 2.1 time: 0.437879 Jul 26 19:48:01.500272 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 719/1378] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:01 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1513 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:01.506050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3eeec6e-7eb3-44ed-b79e-65605c19029a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:01.506974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e3eeec6e-7eb3-44ed-b79e-65605c19029a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:01.518391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3eeec6e-7eb3-44ed-b79e-65605c19029a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:01.518938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3eeec6e-7eb3-44ed-b79e-65605c19029a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:01.520719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3eeec6e-7eb3-44ed-b79e-65605c19029a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:01.521541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3eeec6e-7eb3-44ed-b79e-65605c19029a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:01.898130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:48:01.899434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:48:01.900551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:48:01.901198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:48:01.901854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:48:01.914868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:01.915584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:01.916519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:01.916963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:01.945905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:01.953073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for user 4e8808ff2c4341eca66334700ec25a82 and project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:01.968334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:48:01.970862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:48:02.057139 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34f8b80b-f012-4490-8115-fd0a5fed4c54 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.515628 Jul 26 19:48:02.058857 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 660/1379] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:48:02.065790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b59d0d5-2b62-4e29-8146-7a4d0c9a7232 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:02.068187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6b59d0d5-2b62-4e29-8146-7a4d0c9a7232 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:02.077236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b59d0d5-2b62-4e29-8146-7a4d0c9a7232 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:02.078313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b59d0d5-2b62-4e29-8146-7a4d0c9a7232 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:02.079316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b59d0d5-2b62-4e29-8146-7a4d0c9a7232 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:02.079951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b59d0d5-2b62-4e29-8146-7a4d0c9a7232 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:02.729537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6b59d0d5-2b62-4e29-8146-7a4d0c9a7232 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:02.741158 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b59d0d5-2b62-4e29-8146-7a4d0c9a7232 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1323 microversion: 2.1 time: 0.680865 Jul 26 19:48:02.743853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 661/1380] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:02 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1323 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:02.749345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d1bcd34c-fcc9-44ee-a908-67a077b78e72 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:02.752177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d1bcd34c-fcc9-44ee-a908-67a077b78e72 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:02.770734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1bcd34c-fcc9-44ee-a908-67a077b78e72 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:02.771874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1bcd34c-fcc9-44ee-a908-67a077b78e72 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:02.772882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1bcd34c-fcc9-44ee-a908-67a077b78e72 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:02.773594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1bcd34c-fcc9-44ee-a908-67a077b78e72 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:02.859731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1bcd34c-fcc9-44ee-a908-67a077b78e72 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:02.866800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e3eeec6e-7eb3-44ed-b79e-65605c19029a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:02.869824 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d1bcd34c-fcc9-44ee-a908-67a077b78e72 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e" status: 200 len: 1219 microversion: 2.1 time: 0.124634 Jul 26 19:48:02.870871 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 662/1381] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:02 2022] GET /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:02.885573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c320f3eb-99c2-45a4-8d1b-8aaeeab455bc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:02.886893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c320f3eb-99c2-45a4-8d1b-8aaeeab455bc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:02.887273 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e3eeec6e-7eb3-44ed-b79e-65605c19029a tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1473 microversion: 2.1 time: 1.385196 Jul 26 19:48:02.896236 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 720/1382] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:01 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1473 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:02.915168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-20da2075-4579-4b6d-898b-02ddafd280b8 req-240de3d3-c2a4-46a0-8896-97f3bd5b479a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47c6943-f5c1-402e-b172-03d4c6d40c65", "tag": "781b40de-246f-4c4a-aa2b-9416c43e3b7a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:02.920365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c320f3eb-99c2-45a4-8d1b-8aaeeab455bc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:02.920936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c320f3eb-99c2-45a4-8d1b-8aaeeab455bc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:02.921815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c320f3eb-99c2-45a4-8d1b-8aaeeab455bc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:02.922416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c320f3eb-99c2-45a4-8d1b-8aaeeab455bc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:02.935425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-20da2075-4579-4b6d-898b-02ddafd280b8 req-240de3d3-c2a4-46a0-8896-97f3bd5b479a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:02.936864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-20da2075-4579-4b6d-898b-02ddafd280b8 req-240de3d3-c2a4-46a0-8896-97f3bd5b479a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:02.955577 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-20da2075-4579-4b6d-898b-02ddafd280b8 req-240de3d3-c2a4-46a0-8896-97f3bd5b479a service nova] Creating event network-changed:781b40de-246f-4c4a-aa2b-9416c43e3b7a for instance d47c6943-f5c1-402e-b172-03d4c6d40c65 on n-h2-708768-8 Jul 26 19:48:02.966231 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-20da2075-4579-4b6d-898b-02ddafd280b8 req-240de3d3-c2a4-46a0-8896-97f3bd5b479a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068249 Jul 26 19:48:02.967321 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 721/1383] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:02.977496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:02.979877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:02.994748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:02.996398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:02.999900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:03.001517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:03.056802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:48:03.085498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:03.088066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:03.257197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c320f3eb-99c2-45a4-8d1b-8aaeeab455bc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:03.271631 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c320f3eb-99c2-45a4-8d1b-8aaeeab455bc tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1513 microversion: 2.1 time: 0.399047 Jul 26 19:48:03.272334 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 663/1384] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:02 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:03.436118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lazy-loading 'flavor' on Instance uuid 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:48:03.587244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lazy-loading 'system_metadata' on Instance uuid 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:48:03.709293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9981adb3-6a01-4176-b8c2-ff1d5b0aaf94 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Action: 'create', calling method: .version_select at 0x7f8756e0c940>, body: {"keypair": {"name": "tempest-keypair-311569242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5HNJc+plJ7phD93RR7GtAeFuLR/6ZF8+NJKFnica0p4EgoLmm2yVVoTOHWsVxIqSAo/7qWrZznyOOCj0WhN6rxBdcuR7F1vSUASrgCwWPGkvWclpM906xCRndnJQ1q4w=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:03.725224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lazy-loading 'metadata' on Instance uuid 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:48:03.747210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-9981adb3-6a01-4176-b8c2-ff1d5b0aaf94 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Getting quotas for project a12a08cdecac47df83d0fe375e823172. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:03.755548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-9981adb3-6a01-4176-b8c2-ff1d5b0aaf94 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Getting quotas for user 43416bcbb5a747628d0594cf62819331 and project a12a08cdecac47df83d0fe375e823172. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:03.797791 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9981adb3-6a01-4176-b8c2-ff1d5b0aaf94 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.523218 Jul 26 19:48:03.798692 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 664/1385] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:48:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:03.808435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98e25224-3476-4733-908a-fe62006d24e1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:03.809108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-98e25224-3476-4733-908a-fe62006d24e1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:03.818651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98e25224-3476-4733-908a-fe62006d24e1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:03.819218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98e25224-3476-4733-908a-fe62006d24e1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:03.820406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98e25224-3476-4733-908a-fe62006d24e1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:03.820987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98e25224-3476-4733-908a-fe62006d24e1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:03.851353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:04.432299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:04.678625 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.scheduler.client.report [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Deleted allocations for instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e Jul 26 19:48:04.717000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0cf2ba53-d030-4209-be70-dca9c24e75cc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e" status: 204 len: 0 microversion: 2.1 time: 1.748173 Jul 26 19:48:04.721504 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 722/1386] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:48:02 2022] DELETE /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e => generated 0 bytes in 1750 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:48:04.728558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0354e729-0a12-492b-89a1-7ae4a422ceaf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:04.729480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0354e729-0a12-492b-89a1-7ae4a422ceaf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:04.737480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0354e729-0a12-492b-89a1-7ae4a422ceaf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:04.738166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0354e729-0a12-492b-89a1-7ae4a422ceaf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:04.739173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0354e729-0a12-492b-89a1-7ae4a422ceaf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:04.739800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0354e729-0a12-492b-89a1-7ae4a422ceaf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:04.875773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-98e25224-3476-4733-908a-fe62006d24e1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:04.896526 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98e25224-3476-4733-908a-fe62006d24e1 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1323 microversion: 2.1 time: 1.095002 Jul 26 19:48:04.901399 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 665/1387] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:03 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1323 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:04.927023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:04.930182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:04.949752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:04.950643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:04.956155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:04.960567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.051214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.052192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.054023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lazy-loading 'fault' on Instance uuid fcc21891-611c-4e20-99d7-21b3b2c63ee7 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:48:05.066223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:05.165511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4faef4f5be5941fc961c149905589902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d10cfa367f4bf591a86719352723d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:05.185872 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f865773-796d-426d-9944-e54a5a5109e9 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 200 len: 1308 microversion: 2.1 time: 0.283050 Jul 26 19:48:05.189560 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 666/1388] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:04 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:05.227675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:05.228398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:05.248278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.248747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.249544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.250106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.288597 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e HTTP/1.1 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e'} Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:05.294009 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:05.298769 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:05.298769 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:05.298769 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:05.298769 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:05.298769 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:05.298769 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:48:05.298769 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:05.298769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:05.313950 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e0cd9c37-2c6f-49cd-a738-5ccca27d74af tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e" status: 404 len: 111 microversion: 2.1 time: 0.093439 Jul 26 19:48:05.327964 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 667/1389] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:05 2022] GET /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:05.354880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d789aff0-cae7-4203-834f-c9172ad0b139 req-c3fb74b4-b94d-4544-9f42-3acdd78f2219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc21891-611c-4e20-99d7-21b3b2c63ee7", "name": "network-vif-deleted", "tag": "ad12e6a6-b47b-4eb7-a4ff-9d5e461e44e1"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:05.405653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d789aff0-cae7-4203-834f-c9172ad0b139 req-c3fb74b4-b94d-4544-9f42-3acdd78f2219 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.410245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d789aff0-cae7-4203-834f-c9172ad0b139 req-c3fb74b4-b94d-4544-9f42-3acdd78f2219 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.460279 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d789aff0-cae7-4203-834f-c9172ad0b139 req-c3fb74b4-b94d-4544-9f42-3acdd78f2219 service nova] Creating event network-vif-deleted:ad12e6a6-b47b-4eb7-a4ff-9d5e461e44e1 for instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 on n-h1-708768-8 Jul 26 19:48:05.486640 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d789aff0-cae7-4203-834f-c9172ad0b139 req-c3fb74b4-b94d-4544-9f42-3acdd78f2219 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157316 Jul 26 19:48:05.495391 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 668/1390] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:05.762582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4be66803-72b5-429c-9aff-075399f98f2b tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Calling method '.version_select at 0x7f8756e02700>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:05.763452 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:48:05.763452 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:48:05.764815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4be66803-72b5-429c-9aff-075399f98f2b tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.765186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4be66803-72b5-429c-9aff-075399f98f2b tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.787715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4be66803-72b5-429c-9aff-075399f98f2b tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.788507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4be66803-72b5-429c-9aff-075399f98f2b tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.802574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4be66803-72b5-429c-9aff-075399f98f2b tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.804273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4be66803-72b5-429c-9aff-075399f98f2b tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.814460 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4be66803-72b5-429c-9aff-075399f98f2b tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.305332 Jul 26 19:48:05.823588 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 669/1391] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:48:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:05.829722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2105766012", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d609008d-caf9-4f78-8a5e-41e510179ad2"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:05.854565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0354e729-0a12-492b-89a1-7ae4a422ceaf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf1dac22e284b15b0e93146dc756338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b66d3923b4a4d3dacfa2c53f5af1ac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:05.862507 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0354e729-0a12-492b-89a1-7ae4a422ceaf tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 200 len: 1431 microversion: 2.1 time: 1.138066 Jul 26 19:48:05.863089 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 723/1392] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:04 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 1431 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:05.880328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-261d1d15-1d9a-4ca4-b5d9-4c02636819fe tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Calling method '.version_select at 0x7f875f021dc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:05.881376 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:48:05.881376 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:48:05.882462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-261d1d15-1d9a-4ca4-b5d9-4c02636819fe tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.882922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-261d1d15-1d9a-4ca4-b5d9-4c02636819fe tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.902218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] validate_networks() for [('d609008d-caf9-4f78-8a5e-41e510179ad2', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:48:05.941600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-261d1d15-1d9a-4ca4-b5d9-4c02636819fe tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.941968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-261d1d15-1d9a-4ca4-b5d9-4c02636819fe tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.979876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-261d1d15-1d9a-4ca4-b5d9-4c02636819fe tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:05.980334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-261d1d15-1d9a-4ca4-b5d9-4c02636819fe tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:05.986775 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-261d1d15-1d9a-4ca4-b5d9-4c02636819fe tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-708768-8/servers" status: 200 len: 275 microversion: 2.1 time: 0.122068 Jul 26 19:48:05.987350 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 724/1393] 10.222.0.58 () {58 vars in 1212 bytes} [Tue Jul 26 19:48:05 2022] GET /compute/v2.1/os-hypervisors/n-h1-708768-8/servers => generated 275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:05.998436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8010ce4-8750-4271-ada1-e616c747ee68 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:05.999393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8010ce4-8750-4271-ada1-e616c747ee68 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:06.011032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8010ce4-8750-4271-ada1-e616c747ee68 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.013845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8010ce4-8750-4271-ada1-e616c747ee68 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.014796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8010ce4-8750-4271-ada1-e616c747ee68 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.019174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8010ce4-8750-4271-ada1-e616c747ee68 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.543590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b8010ce4-8750-4271-ada1-e616c747ee68 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:06.555820 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8010ce4-8750-4271-ada1-e616c747ee68 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1323 microversion: 2.1 time: 0.566947 Jul 26 19:48:06.556330 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 725/1394] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:05 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1323 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:06.576827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-86b802ca-b325-4efe-b714-97b7c500e6b4 tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Calling method '.version_select at 0x7f875f06d430>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:06.596957 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:48:06.596957 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:48:06.599433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86b802ca-b325-4efe-b714-97b7c500e6b4 tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.600145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86b802ca-b325-4efe-b714-97b7c500e6b4 tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.640746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86b802ca-b325-4efe-b714-97b7c500e6b4 tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.641452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86b802ca-b325-4efe-b714-97b7c500e6b4 tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.663072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86b802ca-b325-4efe-b714-97b7c500e6b4 tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.663591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86b802ca-b325-4efe-b714-97b7c500e6b4 tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.675600 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-86b802ca-b325-4efe-b714-97b7c500e6b4 tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.102767 Jul 26 19:48:06.676279 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 726/1395] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:48:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:06.685890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:06.686508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: fcc21891-611c-4e20-99d7-21b3b2c63ee7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:06.693412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.694150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.695110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.713258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.734978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] HTTP exception thrown: Instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 could not be found. Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Request method failure captured: Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 HTTP/1.1 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ9EoDmjDlfnqOulDGV1SfEfnIeFu9dFqqXQPYBqw4ipFZVLAFXehVOqC_gv1uVLnWNbDlSay1f_BGmBlIqwCeLy54BsVHyljk1M59n0d7eGFJfW3P2S36UabN99SCHT7jAFSnnwBGGbytKgRmp7wlVPSdRPPmX47y_vQvVy_rqA8g Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88d10cfa367f4bf591a86719352723d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}] Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4faef4f5be5941fc961c149905589902 Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 could not be found. Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'fcc21891-611c-4e20-99d7-21b3b2c63ee7'} Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 could not be found. Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 could not be found. Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:06.736690 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 could not be found. Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Returning 404 to user: Instance fcc21891-611c-4e20-99d7-21b3b2c63ee7 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:06.741689 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1edb3a06-f277-4596-8dc1-e8321eed7657 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7" status: 404 len: 111 microversion: 2.1 time: 0.060925 Jul 26 19:48:06.751860 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 727/1396] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:06 2022] GET /compute/v2.1/servers/fcc21891-611c-4e20-99d7-21b3b2c63ee7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:06.759831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5de59614-8a40-4c67-abae-9cb41a37301d tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Calling method '.version_select at 0x7f875f021dc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:06.760641 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:48:06.760641 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:48:06.761762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5de59614-8a40-4c67-abae-9cb41a37301d tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.768763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5de59614-8a40-4c67-abae-9cb41a37301d tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.799717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5de59614-8a40-4c67-abae-9cb41a37301d tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.800562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5de59614-8a40-4c67-abae-9cb41a37301d tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.804225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:48:06.805122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:48:06.806248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:48:06.807760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:48:06.808380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:48:06.815930 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5de59614-8a40-4c67-abae-9cb41a37301d tempest-HypervisorAdminUnderV252Test-912380604 tempest-HypervisorAdminUnderV252Test-912380604-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-708768-8/search" status: 200 len: 104 microversion: 2.1 time: 0.061368 Jul 26 19:48:06.817545 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 728/1397] 10.222.0.58 () {58 vars in 1209 bytes} [Tue Jul 26 19:48:06 2022] GET /compute/v2.1/os-hypervisors/n-h1-708768-8/search => generated 104 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:06.824982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:06.826331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:06.833737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.834653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.835719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.836592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.855552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] HTTP exception thrown: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.857277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Request method failure captured: Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 HTTP/1.1 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ9EoDmjDlfnqOulDGV1SfEfnIeFu9dFqqXQPYBqw4ipFZVLAFXehVOqC_gv1uVLnWNbDlSay1f_BGmBlIqwCeLy54BsVHyljk1M59n0d7eGFJfW3P2S36UabN99SCHT7jAFSnnwBGGbytKgRmp7wlVPSdRPPmX47y_vQvVy_rqA8g Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88d10cfa367f4bf591a86719352723d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}] Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4faef4f5be5941fc961c149905589902 Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ca9a3004-dc44-4bfc-926a-3f0ed3e29227'} Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:06.858342 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.863749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.865451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.865451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.865451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.866886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Returning 404 to user: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:06.868069 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0bb00b2b-9380-40ed-a5e4-5c5006d90c10 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 404 len: 111 microversion: 2.1 time: 0.049239 Jul 26 19:48:06.872051 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 729/1398] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:48:06 2022] DELETE /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:06.879333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:06.880430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: ca9a3004-dc44-4bfc-926a-3f0ed3e29227] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:06.887691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.888508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.889544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.890203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.895395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:INSERT=1,nova_cell1:DELETE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:06.922118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:06.928903 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] HTTP exception thrown: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Request method failure captured: Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 HTTP/1.1 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ9EoDmjDlfnqOulDGV1SfEfnIeFu9dFqqXQPYBqw4ipFZVLAFXehVOqC_gv1uVLnWNbDlSay1f_BGmBlIqwCeLy54BsVHyljk1M59n0d7eGFJfW3P2S36UabN99SCHT7jAFSnnwBGGbytKgRmp7wlVPSdRPPmX47y_vQvVy_rqA8g Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88d10cfa367f4bf591a86719352723d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}] Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4faef4f5be5941fc961c149905589902 Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ca9a3004-dc44-4bfc-926a-3f0ed3e29227'} Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:06.932939 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Returning 404 to user: Instance ca9a3004-dc44-4bfc-926a-3f0ed3e29227 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c483e572-c9f0-4ece-8091-d9e3ccb3ab4b tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227" status: 404 len: 111 microversion: 2.1 time: 0.061111 Jul 26 19:48:06.940558 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 730/1399] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:06 2022] GET /compute/v2.1/servers/ca9a3004-dc44-4bfc-926a-3f0ed3e29227 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:06.943954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for user 4e8808ff2c4341eca66334700ec25a82 and project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:06.954121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:06.954793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] [instance: 46c80442-0e57-4d48-bc28-6682ae824154] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:06.959313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:06.961043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:48:06.964273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:48:06.969078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.969529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:06.970303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:06.970760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:07.007158 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] HTTP exception thrown: Instance 46c80442-0e57-4d48-bc28-6682ae824154 could not be found. Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Request method failure captured: Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 HTTP/1.1 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ2UfAQCIvAOR-VBpEt0CgxFkMSC4ya3OMI2F7uC_6k3uRL_tRT-Sj98az4J8FgRnLpBCJeiBErA5lPIMgNG1YKhBi2K7o7DAE4I9_dn3Dyp-6IV2D4HTt-cFaeMFXt3G53NcilHVMXJRO5YCu47A4f17lB2cUQUbo5p7jAaxPlkPY Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b66d3923b4a4d3dacfa2c53f5af1ac1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b66d3923b4a4d3dacfa2c53f5af1ac1"}]}] Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5b66d3923b4a4d3dacfa2c53f5af1ac1 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-236995354 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 0bf1dac22e284b15b0e93146dc756338 Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersOnMultiNodesTest-236995354-project Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 46c80442-0e57-4d48-bc28-6682ae824154 could not be found. Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '46c80442-0e57-4d48-bc28-6682ae824154'} Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c80442-0e57-4d48-bc28-6682ae824154 could not be found. Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c80442-0e57-4d48-bc28-6682ae824154 could not be found. Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:07.009009 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c80442-0e57-4d48-bc28-6682ae824154 could not be found. Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] Returning 404 to user: Instance 46c80442-0e57-4d48-bc28-6682ae824154 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-888b281f-86c1-443a-a80b-e058b6435466 tempest-ServersOnMultiNodesTest-236995354 tempest-ServersOnMultiNodesTest-236995354-project] 10.222.0.58 "GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154" status: 404 len: 111 microversion: 2.1 time: 0.070034 Jul 26 19:48:07.014452 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 731/1400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:06 2022] GET /compute/v2.1/servers/46c80442-0e57-4d48-bc28-6682ae824154 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:07.029441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:07.030220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:07.043432 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4c4ef778-36b6-49ca-97b0-eb332f839d26 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.218144 Jul 26 19:48:07.046146 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 670/1401] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:48:07.054575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:07.055049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:07.057808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:07.058293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:07.061525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0219842b-fb44-4a19-b020-71513c55de7b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:07.063224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0219842b-fb44-4a19-b020-71513c55de7b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:07.090447 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] HTTP exception thrown: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Request method failure captured: Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b HTTP/1.1 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ9EoDmjDlfnqOulDGV1SfEfnIeFu9dFqqXQPYBqw4ipFZVLAFXehVOqC_gv1uVLnWNbDlSay1f_BGmBlIqwCeLy54BsVHyljk1M59n0d7eGFJfW3P2S36UabN99SCHT7jAFSnnwBGGbytKgRmp7wlVPSdRPPmX47y_vQvVy_rqA8g Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88d10cfa367f4bf591a86719352723d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}] Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4faef4f5be5941fc961c149905589902 Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c814f3cd-1c30-41a1-9f98-13fdf07d945b'} Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:07.095462 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.101857 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.105517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Returning 404 to user: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:07.105517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2001a435-1ecb-4bcd-b3b0-e3c2b9754f48 tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 404 len: 111 microversion: 2.1 time: 0.093229 Jul 26 19:48:07.108765 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 732/1402] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:48:07 2022] DELETE /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:07.114257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:07.115006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] [instance: c814f3cd-1c30-41a1-9f98-13fdf07d945b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:07.127266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:07.133442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:07.134433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:07.134859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:07.168967 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] HTTP exception thrown: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Request method failure captured: Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b HTTP/1.1 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EQ9EoDmjDlfnqOulDGV1SfEfnIeFu9dFqqXQPYBqw4ipFZVLAFXehVOqC_gv1uVLnWNbDlSay1f_BGmBlIqwCeLy54BsVHyljk1M59n0d7eGFJfW3P2S36UabN99SCHT7jAFSnnwBGGbytKgRmp7wlVPSdRPPmX47y_vQvVy_rqA8g Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_88d10cfa367f4bf591a86719352723d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/88d10cfa367f4bf591a86719352723d6"}]}] Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 88d10cfa367f4bf591a86719352723d6 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1706498708 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4faef4f5be5941fc961c149905589902 Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiskConfigTestJSON-1706498708-project Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c814f3cd-1c30-41a1-9f98-13fdf07d945b'} Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:07.173846 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] Returning 404 to user: Instance c814f3cd-1c30-41a1-9f98-13fdf07d945b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:07.178878 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-adb692ef-9ff1-435a-b29b-7ba01338585e tempest-ServerDiskConfigTestJSON-1706498708 tempest-ServerDiskConfigTestJSON-1706498708-project] 10.222.0.58 "GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b" status: 404 len: 111 microversion: 2.1 time: 0.065410 Jul 26 19:48:07.183808 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 733/1403] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:07 2022] GET /compute/v2.1/servers/c814f3cd-1c30-41a1-9f98-13fdf07d945b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:48:07.425163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0219842b-fb44-4a19-b020-71513c55de7b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:07.433700 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0219842b-fb44-4a19-b020-71513c55de7b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1215 microversion: 2.1 time: 0.379382 Jul 26 19:48:07.434294 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 671/1404] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:07 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1215 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:07.578250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d944d974-a1f1-498e-8a0c-de932f62ddaf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:07.578797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d944d974-a1f1-498e-8a0c-de932f62ddaf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:07.590499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d944d974-a1f1-498e-8a0c-de932f62ddaf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:07.590960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d944d974-a1f1-498e-8a0c-de932f62ddaf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:07.591799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d944d974-a1f1-498e-8a0c-de932f62ddaf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:07.592245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d944d974-a1f1-498e-8a0c-de932f62ddaf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:07.822579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2eed5af4-cce0-4f8c-80c4-9f69d0631135 req-e9204f60-af84-448a-9f32-d2aba4f5c10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c80442-0e57-4d48-bc28-6682ae824154", "name": "network-vif-deleted", "tag": "5efeb5a3-cff9-410e-bd6a-591e1fce4666"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:07.841417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2eed5af4-cce0-4f8c-80c4-9f69d0631135 req-e9204f60-af84-448a-9f32-d2aba4f5c10b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:07.842153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2eed5af4-cce0-4f8c-80c4-9f69d0631135 req-e9204f60-af84-448a-9f32-d2aba4f5c10b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:07.858832 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2eed5af4-cce0-4f8c-80c4-9f69d0631135 req-e9204f60-af84-448a-9f32-d2aba4f5c10b service nova] Creating event network-vif-deleted:5efeb5a3-cff9-410e-bd6a-591e1fce4666 for instance 46c80442-0e57-4d48-bc28-6682ae824154 on n-h1-708768-8 Jul 26 19:48:07.866176 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2eed5af4-cce0-4f8c-80c4-9f69d0631135 req-e9204f60-af84-448a-9f32-d2aba4f5c10b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048971 Jul 26 19:48:07.868361 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 672/1405] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:48:07.969692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1591969386", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "a860ee43-605e-4277-9e3a-cdf5856dd542"}], "security_groups": [{"name": "tempest-securitygroup--634201528"}], "key_name": "tempest-keypair-311569242", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:08.434308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d944d974-a1f1-498e-8a0c-de932f62ddaf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:08.443447 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d944d974-a1f1-498e-8a0c-de932f62ddaf tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1323 microversion: 2.1 time: 0.869171 Jul 26 19:48:08.461084 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 734/1406] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:07 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1323 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:08.468454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4706a7e6-6a02-449a-a9a3-6d765a0ffe10 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:08.469283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4706a7e6-6a02-449a-a9a3-6d765a0ffe10 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:08.489295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4706a7e6-6a02-449a-a9a3-6d765a0ffe10 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:08.489766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4706a7e6-6a02-449a-a9a3-6d765a0ffe10 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:08.490554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4706a7e6-6a02-449a-a9a3-6d765a0ffe10 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:08.490988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4706a7e6-6a02-449a-a9a3-6d765a0ffe10 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:08.639332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] validate_networks() for [('a860ee43-605e-4277-9e3a-cdf5856dd542', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:48:08.747851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4706a7e6-6a02-449a-a9a3-6d765a0ffe10 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:08.768484 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4706a7e6-6a02-449a-a9a3-6d765a0ffe10 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1219 microversion: 2.1 time: 0.296666 Jul 26 19:48:08.768484 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 735/1407] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:08 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1219 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:09.471408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-da835249-3418-459b-94cf-605d12f628ef tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:09.472191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-da835249-3418-459b-94cf-605d12f628ef tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:09.484069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-da835249-3418-459b-94cf-605d12f628ef tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:09.484830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-da835249-3418-459b-94cf-605d12f628ef tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:09.485855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-da835249-3418-459b-94cf-605d12f628ef tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:09.486511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-da835249-3418-459b-94cf-605d12f628ef tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:09.639263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:48:09.639855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:48:09.640151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:48:09.640552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:48:09.640961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:48:09.658884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:09.659339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:09.660182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:09.660676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:09.698367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Getting quotas for project a12a08cdecac47df83d0fe375e823172. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:09.717168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Getting quotas for user 43416bcbb5a747628d0594cf62819331 and project a12a08cdecac47df83d0fe375e823172. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:09.740270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:48:09.742732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:48:09.882365 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dae83578-0bfa-4130-9537-93a7d6a75b9c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.916814 Jul 26 19:48:09.891889 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 673/1408] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:48:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:48:09.911688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-40c8901d-5bba-4b0f-8034-640e24190814 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:09.915414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40c8901d-5bba-4b0f-8034-640e24190814 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:09.935111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40c8901d-5bba-4b0f-8034-640e24190814 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:09.938137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40c8901d-5bba-4b0f-8034-640e24190814 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:09.939120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40c8901d-5bba-4b0f-8034-640e24190814 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:09.943491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40c8901d-5bba-4b0f-8034-640e24190814 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:10.123993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-40c8901d-5bba-4b0f-8034-640e24190814 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:10.141085 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-40c8901d-5bba-4b0f-8034-640e24190814 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1273 microversion: 2.1 time: 0.240237 Jul 26 19:48:10.142215 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 674/1409] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:09 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:10.183848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d92b5508-1f87-469e-89a5-9f8dfc1d9cef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:10.186729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d92b5508-1f87-469e-89a5-9f8dfc1d9cef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:10.430271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d92b5508-1f87-469e-89a5-9f8dfc1d9cef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:10.444459 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d92b5508-1f87-469e-89a5-9f8dfc1d9cef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1241 microversion: 2.1 time: 0.274390 Jul 26 19:48:10.461624 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 675/1410] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:10 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1241 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:10.954228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9a5728d5-e2ea-4dfd-9cf7-8c63c876105d req-11a1eb3b-4623-4f0f-af7c-662ca4189177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47c6943-f5c1-402e-b172-03d4c6d40c65", "name": "network-vif-plugged", "status": "completed", "tag": "781b40de-246f-4c4a-aa2b-9416c43e3b7a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:10.985631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9a5728d5-e2ea-4dfd-9cf7-8c63c876105d req-11a1eb3b-4623-4f0f-af7c-662ca4189177 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:10.997051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9a5728d5-e2ea-4dfd-9cf7-8c63c876105d req-11a1eb3b-4623-4f0f-af7c-662ca4189177 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:11.034445 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9a5728d5-e2ea-4dfd-9cf7-8c63c876105d req-11a1eb3b-4623-4f0f-af7c-662ca4189177 service nova] Creating event network-vif-plugged:781b40de-246f-4c4a-aa2b-9416c43e3b7a for instance d47c6943-f5c1-402e-b172-03d4c6d40c65 on n-h2-708768-8 Jul 26 19:48:11.056738 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9a5728d5-e2ea-4dfd-9cf7-8c63c876105d req-11a1eb3b-4623-4f0f-af7c-662ca4189177 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105700 Jul 26 19:48:11.062798 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 676/1411] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:11.173289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-da835249-3418-459b-94cf-605d12f628ef tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:11.183979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-775c870c-1432-4c3c-a5ed-6767bf616a9d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:11.185851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-775c870c-1432-4c3c-a5ed-6767bf616a9d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:11.199807 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-da835249-3418-459b-94cf-605d12f628ef tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1323 microversion: 2.1 time: 1.733774 Jul 26 19:48:11.215908 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 736/1412] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:09 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1323 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:11.219497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-775c870c-1432-4c3c-a5ed-6767bf616a9d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:11.220287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-775c870c-1432-4c3c-a5ed-6767bf616a9d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:11.222317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-775c870c-1432-4c3c-a5ed-6767bf616a9d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:11.226899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-775c870c-1432-4c3c-a5ed-6767bf616a9d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:11.467650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8061b120-f6c6-4995-b351-52f9bb459069 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:11.469049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8061b120-f6c6-4995-b351-52f9bb459069 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:11.480246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8061b120-f6c6-4995-b351-52f9bb459069 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:11.480693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8061b120-f6c6-4995-b351-52f9bb459069 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:11.486870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8061b120-f6c6-4995-b351-52f9bb459069 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:11.489309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8061b120-f6c6-4995-b351-52f9bb459069 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:11.631884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-775c870c-1432-4c3c-a5ed-6767bf616a9d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:11.651948 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-775c870c-1432-4c3c-a5ed-6767bf616a9d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1273 microversion: 2.1 time: 0.485570 Jul 26 19:48:11.653649 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 677/1413] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:11 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1273 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:11.976441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8061b120-f6c6-4995-b351-52f9bb459069 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:11.989513 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8061b120-f6c6-4995-b351-52f9bb459069 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1293 microversion: 2.1 time: 0.522711 Jul 26 19:48:11.990683 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 737/1414] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:11 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1293 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:12.243491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-294ff9b1-5bab-4713-97d4-a06778f93089 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:12.245025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-294ff9b1-5bab-4713-97d4-a06778f93089 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:12.256445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-294ff9b1-5bab-4713-97d4-a06778f93089 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:12.257660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-294ff9b1-5bab-4713-97d4-a06778f93089 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:12.259159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-294ff9b1-5bab-4713-97d4-a06778f93089 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:12.260080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-294ff9b1-5bab-4713-97d4-a06778f93089 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:12.674872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1727d07-6399-4a64-a30d-9c353c709e81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:12.675688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1727d07-6399-4a64-a30d-9c353c709e81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:12.696850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1727d07-6399-4a64-a30d-9c353c709e81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:12.696850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1727d07-6399-4a64-a30d-9c353c709e81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:12.696850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1727d07-6399-4a64-a30d-9c353c709e81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:12.696850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1727d07-6399-4a64-a30d-9c353c709e81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:12.767275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-294ff9b1-5bab-4713-97d4-a06778f93089 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:12.777866 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-294ff9b1-5bab-4713-97d4-a06778f93089 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1323 microversion: 2.1 time: 0.542040 Jul 26 19:48:12.793882 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 678/1415] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:12 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1323 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:12.894884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1727d07-6399-4a64-a30d-9c353c709e81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:12.907672 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1727d07-6399-4a64-a30d-9c353c709e81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1273 microversion: 2.1 time: 0.237136 Jul 26 19:48:12.919637 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 738/1416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:12 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:13.007486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d40235ac-f11b-4427-9f25-2a0449e17cfc req-176149c2-3fbc-497e-a761-7da27f344976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e", "tag": "4a26068f-b71e-4b1f-8e69-627fea99c7f2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:13.023097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d40235ac-f11b-4427-9f25-2a0449e17cfc req-176149c2-3fbc-497e-a761-7da27f344976 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:13.024711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d40235ac-f11b-4427-9f25-2a0449e17cfc req-176149c2-3fbc-497e-a761-7da27f344976 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:13.039075 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d40235ac-f11b-4427-9f25-2a0449e17cfc req-176149c2-3fbc-497e-a761-7da27f344976 service nova] Creating event network-changed:4a26068f-b71e-4b1f-8e69-627fea99c7f2 for instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e on n-h2-708768-8 Jul 26 19:48:13.045677 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d40235ac-f11b-4427-9f25-2a0449e17cfc req-176149c2-3fbc-497e-a761-7da27f344976 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047223 Jul 26 19:48:13.047403 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 739/1417] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:48:13.059552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3889692b-7b1f-4545-af8a-a8292524765f tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:13.060890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3889692b-7b1f-4545-af8a-a8292524765f tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:13.069306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:13.072762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3889692b-7b1f-4545-af8a-a8292524765f tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:13.073491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3889692b-7b1f-4545-af8a-a8292524765f tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:13.074820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3889692b-7b1f-4545-af8a-a8292524765f tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:13.075843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3889692b-7b1f-4545-af8a-a8292524765f tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:13.147890 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-59cd00a7-05af-4679-80fb-502a0266069c tempest-TenantUsagesNegativeTestJSON-378933415 tempest-TenantUsagesNegativeTestJSON-378933415-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-25T19%3A48%3A12.886538&end=2022-07-27T19%3A48%3A12.886538" status: 404 len: 112 microversion: - time: 0.255120 Jul 26 19:48:13.150205 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 679/1418] 10.222.0.58 () {58 vars in 1316 bytes} [Tue Jul 26 19:48:12 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-25T19%3A48%3A12.886538&end=2022-07-27T19%3A48%3A12.886538 => generated 112 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 19:48:13.169099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44730a75-c26a-4815-92ae-a3df95827280 tempest-TenantUsagesNegativeTestJSON-378933415 tempest-TenantUsagesNegativeTestJSON-378933415-project-admin] Calling method '.version_select at 0x7f8756e04b80>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:13.174809 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-44730a75-c26a-4815-92ae-a3df95827280 tempest-TenantUsagesNegativeTestJSON-378933415 tempest-TenantUsagesNegativeTestJSON-378933415-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44730a75-c26a-4815-92ae-a3df95827280 tempest-TenantUsagesNegativeTestJSON-378933415 tempest-TenantUsagesNegativeTestJSON-378933415-project-admin] Request method failure captured: Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-simple-tenant-usage/069bb6bd25da406083ec243416d4c4f4?start=2022-07-27T19%3A48%3A12.886538&end=2022-07-25T19%3A48%3A12.886538 HTTP/1.1 Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ET8FOwOD1kH3KBisb2IuZAVI919yw6PFWwm4B6C4YwDHvjB5gMpfOnYgRUlU06COMZRANb-4aZE7WzaeRvevAYMliGm8qddJ0dVxfeowrSZdlmMRQE1UVMoblQ_SrCtf_tnJzEWDbdiPiKp__OXj67A_OYGIb7LveIXr0feJX4u1hM Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 863cd63ecbcd492b9d50becc6691f21d Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-378933415 Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/863cd63ecbcd492b9d50becc6691f21d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/863cd63ecbcd492b9d50becc6691f21d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_863cd63ecbcd492b9d50becc6691f21d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/863cd63ecbcd492b9d50becc6691f21d"}]}] Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-378933415 Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 863cd63ecbcd492b9d50becc6691f21d Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-378933415 Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TenantUsagesNegativeTestJSON-378933415-project-admin Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5143d2f81ea42f7ae8e3698aaee9603 Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-378933415-project-admin Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid start time. The start time cannot occur after the end time. Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '069bb6bd25da406083ec243416d4c4f4'} Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 26 19:48:13.183220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:13.190769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44730a75-c26a-4815-92ae-a3df95827280 tempest-TenantUsagesNegativeTestJSON-378933415 tempest-TenantUsagesNegativeTestJSON-378933415-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:13.190769 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44730a75-c26a-4815-92ae-a3df95827280 tempest-TenantUsagesNegativeTestJSON-378933415 tempest-TenantUsagesNegativeTestJSON-378933415-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/069bb6bd25da406083ec243416d4c4f4?start=2022-07-27T19%3A48%3A12.886538&end=2022-07-25T19%3A48%3A12.886538" status: 400 len: 111 microversion: 2.1 time: 0.027728 Jul 26 19:48:13.190769 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 680/1419] 10.222.0.58 () {58 vars in 1412 bytes} [Tue Jul 26 19:48:13 2022] GET /compute/v2.1/os-simple-tenant-usage/069bb6bd25da406083ec243416d4c4f4?start=2022-07-27T19%3A48%3A12.886538&end=2022-07-25T19%3A48%3A12.886538 => generated 111 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:48:13.310901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3889692b-7b1f-4545-af8a-a8292524765f tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:13.328424 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3889692b-7b1f-4545-af8a-a8292524765f tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1299 microversion: 2.1 time: 0.278326 Jul 26 19:48:13.331998 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 740/1420] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:13 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:13.416677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36f2fd5d-e9ca-44f5-bc85-731aafb55a32 tempest-TenantUsagesNegativeTestJSON-2133408742 tempest-TenantUsagesNegativeTestJSON-2133408742-project] Calling method '.version_select at 0x7f8756e42d30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:13.420886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-36f2fd5d-e9ca-44f5-bc85-731aafb55a32 tempest-TenantUsagesNegativeTestJSON-2133408742 tempest-TenantUsagesNegativeTestJSON-2133408742-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'dca3aa118db74e11b0efa91a7d420f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069bb6bd25da406083ec243416d4c4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36f2fd5d-e9ca-44f5-bc85-731aafb55a32 tempest-TenantUsagesNegativeTestJSON-2133408742 tempest-TenantUsagesNegativeTestJSON-2133408742-project] Request method failure captured: Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T19%3A48%3A12.886538&end=2022-07-27T19%3A48%3A12.886538&detailed=1 HTTP/1.1 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ET8kZMPJ8mVSJ2SokgZoU3ws5nn8uv5WVY4c5wPz-1pVj2cAMIO6iOIaLQSWOp9fbUCtYJI4SIRMborY6ODHcPdeH6hpRORgfKJ-DkSHYZi-_txVrvp-HLKo8hTGSV4ofwNeXJNAiWrMcWaTnYw8NujUtOwnrj-5k-b8gRMZS5I_Xg Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 069bb6bd25da406083ec243416d4c4f4 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2133408742 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/069bb6bd25da406083ec243416d4c4f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/069bb6bd25da406083ec243416d4c4f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_069bb6bd25da406083ec243416d4c4f4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/069bb6bd25da406083ec243416d4c4f4"}]}] Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2133408742 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 069bb6bd25da406083ec243416d4c4f4 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2133408742 Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TenantUsagesNegativeTestJSON-2133408742-project Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: dca3aa118db74e11b0efa91a7d420f6e Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2133408742-project Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: action_args: {} Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 19:48:13.423086 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 19:48:13.429335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:13.430877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36f2fd5d-e9ca-44f5-bc85-731aafb55a32 tempest-TenantUsagesNegativeTestJSON-2133408742 tempest-TenantUsagesNegativeTestJSON-2133408742-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:13.432152 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36f2fd5d-e9ca-44f5-bc85-731aafb55a32 tempest-TenantUsagesNegativeTestJSON-2133408742 tempest-TenantUsagesNegativeTestJSON-2133408742-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T19%3A48%3A12.886538&end=2022-07-27T19%3A48%3A12.886538&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.239021 Jul 26 19:48:13.433457 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 681/1421] 10.222.0.58 () {58 vars in 1335 bytes} [Tue Jul 26 19:48:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T19%3A48%3A12.886538&end=2022-07-27T19%3A48%3A12.886538&detailed=1 => generated 123 bytes in 241 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:48:13.800601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-06014019-8ad7-4a81-89f4-27a4dc429b82 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:13.801248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-06014019-8ad7-4a81-89f4-27a4dc429b82 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:13.815592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06014019-8ad7-4a81-89f4-27a4dc429b82 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:13.816074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06014019-8ad7-4a81-89f4-27a4dc429b82 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:13.816970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06014019-8ad7-4a81-89f4-27a4dc429b82 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:13.817533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06014019-8ad7-4a81-89f4-27a4dc429b82 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:13.934494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0a54ebe-2e62-4d9c-908a-c19bf7f9ccf2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:13.936237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0a54ebe-2e62-4d9c-908a-c19bf7f9ccf2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:13.946984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a54ebe-2e62-4d9c-908a-c19bf7f9ccf2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:13.951729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a54ebe-2e62-4d9c-908a-c19bf7f9ccf2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:13.954778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a54ebe-2e62-4d9c-908a-c19bf7f9ccf2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:13.955586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a54ebe-2e62-4d9c-908a-c19bf7f9ccf2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:14.372587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-06014019-8ad7-4a81-89f4-27a4dc429b82 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:14.382928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0a54ebe-2e62-4d9c-908a-c19bf7f9ccf2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:14.388290 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-06014019-8ad7-4a81-89f4-27a4dc429b82 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1520 microversion: 2.1 time: 0.591601 Jul 26 19:48:14.390830 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 741/1422] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:13 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1520 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:14.393223 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0a54ebe-2e62-4d9c-908a-c19bf7f9ccf2 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.462548 Jul 26 19:48:14.396601 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 682/1423] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:13 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:14.398220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9de8f928-7c94-43ab-9b2d-36041d3f6f07 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:14.399045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9de8f928-7c94-43ab-9b2d-36041d3f6f07 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:14.419011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c28a74a6-21d9-4b3e-af6b-8ec2d2e47ab6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:14.420962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c28a74a6-21d9-4b3e-af6b-8ec2d2e47ab6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:14.430296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9de8f928-7c94-43ab-9b2d-36041d3f6f07 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:14.430760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9de8f928-7c94-43ab-9b2d-36041d3f6f07 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:14.431558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9de8f928-7c94-43ab-9b2d-36041d3f6f07 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:14.432293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9de8f928-7c94-43ab-9b2d-36041d3f6f07 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:14.442916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c28a74a6-21d9-4b3e-af6b-8ec2d2e47ab6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:14.443583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c28a74a6-21d9-4b3e-af6b-8ec2d2e47ab6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:14.447643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c28a74a6-21d9-4b3e-af6b-8ec2d2e47ab6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:14.448749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c28a74a6-21d9-4b3e-af6b-8ec2d2e47ab6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:14.512681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c28a74a6-21d9-4b3e-af6b-8ec2d2e47ab6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:48:14.622580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9de8f928-7c94-43ab-9b2d-36041d3f6f07 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:14.657786 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9de8f928-7c94-43ab-9b2d-36041d3f6f07 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1299 microversion: 2.1 time: 0.265567 Jul 26 19:48:14.663105 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 742/1424] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:14 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:14.754593 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c28a74a6-21d9-4b3e-af6b-8ec2d2e47ab6 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 204 len: 0 microversion: 2.1 time: 0.339152 Jul 26 19:48:14.759351 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 683/1425] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:48:14 2022] DELETE /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:48:14.767165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03ba0219-fcde-4cc3-96be-ef056f550708 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:14.768665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03ba0219-fcde-4cc3-96be-ef056f550708 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:14.780538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03ba0219-fcde-4cc3-96be-ef056f550708 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:14.782742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03ba0219-fcde-4cc3-96be-ef056f550708 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:14.794916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03ba0219-fcde-4cc3-96be-ef056f550708 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:14.797612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03ba0219-fcde-4cc3-96be-ef056f550708 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:15.422466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e9ad0602-7094-4099-9a5c-dce7a0394eea tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:15.422466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e9ad0602-7094-4099-9a5c-dce7a0394eea tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:15.434638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9ad0602-7094-4099-9a5c-dce7a0394eea tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:15.435555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9ad0602-7094-4099-9a5c-dce7a0394eea tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:15.446998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9ad0602-7094-4099-9a5c-dce7a0394eea tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:15.447585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9ad0602-7094-4099-9a5c-dce7a0394eea tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:15.760173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e9ad0602-7094-4099-9a5c-dce7a0394eea tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:15.772057 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e9ad0602-7094-4099-9a5c-dce7a0394eea tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.356022 Jul 26 19:48:15.790268 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 684/1426] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:15 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:15.795886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4cda624d-4354-4b43-a675-a2d03163c94d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:15.796695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4cda624d-4354-4b43-a675-a2d03163c94d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:15.805660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cda624d-4354-4b43-a675-a2d03163c94d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:15.806405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cda624d-4354-4b43-a675-a2d03163c94d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:15.807485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cda624d-4354-4b43-a675-a2d03163c94d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:15.808140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cda624d-4354-4b43-a675-a2d03163c94d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:15.953438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03ba0219-fcde-4cc3-96be-ef056f550708 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:15.969895 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03ba0219-fcde-4cc3-96be-ef056f550708 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1526 microversion: 2.1 time: 1.206587 Jul 26 19:48:15.972752 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 743/1427] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:14 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1526 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:15.989897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4cda624d-4354-4b43-a675-a2d03163c94d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:16.010090 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4cda624d-4354-4b43-a675-a2d03163c94d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.218405 Jul 26 19:48:16.023104 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 685/1428] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:15 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:16.416224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-950986664", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:16.482992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:48:16.794954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-490a7efd-623b-44c6-9f41-f57c0645469a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:16.795648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-490a7efd-623b-44c6-9f41-f57c0645469a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:16.808132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-490a7efd-623b-44c6-9f41-f57c0645469a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:16.808788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-490a7efd-623b-44c6-9f41-f57c0645469a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:16.809771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-490a7efd-623b-44c6-9f41-f57c0645469a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:16.810219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-490a7efd-623b-44c6-9f41-f57c0645469a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.065536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-490a7efd-623b-44c6-9f41-f57c0645469a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:17.077182 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-490a7efd-623b-44c6-9f41-f57c0645469a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.286262 Jul 26 19:48:17.078231 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 686/1429] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:16 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:17.100239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-953c739e-39ab-494b-acb9-edd362d86559 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:17.100876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-953c739e-39ab-494b-acb9-edd362d86559 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:17.109187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-953c739e-39ab-494b-acb9-edd362d86559 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.109677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-953c739e-39ab-494b-acb9-edd362d86559 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.110571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-953c739e-39ab-494b-acb9-edd362d86559 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.111022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-953c739e-39ab-494b-acb9-edd362d86559 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.305494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-953c739e-39ab-494b-acb9-edd362d86559 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:17.315015 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-953c739e-39ab-494b-acb9-edd362d86559 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1526 microversion: 2.1 time: 0.235120 Jul 26 19:48:17.315533 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 687/1430] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:17 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1526 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:17.327837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f474275e-6234-4f4c-8074-950e44591205 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:17.327837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f474275e-6234-4f4c-8074-950e44591205 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:17.330222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f474275e-6234-4f4c-8074-950e44591205 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.330764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f474275e-6234-4f4c-8074-950e44591205 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.331879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f474275e-6234-4f4c-8074-950e44591205 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.332945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f474275e-6234-4f4c-8074-950e44591205 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.467004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:48:17.469587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:48:17.471299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:48:17.472023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:48:17.472600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:48:17.502990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.503727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.506017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.506624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.549357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Getting quotas for project 5918d79bd422403c9e8998747935af6c. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:17.565941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Getting quotas for user 949c58249f22473e9956be855557b0b2 and project 5918d79bd422403c9e8998747935af6c. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:17.589637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:48:17.593863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:48:17.615044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f474275e-6234-4f4c-8074-950e44591205 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:17.627328 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f474275e-6234-4f4c-8074-950e44591205 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.310561 Jul 26 19:48:17.630542 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 688/1431] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:17 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:17.710009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-801544ac-4987-4baf-81e3-fc0161e8ea68 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.734631 Jul 26 19:48:17.712511 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 744/1432] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:48:17.747639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de4108b2-76c1-4809-ab44-3ece65bd8815 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:17.748320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de4108b2-76c1-4809-ab44-3ece65bd8815 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:17.933857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-de4108b2-76c1-4809-ab44-3ece65bd8815 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:17.944912 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de4108b2-76c1-4809-ab44-3ece65bd8815 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1216 microversion: 2.1 time: 0.221444 Jul 26 19:48:17.946479 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 745/1433] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:17 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1216 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:17.949534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44ed3da0-bfdf-4d69-8f22-5b3d520b6c06 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Calling method '.version_select at 0x7f8756e028b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:17.950926 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:48:17.950926 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:48:17.952693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44ed3da0-bfdf-4d69-8f22-5b3d520b6c06 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.953284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44ed3da0-bfdf-4d69-8f22-5b3d520b6c06 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.972404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44ed3da0-bfdf-4d69-8f22-5b3d520b6c06 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.973510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44ed3da0-bfdf-4d69-8f22-5b3d520b6c06 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:17.986874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44ed3da0-bfdf-4d69-8f22-5b3d520b6c06 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:17.987758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44ed3da0-bfdf-4d69-8f22-5b3d520b6c06 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.000447 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44ed3da0-bfdf-4d69-8f22-5b3d520b6c06 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.367087 Jul 26 19:48:18.001302 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 689/1434] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 19:48:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:48:18.013024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-268bf521-3f9e-41fb-a986-e44ececb12a7 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Calling method '.version_select at 0x7f875f06d430>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:18.013913 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:48:18.013913 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:48:18.015091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-268bf521-3f9e-41fb-a986-e44ececb12a7 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.015538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-268bf521-3f9e-41fb-a986-e44ececb12a7 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.056931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-268bf521-3f9e-41fb-a986-e44ececb12a7 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.058900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-268bf521-3f9e-41fb-a986-e44ececb12a7 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.072073 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-268bf521-3f9e-41fb-a986-e44ececb12a7 tempest-HypervisorAdminV228Test-265665980 tempest-HypervisorAdminV228Test-265665980-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.063316 Jul 26 19:48:18.074016 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 746/1435] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jul 26 19:48:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:48:18.099227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3b09b078-9ae2-4b43-b3be-8d99e63b539f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:18.099909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3b09b078-9ae2-4b43-b3be-8d99e63b539f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:18.115716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b09b078-9ae2-4b43-b3be-8d99e63b539f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.116799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b09b078-9ae2-4b43-b3be-8d99e63b539f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.118809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b09b078-9ae2-4b43-b3be-8d99e63b539f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.119448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b09b078-9ae2-4b43-b3be-8d99e63b539f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.157888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:18.337486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-27236895-b7d0-4a8b-9577-9e759a35a3be tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:18.338117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-27236895-b7d0-4a8b-9577-9e759a35a3be tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:18.353116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27236895-b7d0-4a8b-9577-9e759a35a3be tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.354200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27236895-b7d0-4a8b-9577-9e759a35a3be tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.356367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27236895-b7d0-4a8b-9577-9e759a35a3be tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.363014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3b09b078-9ae2-4b43-b3be-8d99e63b539f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:18.379537 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3b09b078-9ae2-4b43-b3be-8d99e63b539f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.284704 Jul 26 19:48:18.380671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27236895-b7d0-4a8b-9577-9e759a35a3be tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.385376 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 690/1436] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:18 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:18.410096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9fbbb1cc-6e85-460e-86f3-ab7da6ba19bc req-5b49ac61-7b97-4670-91d5-8f4de3af94e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7534f20c-a2cf-46f8-b462-33387eb39e2b", "tag": "fc42c6ee-dc12-444c-bb1e-7889950036ef"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:18.464767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9fbbb1cc-6e85-460e-86f3-ab7da6ba19bc req-5b49ac61-7b97-4670-91d5-8f4de3af94e1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.465225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9fbbb1cc-6e85-460e-86f3-ab7da6ba19bc req-5b49ac61-7b97-4670-91d5-8f4de3af94e1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.511269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9fbbb1cc-6e85-460e-86f3-ab7da6ba19bc req-5b49ac61-7b97-4670-91d5-8f4de3af94e1 service nova] Creating event network-changed:fc42c6ee-dc12-444c-bb1e-7889950036ef for instance 7534f20c-a2cf-46f8-b462-33387eb39e2b on n-h1-708768-8 Jul 26 19:48:18.521478 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9fbbb1cc-6e85-460e-86f3-ab7da6ba19bc req-5b49ac61-7b97-4670-91d5-8f4de3af94e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127723 Jul 26 19:48:18.522384 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 691/1437] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:18.653232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3942f8cd-b5f8-45fb-99de-fde8e70d38cf tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:18.653946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3942f8cd-b5f8-45fb-99de-fde8e70d38cf tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:18.662690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3942f8cd-b5f8-45fb-99de-fde8e70d38cf tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.663134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3942f8cd-b5f8-45fb-99de-fde8e70d38cf tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:18.664499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3942f8cd-b5f8-45fb-99de-fde8e70d38cf tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:18.667467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3942f8cd-b5f8-45fb-99de-fde8e70d38cf tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:19.157350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3942f8cd-b5f8-45fb-99de-fde8e70d38cf tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:19.175037 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3942f8cd-b5f8-45fb-99de-fde8e70d38cf tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.527315 Jul 26 19:48:19.175681 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 692/1438] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:18 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:19.181389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff6f745c-5072-4f20-b54b-ac2adee5ee3a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.181999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff6f745c-5072-4f20-b54b-ac2adee5ee3a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:19.199438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff6f745c-5072-4f20-b54b-ac2adee5ee3a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:19.199919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff6f745c-5072-4f20-b54b-ac2adee5ee3a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:19.200713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff6f745c-5072-4f20-b54b-ac2adee5ee3a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:19.201145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff6f745c-5072-4f20-b54b-ac2adee5ee3a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:19.218570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-27236895-b7d0-4a8b-9577-9e759a35a3be tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb1eb1903e84b65bbaf60a89f626f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bfe22d09cc4c7fba9cceb0b6532fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:19.229207 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-27236895-b7d0-4a8b-9577-9e759a35a3be tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 200 len: 1526 microversion: 2.1 time: 0.896793 Jul 26 19:48:19.232063 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 747/1439] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:18 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 1526 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:19.419067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff6f745c-5072-4f20-b54b-ac2adee5ee3a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:19.437907 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff6f745c-5072-4f20-b54b-ac2adee5ee3a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1268 microversion: 2.1 time: 0.259357 Jul 26 19:48:19.440434 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 693/1440] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1268 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:19.455148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5d643a3-1bb4-44e6-95da-c461b21e18fb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.456063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5d643a3-1bb4-44e6-95da-c461b21e18fb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:19.479367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5d643a3-1bb4-44e6-95da-c461b21e18fb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:19.482067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5d643a3-1bb4-44e6-95da-c461b21e18fb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:19.482983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5d643a3-1bb4-44e6-95da-c461b21e18fb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:19.486499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5d643a3-1bb4-44e6-95da-c461b21e18fb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:19.499334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4b557881-3ab2-4c3c-aa7c-d122f6e9e843 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.512973 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4b557881-3ab2-4c3c-aa7c-d122f6e9e843 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.279541 Jul 26 19:48:19.514609 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 748/1441] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:19.531532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30abd177-00e5-4730-95f9-dfeb25ca296c tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.575905 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-30abd177-00e5-4730-95f9-dfeb25ca296c tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.051404 Jul 26 19:48:19.583699 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 749/1442] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:19.593142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a61abf0a-a51b-4c9d-b53b-40170bae12d0 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.603348 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a61abf0a-a51b-4c9d-b53b-40170bae12d0 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015327 Jul 26 19:48:19.604598 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 750/1443] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:48:19.620220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd821130-f0a5-4139-bf14-9f246f4f77c2 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.629399 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bd821130-f0a5-4139-bf14-9f246f4f77c2 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015096 Jul 26 19:48:19.630485 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 751/1444] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:19.642329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1df85cf7-13c5-422f-a3ab-f21d2a8dfec1 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.674086 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1df85cf7-13c5-422f-a3ab-f21d2a8dfec1 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.035378 Jul 26 19:48:19.675299 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 752/1445] 10.222.0.58 () {58 vars in 1165 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:19.682081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:19.693041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-554db14d-4694-4615-8c76-7bccda547bc4 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.701923 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-554db14d-4694-4615-8c76-7bccda547bc4 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013341 Jul 26 19:48:19.710240 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 753/1446] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:48:19.721754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e38d5c95-99c8-4fa8-8a0a-3728a4120002 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.748351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e38d5c95-99c8-4fa8-8a0a-3728a4120002 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.036353 Jul 26 19:48:19.759412 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 754/1447] 10.222.0.58 () {58 vars in 1169 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:19.765946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ddbc3611-fa39-4c07-8d19-362b3a1f2dfc tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.782924 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ddbc3611-fa39-4c07-8d19-362b3a1f2dfc tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021484 Jul 26 19:48:19.783515 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 755/1448] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:19.799202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3385b81e-59f9-458a-bd7d-4e9a20a5bd7f tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.821057 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3385b81e-59f9-458a-bd7d-4e9a20a5bd7f tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024927 Jul 26 19:48:19.821875 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 756/1449] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:19.845755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-679b6f92-56d7-4fbc-94f0-914cdfdc0f8e tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.854156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d5d643a3-1bb4-44e6-95da-c461b21e18fb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:19.865923 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5d643a3-1bb4-44e6-95da-c461b21e18fb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.422126 Jul 26 19:48:19.867040 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 694/1450] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:19.932822 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-679b6f92-56d7-4fbc-94f0-914cdfdc0f8e tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.097736 Jul 26 19:48:19.933268 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 757/1451] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:19.950393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5cf5f991-ffd8-49d5-8eec-578bd3ebb2a3 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:19.959646 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5cf5f991-ffd8-49d5-8eec-578bd3ebb2a3 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013342 Jul 26 19:48:19.960555 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 695/1452] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:19.972795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-276f2c99-0938-4b03-9f7f-679a0a582938 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.006008 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-276f2c99-0938-4b03-9f7f-679a0a582938 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.037407 Jul 26 19:48:20.006613 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 758/1453] 10.222.0.58 () {58 vars in 1144 bytes} [Tue Jul 26 19:48:19 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:20.025132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc4d769f-32df-45d8-af5b-f07193d2c590 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.037000 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc4d769f-32df-45d8-af5b-f07193d2c590 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019631 Jul 26 19:48:20.037669 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 696/1454] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:20.053294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bf2253f-ec5a-4b39-8df7-47d530193f04 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.090500 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0bf2253f-ec5a-4b39-8df7-47d530193f04 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.043362 Jul 26 19:48:20.091512 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 759/1455] 10.222.0.58 () {58 vars in 1148 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:20.108322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f768e231-faef-40ff-a5c6-65dbaa4e8caf tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.125355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f768e231-faef-40ff-a5c6-65dbaa4e8caf tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.021711 Jul 26 19:48:20.135149 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 697/1456] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:20.141754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1b78b0ab-c4cf-47e4-93ea-e38dbb1c8d8b tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.164626 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1b78b0ab-c4cf-47e4-93ea-e38dbb1c8d8b tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028180 Jul 26 19:48:20.165563 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 760/1457] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:20.178722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b26553f1-d8ef-4cc6-a9ff-63bf9213e812 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.200092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3279ba61-cc79-4096-8a63-29e0e52bd946 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.200759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3279ba61-cc79-4096-8a63-29e0e52bd946 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:20.219731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3279ba61-cc79-4096-8a63-29e0e52bd946 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.220685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3279ba61-cc79-4096-8a63-29e0e52bd946 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.221494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3279ba61-cc79-4096-8a63-29e0e52bd946 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.226484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3279ba61-cc79-4096-8a63-29e0e52bd946 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.282018 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b26553f1-d8ef-4cc6-a9ff-63bf9213e812 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.107391 Jul 26 19:48:20.297333 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 698/1458] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:20.315452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.318172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d47c6943-f5c1-402e-b172-03d4c6d40c65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:20.329004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.333672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.335151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.335866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.368270 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Instance d47c6943-f5c1-402e-b172-03d4c6d40c65 could not be found. Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 HTTP/1.1 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance d47c6943-f5c1-402e-b172-03d4c6d40c65 could not be found. Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd47c6943-f5c1-402e-b172-03d4c6d40c65'} Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47c6943-f5c1-402e-b172-03d4c6d40c65 could not be found. Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47c6943-f5c1-402e-b172-03d4c6d40c65 could not be found. Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.374911 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47c6943-f5c1-402e-b172-03d4c6d40c65 could not be found. Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Instance d47c6943-f5c1-402e-b172-03d4c6d40c65 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b79154e-7970-4d54-8b97-cdc055de4e77 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65" status: 404 len: 111 microversion: 2.1 time: 0.076632 Jul 26 19:48:20.381241 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 699/1459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/servers/d47c6943-f5c1-402e-b172-03d4c6d40c65 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:20.391125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d0bbaff-d401-4609-879e-5ee1a53e0a4a tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.431338 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d0bbaff-d401-4609-879e-5ee1a53e0a4a tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050304 Jul 26 19:48:20.442822 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 700/1460] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:20.447759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc45f49c-13e7-4e8a-9364-703094fb3952 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '.version_select at 0x7f8756e884c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.466215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=26 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:20.484930 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-fc45f49c-13e7-4e8a-9364-703094fb3952 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Image not found. Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc45f49c-13e7-4e8a-9364-703094fb3952 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/images/0c61c4dd-a87f-4575-a2ad-133caff6e279 HTTP/1.1 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: exception: Image not found. Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '0c61c4dd-a87f-4575-a2ad-133caff6e279'} Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0c61c4dd-a87f-4575-a2ad-133caff6e279 to delete Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c61c4dd-a87f-4575-a2ad-133caff6e279 could not be found. Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:20.487163 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc45f49c-13e7-4e8a-9364-703094fb3952 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Image not found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc45f49c-13e7-4e8a-9364-703094fb3952 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/images/0c61c4dd-a87f-4575-a2ad-133caff6e279" status: 404 len: 62 microversion: 2.1 time: 0.044781 Jul 26 19:48:20.496489 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 701/1461] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:20 2022] DELETE /compute/v2.1/images/0c61c4dd-a87f-4575-a2ad-133caff6e279 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:48:20.500686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7b06bff-9e8b-47db-b12f-30706c34ad85 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.507803 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f7b06bff-9e8b-47db-b12f-30706c34ad85 tempest-FlavorsV2TestJSON-2028532042 tempest-FlavorsV2TestJSON-2028532042-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013503 Jul 26 19:48:20.508695 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 702/1462] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:20.513624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f04744fe-2394-4454-8af1-e7b38a97b907 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.514233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f04744fe-2394-4454-8af1-e7b38a97b907 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:20.522220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f04744fe-2394-4454-8af1-e7b38a97b907 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.522686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f04744fe-2394-4454-8af1-e7b38a97b907 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.523477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f04744fe-2394-4454-8af1-e7b38a97b907 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.523998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f04744fe-2394-4454-8af1-e7b38a97b907 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.657621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f04744fe-2394-4454-8af1-e7b38a97b907 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:20.683337 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f04744fe-2394-4454-8af1-e7b38a97b907 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1274 microversion: 2.1 time: 0.167734 Jul 26 19:48:20.687565 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 703/1463] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:20.700965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.701531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:20.722478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.727227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.729870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.730352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.778706 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e HTTP/1.1 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd4d3b0f0-e8fa-4d5c-9156-5b440407583e'} Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:20.781657 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:20.787654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b95fc89-62b3-45d2-8b8f-4771bfa5c1e4 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 404 len: 111 microversion: 2.1 time: 0.094769 Jul 26 19:48:20.791014 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 704/1464] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:48:20 2022] DELETE /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:20.795688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a75119c4-51c9-4d00-ab3f-bc7b7b7ba938 req-3022ed63-f083-4848-b1c6-67b04bf31126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e", "name": "network-vif-plugged", "status": "completed", "tag": "4a26068f-b71e-4b1f-8e69-627fea99c7f2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:20.808716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a75119c4-51c9-4d00-ab3f-bc7b7b7ba938 req-3022ed63-f083-4848-b1c6-67b04bf31126 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.810708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a75119c4-51c9-4d00-ab3f-bc7b7b7ba938 req-3022ed63-f083-4848-b1c6-67b04bf31126 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.829671 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a75119c4-51c9-4d00-ab3f-bc7b7b7ba938 req-3022ed63-f083-4848-b1c6-67b04bf31126 service nova] Creating event network-vif-plugged:4a26068f-b71e-4b1f-8e69-627fea99c7f2 for instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e on n-h2-708768-8 Jul 26 19:48:20.835746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a75119c4-51c9-4d00-ab3f-bc7b7b7ba938 req-3022ed63-f083-4848-b1c6-67b04bf31126 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043525 Jul 26 19:48:20.836852 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 705/1465] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:20.867859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3279ba61-cc79-4096-8a63-29e0e52bd946 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:20.876982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3279ba61-cc79-4096-8a63-29e0e52bd946 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.682940 Jul 26 19:48:20.890431 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 761/1466] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:20.929613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:20.933770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: d4d3b0f0-e8fa-4d5c-9156-5b440407583e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:20.949815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.951918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.955005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:20.956069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:20.978520 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e HTTP/1.1 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'd4d3b0f0-e8fa-4d5c-9156-5b440407583e'} Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:20.996744 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Instance d4d3b0f0-e8fa-4d5c-9156-5b440407583e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5860c43c-aa98-491f-aa99-eb4e6e50cdaa tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e" status: 404 len: 111 microversion: 2.1 time: 0.091038 Jul 26 19:48:21.001829 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 762/1467] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/servers/d4d3b0f0-e8fa-4d5c-9156-5b440407583e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:21.006678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7f744ada-9179-4acb-bde5-621958203398 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:21.007300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7f744ada-9179-4acb-bde5-621958203398 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:21.018770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f744ada-9179-4acb-bde5-621958203398 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:21.019222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f744ada-9179-4acb-bde5-621958203398 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:21.020596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f744ada-9179-4acb-bde5-621958203398 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:21.042272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f744ada-9179-4acb-bde5-621958203398 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:21.103178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-62152149-3927-4473-bb79-d315d2958753 req-b03f3292-0296-40bb-9fac-ee5e8c5df5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a882035e-ffcb-4327-8443-26bc7f4d9bca", "tag": "9ef206a7-38f6-4551-896a-8ab1a4ef7370"}, {"server_uuid": "d47c6943-f5c1-402e-b172-03d4c6d40c65", "name": "network-vif-deleted", "tag": "781b40de-246f-4c4a-aa2b-9416c43e3b7a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:21.115248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-62152149-3927-4473-bb79-d315d2958753 req-b03f3292-0296-40bb-9fac-ee5e8c5df5e9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:21.115865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-62152149-3927-4473-bb79-d315d2958753 req-b03f3292-0296-40bb-9fac-ee5e8c5df5e9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:21.131966 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-62152149-3927-4473-bb79-d315d2958753 req-b03f3292-0296-40bb-9fac-ee5e8c5df5e9 service nova] Creating event network-changed:9ef206a7-38f6-4551-896a-8ab1a4ef7370 for instance a882035e-ffcb-4327-8443-26bc7f4d9bca on n-h1-708768-8 Jul 26 19:48:21.132583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-62152149-3927-4473-bb79-d315d2958753 req-b03f3292-0296-40bb-9fac-ee5e8c5df5e9 service nova] Creating event network-vif-deleted:781b40de-246f-4c4a-aa2b-9416c43e3b7a for instance d47c6943-f5c1-402e-b172-03d4c6d40c65 on n-h2-708768-8 Jul 26 19:48:21.151147 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-62152149-3927-4473-bb79-d315d2958753 req-b03f3292-0296-40bb-9fac-ee5e8c5df5e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.311524 Jul 26 19:48:21.153220 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 706/1468] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:21.170730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e2883aee-f36e-447f-a8be-e6ac992a3261 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '.version_select at 0x7f8756e049d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:21.195159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:21.209583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e2883aee-f36e-447f-a8be-e6ac992a3261 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823063453" status: 202 len: 0 microversion: 2.1 time: 0.053846 Jul 26 19:48:21.211095 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 707/1469] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823063453 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:48:21.661426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7f744ada-9179-4acb-bde5-621958203398 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:21.679035 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7f744ada-9179-4acb-bde5-621958203398 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.679114 Jul 26 19:48:21.680292 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 763/1470] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:20 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:21.708914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68a6ba06-edab-4408-9c09-4435a10a0fc3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:21.709660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68a6ba06-edab-4408-9c09-4435a10a0fc3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:21.716642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68a6ba06-edab-4408-9c09-4435a10a0fc3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:21.717090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68a6ba06-edab-4408-9c09-4435a10a0fc3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:21.717875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68a6ba06-edab-4408-9c09-4435a10a0fc3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:21.718336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68a6ba06-edab-4408-9c09-4435a10a0fc3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:21.840934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68a6ba06-edab-4408-9c09-4435a10a0fc3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:21.849618 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68a6ba06-edab-4408-9c09-4435a10a0fc3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1274 microversion: 2.1 time: 0.145518 Jul 26 19:48:21.864058 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 708/1471] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:21 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:21.913923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0b46a448-9783-4509-9238-db05dfbabc00 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:21.920185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0b46a448-9783-4509-9238-db05dfbabc00 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:21.928066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b46a448-9783-4509-9238-db05dfbabc00 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:21.928555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b46a448-9783-4509-9238-db05dfbabc00 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:21.929467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b46a448-9783-4509-9238-db05dfbabc00 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:21.929945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b46a448-9783-4509-9238-db05dfbabc00 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:22.305678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b46a448-9783-4509-9238-db05dfbabc00 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:22.322346 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0b46a448-9783-4509-9238-db05dfbabc00 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.413685 Jul 26 19:48:22.322939 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 764/1472] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:21 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:22.701858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d50f9066-4bff-4cb9-b089-655f798a60cb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:22.703832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d50f9066-4bff-4cb9-b089-655f798a60cb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:22.723547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d50f9066-4bff-4cb9-b089-655f798a60cb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:22.730777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d50f9066-4bff-4cb9-b089-655f798a60cb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:22.732787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d50f9066-4bff-4cb9-b089-655f798a60cb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:22.734704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d50f9066-4bff-4cb9-b089-655f798a60cb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:22.870999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-27e12465-261c-4520-abe1-40cf2886aac0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:22.873603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-27e12465-261c-4520-abe1-40cf2886aac0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:22.901205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27e12465-261c-4520-abe1-40cf2886aac0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:22.901866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27e12465-261c-4520-abe1-40cf2886aac0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:22.903004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27e12465-261c-4520-abe1-40cf2886aac0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:22.903630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27e12465-261c-4520-abe1-40cf2886aac0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:23.270883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d50f9066-4bff-4cb9-b089-655f798a60cb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:23.279705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d50f9066-4bff-4cb9-b089-655f798a60cb tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.581785 Jul 26 19:48:23.285146 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 709/1473] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:22 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:23.345817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-687f0fc7-1190-4952-9436-fd0bf1542676 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:23.346720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-687f0fc7-1190-4952-9436-fd0bf1542676 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:23.359563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-687f0fc7-1190-4952-9436-fd0bf1542676 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:23.362937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-687f0fc7-1190-4952-9436-fd0bf1542676 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:23.364682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-687f0fc7-1190-4952-9436-fd0bf1542676 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:23.366858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-687f0fc7-1190-4952-9436-fd0bf1542676 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:23.657432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-687f0fc7-1190-4952-9436-fd0bf1542676 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:23.667790 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-687f0fc7-1190-4952-9436-fd0bf1542676 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.325961 Jul 26 19:48:23.674369 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 710/1474] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:23 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:24.264365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-27e12465-261c-4520-abe1-40cf2886aac0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:24.268398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:24.279700 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-27e12465-261c-4520-abe1-40cf2886aac0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 1.412486 Jul 26 19:48:24.280912 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 765/1475] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:22 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:24.305841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7c4682c9-6af7-4137-9a7b-b57dfa4bb964 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:24.306892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7c4682c9-6af7-4137-9a7b-b57dfa4bb964 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:24.329413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c4682c9-6af7-4137-9a7b-b57dfa4bb964 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:24.331260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c4682c9-6af7-4137-9a7b-b57dfa4bb964 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:24.334388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c4682c9-6af7-4137-9a7b-b57dfa4bb964 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:24.334863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c4682c9-6af7-4137-9a7b-b57dfa4bb964 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:24.695958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-72e04d26-9500-481a-820b-90d2f3d678bd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:24.696664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-72e04d26-9500-481a-820b-90d2f3d678bd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:24.709063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72e04d26-9500-481a-820b-90d2f3d678bd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:24.709803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72e04d26-9500-481a-820b-90d2f3d678bd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:24.713033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72e04d26-9500-481a-820b-90d2f3d678bd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:24.713662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72e04d26-9500-481a-820b-90d2f3d678bd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:25.069962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7c4682c9-6af7-4137-9a7b-b57dfa4bb964 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:25.080024 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7c4682c9-6af7-4137-9a7b-b57dfa4bb964 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.781087 Jul 26 19:48:25.080916 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 711/1476] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:24 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:25.302398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3979ccff-4759-4e4c-9185-07e263f97517 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:25.303534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3979ccff-4759-4e4c-9185-07e263f97517 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:25.322700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3979ccff-4759-4e4c-9185-07e263f97517 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:25.323290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3979ccff-4759-4e4c-9185-07e263f97517 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:25.325137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3979ccff-4759-4e4c-9185-07e263f97517 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:25.325597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3979ccff-4759-4e4c-9185-07e263f97517 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:25.447305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-72e04d26-9500-481a-820b-90d2f3d678bd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:25.460022 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-72e04d26-9500-481a-820b-90d2f3d678bd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.769475 Jul 26 19:48:25.460612 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 766/1477] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:24 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:25.471267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc825974-463d-4e5b-aa23-054119205215 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '.version_select at 0x7f875f12b550>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:25.512074 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cc825974-463d-4e5b-aa23-054119205215 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Image not found. Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc825974-463d-4e5b-aa23-054119205215 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/683da6a3-921f-4858-b8f4-357a478c2498 HTTP/1.1 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '683da6a3-921f-4858-b8f4-357a478c2498'} Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 683da6a3-921f-4858-b8f4-357a478c2498 to delete Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 683da6a3-921f-4858-b8f4-357a478c2498 could not be found. Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:25.514346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:48:25.519228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.525061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc825974-463d-4e5b-aa23-054119205215 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:25.526121 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc825974-463d-4e5b-aa23-054119205215 tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/images/683da6a3-921f-4858-b8f4-357a478c2498" status: 404 len: 62 microversion: 2.1 time: 0.064420 Jul 26 19:48:25.532799 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 767/1478] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:25 2022] DELETE /compute/v2.1/images/683da6a3-921f-4858-b8f4-357a478c2498 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:48:25.541494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:25.542155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:25.549688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:25.550375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:25.552811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:25.553424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:25.568677 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 HTTP/1.1 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f91a2c0b-cbe3-4c61-ae77-6878c69fd643'} Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:25.570761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.575279 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.576957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:25.577969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31ec6a2a-4622-4bc2-b3dd-2d0525cf275c tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 404 len: 111 microversion: 2.1 time: 0.041061 Jul 26 19:48:25.579478 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 768/1479] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:48:25 2022] DELETE /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:48:25.589160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:25.590028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] [instance: f91a2c0b-cbe3-4c61-ae77-6878c69fd643] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:25.597300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:25.597999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:25.599194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:25.599847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:25.615517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] HTTP exception thrown: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Request method failure captured: Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 HTTP/1.1 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESS0BgYDbZkr2Uw8xtXo78axLi-yKoqpZ9lkxkQQ6EJr2A-XO0KXA2WyHoPyxDSfxSlAZF33Kz6FiY0xGlgIdCiC4KpLxl2zlMFbst38Nh1GilVhYEjtoxmpUEzfdDA_xWlRK8ijVoB-DeRZqWZTha7sG7_uBIhzRXNiTjO_G9Bris Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20bfe22d09cc4c7fba9cceb0b6532fc0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20bfe22d09cc4c7fba9cceb0b6532fc0"}]}] Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 20bfe22d09cc4c7fba9cceb0b6532fc0 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6cb1eb1903e84b65bbaf60a89f626f47 Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577805360-project Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f91a2c0b-cbe3-4c61-ae77-6878c69fd643'} Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.617391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:25.621961 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.621961 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:25.621961 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:25.621961 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:25.621961 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:25.621961 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:25.621961 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. Jul 26 19:48:25.621961 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:48:25.623674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] Returning 404 to user: Instance f91a2c0b-cbe3-4c61-ae77-6878c69fd643 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:25.624715 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b2c4240b-ddae-4799-a2a5-f42ea670fb6f tempest-ImagesOneServerNegativeTestJSON-1577805360 tempest-ImagesOneServerNegativeTestJSON-1577805360-project] 10.222.0.58 "GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643" status: 404 len: 111 microversion: 2.1 time: 0.039927 Jul 26 19:48:25.628571 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 769/1480] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:25 2022] GET /compute/v2.1/servers/f91a2c0b-cbe3-4c61-ae77-6878c69fd643 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:26.048193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-cc938da5-30e1-406b-96d0-0376be79a507 req-3ee966a7-0a16-40b5-bc9c-2fec0086ec3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e", "name": "network-vif-deleted", "tag": "4a26068f-b71e-4b1f-8e69-627fea99c7f2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:26.088459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cc938da5-30e1-406b-96d0-0376be79a507 req-3ee966a7-0a16-40b5-bc9c-2fec0086ec3d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:26.088912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cc938da5-30e1-406b-96d0-0376be79a507 req-3ee966a7-0a16-40b5-bc9c-2fec0086ec3d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:26.098786 n-d-708768-8 devstack@n-api.service[125963]: /opt/stack/nova/nova/db/main/api.py:1842: SAWarning: Multiple rows returned with uselist=False for eagerly-loaded attribute 'Instance.extra' Jul 26 19:48:26.098786 n-d-708768-8 devstack@n-api.service[125963]: instances = query_prefix.all() Jul 26 19:48:26.102314 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-cc938da5-30e1-406b-96d0-0376be79a507 req-3ee966a7-0a16-40b5-bc9c-2fec0086ec3d service nova] Creating event network-vif-deleted:4a26068f-b71e-4b1f-8e69-627fea99c7f2 for instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e on n-h2-708768-8 Jul 26 19:48:26.113691 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-cc938da5-30e1-406b-96d0-0376be79a507 req-3ee966a7-0a16-40b5-bc9c-2fec0086ec3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071681 Jul 26 19:48:26.123189 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 770/1481] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:26.147294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5ba8efc-0c54-470e-b127-d726f974b6c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:26.148817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a5ba8efc-0c54-470e-b127-d726f974b6c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:26.182992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5ba8efc-0c54-470e-b127-d726f974b6c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:26.186851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5ba8efc-0c54-470e-b127-d726f974b6c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:26.188478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5ba8efc-0c54-470e-b127-d726f974b6c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:26.194679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5ba8efc-0c54-470e-b127-d726f974b6c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:26.276897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3979ccff-4759-4e4c-9185-07e263f97517 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:26.294616 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3979ccff-4759-4e4c-9185-07e263f97517 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 0.996326 Jul 26 19:48:26.299691 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 712/1482] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:25 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:26.483351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-067e72ef-d7a5-4480-96cd-c76c9ed203d0 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:26.486844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-067e72ef-d7a5-4480-96cd-c76c9ed203d0 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:26.495242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-067e72ef-d7a5-4480-96cd-c76c9ed203d0 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:26.496137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-067e72ef-d7a5-4480-96cd-c76c9ed203d0 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:26.497256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-067e72ef-d7a5-4480-96cd-c76c9ed203d0 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:26.497933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-067e72ef-d7a5-4480-96cd-c76c9ed203d0 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:26.536675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a5ba8efc-0c54-470e-b127-d726f974b6c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:26.549233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5ba8efc-0c54-470e-b127-d726f974b6c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.424094 Jul 26 19:48:26.562632 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 771/1483] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:26 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:27.281580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-067e72ef-d7a5-4480-96cd-c76c9ed203d0 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:27.290735 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-067e72ef-d7a5-4480-96cd-c76c9ed203d0 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.812688 Jul 26 19:48:27.291509 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 713/1484] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:26 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:27.320892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7825f67a-b685-4b41-b548-2e1d484a73bf tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:27.321528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7825f67a-b685-4b41-b548-2e1d484a73bf tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:27.329733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7825f67a-b685-4b41-b548-2e1d484a73bf tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:27.330182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7825f67a-b685-4b41-b548-2e1d484a73bf tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:27.330968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7825f67a-b685-4b41-b548-2e1d484a73bf tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:27.331412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7825f67a-b685-4b41-b548-2e1d484a73bf tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:27.445559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-75c7f748-3587-48c7-9d71-fcc10b6e2421 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:27.447843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-75c7f748-3587-48c7-9d71-fcc10b6e2421 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:27.454735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75c7f748-3587-48c7-9d71-fcc10b6e2421 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:27.455489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75c7f748-3587-48c7-9d71-fcc10b6e2421 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:27.456913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75c7f748-3587-48c7-9d71-fcc10b6e2421 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:27.458180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75c7f748-3587-48c7-9d71-fcc10b6e2421 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:27.497909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7825f67a-b685-4b41-b548-2e1d484a73bf tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:27.514403 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7825f67a-b685-4b41-b548-2e1d484a73bf tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 0.198141 Jul 26 19:48:27.527866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 772/1485] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:27 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:27.571390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7bbb88df-a732-49de-9260-2422add11949 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:27.572053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7bbb88df-a732-49de-9260-2422add11949 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:27.574040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:27.579905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bbb88df-a732-49de-9260-2422add11949 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:27.580359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bbb88df-a732-49de-9260-2422add11949 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:27.581134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bbb88df-a732-49de-9260-2422add11949 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:27.581671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bbb88df-a732-49de-9260-2422add11949 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:27.731946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7bbb88df-a732-49de-9260-2422add11949 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:27.740371 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7bbb88df-a732-49de-9260-2422add11949 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.173844 Jul 26 19:48:27.741563 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 773/1486] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:27 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:27.986980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-75c7f748-3587-48c7-9d71-fcc10b6e2421 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 3f39e3c9-d789-460b-a36b-c5b9e3527888 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:48:28.018025 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-75c7f748-3587-48c7-9d71-fcc10b6e2421 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 2342 microversion: 2.25 time: 0.577668 Jul 26 19:48:28.018623 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 714/1487] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:48:27 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 2342 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:48:28.044955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf0ab4cc-1529-4e45-97df-0253e9e85b7c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:28.047938 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:48:28.047938 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:48:28.050195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf0ab4cc-1529-4e45-97df-0253e9e85b7c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.050806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf0ab4cc-1529-4e45-97df-0253e9e85b7c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:28.052330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf0ab4cc-1529-4e45-97df-0253e9e85b7c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.052893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf0ab4cc-1529-4e45-97df-0253e9e85b7c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:28.054068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:28.117702 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf0ab4cc-1529-4e45-97df-0253e9e85b7c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.075383 Jul 26 19:48:28.124862 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 774/1488] 10.222.0.58 () {60 vars in 1217 bytes} [Tue Jul 26 19:48:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:48:28.314508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2346ceee-7f4a-4a3c-af6a-163cd56b0230 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:28.315155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2346ceee-7f4a-4a3c-af6a-163cd56b0230 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:28.328950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2346ceee-7f4a-4a3c-af6a-163cd56b0230 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.329410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2346ceee-7f4a-4a3c-af6a-163cd56b0230 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:28.336046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2346ceee-7f4a-4a3c-af6a-163cd56b0230 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.336572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2346ceee-7f4a-4a3c-af6a-163cd56b0230 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:28.435641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-436d1bd6-5600-4d64-915e-01110c78479c req-7d3516dd-a6f3-4f62-9b01-ddfba75520ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df01792-8d3a-4b9b-b786-3e1fa006643f", "tag": "09a7781d-402a-4e6c-a8a1-86b9d590132c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:28.455603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-436d1bd6-5600-4d64-915e-01110c78479c req-7d3516dd-a6f3-4f62-9b01-ddfba75520ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.456386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-436d1bd6-5600-4d64-915e-01110c78479c req-7d3516dd-a6f3-4f62-9b01-ddfba75520ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:28.484617 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-436d1bd6-5600-4d64-915e-01110c78479c req-7d3516dd-a6f3-4f62-9b01-ddfba75520ca service nova] Creating event network-changed:09a7781d-402a-4e6c-a8a1-86b9d590132c for instance 7df01792-8d3a-4b9b-b786-3e1fa006643f on n-h2-708768-8 Jul 26 19:48:28.502471 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-436d1bd6-5600-4d64-915e-01110c78479c req-7d3516dd-a6f3-4f62-9b01-ddfba75520ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070863 Jul 26 19:48:28.504363 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 775/1489] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:28.537310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1f0a619-cb79-4af7-8a69-c597ad9cee78 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:28.538008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1f0a619-cb79-4af7-8a69-c597ad9cee78 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:28.555492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1f0a619-cb79-4af7-8a69-c597ad9cee78 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.556205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1f0a619-cb79-4af7-8a69-c597ad9cee78 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:28.557215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1f0a619-cb79-4af7-8a69-c597ad9cee78 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.557798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1f0a619-cb79-4af7-8a69-c597ad9cee78 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:28.939146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2346ceee-7f4a-4a3c-af6a-163cd56b0230 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:28.959667 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2346ceee-7f4a-4a3c-af6a-163cd56b0230 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.642086 Jul 26 19:48:28.960863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 715/1490] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:28 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:28.975139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-72b1a5b1-d3de-4540-85ae-12e5f249c013 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:28.976311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-72b1a5b1-d3de-4540-85ae-12e5f249c013 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:28.985895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72b1a5b1-d3de-4540-85ae-12e5f249c013 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.986839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72b1a5b1-d3de-4540-85ae-12e5f249c013 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:28.987891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72b1a5b1-d3de-4540-85ae-12e5f249c013 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:28.989789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72b1a5b1-d3de-4540-85ae-12e5f249c013 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:29.389747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-72b1a5b1-d3de-4540-85ae-12e5f249c013 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:29.401683 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-72b1a5b1-d3de-4540-85ae-12e5f249c013 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.439481 Jul 26 19:48:29.403950 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 716/1491] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:28 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:29.419684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4874a8a8-540a-42da-8b5a-b1b145f1ad75 req-e1fea8e6-8532-4a75-9b45-58b668bf0a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a882035e-ffcb-4327-8443-26bc7f4d9bca", "name": "network-vif-plugged", "status": "completed", "tag": "9ef206a7-38f6-4551-896a-8ab1a4ef7370"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:29.442347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4874a8a8-540a-42da-8b5a-b1b145f1ad75 req-e1fea8e6-8532-4a75-9b45-58b668bf0a7c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:29.443238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4874a8a8-540a-42da-8b5a-b1b145f1ad75 req-e1fea8e6-8532-4a75-9b45-58b668bf0a7c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:29.461175 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4874a8a8-540a-42da-8b5a-b1b145f1ad75 req-e1fea8e6-8532-4a75-9b45-58b668bf0a7c service nova] Creating event network-vif-plugged:9ef206a7-38f6-4551-896a-8ab1a4ef7370 for instance a882035e-ffcb-4327-8443-26bc7f4d9bca on n-h1-708768-8 Jul 26 19:48:29.487262 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4874a8a8-540a-42da-8b5a-b1b145f1ad75 req-e1fea8e6-8532-4a75-9b45-58b668bf0a7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081794 Jul 26 19:48:29.487964 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 717/1492] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:29.989585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-35d1f5e9-b3e6-4058-9dee-17f448c370da tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:29.990307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-35d1f5e9-b3e6-4058-9dee-17f448c370da tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:30.013577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35d1f5e9-b3e6-4058-9dee-17f448c370da tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:30.020536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35d1f5e9-b3e6-4058-9dee-17f448c370da tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:30.021504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35d1f5e9-b3e6-4058-9dee-17f448c370da tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:30.021975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35d1f5e9-b3e6-4058-9dee-17f448c370da tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:30.461099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1f0a619-cb79-4af7-8a69-c597ad9cee78 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:30.477977 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1f0a619-cb79-4af7-8a69-c597ad9cee78 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 1.945187 Jul 26 19:48:30.478920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 776/1493] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:28 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:30.484079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3fddfa52-03ce-47d7-9889-bcc9e90574bf tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:30.484907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3fddfa52-03ce-47d7-9889-bcc9e90574bf tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:30.499552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fddfa52-03ce-47d7-9889-bcc9e90574bf tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:30.500243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fddfa52-03ce-47d7-9889-bcc9e90574bf tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:30.501187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fddfa52-03ce-47d7-9889-bcc9e90574bf tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:30.501781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fddfa52-03ce-47d7-9889-bcc9e90574bf tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:30.863118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-35d1f5e9-b3e6-4058-9dee-17f448c370da tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:30.869071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:30.877345 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-35d1f5e9-b3e6-4058-9dee-17f448c370da tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1366 microversion: 2.1 time: 0.893576 Jul 26 19:48:30.878241 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 718/1494] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:29 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1366 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:31.033356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-32917032-0c9e-447c-9dd5-c6c6b25322f9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74ba3437-1a23-4cea-a433-87736ea06c80", "device": "/dev/xvdb"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:31.037793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-32917032-0c9e-447c-9dd5-c6c6b25322f9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:31.050602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32917032-0c9e-447c-9dd5-c6c6b25322f9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:31.051998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32917032-0c9e-447c-9dd5-c6c6b25322f9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:31.053388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32917032-0c9e-447c-9dd5-c6c6b25322f9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:31.054076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32917032-0c9e-447c-9dd5-c6c6b25322f9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:31.129387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3fddfa52-03ce-47d7-9889-bcc9e90574bf tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:31.138100 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3fddfa52-03ce-47d7-9889-bcc9e90574bf tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.657706 Jul 26 19:48:31.154621 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 777/1495] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:30 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:31.672678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2030288600", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "50f2dfa9-34b9-455e-8977-8a3ecc98c855"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:31.715507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-32917032-0c9e-447c-9dd5-c6c6b25322f9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "POST /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.686231 Jul 26 19:48:31.718676 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 719/1496] 10.222.0.58 () {62 vars in 1364 bytes} [Tue Jul 26 19:48:31 2022] POST /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:48:31.737487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e679c67d-c567-4af7-8988-88598e20a100 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:31.739746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e679c67d-c567-4af7-8988-88598e20a100 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:31.756143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e679c67d-c567-4af7-8988-88598e20a100 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:31.767266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e679c67d-c567-4af7-8988-88598e20a100 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:31.770176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e679c67d-c567-4af7-8988-88598e20a100 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:31.771067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e679c67d-c567-4af7-8988-88598e20a100 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:31.814262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] validate_networks() for [('50f2dfa9-34b9-455e-8977-8a3ecc98c855', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:48:32.125339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e679c67d-c567-4af7-8988-88598e20a100 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:32.140156 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e679c67d-c567-4af7-8988-88598e20a100 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 0.417807 Jul 26 19:48:32.140774 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 720/1497] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:31 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:32.159736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fccc349a-2839-47d7-a6c6-670709dc7cc8 req-0651e804-e381-49b4-9ae4-9ccbccf3c510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7534f20c-a2cf-46f8-b462-33387eb39e2b", "name": "network-vif-plugged", "status": "completed", "tag": "fc42c6ee-dc12-444c-bb1e-7889950036ef"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:32.189634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fccc349a-2839-47d7-a6c6-670709dc7cc8 req-0651e804-e381-49b4-9ae4-9ccbccf3c510 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:32.191380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fccc349a-2839-47d7-a6c6-670709dc7cc8 req-0651e804-e381-49b4-9ae4-9ccbccf3c510 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:32.220870 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fccc349a-2839-47d7-a6c6-670709dc7cc8 req-0651e804-e381-49b4-9ae4-9ccbccf3c510 service nova] Creating event network-vif-plugged:fc42c6ee-dc12-444c-bb1e-7889950036ef for instance 7534f20c-a2cf-46f8-b462-33387eb39e2b on n-h1-708768-8 Jul 26 19:48:32.237521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fccc349a-2839-47d7-a6c6-670709dc7cc8 req-0651e804-e381-49b4-9ae4-9ccbccf3c510 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091774 Jul 26 19:48:32.239084 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 721/1498] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:32.253460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1fccf8b3-17a4-4da7-a493-14f04800aeef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:32.257654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1fccf8b3-17a4-4da7-a493-14f04800aeef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:32.285978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fccf8b3-17a4-4da7-a493-14f04800aeef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:32.287800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fccf8b3-17a4-4da7-a493-14f04800aeef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:32.288863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fccf8b3-17a4-4da7-a493-14f04800aeef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:32.289312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fccf8b3-17a4-4da7-a493-14f04800aeef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:32.601355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1fccf8b3-17a4-4da7-a493-14f04800aeef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:32.615543 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1fccf8b3-17a4-4da7-a493-14f04800aeef tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1555 microversion: 2.1 time: 0.373067 Jul 26 19:48:32.619025 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 722/1499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:32 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1555 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:32.638383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d42e5360-e366-4cbb-88a4-d27f6550d84f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:32.639555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d42e5360-e366-4cbb-88a4-d27f6550d84f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:32.656756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d42e5360-e366-4cbb-88a4-d27f6550d84f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:32.658963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d42e5360-e366-4cbb-88a4-d27f6550d84f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:32.660142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d42e5360-e366-4cbb-88a4-d27f6550d84f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:32.661418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d42e5360-e366-4cbb-88a4-d27f6550d84f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:32.893593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d42e5360-e366-4cbb-88a4-d27f6550d84f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:32.904791 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d42e5360-e366-4cbb-88a4-d27f6550d84f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 0.282022 Jul 26 19:48:32.906910 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 723/1500] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:32 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:32.913881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-beff2755-efd3-4d6b-965b-73c2ee165015 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:32.917737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-beff2755-efd3-4d6b-965b-73c2ee165015 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:32.933946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-beff2755-efd3-4d6b-965b-73c2ee165015 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:32.936564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-beff2755-efd3-4d6b-965b-73c2ee165015 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:32.937394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-beff2755-efd3-4d6b-965b-73c2ee165015 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:32.937859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-beff2755-efd3-4d6b-965b-73c2ee165015 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:33.093962 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-beff2755-efd3-4d6b-965b-73c2ee165015 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185205 Jul 26 19:48:33.097384 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 724/1501] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:48:32 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:33.166400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8aaf5cd6-8204-4904-adff-1250637f182a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:33.167051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8aaf5cd6-8204-4904-adff-1250637f182a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:33.188155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8aaf5cd6-8204-4904-adff-1250637f182a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:33.188609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8aaf5cd6-8204-4904-adff-1250637f182a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:33.193810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8aaf5cd6-8204-4904-adff-1250637f182a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:33.194518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8aaf5cd6-8204-4904-adff-1250637f182a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:33.750877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8aaf5cd6-8204-4904-adff-1250637f182a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:33.760279 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8aaf5cd6-8204-4904-adff-1250637f182a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 0.598526 Jul 26 19:48:33.764454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 725/1502] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:33 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:33.931723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4eff3cff-205d-49c8-8d30-e4ff51f51807 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:33.932358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4eff3cff-205d-49c8-8d30-e4ff51f51807 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:33.941561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eff3cff-205d-49c8-8d30-e4ff51f51807 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:33.942320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eff3cff-205d-49c8-8d30-e4ff51f51807 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:33.943126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eff3cff-205d-49c8-8d30-e4ff51f51807 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:33.943567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eff3cff-205d-49c8-8d30-e4ff51f51807 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:34.316549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:48:34.317588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:48:34.317992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:48:34.318602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:48:34.319197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:48:34.341896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:34.342669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:34.344532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:34.347487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:34.396472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Getting quotas for project e5a0c6b8a5804e0ab6af55c5ee740e21. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:34.406911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Getting quotas for user 8c9e3f3572674c1380d3eca3d4c5e58c and project e5a0c6b8a5804e0ab6af55c5ee740e21. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:34.419378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:34.447496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Going to run 2 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:48:34.450240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 295b3c66-74b3-4bdf-a567-45f39227ae6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:48:34.541366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=295b3c66-74b3-4bdf-a567-45f39227ae6d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:48:34.655503 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7831bc1c-ebc4-4814-b751-f78911c41eca tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.428972 Jul 26 19:48:34.668852 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 778/1503] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:48:34.679829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ff51cd54-0281-44ec-ab9d-c0279071e265 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:34.685700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ff51cd54-0281-44ec-ab9d-c0279071e265 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:34.686665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ff51cd54-0281-44ec-ab9d-c0279071e265 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Searching by: {'deleted': False, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:48:34.710847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff51cd54-0281-44ec-ab9d-c0279071e265 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:34.711433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff51cd54-0281-44ec-ab9d-c0279071e265 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:34.712389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff51cd54-0281-44ec-ab9d-c0279071e265 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:34.712926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff51cd54-0281-44ec-ab9d-c0279071e265 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:34.736351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ff51cd54-0281-44ec-ab9d-c0279071e265 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.061000 Jul 26 19:48:34.737983 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 779/1504] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 19:48:34 2022] GET /compute/v2.1/servers => generated 677 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:34.749908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-afa7ec3c-d0ba-4f06-98ad-3aa7d6924e20 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:34.750516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-afa7ec3c-d0ba-4f06-98ad-3aa7d6924e20 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:34.858502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-afa7ec3c-d0ba-4f06-98ad-3aa7d6924e20 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:34.872722 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-afa7ec3c-d0ba-4f06-98ad-3aa7d6924e20 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1220 microversion: 2.1 time: 0.122861 Jul 26 19:48:34.875656 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 780/1505] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:34 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:34.894691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb14b593-785a-4a16-bc34-6ec58d49f711 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:34.900985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fb14b593-785a-4a16-bc34-6ec58d49f711 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:34.935702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb14b593-785a-4a16-bc34-6ec58d49f711 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:34.940841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4eff3cff-205d-49c8-8d30-e4ff51f51807 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:34.952024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb14b593-785a-4a16-bc34-6ec58d49f711 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:34.955314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb14b593-785a-4a16-bc34-6ec58d49f711 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:34.960576 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4eff3cff-205d-49c8-8d30-e4ff51f51807 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1315 microversion: 2.1 time: 1.033046 Jul 26 19:48:34.961477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb14b593-785a-4a16-bc34-6ec58d49f711 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:34.965211 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 726/1506] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:33 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1315 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:35.562421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fb14b593-785a-4a16-bc34-6ec58d49f711 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:35.578018 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fb14b593-785a-4a16-bc34-6ec58d49f711 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 0.700853 Jul 26 19:48:35.578998 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 781/1507] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:34 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:35.902337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-301ce2f5-f57d-4013-9d87-f26a335145ae tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:35.903830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-301ce2f5-f57d-4013-9d87-f26a335145ae tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:35.987386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57de99aa-6500-457b-9f67-89a9dfc70409 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:35.989076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-57de99aa-6500-457b-9f67-89a9dfc70409 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:36.000056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57de99aa-6500-457b-9f67-89a9dfc70409 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:36.000871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57de99aa-6500-457b-9f67-89a9dfc70409 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:36.003948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57de99aa-6500-457b-9f67-89a9dfc70409 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:36.005439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57de99aa-6500-457b-9f67-89a9dfc70409 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:36.149412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-301ce2f5-f57d-4013-9d87-f26a335145ae tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:36.159811 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-301ce2f5-f57d-4013-9d87-f26a335145ae tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1220 microversion: 2.1 time: 0.262202 Jul 26 19:48:36.160780 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 727/1508] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:35 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1220 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:36.557305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-8ec03c21-f455-4927-8317-8fbd67e15c02 req-d1a2c1c0-eb3c-46ed-b096-0bb439c50cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a882035e-ffcb-4327-8443-26bc7f4d9bca", "tag": "9ef206a7-38f6-4551-896a-8ab1a4ef7370"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:36.570575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8ec03c21-f455-4927-8317-8fbd67e15c02 req-d1a2c1c0-eb3c-46ed-b096-0bb439c50cb3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:36.579488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8ec03c21-f455-4927-8317-8fbd67e15c02 req-d1a2c1c0-eb3c-46ed-b096-0bb439c50cb3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:36.625355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-8ec03c21-f455-4927-8317-8fbd67e15c02 req-d1a2c1c0-eb3c-46ed-b096-0bb439c50cb3 service nova] Creating event network-changed:9ef206a7-38f6-4551-896a-8ab1a4ef7370 for instance a882035e-ffcb-4327-8443-26bc7f4d9bca on n-h1-708768-8 Jul 26 19:48:36.645624 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-8ec03c21-f455-4927-8317-8fbd67e15c02 req-d1a2c1c0-eb3c-46ed-b096-0bb439c50cb3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371769 Jul 26 19:48:36.661433 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 728/1509] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:36.667492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee3303f4-4de7-4713-a6f8-233d85103340 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:36.668432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ee3303f4-4de7-4713-a6f8-233d85103340 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:36.686561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee3303f4-4de7-4713-a6f8-233d85103340 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:36.687214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee3303f4-4de7-4713-a6f8-233d85103340 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:36.688238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee3303f4-4de7-4713-a6f8-233d85103340 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:36.689118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee3303f4-4de7-4713-a6f8-233d85103340 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:37.067789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ee3303f4-4de7-4713-a6f8-233d85103340 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:37.085690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ee3303f4-4de7-4713-a6f8-233d85103340 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 0.422271 Jul 26 19:48:37.087774 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 729/1510] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:36 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:37.181135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6deed7aa-4d94-4dc5-8472-2f38481134de tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:37.186842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6deed7aa-4d94-4dc5-8472-2f38481134de tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:37.205016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6deed7aa-4d94-4dc5-8472-2f38481134de tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:37.205877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6deed7aa-4d94-4dc5-8472-2f38481134de tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:37.206874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6deed7aa-4d94-4dc5-8472-2f38481134de tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:37.209565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6deed7aa-4d94-4dc5-8472-2f38481134de tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:37.356451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6deed7aa-4d94-4dc5-8472-2f38481134de tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:37.366071 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6deed7aa-4d94-4dc5-8472-2f38481134de tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1278 microversion: 2.1 time: 0.188692 Jul 26 19:48:37.366654 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 730/1511] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:37 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:37.870521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ef1af9be-007b-411c-a2c6-4261be5eac18 req-58bcfb2f-bfea-49ab-909e-82305812b49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df01792-8d3a-4b9b-b786-3e1fa006643f", "name": "network-vif-plugged", "status": "completed", "tag": "09a7781d-402a-4e6c-a8a1-86b9d590132c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:37.884558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ef1af9be-007b-411c-a2c6-4261be5eac18 req-58bcfb2f-bfea-49ab-909e-82305812b49a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:37.885360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ef1af9be-007b-411c-a2c6-4261be5eac18 req-58bcfb2f-bfea-49ab-909e-82305812b49a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:37.933442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-57de99aa-6500-457b-9f67-89a9dfc70409 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:37.936037 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ef1af9be-007b-411c-a2c6-4261be5eac18 req-58bcfb2f-bfea-49ab-909e-82305812b49a service nova] Creating event network-vif-plugged:09a7781d-402a-4e6c-a8a1-86b9d590132c for instance 7df01792-8d3a-4b9b-b786-3e1fa006643f on n-h2-708768-8 Jul 26 19:48:37.943435 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ef1af9be-007b-411c-a2c6-4261be5eac18 req-58bcfb2f-bfea-49ab-909e-82305812b49a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220647 Jul 26 19:48:37.944903 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 731/1512] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:48:37.960126 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-57de99aa-6500-457b-9f67-89a9dfc70409 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1502 microversion: 2.1 time: 1.969112 Jul 26 19:48:37.961345 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 782/1513] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:35 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1502 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:37.983353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fbb3a91f-57f1-4ee0-a6a7-04904f4722e8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:37.983957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fbb3a91f-57f1-4ee0-a6a7-04904f4722e8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:37.996263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fbb3a91f-57f1-4ee0-a6a7-04904f4722e8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:38.000765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fbb3a91f-57f1-4ee0-a6a7-04904f4722e8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:38.001881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fbb3a91f-57f1-4ee0-a6a7-04904f4722e8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:38.002496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fbb3a91f-57f1-4ee0-a6a7-04904f4722e8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:38.111548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6390e668-0ea2-4623-a744-8bab73239d60 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:38.113130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6390e668-0ea2-4623-a744-8bab73239d60 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:38.143339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6390e668-0ea2-4623-a744-8bab73239d60 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:38.152732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6390e668-0ea2-4623-a744-8bab73239d60 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:38.155536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6390e668-0ea2-4623-a744-8bab73239d60 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:38.158739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6390e668-0ea2-4623-a744-8bab73239d60 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:38.229582 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fbb3a91f-57f1-4ee0-a6a7-04904f4722e8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b/action" status: 202 len: 0 microversion: 2.1 time: 0.250551 Jul 26 19:48:38.234003 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 732/1514] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:48:37 2022] POST /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:48:38.248460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-69f30500-b705-45bc-9041-f4a83d94b230 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:38.252466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-69f30500-b705-45bc-9041-f4a83d94b230 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:38.267145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69f30500-b705-45bc-9041-f4a83d94b230 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:38.269151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69f30500-b705-45bc-9041-f4a83d94b230 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:38.273921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69f30500-b705-45bc-9041-f4a83d94b230 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:38.274863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69f30500-b705-45bc-9041-f4a83d94b230 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:38.556522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-69f30500-b705-45bc-9041-f4a83d94b230 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:38.593348 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-69f30500-b705-45bc-9041-f4a83d94b230 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1507 microversion: 2.1 time: 0.357699 Jul 26 19:48:38.595530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 733/1515] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:38 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:38.614138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3992f078-54a6-4085-b13e-d16494506592 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:38.615004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3992f078-54a6-4085-b13e-d16494506592 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:38.623077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3992f078-54a6-4085-b13e-d16494506592 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:38.628352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3992f078-54a6-4085-b13e-d16494506592 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:38.629966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3992f078-54a6-4085-b13e-d16494506592 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:38.630971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3992f078-54a6-4085-b13e-d16494506592 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:38.754701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3992f078-54a6-4085-b13e-d16494506592 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:38.765112 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3992f078-54a6-4085-b13e-d16494506592 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1278 microversion: 2.1 time: 0.154513 Jul 26 19:48:38.791434 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 734/1516] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:38 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:39.454402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6390e668-0ea2-4623-a744-8bab73239d60 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:39.478236 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6390e668-0ea2-4623-a744-8bab73239d60 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1316 microversion: 2.1 time: 1.369663 Jul 26 19:48:39.480392 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 783/1517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:38 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1316 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:39.625894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4447cb1b-d4f2-442c-89fb-bb92afb6c2a4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:39.627573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4447cb1b-d4f2-442c-89fb-bb92afb6c2a4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:39.674609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4447cb1b-d4f2-442c-89fb-bb92afb6c2a4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:39.676928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4447cb1b-d4f2-442c-89fb-bb92afb6c2a4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:39.680752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4447cb1b-d4f2-442c-89fb-bb92afb6c2a4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:39.681262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4447cb1b-d4f2-442c-89fb-bb92afb6c2a4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:39.792736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c211d99-6bcc-4793-ad85-f8b5b80dd0fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:39.793359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3c211d99-6bcc-4793-ad85-f8b5b80dd0fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:39.805423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c211d99-6bcc-4793-ad85-f8b5b80dd0fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:39.805878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c211d99-6bcc-4793-ad85-f8b5b80dd0fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:39.806672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c211d99-6bcc-4793-ad85-f8b5b80dd0fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:39.807116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c211d99-6bcc-4793-ad85-f8b5b80dd0fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:39.921300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4447cb1b-d4f2-442c-89fb-bb92afb6c2a4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:39.938622 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4447cb1b-d4f2-442c-89fb-bb92afb6c2a4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1487 microversion: 2.1 time: 0.325864 Jul 26 19:48:39.942798 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 735/1518] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:39 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1487 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:39.974161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-27edbfee-39c8-4d99-a566-602d2cda5682 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:39.975509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-27edbfee-39c8-4d99-a566-602d2cda5682 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:39.984955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27edbfee-39c8-4d99-a566-602d2cda5682 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:39.985429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27edbfee-39c8-4d99-a566-602d2cda5682 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:39.987459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27edbfee-39c8-4d99-a566-602d2cda5682 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:39.987940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27edbfee-39c8-4d99-a566-602d2cda5682 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:40.047888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:40.073966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-27edbfee-39c8-4d99-a566-602d2cda5682 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:48:40.231460 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-27edbfee-39c8-4d99-a566-602d2cda5682 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 204 len: 0 microversion: 2.1 time: 0.265853 Jul 26 19:48:40.232879 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 736/1519] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:48:39 2022] DELETE /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:48:40.246276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-92e52681-468f-4e9c-93ec-f5d748fe74a8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:40.248643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92e52681-468f-4e9c-93ec-f5d748fe74a8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:40.264580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92e52681-468f-4e9c-93ec-f5d748fe74a8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:40.265041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92e52681-468f-4e9c-93ec-f5d748fe74a8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:40.268156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92e52681-468f-4e9c-93ec-f5d748fe74a8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:40.268608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92e52681-468f-4e9c-93ec-f5d748fe74a8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:40.558364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-92e52681-468f-4e9c-93ec-f5d748fe74a8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:40.579760 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-92e52681-468f-4e9c-93ec-f5d748fe74a8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1493 microversion: 2.1 time: 0.334347 Jul 26 19:48:40.596698 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 737/1520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:40 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1493 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:40.604104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8d6d8d2-45e8-4acd-8767-d8f0366a0fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:40.604723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e8d6d8d2-45e8-4acd-8767-d8f0366a0fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:40.613003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8d2-45e8-4acd-8767-d8f0366a0fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:40.614014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8d2-45e8-4acd-8767-d8f0366a0fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:40.615177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8d2-45e8-4acd-8767-d8f0366a0fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:40.615916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8d2-45e8-4acd-8767-d8f0366a0fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:40.765067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c211d99-6bcc-4793-ad85-f8b5b80dd0fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:40.776082 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c211d99-6bcc-4793-ad85-f8b5b80dd0fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1278 microversion: 2.1 time: 0.986942 Jul 26 19:48:40.796227 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 784/1521] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:39 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1278 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:41.020997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e8d6d8d2-45e8-4acd-8767-d8f0366a0fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:41.039504 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e8d6d8d2-45e8-4acd-8767-d8f0366a0fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1465 microversion: 2.1 time: 0.438572 Jul 26 19:48:41.041782 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 738/1522] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:40 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1465 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:41.069419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1280741706", "metadata": {"image_type": "test"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:41.072127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:41.091190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:41.093772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:41.096667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:41.097137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:41.170977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Getting quotas for project 5918d79bd422403c9e8998747935af6c. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:41.177863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Getting quotas for user 949c58249f22473e9956be855557b0b2 and project 5918d79bd422403c9e8998747935af6c. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:41.468909 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0474e8f3-c947-4c85-9d2c-053075a9e04a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "POST /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f/action" status: 202 len: 0 microversion: 2.1 time: 0.406700 Jul 26 19:48:41.469842 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 785/1523] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:48:41 2022] POST /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 19:48:41.481313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2755ef8c-bf7d-496b-9871-7c19e76b2dc1 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756e97820>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:41.558497 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2755ef8c-bf7d-496b-9871-7c19e76b2dc1 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.081742 Jul 26 19:48:41.568219 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 739/1524] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:41 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:41.607586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64f7111d-3c32-4540-b785-72daf338bd80 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:41.608577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64f7111d-3c32-4540-b785-72daf338bd80 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:41.624420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64f7111d-3c32-4540-b785-72daf338bd80 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:41.625412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64f7111d-3c32-4540-b785-72daf338bd80 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:41.626487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64f7111d-3c32-4540-b785-72daf338bd80 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:41.627210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64f7111d-3c32-4540-b785-72daf338bd80 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:41.804505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-67b3fe80-2f0d-43a4-ae5c-1382120219ac tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:41.805398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-67b3fe80-2f0d-43a4-ae5c-1382120219ac tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:41.826597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67b3fe80-2f0d-43a4-ae5c-1382120219ac tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:41.827573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67b3fe80-2f0d-43a4-ae5c-1382120219ac tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:41.828820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67b3fe80-2f0d-43a4-ae5c-1382120219ac tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:41.829523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67b3fe80-2f0d-43a4-ae5c-1382120219ac tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:42.444750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-67b3fe80-2f0d-43a4-ae5c-1382120219ac tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:42.459753 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-67b3fe80-2f0d-43a4-ae5c-1382120219ac tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 0.663740 Jul 26 19:48:42.470116 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 740/1525] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:41 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:42.574266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-714fb19e-761d-4135-b284-1c87c26616ef tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756f28dc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:42.691345 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-714fb19e-761d-4135-b284-1c87c26616ef tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.118093 Jul 26 19:48:42.702015 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 741/1526] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:42 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:42.724873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64f7111d-3c32-4540-b785-72daf338bd80 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:42.749139 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64f7111d-3c32-4540-b785-72daf338bd80 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1493 microversion: 2.1 time: 1.149544 Jul 26 19:48:42.750348 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 786/1527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:41 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1493 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:43.493918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-07081edc-47d4-4efd-a704-ecadacf2e869 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:43.494536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-07081edc-47d4-4efd-a704-ecadacf2e869 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:43.514197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-07081edc-47d4-4efd-a704-ecadacf2e869 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:43.515988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-07081edc-47d4-4efd-a704-ecadacf2e869 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:43.521778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-07081edc-47d4-4efd-a704-ecadacf2e869 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:43.525114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-07081edc-47d4-4efd-a704-ecadacf2e869 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:43.661468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3695e41c-984d-4623-b198-6a2c151a62a4 req-778846ce-9069-4cbd-88cc-3cf56cadd977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7534f20c-a2cf-46f8-b462-33387eb39e2b", "name": "network-vif-deleted", "tag": "fc42c6ee-dc12-444c-bb1e-7889950036ef"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:43.731012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3695e41c-984d-4623-b198-6a2c151a62a4 req-778846ce-9069-4cbd-88cc-3cf56cadd977 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:43.732342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3695e41c-984d-4623-b198-6a2c151a62a4 req-778846ce-9069-4cbd-88cc-3cf56cadd977 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:43.776712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:43.790713 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3695e41c-984d-4623-b198-6a2c151a62a4 req-778846ce-9069-4cbd-88cc-3cf56cadd977 service nova] Creating event network-vif-deleted:fc42c6ee-dc12-444c-bb1e-7889950036ef for instance 7534f20c-a2cf-46f8-b462-33387eb39e2b on n-h1-708768-8 Jul 26 19:48:43.804438 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3695e41c-984d-4623-b198-6a2c151a62a4 req-778846ce-9069-4cbd-88cc-3cf56cadd977 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147968 Jul 26 19:48:43.808489 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 787/1528] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:48:43.825299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf285420-7f41-49ac-932b-4f97538f90a0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875edc8280>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:43.970184 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf285420-7f41-49ac-932b-4f97538f90a0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.160157 Jul 26 19:48:43.981641 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 788/1529] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:43 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:43.992846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:43.993603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:44.016691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:44.019654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:44.025103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:44.025807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:44.095745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:44.096355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:44.097102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lazy-loading 'fault' on Instance uuid 7534f20c-a2cf-46f8-b462-33387eb39e2b {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:48:44.247506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:44.279040 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f7f042c9-a402-46d8-9b7a-bec4c19699f4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 200 len: 1305 microversion: 2.1 time: 0.292343 Jul 26 19:48:44.293081 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 789/1530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:43 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 1305 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:44.569575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-07081edc-47d4-4efd-a704-ecadacf2e869 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:44.630533 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-07081edc-47d4-4efd-a704-ecadacf2e869 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 1.143296 Jul 26 19:48:44.632682 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 742/1531] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:43 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:44.986253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dec6953-9148-4579-ad1d-a0b6a97a5c4a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875ee491f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:44.994232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:44.995281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:45.064679 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1dec6953-9148-4579-ad1d-a0b6a97a5c4a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.082947 Jul 26 19:48:45.073258 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 790/1532] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:44 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:45.305814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:45.306512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:45.339490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:45.343794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:45.344751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:45.349453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:45.483301 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b HTTP/1.1 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7534f20c-a2cf-46f8-b462-33387eb39e2b'} Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:48:45.502908 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:45.508807 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:48:45.508807 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:48:45.508807 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:48:45.508807 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:48:45.508807 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:48:45.508807 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:48:45.508807 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:48:45.508807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:48:45.514168 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d084756f-57d2-442e-b1a5-627a2411d006 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 404 len: 111 microversion: 2.1 time: 0.214139 Jul 26 19:48:45.519000 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 743/1533] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:45 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:48:45.654537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-200673b2-aeea-4a83-9cd6-dc20d3dd0fbe tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:45.655156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-200673b2-aeea-4a83-9cd6-dc20d3dd0fbe tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:45.673570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-200673b2-aeea-4a83-9cd6-dc20d3dd0fbe tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:45.679909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-200673b2-aeea-4a83-9cd6-dc20d3dd0fbe tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:45.681205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-200673b2-aeea-4a83-9cd6-dc20d3dd0fbe tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:45.684813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-200673b2-aeea-4a83-9cd6-dc20d3dd0fbe tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:45.893036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-13310154", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d609008d-caf9-4f78-8a5e-41e510179ad2"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:46.043670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] validate_networks() for [('d609008d-caf9-4f78-8a5e-41e510179ad2', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:48:46.155688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:46.415857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-200673b2-aeea-4a83-9cd6-dc20d3dd0fbe tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:46.447746 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-200673b2-aeea-4a83-9cd6-dc20d3dd0fbe tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 0.793464 Jul 26 19:48:46.469700 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 791/1534] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:45 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:46.482617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4452925d-96d5-40ce-944a-67ebe8db52f4 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875eef1dc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:46.578252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4452925d-96d5-40ce-944a-67ebe8db52f4 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.107303 Jul 26 19:48:46.582925 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 792/1535] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:46 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:46.701920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-00b69bc6-e227-4f7d-bd66-2980f292af27 req-d4456549-d993-4630-b731-0a18980cadee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1137667-e7fe-45bb-9d9d-cf0a68299575", "tag": "f93cc2bb-ea7b-4279-b7f1-8c09812ea516"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:46.724035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-00b69bc6-e227-4f7d-bd66-2980f292af27 req-d4456549-d993-4630-b731-0a18980cadee service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:46.745322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-00b69bc6-e227-4f7d-bd66-2980f292af27 req-d4456549-d993-4630-b731-0a18980cadee service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:46.800391 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-00b69bc6-e227-4f7d-bd66-2980f292af27 req-d4456549-d993-4630-b731-0a18980cadee service nova] Creating event network-changed:f93cc2bb-ea7b-4279-b7f1-8c09812ea516 for instance d1137667-e7fe-45bb-9d9d-cf0a68299575 on n-h1-708768-8 Jul 26 19:48:46.814788 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-00b69bc6-e227-4f7d-bd66-2980f292af27 req-d4456549-d993-4630-b731-0a18980cadee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117335 Jul 26 19:48:46.822234 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 793/1536] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:47.476217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:48:47.476746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:48:47.477082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:48:47.477656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:48:47.478345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:48:47.494089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:47.503183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:47.504906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:47.509097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:47.581512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:47.595357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for user 4e8808ff2c4341eca66334700ec25a82 and project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:47.643144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:48:47.650090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:48:47.653364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1748009554", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "618bcde5-26e7-4388-b600-7bc024c2b781"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:47.792619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] validate_networks() for [('618bcde5-26e7-4388-b600-7bc024c2b781', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:48:47.832908 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65f3316f-d4fe-4180-b1b2-85e2ee33d825 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944062 Jul 26 19:48:47.836651 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 744/1537] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:48:47.847595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db50c725-bd2b-41be-aadd-e43f3a89df09 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:47.848945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-db50c725-bd2b-41be-aadd-e43f3a89df09 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:47.865152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db50c725-bd2b-41be-aadd-e43f3a89df09 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:47.865447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db50c725-bd2b-41be-aadd-e43f3a89df09 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:47.870917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db50c725-bd2b-41be-aadd-e43f3a89df09 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:47.884407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db50c725-bd2b-41be-aadd-e43f3a89df09 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:49.060635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-db50c725-bd2b-41be-aadd-e43f3a89df09 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:49.081450 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db50c725-bd2b-41be-aadd-e43f3a89df09 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 1.243453 Jul 26 19:48:49.082034 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 745/1538] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:47 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:49.109488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7850af35-5b53-47cd-ae01-7e1bfbc551c7 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756f1af70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:49.242117 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7850af35-5b53-47cd-ae01-7e1bfbc551c7 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.149531 Jul 26 19:48:49.242117 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 746/1539] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:49 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:49.259474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d38f4f1-fdf3-4bae-9350-8fecb5e9dd84 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:49.280787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0d38f4f1-fdf3-4bae-9350-8fecb5e9dd84 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:49.312702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d38f4f1-fdf3-4bae-9350-8fecb5e9dd84 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:49.313293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d38f4f1-fdf3-4bae-9350-8fecb5e9dd84 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:49.314124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d38f4f1-fdf3-4bae-9350-8fecb5e9dd84 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:49.314633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d38f4f1-fdf3-4bae-9350-8fecb5e9dd84 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:49.632626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0d38f4f1-fdf3-4bae-9350-8fecb5e9dd84 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:49.656261 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d38f4f1-fdf3-4bae-9350-8fecb5e9dd84 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1209 microversion: 2.1 time: 0.411644 Jul 26 19:48:49.659260 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 747/1540] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:49 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1209 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:49.672709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-faeab53b-ed86-4351-901f-1c0394dc4cb9 req-7aa600eb-7637-4ae7-a06d-2c8a6e846476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295b3c66-74b3-4bdf-a567-45f39227ae6d", "tag": "2444f8ac-49c6-49b0-947d-1cabbcf20fda"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:49.714524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-faeab53b-ed86-4351-901f-1c0394dc4cb9 req-7aa600eb-7637-4ae7-a06d-2c8a6e846476 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:49.714963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-faeab53b-ed86-4351-901f-1c0394dc4cb9 req-7aa600eb-7637-4ae7-a06d-2c8a6e846476 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:49.762032 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-faeab53b-ed86-4351-901f-1c0394dc4cb9 req-7aa600eb-7637-4ae7-a06d-2c8a6e846476 service nova] Creating event network-changed:2444f8ac-49c6-49b0-947d-1cabbcf20fda for instance 295b3c66-74b3-4bdf-a567-45f39227ae6d on n-h2-708768-8 Jul 26 19:48:49.780457 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-faeab53b-ed86-4351-901f-1c0394dc4cb9 req-7aa600eb-7637-4ae7-a06d-2c8a6e846476 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119230 Jul 26 19:48:49.781072 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 748/1541] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:49.787414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3a9d0626-dc2e-4c2d-bccd-d2dcfef7c341 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:49.804311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3a9d0626-dc2e-4c2d-bccd-d2dcfef7c341 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:49.811086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:49.830386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a9d0626-dc2e-4c2d-bccd-d2dcfef7c341 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:49.840662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a9d0626-dc2e-4c2d-bccd-d2dcfef7c341 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:49.841672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a9d0626-dc2e-4c2d-bccd-d2dcfef7c341 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:49.842172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a9d0626-dc2e-4c2d-bccd-d2dcfef7c341 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:50.401802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:48:50.402937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:48:50.403855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:48:50.404512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:48:50.405220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:48:50.422394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:50.423472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:50.437444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:50.438602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:50.491078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Getting quotas for project 56462831b5fc4ac7b87c7da6ea7f172e. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:48:50.502104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Getting quotas for user 2952a164d671418eb175f38b70a4283e and project 56462831b5fc4ac7b87c7da6ea7f172e. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:48:50.545447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:48:50.547815 n-d-708768-8 devstack@n-api.service[125963]: WARNING nova.utils [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1748009554 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-174800955 Jul 26 19:48:50.554174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:48:50.685655 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ca0ad338-bf02-458c-91d7-9b4dd6a566b7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.328892 Jul 26 19:48:50.688612 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 794/1542] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:48:50.699014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f1f42d5-4a2e-439d-bbe7-dfdf0300846d tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:50.702080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4f1f42d5-4a2e-439d-bbe7-dfdf0300846d tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:50.741641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f1f42d5-4a2e-439d-bbe7-dfdf0300846d tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:50.742323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f1f42d5-4a2e-439d-bbe7-dfdf0300846d tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:50.743376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f1f42d5-4a2e-439d-bbe7-dfdf0300846d tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:50.750010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f1f42d5-4a2e-439d-bbe7-dfdf0300846d tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:50.797244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-3a9d0626-dc2e-4c2d-bccd-d2dcfef7c341 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 3f39e3c9-d789-460b-a36b-c5b9e3527888 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:48:50.850179 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3a9d0626-dc2e-4c2d-bccd-d2dcfef7c341 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 2420 microversion: 2.25 time: 1.066763 Jul 26 19:48:50.850794 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 749/1543] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:48:49 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 2420 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:48:50.870390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cd67d73-26a3-4266-ba8b-a64d53f16fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756f51dc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:50.991501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cd67d73-26a3-4266-ba8b-a64d53f16fb3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.134232 Jul 26 19:48:50.994184 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 750/1544] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:50 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:51.005552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e0c012b-2622-4817-b10f-b341cdcfc74b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:51.010370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e0c012b-2622-4817-b10f-b341cdcfc74b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:51.033032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e0c012b-2622-4817-b10f-b341cdcfc74b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:51.033490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e0c012b-2622-4817-b10f-b341cdcfc74b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:51.036268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e0c012b-2622-4817-b10f-b341cdcfc74b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:51.038127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e0c012b-2622-4817-b10f-b341cdcfc74b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:51.639043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e0c012b-2622-4817-b10f-b341cdcfc74b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:51.654116 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e0c012b-2622-4817-b10f-b341cdcfc74b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1271 microversion: 2.1 time: 0.658368 Jul 26 19:48:51.664692 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 751/1545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:50 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1271 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:51.671692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-281c00e2-80a5-4bce-b0e0-f7c0f68056c2 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:51.672441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-281c00e2-80a5-4bce-b0e0-f7c0f68056c2 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:51.831485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-281c00e2-80a5-4bce-b0e0-f7c0f68056c2 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:51.845537 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-281c00e2-80a5-4bce-b0e0-f7c0f68056c2 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1232 microversion: 2.1 time: 0.183800 Jul 26 19:48:51.847359 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 752/1546] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:51 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1232 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:51.894036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-708768-8", "block_migration": "auto"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:51.897685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:51.955143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:51.955601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:51.956415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:51.956855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:52.029898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'flavor' on Instance uuid 3f39e3c9-d789-460b-a36b-c5b9e3527888 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:48:52.061265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Going to try to live migrate instance to n-h2-708768-8 {{(pid=125964) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:48:54.191115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4f1f42d5-4a2e-439d-bbe7-dfdf0300846d tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:54.220916 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4f1f42d5-4a2e-439d-bbe7-dfdf0300846d tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 3.521058 Jul 26 19:48:54.221706 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 795/1547] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:50 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 3533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:54.241044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-79662298-bab4-4112-b580-d4c2b9d1e273 req-7a8105c7-d38b-497d-ba7f-42659827baac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df01792-8d3a-4b9b-b786-3e1fa006643f", "name": "network-vif-plugged", "status": "completed", "tag": "09a7781d-402a-4e6c-a8a1-86b9d590132c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:54.276616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-79662298-bab4-4112-b580-d4c2b9d1e273 req-7a8105c7-d38b-497d-ba7f-42659827baac service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:54.277169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-79662298-bab4-4112-b580-d4c2b9d1e273 req-7a8105c7-d38b-497d-ba7f-42659827baac service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:54.303383 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-79662298-bab4-4112-b580-d4c2b9d1e273 req-7a8105c7-d38b-497d-ba7f-42659827baac service nova] Creating event network-vif-plugged:09a7781d-402a-4e6c-a8a1-86b9d590132c for instance 7df01792-8d3a-4b9b-b786-3e1fa006643f on n-h2-708768-8 Jul 26 19:48:54.311602 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-79662298-bab4-4112-b580-d4c2b9d1e273 req-7a8105c7-d38b-497d-ba7f-42659827baac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087501 Jul 26 19:48:54.312442 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 796/1548] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:48:54.324307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2555968d-1e24-49bf-82cd-edda7114a700 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875f43c8b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:54.469187 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2555968d-1e24-49bf-82cd-edda7114a700 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.152275 Jul 26 19:48:54.474784 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 797/1549] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:54 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:54.498687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eafc933d-a6b5-4874-b8fb-85543f908cda tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:54.501421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eafc933d-a6b5-4874-b8fb-85543f908cda tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:54.550047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eafc933d-a6b5-4874-b8fb-85543f908cda tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:54.554350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eafc933d-a6b5-4874-b8fb-85543f908cda tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:54.571981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eafc933d-a6b5-4874-b8fb-85543f908cda tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:54.572589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eafc933d-a6b5-4874-b8fb-85543f908cda tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:55.953240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eafc933d-a6b5-4874-b8fb-85543f908cda tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:55.977950 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eafc933d-a6b5-4874-b8fb-85543f908cda tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1313 microversion: 2.1 time: 1.500852 Jul 26 19:48:55.980927 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 798/1550] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:54 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1313 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:55.992524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e1d7d606-7c9a-45d3-8fd7-5cf376804968 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:56.007992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e1d7d606-7c9a-45d3-8fd7-5cf376804968 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:56.044270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1d7d606-7c9a-45d3-8fd7-5cf376804968 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:56.047321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1d7d606-7c9a-45d3-8fd7-5cf376804968 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:56.051929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1d7d606-7c9a-45d3-8fd7-5cf376804968 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:56.054322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1d7d606-7c9a-45d3-8fd7-5cf376804968 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:56.132971 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cdb96fcb-fe97-42f8-b9bf-fefaf6ebf849 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/action" status: 202 len: 0 microversion: 2.25 time: 4.266141 Jul 26 19:48:56.134609 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 753/1551] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 19:48:51 2022] POST /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/action => generated 0 bytes in 4286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:48:56.140649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d6f8eb3-4894-4b53-82ea-e8fafdf2deed tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:56.148275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9d6f8eb3-4894-4b53-82ea-e8fafdf2deed tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:56.187849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d6f8eb3-4894-4b53-82ea-e8fafdf2deed tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:56.188533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d6f8eb3-4894-4b53-82ea-e8fafdf2deed tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:56.193329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d6f8eb3-4894-4b53-82ea-e8fafdf2deed tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:56.194039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d6f8eb3-4894-4b53-82ea-e8fafdf2deed tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:56.640216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e1d7d606-7c9a-45d3-8fd7-5cf376804968 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:56.666538 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e1d7d606-7c9a-45d3-8fd7-5cf376804968 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1290 microversion: 2.1 time: 0.680069 Jul 26 19:48:56.682141 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 799/1552] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:55 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1290 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:56.684201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ea778cf8-2ddc-4368-8778-9e03514d896b tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875eeab9d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:56.765513 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ea778cf8-2ddc-4368-8778-9e03514d896b tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.096242 Jul 26 19:48:56.766123 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 800/1553] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:56 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:56.782641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:56.783563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:56.797883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:56.798641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:56.799693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:56.800335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:57.483339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:57.497807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:57.499690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:57.509257 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c06a089d-9ac4-4317-b949-cd089bb31a0b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.741447 Jul 26 19:48:57.510171 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 801/1554] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:48:56 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:48:57.515207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-289b08d5-3ad9-464b-a2c6-2d3c539b9e03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:57.526435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-289b08d5-3ad9-464b-a2c6-2d3c539b9e03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:57.542156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-289b08d5-3ad9-464b-a2c6-2d3c539b9e03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:57.542921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-289b08d5-3ad9-464b-a2c6-2d3c539b9e03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:57.543951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-289b08d5-3ad9-464b-a2c6-2d3c539b9e03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:57.544560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-289b08d5-3ad9-464b-a2c6-2d3c539b9e03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:57.546253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:57.675005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9d6f8eb3-4894-4b53-82ea-e8fafdf2deed tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:57.688768 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9d6f8eb3-4894-4b53-82ea-e8fafdf2deed tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 1.547394 Jul 26 19:48:57.689798 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 754/1555] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:56 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:57.705143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4cd71029-5e12-47ca-a2e4-8dd330f90c4b tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:57.705768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4cd71029-5e12-47ca-a2e4-8dd330f90c4b tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:57.739579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cd71029-5e12-47ca-a2e4-8dd330f90c4b tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:57.740305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cd71029-5e12-47ca-a2e4-8dd330f90c4b tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:57.750823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cd71029-5e12-47ca-a2e4-8dd330f90c4b tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:57.751282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cd71029-5e12-47ca-a2e4-8dd330f90c4b tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:58.383512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4cd71029-5e12-47ca-a2e4-8dd330f90c4b tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:58.413666 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4cd71029-5e12-47ca-a2e4-8dd330f90c4b tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 0.721599 Jul 26 19:48:58.415243 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 755/1556] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:57 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:58.436465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-710ea06d-7dee-45e6-ade0-25f1ea96cd7d tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756ed6f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:58.538630 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-710ea06d-7dee-45e6-ade0-25f1ea96cd7d tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.121601 Jul 26 19:48:58.539228 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 756/1557] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:48:58 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:58.563765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:58.564408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:58.589754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-289b08d5-3ad9-464b-a2c6-2d3c539b9e03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:58.604639 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-289b08d5-3ad9-464b-a2c6-2d3c539b9e03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1313 microversion: 2.1 time: 1.093178 Jul 26 19:48:58.605661 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 802/1558] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:57 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:48:58.610701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:58.612983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:58.614005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:58.614668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:58.668636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:48:58.719880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab40ecb7-9e00-4556-a368-469e59f5b665 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:48:58.720952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab40ecb7-9e00-4556-a368-469e59f5b665 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:48:58.736567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab40ecb7-9e00-4556-a368-469e59f5b665 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:58.738878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab40ecb7-9e00-4556-a368-469e59f5b665 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:58.742031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab40ecb7-9e00-4556-a368-469e59f5b665 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:58.742725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab40ecb7-9e00-4556-a368-469e59f5b665 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:59.832629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab40ecb7-9e00-4556-a368-469e59f5b665 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:48:59.845268 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab40ecb7-9e00-4556-a368-469e59f5b665 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 1.132843 Jul 26 19:48:59.846063 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 803/1559] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:58 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:48:59.900470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4dfc7566-d509-45dd-a898-b5dcd236d0fb req-119e0f1b-ea9f-4c2a-a1fc-7cbebe1440a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c880cc-b8a9-4167-aa94-5c52d9d130e0", "tag": "821f8e2a-ea44-4252-9be5-5e243e4d636e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:48:59.945979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4dfc7566-d509-45dd-a898-b5dcd236d0fb req-119e0f1b-ea9f-4c2a-a1fc-7cbebe1440a0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:48:59.947343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4dfc7566-d509-45dd-a898-b5dcd236d0fb req-119e0f1b-ea9f-4c2a-a1fc-7cbebe1440a0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:48:59.971456 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-4dfc7566-d509-45dd-a898-b5dcd236d0fb req-119e0f1b-ea9f-4c2a-a1fc-7cbebe1440a0 service nova] Creating event network-changed:821f8e2a-ea44-4252-9be5-5e243e4d636e for instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 on n-h1-708768-8 Jul 26 19:48:59.986189 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4dfc7566-d509-45dd-a898-b5dcd236d0fb req-119e0f1b-ea9f-4c2a-a1fc-7cbebe1440a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098436 Jul 26 19:48:59.987699 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 804/1560] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:00.004263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac45bf38-6c3b-449c-a517-e44d921d7c83 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:00.004999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ac45bf38-6c3b-449c-a517-e44d921d7c83 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:00.017936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac45bf38-6c3b-449c-a517-e44d921d7c83 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:00.018382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac45bf38-6c3b-449c-a517-e44d921d7c83 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:00.019163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac45bf38-6c3b-449c-a517-e44d921d7c83 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:00.019597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac45bf38-6c3b-449c-a517-e44d921d7c83 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:00.248865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:00.268581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:00.272312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:00.273556 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9abd5e10-e427-4d30-8a5e-325899da3872 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 1.719900 Jul 26 19:49:00.309598 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 757/1561] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:48:58 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:00.322233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d5b3d84-f34b-4c2e-af1f-f34c07c65c1f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756f453a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:00.429953 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d5b3d84-f34b-4c2e-af1f-f34c07c65c1f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.118857 Jul 26 19:49:00.431756 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 758/1562] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:00 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:00.441332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b1df0e4c-95a0-46bb-bcfd-4f02e8232fee tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:00.445094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b1df0e4c-95a0-46bb-bcfd-4f02e8232fee tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:00.466206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:00.468425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1df0e4c-95a0-46bb-bcfd-4f02e8232fee tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:00.477201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1df0e4c-95a0-46bb-bcfd-4f02e8232fee tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:00.483255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1df0e4c-95a0-46bb-bcfd-4f02e8232fee tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:00.484018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b1df0e4c-95a0-46bb-bcfd-4f02e8232fee tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:00.519496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:00.986494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ac45bf38-6c3b-449c-a517-e44d921d7c83 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:00.996454 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ac45bf38-6c3b-449c-a517-e44d921d7c83 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 1.004758 Jul 26 19:49:00.999470 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 805/1563] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:48:59 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:01.015898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0e64b03b-0869-474a-bcbd-e613ff2c9a18 req-783c232e-7ae7-4c19-945e-639bc3fbeffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295b3c66-74b3-4bdf-a567-45f39227ae6d", "name": "network-vif-plugged", "status": "completed", "tag": "2444f8ac-49c6-49b0-947d-1cabbcf20fda"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:01.061849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0e64b03b-0869-474a-bcbd-e613ff2c9a18 req-783c232e-7ae7-4c19-945e-639bc3fbeffe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:01.062384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0e64b03b-0869-474a-bcbd-e613ff2c9a18 req-783c232e-7ae7-4c19-945e-639bc3fbeffe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:01.122131 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0e64b03b-0869-474a-bcbd-e613ff2c9a18 req-783c232e-7ae7-4c19-945e-639bc3fbeffe service nova] Creating event network-vif-plugged:2444f8ac-49c6-49b0-947d-1cabbcf20fda for instance 295b3c66-74b3-4bdf-a567-45f39227ae6d on n-h2-708768-8 Jul 26 19:49:01.143112 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0e64b03b-0869-474a-bcbd-e613ff2c9a18 req-783c232e-7ae7-4c19-945e-639bc3fbeffe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140353 Jul 26 19:49:01.143752 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 806/1564] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:01.173767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-974d083b-4a44-4197-9540-fb66a3a4fcf7 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:01.178023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-974d083b-4a44-4197-9540-fb66a3a4fcf7 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:01.187232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-974d083b-4a44-4197-9540-fb66a3a4fcf7 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:01.201628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-974d083b-4a44-4197-9540-fb66a3a4fcf7 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:01.202694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-974d083b-4a44-4197-9540-fb66a3a4fcf7 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:01.210915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-974d083b-4a44-4197-9540-fb66a3a4fcf7 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:01.541798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b1df0e4c-95a0-46bb-bcfd-4f02e8232fee tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:01.550686 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b1df0e4c-95a0-46bb-bcfd-4f02e8232fee tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1313 microversion: 2.1 time: 1.117567 Jul 26 19:49:01.551863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 759/1565] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:00 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1313 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:01.574940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:01.576976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:01.608343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:01.608816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:01.614993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:01.618923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:01.838409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:01.849218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-974d083b-4a44-4197-9540-fb66a3a4fcf7 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:01.872319 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-974d083b-4a44-4197-9540-fb66a3a4fcf7 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 0.726701 Jul 26 19:49:01.874898 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 807/1566] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:01 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:01.887253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1fc7de3-06f7-4776-ad81-82f9617df1fa tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875f249310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:02.006151 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1fc7de3-06f7-4776-ad81-82f9617df1fa tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.128764 Jul 26 19:49:02.006822 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 808/1567] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:01 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:02.040383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-66d19d15-3bff-4194-8c8f-dc367c91700c tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:02.046593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-66d19d15-3bff-4194-8c8f-dc367c91700c tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:02.079786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-66d19d15-3bff-4194-8c8f-dc367c91700c tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:02.080247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-66d19d15-3bff-4194-8c8f-dc367c91700c tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:02.081057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-66d19d15-3bff-4194-8c8f-dc367c91700c tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:02.095657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-66d19d15-3bff-4194-8c8f-dc367c91700c tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:02.554184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-66d19d15-3bff-4194-8c8f-dc367c91700c tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:02.562567 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-66d19d15-3bff-4194-8c8f-dc367c91700c tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 0.542312 Jul 26 19:49:02.588821 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 809/1568] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:02 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:02.593911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbc62d2b-7453-44d5-a76b-e1a9b342acb1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:02.594428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cbc62d2b-7453-44d5-a76b-e1a9b342acb1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:02.633513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbc62d2b-7453-44d5-a76b-e1a9b342acb1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:02.634122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbc62d2b-7453-44d5-a76b-e1a9b342acb1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:02.634901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbc62d2b-7453-44d5-a76b-e1a9b342acb1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:02.635779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbc62d2b-7453-44d5-a76b-e1a9b342acb1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:03.196062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cbc62d2b-7453-44d5-a76b-e1a9b342acb1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:03.215422 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cbc62d2b-7453-44d5-a76b-e1a9b342acb1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1313 microversion: 2.1 time: 0.619885 Jul 26 19:49:03.216813 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 810/1569] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:02 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:03.255379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-cb2289ea-67cb-4ff3-af56-b6f98695227f req-f317266b-d60c-4a0c-b9f3-75d13cbd286b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050494f0-8ecf-4ca8-a74c-cfa13118930b", "tag": "4dd62864-a2c3-48eb-8843-d6680b22facb"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:03.286305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cb2289ea-67cb-4ff3-af56-b6f98695227f req-f317266b-d60c-4a0c-b9f3-75d13cbd286b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:03.291548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cb2289ea-67cb-4ff3-af56-b6f98695227f req-f317266b-d60c-4a0c-b9f3-75d13cbd286b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:03.322610 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-cb2289ea-67cb-4ff3-af56-b6f98695227f req-f317266b-d60c-4a0c-b9f3-75d13cbd286b service nova] Creating event network-changed:4dd62864-a2c3-48eb-8843-d6680b22facb for instance 050494f0-8ecf-4ca8-a74c-cfa13118930b on n-h2-708768-8 Jul 26 19:49:03.341864 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-cb2289ea-67cb-4ff3-af56-b6f98695227f req-f317266b-d60c-4a0c-b9f3-75d13cbd286b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114270 Jul 26 19:49:03.352800 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 811/1570] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:03.358182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03d36618-e822-4be9-bb30-8790ea22d280 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:03.358885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03d36618-e822-4be9-bb30-8790ea22d280 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:03.385131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03d36618-e822-4be9-bb30-8790ea22d280 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:03.385581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03d36618-e822-4be9-bb30-8790ea22d280 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:03.386370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03d36618-e822-4be9-bb30-8790ea22d280 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:03.386813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03d36618-e822-4be9-bb30-8790ea22d280 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:03.478262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:03.493475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:03.508197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:03.509611 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1cdbad4d-7f20-4791-aee5-c79f9ac8daff tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 1.956362 Jul 26 19:49:03.510216 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 760/1571] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:01 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:03.548821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7727e593-87ff-48e2-b7cc-1560db985a6e tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756f51160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:03.736542 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7727e593-87ff-48e2-b7cc-1560db985a6e tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.202771 Jul 26 19:49:03.737493 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 761/1572] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:03 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:03.754011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e9e986f-51c3-42fb-8efb-e4306c5e827e tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:03.759503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e9e986f-51c3-42fb-8efb-e4306c5e827e tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:03.808301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e9e986f-51c3-42fb-8efb-e4306c5e827e tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:03.811117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e9e986f-51c3-42fb-8efb-e4306c5e827e tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:03.812007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e9e986f-51c3-42fb-8efb-e4306c5e827e tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:03.812447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e9e986f-51c3-42fb-8efb-e4306c5e827e tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:03.921486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03d36618-e822-4be9-bb30-8790ea22d280 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:03.929915 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03d36618-e822-4be9-bb30-8790ea22d280 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 0.575706 Jul 26 19:49:03.940281 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 812/1573] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:03 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:03.954401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e69730c7-f163-4baf-b932-4730f7085944 req-2a436a33-ed71-474c-a7c2-9dd53513b533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1137667-e7fe-45bb-9d9d-cf0a68299575", "name": "network-vif-plugged", "status": "completed", "tag": "f93cc2bb-ea7b-4279-b7f1-8c09812ea516"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:03.987707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e69730c7-f163-4baf-b932-4730f7085944 req-2a436a33-ed71-474c-a7c2-9dd53513b533 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:03.988267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e69730c7-f163-4baf-b932-4730f7085944 req-2a436a33-ed71-474c-a7c2-9dd53513b533 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:04.033827 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e69730c7-f163-4baf-b932-4730f7085944 req-2a436a33-ed71-474c-a7c2-9dd53513b533 service nova] Creating event network-vif-plugged:f93cc2bb-ea7b-4279-b7f1-8c09812ea516 for instance d1137667-e7fe-45bb-9d9d-cf0a68299575 on n-h1-708768-8 Jul 26 19:49:04.059757 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e69730c7-f163-4baf-b932-4730f7085944 req-2a436a33-ed71-474c-a7c2-9dd53513b533 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118000 Jul 26 19:49:04.083948 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 813/1574] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:04.240853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-011b87a4-44a5-4237-8b38-38f5837ea4bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:04.241583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-011b87a4-44a5-4237-8b38-38f5837ea4bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:04.256230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-011b87a4-44a5-4237-8b38-38f5837ea4bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:04.257130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-011b87a4-44a5-4237-8b38-38f5837ea4bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:04.258133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-011b87a4-44a5-4237-8b38-38f5837ea4bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:04.260363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-011b87a4-44a5-4237-8b38-38f5837ea4bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:04.722741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-011b87a4-44a5-4237-8b38-38f5837ea4bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:04.731968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:04.741112 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-011b87a4-44a5-4237-8b38-38f5837ea4bc tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1313 microversion: 2.1 time: 0.504557 Jul 26 19:49:04.758493 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 814/1575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:04 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:49:04.763723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:04.769120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:04.783917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:04.791074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:04.793526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:04.795314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:04.799321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:04.829472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e9e986f-51c3-42fb-8efb-e4306c5e827e tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:04.842394 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e9e986f-51c3-42fb-8efb-e4306c5e827e tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 1.103698 Jul 26 19:49:04.846121 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 762/1576] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:03 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:04.862834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-42e149fe-7b15-41a4-bf04-b16040fef7a3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756ed65e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:04.985252 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-42e149fe-7b15-41a4-bf04-b16040fef7a3 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.132921 Jul 26 19:49:04.987170 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 763/1577] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:04 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:04.999230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08fa1421-cd10-41af-a9e1-dad1a2717237 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:05.006011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-08fa1421-cd10-41af-a9e1-dad1a2717237 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:05.024138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08fa1421-cd10-41af-a9e1-dad1a2717237 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:05.036084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08fa1421-cd10-41af-a9e1-dad1a2717237 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:05.037315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08fa1421-cd10-41af-a9e1-dad1a2717237 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:05.041584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08fa1421-cd10-41af-a9e1-dad1a2717237 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:05.447283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-08fa1421-cd10-41af-a9e1-dad1a2717237 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:05.476395 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-08fa1421-cd10-41af-a9e1-dad1a2717237 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1320 microversion: 2.1 time: 0.472502 Jul 26 19:49:05.492086 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 764/1578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:04 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1320 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:05.623121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1571266459", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "253917a0-9d68-4d2a-bb7f-b26244d056e0"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:05.784985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] validate_networks() for [('253917a0-9d68-4d2a-bb7f-b26244d056e0', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:49:06.241862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:06.256980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:06.265778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:06.267037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bd5e8f85-b161-47a5-bc1e-4ea14a7be202 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 1.507216 Jul 26 19:49:06.267648 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 815/1579] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:04 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:06.300913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5efe3a8-e78b-412d-af34-73107bbaad6f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:06.302321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a5efe3a8-e78b-412d-af34-73107bbaad6f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:06.326509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5efe3a8-e78b-412d-af34-73107bbaad6f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:06.326964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5efe3a8-e78b-412d-af34-73107bbaad6f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:06.327789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5efe3a8-e78b-412d-af34-73107bbaad6f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:06.328229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5efe3a8-e78b-412d-af34-73107bbaad6f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:06.883921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a5efe3a8-e78b-412d-af34-73107bbaad6f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:06.893796 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5efe3a8-e78b-412d-af34-73107bbaad6f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1313 microversion: 2.1 time: 0.603706 Jul 26 19:49:06.909242 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 816/1580] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:06 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:06.921544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28c34000-b32d-44d8-be08-4d92dcb6bea6 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:06.922167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-28c34000-b32d-44d8-be08-4d92dcb6bea6 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:06.941789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28c34000-b32d-44d8-be08-4d92dcb6bea6 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:06.942957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28c34000-b32d-44d8-be08-4d92dcb6bea6 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:06.944237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28c34000-b32d-44d8-be08-4d92dcb6bea6 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:06.944731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28c34000-b32d-44d8-be08-4d92dcb6bea6 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:06.948227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:49:06.949058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:49:06.950255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:49:06.950887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:49:06.951697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:49:06.973763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:06.978547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:06.982745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:06.984673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:07.104241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Getting quotas for project 76cff6b8f0eb4130acc4fbf20d111823. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:49:07.122124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Getting quotas for user f850c7cd5b0d494299638f3b37983089 and project 76cff6b8f0eb4130acc4fbf20d111823. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:49:07.139020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:49:07.141762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:49:07.232525 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23dcbb8d-cf3d-41ed-81b1-9d04c7193978 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732908 Jul 26 19:49:07.239434 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 765/1581] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:49:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:49:07.249921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36f0602b-9205-4615-97ac-fa94f097db4d tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756ed6c10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:07.328560 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36f0602b-9205-4615-97ac-fa94f097db4d tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.091715 Jul 26 19:49:07.334282 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 766/1582] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:07 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:07.349312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d921177-c8ee-44a8-8a2f-03e4e9da08db tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:07.353249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d921177-c8ee-44a8-8a2f-03e4e9da08db tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:07.378010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d921177-c8ee-44a8-8a2f-03e4e9da08db tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:07.380463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d921177-c8ee-44a8-8a2f-03e4e9da08db tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:07.384627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d921177-c8ee-44a8-8a2f-03e4e9da08db tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:07.385284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d921177-c8ee-44a8-8a2f-03e4e9da08db tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:07.392959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-28c34000-b32d-44d8-be08-4d92dcb6bea6 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:07.421540 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-28c34000-b32d-44d8-be08-4d92dcb6bea6 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 0.495114 Jul 26 19:49:07.422238 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 817/1583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:06 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:07.438159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-676e993b-7996-49d6-922e-b5f9488b923a req-39903dda-a96d-477a-8f7c-c46f8bbcb998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c880cc-b8a9-4167-aa94-5c52d9d130e0", "name": "network-vif-plugged", "status": "completed", "tag": "821f8e2a-ea44-4252-9be5-5e243e4d636e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:07.491950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-676e993b-7996-49d6-922e-b5f9488b923a req-39903dda-a96d-477a-8f7c-c46f8bbcb998 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:07.492401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-676e993b-7996-49d6-922e-b5f9488b923a req-39903dda-a96d-477a-8f7c-c46f8bbcb998 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:07.530933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-676e993b-7996-49d6-922e-b5f9488b923a req-39903dda-a96d-477a-8f7c-c46f8bbcb998 service nova] Creating event network-vif-plugged:821f8e2a-ea44-4252-9be5-5e243e4d636e for instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 on n-h1-708768-8 Jul 26 19:49:07.552981 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-676e993b-7996-49d6-922e-b5f9488b923a req-39903dda-a96d-477a-8f7c-c46f8bbcb998 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124936 Jul 26 19:49:07.556012 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 818/1584] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:07.581991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2f4aec44-d844-4b7d-9b2b-0d667e215b51 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:07.585084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2f4aec44-d844-4b7d-9b2b-0d667e215b51 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:07.796091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d921177-c8ee-44a8-8a2f-03e4e9da08db tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:07.807888 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d921177-c8ee-44a8-8a2f-03e4e9da08db tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 200 len: 1507 microversion: 2.1 time: 0.471941 Jul 26 19:49:07.817227 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 767/1585] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:07 2022] GET /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:07.838343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:07.839580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:07.856933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:07.857368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:07.863117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:07.863655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:07.968611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2f4aec44-d844-4b7d-9b2b-0d667e215b51 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:07.982704 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2f4aec44-d844-4b7d-9b2b-0d667e215b51 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1225 microversion: 2.1 time: 0.410724 Jul 26 19:49:07.985694 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 819/1586] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:07 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1225 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:08.001942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0132aac4-9d46-49d3-8c5a-6b7084d21136 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:08.005366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0132aac4-9d46-49d3-8c5a-6b7084d21136 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 295b3c66-74b3-4bdf-a567-45f39227ae6d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:08.025317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0132aac4-9d46-49d3-8c5a-6b7084d21136 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:08.028517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0132aac4-9d46-49d3-8c5a-6b7084d21136 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:08.029576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0132aac4-9d46-49d3-8c5a-6b7084d21136 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:08.030194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0132aac4-9d46-49d3-8c5a-6b7084d21136 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:08.158030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:08.167844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:08.169448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:08.170641 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3e16746-58f3-417b-b087-f4916518be67 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.350487 Jul 26 19:49:08.197024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 768/1587] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:07 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:08.206529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-747b6a3e-675a-4bee-9daa-6d5200dbc704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:08.211945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-747b6a3e-675a-4bee-9daa-6d5200dbc704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:08.230338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-747b6a3e-675a-4bee-9daa-6d5200dbc704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:08.231044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-747b6a3e-675a-4bee-9daa-6d5200dbc704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:08.233555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-747b6a3e-675a-4bee-9daa-6d5200dbc704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:08.234175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-747b6a3e-675a-4bee-9daa-6d5200dbc704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:08.540009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-747b6a3e-675a-4bee-9daa-6d5200dbc704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:08.553619 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-747b6a3e-675a-4bee-9daa-6d5200dbc704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1313 microversion: 2.1 time: 0.354899 Jul 26 19:49:08.568002 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 769/1588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:08 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:08.589637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5950623-9ca0-480a-9f94-b88b207db338 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756ed6550>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:08.697995 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5950623-9ca0-480a-9f94-b88b207db338 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.139046 Jul 26 19:49:08.698645 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 770/1589] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:08 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:08.713006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-557e1bcf-2a76-42c5-978d-f5f2fba60104 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:08.717120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-557e1bcf-2a76-42c5-978d-f5f2fba60104 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:08.746424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-557e1bcf-2a76-42c5-978d-f5f2fba60104 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:08.747049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-557e1bcf-2a76-42c5-978d-f5f2fba60104 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:08.749457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-557e1bcf-2a76-42c5-978d-f5f2fba60104 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:08.757811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-557e1bcf-2a76-42c5-978d-f5f2fba60104 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.028878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0132aac4-9d46-49d3-8c5a-6b7084d21136 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:09.044472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-557e1bcf-2a76-42c5-978d-f5f2fba60104 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:09.044786 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0132aac4-9d46-49d3-8c5a-6b7084d21136 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/295b3c66-74b3-4bdf-a567-45f39227ae6d" status: 200 len: 1508 microversion: 2.1 time: 1.057500 Jul 26 19:49:09.045981 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 820/1590] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:07 2022] GET /compute/v2.1/servers/295b3c66-74b3-4bdf-a567-45f39227ae6d => generated 1508 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:09.055052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-225ed6bd-8ca2-4887-8241-dc545dda105c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:09.063224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-225ed6bd-8ca2-4887-8241-dc545dda105c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:09.070582 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-557e1bcf-2a76-42c5-978d-f5f2fba60104 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 0.369401 Jul 26 19:49:09.076065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-225ed6bd-8ca2-4887-8241-dc545dda105c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.076794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-225ed6bd-8ca2-4887-8241-dc545dda105c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.077311 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 771/1591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:08 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:09.077951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-225ed6bd-8ca2-4887-8241-dc545dda105c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.078556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-225ed6bd-8ca2-4887-8241-dc545dda105c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.105229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77714092-2b5b-4b9c-bbbf-3a7a2f0726a0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:09.108129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77714092-2b5b-4b9c-bbbf-3a7a2f0726a0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 295b3c66-74b3-4bdf-a567-45f39227ae6d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:09.128059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77714092-2b5b-4b9c-bbbf-3a7a2f0726a0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.132926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77714092-2b5b-4b9c-bbbf-3a7a2f0726a0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.135236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77714092-2b5b-4b9c-bbbf-3a7a2f0726a0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.152571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77714092-2b5b-4b9c-bbbf-3a7a2f0726a0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.228830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77714092-2b5b-4b9c-bbbf-3a7a2f0726a0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 295b3c66-74b3-4bdf-a567-45f39227ae6d] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:49:09.307046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-225ed6bd-8ca2-4887-8241-dc545dda105c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:09.317909 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-225ed6bd-8ca2-4887-8241-dc545dda105c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1277 microversion: 2.1 time: 0.268268 Jul 26 19:49:09.319356 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 821/1592] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:09 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:09.325171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:09.333308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:09.363186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.364689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.368257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.368929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.410035 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77714092-2b5b-4b9c-bbbf-3a7a2f0726a0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "DELETE /compute/v2.1/servers/295b3c66-74b3-4bdf-a567-45f39227ae6d" status: 204 len: 0 microversion: 2.1 time: 0.330170 Jul 26 19:49:09.412957 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 772/1593] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:49:09 2022] DELETE /compute/v2.1/servers/295b3c66-74b3-4bdf-a567-45f39227ae6d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:09.428226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-73f21ba2-6740-4300-919c-42bfff215b15 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:09.431136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-73f21ba2-6740-4300-919c-42bfff215b15 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:09.451020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f21ba2-6740-4300-919c-42bfff215b15 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.455358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f21ba2-6740-4300-919c-42bfff215b15 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.457516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f21ba2-6740-4300-919c-42bfff215b15 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.458226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f21ba2-6740-4300-919c-42bfff215b15 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.520870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-73f21ba2-6740-4300-919c-42bfff215b15 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: d1137667-e7fe-45bb-9d9d-cf0a68299575] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:49:09.770363 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-73f21ba2-6740-4300-919c-42bfff215b15 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575" status: 204 len: 0 microversion: 2.1 time: 0.352206 Jul 26 19:49:09.771478 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 773/1594] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:49:09 2022] DELETE /compute/v2.1/servers/d1137667-e7fe-45bb-9d9d-cf0a68299575 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:09.778585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f29cfd4-a5da-4edf-ae1c-78b4b559a4d5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:09.779297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f29cfd4-a5da-4edf-ae1c-78b4b559a4d5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:09.818807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f29cfd4-a5da-4edf-ae1c-78b4b559a4d5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.819274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f29cfd4-a5da-4edf-ae1c-78b4b559a4d5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:09.820097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f29cfd4-a5da-4edf-ae1c-78b4b559a4d5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:09.836407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f29cfd4-a5da-4edf-ae1c-78b4b559a4d5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:10.246315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f29cfd4-a5da-4edf-ae1c-78b4b559a4d5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:10.260878 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f29cfd4-a5da-4edf-ae1c-78b4b559a4d5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1313 microversion: 2.1 time: 0.485900 Jul 26 19:49:10.278373 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 774/1595] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:09 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:10.284873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a215250-2b72-47fc-a716-a41b03452ef2 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756f943a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:10.287881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:10.303420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:10.312810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:10.314381 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9a9e92d6-2bf0-498c-9f0e-0061580434e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.992859 Jul 26 19:49:10.315272 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 822/1596] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:09 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:10.423097 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a215250-2b72-47fc-a716-a41b03452ef2 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.142410 Jul 26 19:49:10.424111 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 775/1597] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:10 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:10.438337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-637852977", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "50f2dfa9-34b9-455e-8977-8a3ecc98c855"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:10.470645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-601181794", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "0f695fb7-3303-409c-b910-73ee1e80f46d"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:10.540953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] validate_networks() for [('50f2dfa9-34b9-455e-8977-8a3ecc98c855', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:49:10.639035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] validate_networks() for [('0f695fb7-3303-409c-b910-73ee1e80f46d', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:49:12.502536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:49:12.503804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:49:12.504589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:49:12.505555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:49:12.506149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:49:12.545012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:12.548144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:12.553965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:12.554780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:12.668549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Getting quotas for project e5a0c6b8a5804e0ab6af55c5ee740e21. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:49:12.685417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Getting quotas for user 8c9e3f3572674c1380d3eca3d4c5e58c and project e5a0c6b8a5804e0ab6af55c5ee740e21. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:49:12.742124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Going to run 2 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:49:12.750139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 8cea81bb-4094-43a7-b913-64a304aec896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:49:12.882784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:49:12.884420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:49:12.885079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:49:12.885655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:49:12.886235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:49:12.914268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:12.915095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:12.919644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=8cea81bb-4094-43a7-b913-64a304aec896,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:49:12.920987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:12.921715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:13.010718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:49:13.037600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for user 678a9d8bb54a4fdb8997fcf480a3a355 and project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:49:13.115467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:49:13.118797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:49:13.167955 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6bb424d9-309c-4ac8-b3d9-0d22812b23fb tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.733929 Jul 26 19:49:13.168590 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 776/1598] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:49:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2735 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:49:13.218697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc926615-b2a8-4dbb-be9e-ef17959e9091 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:13.219482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fc926615-b2a8-4dbb-be9e-ef17959e9091 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:13.264114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc926615-b2a8-4dbb-be9e-ef17959e9091 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:13.276518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc926615-b2a8-4dbb-be9e-ef17959e9091 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:13.292077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc926615-b2a8-4dbb-be9e-ef17959e9091 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:13.294514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc926615-b2a8-4dbb-be9e-ef17959e9091 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:13.387803 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b482a6c2-61e4-40db-8501-963512472808 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.071151 Jul 26 19:49:13.399843 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 823/1599] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:49:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:49:13.404805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37d6b1d8-89b1-4e1a-b290-57a05eb4ad5a tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:13.405420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37d6b1d8-89b1-4e1a-b290-57a05eb4ad5a tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:13.490012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d6b1d8-89b1-4e1a-b290-57a05eb4ad5a tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:13.490455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d6b1d8-89b1-4e1a-b290-57a05eb4ad5a tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:13.503484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d6b1d8-89b1-4e1a-b290-57a05eb4ad5a tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:13.503961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d6b1d8-89b1-4e1a-b290-57a05eb4ad5a tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:13.927786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fc926615-b2a8-4dbb-be9e-ef17959e9091 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:13.934357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:13.936417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-37d6b1d8-89b1-4e1a-b290-57a05eb4ad5a tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:13.937865 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc926615-b2a8-4dbb-be9e-ef17959e9091 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 0.758201 Jul 26 19:49:13.938636 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 777/1600] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:13 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:13.946237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed7541d3-6e3c-4fa4-bf1c-032ea191024a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:13.947876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed7541d3-6e3c-4fa4-bf1c-032ea191024a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:13.963923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed7541d3-6e3c-4fa4-bf1c-032ea191024a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:13.964383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed7541d3-6e3c-4fa4-bf1c-032ea191024a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:13.964994 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37d6b1d8-89b1-4e1a-b290-57a05eb4ad5a tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1283 microversion: 2.1 time: 0.560601 Jul 26 19:49:13.965147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed7541d3-6e3c-4fa4-bf1c-032ea191024a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:13.965588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed7541d3-6e3c-4fa4-bf1c-032ea191024a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:13.972297 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 824/1601] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:13 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1283 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:13.990252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:13.990867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:14.018152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:14.021283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:14.023361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:14.024829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:14.373531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ed7541d3-6e3c-4fa4-bf1c-032ea191024a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:14.388599 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed7541d3-6e3c-4fa4-bf1c-032ea191024a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1500 microversion: 2.1 time: 0.444156 Jul 26 19:49:14.391938 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 778/1602] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:13 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1500 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:14.399646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7ad9295-df9c-4761-8588-857cac4cd15f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756ec4dc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:14.478808 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c7ad9295-df9c-4761-8588-857cac4cd15f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.083101 Jul 26 19:49:14.480960 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 779/1603] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:14 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:14.497729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:14.512253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:14.514344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Searching by: {'deleted': False, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:49:14.599673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:14.601882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:14.605814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:14.606284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:14.811463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:14.831674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:14.836486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:14.838829 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ea82dccf-6b98-43e9-8d6e-bfd0a2ede80f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.864470 Jul 26 19:49:14.845756 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 825/1604] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:13 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:14.859484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-205e6997-23df-40e3-b348-a4ee7b6fc421 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:14.877544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-205e6997-23df-40e3-b348-a4ee7b6fc421 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:14.898099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-205e6997-23df-40e3-b348-a4ee7b6fc421 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:14.899297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-205e6997-23df-40e3-b348-a4ee7b6fc421 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:14.900397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-205e6997-23df-40e3-b348-a4ee7b6fc421 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:14.901076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-205e6997-23df-40e3-b348-a4ee7b6fc421 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:15.038239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:49:15.229376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7e8cdd1c-91a9-46f3-865f-6a25dfb188f5 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.745909 Jul 26 19:49:15.247155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-205e6997-23df-40e3-b348-a4ee7b6fc421 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:15.263204 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-205e6997-23df-40e3-b348-a4ee7b6fc421 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1214 microversion: 2.1 time: 0.415648 Jul 26 19:49:15.264375 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 780/1605] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 19:49:14 2022] GET /compute/v2.1/servers => generated 1003 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:15.266279 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 826/1606] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:14 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1214 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:15.329080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-32912622-1988-498e-809b-d7cd46b09170 req-d0fce3a0-6add-4a45-9f29-8b36fb49ac66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295b3c66-74b3-4bdf-a567-45f39227ae6d", "name": "network-vif-deleted", "tag": "2444f8ac-49c6-49b0-947d-1cabbcf20fda"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:15.333831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb9e1d63-1089-48d6-be61-5adfd3ae0704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:15.340233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fb9e1d63-1089-48d6-be61-5adfd3ae0704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:15.366300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d63-1089-48d6-be61-5adfd3ae0704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:15.373620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d63-1089-48d6-be61-5adfd3ae0704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:15.374212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-32912622-1988-498e-809b-d7cd46b09170 req-d0fce3a0-6add-4a45-9f29-8b36fb49ac66 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:15.376578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-32912622-1988-498e-809b-d7cd46b09170 req-d0fce3a0-6add-4a45-9f29-8b36fb49ac66 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:15.377350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d63-1089-48d6-be61-5adfd3ae0704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:15.381976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d63-1089-48d6-be61-5adfd3ae0704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:15.427154 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-32912622-1988-498e-809b-d7cd46b09170 req-d0fce3a0-6add-4a45-9f29-8b36fb49ac66 service nova] Creating event network-vif-deleted:2444f8ac-49c6-49b0-947d-1cabbcf20fda for instance 295b3c66-74b3-4bdf-a567-45f39227ae6d on n-h2-708768-8 Jul 26 19:49:15.444464 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-32912622-1988-498e-809b-d7cd46b09170 req-d0fce3a0-6add-4a45-9f29-8b36fb49ac66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152572 Jul 26 19:49:15.451062 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 781/1607] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:15.469336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1e534444-4101-409f-be70-920d604418a7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:15.470155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-fb9e1d63-1089-48d6-be61-5adfd3ae0704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lazy-loading 'flavor' on Instance uuid 52c880cc-b8a9-4167-aa94-5c52d9d130e0 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:49:15.476306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1e534444-4101-409f-be70-920d604418a7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:15.499052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e534444-4101-409f-be70-920d604418a7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:15.505354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e534444-4101-409f-be70-920d604418a7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:15.506544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e534444-4101-409f-be70-920d604418a7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:15.508197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e534444-4101-409f-be70-920d604418a7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:16.158681 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fb9e1d63-1089-48d6-be61-5adfd3ae0704 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0/action" status: 202 len: 0 microversion: 2.1 time: 0.865551 Jul 26 19:49:16.159293 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 827/1608] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:15 2022] POST /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:49:16.175287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a59749a5-610d-4d1b-a116-d066717568a0 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:16.176079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a59749a5-610d-4d1b-a116-d066717568a0 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:16.180258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1e534444-4101-409f-be70-920d604418a7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:16.193482 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1e534444-4101-409f-be70-920d604418a7 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 0.740786 Jul 26 19:49:16.194941 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 782/1609] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:15 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:16.200109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5a4fdbf8-37dc-48c3-8f30-9df47ce66eb8 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:16.201256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a4fdbf8-37dc-48c3-8f30-9df47ce66eb8 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:16.208482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a4fdbf8-37dc-48c3-8f30-9df47ce66eb8 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:16.209199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a4fdbf8-37dc-48c3-8f30-9df47ce66eb8 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:16.210166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a4fdbf8-37dc-48c3-8f30-9df47ce66eb8 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:16.210403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a59749a5-610d-4d1b-a116-d066717568a0 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:16.210865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a59749a5-610d-4d1b-a116-d066717568a0 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:16.211237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a4fdbf8-37dc-48c3-8f30-9df47ce66eb8 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:16.211660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a59749a5-610d-4d1b-a116-d066717568a0 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:16.212106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a59749a5-610d-4d1b-a116-d066717568a0 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:16.370346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5a4fdbf8-37dc-48c3-8f30-9df47ce66eb8 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:16.386102 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5a4fdbf8-37dc-48c3-8f30-9df47ce66eb8 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1213 microversion: 2.1 time: 0.189834 Jul 26 19:49:16.406093 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 783/1610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:16 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:16.422031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7cc31943-8435-4c45-87f0-2d002f337790 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875766c9d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:16.538170 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7cc31943-8435-4c45-87f0-2d002f337790 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.129277 Jul 26 19:49:16.541762 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 784/1611] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:16 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:16.587178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cba94659-7d14-4943-b234-c2846abcb398 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "714a8970-29be-4851-a9cd-2118e8bbe4d9"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:16.605373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cba94659-7d14-4943-b234-c2846abcb398 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:16.631774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:16.634040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cba94659-7d14-4943-b234-c2846abcb398 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:16.634619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cba94659-7d14-4943-b234-c2846abcb398 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:16.635595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cba94659-7d14-4943-b234-c2846abcb398 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:16.636199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cba94659-7d14-4943-b234-c2846abcb398 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:17.165608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a59749a5-610d-4d1b-a116-d066717568a0 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:17.200007 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a59749a5-610d-4d1b-a116-d066717568a0 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1325 microversion: 2.1 time: 1.038101 Jul 26 19:49:17.207045 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 828/1612] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:16 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1325 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:17.253836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-622edf5d-4c03-4fba-b7ef-7fed068c9152 req-b6f43a70-5a02-475a-aabf-aa7e1ef942d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1137667-e7fe-45bb-9d9d-cf0a68299575", "name": "network-vif-deleted", "tag": "f93cc2bb-ea7b-4279-b7f1-8c09812ea516"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:17.336542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-622edf5d-4c03-4fba-b7ef-7fed068c9152 req-b6f43a70-5a02-475a-aabf-aa7e1ef942d2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:17.342514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-622edf5d-4c03-4fba-b7ef-7fed068c9152 req-b6f43a70-5a02-475a-aabf-aa7e1ef942d2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:17.392187 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-622edf5d-4c03-4fba-b7ef-7fed068c9152 req-b6f43a70-5a02-475a-aabf-aa7e1ef942d2 service nova] Creating event network-vif-deleted:f93cc2bb-ea7b-4279-b7f1-8c09812ea516 for instance d1137667-e7fe-45bb-9d9d-cf0a68299575 on n-h1-708768-8 Jul 26 19:49:17.419706 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-622edf5d-4c03-4fba-b7ef-7fed068c9152 req-b6f43a70-5a02-475a-aabf-aa7e1ef942d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204575 Jul 26 19:49:17.420943 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 829/1613] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:17.434676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:17.461769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:17.478304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:17.479117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:17.480866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:17.481510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:17.656740 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cba94659-7d14-4943-b234-c2846abcb398 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "POST /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.112530 Jul 26 19:49:17.659170 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 785/1614] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 19:49:16 2022] POST /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments => generated 194 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:17.683918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fde11680-678d-4254-8fd7-22e0b86aa903 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:17.685751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fde11680-678d-4254-8fd7-22e0b86aa903 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:17.722172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fde11680-678d-4254-8fd7-22e0b86aa903 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:17.725054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fde11680-678d-4254-8fd7-22e0b86aa903 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:17.726596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fde11680-678d-4254-8fd7-22e0b86aa903 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:17.729737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fde11680-678d-4254-8fd7-22e0b86aa903 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:18.096037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:18.151132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:18.152679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:18.153872 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e892a920-34a3-4758-9134-05e0e8c8d86b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.731229 Jul 26 19:49:18.154431 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 830/1615] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:17 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:18.177521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fef4fb6b-de95-4454-8d9f-9ca4d5206c96 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:18.178169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fef4fb6b-de95-4454-8d9f-9ca4d5206c96 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:18.185777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fef4fb6b-de95-4454-8d9f-9ca4d5206c96 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:18.186128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fef4fb6b-de95-4454-8d9f-9ca4d5206c96 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:18.186920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fef4fb6b-de95-4454-8d9f-9ca4d5206c96 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:18.187361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fef4fb6b-de95-4454-8d9f-9ca4d5206c96 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:18.283049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fde11680-678d-4254-8fd7-22e0b86aa903 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:18.299156 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fde11680-678d-4254-8fd7-22e0b86aa903 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1506 microversion: 2.1 time: 0.637261 Jul 26 19:49:18.303380 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 786/1616] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:17 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:18.314783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6b30f8b5-3d55-4f48-a730-ba620b85705a req-2d0f859b-0f0f-45dc-8f1e-8761e49dc18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050494f0-8ecf-4ca8-a74c-cfa13118930b", "name": "network-vif-plugged", "status": "completed", "tag": "4dd62864-a2c3-48eb-8843-d6680b22facb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:18.360910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6b30f8b5-3d55-4f48-a730-ba620b85705a req-2d0f859b-0f0f-45dc-8f1e-8761e49dc18c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:18.363876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6b30f8b5-3d55-4f48-a730-ba620b85705a req-2d0f859b-0f0f-45dc-8f1e-8761e49dc18c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:18.414554 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6b30f8b5-3d55-4f48-a730-ba620b85705a req-2d0f859b-0f0f-45dc-8f1e-8761e49dc18c service nova] Creating event network-vif-plugged:4dd62864-a2c3-48eb-8843-d6680b22facb for instance 050494f0-8ecf-4ca8-a74c-cfa13118930b on n-h2-708768-8 Jul 26 19:49:18.430748 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6b30f8b5-3d55-4f48-a730-ba620b85705a req-2d0f859b-0f0f-45dc-8f1e-8761e49dc18c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125400 Jul 26 19:49:18.433930 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 787/1617] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:18.450646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a71abb9c-cfd2-468a-a048-61d5af535643 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:18.453912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a71abb9c-cfd2-468a-a048-61d5af535643 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:18.468685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a71abb9c-cfd2-468a-a048-61d5af535643 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:18.473213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a71abb9c-cfd2-468a-a048-61d5af535643 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:18.477595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a71abb9c-cfd2-468a-a048-61d5af535643 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:18.478340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a71abb9c-cfd2-468a-a048-61d5af535643 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:18.883244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a71abb9c-cfd2-468a-a048-61d5af535643 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:18.893254 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a71abb9c-cfd2-468a-a048-61d5af535643 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 0.457655 Jul 26 19:49:18.914888 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 788/1618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:18 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:18.940048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f456cf64-c525-4a93-8b37-d9e4cbc9e037 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:18.940815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f456cf64-c525-4a93-8b37-d9e4cbc9e037 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:18.960291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f456cf64-c525-4a93-8b37-d9e4cbc9e037 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:18.974264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f456cf64-c525-4a93-8b37-d9e4cbc9e037 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:18.975278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f456cf64-c525-4a93-8b37-d9e4cbc9e037 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:18.975764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f456cf64-c525-4a93-8b37-d9e4cbc9e037 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:19.566638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fef4fb6b-de95-4454-8d9f-9ca4d5206c96 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:19.579880 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fef4fb6b-de95-4454-8d9f-9ca4d5206c96 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1310 microversion: 2.1 time: 1.406450 Jul 26 19:49:19.584037 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 831/1619] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:18 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1310 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:19.595317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb068aae-01a5-46b0-9ae0-294131fb7ff6 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875eed61f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:19.678763 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fb068aae-01a5-46b0-9ae0-294131fb7ff6 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1422 microversion: 2.1 time: 0.096762 Jul 26 19:49:19.679660 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 832/1620] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:19 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:19.688848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dc47e176-eece-4412-b1f8-5de2154734a2 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:19.693070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dc47e176-eece-4412-b1f8-5de2154734a2 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:19.712691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dc47e176-eece-4412-b1f8-5de2154734a2 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:19.713368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dc47e176-eece-4412-b1f8-5de2154734a2 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:19.714456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dc47e176-eece-4412-b1f8-5de2154734a2 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:19.720502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dc47e176-eece-4412-b1f8-5de2154734a2 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:19.774421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:20.304927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f456cf64-c525-4a93-8b37-d9e4cbc9e037 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:20.353846 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f456cf64-c525-4a93-8b37-d9e4cbc9e037 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1317 microversion: 2.1 time: 1.437671 Jul 26 19:49:20.354463 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 789/1621] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:18 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1317 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:20.363447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:20.364898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:20.378364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:20.378844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:20.380174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:20.380690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:20.576268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dc47e176-eece-4412-b1f8-5de2154734a2 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:20.590968 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dc47e176-eece-4412-b1f8-5de2154734a2 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1325 microversion: 2.1 time: 0.909302 Jul 26 19:49:20.591579 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 833/1622] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:19 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1325 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:20.601927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b6deb646-fdff-4b8c-8d39-6e5803be9882 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:20.602993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b6deb646-fdff-4b8c-8d39-6e5803be9882 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:20.609653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b6deb646-fdff-4b8c-8d39-6e5803be9882 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:20.610410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b6deb646-fdff-4b8c-8d39-6e5803be9882 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:20.611425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b6deb646-fdff-4b8c-8d39-6e5803be9882 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:20.612109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b6deb646-fdff-4b8c-8d39-6e5803be9882 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:20.657417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:20.670396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:20.672133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:20.673536 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-99bf6d2c-975c-428d-8e59-6d6442b6f388 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.317306 Jul 26 19:49:20.675005 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 790/1623] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:20 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:20.681649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f99cf8c1-bbe6-408f-b070-815a0d64cd63 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:20.682475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f99cf8c1-bbe6-408f-b070-815a0d64cd63 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:20.691645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f99cf8c1-bbe6-408f-b070-815a0d64cd63 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:20.692609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f99cf8c1-bbe6-408f-b070-815a0d64cd63 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:20.693638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f99cf8c1-bbe6-408f-b070-815a0d64cd63 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:20.694579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f99cf8c1-bbe6-408f-b070-815a0d64cd63 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:20.983240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f99cf8c1-bbe6-408f-b070-815a0d64cd63 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:20.994443 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f99cf8c1-bbe6-408f-b070-815a0d64cd63 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1332 microversion: 2.1 time: 0.317969 Jul 26 19:49:20.995764 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 791/1624] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:20 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1332 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:21.001738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-573bf59e-df00-4b38-8e06-8fb8cfcb966b req-0314948d-fade-478e-9f5a-dfd3ede39c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935ae66a-87b3-42a0-99ec-679dedd8f3df", "tag": "c36f3c36-3ad6-4297-b38d-d13e0fc6869d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:21.013370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-573bf59e-df00-4b38-8e06-8fb8cfcb966b req-0314948d-fade-478e-9f5a-dfd3ede39c13 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.013747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-573bf59e-df00-4b38-8e06-8fb8cfcb966b req-0314948d-fade-478e-9f5a-dfd3ede39c13 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.035193 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-573bf59e-df00-4b38-8e06-8fb8cfcb966b req-0314948d-fade-478e-9f5a-dfd3ede39c13 service nova] Creating event network-changed:c36f3c36-3ad6-4297-b38d-d13e0fc6869d for instance 935ae66a-87b3-42a0-99ec-679dedd8f3df on n-h2-708768-8 Jul 26 19:49:21.041638 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-573bf59e-df00-4b38-8e06-8fb8cfcb966b req-0314948d-fade-478e-9f5a-dfd3ede39c13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044425 Jul 26 19:49:21.042485 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 792/1625] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:21.049501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74a51562-ffd4-4e74-b5b6-b48e90a7151b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:21.050218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74a51562-ffd4-4e74-b5b6-b48e90a7151b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:21.062779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74a51562-ffd4-4e74-b5b6-b48e90a7151b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.063372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74a51562-ffd4-4e74-b5b6-b48e90a7151b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.065758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74a51562-ffd4-4e74-b5b6-b48e90a7151b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.065908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74a51562-ffd4-4e74-b5b6-b48e90a7151b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.274841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-74a51562-ffd4-4e74-b5b6-b48e90a7151b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:21.286310 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74a51562-ffd4-4e74-b5b6-b48e90a7151b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1310 microversion: 2.1 time: 0.241800 Jul 26 19:49:21.287226 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 793/1626] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:21 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1310 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:21.301281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b6deb646-fdff-4b8c-8d39-6e5803be9882 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:21.302610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf0676c9-9620-420e-9f37-4570fe367188 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756fbf670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:21.323250 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b6deb646-fdff-4b8c-8d39-6e5803be9882 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1506 microversion: 2.1 time: 0.726655 Jul 26 19:49:21.324653 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 834/1627] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:20 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:21.372502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c19577a2-e32c-4fa6-9509-266f19b316b1 req-ef66064d-0179-449a-bb1a-6de09ef2312d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f39e3c9-d789-460b-a36b-c5b9e3527888", "name": "network-vif-unplugged", "status": "completed", "tag": "643df902-6645-4b6e-9c71-22da5df80018"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:21.410298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf0676c9-9620-420e-9f37-4570fe367188 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1431 microversion: 2.1 time: 0.121709 Jul 26 19:49:21.423567 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 794/1628] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:21 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1431 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:21.433585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c19577a2-e32c-4fa6-9509-266f19b316b1 req-ef66064d-0179-449a-bb1a-6de09ef2312d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.434032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c19577a2-e32c-4fa6-9509-266f19b316b1 req-ef66064d-0179-449a-bb1a-6de09ef2312d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.446133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-37b952d6-be6a-4dc9-9790-2c81ef9d5afa tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:21.447916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-37b952d6-be6a-4dc9-9790-2c81ef9d5afa tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:21.459547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37b952d6-be6a-4dc9-9790-2c81ef9d5afa tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.459800 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c19577a2-e32c-4fa6-9509-266f19b316b1 req-ef66064d-0179-449a-bb1a-6de09ef2312d service nova] Creating event network-vif-unplugged:643df902-6645-4b6e-9c71-22da5df80018 for instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 on n-h1-708768-8 Jul 26 19:49:21.461178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37b952d6-be6a-4dc9-9790-2c81ef9d5afa tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.462367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37b952d6-be6a-4dc9-9790-2c81ef9d5afa tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.464027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37b952d6-be6a-4dc9-9790-2c81ef9d5afa tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.473754 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c19577a2-e32c-4fa6-9509-266f19b316b1 req-ef66064d-0179-449a-bb1a-6de09ef2312d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110822 Jul 26 19:49:21.476615 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 835/1629] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:21.485772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-62ddb8e9-62a8-4312-96a8-65c3c3683b56 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875f3fbdc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:21.579194 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-62ddb8e9-62a8-4312-96a8-65c3c3683b56 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 200 len: 1431 microversion: 2.1 time: 0.101239 Jul 26 19:49:21.591661 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 836/1630] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:21 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 1431 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:21.612266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e4586447-a3f8-4501-bc2e-2c775dc86e13 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:21.613222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e4586447-a3f8-4501-bc2e-2c775dc86e13 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:21.622380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4586447-a3f8-4501-bc2e-2c775dc86e13 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.623021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4586447-a3f8-4501-bc2e-2c775dc86e13 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.624005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4586447-a3f8-4501-bc2e-2c775dc86e13 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.624610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4586447-a3f8-4501-bc2e-2c775dc86e13 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.827894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-37b952d6-be6a-4dc9-9790-2c81ef9d5afa tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:21.849726 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-37b952d6-be6a-4dc9-9790-2c81ef9d5afa tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1317 microversion: 2.1 time: 0.423017 Jul 26 19:49:21.850703 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 795/1631] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:21 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:21.858142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e1585d61-c3ee-48a0-a172-e602b2b89c32 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:21.859100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e1585d61-c3ee-48a0-a172-e602b2b89c32 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:21.871140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1585d61-c3ee-48a0-a172-e602b2b89c32 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.871814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1585d61-c3ee-48a0-a172-e602b2b89c32 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:21.872594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1585d61-c3ee-48a0-a172-e602b2b89c32 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:21.873027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1585d61-c3ee-48a0-a172-e602b2b89c32 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.057923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1585d61-c3ee-48a0-a172-e602b2b89c32 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:22.066297 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e1585d61-c3ee-48a0-a172-e602b2b89c32 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1325 microversion: 2.1 time: 0.214169 Jul 26 19:49:22.068335 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 796/1632] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:21 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:22.074807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:22.075762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:22.084340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:22.084874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.085714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:22.086216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.288817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:22.292904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:22.309259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e4586447-a3f8-4501-bc2e-2c775dc86e13 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:22.314526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:22.318298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:22.322417 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7eea34fb-8c80-4657-9939-1d78443f4a30 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.251972 Jul 26 19:49:22.323544 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e4586447-a3f8-4501-bc2e-2c775dc86e13 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1465 microversion: 2.1 time: 0.730632 Jul 26 19:49:22.325246 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 797/1633] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:22 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:22.325682 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 837/1634] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:21 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1465 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:22.331065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-275f15ca-96bc-4a15-974c-1f4ee0c11f77 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:22.331889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-275f15ca-96bc-4a15-974c-1f4ee0c11f77 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:22.338175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8cecbdb4-5d15-4fec-b37e-8d202d903c9e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:22.338800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8cecbdb4-5d15-4fec-b37e-8d202d903c9e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:22.341304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-275f15ca-96bc-4a15-974c-1f4ee0c11f77 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:22.342594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-275f15ca-96bc-4a15-974c-1f4ee0c11f77 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.343593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-275f15ca-96bc-4a15-974c-1f4ee0c11f77 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:22.346761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-275f15ca-96bc-4a15-974c-1f4ee0c11f77 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.347850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8cecbdb4-5d15-4fec-b37e-8d202d903c9e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:22.348799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8cecbdb4-5d15-4fec-b37e-8d202d903c9e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.350833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8cecbdb4-5d15-4fec-b37e-8d202d903c9e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:22.352421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8cecbdb4-5d15-4fec-b37e-8d202d903c9e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.532992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-275f15ca-96bc-4a15-974c-1f4ee0c11f77 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:22.543434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-275f15ca-96bc-4a15-974c-1f4ee0c11f77 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1535 microversion: 2.1 time: 0.216318 Jul 26 19:49:22.544251 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 798/1635] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:22 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1535 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:22.548886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9037c076-cd78-4793-b306-b09e217c870f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8757124d30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:22.610796 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9037c076-cd78-4793-b306-b09e217c870f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/d3881918-9bf6-46c2-abd0-edc31f73f7fa" status: 200 len: 784 microversion: 2.1 time: 0.065459 Jul 26 19:49:22.611508 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 799/1636] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:22 2022] GET /compute/v2.1/images/d3881918-9bf6-46c2-abd0-edc31f73f7fa => generated 784 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:22.617680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc340e3d-973b-4780-96b4-f6cd8913c445 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:22.618684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bc340e3d-973b-4780-96b4-f6cd8913c445 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:22.635502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc340e3d-973b-4780-96b4-f6cd8913c445 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:22.636429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc340e3d-973b-4780-96b4-f6cd8913c445 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.637522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc340e3d-973b-4780-96b4-f6cd8913c445 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:22.638365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc340e3d-973b-4780-96b4-f6cd8913c445 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:22.715496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=12 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:22.786096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc340e3d-973b-4780-96b4-f6cd8913c445 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:22.795807 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc340e3d-973b-4780-96b4-f6cd8913c445 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1506 microversion: 2.1 time: 0.182742 Jul 26 19:49:22.797440 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 800/1637] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:22 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:22.802467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e9b326ba-f729-47b9-89e0-bbdd92e52bc5 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'create', calling method: .version_select at 0x7f8756ea5670>, body: {"pool": "0276911f-94cd-4250-bec1-fa4860ff6b75"} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:22.959051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:23.089099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:23.291568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8cecbdb4-5d15-4fec-b37e-8d202d903c9e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:23.305026 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8cecbdb4-5d15-4fec-b37e-8d202d903c9e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1310 microversion: 2.1 time: 0.976625 Jul 26 19:49:23.305618 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 838/1638] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:22 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1310 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:23.312977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ce23f429-f490-403c-adab-96c6bf0870e5 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:23.359386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ce23f429-f490-403c-adab-96c6bf0870e5 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050700 Jul 26 19:49:23.360548 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 839/1639] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:49:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:23.381585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18140447-62d1-4ce8-abea-0eb3402a9fd0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:23.382488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18140447-62d1-4ce8-abea-0eb3402a9fd0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:23.390310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18140447-62d1-4ce8-abea-0eb3402a9fd0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:23.391016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18140447-62d1-4ce8-abea-0eb3402a9fd0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:23.392187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18140447-62d1-4ce8-abea-0eb3402a9fd0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:23.392791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18140447-62d1-4ce8-abea-0eb3402a9fd0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:23.993218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18140447-62d1-4ce8-abea-0eb3402a9fd0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:24.002376 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18140447-62d1-4ce8-abea-0eb3402a9fd0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1317 microversion: 2.1 time: 0.640421 Jul 26 19:49:24.008860 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 840/1640] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:23 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:24.013722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-9599c693-e04b-45da-8f08-ad0ce80b032b req-5be6513f-32d9-4982-b140-f0cc28566874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df01792-8d3a-4b9b-b786-3e1fa006643f", "name": "network-vif-unplugged", "status": "completed", "tag": "09a7781d-402a-4e6c-a8a1-86b9d590132c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:24.044628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9599c693-e04b-45da-8f08-ad0ce80b032b req-5be6513f-32d9-4982-b140-f0cc28566874 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:24.046777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9599c693-e04b-45da-8f08-ad0ce80b032b req-5be6513f-32d9-4982-b140-f0cc28566874 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:24.074778 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-9599c693-e04b-45da-8f08-ad0ce80b032b req-5be6513f-32d9-4982-b140-f0cc28566874 service nova] Creating event network-vif-unplugged:09a7781d-402a-4e6c-a8a1-86b9d590132c for instance 7df01792-8d3a-4b9b-b786-3e1fa006643f on n-h2-708768-8 Jul 26 19:49:24.085056 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-9599c693-e04b-45da-8f08-ad0ce80b032b req-5be6513f-32d9-4982-b140-f0cc28566874 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074501 Jul 26 19:49:24.086091 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 841/1641] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:24.091806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38fa99fd-f533-4c9d-a00f-23139fd75342 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:24.092863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-38fa99fd-f533-4c9d-a00f-23139fd75342 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:24.100422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38fa99fd-f533-4c9d-a00f-23139fd75342 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:24.102969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38fa99fd-f533-4c9d-a00f-23139fd75342 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:24.104489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38fa99fd-f533-4c9d-a00f-23139fd75342 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:24.108118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38fa99fd-f533-4c9d-a00f-23139fd75342 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:24.529948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-38fa99fd-f533-4c9d-a00f-23139fd75342 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:24.550367 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-38fa99fd-f533-4c9d-a00f-23139fd75342 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1325 microversion: 2.1 time: 0.459790 Jul 26 19:49:24.565435 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 842/1642] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:24 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1325 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:24.596195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:24.608041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:24.648715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:24.656044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:24.661323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:24.663074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:24.723094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:24.950436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:24.962923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:24.964879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:24.967252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9294ca73-9e53-4912-850b-1d9fce589f06 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.401144 Jul 26 19:49:24.968115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 843/1643] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:24 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:24.974496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5acf0247-fb61-4f5f-ad19-d5cb75d78322 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875edd6f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:25.188068 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e9b326ba-f729-47b9-89e0-bbdd92e52bc5 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.389186 Jul 26 19:49:25.188728 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 801/1644] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:49:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:25.199471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4e254adf-3411-43b9-9957-41e05a20c6b0 req-a6b4c28e-6607-4a06-8fd7-1c36f7d91f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72cafc58-bc33-4e37-8484-b7067c652a12", "tag": "efe749c8-7803-417c-adea-7ae5a57594cd"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:25.216744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4e254adf-3411-43b9-9957-41e05a20c6b0 req-a6b4c28e-6607-4a06-8fd7-1c36f7d91f58 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.217200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4e254adf-3411-43b9-9957-41e05a20c6b0 req-a6b4c28e-6607-4a06-8fd7-1c36f7d91f58 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.234297 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4e254adf-3411-43b9-9957-41e05a20c6b0 req-a6b4c28e-6607-4a06-8fd7-1c36f7d91f58 service nova] Creating event network-changed:efe749c8-7803-417c-adea-7ae5a57594cd for instance 72cafc58-bc33-4e37-8484-b7067c652a12 on n-h1-708768-8 Jul 26 19:49:25.240028 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4e254adf-3411-43b9-9957-41e05a20c6b0 req-a6b4c28e-6607-4a06-8fd7-1c36f7d91f58 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049617 Jul 26 19:49:25.240792 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 802/1645] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:25.246064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bfe97b8-a42c-465a-8245-cb17b05773f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:25.246971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5bfe97b8-a42c-465a-8245-cb17b05773f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:25.253690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bfe97b8-a42c-465a-8245-cb17b05773f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.254452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bfe97b8-a42c-465a-8245-cb17b05773f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.255550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bfe97b8-a42c-465a-8245-cb17b05773f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.256496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bfe97b8-a42c-465a-8245-cb17b05773f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.434607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5bfe97b8-a42c-465a-8245-cb17b05773f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:25.445249 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5bfe97b8-a42c-465a-8245-cb17b05773f6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1506 microversion: 2.1 time: 0.203168 Jul 26 19:49:25.445845 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 803/1646] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:25 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:25.465281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46fff816-b1ae-4a10-b89c-f1c4b3c59e74 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:25.465916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-46fff816-b1ae-4a10-b89c-f1c4b3c59e74 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:25.472532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46fff816-b1ae-4a10-b89c-f1c4b3c59e74 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.473092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46fff816-b1ae-4a10-b89c-f1c4b3c59e74 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.474445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46fff816-b1ae-4a10-b89c-f1c4b3c59e74 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.474910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46fff816-b1ae-4a10-b89c-f1c4b3c59e74 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.617695 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5acf0247-fb61-4f5f-ad19-d5cb75d78322 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "DELETE /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 204 len: 0 microversion: 2.1 time: 0.648207 Jul 26 19:49:25.618320 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 844/1647] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:24 2022] DELETE /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:25.623225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d33d0fd-252a-435e-acd3-f75c4e564a0c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:25.623927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8d33d0fd-252a-435e-acd3-f75c4e564a0c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:25.640615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d33d0fd-252a-435e-acd3-f75c4e564a0c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.641074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d33d0fd-252a-435e-acd3-f75c4e564a0c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.641877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d33d0fd-252a-435e-acd3-f75c4e564a0c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.642318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d33d0fd-252a-435e-acd3-f75c4e564a0c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.722020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-46fff816-b1ae-4a10-b89c-f1c4b3c59e74 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:25.732000 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-46fff816-b1ae-4a10-b89c-f1c4b3c59e74 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1310 microversion: 2.1 time: 0.284778 Jul 26 19:49:25.734593 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 804/1648] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:25 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1310 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:25.740110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'action', calling method: .version_select at 0x7f8765d2bca0>, body: {"addFloatingIp": {"address": "172.25.0.32"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:25.743188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:25.750534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.750990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.751822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:25.752263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:25.823407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Acquired lock "refresh_cache-050494f0-8ecf-4ca8-a74c-cfa13118930b" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:49:25.975789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8d33d0fd-252a-435e-acd3-f75c4e564a0c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:25.984418 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d33d0fd-252a-435e-acd3-f75c4e564a0c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1317 microversion: 2.1 time: 0.365072 Jul 26 19:49:25.985002 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 845/1649] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:25 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:26.004073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e46de45-4197-48a0-abf4-9afe10471491 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:26.005569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e46de45-4197-48a0-abf4-9afe10471491 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:26.012204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e46de45-4197-48a0-abf4-9afe10471491 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.012952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e46de45-4197-48a0-abf4-9afe10471491 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.013928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e46de45-4197-48a0-abf4-9afe10471491 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.014368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e46de45-4197-48a0-abf4-9afe10471491 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.241100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e46de45-4197-48a0-abf4-9afe10471491 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:26.249265 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e46de45-4197-48a0-abf4-9afe10471491 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1325 microversion: 2.1 time: 0.249784 Jul 26 19:49:26.250311 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 846/1650] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:25 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:26.255681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d46887c6-8bd1-45ab-8b34-639d79a74862 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875f0d2040>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:26.278599 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d46887c6-8bd1-45ab-8b34-639d79a74862 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] HTTP exception thrown: Image not found. Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d46887c6-8bd1-45ab-8b34-639d79a74862 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Request method failure captured: Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 HTTP/1.1 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ET_-uVma4_ynqvp580XdupW72iOWhljwKuV0ZDp-gO-Cp9ABFecHNdnLR_7Q0rod9Etk_HJ6OYf1NGSJTA1R8XiYCatvO85syl7-9uz66_JzX6yz1YOn4nSNOiifp_J4pJ3G_Jum2sorrahAD0wFgv5wQJsZRxFJZvRXjdqXX-wHyM Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5918d79bd422403c9e8998747935af6c Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5918d79bd422403c9e8998747935af6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5918d79bd422403c9e8998747935af6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5918d79bd422403c9e8998747935af6c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5918d79bd422403c9e8998747935af6c"}]}] Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5918d79bd422403c9e8998747935af6c Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesOneServerTestJSON-553654240-project Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 949c58249f22473e9956be855557b0b2 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesOneServerTestJSON-553654240-project Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84'} Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:49:26.281529 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 could not be found. Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d46887c6-8bd1-45ab-8b34-639d79a74862 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d46887c6-8bd1-45ab-8b34-639d79a74862 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 404 len: 62 microversion: 2.1 time: 0.031754 Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 847/1651] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:26 2022] GET /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:26.293210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:26.298064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.298335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.299143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.299583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.439314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:26.448824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:26.450323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:26.451510 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bb215e89-ce62-4ba1-ac01-e04ab6c74e1a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.166283 Jul 26 19:49:26.452108 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 848/1652] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:26 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:26.457007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf2201f6-7ccf-44ad-bb15-519d6ac3efdb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1624272501"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:26.459706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf2201f6-7ccf-44ad-bb15-519d6ac3efdb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:26.466979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf2201f6-7ccf-44ad-bb15-519d6ac3efdb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.467424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf2201f6-7ccf-44ad-bb15-519d6ac3efdb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.468219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf2201f6-7ccf-44ad-bb15-519d6ac3efdb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.468673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf2201f6-7ccf-44ad-bb15-519d6ac3efdb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.708264 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf2201f6-7ccf-44ad-bb15-519d6ac3efdb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "POST /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f/action" status: 202 len: 0 microversion: 2.1 time: 0.254296 Jul 26 19:49:26.709241 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 849/1653] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:26 2022] POST /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 19:49:26.714661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af4c9219-ea97-43c8-b598-58740c6f11ba tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:26.715406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af4c9219-ea97-43c8-b598-58740c6f11ba tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:26.722103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af4c9219-ea97-43c8-b598-58740c6f11ba tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.722832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af4c9219-ea97-43c8-b598-58740c6f11ba tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.724218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af4c9219-ea97-43c8-b598-58740c6f11ba tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.724649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af4c9219-ea97-43c8-b598-58740c6f11ba tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.878436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-af4c9219-ea97-43c8-b598-58740c6f11ba tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:26.887095 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af4c9219-ea97-43c8-b598-58740c6f11ba tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1506 microversion: 2.1 time: 0.176399 Jul 26 19:49:26.887971 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 850/1654] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:26 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:26.892786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b59167f-4be3-483b-a343-75303c195629 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875f2491f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:26.948982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9b59167f-4be3-483b-a343-75303c195629 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac" status: 200 len: 1427 microversion: 2.1 time: 0.059788 Jul 26 19:49:26.950533 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 851/1655] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:26 2022] GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:26.956371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a6f5c4a8-23da-4fc6-b7ec-592d874f3d5f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:26.957199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a6f5c4a8-23da-4fc6-b7ec-592d874f3d5f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:26.965314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6f5c4a8-23da-4fc6-b7ec-592d874f3d5f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.965960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6f5c4a8-23da-4fc6-b7ec-592d874f3d5f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:26.966916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6f5c4a8-23da-4fc6-b7ec-592d874f3d5f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:26.967536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6f5c4a8-23da-4fc6-b7ec-592d874f3d5f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.220119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a6f5c4a8-23da-4fc6-b7ec-592d874f3d5f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:27.231189 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a6f5c4a8-23da-4fc6-b7ec-592d874f3d5f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1310 microversion: 2.1 time: 0.279406 Jul 26 19:49:27.244043 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 852/1656] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:26 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:27.250998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e8915c19-6219-4985-b458-fd23eed98535 req-efdd5943-eb09-4f6f-8843-ac8131e4d638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935ae66a-87b3-42a0-99ec-679dedd8f3df", "name": "network-vif-plugged", "status": "completed", "tag": "c36f3c36-3ad6-4297-b38d-d13e0fc6869d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:27.261847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e8915c19-6219-4985-b458-fd23eed98535 req-efdd5943-eb09-4f6f-8843-ac8131e4d638 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.262188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e8915c19-6219-4985-b458-fd23eed98535 req-efdd5943-eb09-4f6f-8843-ac8131e4d638 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.277136 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e8915c19-6219-4985-b458-fd23eed98535 req-efdd5943-eb09-4f6f-8843-ac8131e4d638 service nova] Creating event network-vif-plugged:c36f3c36-3ad6-4297-b38d-d13e0fc6869d for instance 935ae66a-87b3-42a0-99ec-679dedd8f3df on n-h2-708768-8 Jul 26 19:49:27.283586 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e8915c19-6219-4985-b458-fd23eed98535 req-efdd5943-eb09-4f6f-8843-ac8131e4d638 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037651 Jul 26 19:49:27.284844 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 853/1657] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:27.291432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9159cced-185c-4328-b28f-14f30c25731c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:27.292434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9159cced-185c-4328-b28f-14f30c25731c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:27.300091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9159cced-185c-4328-b28f-14f30c25731c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.300543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9159cced-185c-4328-b28f-14f30c25731c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.301411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9159cced-185c-4328-b28f-14f30c25731c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.301849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9159cced-185c-4328-b28f-14f30c25731c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.312953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Building network info cache for instance {{(pid=125964) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:49:27.512727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9159cced-185c-4328-b28f-14f30c25731c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:27.529008 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9159cced-185c-4328-b28f-14f30c25731c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1317 microversion: 2.1 time: 0.238631 Jul 26 19:49:27.530605 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 854/1658] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:27 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:27.540651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80edce67-3ac2-4c80-ae88-4472acbe0747 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:27.541822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80edce67-3ac2-4c80-ae88-4472acbe0747 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:27.561670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80edce67-3ac2-4c80-ae88-4472acbe0747 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.562524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80edce67-3ac2-4c80-ae88-4472acbe0747 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.563508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80edce67-3ac2-4c80-ae88-4472acbe0747 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.564159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80edce67-3ac2-4c80-ae88-4472acbe0747 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.784022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-80edce67-3ac2-4c80-ae88-4472acbe0747 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:27.788393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:27.793005 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80edce67-3ac2-4c80-ae88-4472acbe0747 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1325 microversion: 2.1 time: 0.259178 Jul 26 19:49:27.793601 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 855/1659] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:27 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1325 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:27.799193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-650caa86-32ee-4c7c-8bbc-91f7380ce3ff req-d35a9120-29c7-4728-b441-9845a73ee950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f39e3c9-d789-460b-a36b-c5b9e3527888", "tag": "643df902-6645-4b6e-9c71-22da5df80018"}, {"name": "network-changed", "server_uuid": "7e62231c-b880-4fb8-af6e-4dfaf7047ab4", "tag": "2f227705-754f-4502-bdae-24b122de042d"}, {"name": "network-changed", "server_uuid": "8cea81bb-4094-43a7-b913-64a304aec896", "tag": "04875e86-a1fa-4ee6-8b44-63eb3acb230c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:27.812537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-650caa86-32ee-4c7c-8bbc-91f7380ce3ff req-d35a9120-29c7-4728-b441-9845a73ee950 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.812976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-650caa86-32ee-4c7c-8bbc-91f7380ce3ff req-d35a9120-29c7-4728-b441-9845a73ee950 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.831728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-650caa86-32ee-4c7c-8bbc-91f7380ce3ff req-d35a9120-29c7-4728-b441-9845a73ee950 service nova] Creating event network-changed:643df902-6645-4b6e-9c71-22da5df80018 for instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 on n-h1-708768-8 Jul 26 19:49:27.832636 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-650caa86-32ee-4c7c-8bbc-91f7380ce3ff req-d35a9120-29c7-4728-b441-9845a73ee950 service nova] Creating event network-changed:2f227705-754f-4502-bdae-24b122de042d for instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 on n-h1-708768-8 Jul 26 19:49:27.833334 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-650caa86-32ee-4c7c-8bbc-91f7380ce3ff req-d35a9120-29c7-4728-b441-9845a73ee950 service nova] Creating event network-changed:04875e86-a1fa-4ee6-8b44-63eb3acb230c for instance 8cea81bb-4094-43a7-b913-64a304aec896 on n-h2-708768-8 Jul 26 19:49:27.843868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-650caa86-32ee-4c7c-8bbc-91f7380ce3ff req-d35a9120-29c7-4728-b441-9845a73ee950 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.048643 Jul 26 19:49:27.845078 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 856/1660] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:27.852998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-20f82f0a-95cb-4fc4-a162-39ca2de07062 req-0967e5bb-5e02-48d7-bc42-4503812ca36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050494f0-8ecf-4ca8-a74c-cfa13118930b", "tag": "4dd62864-a2c3-48eb-8843-d6680b22facb"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:27.865605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-20f82f0a-95cb-4fc4-a162-39ca2de07062 req-0967e5bb-5e02-48d7-bc42-4503812ca36e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.866056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-20f82f0a-95cb-4fc4-a162-39ca2de07062 req-0967e5bb-5e02-48d7-bc42-4503812ca36e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.878045 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-20f82f0a-95cb-4fc4-a162-39ca2de07062 req-0967e5bb-5e02-48d7-bc42-4503812ca36e service nova] Creating event network-changed:4dd62864-a2c3-48eb-8843-d6680b22facb for instance 050494f0-8ecf-4ca8-a74c-cfa13118930b on n-h2-708768-8 Jul 26 19:49:27.883555 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-20f82f0a-95cb-4fc4-a162-39ca2de07062 req-0967e5bb-5e02-48d7-bc42-4503812ca36e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036954 Jul 26 19:49:27.884451 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 857/1661] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:27.890200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:27.890900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:27.897499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.897941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.899346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.899817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.964274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Updating instance_info_cache with network_info: [{"id": "4dd62864-a2c3-48eb-8843-d6680b22facb", "address": "fa:16:3e:53:61:31", "network": {"id": "618bcde5-26e7-4388-b600-7bc024c2b781", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-875896179-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "56462831b5fc4ac7b87c7da6ea7f172e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4dd62864-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125964) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:49:27.978180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Releasing lock "refresh_cache-050494f0-8ecf-4ca8-a74c-cfa13118930b" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:49:27.979330 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4d0cad9b-93eb-4247-b3f4-265c93b0b682 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action" status: 202 len: 0 microversion: 2.1 time: 2.243536 Jul 26 19:49:27.980096 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 805/1662] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:25 2022] POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action => generated 0 bytes in 2245 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 19:49:27.985064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7cda870-2d33-4461-a482-f58d155ecdf8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:27.985889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c7cda870-2d33-4461-a482-f58d155ecdf8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:27.992507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7cda870-2d33-4461-a482-f58d155ecdf8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.993161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7cda870-2d33-4461-a482-f58d155ecdf8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:27.994035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7cda870-2d33-4461-a482-f58d155ecdf8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:27.994579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7cda870-2d33-4461-a482-f58d155ecdf8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:28.162449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c7cda870-2d33-4461-a482-f58d155ecdf8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:28.171031 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c7cda870-2d33-4461-a482-f58d155ecdf8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1506 microversion: 2.1 time: 0.189589 Jul 26 19:49:28.172724 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 806/1663] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:27 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:28.179115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d355a1c4-d276-4415-8225-4da13a642a6a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8756ed6d30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:28.237049 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d355a1c4-d276-4415-8225-4da13a642a6a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac" status: 200 len: 1427 microversion: 2.1 time: 0.062713 Jul 26 19:49:28.237978 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 807/1664] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:28 2022] GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:28.243957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee3c1878-915b-44bf-b8d7-f6c646e4cb87 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'create', calling method: .version_select at 0x7f8756f519d0>, body: {"pool": "0276911f-94cd-4250-bec1-fa4860ff6b75"} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:28.506425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:28.518480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:28.521878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:28.523310 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e3b9169b-c9a5-47d1-95dd-33ae6f16f3e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.637446 Jul 26 19:49:28.524435 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 858/1665] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:27 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:28.529463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-78a373bd-cb28-4b58-8ee8-cd2d48a4e059 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:28.530493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-78a373bd-cb28-4b58-8ee8-cd2d48a4e059 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:28.537698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78a373bd-cb28-4b58-8ee8-cd2d48a4e059 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:28.538307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78a373bd-cb28-4b58-8ee8-cd2d48a4e059 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:28.539227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78a373bd-cb28-4b58-8ee8-cd2d48a4e059 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:28.539949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78a373bd-cb28-4b58-8ee8-cd2d48a4e059 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:28.885729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-78a373bd-cb28-4b58-8ee8-cd2d48a4e059 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:28.899410 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-78a373bd-cb28-4b58-8ee8-cd2d48a4e059 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1310 microversion: 2.1 time: 0.373864 Jul 26 19:49:28.901347 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 859/1666] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:28 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1310 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:28.907272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e22a35a8-55f4-4950-a2f1-c217fc263955 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:28.908887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e22a35a8-55f4-4950-a2f1-c217fc263955 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:28.921987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e22a35a8-55f4-4950-a2f1-c217fc263955 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:28.923570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e22a35a8-55f4-4950-a2f1-c217fc263955 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:28.925235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e22a35a8-55f4-4950-a2f1-c217fc263955 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:28.926321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e22a35a8-55f4-4950-a2f1-c217fc263955 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:29.261036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e22a35a8-55f4-4950-a2f1-c217fc263955 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:29.272059 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e22a35a8-55f4-4950-a2f1-c217fc263955 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1317 microversion: 2.1 time: 0.369568 Jul 26 19:49:29.273269 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 860/1667] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:28 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:29.301765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b9f5182d-07d4-4514-8fb5-43890f16c9bf tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:29.302799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b9f5182d-07d4-4514-8fb5-43890f16c9bf tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:29.322115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9f5182d-07d4-4514-8fb5-43890f16c9bf tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:29.323475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9f5182d-07d4-4514-8fb5-43890f16c9bf tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:29.327790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9f5182d-07d4-4514-8fb5-43890f16c9bf tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:29.328694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9f5182d-07d4-4514-8fb5-43890f16c9bf tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:29.649458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b9f5182d-07d4-4514-8fb5-43890f16c9bf tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:29.657178 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b9f5182d-07d4-4514-8fb5-43890f16c9bf tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1325 microversion: 2.1 time: 0.382674 Jul 26 19:49:29.658626 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 861/1668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:29 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:29.675115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5fbeda9a-a4ad-4122-a7a5-757b20e3a0d3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:29.676018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5fbeda9a-a4ad-4122-a7a5-757b20e3a0d3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:29.682266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:29.684305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fbeda9a-a4ad-4122-a7a5-757b20e3a0d3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:29.684973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fbeda9a-a4ad-4122-a7a5-757b20e3a0d3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:29.685947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fbeda9a-a4ad-4122-a7a5-757b20e3a0d3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:29.686545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fbeda9a-a4ad-4122-a7a5-757b20e3a0d3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.008935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5fbeda9a-a4ad-4122-a7a5-757b20e3a0d3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:30.011019 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ee3c1878-915b-44bf-b8d7-f6c646e4cb87 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.771144 Jul 26 19:49:30.012416 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 808/1669] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:49:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:30.017491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11f98532-b0eb-48cb-9c84-4b3b9dd4fdfb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f8757124dc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:30.019290 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5fbeda9a-a4ad-4122-a7a5-757b20e3a0d3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1506 microversion: 2.1 time: 0.359298 Jul 26 19:49:30.035534 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 862/1670] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:29 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:30.040916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e366ddf2-bee6-4d58-97f8-525d11bc21be req-b677dd9a-13b7-4977-934f-58e0f70cf048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72cafc58-bc33-4e37-8484-b7067c652a12", "name": "network-vif-plugged", "status": "completed", "tag": "efe749c8-7803-417c-adea-7ae5a57594cd"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:30.054603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e366ddf2-bee6-4d58-97f8-525d11bc21be req-b677dd9a-13b7-4977-934f-58e0f70cf048 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.055050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e366ddf2-bee6-4d58-97f8-525d11bc21be req-b677dd9a-13b7-4977-934f-58e0f70cf048 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.067413 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e366ddf2-bee6-4d58-97f8-525d11bc21be req-b677dd9a-13b7-4977-934f-58e0f70cf048 service nova] Creating event network-vif-plugged:efe749c8-7803-417c-adea-7ae5a57594cd for instance 72cafc58-bc33-4e37-8484-b7067c652a12 on n-h1-708768-8 Jul 26 19:49:30.073317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e366ddf2-bee6-4d58-97f8-525d11bc21be req-b677dd9a-13b7-4977-934f-58e0f70cf048 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036080 Jul 26 19:49:30.076659 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 863/1671] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:30.079402 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11f98532-b0eb-48cb-9c84-4b3b9dd4fdfb tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac" status: 200 len: 1427 microversion: 2.1 time: 0.065659 Jul 26 19:49:30.080471 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 809/1672] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:30 2022] GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:30.082293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:30.084268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:30.085825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-76101eb4-9441-46d9-9b2c-8b85510a83d6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:30.086441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-76101eb4-9441-46d9-9b2c-8b85510a83d6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:30.090856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.091314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.092103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.092784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76101eb4-9441-46d9-9b2c-8b85510a83d6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.093241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76101eb4-9441-46d9-9b2c-8b85510a83d6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.093530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.094016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76101eb4-9441-46d9-9b2c-8b85510a83d6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.094484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76101eb4-9441-46d9-9b2c-8b85510a83d6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.232324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-76101eb4-9441-46d9-9b2c-8b85510a83d6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:30.236142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:30.240490 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-76101eb4-9441-46d9-9b2c-8b85510a83d6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1493 microversion: 2.1 time: 0.158867 Jul 26 19:49:30.241070 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 810/1673] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:30 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1493 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:30.246144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.227"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:30.247460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:30.248662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:30.249016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:30.250182 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b85f285d-7154-476f-8691-a4ec9bde744c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.172552 Jul 26 19:49:30.250725 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 864/1674] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:30 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:30.255393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.255869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.256660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.257094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.286278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Acquired lock "refresh_cache-050494f0-8ecf-4ca8-a74c-cfa13118930b" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:49:30.323658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0dbae27f-cffd-4c6f-a0bc-66b3699bb26f tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:30.324722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0dbae27f-cffd-4c6f-a0bc-66b3699bb26f tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:30.331026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dbae27f-cffd-4c6f-a0bc-66b3699bb26f tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.331489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dbae27f-cffd-4c6f-a0bc-66b3699bb26f tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.332301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dbae27f-cffd-4c6f-a0bc-66b3699bb26f tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.332970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dbae27f-cffd-4c6f-a0bc-66b3699bb26f tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.459987 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0dbae27f-cffd-4c6f-a0bc-66b3699bb26f tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1644 microversion: 2.1 time: 0.199012 Jul 26 19:49:30.460568 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 865/1675] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:30 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1644 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:30.480162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-535e272b-5c19-42ed-8ddb-f44b2236c8f3 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:30.480785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-535e272b-5c19-42ed-8ddb-f44b2236c8f3 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:30.487256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-535e272b-5c19-42ed-8ddb-f44b2236c8f3 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.487444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-535e272b-5c19-42ed-8ddb-f44b2236c8f3 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.488122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-535e272b-5c19-42ed-8ddb-f44b2236c8f3 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.488583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-535e272b-5c19-42ed-8ddb-f44b2236c8f3 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.719159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.227 (38a4ef48-5314-4538-b066-15ed2f011a87) with port 4dd62864-a2c3-48eb-8843-d6680b22facb using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0276911f-94cd-4250-bec1-fa4860ff6b75.", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:49:30.719981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Releasing lock "refresh_cache-050494f0-8ecf-4ca8-a74c-cfa13118930b" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:49:30.720689 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.227 (38a4ef48-5314-4538-b066-15ed2f011a87) with port 4dd62864-a2c3-48eb-8843-d6680b22facb using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0276911f-94cd-4250-bec1-fa4860ff6b75. Jul 26 19:49:30.720689 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-6a2cde1e-e48b-4e58-8e43-583eb1801b07'] Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Request method failure captured: Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action HTTP/1.1 Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 46 Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUejU1Gov_nMXWVSbK7IZwuY_Xk0MZ5zF-GbuO_QvhZjBX7QVZD4TgDMq1jpxcCSXjvslAkah7VuM6FsaENg0aGna0G9R_eBdJBKPnMRY7nJqoRvOC26L-mMP-pkT6sb3BoKN_-XGMqIzk8v8VLuq7mGkrJDD-iBEtTq6IEUMIQFbk Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56462831b5fc4ac7b87c7da6ea7f172e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}] Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2952a164d671418eb175f38b70a4283e Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: {"addFloatingIp": {"address": "172.25.0.227"}} Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot associate floating IP 172.25.0.227 (38a4ef48-5314-4538-b066-15ed2f011a87) with port 4dd62864-a2c3-48eb-8843-d6680b22facb using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0276911f-94cd-4250-bec1-fa4860ff6b75. Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-6a2cde1e-e48b-4e58-8e43-583eb1801b07'] Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '050494f0-8ecf-4ca8-a74c-cfa13118930b', 'body': {'addFloatingIp': {'address': '172.25.0.227'}}} Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:49:30.728335 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.227 (38a4ef48-5314-4538-b066-15ed2f011a87) with port 4dd62864-a2c3-48eb-8843-d6680b22facb using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0276911f-94cd-4250-bec1-fa4860ff6b75. Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a2cde1e-e48b-4e58-8e43-583eb1801b07'] Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.227 (38a4ef48-5314-4538-b066-15ed2f011a87) with port 4dd62864-a2c3-48eb-8843-d6680b22facb using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0276911f-94cd-4250-bec1-fa4860ff6b75. Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a2cde1e-e48b-4e58-8e43-583eb1801b07'] Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.227 (38a4ef48-5314-4538-b066-15ed2f011a87) with port 4dd62864-a2c3-48eb-8843-d6680b22facb using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0276911f-94cd-4250-bec1-fa4860ff6b75. Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a2cde1e-e48b-4e58-8e43-583eb1801b07'] Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.227 (38a4ef48-5314-4538-b066-15ed2f011a87) with port 4dd62864-a2c3-48eb-8843-d6680b22facb using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0276911f-94cd-4250-bec1-fa4860ff6b75. Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a2cde1e-e48b-4e58-8e43-583eb1801b07'] Jul 26 19:49:30.737425 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:30.741652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Returning 400 to user: Cannot associate floating IP 172.25.0.227 (38a4ef48-5314-4538-b066-15ed2f011a87) with port 4dd62864-a2c3-48eb-8843-d6680b22facb using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0276911f-94cd-4250-bec1-fa4860ff6b75. Jul 26 19:49:30.741652 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-6a2cde1e-e48b-4e58-8e43-583eb1801b07'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:30.741652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ac425a9-f700-4db5-b385-88a8d9c6b956 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action" status: 400 len: 381 microversion: 2.1 time: 0.487711 Jul 26 19:49:30.741652 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 811/1676] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:30 2022] POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action => generated 381 bytes in 489 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:49:30.741652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9085cc3d-8a20-4472-989f-30085d368dfc tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:30.744667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9085cc3d-8a20-4472-989f-30085d368dfc tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:30.757202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9085cc3d-8a20-4472-989f-30085d368dfc tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.757947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9085cc3d-8a20-4472-989f-30085d368dfc tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.758595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9085cc3d-8a20-4472-989f-30085d368dfc tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.759138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9085cc3d-8a20-4472-989f-30085d368dfc tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.771430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-535e272b-5c19-42ed-8ddb-f44b2236c8f3 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:30.794530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-535e272b-5c19-42ed-8ddb-f44b2236c8f3 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1317 microversion: 2.1 time: 0.316234 Jul 26 19:49:30.796592 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 866/1677] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:30 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:30.824987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d8a25b0-67a3-48f3-8aeb-54edf3eb01ea tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:30.828971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9d8a25b0-67a3-48f3-8aeb-54edf3eb01ea tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:30.842088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d8a25b0-67a3-48f3-8aeb-54edf3eb01ea tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.842853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d8a25b0-67a3-48f3-8aeb-54edf3eb01ea tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.844392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d8a25b0-67a3-48f3-8aeb-54edf3eb01ea tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:30.856804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d8a25b0-67a3-48f3-8aeb-54edf3eb01ea tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:30.990600 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9085cc3d-8a20-4472-989f-30085d368dfc tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1644 microversion: 2.1 time: 0.258965 Jul 26 19:49:30.991224 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 812/1678] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:30 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1644 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:31.029757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f863b94a-fde9-4c9d-a7f4-91b67d52607f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '.version_select at 0x7f8756fbf940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:31.206899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9d8a25b0-67a3-48f3-8aeb-54edf3eb01ea tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:31.215380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9d8a25b0-67a3-48f3-8aeb-54edf3eb01ea tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1325 microversion: 2.1 time: 0.417468 Jul 26 19:49:31.229917 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 867/1679] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:30 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1325 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:31.234681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f2fd4a9c-e511-4ccd-b9e5-56a3a1cb376d tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:31.237406 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:49:31.237406 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:49:31.239229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a9c-e511-4ccd-b9e5-56a3a1cb376d tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:31.240374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a9c-e511-4ccd-b9e5-56a3a1cb376d tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:31.241232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a9c-e511-4ccd-b9e5-56a3a1cb376d tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:31.241668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2fd4a9c-e511-4ccd-b9e5-56a3a1cb376d tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:31.272179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f2fd4a9c-e511-4ccd-b9e5-56a3a1cb376d tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040899 Jul 26 19:49:31.273148 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 868/1680] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 19:49:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:31.277864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90dd44c8-36f7-4e58-9736-c9ac8c90ef00 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:31.278480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90dd44c8-36f7-4e58-9736-c9ac8c90ef00 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:31.286043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90dd44c8-36f7-4e58-9736-c9ac8c90ef00 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:31.286519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90dd44c8-36f7-4e58-9736-c9ac8c90ef00 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:31.287376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90dd44c8-36f7-4e58-9736-c9ac8c90ef00 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:31.287863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90dd44c8-36f7-4e58-9736-c9ac8c90ef00 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:31.435465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90dd44c8-36f7-4e58-9736-c9ac8c90ef00 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:31.444216 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90dd44c8-36f7-4e58-9736-c9ac8c90ef00 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1506 microversion: 2.1 time: 0.169933 Jul 26 19:49:31.457280 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 869/1681] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:31 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:31.457280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31531009-d90d-4b88-a2e4-1d5069c647fd tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875f3fbdc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:31.503910 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31531009-d90d-4b88-a2e4-1d5069c647fd tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac" status: 200 len: 1427 microversion: 2.1 time: 0.057435 Jul 26 19:49:31.505266 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 870/1682] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:31 2022] GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:31.647407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a32ffd82-9bee-486c-aed3-5b49092d1c63"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:31.649994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:31.656826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:31.657281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:31.658577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:31.659014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:31.776751 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] HTTP exception thrown: Volume a32ffd82-9bee-486c-aed3-5b49092d1c63 could not be found. Jul 26 19:49:31.945833 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f863b94a-fde9-4c9d-a7f4-91b67d52607f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/38a4ef48-5314-4538-b066-15ed2f011a87" status: 202 len: 0 microversion: 2.1 time: 0.934652 Jul 26 19:49:31.946422 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 813/1683] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:49:31 2022] DELETE /compute/v2.1/os-floating-ips/38a4ef48-5314-4538-b066-15ed2f011a87 => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:49:31.951313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:31.951949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:31.959265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:31.959818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:31.960657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:31.961313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Request method failure captured: Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments/714a8970-29be-4851-a9cd-2118e8bbe4d9 HTTP/1.1 Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 74 Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ETynJvrcF9ZsJjgRI1IeSLiALk1NQY-h4PuOH2--C-ntXFtt52L5gm0Q_01T7evM5htn4TmlkvcTETkbknpYpNwxjb3FyJdndMeDUEp7iiiAhovsFCMD2_CyS1GIJu6lnSwPRvO80ScmLDN5ugyX9ci15fryHjNKiaeFZQ07A37jo8 Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 54301d9fbaa941ed9b4771757a4c648f Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesAdminNegativeTest-2101911032 Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/54301d9fbaa941ed9b4771757a4c648f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54301d9fbaa941ed9b4771757a4c648f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_54301d9fbaa941ed9b4771757a4c648f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54301d9fbaa941ed9b4771757a4c648f"}]}] Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesAdminNegativeTest-2101911032 Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 54301d9fbaa941ed9b4771757a4c648f Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2101911032 Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesAdminNegativeTest-2101911032-project-admin Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: b26da98347454de39e7dc55f572418ef Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesAdminNegativeTest-2101911032-project-admin Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: {"volumeAttachment": {"volumeId": "a32ffd82-9bee-486c-aed3-5b49092d1c63"}} Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: exception: Volume a32ffd82-9bee-486c-aed3-5b49092d1c63 could not be found. Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': 'a882035e-ffcb-4327-8443-26bc7f4d9bca', 'id': '714a8970-29be-4851-a9cd-2118e8bbe4d9', 'body': {'volumeAttachment': {'volumeId': 'a32ffd82-9bee-486c-aed3-5b49092d1c63'}}} Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a32ffd82-9bee-486c-aed3-5b49092d1c63 could not be found. (HTTP 404) (Request-ID: req-1e1d7c57-e268-432f-a06b-4461ea6745f4) Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:49:31.980335 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a32ffd82-9bee-486c-aed3-5b49092d1c63 could not be found. Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume a32ffd82-9bee-486c-aed3-5b49092d1c63 could not be found. Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a32ffd82-9bee-486c-aed3-5b49092d1c63 could not be found. Jul 26 19:49:31.985905 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:31.993438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Returning 400 to user: Volume a32ffd82-9bee-486c-aed3-5b49092d1c63 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:31.994219 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fb641c8d-5173-4299-b7df-2b5af32ed9cc tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments/714a8970-29be-4851-a9cd-2118e8bbe4d9" status: 400 len: 107 microversion: 2.1 time: 0.487665 Jul 26 19:49:31.994991 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 871/1684] 10.222.0.58 () {60 vars in 1433 bytes} [Tue Jul 26 19:49:31 2022] PUT /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments/714a8970-29be-4851-a9cd-2118e8bbe4d9 => generated 107 bytes in 489 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:49:32.002741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-708768-8", "block_migration": true, "disk_over_commit": false}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:32.005652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:32.015167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:32.015979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:32.016996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:32.017620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:32.090426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lazy-loading 'flavor' on Instance uuid 935ae66a-87b3-42a0-99ec-679dedd8f3df {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:49:32.107018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Going to try to live migrate instance to n-h1-708768-8 {{(pid=125963) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:49:32.136424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:32.147157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:32.148675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:32.165082 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3daf22f4-8e8a-46b1-82ed-f8e50e626ef2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.217360 Jul 26 19:49:32.165671 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 814/1685] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:31 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:32.170487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-71c3793b-b175-4bec-a058-e9741d481af9 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:32.171090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-71c3793b-b175-4bec-a058-e9741d481af9 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:32.177982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71c3793b-b175-4bec-a058-e9741d481af9 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:32.178651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71c3793b-b175-4bec-a058-e9741d481af9 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:32.179631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71c3793b-b175-4bec-a058-e9741d481af9 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:32.180213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71c3793b-b175-4bec-a058-e9741d481af9 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:32.409263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-71c3793b-b175-4bec-a058-e9741d481af9 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:32.418993 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-71c3793b-b175-4bec-a058-e9741d481af9 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1317 microversion: 2.1 time: 0.251122 Jul 26 19:49:32.420045 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 815/1686] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:32 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:32.425163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'action', calling method: .version_select at 0x7f8765f14a60>, body: {"removeFloatingIp": {"address": "172.25.0.32"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:32.662124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:32.669528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:32.669989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:32.670787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:32.671250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:33.495802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Acquired lock "refresh_cache-050494f0-8ecf-4ca8-a74c-cfa13118930b" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:49:33.917163 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7b78cbaa-d3c2-4032-a8a2-4bf21edbe866 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df/action" status: 202 len: 0 microversion: 2.1 time: 1.920377 Jul 26 19:49:33.924011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 872/1687] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:31 2022] POST /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df/action => generated 0 bytes in 1928 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:49:33.932001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-30c1935e-53dc-47cc-955c-a78dacd785e4 req-ffa3f68b-05c0-468f-91cc-465c934b8fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e62231c-b880-4fb8-af6e-4dfaf7047ab4", "name": "network-vif-plugged", "status": "completed", "tag": "2f227705-754f-4502-bdae-24b122de042d"}, {"server_uuid": "8cea81bb-4094-43a7-b913-64a304aec896", "name": "network-vif-plugged", "status": "completed", "tag": "04875e86-a1fa-4ee6-8b44-63eb3acb230c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:33.967154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-30c1935e-53dc-47cc-955c-a78dacd785e4 req-ffa3f68b-05c0-468f-91cc-465c934b8fd1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:33.969736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-30c1935e-53dc-47cc-955c-a78dacd785e4 req-ffa3f68b-05c0-468f-91cc-465c934b8fd1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:33.998576 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-30c1935e-53dc-47cc-955c-a78dacd785e4 req-ffa3f68b-05c0-468f-91cc-465c934b8fd1 service nova] Creating event network-vif-plugged:2f227705-754f-4502-bdae-24b122de042d for instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 on n-h1-708768-8 Jul 26 19:49:34.005913 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-30c1935e-53dc-47cc-955c-a78dacd785e4 req-ffa3f68b-05c0-468f-91cc-465c934b8fd1 service nova] Creating event network-vif-plugged:04875e86-a1fa-4ee6-8b44-63eb3acb230c for instance 8cea81bb-4094-43a7-b913-64a304aec896 on n-h2-708768-8 Jul 26 19:49:34.028964 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-30c1935e-53dc-47cc-955c-a78dacd785e4 req-ffa3f68b-05c0-468f-91cc-465c934b8fd1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103051 Jul 26 19:49:34.030715 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 873/1688] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:34.043983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-665454d8-8d2a-4990-be74-607012028019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:34.045221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-665454d8-8d2a-4990-be74-607012028019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:34.065557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-665454d8-8d2a-4990-be74-607012028019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:34.066301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-665454d8-8d2a-4990-be74-607012028019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:34.072659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-665454d8-8d2a-4990-be74-607012028019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:34.073355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-665454d8-8d2a-4990-be74-607012028019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:34.380138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-665454d8-8d2a-4990-be74-607012028019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lazy-loading 'services' on Instance uuid a882035e-ffcb-4327-8443-26bc7f4d9bca {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:49:34.436908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:34.636876 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-665454d8-8d2a-4990-be74-607012028019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments/714a8970-29be-4851-a9cd-2118e8bbe4d9" status: 202 len: 0 microversion: 2.1 time: 0.601362 Jul 26 19:49:34.638661 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 874/1689] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 19:49:34 2022] DELETE /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments/714a8970-29be-4851-a9cd-2118e8bbe4d9 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:49:34.689360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c9ff2de-d513-4ca6-9f57-8d9916993f7c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:34.691602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8c9ff2de-d513-4ca6-9f57-8d9916993f7c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:34.751856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9ff2de-d513-4ca6-9f57-8d9916993f7c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:34.754684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9ff2de-d513-4ca6-9f57-8d9916993f7c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:34.755995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9ff2de-d513-4ca6-9f57-8d9916993f7c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:34.758094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9ff2de-d513-4ca6-9f57-8d9916993f7c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:34.827528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Building network info cache for instance {{(pid=125964) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:49:35.062945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8c9ff2de-d513-4ca6-9f57-8d9916993f7c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:35.073321 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c9ff2de-d513-4ca6-9f57-8d9916993f7c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1523 microversion: 2.1 time: 0.432537 Jul 26 19:49:35.074539 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 875/1690] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:34 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:35.079548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ec95cd64-aba2-48ab-a827-7ed0b90cc03b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:35.080200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ec95cd64-aba2-48ab-a827-7ed0b90cc03b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:35.087375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec95cd64-aba2-48ab-a827-7ed0b90cc03b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:35.088451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec95cd64-aba2-48ab-a827-7ed0b90cc03b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:35.089262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec95cd64-aba2-48ab-a827-7ed0b90cc03b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:35.089701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec95cd64-aba2-48ab-a827-7ed0b90cc03b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:35.687216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ec95cd64-aba2-48ab-a827-7ed0b90cc03b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:35.695681 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ec95cd64-aba2-48ab-a827-7ed0b90cc03b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1522 microversion: 2.1 time: 0.619637 Jul 26 19:49:35.696272 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 876/1691] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:35 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1522 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:35.707252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-141f76d6-5953-428d-bab5-6907085a8580 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875ecdc3a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:36.200467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Updating instance_info_cache with network_info: [{"id": "4dd62864-a2c3-48eb-8843-d6680b22facb", "address": "fa:16:3e:53:61:31", "network": {"id": "618bcde5-26e7-4388-b600-7bc024c2b781", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-875896179-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "56462831b5fc4ac7b87c7da6ea7f172e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4dd62864-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125964) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:49:36.218860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Releasing lock "refresh_cache-050494f0-8ecf-4ca8-a74c-cfa13118930b" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:49:36.220174 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8897d423-2581-4299-bc17-bc9ee5fbd2a9 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action" status: 202 len: 0 microversion: 2.1 time: 3.798990 Jul 26 19:49:36.224436 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 816/1692] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:32 2022] POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action => generated 0 bytes in 3804 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 19:49:36.233784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:36.247219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:36.267755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:36.269403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:36.276788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:36.280374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:36.893853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:36.912921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:36.918656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:36.920831 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3cd46b7a-08d7-4b2e-b41a-88be12473911 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1812 microversion: 2.25 time: 0.695175 Jul 26 19:49:36.936743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 817/1693] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:36 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1812 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:36.945746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df5c659a-6e02-459a-b2cb-cf2590c49216 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:36.947299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df5c659a-6e02-459a-b2cb-cf2590c49216 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:36.968090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df5c659a-6e02-459a-b2cb-cf2590c49216 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:36.968816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df5c659a-6e02-459a-b2cb-cf2590c49216 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:36.974620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df5c659a-6e02-459a-b2cb-cf2590c49216 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:36.975323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df5c659a-6e02-459a-b2cb-cf2590c49216 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:37.476597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-df5c659a-6e02-459a-b2cb-cf2590c49216 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:37.484579 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df5c659a-6e02-459a-b2cb-cf2590c49216 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 200 len: 1504 microversion: 2.1 time: 0.546021 Jul 26 19:49:37.485157 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 818/1694] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:36 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:37.507653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1858ce03-0ce4-421b-8d77-23b3d28cdc2b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:37.507653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1858ce03-0ce4-421b-8d77-23b3d28cdc2b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:37.556834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1858ce03-0ce4-421b-8d77-23b3d28cdc2b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:37.557284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1858ce03-0ce4-421b-8d77-23b3d28cdc2b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:37.558079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1858ce03-0ce4-421b-8d77-23b3d28cdc2b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:37.558518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1858ce03-0ce4-421b-8d77-23b3d28cdc2b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:38.260823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1858ce03-0ce4-421b-8d77-23b3d28cdc2b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:38.268016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:38.272980 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1858ce03-0ce4-421b-8d77-23b3d28cdc2b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1503 microversion: 2.1 time: 0.786766 Jul 26 19:49:38.277613 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 819/1695] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:37 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1503 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:38.284627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29c92c81-f9aa-41e1-82ad-0b3c996de644 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:38.308795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-29c92c81-f9aa-41e1-82ad-0b3c996de644 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:38.334709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29c92c81-f9aa-41e1-82ad-0b3c996de644 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:38.336795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29c92c81-f9aa-41e1-82ad-0b3c996de644 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:38.338383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29c92c81-f9aa-41e1-82ad-0b3c996de644 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:38.339585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29c92c81-f9aa-41e1-82ad-0b3c996de644 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:38.399408 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29c92c81-f9aa-41e1-82ad-0b3c996de644 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120415 Jul 26 19:49:38.407594 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 820/1696] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:49:38 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:38.422873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b4cf5c55-5ccc-46cb-82b6-35d44b751543 req-c221367b-afce-4bfb-b3bc-b4511ad3676f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050494f0-8ecf-4ca8-a74c-cfa13118930b", "tag": "4dd62864-a2c3-48eb-8843-d6680b22facb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:38.445028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b4cf5c55-5ccc-46cb-82b6-35d44b751543 req-c221367b-afce-4bfb-b3bc-b4511ad3676f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:38.445726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b4cf5c55-5ccc-46cb-82b6-35d44b751543 req-c221367b-afce-4bfb-b3bc-b4511ad3676f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:38.480738 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b4cf5c55-5ccc-46cb-82b6-35d44b751543 req-c221367b-afce-4bfb-b3bc-b4511ad3676f service nova] Creating event network-changed:4dd62864-a2c3-48eb-8843-d6680b22facb for instance 050494f0-8ecf-4ca8-a74c-cfa13118930b on n-h2-708768-8 Jul 26 19:49:38.489489 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b4cf5c55-5ccc-46cb-82b6-35d44b751543 req-c221367b-afce-4bfb-b3bc-b4511ad3676f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079312 Jul 26 19:49:38.490723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 821/1697] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:38.523478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:38.524512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:38.542290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:38.548356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:38.549436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:38.550053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:38.651954 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] HTTP exception thrown: Action 999 not found Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Request method failure captured: Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12/os-instance-actions/999 HTTP/1.1 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUxlS-AkOd35eM4zR-3AsfWa3Pb6Y2uuw6mmGuDL6g5dVw0SUHDBvhw9h8XUsILM9yMX8ossqaM74oZegkLUwXiNYIsW9mpWqKeGbE_yf0U_kUkXqp9Z6EK8UGsUXWHmZfSELS5mz9AOWwB0gFUdz_Vj_xbms8AT6W3NgL65OeKRxs Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 76cff6b8f0eb4130acc4fbf20d111823 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76cff6b8f0eb4130acc4fbf20d111823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76cff6b8f0eb4130acc4fbf20d111823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76cff6b8f0eb4130acc4fbf20d111823", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76cff6b8f0eb4130acc4fbf20d111823"}]}] Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 76cff6b8f0eb4130acc4fbf20d111823 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-InstanceActionsNegativeTestJSON-66144696-project Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: f850c7cd5b0d494299638f3b37983089 Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-66144696-project Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: exception: Action 999 not found Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'server_id': '72cafc58-bc33-4e37-8484-b7067c652a12', 'id': '999'} Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 26 19:49:38.681635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:38.685801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Returning 404 to user: Action 999 not found {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:38.685801 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5bc0de56-7e82-4ae6-845e-2fd833e7754c tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.191253 Jul 26 19:49:38.685801 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 822/1698] 10.222.0.58 () {58 vars in 1308 bytes} [Tue Jul 26 19:49:38 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12/os-instance-actions/999 => generated 66 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:49:38.693303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-3d0b9146-cd7e-4cf6-b799-c6632de6ab79 req-6d3ce7d9-6037-4f95-8e9d-085e9527e9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f39e3c9-d789-460b-a36b-c5b9e3527888", "name": "network-vif-unplugged", "status": "completed", "tag": "643df902-6645-4b6e-9c71-22da5df80018"}, {"server_uuid": "7df01792-8d3a-4b9b-b786-3e1fa006643f", "name": "network-vif-plugged", "status": "completed", "tag": "09a7781d-402a-4e6c-a8a1-86b9d590132c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:38.728365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3d0b9146-cd7e-4cf6-b799-c6632de6ab79 req-6d3ce7d9-6037-4f95-8e9d-085e9527e9ae service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:38.728809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3d0b9146-cd7e-4cf6-b799-c6632de6ab79 req-6d3ce7d9-6037-4f95-8e9d-085e9527e9ae service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:38.791838 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3d0b9146-cd7e-4cf6-b799-c6632de6ab79 req-6d3ce7d9-6037-4f95-8e9d-085e9527e9ae service nova] Creating event network-vif-unplugged:643df902-6645-4b6e-9c71-22da5df80018 for instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 on n-h2-708768-8 Jul 26 19:49:38.792596 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3d0b9146-cd7e-4cf6-b799-c6632de6ab79 req-6d3ce7d9-6037-4f95-8e9d-085e9527e9ae service nova] Creating event network-vif-plugged:09a7781d-402a-4e6c-a8a1-86b9d590132c for instance 7df01792-8d3a-4b9b-b786-3e1fa006643f on n-h2-708768-8 Jul 26 19:49:38.818053 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-3d0b9146-cd7e-4cf6-b799-c6632de6ab79 req-6d3ce7d9-6037-4f95-8e9d-085e9527e9ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.132093 Jul 26 19:49:38.818978 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 823/1699] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:38.824242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-daad6027-0554-4d33-9407-36ed9f607622 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '.version_select at 0x7f87572d4280>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:41.250515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:41.576772 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-daad6027-0554-4d33-9407-36ed9f607622 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/e73d73bd-8b58-4079-9be9-fac1bb176dba" status: 202 len: 0 microversion: 2.1 time: 2.756477 Jul 26 19:49:41.577797 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 824/1700] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:49:38 2022] DELETE /compute/v2.1/os-floating-ips/e73d73bd-8b58-4079-9be9-fac1bb176dba => generated 0 bytes in 2758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:49:41.583508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-83ef9728-2dff-4114-88ae-f127c9ae7af9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:41.584425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83ef9728-2dff-4114-88ae-f127c9ae7af9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:41.600411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83ef9728-2dff-4114-88ae-f127c9ae7af9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:41.601959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83ef9728-2dff-4114-88ae-f127c9ae7af9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:41.603320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83ef9728-2dff-4114-88ae-f127c9ae7af9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:41.603923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83ef9728-2dff-4114-88ae-f127c9ae7af9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:42.480616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83ef9728-2dff-4114-88ae-f127c9ae7af9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:42.490072 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-83ef9728-2dff-4114-88ae-f127c9ae7af9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1522 microversion: 2.1 time: 0.910823 Jul 26 19:49:42.503678 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 825/1701] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:41 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1522 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:42.503678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-59eefe8b-ad45-4a3f-a9d7-7e58fd3999e1 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:42.503678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-59eefe8b-ad45-4a3f-a9d7-7e58fd3999e1 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 8cea81bb-4094-43a7-b913-64a304aec896] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:42.512013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59eefe8b-ad45-4a3f-a9d7-7e58fd3999e1 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:42.512013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59eefe8b-ad45-4a3f-a9d7-7e58fd3999e1 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:42.512013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59eefe8b-ad45-4a3f-a9d7-7e58fd3999e1 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:42.512013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59eefe8b-ad45-4a3f-a9d7-7e58fd3999e1 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:42.696427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-59eefe8b-ad45-4a3f-a9d7-7e58fd3999e1 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:42.707993 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-59eefe8b-ad45-4a3f-a9d7-7e58fd3999e1 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896" status: 200 len: 1504 microversion: 2.1 time: 0.214797 Jul 26 19:49:42.709348 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 826/1702] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:42 2022] GET /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:42.714975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:42.716066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:42.742978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:42.743333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:42.744364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:42.744582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.044147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:43.053309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:43.054849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:43.056067 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-648deed2-a62d-4bbc-99d5-a1b96d4e77f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1802 microversion: 2.25 time: 0.345388 Jul 26 19:49:43.062122 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 827/1703] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:42 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1802 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:43.068518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e166c5af-b41b-4c2b-9738-f4c8d553e488 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '.version_select at 0x7f8756fbf430>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:43.069082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e166c5af-b41b-4c2b-9738-f4c8d553e488 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: c83b7e61-f9b0-4538-9032-fabd017ba6d3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:43.079711 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-e166c5af-b41b-4c2b-9738-f4c8d553e488 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] HTTP exception thrown: Instance c83b7e61-f9b0-4538-9032-fabd017ba6d3 could not be found. Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e166c5af-b41b-4c2b-9738-f4c8d553e488 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Request method failure captured: Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/c83b7e61-f9b0-4538-9032-fabd017ba6d3/os-instance-actions HTTP/1.1 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUxlS-AkOd35eM4zR-3AsfWa3Pb6Y2uuw6mmGuDL6g5dVw0SUHDBvhw9h8XUsILM9yMX8ossqaM74oZegkLUwXiNYIsW9mpWqKeGbE_yf0U_kUkXqp9Z6EK8UGsUXWHmZfSELS5mz9AOWwB0gFUdz_Vj_xbms8AT6W3NgL65OeKRxs Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 76cff6b8f0eb4130acc4fbf20d111823 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76cff6b8f0eb4130acc4fbf20d111823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76cff6b8f0eb4130acc4fbf20d111823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76cff6b8f0eb4130acc4fbf20d111823", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76cff6b8f0eb4130acc4fbf20d111823"}]}] Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 76cff6b8f0eb4130acc4fbf20d111823 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-InstanceActionsNegativeTestJSON-66144696-project Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: f850c7cd5b0d494299638f3b37983089 Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-66144696-project Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance c83b7e61-f9b0-4538-9032-fabd017ba6d3 could not be found. Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'server_id': 'c83b7e61-f9b0-4538-9032-fabd017ba6d3'} Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83b7e61-f9b0-4538-9032-fabd017ba6d3 could not be found. Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:49:43.081338 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83b7e61-f9b0-4538-9032-fabd017ba6d3 could not be found. Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83b7e61-f9b0-4538-9032-fabd017ba6d3 could not be found. Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e166c5af-b41b-4c2b-9738-f4c8d553e488 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Returning 404 to user: Instance c83b7e61-f9b0-4538-9032-fabd017ba6d3 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e166c5af-b41b-4c2b-9738-f4c8d553e488 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/c83b7e61-f9b0-4538-9032-fabd017ba6d3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.019636 Jul 26 19:49:43.086528 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 828/1704] 10.222.0.58 () {58 vars in 1296 bytes} [Tue Jul 26 19:49:43 2022] GET /compute/v2.1/servers/c83b7e61-f9b0-4538-9032-fabd017ba6d3/os-instance-actions => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:49:43.089714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61a62629-6dbc-40a0-9468-2dd54bd970ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:43.090336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61a62629-6dbc-40a0-9468-2dd54bd970ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:43.097119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61a62629-6dbc-40a0-9468-2dd54bd970ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:43.097581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61a62629-6dbc-40a0-9468-2dd54bd970ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.098377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61a62629-6dbc-40a0-9468-2dd54bd970ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:43.098813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61a62629-6dbc-40a0-9468-2dd54bd970ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.471904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61a62629-6dbc-40a0-9468-2dd54bd970ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:43.480349 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61a62629-6dbc-40a0-9468-2dd54bd970ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1503 microversion: 2.1 time: 0.395413 Jul 26 19:49:43.483921 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 829/1705] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:43 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:43.495466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f2fa9cc-b86e-4b83-a563-29809d3abead tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:43.497862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f2fa9cc-b86e-4b83-a563-29809d3abead tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:43.513544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2fa9cc-b86e-4b83-a563-29809d3abead tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:43.513993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2fa9cc-b86e-4b83-a563-29809d3abead tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.515096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2fa9cc-b86e-4b83-a563-29809d3abead tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:43.515540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2fa9cc-b86e-4b83-a563-29809d3abead tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.590657 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f2fa9cc-b86e-4b83-a563-29809d3abead tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105512 Jul 26 19:49:43.591335 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 830/1706] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:49:43 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:43.595695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7b4c9995-08db-4857-8d06-66acdf352a46 req-e770d57f-d195-4f2e-ba70-17b8ef26663f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935ae66a-87b3-42a0-99ec-679dedd8f3df", "name": "network-vif-unplugged", "status": "completed", "tag": "c36f3c36-3ad6-4297-b38d-d13e0fc6869d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:43.617867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7b4c9995-08db-4857-8d06-66acdf352a46 req-e770d57f-d195-4f2e-ba70-17b8ef26663f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:43.618319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7b4c9995-08db-4857-8d06-66acdf352a46 req-e770d57f-d195-4f2e-ba70-17b8ef26663f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.641391 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7b4c9995-08db-4857-8d06-66acdf352a46 req-e770d57f-d195-4f2e-ba70-17b8ef26663f service nova] Creating event network-vif-unplugged:c36f3c36-3ad6-4297-b38d-d13e0fc6869d for instance 935ae66a-87b3-42a0-99ec-679dedd8f3df on n-h2-708768-8 Jul 26 19:49:43.661598 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7b4c9995-08db-4857-8d06-66acdf352a46 req-e770d57f-d195-4f2e-ba70-17b8ef26663f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069130 Jul 26 19:49:43.662528 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 831/1707] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:43.667602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e3e97dd2-7bb7-4f58-8e4a-2770afeecc58 req-08ae1aba-1fff-42ed-8457-1caf1a55dae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c880cc-b8a9-4167-aa94-5c52d9d130e0", "name": "network-vif-plugged", "status": "completed", "tag": "821f8e2a-ea44-4252-9be5-5e243e4d636e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:43.683737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e3e97dd2-7bb7-4f58-8e4a-2770afeecc58 req-08ae1aba-1fff-42ed-8457-1caf1a55dae2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:43.684476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e3e97dd2-7bb7-4f58-8e4a-2770afeecc58 req-08ae1aba-1fff-42ed-8457-1caf1a55dae2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.710916 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e3e97dd2-7bb7-4f58-8e4a-2770afeecc58 req-08ae1aba-1fff-42ed-8457-1caf1a55dae2 service nova] Creating event network-vif-plugged:821f8e2a-ea44-4252-9be5-5e243e4d636e for instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 on n-h1-708768-8 Jul 26 19:49:43.719602 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e3e97dd2-7bb7-4f58-8e4a-2770afeecc58 req-08ae1aba-1fff-42ed-8457-1caf1a55dae2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055683 Jul 26 19:49:43.728415 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 832/1708] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:43.734108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6c41990-49d9-49ff-b314-954101cdf455 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6c41990-49d9-49ff-b314-954101cdf455 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Request method failure captured: Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action HTTP/1.1 Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 34 Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUejU1Gov_nMXWVSbK7IZwuY_Xk0MZ5zF-GbuO_QvhZjBX7QVZD4TgDMq1jpxcCSXjvslAkah7VuM6FsaENg0aGna0G9R_eBdJBKPnMRY7nJqoRvOC26L-mMP-pkT6sb3BoKN_-XGMqIzk8v8VLuq7mGkrJDD-iBEtTq6IEUMIQFbk Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56462831b5fc4ac7b87c7da6ea7f172e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}] Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2952a164d671418eb175f38b70a4283e Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: {"addFloatingIp": {"address": ""}} Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '050494f0-8ecf-4ca8-a74c-cfa13118930b', 'body': {'addFloatingIp': {'address': ''}}} Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi '' Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:49:43.737972 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:43.745586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6c41990-49d9-49ff-b314-954101cdf455 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:43.755779 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f6c41990-49d9-49ff-b314-954101cdf455 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action" status: 400 len: 142 microversion: 2.1 time: 0.009700 Jul 26 19:49:43.756774 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 833/1709] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:43 2022] POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action => generated 142 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:49:43.761549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3d196cd-1af2-4c1b-83ca-041b441c6d6b tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:43.762206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3d196cd-1af2-4c1b-83ca-041b441c6d6b tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 8cea81bb-4094-43a7-b913-64a304aec896] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:43.769590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3d196cd-1af2-4c1b-83ca-041b441c6d6b tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:43.770611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3d196cd-1af2-4c1b-83ca-041b441c6d6b tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.771404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3d196cd-1af2-4c1b-83ca-041b441c6d6b tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:43.771941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3d196cd-1af2-4c1b-83ca-041b441c6d6b tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:43.831410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3d196cd-1af2-4c1b-83ca-041b441c6d6b tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 8cea81bb-4094-43a7-b913-64a304aec896] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:49:43.973296 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3d196cd-1af2-4c1b-83ca-041b441c6d6b tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896" status: 204 len: 0 microversion: 2.1 time: 0.215056 Jul 26 19:49:43.975028 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 834/1710] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:49:43 2022] DELETE /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:43.987881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd1c5e5e-cf36-4c3c-80f6-6a8965cdec35 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '.version_select at 0x7f8756f51310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:44.000091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd1c5e5e-cf36-4c3c-80f6-6a8965cdec35 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.001462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd1c5e5e-cf36-4c3c-80f6-6a8965cdec35 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.037295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd1c5e5e-cf36-4c3c-80f6-6a8965cdec35 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.059697 Jul 26 19:49:44.047995 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 835/1711] 10.222.0.58 () {60 vars in 1184 bytes} [Tue Jul 26 19:49:43 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:44.053964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98f0dd71-ab24-4bc4-8b80-a8bfa66970d3 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:44.054961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-98f0dd71-ab24-4bc4-8b80-a8bfa66970d3 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:44.062783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98f0dd71-ab24-4bc4-8b80-a8bfa66970d3 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.063636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98f0dd71-ab24-4bc4-8b80-a8bfa66970d3 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.065417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98f0dd71-ab24-4bc4-8b80-a8bfa66970d3 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.066101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98f0dd71-ab24-4bc4-8b80-a8bfa66970d3 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.101047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-98f0dd71-ab24-4bc4-8b80-a8bfa66970d3 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:49:44.321433 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98f0dd71-ab24-4bc4-8b80-a8bfa66970d3 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "DELETE /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 204 len: 0 microversion: 2.1 time: 0.271545 Jul 26 19:49:44.322532 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 836/1712] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:49:44 2022] DELETE /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:44.330132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-484c974c-7998-42aa-be78-56e5d319cf89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:44.330885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-484c974c-7998-42aa-be78-56e5d319cf89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:44.338972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-484c974c-7998-42aa-be78-56e5d319cf89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.339489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-484c974c-7998-42aa-be78-56e5d319cf89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.341949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-484c974c-7998-42aa-be78-56e5d319cf89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.342550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-484c974c-7998-42aa-be78-56e5d319cf89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.575722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-484c974c-7998-42aa-be78-56e5d319cf89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:44.585811 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-484c974c-7998-42aa-be78-56e5d319cf89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1522 microversion: 2.1 time: 0.261747 Jul 26 19:49:44.587549 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 837/1713] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:44 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:44.593437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:44.596146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:44.604766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.605602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.606829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.607868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.644193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Acquired lock "refresh_cache-050494f0-8ecf-4ca8-a74c-cfa13118930b" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:49:44.773003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Releasing lock "refresh_cache-050494f0-8ecf-4ca8-a74c-cfa13118930b" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:49:44.774376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] HTTP exception thrown: floating IP not found Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Request method failure captured: Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action HTTP/1.1 Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 41 Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUejU1Gov_nMXWVSbK7IZwuY_Xk0MZ5zF-GbuO_QvhZjBX7QVZD4TgDMq1jpxcCSXjvslAkah7VuM6FsaENg0aGna0G9R_eBdJBKPnMRY7nJqoRvOC26L-mMP-pkT6sb3BoKN_-XGMqIzk8v8VLuq7mGkrJDD-iBEtTq6IEUMIQFbk Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56462831b5fc4ac7b87c7da6ea7f172e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}] Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2952a164d671418eb175f38b70a4283e Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: exception: floating IP not found Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '050494f0-8ecf-4ca8-a74c-cfa13118930b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 26 19:49:44.776867 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 26 19:49:44.781537 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:44.784661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Returning 404 to user: floating IP not found {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:44.786355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4eb2c843-7ec6-4e07-8e38-2c62f816d751 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action" status: 404 len: 67 microversion: 2.1 time: 0.197287 Jul 26 19:49:44.792826 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 838/1714] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:44 2022] POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action => generated 67 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:49:44.798643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-601c6d3c-ece3-471b-9b18-2ee91d16e8c0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:44.800651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-601c6d3c-ece3-471b-9b18-2ee91d16e8c0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:44.803571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:44.813682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-601c6d3c-ece3-471b-9b18-2ee91d16e8c0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.814631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-601c6d3c-ece3-471b-9b18-2ee91d16e8c0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.815962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-601c6d3c-ece3-471b-9b18-2ee91d16e8c0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:44.817456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-601c6d3c-ece3-471b-9b18-2ee91d16e8c0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:44.850924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-601c6d3c-ece3-471b-9b18-2ee91d16e8c0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:49:44.854968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:45.022947 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-601c6d3c-ece3-471b-9b18-2ee91d16e8c0 tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 204 len: 0 microversion: 2.1 time: 0.228224 Jul 26 19:49:45.024779 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 839/1715] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:49:44 2022] DELETE /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:45.034870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-41ef9c81-0dcd-4932-a73a-7bea2270e38e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:45.037142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41ef9c81-0dcd-4932-a73a-7bea2270e38e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:45.044895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41ef9c81-0dcd-4932-a73a-7bea2270e38e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:45.045342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41ef9c81-0dcd-4932-a73a-7bea2270e38e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:45.046119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41ef9c81-0dcd-4932-a73a-7bea2270e38e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:45.046717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41ef9c81-0dcd-4932-a73a-7bea2270e38e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:45.086832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=31 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:45.278785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-41ef9c81-0dcd-4932-a73a-7bea2270e38e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 3f39e3c9-d789-460b-a36b-c5b9e3527888 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:49:45.304532 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-41ef9c81-0dcd-4932-a73a-7bea2270e38e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 2420 microversion: 2.25 time: 0.278134 Jul 26 19:49:45.323971 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 840/1716] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:45 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 2420 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:45.346971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3f9ea22b-04d6-416c-a7be-006179b81444 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:45.358272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3f9ea22b-04d6-416c-a7be-006179b81444 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:45.366576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f9ea22b-04d6-416c-a7be-006179b81444 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:45.367022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f9ea22b-04d6-416c-a7be-006179b81444 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:45.367856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f9ea22b-04d6-416c-a7be-006179b81444 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:45.368279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f9ea22b-04d6-416c-a7be-006179b81444 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:45.626270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f9ea22b-04d6-416c-a7be-006179b81444 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:45.642368 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3f9ea22b-04d6-416c-a7be-006179b81444 tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1529 microversion: 2.1 time: 0.315972 Jul 26 19:49:45.644141 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 841/1717] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:45 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1529 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:45.678445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f172f34-f522-4790-b4e7-aa0c21f0c02d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:45.679369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f172f34-f522-4790-b4e7-aa0c21f0c02d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:45.687693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f172f34-f522-4790-b4e7-aa0c21f0c02d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:45.687938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f172f34-f522-4790-b4e7-aa0c21f0c02d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:45.689347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f172f34-f522-4790-b4e7-aa0c21f0c02d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:45.689891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f172f34-f522-4790-b4e7-aa0c21f0c02d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:45.694265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:45.970144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f172f34-f522-4790-b4e7-aa0c21f0c02d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:45.978551 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f172f34-f522-4790-b4e7-aa0c21f0c02d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1503 microversion: 2.1 time: 0.315094 Jul 26 19:49:45.985687 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 842/1718] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:45 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:45.990831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6394479-5325-4825-8c8b-fabc10ee3cd8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:45.994280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f6394479-5325-4825-8c8b-fabc10ee3cd8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:46.011042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6394479-5325-4825-8c8b-fabc10ee3cd8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:46.013552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6394479-5325-4825-8c8b-fabc10ee3cd8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:46.014463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6394479-5325-4825-8c8b-fabc10ee3cd8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:46.014981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6394479-5325-4825-8c8b-fabc10ee3cd8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:46.082193 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f6394479-5325-4825-8c8b-fabc10ee3cd8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095237 Jul 26 19:49:46.088969 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 843/1719] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:49:45 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:49:46.098696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6e475bc-b1c9-465b-9829-877d1772e03f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:46.156862 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b6e475bc-b1c9-465b-9829-877d1772e03f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6e475bc-b1c9-465b-9829-877d1772e03f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Request method failure captured: Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action HTTP/1.1 Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 44 Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUejU1Gov_nMXWVSbK7IZwuY_Xk0MZ5zF-GbuO_QvhZjBX7QVZD4TgDMq1jpxcCSXjvslAkah7VuM6FsaENg0aGna0G9R_eBdJBKPnMRY7nJqoRvOC26L-mMP-pkT6sb3BoKN_-XGMqIzk8v8VLuq7mGkrJDD-iBEtTq6IEUMIQFbk Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56462831b5fc4ac7b87c7da6ea7f172e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}] Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2952a164d671418eb175f38b70a4283e Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: exception: Floating IP not found for address 0.0.0.0. Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '050494f0-8ecf-4ca8-a74c-cfa13118930b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 26 19:49:46.159000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6e475bc-b1c9-465b-9829-877d1772e03f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:46.163749 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b6e475bc-b1c9-465b-9829-877d1772e03f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action" status: 404 len: 88 microversion: 2.1 time: 0.070426 Jul 26 19:49:46.166865 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 844/1720] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:49:46 2022] POST /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b/action => generated 88 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:49:46.171720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4969ef60-e736-49aa-bd4e-e7ef4213c21c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:46.176261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4969ef60-e736-49aa-bd4e-e7ef4213c21c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 8cea81bb-4094-43a7-b913-64a304aec896] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:46.194725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4969ef60-e736-49aa-bd4e-e7ef4213c21c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:46.195429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4969ef60-e736-49aa-bd4e-e7ef4213c21c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:46.196428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4969ef60-e736-49aa-bd4e-e7ef4213c21c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:46.198718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4969ef60-e736-49aa-bd4e-e7ef4213c21c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:46.626592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4969ef60-e736-49aa-bd4e-e7ef4213c21c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9e3f3572674c1380d3eca3d4c5e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a0c6b8a5804e0ab6af55c5ee740e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:46.642652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4969ef60-e736-49aa-bd4e-e7ef4213c21c tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896" status: 200 len: 1468 microversion: 2.1 time: 0.473496 Jul 26 19:49:46.643598 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 845/1721] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:46 2022] GET /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896 => generated 1468 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:46.649654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2f4dbf9-a58a-4b29-a9ae-1cb03712a28d tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:46.650347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d2f4dbf9-a58a-4b29-a9ae-1cb03712a28d tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:46.657151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2f4dbf9-a58a-4b29-a9ae-1cb03712a28d tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:46.660262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2f4dbf9-a58a-4b29-a9ae-1cb03712a28d tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:46.661579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2f4dbf9-a58a-4b29-a9ae-1cb03712a28d tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:46.662223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2f4dbf9-a58a-4b29-a9ae-1cb03712a28d tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:46.899956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-d2f4dbf9-a58a-4b29-a9ae-1cb03712a28d tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 3f39e3c9-d789-460b-a36b-c5b9e3527888 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:49:46.919069 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d2f4dbf9-a58a-4b29-a9ae-1cb03712a28d tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 2420 microversion: 2.25 time: 0.274255 Jul 26 19:49:46.920482 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 846/1722] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:49:46 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 2420 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:49:46.925640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b56b8d5-a5f8-4c09-9ea3-8db47a08ef03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:46.927988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6b56b8d5-a5f8-4c09-9ea3-8db47a08ef03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:46.934992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b56b8d5-a5f8-4c09-9ea3-8db47a08ef03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:46.935797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b56b8d5-a5f8-4c09-9ea3-8db47a08ef03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:46.937468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b56b8d5-a5f8-4c09-9ea3-8db47a08ef03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:46.938347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b56b8d5-a5f8-4c09-9ea3-8db47a08ef03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:47.734038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6b56b8d5-a5f8-4c09-9ea3-8db47a08ef03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:47.773342 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b56b8d5-a5f8-4c09-9ea3-8db47a08ef03 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1522 microversion: 2.1 time: 0.846423 Jul 26 19:49:47.774278 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 847/1723] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:46 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1522 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:47.786276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c2fa44dc-bc1a-40f2-86a0-74962f4148ae req-e25abe17-9189-41d2-a9c9-6cd02265e76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935ae66a-87b3-42a0-99ec-679dedd8f3df", "tag": "c36f3c36-3ad6-4297-b38d-d13e0fc6869d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:47.833640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c2fa44dc-bc1a-40f2-86a0-74962f4148ae req-e25abe17-9189-41d2-a9c9-6cd02265e76e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:47.838697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c2fa44dc-bc1a-40f2-86a0-74962f4148ae req-e25abe17-9189-41d2-a9c9-6cd02265e76e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:47.876979 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c2fa44dc-bc1a-40f2-86a0-74962f4148ae req-e25abe17-9189-41d2-a9c9-6cd02265e76e service nova] Creating event network-changed:c36f3c36-3ad6-4297-b38d-d13e0fc6869d for instance 935ae66a-87b3-42a0-99ec-679dedd8f3df on n-h2-708768-8 Jul 26 19:49:47.895409 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c2fa44dc-bc1a-40f2-86a0-74962f4148ae req-e25abe17-9189-41d2-a9c9-6cd02265e76e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115654 Jul 26 19:49:47.896487 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 848/1724] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:47.911303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8330b184-e8e8-4dc2-9694-ff046e80d29f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:47.912227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8330b184-e8e8-4dc2-9694-ff046e80d29f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:47.924000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8330b184-e8e8-4dc2-9694-ff046e80d29f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:47.927417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8330b184-e8e8-4dc2-9694-ff046e80d29f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:47.928418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8330b184-e8e8-4dc2-9694-ff046e80d29f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:47.932855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8330b184-e8e8-4dc2-9694-ff046e80d29f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:47.985603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8330b184-e8e8-4dc2-9694-ff046e80d29f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:49:48.165232 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8330b184-e8e8-4dc2-9694-ff046e80d29f tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "DELETE /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 204 len: 0 microversion: 2.1 time: 0.266844 Jul 26 19:49:48.169497 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 849/1725] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:49:47 2022] DELETE /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:48.182967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-154255150", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "a860ee43-605e-4277-9e3a-cdf5856dd542"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:49.179474 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-141f76d6-5953-428d-bab5-6907085a8580 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac" status: 200 len: 1436 microversion: 2.1 time: 13.481078 Jul 26 19:49:49.182143 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 877/1726] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:35 2022] GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac => generated 1436 bytes in 13485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:49.194015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7867ae33-8df8-4c8f-b57b-6f7af56c22ff tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:49.195748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] validate_networks() for [('a860ee43-605e-4277-9e3a-cdf5856dd542', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:49:49.200812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7867ae33-8df8-4c8f-b57b-6f7af56c22ff tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:49.217986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7867ae33-8df8-4c8f-b57b-6f7af56c22ff tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:49.220053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7867ae33-8df8-4c8f-b57b-6f7af56c22ff tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:49.222739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7867ae33-8df8-4c8f-b57b-6f7af56c22ff tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:49.224871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7867ae33-8df8-4c8f-b57b-6f7af56c22ff tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:49.311698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7867ae33-8df8-4c8f-b57b-6f7af56c22ff tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f850c7cd5b0d494299638f3b37983089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cff6b8f0eb4130acc4fbf20d111823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:49.327958 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7867ae33-8df8-4c8f-b57b-6f7af56c22ff tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 200 len: 1487 microversion: 2.1 time: 0.143285 Jul 26 19:49:49.328633 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 878/1727] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:49 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 1487 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:49.334201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5bfc4767-128f-4bb9-a27a-816cdcee3955 req-58f09e32-5323-405e-ad50-54b257772e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935ae66a-87b3-42a0-99ec-679dedd8f3df", "name": "network-vif-unplugged", "status": "completed", "tag": "c36f3c36-3ad6-4297-b38d-d13e0fc6869d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:49.354924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5bfc4767-128f-4bb9-a27a-816cdcee3955 req-58f09e32-5323-405e-ad50-54b257772e7b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:49.355807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5bfc4767-128f-4bb9-a27a-816cdcee3955 req-58f09e32-5323-405e-ad50-54b257772e7b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:49.369794 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5bfc4767-128f-4bb9-a27a-816cdcee3955 req-58f09e32-5323-405e-ad50-54b257772e7b service nova] Creating event network-vif-unplugged:c36f3c36-3ad6-4297-b38d-d13e0fc6869d for instance 935ae66a-87b3-42a0-99ec-679dedd8f3df on n-h2-708768-8 Jul 26 19:49:49.390478 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5bfc4767-128f-4bb9-a27a-816cdcee3955 req-58f09e32-5323-405e-ad50-54b257772e7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059860 Jul 26 19:49:49.391252 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 879/1728] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:49.405469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bf5ae90d-69d5-4af1-992f-57c5319f9153 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:49.408274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bf5ae90d-69d5-4af1-992f-57c5319f9153 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:49.424586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf5ae90d-69d5-4af1-992f-57c5319f9153 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:49.428138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf5ae90d-69d5-4af1-992f-57c5319f9153 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:49.430213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf5ae90d-69d5-4af1-992f-57c5319f9153 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:49.433667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf5ae90d-69d5-4af1-992f-57c5319f9153 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:49.721742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bf5ae90d-69d5-4af1-992f-57c5319f9153 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:49.733167 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bf5ae90d-69d5-4af1-992f-57c5319f9153 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1503 microversion: 2.1 time: 0.340343 Jul 26 19:49:49.738463 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 880/1729] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:49 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:49.745103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-336158fc-a7eb-4a04-9de2-e930f91f28bf tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:49.745914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-336158fc-a7eb-4a04-9de2-e930f91f28bf tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:49.752826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-336158fc-a7eb-4a04-9de2-e930f91f28bf tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:49.753542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-336158fc-a7eb-4a04-9de2-e930f91f28bf tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:49.755021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-336158fc-a7eb-4a04-9de2-e930f91f28bf tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:49.755647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-336158fc-a7eb-4a04-9de2-e930f91f28bf tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:49.923343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-336158fc-a7eb-4a04-9de2-e930f91f28bf tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lazy-loading 'services' on Instance uuid 3f39e3c9-d789-460b-a36b-c5b9e3527888 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:49:50.061529 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-336158fc-a7eb-4a04-9de2-e930f91f28bf tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments/74ba3437-1a23-4cea-a433-87736ea06c80" status: 202 len: 0 microversion: 2.25 time: 0.320191 Jul 26 19:49:50.065515 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 881/1730] 10.222.0.58 () {60 vars in 1457 bytes} [Tue Jul 26 19:49:49 2022] DELETE /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments/74ba3437-1a23-4cea-a433-87736ea06c80 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:50.071830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:50.072526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 8cea81bb-4094-43a7-b913-64a304aec896] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:50.083802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.084263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:50.085058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.085952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:50.116006 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] HTTP exception thrown: Instance 8cea81bb-4094-43a7-b913-64a304aec896 could not be found. Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Request method failure captured: Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896 HTTP/1.1 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EUO1mPUw6ctQLL8MHgLq3rzAOP5FVis1entwpfXLZBevIOQrCGAsKPxDcL8gZaMhOX9GyDe9z5Mx0CZJ1sxyRo-uyPvDNX6hUGk6LPwfh_r7sJFFCdFwyN1eL73Wo-GslZjrhxe_OXUa2JJaG8XH21xqYPvXKopd8miSctshh02sAY Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e5a0c6b8a5804e0ab6af55c5ee740e21 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-MultipleCreateTestJSON-637780885 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e5a0c6b8a5804e0ab6af55c5ee740e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e5a0c6b8a5804e0ab6af55c5ee740e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e5a0c6b8a5804e0ab6af55c5ee740e21", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e5a0c6b8a5804e0ab6af55c5ee740e21"}]}] Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-MultipleCreateTestJSON-637780885 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e5a0c6b8a5804e0ab6af55c5ee740e21 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-MultipleCreateTestJSON-637780885 Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-MultipleCreateTestJSON-637780885-project Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 8c9e3f3572674c1380d3eca3d4c5e58c Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-MultipleCreateTestJSON-637780885-project Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 8cea81bb-4094-43a7-b913-64a304aec896 could not be found. Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8cea81bb-4094-43a7-b913-64a304aec896'} Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cea81bb-4094-43a7-b913-64a304aec896 could not be found. Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cea81bb-4094-43a7-b913-64a304aec896 could not be found. Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:50.120057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:50.125567 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:50.125567 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:50.125567 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:50.125567 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:50.125567 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:50.125567 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cea81bb-4094-43a7-b913-64a304aec896 could not be found. Jul 26 19:49:50.125567 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:50.125567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Returning 404 to user: Instance 8cea81bb-4094-43a7-b913-64a304aec896 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:50.126958 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0101cde3-7191-4a11-aa5b-3f32231dcd1f tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896" status: 404 len: 111 microversion: 2.1 time: 0.060254 Jul 26 19:49:50.128040 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 882/1731] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:50 2022] GET /compute/v2.1/servers/8cea81bb-4094-43a7-b913-64a304aec896 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:49:50.133645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64d724e0-f546-4484-a6bb-e57629db649a tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:50.134268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64d724e0-f546-4484-a6bb-e57629db649a tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:50.143583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64d724e0-f546-4484-a6bb-e57629db649a tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.144250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64d724e0-f546-4484-a6bb-e57629db649a tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:50.145865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64d724e0-f546-4484-a6bb-e57629db649a tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.146380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64d724e0-f546-4484-a6bb-e57629db649a tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:50.417009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64d724e0-f546-4484-a6bb-e57629db649a tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:50.426782 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64d724e0-f546-4484-a6bb-e57629db649a tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1541 microversion: 2.1 time: 0.297112 Jul 26 19:49:50.428165 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 883/1732] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:50 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1541 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:50.434744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e878c02e-8f4b-4cb5-b9cb-d317e1bc027c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:50.436298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e878c02e-8f4b-4cb5-b9cb-d317e1bc027c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:50.445402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e878c02e-8f4b-4cb5-b9cb-d317e1bc027c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.446806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e878c02e-8f4b-4cb5-b9cb-d317e1bc027c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:50.447862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e878c02e-8f4b-4cb5-b9cb-d317e1bc027c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.448529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e878c02e-8f4b-4cb5-b9cb-d317e1bc027c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:50.539774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:49:50.540334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:49:50.540568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:49:50.541186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:49:50.541765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:49:50.558849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.559356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:50.560528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.561159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:50.601889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Getting quotas for project a12a08cdecac47df83d0fe375e823172. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:49:50.613064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Getting quotas for user 43416bcbb5a747628d0594cf62819331 and project a12a08cdecac47df83d0fe375e823172. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:49:50.648927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:49:50.657322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:49:50.789745 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5c8ec4f-4f07-4635-b22a-fd09d2cb7f22 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.618479 Jul 26 19:49:50.790952 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 850/1733] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:49:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:49:50.805521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9604e973-594a-47d9-9075-d844c2c29fe1 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f87572f44c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:50.906793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9604e973-594a-47d9-9075-d844c2c29fe1 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac" status: 200 len: 1436 microversion: 2.1 time: 0.114541 Jul 26 19:49:50.907727 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 851/1734] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:49:50 2022] GET /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac => generated 1436 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:50.917868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9b1631cc-43eb-4831-886b-3874fc517fcd req-35ebad34-5d65-4d38-a517-9ad2ff7fa19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cea81bb-4094-43a7-b913-64a304aec896", "name": "network-vif-deleted", "tag": "04875e86-a1fa-4ee6-8b44-63eb3acb230c"}, {"server_uuid": "7e62231c-b880-4fb8-af6e-4dfaf7047ab4", "name": "network-vif-deleted", "tag": "2f227705-754f-4502-bdae-24b122de042d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:50.958005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9b1631cc-43eb-4831-886b-3874fc517fcd req-35ebad34-5d65-4d38-a517-9ad2ff7fa19f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:50.958505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9b1631cc-43eb-4831-886b-3874fc517fcd req-35ebad34-5d65-4d38-a517-9ad2ff7fa19f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.007911 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9b1631cc-43eb-4831-886b-3874fc517fcd req-35ebad34-5d65-4d38-a517-9ad2ff7fa19f service nova] Creating event network-vif-deleted:04875e86-a1fa-4ee6-8b44-63eb3acb230c for instance 8cea81bb-4094-43a7-b913-64a304aec896 on n-h2-708768-8 Jul 26 19:49:51.008431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9b1631cc-43eb-4831-886b-3874fc517fcd req-35ebad34-5d65-4d38-a517-9ad2ff7fa19f service nova] Creating event network-vif-deleted:2f227705-754f-4502-bdae-24b122de042d for instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 on n-h1-708768-8 Jul 26 19:49:51.028956 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9b1631cc-43eb-4831-886b-3874fc517fcd req-35ebad34-5d65-4d38-a517-9ad2ff7fa19f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119816 Jul 26 19:49:51.034626 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 852/1735] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:51.044751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03ced7f4-5cfb-4bec-9fc5-802f6d76a98b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:51.048031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03ced7f4-5cfb-4bec-9fc5-802f6d76a98b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:51.057478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03ced7f4-5cfb-4bec-9fc5-802f6d76a98b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.058623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03ced7f4-5cfb-4bec-9fc5-802f6d76a98b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.059811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03ced7f4-5cfb-4bec-9fc5-802f6d76a98b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.060616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03ced7f4-5cfb-4bec-9fc5-802f6d76a98b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.131966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e878c02e-8f4b-4cb5-b9cb-d317e1bc027c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:51.136018 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03ced7f4-5cfb-4bec-9fc5-802f6d76a98b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099159 Jul 26 19:49:51.140941 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 853/1736] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 19:49:51 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:49:51.148370 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e878c02e-8f4b-4cb5-b9cb-d317e1bc027c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1522 microversion: 2.1 time: 0.717198 Jul 26 19:49:51.156658 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 884/1737] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:50 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:51.163198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:51.163838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] [instance: 7e62231c-b880-4fb8-af6e-4dfaf7047ab4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:51.168967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:51.173848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] [instance: 72cafc58-bc33-4e37-8484-b7067c652a12] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:51.199759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.199925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.200375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.200633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.201164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.201603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.203809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.206597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.249867 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] HTTP exception thrown: Instance 72cafc58-bc33-4e37-8484-b7067c652a12 could not be found. Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Request method failure captured: Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 HTTP/1.1 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EUxlS-AkOd35eM4zR-3AsfWa3Pb6Y2uuw6mmGuDL6g5dVw0SUHDBvhw9h8XUsILM9yMX8ossqaM74oZegkLUwXiNYIsW9mpWqKeGbE_yf0U_kUkXqp9Z6EK8UGsUXWHmZfSELS5mz9AOWwB0gFUdz_Vj_xbms8AT6W3NgL65OeKRxs Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 76cff6b8f0eb4130acc4fbf20d111823 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76cff6b8f0eb4130acc4fbf20d111823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76cff6b8f0eb4130acc4fbf20d111823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76cff6b8f0eb4130acc4fbf20d111823", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76cff6b8f0eb4130acc4fbf20d111823"}]}] Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 76cff6b8f0eb4130acc4fbf20d111823 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-66144696 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-InstanceActionsNegativeTestJSON-66144696-project Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f850c7cd5b0d494299638f3b37983089 Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-66144696-project Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 72cafc58-bc33-4e37-8484-b7067c652a12 could not be found. Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '72cafc58-bc33-4e37-8484-b7067c652a12'} Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72cafc58-bc33-4e37-8484-b7067c652a12 could not be found. Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72cafc58-bc33-4e37-8484-b7067c652a12 could not be found. Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.266946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:51.275258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.275258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:51.275258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:51.275258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:51.275258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:51.275258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:51.275258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72cafc58-bc33-4e37-8484-b7067c652a12 could not be found. Jul 26 19:49:51.275258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.276695 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] HTTP exception thrown: Instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 could not be found. Jul 26 19:49:51.279653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] Returning 404 to user: Instance 72cafc58-bc33-4e37-8484-b7067c652a12 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:51.280871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-28fe4c43-9577-48e1-82fb-7be712657a9b tempest-InstanceActionsNegativeTestJSON-66144696 tempest-InstanceActionsNegativeTestJSON-66144696-project] 10.222.0.58 "GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12" status: 404 len: 111 microversion: 2.1 time: 0.122558 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Request method failure captured: Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 HTTP/1.1 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUO1mPUw6ctQLL8MHgLq3rzAOP5FVis1entwpfXLZBevIOQrCGAsKPxDcL8gZaMhOX9GyDe9z5Mx0CZJ1sxyRo-uyPvDNX6hUGk6LPwfh_r7sJFFCdFwyN1eL73Wo-GslZjrhxe_OXUa2JJaG8XH21xqYPvXKopd8miSctshh02sAY Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e5a0c6b8a5804e0ab6af55c5ee740e21 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-MultipleCreateTestJSON-637780885 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e5a0c6b8a5804e0ab6af55c5ee740e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e5a0c6b8a5804e0ab6af55c5ee740e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e5a0c6b8a5804e0ab6af55c5ee740e21", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e5a0c6b8a5804e0ab6af55c5ee740e21"}]}] Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-MultipleCreateTestJSON-637780885 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e5a0c6b8a5804e0ab6af55c5ee740e21 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-MultipleCreateTestJSON-637780885 Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-MultipleCreateTestJSON-637780885-project Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8c9e3f3572674c1380d3eca3d4c5e58c Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-MultipleCreateTestJSON-637780885-project Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 could not be found. Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7e62231c-b880-4fb8-af6e-4dfaf7047ab4'} Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 could not be found. Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 could not be found. Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:51.281296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.287355 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:51.287355 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:51.287355 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:51.287355 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:51.287355 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:51.287355 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 could not be found. Jul 26 19:49:51.287355 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:51.288682 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 885/1738] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:51 2022] GET /compute/v2.1/servers/72cafc58-bc33-4e37-8484-b7067c652a12 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:49:51.288933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] Returning 404 to user: Instance 7e62231c-b880-4fb8-af6e-4dfaf7047ab4 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:51.291742 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b632dcbc-ca4c-450f-81da-babfcad873bd tempest-MultipleCreateTestJSON-637780885 tempest-MultipleCreateTestJSON-637780885-project] 10.222.0.58 "GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4" status: 404 len: 111 microversion: 2.1 time: 0.130192 Jul 26 19:49:51.291742 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 854/1739] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:51 2022] GET /compute/v2.1/servers/7e62231c-b880-4fb8-af6e-4dfaf7047ab4 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:49:51.306168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80ebb02a-3cce-4f7f-864c-36cc3b6a910b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:51.309484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80ebb02a-3cce-4f7f-864c-36cc3b6a910b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:51.314290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afacb09c-84ff-424b-839b-6b87eda2b019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:51.315169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-afacb09c-84ff-424b-839b-6b87eda2b019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:51.327103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80ebb02a-3cce-4f7f-864c-36cc3b6a910b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.332087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80ebb02a-3cce-4f7f-864c-36cc3b6a910b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.333618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80ebb02a-3cce-4f7f-864c-36cc3b6a910b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.334183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80ebb02a-3cce-4f7f-864c-36cc3b6a910b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.665299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afacb09c-84ff-424b-839b-6b87eda2b019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:51.679547 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afacb09c-84ff-424b-839b-6b87eda2b019 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1217 microversion: 2.1 time: 0.382228 Jul 26 19:49:51.682553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 855/1740] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:51 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1217 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:51.701151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-60fc212e-f8ed-4146-a0a7-14cb42cdb508 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:51.704082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-60fc212e-f8ed-4146-a0a7-14cb42cdb508 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:51.726459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60fc212e-f8ed-4146-a0a7-14cb42cdb508 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.727091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60fc212e-f8ed-4146-a0a7-14cb42cdb508 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.728172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60fc212e-f8ed-4146-a0a7-14cb42cdb508 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.729322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60fc212e-f8ed-4146-a0a7-14cb42cdb508 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.824854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-80ebb02a-3cce-4f7f-864c-36cc3b6a910b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:51.835266 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80ebb02a-3cce-4f7f-864c-36cc3b6a910b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1493 microversion: 2.1 time: 0.535029 Jul 26 19:49:51.860556 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 886/1741] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:51 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1493 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:51.866290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:51.866919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:51.878287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.878735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.884479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.885783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.923940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-60fc212e-f8ed-4146-a0a7-14cb42cdb508 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:51.934438 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-60fc212e-f8ed-4146-a0a7-14cb42cdb508 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1465 microversion: 2.1 time: 0.250606 Jul 26 19:49:51.935305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.936120 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 856/1742] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:51 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1465 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:51.939589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.940188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lazy-loading 'fault' on Instance uuid 050494f0-8ecf-4ca8-a74c-cfa13118930b {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:49:51.943835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b4984d1d-3978-4a00-9e4d-86e53ca09eae req-8b1383e0-7bfb-4c92-ba87-d3cb3d661eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72cafc58-bc33-4e37-8484-b7067c652a12", "name": "network-vif-deleted", "tag": "efe749c8-7803-417c-adea-7ae5a57594cd"}, {"server_uuid": "050494f0-8ecf-4ca8-a74c-cfa13118930b", "name": "network-vif-deleted", "tag": "4dd62864-a2c3-48eb-8843-d6680b22facb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:51.959282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b4984d1d-3978-4a00-9e4d-86e53ca09eae req-8b1383e0-7bfb-4c92-ba87-d3cb3d661eed service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.959772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b4984d1d-3978-4a00-9e4d-86e53ca09eae req-8b1383e0-7bfb-4c92-ba87-d3cb3d661eed service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:51.972680 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b4984d1d-3978-4a00-9e4d-86e53ca09eae req-8b1383e0-7bfb-4c92-ba87-d3cb3d661eed service nova] Creating event network-vif-deleted:efe749c8-7803-417c-adea-7ae5a57594cd for instance 72cafc58-bc33-4e37-8484-b7067c652a12 on n-h1-708768-8 Jul 26 19:49:51.973973 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b4984d1d-3978-4a00-9e4d-86e53ca09eae req-8b1383e0-7bfb-4c92-ba87-d3cb3d661eed service nova] Creating event network-vif-deleted:4dd62864-a2c3-48eb-8843-d6680b22facb for instance 050494f0-8ecf-4ca8-a74c-cfa13118930b on n-h2-708768-8 Jul 26 19:49:51.983261 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b4984d1d-3978-4a00-9e4d-86e53ca09eae req-8b1383e0-7bfb-4c92-ba87-d3cb3d661eed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045289 Jul 26 19:49:51.983892 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 857/1743] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:51.989547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9351ea9d-6794-449b-9fbe-155a19785dee tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '.version_select at 0x7f87576c88b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:51.993804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9351ea9d-6794-449b-9fbe-155a19785dee tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:51.994248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9351ea9d-6794-449b-9fbe-155a19785dee tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.003315 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9351ea9d-6794-449b-9fbe-155a19785dee tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.018100 Jul 26 19:49:52.004281 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 858/1744] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:49:51 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:52.009092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2ca5778-fa3a-433a-b6c6-4714243bad92 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f87570aad30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:52.065122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2952a164d671418eb175f38b70a4283e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56462831b5fc4ac7b87c7da6ea7f172e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:52.076084 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9696a965-8726-4961-87b9-984c0a2b98ec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 200 len: 1322 microversion: 2.1 time: 0.214214 Jul 26 19:49:52.076929 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 887/1745] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:51 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:52.087249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-53786410-b9a3-48af-b247-fb39ddbc58a3 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:52.088458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-53786410-b9a3-48af-b247-fb39ddbc58a3 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:52.102688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53786410-b9a3-48af-b247-fb39ddbc58a3 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:52.103186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53786410-b9a3-48af-b247-fb39ddbc58a3 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.107288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53786410-b9a3-48af-b247-fb39ddbc58a3 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:52.107822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53786410-b9a3-48af-b247-fb39ddbc58a3 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.745781 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-53786410-b9a3-48af-b247-fb39ddbc58a3 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1644 microversion: 2.1 time: 0.667683 Jul 26 19:49:52.746716 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 888/1746] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:52 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1644 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:52.752909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac241276-3794-471c-81a9-d37a29bf5810 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:52.756114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ac241276-3794-471c-81a9-d37a29bf5810 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:52.767575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac241276-3794-471c-81a9-d37a29bf5810 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:52.771871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac241276-3794-471c-81a9-d37a29bf5810 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.772924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac241276-3794-471c-81a9-d37a29bf5810 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:52.773975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac241276-3794-471c-81a9-d37a29bf5810 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.788404 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f2ca5778-fa3a-433a-b6c6-4714243bad92 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "DELETE /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac" status: 204 len: 0 microversion: 2.1 time: 0.782665 Jul 26 19:49:52.789532 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 859/1747] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:52 2022] DELETE /compute/v2.1/images/0d5e1a7b-4671-452e-9971-f6cbc65e09ac => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:52.802502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39be4077-8fda-4af5-a51e-2fd0e731ce1e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:52.805945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39be4077-8fda-4af5-a51e-2fd0e731ce1e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:52.820552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ac241276-3794-471c-81a9-d37a29bf5810 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072518 Jul 26 19:49:52.825534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39be4077-8fda-4af5-a51e-2fd0e731ce1e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:52.825995 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 889/1748] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 19:49:52 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:49:52.828133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39be4077-8fda-4af5-a51e-2fd0e731ce1e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.829057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39be4077-8fda-4af5-a51e-2fd0e731ce1e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:52.829515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39be4077-8fda-4af5-a51e-2fd0e731ce1e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.833367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e649682-7adb-4947-994f-97244ab25249 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:52.834297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5e649682-7adb-4947-994f-97244ab25249 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:52.840944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e649682-7adb-4947-994f-97244ab25249 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:52.841621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e649682-7adb-4947-994f-97244ab25249 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.842735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e649682-7adb-4947-994f-97244ab25249 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:52.843359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e649682-7adb-4947-994f-97244ab25249 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:52.910713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:52.949383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5e649682-7adb-4947-994f-97244ab25249 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:52.961239 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5e649682-7adb-4947-994f-97244ab25249 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1269 microversion: 2.1 time: 0.132131 Jul 26 19:49:52.962016 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 890/1749] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:52 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:52.966628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c7e7503-c981-4440-bd49-1db6fc124e4f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '.version_select at 0x7f875ec6bf70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:52.995787 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0c7e7503-c981-4440-bd49-1db6fc124e4f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] HTTP exception thrown: Image not found. Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c7e7503-c981-4440-bd49-1db6fc124e4f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Request method failure captured: Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 HTTP/1.1 Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ET_-uVma4_ynqvp580XdupW72iOWhljwKuV0ZDp-gO-Cp9ABFecHNdnLR_7Q0rod9Etk_HJ6OYf1NGSJTA1R8XiYCatvO85syl7-9uz66_JzX6yz1YOn4nSNOiifp_J4pJ3G_Jum2sorrahAD0wFgv5wQJsZRxFJZvRXjdqXX-wHyM Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5918d79bd422403c9e8998747935af6c Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5918d79bd422403c9e8998747935af6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5918d79bd422403c9e8998747935af6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5918d79bd422403c9e8998747935af6c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5918d79bd422403c9e8998747935af6c"}]}] Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5918d79bd422403c9e8998747935af6c Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesOneServerTestJSON-553654240-project Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 949c58249f22473e9956be855557b0b2 Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesOneServerTestJSON-553654240-project Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84'} Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 to delete Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 could not be found. Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:52.999387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:49:53.007129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:49:53.011720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c7e7503-c981-4440-bd49-1db6fc124e4f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:53.012783 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c7e7503-c981-4440-bd49-1db6fc124e4f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "DELETE /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84" status: 404 len: 62 microversion: 2.1 time: 0.049665 Jul 26 19:49:53.016643 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 891/1750] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:52 2022] DELETE /compute/v2.1/images/c438ca4a-4b91-4b3f-9bf1-b0b2844a9c84 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:49:53.022279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-924054516", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "0f695fb7-3303-409c-b910-73ee1e80f46d"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:53.115436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] validate_networks() for [('0f695fb7-3303-409c-b910-73ee1e80f46d', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:49:53.343049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-39be4077-8fda-4af5-a51e-2fd0e731ce1e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:53.355973 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39be4077-8fda-4af5-a51e-2fd0e731ce1e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1504 microversion: 2.1 time: 0.565018 Jul 26 19:49:53.372159 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 860/1751] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:52 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:53.377429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96cce400-66ff-47ee-a12c-eaee00cf2152 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:53.378121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-96cce400-66ff-47ee-a12c-eaee00cf2152 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:53.386004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96cce400-66ff-47ee-a12c-eaee00cf2152 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:53.386684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96cce400-66ff-47ee-a12c-eaee00cf2152 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:53.387793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96cce400-66ff-47ee-a12c-eaee00cf2152 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:53.388404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96cce400-66ff-47ee-a12c-eaee00cf2152 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:53.416841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-96cce400-66ff-47ee-a12c-eaee00cf2152 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:49:53.525783 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96cce400-66ff-47ee-a12c-eaee00cf2152 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 204 len: 0 microversion: 2.1 time: 0.151746 Jul 26 19:49:53.528378 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 861/1752] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:49:53 2022] DELETE /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:49:53.541681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:53.542679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] [instance: 050494f0-8ecf-4ca8-a74c-cfa13118930b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:53.557743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:53.558664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:53.559725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:53.560341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:53.578875 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] HTTP exception thrown: Instance 050494f0-8ecf-4ca8-a74c-cfa13118930b could not be found. Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Request method failure captured: Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b HTTP/1.1 Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUejU1Gov_nMXWVSbK7IZwuY_Xk0MZ5zF-GbuO_QvhZjBX7QVZD4TgDMq1jpxcCSXjvslAkah7VuM6FsaENg0aGna0G9R_eBdJBKPnMRY7nJqoRvOC26L-mMP-pkT6sb3BoKN_-XGMqIzk8v8VLuq7mGkrJDD-iBEtTq6IEUMIQFbk Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56462831b5fc4ac7b87c7da6ea7f172e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56462831b5fc4ac7b87c7da6ea7f172e"}]}] Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 56462831b5fc4ac7b87c7da6ea7f172e Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2952a164d671418eb175f38b70a4283e Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 050494f0-8ecf-4ca8-a74c-cfa13118930b could not be found. Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '050494f0-8ecf-4ca8-a74c-cfa13118930b'} Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 050494f0-8ecf-4ca8-a74c-cfa13118930b could not be found. Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 050494f0-8ecf-4ca8-a74c-cfa13118930b could not be found. Jul 26 19:49:53.580851 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 050494f0-8ecf-4ca8-a74c-cfa13118930b could not be found. Jul 26 19:49:53.586906 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:53.589870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] Returning 404 to user: Instance 050494f0-8ecf-4ca8-a74c-cfa13118930b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:53.590966 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3961742b-a9cb-4a2c-bf5b-877eba878dec tempest-FloatingIPsAssociationNegativeTestJSON-2066594229 tempest-FloatingIPsAssociationNegativeTestJSON-2066594229-project] 10.222.0.58 "GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b" status: 404 len: 111 microversion: 2.1 time: 0.059297 Jul 26 19:49:53.592119 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 862/1753] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:53 2022] GET /compute/v2.1/servers/050494f0-8ecf-4ca8-a74c-cfa13118930b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:49:53.599523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63cc7163-668e-463f-bab3-8b6d795d5af0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:53.600549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63cc7163-668e-463f-bab3-8b6d795d5af0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:53.607339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63cc7163-668e-463f-bab3-8b6d795d5af0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:53.608292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63cc7163-668e-463f-bab3-8b6d795d5af0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:53.610133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63cc7163-668e-463f-bab3-8b6d795d5af0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:53.610810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63cc7163-668e-463f-bab3-8b6d795d5af0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.107093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63cc7163-668e-463f-bab3-8b6d795d5af0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:54.119985 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63cc7163-668e-463f-bab3-8b6d795d5af0 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1471 microversion: 2.1 time: 0.526505 Jul 26 19:49:54.120880 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 863/1754] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:53 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1471 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:54.126131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d6800f13-efe1-422c-8b58-5b6e744b70de tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:54.128716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d6800f13-efe1-422c-8b58-5b6e744b70de tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:54.135083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6800f13-efe1-422c-8b58-5b6e744b70de tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.135862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6800f13-efe1-422c-8b58-5b6e744b70de tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.136856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6800f13-efe1-422c-8b58-5b6e744b70de tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.137523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6800f13-efe1-422c-8b58-5b6e744b70de tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.171307 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d6800f13-efe1-422c-8b58-5b6e744b70de tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049129 Jul 26 19:49:54.172608 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 864/1755] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 19:49:54 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:49:54.180487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-424986a9-0aa1-43f2-8aa3-f07893da0ecd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:54.181348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-424986a9-0aa1-43f2-8aa3-f07893da0ecd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:54.188243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424986a9-0aa1-43f2-8aa3-f07893da0ecd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.188919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424986a9-0aa1-43f2-8aa3-f07893da0ecd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.190400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424986a9-0aa1-43f2-8aa3-f07893da0ecd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.191011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424986a9-0aa1-43f2-8aa3-f07893da0ecd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.291454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-424986a9-0aa1-43f2-8aa3-f07893da0ecd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:54.309173 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-424986a9-0aa1-43f2-8aa3-f07893da0ecd tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1275 microversion: 2.1 time: 0.134011 Jul 26 19:49:54.310755 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 865/1756] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:54 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:54.378930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d045959-c946-4914-b4b9-07a089d37420 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:54.380286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d045959-c946-4914-b4b9-07a089d37420 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:54.389763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d045959-c946-4914-b4b9-07a089d37420 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.390469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d045959-c946-4914-b4b9-07a089d37420 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.391415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d045959-c946-4914-b4b9-07a089d37420 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.391931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:49:54.392443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:49:54.392750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d045959-c946-4914-b4b9-07a089d37420 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.393113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:49:54.393621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:49:54.394151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:49:54.410925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.411708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.413589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.420777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:54.456466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:49:54.463972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for user 678a9d8bb54a4fdb8997fcf480a3a355 and project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:49:54.482447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:49:54.486205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:49:54.574025 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af2b75b7-e39a-4bd9-b392-9536a2d4e731 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.556055 Jul 26 19:49:54.582089 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 892/1757] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:49:54.588173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab3abc97-08c0-4192-9a6d-674b18170092 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:54.589638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab3abc97-08c0-4192-9a6d-674b18170092 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:54.710302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d045959-c946-4914-b4b9-07a089d37420 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:54.722115 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d045959-c946-4914-b4b9-07a089d37420 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1504 microversion: 2.1 time: 0.345343 Jul 26 19:49:54.722957 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 866/1758] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:54 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:49:54.952571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-cd64610c-2152-4a14-8d64-bdeb7b783869 req-e7f1edd3-b12a-4bdd-8314-eca9138ddcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c880cc-b8a9-4167-aa94-5c52d9d130e0", "name": "network-vif-unplugged", "status": "completed", "tag": "821f8e2a-ea44-4252-9be5-5e243e4d636e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:54.969443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cd64610c-2152-4a14-8d64-bdeb7b783869 req-e7f1edd3-b12a-4bdd-8314-eca9138ddcd4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:54.969985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cd64610c-2152-4a14-8d64-bdeb7b783869 req-e7f1edd3-b12a-4bdd-8314-eca9138ddcd4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:55.000851 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-cd64610c-2152-4a14-8d64-bdeb7b783869 req-e7f1edd3-b12a-4bdd-8314-eca9138ddcd4 service nova] Creating event network-vif-unplugged:821f8e2a-ea44-4252-9be5-5e243e4d636e for instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 on n-h1-708768-8 Jul 26 19:49:55.009275 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-cd64610c-2152-4a14-8d64-bdeb7b783869 req-e7f1edd3-b12a-4bdd-8314-eca9138ddcd4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060476 Jul 26 19:49:55.010328 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 867/1759] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:55.096336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab3abc97-08c0-4192-9a6d-674b18170092 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:55.109115 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab3abc97-08c0-4192-9a6d-674b18170092 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1210 microversion: 2.1 time: 0.525100 Jul 26 19:49:55.111697 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 893/1760] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:54 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1210 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:55.145004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b85a98dd-7661-44f3-a58d-4128afba157a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:55.146009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b85a98dd-7661-44f3-a58d-4128afba157a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:55.164839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b85a98dd-7661-44f3-a58d-4128afba157a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:55.166032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b85a98dd-7661-44f3-a58d-4128afba157a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:55.166463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b85a98dd-7661-44f3-a58d-4128afba157a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:55.166895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b85a98dd-7661-44f3-a58d-4128afba157a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:55.185434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1e79886-96e3-49d3-98f3-1603a5c08405 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:55.188552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1e79886-96e3-49d3-98f3-1603a5c08405 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:55.204968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1e79886-96e3-49d3-98f3-1603a5c08405 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:55.205686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1e79886-96e3-49d3-98f3-1603a5c08405 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:55.208712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1e79886-96e3-49d3-98f3-1603a5c08405 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:55.209334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1e79886-96e3-49d3-98f3-1603a5c08405 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:55.253451 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1e79886-96e3-49d3-98f3-1603a5c08405 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072302 Jul 26 19:49:55.255578 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 894/1761] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 19:49:55 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:49:55.330458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-84a109ff-4ac6-4c37-b3ad-5a3bd7fa95a8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:55.331143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-84a109ff-4ac6-4c37-b3ad-5a3bd7fa95a8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:55.345549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84a109ff-4ac6-4c37-b3ad-5a3bd7fa95a8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:55.348908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84a109ff-4ac6-4c37-b3ad-5a3bd7fa95a8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:55.385148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84a109ff-4ac6-4c37-b3ad-5a3bd7fa95a8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:55.386289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84a109ff-4ac6-4c37-b3ad-5a3bd7fa95a8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:55.661524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b85a98dd-7661-44f3-a58d-4128afba157a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:55.683558 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b85a98dd-7661-44f3-a58d-4128afba157a tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1471 microversion: 2.1 time: 0.544193 Jul 26 19:49:55.693100 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 868/1762] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:55 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1471 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:55.753003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-285ead90-56b5-4049-8d2a-a333f55dba16 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:55.756764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-285ead90-56b5-4049-8d2a-a333f55dba16 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:55.779974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-285ead90-56b5-4049-8d2a-a333f55dba16 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:55.780426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-285ead90-56b5-4049-8d2a-a333f55dba16 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:55.781219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-285ead90-56b5-4049-8d2a-a333f55dba16 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:55.787131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-285ead90-56b5-4049-8d2a-a333f55dba16 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.217462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-285ead90-56b5-4049-8d2a-a333f55dba16 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:56.231595 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-285ead90-56b5-4049-8d2a-a333f55dba16 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 200 len: 1507 microversion: 2.1 time: 0.491094 Jul 26 19:49:56.235515 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 869/1763] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:55 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 1507 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:49:56.255705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36763754-3e45-4c40-ab4f-610d5e4f91db tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:56.258188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-36763754-3e45-4c40-ab4f-610d5e4f91db tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:56.309100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36763754-3e45-4c40-ab4f-610d5e4f91db tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:56.310095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36763754-3e45-4c40-ab4f-610d5e4f91db tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.312987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36763754-3e45-4c40-ab4f-610d5e4f91db tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:56.313719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36763754-3e45-4c40-ab4f-610d5e4f91db tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.436875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-84a109ff-4ac6-4c37-b3ad-5a3bd7fa95a8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:56.451347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-36763754-3e45-4c40-ab4f-610d5e4f91db tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:56.452114 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-84a109ff-4ac6-4c37-b3ad-5a3bd7fa95a8 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1317 microversion: 2.1 time: 1.125547 Jul 26 19:49:56.459794 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36763754-3e45-4c40-ab4f-610d5e4f91db tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1268 microversion: 2.1 time: 0.222835 Jul 26 19:49:56.460963 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 895/1764] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:55 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1317 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:56.467170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:56.468002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:56.475440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:56.476211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.477296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:56.477961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.480278 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 870/1765] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:56 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1268 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:56.495861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-207d2e26-e1ac-4a4e-be5f-ff5d60f9f207 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:56.498503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-207d2e26-e1ac-4a4e-be5f-ff5d60f9f207 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:56.507269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-207d2e26-e1ac-4a4e-be5f-ff5d60f9f207 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:56.508032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-207d2e26-e1ac-4a4e-be5f-ff5d60f9f207 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.508995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-207d2e26-e1ac-4a4e-be5f-ff5d60f9f207 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:56.513367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-207d2e26-e1ac-4a4e-be5f-ff5d60f9f207 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.525302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:49:56.539054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.api [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Working on deleting snapshot 32781529-d0ef-40a3-a506-61200a4ff9dc from shelved instance... Jul 26 19:49:56.590788 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-207d2e26-e1ac-4a4e-be5f-ff5d60f9f207 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109315 Jul 26 19:49:56.596274 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 871/1766] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 19:49:56 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:49:56.712165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e3ad4706-f17a-4af1-92e8-ec9797ac5e21 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:56.712776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e3ad4706-f17a-4af1-92e8-ec9797ac5e21 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:56.722028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3ad4706-f17a-4af1-92e8-ec9797ac5e21 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:56.723054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3ad4706-f17a-4af1-92e8-ec9797ac5e21 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.723881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3ad4706-f17a-4af1-92e8-ec9797ac5e21 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:56.724323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3ad4706-f17a-4af1-92e8-ec9797ac5e21 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:56.889592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e3ad4706-f17a-4af1-92e8-ec9797ac5e21 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949c58249f22473e9956be855557b0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5918d79bd422403c9e8998747935af6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:56.905396 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e3ad4706-f17a-4af1-92e8-ec9797ac5e21 tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 200 len: 1429 microversion: 2.1 time: 0.197132 Jul 26 19:49:56.906378 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 872/1767] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:56 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 1429 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:57.056311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-259d632e-fbc0-4e50-b244-a1f691719ef4 req-4cd02818-f4e1-4f90-8452-4307e0552331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df01792-8d3a-4b9b-b786-3e1fa006643f", "name": "network-vif-deleted", "tag": "09a7781d-402a-4e6c-a8a1-86b9d590132c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:57.088895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-259d632e-fbc0-4e50-b244-a1f691719ef4 req-4cd02818-f4e1-4f90-8452-4307e0552331 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:57.089437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-259d632e-fbc0-4e50-b244-a1f691719ef4 req-4cd02818-f4e1-4f90-8452-4307e0552331 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:57.113988 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-259d632e-fbc0-4e50-b244-a1f691719ef4 req-4cd02818-f4e1-4f90-8452-4307e0552331 service nova] Creating event network-vif-deleted:09a7781d-402a-4e6c-a8a1-86b9d590132c for instance 7df01792-8d3a-4b9b-b786-3e1fa006643f on n-h2-708768-8 Jul 26 19:49:57.126963 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-259d632e-fbc0-4e50-b244-a1f691719ef4 req-4cd02818-f4e1-4f90-8452-4307e0552331 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075604 Jul 26 19:49:57.130058 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 873/1768] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:49:57.139062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-35605204-f2ff-4313-980f-7399165d5645 req-47fd8fa6-c2e1-41a2-a8e2-62e319bc592b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df01792-8d3a-4b9b-b786-3e1fa006643f", "name": "network-vif-unplugged", "status": "completed", "tag": "09a7781d-402a-4e6c-a8a1-86b9d590132c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:57.161062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-35605204-f2ff-4313-980f-7399165d5645 req-47fd8fa6-c2e1-41a2-a8e2-62e319bc592b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:57.164134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-35605204-f2ff-4313-980f-7399165d5645 req-47fd8fa6-c2e1-41a2-a8e2-62e319bc592b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:57.184214 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-35605204-f2ff-4313-980f-7399165d5645 req-47fd8fa6-c2e1-41a2-a8e2-62e319bc592b service nova] Creating event network-vif-unplugged:09a7781d-402a-4e6c-a8a1-86b9d590132c for instance 7df01792-8d3a-4b9b-b786-3e1fa006643f on n-h2-708768-8 Jul 26 19:49:57.208388 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-35605204-f2ff-4313-980f-7399165d5645 req-47fd8fa6-c2e1-41a2-a8e2-62e319bc592b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074986 Jul 26 19:49:57.209889 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 874/1769] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:49:57.381515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Doing local delete in cell 0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) {{(pid=125963) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 26 19:49:57.383322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:57.384089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:57.384655 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.api [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 26 19:49:57.389308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] deallocate_for_instance() {{(pid=125963) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 26 19:49:57.477901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a760b1ba-1ac9-4986-ac7a-8840cd51ad4b tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:57.485599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a760b1ba-1ac9-4986-ac7a-8840cd51ad4b tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:57.506408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a760b1ba-1ac9-4986-ac7a-8840cd51ad4b tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:57.507021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a760b1ba-1ac9-4986-ac7a-8840cd51ad4b tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:57.508306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a760b1ba-1ac9-4986-ac7a-8840cd51ad4b tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:57.509010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a760b1ba-1ac9-4986-ac7a-8840cd51ad4b tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:57.831063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a760b1ba-1ac9-4986-ac7a-8840cd51ad4b tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:57.841631 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a760b1ba-1ac9-4986-ac7a-8840cd51ad4b tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1317 microversion: 2.1 time: 0.369783 Jul 26 19:49:57.844622 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 875/1770] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:57 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:57.859875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a3e99eb5-a709-47e5-a2c8-581e9b6b6498 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:57.860536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a3e99eb5-a709-47e5-a2c8-581e9b6b6498 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:57.867973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:57.870142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3e99eb5-a709-47e5-a2c8-581e9b6b6498 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:57.870806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3e99eb5-a709-47e5-a2c8-581e9b6b6498 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:57.872149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3e99eb5-a709-47e5-a2c8-581e9b6b6498 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:57.872509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3e99eb5-a709-47e5-a2c8-581e9b6b6498 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:57.978270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a3e99eb5-a709-47e5-a2c8-581e9b6b6498 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:57.988217 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a3e99eb5-a709-47e5-a2c8-581e9b6b6498 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1268 microversion: 2.1 time: 0.142332 Jul 26 19:49:57.989655 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 876/1771] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:57 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:57.994812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5e636c15-2950-4fd3-98e1-f3fd20f51a6d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:57.997359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5e636c15-2950-4fd3-98e1-f3fd20f51a6d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:58.006927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e636c15-2950-4fd3-98e1-f3fd20f51a6d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:58.007823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e636c15-2950-4fd3-98e1-f3fd20f51a6d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:58.009076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e636c15-2950-4fd3-98e1-f3fd20f51a6d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:58.010725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e636c15-2950-4fd3-98e1-f3fd20f51a6d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:58.046802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5e636c15-2950-4fd3-98e1-f3fd20f51a6d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.055764 Jul 26 19:49:58.048170 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 877/1772] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 19:49:57 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:58.053183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:58.054035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] [instance: 7df01792-8d3a-4b9b-b786-3e1fa006643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:58.060696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:58.061260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:58.061911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:58.062342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:58.068730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:49:58.081371 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] HTTP exception thrown: Instance 7df01792-8d3a-4b9b-b786-3e1fa006643f could not be found. Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Request method failure captured: Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f HTTP/1.1 Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ET_-uVma4_ynqvp580XdupW72iOWhljwKuV0ZDp-gO-Cp9ABFecHNdnLR_7Q0rod9Etk_HJ6OYf1NGSJTA1R8XiYCatvO85syl7-9uz66_JzX6yz1YOn4nSNOiifp_J4pJ3G_Jum2sorrahAD0wFgv5wQJsZRxFJZvRXjdqXX-wHyM Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5918d79bd422403c9e8998747935af6c Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5918d79bd422403c9e8998747935af6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5918d79bd422403c9e8998747935af6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5918d79bd422403c9e8998747935af6c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5918d79bd422403c9e8998747935af6c"}]}] Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5918d79bd422403c9e8998747935af6c Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-553654240 Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesOneServerTestJSON-553654240-project Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 949c58249f22473e9956be855557b0b2 Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesOneServerTestJSON-553654240-project Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7df01792-8d3a-4b9b-b786-3e1fa006643f could not be found. Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7df01792-8d3a-4b9b-b786-3e1fa006643f'} Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7df01792-8d3a-4b9b-b786-3e1fa006643f could not be found. Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7df01792-8d3a-4b9b-b786-3e1fa006643f could not be found. Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:49:58.084893 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:58.090635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:49:58.090635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:49:58.090635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:49:58.090635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:49:58.090635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:49:58.090635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7df01792-8d3a-4b9b-b786-3e1fa006643f could not be found. Jul 26 19:49:58.090635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:49:58.092304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] Returning 404 to user: Instance 7df01792-8d3a-4b9b-b786-3e1fa006643f could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:49:58.093345 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-607383f4-8e72-469d-82bf-fb151165e70f tempest-ImagesOneServerTestJSON-553654240 tempest-ImagesOneServerTestJSON-553654240-project] 10.222.0.58 "GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f" status: 404 len: 111 microversion: 2.1 time: 0.043892 Jul 26 19:49:58.097387 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 878/1773] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:58 2022] GET /compute/v2.1/servers/7df01792-8d3a-4b9b-b786-3e1fa006643f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:49:58.869057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5214c44-8524-4d9a-8f0a-9e6e7979a94e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:58.870293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b5214c44-8524-4d9a-8f0a-9e6e7979a94e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:58.882986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5214c44-8524-4d9a-8f0a-9e6e7979a94e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:58.885589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5214c44-8524-4d9a-8f0a-9e6e7979a94e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:58.887039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5214c44-8524-4d9a-8f0a-9e6e7979a94e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:58.887883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5214c44-8524-4d9a-8f0a-9e6e7979a94e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:59.184922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b5214c44-8524-4d9a-8f0a-9e6e7979a94e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:59.193611 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b5214c44-8524-4d9a-8f0a-9e6e7979a94e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1317 microversion: 2.1 time: 0.331170 Jul 26 19:49:59.194205 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 879/1774] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:58 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:59.217358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44643ff9-0d08-4c5d-b682-535e0e6c2cf3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:49:59.218217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-44643ff9-0d08-4c5d-b682-535e0e6c2cf3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:49:59.226467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44643ff9-0d08-4c5d-b682-535e0e6c2cf3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:59.227109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44643ff9-0d08-4c5d-b682-535e0e6c2cf3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:59.229837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44643ff9-0d08-4c5d-b682-535e0e6c2cf3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:59.230463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44643ff9-0d08-4c5d-b682-535e0e6c2cf3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:59.318201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-44643ff9-0d08-4c5d-b682-535e0e6c2cf3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:49:59.327278 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44643ff9-0d08-4c5d-b682-535e0e6c2cf3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1268 microversion: 2.1 time: 0.113821 Jul 26 19:49:59.328326 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 880/1775] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:49:59 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:49:59.340162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-11e1bf1d-8aab-4e43-89ec-4ea4816006d8 req-0b1059b1-1303-4eaf-851a-31151a99b9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b114d6-d4fa-425a-ae17-66f167139c42", "tag": "3c20bc75-563d-451f-8538-81fb1b7c79f5"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:49:59.353337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-11e1bf1d-8aab-4e43-89ec-4ea4816006d8 req-0b1059b1-1303-4eaf-851a-31151a99b9c6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:49:59.353783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-11e1bf1d-8aab-4e43-89ec-4ea4816006d8 req-0b1059b1-1303-4eaf-851a-31151a99b9c6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:49:59.367111 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-11e1bf1d-8aab-4e43-89ec-4ea4816006d8 req-0b1059b1-1303-4eaf-851a-31151a99b9c6 service nova] Creating event network-changed:3c20bc75-563d-451f-8538-81fb1b7c79f5 for instance 86b114d6-d4fa-425a-ae17-66f167139c42 on n-h1-708768-8 Jul 26 19:49:59.372609 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-11e1bf1d-8aab-4e43-89ec-4ea4816006d8 req-0b1059b1-1303-4eaf-851a-31151a99b9c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042661 Jul 26 19:49:59.373509 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 881/1776] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:00.078687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:00.086005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Updating instance_info_cache with network_info: [] {{(pid=125963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:50:00.110198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-42ba63e9-e904-4373-bbef-ae11419c74dd req-13ae390a-cc36-42d3-8d69-9b8fc1234c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c880cc-b8a9-4167-aa94-5c52d9d130e0", "name": "network-vif-deleted", "tag": "821f8e2a-ea44-4252-9be5-5e243e4d636e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:00.144561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-42ba63e9-e904-4373-bbef-ae11419c74dd req-13ae390a-cc36-42d3-8d69-9b8fc1234c0d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:00.145014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-42ba63e9-e904-4373-bbef-ae11419c74dd req-13ae390a-cc36-42d3-8d69-9b8fc1234c0d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:00.243988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.server_external_events [req-42ba63e9-e904-4373-bbef-ae11419c74dd req-13ae390a-cc36-42d3-8d69-9b8fc1234c0d service nova] Unable to find a host for instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0. Dropping event network-vif-deleted {{(pid=125964) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 19:50:00.244983 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-42ba63e9-e904-4373-bbef-ae11419c74dd req-13ae390a-cc36-42d3-8d69-9b8fc1234c0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.144453 Jul 26 19:50:00.249630 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 882/1777] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 150 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 19:50:00.268470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79f3a575-18fd-48da-81f7-3eb3ba3df4e5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:00.272687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-79f3a575-18fd-48da-81f7-3eb3ba3df4e5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:00.304391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79f3a575-18fd-48da-81f7-3eb3ba3df4e5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:00.307516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79f3a575-18fd-48da-81f7-3eb3ba3df4e5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:00.312849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79f3a575-18fd-48da-81f7-3eb3ba3df4e5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:00.313609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79f3a575-18fd-48da-81f7-3eb3ba3df4e5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:00.572690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:00.624183 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f07e2f58-0197-4961-8a10-bac5d6600177 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 204 len: 0 microversion: 2.1 time: 4.160889 Jul 26 19:50:00.632477 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 896/1778] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:49:56 2022] DELETE /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 0 bytes in 4168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:50:00.635681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f79d10b-c826-44e5-aeb0-2c5d6a356aaa tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:00.636301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4f79d10b-c826-44e5-aeb0-2c5d6a356aaa tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:00.673841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f79d10b-c826-44e5-aeb0-2c5d6a356aaa tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:00.674323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f79d10b-c826-44e5-aeb0-2c5d6a356aaa tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:00.676463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f79d10b-c826-44e5-aeb0-2c5d6a356aaa tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:00.679103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f79d10b-c826-44e5-aeb0-2c5d6a356aaa tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:00.777323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79f3a575-18fd-48da-81f7-3eb3ba3df4e5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:00.790310 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79f3a575-18fd-48da-81f7-3eb3ba3df4e5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1317 microversion: 2.1 time: 0.526664 Jul 26 19:50:00.791225 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 883/1779] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:00 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:00.807281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:00.807923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:00.817494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:00.817850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:00.818694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:00.819128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:00.843804 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 HTTP/1.1 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '52c880cc-b8a9-4167-aa94-5c52d9d130e0'} Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:00.845452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:00.850951 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3d26966-b7ba-4b39-b61a-cd2d5b015b25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 404 len: 111 microversion: 2.1 time: 0.054622 Jul 26 19:50:00.869711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 884/1780] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:00 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:50:01.172454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6bf56428-21bf-4d9a-bdd6-63ca977fa9ca tempest-ListImageFiltersNegativeTestJSON-1688923835 tempest-ListImageFiltersNegativeTestJSON-1688923835-project] Calling method '.version_select at 0x7f875713ea60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:01.200987 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-6bf56428-21bf-4d9a-bdd6-63ca977fa9ca tempest-ListImageFiltersNegativeTestJSON-1688923835 tempest-ListImageFiltersNegativeTestJSON-1688923835-project] HTTP exception thrown: Image not found. Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6bf56428-21bf-4d9a-bdd6-63ca977fa9ca tempest-ListImageFiltersNegativeTestJSON-1688923835 tempest-ListImageFiltersNegativeTestJSON-1688923835-project] Request method failure captured: Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/images/db397627-2108-4760-94f3-76e915e31865 HTTP/1.1 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EVoyUbU226iIuZqXhTcWQhrNSR-vEWXC9YRNdT16vN4Iy3gDXj-AEcWnLaiAbm9jeB2hsOrPEdKUH4tuq60MghI9h_tpZYFc7_T-75KPOdg8gKe95-syGhmgm7kcIk7TW2-Y5kh53xsl-W6z3cHdqm3lgpKT6jBYMwGzbaEaMuJgWs Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 750a7ddae18e405c9e15141ead5a7762 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1688923835 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/750a7ddae18e405c9e15141ead5a7762"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/750a7ddae18e405c9e15141ead5a7762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_750a7ddae18e405c9e15141ead5a7762", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/750a7ddae18e405c9e15141ead5a7762"}]}] Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1688923835 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 750a7ddae18e405c9e15141ead5a7762 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1688923835 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ListImageFiltersNegativeTestJSON-1688923835-project Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: f580d98831094d92a65fbe81276e27a7 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1688923835-project Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: exception: Image not found. Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'db397627-2108-4760-94f3-76e915e31865'} Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID db397627-2108-4760-94f3-76e915e31865 Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 19:50:01.203189 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db397627-2108-4760-94f3-76e915e31865 could not be found. Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 19:50:01.208614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:01.215848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6bf56428-21bf-4d9a-bdd6-63ca977fa9ca tempest-ListImageFiltersNegativeTestJSON-1688923835 tempest-ListImageFiltersNegativeTestJSON-1688923835-project] Returning 404 to user: Image not found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:01.216708 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6bf56428-21bf-4d9a-bdd6-63ca977fa9ca tempest-ListImageFiltersNegativeTestJSON-1688923835 tempest-ListImageFiltersNegativeTestJSON-1688923835-project] 10.222.0.58 "GET /compute/v2.1/images/db397627-2108-4760-94f3-76e915e31865" status: 404 len: 62 microversion: 2.1 time: 0.348632 Jul 26 19:50:01.217622 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 885/1781] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:00 2022] GET /compute/v2.1/images/db397627-2108-4760-94f3-76e915e31865 => generated 62 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:50:01.235396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-114293988", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d609008d-caf9-4f78-8a5e-41e510179ad2"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:01.363797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] validate_networks() for [('d609008d-caf9-4f78-8a5e-41e510179ad2', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:01.672554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:02.168910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4f79d10b-c826-44e5-aeb0-2c5d6a356aaa tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:02.187646 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4f79d10b-c826-44e5-aeb0-2c5d6a356aaa tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1310 microversion: 2.1 time: 1.556180 Jul 26 19:50:02.197154 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 897/1782] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:00 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1310 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:02.211413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c7c94c1-77b5-4e13-b707-968218038e2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:02.215846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c7c94c1-77b5-4e13-b707-968218038e2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:02.247183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c7c94c1-77b5-4e13-b707-968218038e2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:02.249973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c7c94c1-77b5-4e13-b707-968218038e2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:02.252223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c7c94c1-77b5-4e13-b707-968218038e2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:02.255131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c7c94c1-77b5-4e13-b707-968218038e2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:02.779255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c7c94c1-77b5-4e13-b707-968218038e2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:02.793533 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c7c94c1-77b5-4e13-b707-968218038e2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1317 microversion: 2.1 time: 0.594473 Jul 26 19:50:02.795404 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 898/1783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:02 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:03.185369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:03.187059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:03.188001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:03.188919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:03.189540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:03.208883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:03.209962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:03.211411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:03.212453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:03.222998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e603525-dbc7-4d26-b82f-d771552b15f6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:03.224535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e603525-dbc7-4d26-b82f-d771552b15f6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:03.242562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e603525-dbc7-4d26-b82f-d771552b15f6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:03.245656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e603525-dbc7-4d26-b82f-d771552b15f6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:03.251057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e603525-dbc7-4d26-b82f-d771552b15f6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:03.251508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e603525-dbc7-4d26-b82f-d771552b15f6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:03.278928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:03.291462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for user 4e8808ff2c4341eca66334700ec25a82 and project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:03.342020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:03.349574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:03.458016 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f5bc79a-0da4-49be-98bb-a27c3f4ea4b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.239121 Jul 26 19:50:03.459372 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 886/1784] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:50:03.474851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26735691-c330-4e8f-851b-470aeebc6ae9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:03.479642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-26735691-c330-4e8f-851b-470aeebc6ae9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:03.704909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-26735691-c330-4e8f-851b-470aeebc6ae9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:03.714723 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-26735691-c330-4e8f-851b-470aeebc6ae9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1214 microversion: 2.1 time: 0.245814 Jul 26 19:50:03.717663 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 887/1785] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:03 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1214 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:03.734046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4db6fccc-39be-4fa7-9bbe-59db59a13fa0 req-7c26538f-db5e-4d6f-b665-92a413fb148e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13baaecc-fbee-455e-b19a-01055ffe15aa", "tag": "29c14f48-9d91-41cf-93b8-933d95135cb9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:03.766807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4db6fccc-39be-4fa7-9bbe-59db59a13fa0 req-7c26538f-db5e-4d6f-b665-92a413fb148e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:03.767259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4db6fccc-39be-4fa7-9bbe-59db59a13fa0 req-7c26538f-db5e-4d6f-b665-92a413fb148e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:03.797269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4db6fccc-39be-4fa7-9bbe-59db59a13fa0 req-7c26538f-db5e-4d6f-b665-92a413fb148e service nova] Creating event network-changed:29c14f48-9d91-41cf-93b8-933d95135cb9 for instance 13baaecc-fbee-455e-b19a-01055ffe15aa on n-h2-708768-8 Jul 26 19:50:03.811140 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4db6fccc-39be-4fa7-9bbe-59db59a13fa0 req-7c26538f-db5e-4d6f-b665-92a413fb148e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091521 Jul 26 19:50:03.812132 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 888/1786] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:03.827748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87e13757-1c32-4c8e-a853-5e4254333a65 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:03.829370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-87e13757-1c32-4c8e-a853-5e4254333a65 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:03.844810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87e13757-1c32-4c8e-a853-5e4254333a65 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:03.845450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87e13757-1c32-4c8e-a853-5e4254333a65 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:03.852663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87e13757-1c32-4c8e-a853-5e4254333a65 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:03.853283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87e13757-1c32-4c8e-a853-5e4254333a65 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:03.955696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e603525-dbc7-4d26-b82f-d771552b15f6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:03.976724 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e603525-dbc7-4d26-b82f-d771552b15f6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1310 microversion: 2.1 time: 0.758754 Jul 26 19:50:03.979875 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 899/1787] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:03 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1310 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:50:04.730470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-87e13757-1c32-4c8e-a853-5e4254333a65 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:04.743518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c471bde4-810e-40d2-928d-d1ee04cf5680 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:04.744783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c471bde4-810e-40d2-928d-d1ee04cf5680 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:04.751366 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-87e13757-1c32-4c8e-a853-5e4254333a65 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1317 microversion: 2.1 time: 0.937966 Jul 26 19:50:04.754025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:04.757091 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 889/1788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:03 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1317 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:04.772228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c471bde4-810e-40d2-928d-d1ee04cf5680 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:04.772712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c471bde4-810e-40d2-928d-d1ee04cf5680 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:04.773552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c471bde4-810e-40d2-928d-d1ee04cf5680 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:04.773985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c471bde4-810e-40d2-928d-d1ee04cf5680 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:05.005014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bcb4828c-a35d-437a-bf77-dfc92a764be2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:05.006091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bcb4828c-a35d-437a-bf77-dfc92a764be2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:05.017396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bcb4828c-a35d-437a-bf77-dfc92a764be2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:05.020394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bcb4828c-a35d-437a-bf77-dfc92a764be2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:05.020724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c471bde4-810e-40d2-928d-d1ee04cf5680 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:05.022795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bcb4828c-a35d-437a-bf77-dfc92a764be2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:05.023243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bcb4828c-a35d-437a-bf77-dfc92a764be2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:05.047962 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c471bde4-810e-40d2-928d-d1ee04cf5680 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1210 microversion: 2.1 time: 0.310524 Jul 26 19:50:05.049061 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 900/1789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:04 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1210 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:05.056589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6e153ad4-b747-4a17-9f5f-6087a103f320 req-bdcfb52f-23b2-4cff-8584-83b0fbc46c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b114d6-d4fa-425a-ae17-66f167139c42", "name": "network-vif-plugged", "status": "completed", "tag": "3c20bc75-563d-451f-8538-81fb1b7c79f5"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:05.094171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6e153ad4-b747-4a17-9f5f-6087a103f320 req-bdcfb52f-23b2-4cff-8584-83b0fbc46c4e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:05.095022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6e153ad4-b747-4a17-9f5f-6087a103f320 req-bdcfb52f-23b2-4cff-8584-83b0fbc46c4e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:05.121388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:05.132450 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6e153ad4-b747-4a17-9f5f-6087a103f320 req-bdcfb52f-23b2-4cff-8584-83b0fbc46c4e service nova] Creating event network-vif-plugged:3c20bc75-563d-451f-8538-81fb1b7c79f5 for instance 86b114d6-d4fa-425a-ae17-66f167139c42 on n-h1-708768-8 Jul 26 19:50:05.145554 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6e153ad4-b747-4a17-9f5f-6087a103f320 req-bdcfb52f-23b2-4cff-8584-83b0fbc46c4e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093202 Jul 26 19:50:05.147253 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 901/1790] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:05.933745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-632b143a-d247-46ac-8b39-94a8c1b9689c tempest-ListImagesTestJSON-1683695663 tempest-ListImagesTestJSON-1683695663-project] Calling method '.version_select at 0x7f875ebd61f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:05.946961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bcb4828c-a35d-437a-bf77-dfc92a764be2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:05.963138 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bcb4828c-a35d-437a-bf77-dfc92a764be2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1310 microversion: 2.1 time: 0.962952 Jul 26 19:50:05.965160 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 890/1791] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:04 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1310 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:05.971695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9cedb85f-1729-4822-aefe-a7a33b6fa3ed tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:05.978331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9cedb85f-1729-4822-aefe-a7a33b6fa3ed tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:05.993970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cedb85f-1729-4822-aefe-a7a33b6fa3ed tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:05.994499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cedb85f-1729-4822-aefe-a7a33b6fa3ed tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:05.995352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cedb85f-1729-4822-aefe-a7a33b6fa3ed tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:05.996089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9cedb85f-1729-4822-aefe-a7a33b6fa3ed tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:06.005120 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-632b143a-d247-46ac-8b39-94a8c1b9689c tempest-ListImagesTestJSON-1683695663 tempest-ListImagesTestJSON-1683695663-project] 10.222.0.58 "GET /compute/v2.1/images/d3881918-9bf6-46c2-abd0-edc31f73f7fa" status: 200 len: 784 microversion: 2.1 time: 0.346606 Jul 26 19:50:06.016231 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 902/1792] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:05 2022] GET /compute/v2.1/images/d3881918-9bf6-46c2-abd0-edc31f73f7fa => generated 784 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:50:06.022671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f6126e4-4c4f-4dcf-b621-6aa2ac6ebccf tempest-ListImagesTestJSON-1683695663 tempest-ListImagesTestJSON-1683695663-project] Calling method '.version_select at 0x7f875ec37af0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:06.113009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4f6126e4-4c4f-4dcf-b621-6aa2ac6ebccf tempest-ListImagesTestJSON-1683695663 tempest-ListImagesTestJSON-1683695663-project] 10.222.0.58 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.095179 Jul 26 19:50:06.123425 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 903/1793] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Jul 26 19:50:06 2022] GET /compute/v2.1/images => generated 445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:06.129719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7dcc872-91c0-490e-b317-f33cb7422d75 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:06.131333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e7dcc872-91c0-490e-b317-f33cb7422d75 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:06.139416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7dcc872-91c0-490e-b317-f33cb7422d75 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:06.140199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7dcc872-91c0-490e-b317-f33cb7422d75 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:06.141215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7dcc872-91c0-490e-b317-f33cb7422d75 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:06.141917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7dcc872-91c0-490e-b317-f33cb7422d75 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:06.335593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e7dcc872-91c0-490e-b317-f33cb7422d75 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:06.345353 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7dcc872-91c0-490e-b317-f33cb7422d75 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1272 microversion: 2.1 time: 0.220338 Jul 26 19:50:06.355664 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 904/1794] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:06 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:06.363584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f3af60af-5efc-4210-a14b-8ff333d300f0 tempest-ListImagesTestJSON-1683695663 tempest-ListImagesTestJSON-1683695663-project] Calling method '.version_select at 0x7f875ebdaa60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:06.450895 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f3af60af-5efc-4210-a14b-8ff333d300f0 tempest-ListImagesTestJSON-1683695663 tempest-ListImagesTestJSON-1683695663-project] 10.222.0.58 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.092555 Jul 26 19:50:06.451746 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 905/1795] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:50:06 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:06.513433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9cedb85f-1729-4822-aefe-a7a33b6fa3ed tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:06.526594 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9cedb85f-1729-4822-aefe-a7a33b6fa3ed tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1317 microversion: 2.1 time: 0.560125 Jul 26 19:50:06.530454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 891/1796] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:05 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:06.990366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11d17e64-70ab-4c5f-be57-42ce523d3f83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:06.991730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11d17e64-70ab-4c5f-be57-42ce523d3f83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:07.008302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11d17e64-70ab-4c5f-be57-42ce523d3f83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:07.021347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11d17e64-70ab-4c5f-be57-42ce523d3f83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:07.023216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11d17e64-70ab-4c5f-be57-42ce523d3f83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:07.024030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11d17e64-70ab-4c5f-be57-42ce523d3f83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:07.349851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-11d17e64-70ab-4c5f-be57-42ce523d3f83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:07.366114 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11d17e64-70ab-4c5f-be57-42ce523d3f83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1310 microversion: 2.1 time: 0.381005 Jul 26 19:50:07.369969 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 906/1797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:06 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1310 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:07.378686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4931ac55-87d9-4ef8-ac74-d9f9bf03be42 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:07.380494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4931ac55-87d9-4ef8-ac74-d9f9bf03be42 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:07.392450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4931ac55-87d9-4ef8-ac74-d9f9bf03be42 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:07.395266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4931ac55-87d9-4ef8-ac74-d9f9bf03be42 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:07.400385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4931ac55-87d9-4ef8-ac74-d9f9bf03be42 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:07.402796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4931ac55-87d9-4ef8-ac74-d9f9bf03be42 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:07.556232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-69877ee8-9516-40fb-aea8-5859d7c1321e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:07.557219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-69877ee8-9516-40fb-aea8-5859d7c1321e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:07.573344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69877ee8-9516-40fb-aea8-5859d7c1321e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:07.574281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69877ee8-9516-40fb-aea8-5859d7c1321e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:07.577652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69877ee8-9516-40fb-aea8-5859d7c1321e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:07.579328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69877ee8-9516-40fb-aea8-5859d7c1321e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:07.643804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4931ac55-87d9-4ef8-ac74-d9f9bf03be42 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:07.653083 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4931ac55-87d9-4ef8-ac74-d9f9bf03be42 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1272 microversion: 2.1 time: 0.278676 Jul 26 19:50:07.682352 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 892/1798] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:07 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:08.391671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45f5db51-7cee-46c9-b726-e9151e768005 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:08.392534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45f5db51-7cee-46c9-b726-e9151e768005 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:08.424828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45f5db51-7cee-46c9-b726-e9151e768005 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:08.426366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45f5db51-7cee-46c9-b726-e9151e768005 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:08.427517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45f5db51-7cee-46c9-b726-e9151e768005 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:08.433735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45f5db51-7cee-46c9-b726-e9151e768005 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:08.596438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-69877ee8-9516-40fb-aea8-5859d7c1321e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:08.607598 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-69877ee8-9516-40fb-aea8-5859d7c1321e tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1507 microversion: 2.1 time: 1.062204 Jul 26 19:50:08.608869 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 907/1799] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:07 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1507 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:50:08.690861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7ac1205-9870-4596-b5b0-d8bc76593ea5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:08.692710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e7ac1205-9870-4596-b5b0-d8bc76593ea5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:08.701411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ac1205-9870-4596-b5b0-d8bc76593ea5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:08.701985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ac1205-9870-4596-b5b0-d8bc76593ea5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:08.703917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ac1205-9870-4596-b5b0-d8bc76593ea5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:08.704592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ac1205-9870-4596-b5b0-d8bc76593ea5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:08.930578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45f5db51-7cee-46c9-b726-e9151e768005 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:08.954108 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45f5db51-7cee-46c9-b726-e9151e768005 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1310 microversion: 2.1 time: 0.567446 Jul 26 19:50:08.963429 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 893/1800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:08 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1310 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:50:09.285011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e7ac1205-9870-4596-b5b0-d8bc76593ea5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:09.302548 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7ac1205-9870-4596-b5b0-d8bc76593ea5 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1314 microversion: 2.1 time: 0.614850 Jul 26 19:50:09.303331 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 908/1801] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:08 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:50:09.504605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9f1fc62e-e9f9-4344-ba71-d33b6de4a29a req-3588dd6b-2946-44d8-8a47-ea64c0f9ae1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13baaecc-fbee-455e-b19a-01055ffe15aa", "name": "network-vif-plugged", "status": "completed", "tag": "29c14f48-9d91-41cf-93b8-933d95135cb9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:09.536825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9f1fc62e-e9f9-4344-ba71-d33b6de4a29a req-3588dd6b-2946-44d8-8a47-ea64c0f9ae1c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:09.537277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9f1fc62e-e9f9-4344-ba71-d33b6de4a29a req-3588dd6b-2946-44d8-8a47-ea64c0f9ae1c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:09.578450 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9f1fc62e-e9f9-4344-ba71-d33b6de4a29a req-3588dd6b-2946-44d8-8a47-ea64c0f9ae1c service nova] Creating event network-vif-plugged:29c14f48-9d91-41cf-93b8-933d95135cb9 for instance 13baaecc-fbee-455e-b19a-01055ffe15aa on n-h2-708768-8 Jul 26 19:50:09.612592 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9f1fc62e-e9f9-4344-ba71-d33b6de4a29a req-3588dd6b-2946-44d8-8a47-ea64c0f9ae1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095626 Jul 26 19:50:09.613383 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 894/1802] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:09.859802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-80c43439-5d11-4f33-b2be-09850e62c6c4 req-460558cd-4c38-4ce5-a482-022637016446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009", "tag": "2cea112a-80c6-4def-ac26-fa83b4bdc72b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:09.954891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-80c43439-5d11-4f33-b2be-09850e62c6c4 req-460558cd-4c38-4ce5-a482-022637016446 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:09.956984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-80c43439-5d11-4f33-b2be-09850e62c6c4 req-460558cd-4c38-4ce5-a482-022637016446 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:09.975589 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-80c43439-5d11-4f33-b2be-09850e62c6c4 req-460558cd-4c38-4ce5-a482-022637016446 service nova] Creating event network-changed:2cea112a-80c6-4def-ac26-fa83b4bdc72b for instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 on n-h1-708768-8 Jul 26 19:50:09.985521 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-80c43439-5d11-4f33-b2be-09850e62c6c4 req-460558cd-4c38-4ce5-a482-022637016446 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130527 Jul 26 19:50:09.987429 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 909/1803] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:09.992704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-04cc52e3-440e-42c6-8597-35420dfc5f99 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:09.994338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-04cc52e3-440e-42c6-8597-35420dfc5f99 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:10.020980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04cc52e3-440e-42c6-8597-35420dfc5f99 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:10.032663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04cc52e3-440e-42c6-8597-35420dfc5f99 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:10.035009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04cc52e3-440e-42c6-8597-35420dfc5f99 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:10.036563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04cc52e3-440e-42c6-8597-35420dfc5f99 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:10.329134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0526a933-dd9d-4b4f-a9b8-c489ad86412b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:10.330321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0526a933-dd9d-4b4f-a9b8-c489ad86412b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:10.339912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0526a933-dd9d-4b4f-a9b8-c489ad86412b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:10.340624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0526a933-dd9d-4b4f-a9b8-c489ad86412b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:10.342522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0526a933-dd9d-4b4f-a9b8-c489ad86412b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:10.343339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0526a933-dd9d-4b4f-a9b8-c489ad86412b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:10.679683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0526a933-dd9d-4b4f-a9b8-c489ad86412b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:10.692561 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0526a933-dd9d-4b4f-a9b8-c489ad86412b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1314 microversion: 2.1 time: 0.371217 Jul 26 19:50:10.697366 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 910/1804] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:10 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:10.818003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-04cc52e3-440e-42c6-8597-35420dfc5f99 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:10.829447 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-04cc52e3-440e-42c6-8597-35420dfc5f99 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1310 microversion: 2.1 time: 0.843871 Jul 26 19:50:10.843393 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 895/1805] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:09 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1310 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:11.416898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "538df417-5943-4292-b51c-5efc58bd4255"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:11.420053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:11.433800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:11.436135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:11.437992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:11.439307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:11.527115 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] HTTP exception thrown: Volume ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 could not be found. Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Request method failure captured: Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42/os-volume_attachments/ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 HTTP/1.1 Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 74 Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ETynJvrcF9ZsJjgRI1IeSLiALk1NQY-h4PuOH2--C-ntXFtt52L5gm0Q_01T7evM5htn4TmlkvcTETkbknpYpNwxjb3FyJdndMeDUEp7iiiAhovsFCMD2_CyS1GIJu6lnSwPRvO80ScmLDN5ugyX9ci15fryHjNKiaeFZQ07A37jo8 Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 54301d9fbaa941ed9b4771757a4c648f Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesAdminNegativeTest-2101911032 Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/54301d9fbaa941ed9b4771757a4c648f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54301d9fbaa941ed9b4771757a4c648f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_54301d9fbaa941ed9b4771757a4c648f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54301d9fbaa941ed9b4771757a4c648f"}]}] Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesAdminNegativeTest-2101911032 Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 54301d9fbaa941ed9b4771757a4c648f Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2101911032 Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesAdminNegativeTest-2101911032-project-admin Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: b26da98347454de39e7dc55f572418ef Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesAdminNegativeTest-2101911032-project-admin Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: {"volumeAttachment": {"volumeId": "538df417-5943-4292-b51c-5efc58bd4255"}} Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: exception: Volume ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 could not be found. Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '86b114d6-d4fa-425a-ae17-66f167139c42', 'id': 'ed8e8ed7-9e46-4893-aed3-49cf9c7edb56', 'body': {'volumeAttachment': {'volumeId': '538df417-5943-4292-b51c-5efc58bd4255'}}} Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 could not be found. (HTTP 404) (Request-ID: req-719b4c76-d393-4f88-9d10-ea5981d5de1e) Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:50:11.529658 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 could not be found. Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 could not be found. Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 could not be found. Jul 26 19:50:11.537228 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:11.544790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] Returning 404 to user: Volume ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:11.546226 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b5ee82d-4044-4db7-9054-25477c48661b tempest-VolumesAdminNegativeTest-2101911032 tempest-VolumesAdminNegativeTest-2101911032-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42/os-volume_attachments/ed8e8ed7-9e46-4893-aed3-49cf9c7edb56" status: 404 len: 109 microversion: 2.1 time: 0.133613 Jul 26 19:50:11.547466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 911/1806] 10.222.0.58 () {60 vars in 1433 bytes} [Tue Jul 26 19:50:11 2022] PUT /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42/os-volume_attachments/ed8e8ed7-9e46-4893-aed3-49cf9c7edb56 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:50:11.721885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4eaf41e-f548-4fea-b570-f18947410bd1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:11.722976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b4eaf41e-f548-4fea-b570-f18947410bd1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:11.735344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4eaf41e-f548-4fea-b570-f18947410bd1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:11.735923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4eaf41e-f548-4fea-b570-f18947410bd1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:11.736927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4eaf41e-f548-4fea-b570-f18947410bd1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:11.737722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4eaf41e-f548-4fea-b570-f18947410bd1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:11.854226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4a044973-9049-4d02-a912-ab32882093de tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:11.854978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4a044973-9049-4d02-a912-ab32882093de tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:11.864853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a044973-9049-4d02-a912-ab32882093de tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:11.868116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a044973-9049-4d02-a912-ab32882093de tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:11.870889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a044973-9049-4d02-a912-ab32882093de tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:11.872673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a044973-9049-4d02-a912-ab32882093de tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:12.143909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b4eaf41e-f548-4fea-b570-f18947410bd1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:12.155298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4eaf41e-f548-4fea-b570-f18947410bd1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1314 microversion: 2.1 time: 0.441773 Jul 26 19:50:12.161354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4a044973-9049-4d02-a912-ab32882093de tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:12.168597 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 896/1807] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:11 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:12.177996 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4a044973-9049-4d02-a912-ab32882093de tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1493 microversion: 2.1 time: 0.328310 Jul 26 19:50:12.178507 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 912/1808] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:11 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1493 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:12.207347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-067cfa20-0f90-4619-b564-45e5710bf2e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:12.208282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-067cfa20-0f90-4619-b564-45e5710bf2e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:12.225721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-067cfa20-0f90-4619-b564-45e5710bf2e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:12.226401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-067cfa20-0f90-4619-b564-45e5710bf2e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:12.228830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-067cfa20-0f90-4619-b564-45e5710bf2e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:12.229537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-067cfa20-0f90-4619-b564-45e5710bf2e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:12.583507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-067cfa20-0f90-4619-b564-45e5710bf2e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1644 microversion: 2.1 time: 0.381525 Jul 26 19:50:12.585987 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 897/1809] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:12 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1644 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:12.606123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8b8d6e08-e6fd-49ef-a8ed-e8d5a07ace10 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:12.607168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8b8d6e08-e6fd-49ef-a8ed-e8d5a07ace10 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:12.622933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b8d6e08-e6fd-49ef-a8ed-e8d5a07ace10 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:12.623509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b8d6e08-e6fd-49ef-a8ed-e8d5a07ace10 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:12.624691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b8d6e08-e6fd-49ef-a8ed-e8d5a07ace10 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:12.625315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b8d6e08-e6fd-49ef-a8ed-e8d5a07ace10 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:12.860576 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8b8d6e08-e6fd-49ef-a8ed-e8d5a07ace10 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1644 microversion: 2.1 time: 0.258323 Jul 26 19:50:12.864066 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 898/1810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:12 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1644 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:12.882649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb02dc58-b9a8-4534-a87d-951b7770a6bb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:12.886020 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:50:12.886020 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:50:12.887304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb02dc58-b9a8-4534-a87d-951b7770a6bb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:12.887800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb02dc58-b9a8-4534-a87d-951b7770a6bb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:12.888626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb02dc58-b9a8-4534-a87d-951b7770a6bb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:12.889069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb02dc58-b9a8-4534-a87d-951b7770a6bb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:12.918362 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb02dc58-b9a8-4534-a87d-951b7770a6bb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040672 Jul 26 19:50:12.918992 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 899/1811] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 19:50:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:50:12.931306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba77a0ca-fafb-4118-afee-a60e1f3e4973 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:12.931885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba77a0ca-fafb-4118-afee-a60e1f3e4973 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:12.938221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba77a0ca-fafb-4118-afee-a60e1f3e4973 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:12.938681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba77a0ca-fafb-4118-afee-a60e1f3e4973 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:12.942208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba77a0ca-fafb-4118-afee-a60e1f3e4973 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:12.943018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba77a0ca-fafb-4118-afee-a60e1f3e4973 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:13.008695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38b215b5-83c6-44d8-b15b-aa42470829b4 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Action: 'create', calling method: .version_select at 0x7f875ed6f4c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVbCC7lmW/x8lSm3vtfEFTCZRMK+ytw9hHKhwNJg9f/+1m+lbIYcTbmx01WW6OHmrNHCsJVHNpkCkAFKwoo578nKjWmMwKDWbjoTxARw1WwVbfEdK96fd+H3TK++pi99Q=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:13.019996 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-38b215b5-83c6-44d8-b15b-aa42470829b4 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38b215b5-83c6-44d8-b15b-aa42470829b4 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Request method failure captured: Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 257 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0JMCfVHZSkMmPlQ6-0iR2C9SKmf6AfMQshXrRaQIx690sfOwk0zvWZmkRLtisKqjw12n43vRrlivuqs6_Z7YC59BZDyBQJJnPPpIVi0HGUI6-Dq9r3XqvBRi4M0g94cS7r0K51nrU0vy2hTI7VyW-UaAQ71dI3wCSMn8JfEha1wU Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b6b95db2ed14b38b2eadc3e96b9c998", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}] Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVbCC7lmW/x8lSm3vtfEFTCZRMK+ytw9hHKhwNJg9f/+1m+lbIYcTbmx01WW6OHmrNHCsJVHNpkCkAFKwoo578nKjWmMwKDWbjoTxARw1WwVbfEdK96fd+H3TK++pi99Q=="}} Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVbCC7lmW/x8lSm3vtfEFTCZRMK+ytw9hHKhwNJg9f/+1m+lbIYcTbmx01WW6OHmrNHCsJVHNpkCkAFKwoo578nKjWmMwKDWbjoTxARw1WwVbfEdK96fd+H3TK++pi99Q=='}}} Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:13.030158 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 19:50:13.036250 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.041668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38b215b5-83c6-44d8-b15b-aa42470829b4 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:13.042706 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-38b215b5-83c6-44d8-b15b-aa42470829b4 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.560018 Jul 26 19:50:13.043527 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 913/1812] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:50:12 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 561 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 19:50:13.064962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7d460372-ad0f-449d-8cb4-ec31fcb22c20 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Action: 'create', calling method: .version_select at 0x7f875ebe1280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-999969219", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:13.093022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7d460372-ad0f-449d-8cb4-ec31fcb22c20 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:13.102210 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba77a0ca-fafb-4118-afee-a60e1f3e4973 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa/action" status: 202 len: 0 microversion: 2.1 time: 0.168327 Jul 26 19:50:13.106969 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 900/1813] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:50:12 2022] POST /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:50:13.110084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7d460372-ad0f-449d-8cb4-ec31fcb22c20 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for user b77ba6c6e7894b0eb516deb370817fb6 and project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:13.132643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b2c98bab-a6a4-44fa-9df5-e724c77a5e89 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:13.134025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b2c98bab-a6a4-44fa-9df5-e724c77a5e89 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:13.149790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2c98bab-a6a4-44fa-9df5-e724c77a5e89 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:13.153103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2c98bab-a6a4-44fa-9df5-e724c77a5e89 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:13.154145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2c98bab-a6a4-44fa-9df5-e724c77a5e89 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:13.155117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2c98bab-a6a4-44fa-9df5-e724c77a5e89 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:13.156427 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-7d460372-ad0f-449d-8cb4-ec31fcb22c20 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7d460372-ad0f-449d-8cb4-ec31fcb22c20 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Request method failure captured: Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 2166 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0JMCfVHZSkMmPlQ6-0iR2C9SKmf6AfMQshXrRaQIx690sfOwk0zvWZmkRLtisKqjw12n43vRrlivuqs6_Z7YC59BZDyBQJJnPPpIVi0HGUI6-Dq9r3XqvBRi4M0g94cS7r0K51nrU0vy2hTI7VyW-UaAQ71dI3wCSMn8JfEha1wU Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b6b95db2ed14b38b2eadc3e96b9c998", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}] Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-999969219", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:50:13.178078 n-d-708768-8 devstack@n-api.service[125963]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-999969219', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:13.180930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7d460372-ad0f-449d-8cb4-ec31fcb22c20 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:13.184233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7d460372-ad0f-449d-8cb4-ec31fcb22c20 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.130823 Jul 26 19:50:13.187094 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 914/1814] 10.222.0.58 () {60 vars in 1160 bytes} [Tue Jul 26 19:50:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:50:13.195294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90b01492-0266-42e5-99b9-306d394f33c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:13.195969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90b01492-0266-42e5-99b9-306d394f33c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:13.212799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:13.217470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:13.220722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90b01492-0266-42e5-99b9-306d394f33c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:13.221098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90b01492-0266-42e5-99b9-306d394f33c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:13.222607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90b01492-0266-42e5-99b9-306d394f33c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:13.223055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90b01492-0266-42e5-99b9-306d394f33c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:13.251932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=82,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=14,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:13.452742 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b2c98bab-a6a4-44fa-9df5-e724c77a5e89 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1649 microversion: 2.1 time: 0.340283 Jul 26 19:50:13.476490 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 901/1815] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:13 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1649 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:13.496051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-58d9ca40-bbcb-45a7-87d3-6938e0ee97fc tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Action: 'create', calling method: .version_select at 0x7f8756fbf4c0>, body: {"keypair": {"name": "tempest-keypair-774511115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPR27GPI0VocgOSP0OBD9Do4AlBK/s+JtftL0J+e05cL5u3GvjGkbLw8hpCqwCBSj1/EAe6LVhPmrtoXbUHg4sRfoDTFhRuQWaW4m8jBZtSu45lKEh2ZbMKu0NNKNYRhQ=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:13.538026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-58d9ca40-bbcb-45a7-87d3-6938e0ee97fc tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:13.549128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-58d9ca40-bbcb-45a7-87d3-6938e0ee97fc tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for user b77ba6c6e7894b0eb516deb370817fb6 and project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:13.617105 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-58d9ca40-bbcb-45a7-87d3-6938e0ee97fc tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151682 Jul 26 19:50:13.618722 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 902/1816] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:50:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:13.631480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90b01492-0266-42e5-99b9-306d394f33c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:13.644570 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90b01492-0266-42e5-99b9-306d394f33c6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1314 microversion: 2.1 time: 0.454030 Jul 26 19:50:13.645183 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 915/1817] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:13 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:13.669466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ab5ff64-ad02-4cb5-bbb8-ef6fa39dfed7 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Action: 'create', calling method: .version_select at 0x7f875ecdc3a0>, body: {"keypair": {"name": "tempest-keypair-774511115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPDrvy5BD9/5iecCbB98hRTc86fhPfSk3balgjp2EufhcSoG/cUsXRnw5NmkJJ3Zd0M7qi6Do9Q3E3TJn4hIQpYv6m9LlMbJvQfY7gqo+e92tCsbOYcHZAtmSb/9JdLJw=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:13.694699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-0ab5ff64-ad02-4cb5-bbb8-ef6fa39dfed7 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:13.704185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-0ab5ff64-ad02-4cb5-bbb8-ef6fa39dfed7 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for user b77ba6c6e7894b0eb516deb370817fb6 and project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:13.725382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65a82817-3bcc-4881-a40e-84e61930b694 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1496394987", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:13.730770 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-65a82817-3bcc-4881-a40e-84e61930b694 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] HTTP exception thrown: min_count must be <= max_count Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65a82817-3bcc-4881-a40e-84e61930b694 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Request method failure captured: Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 184 Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EV0WF7T_MSCVCvExtpgVajhzEsgwbnxX-7UR0W8S7VX5hrGSkBBmzxW_7yiCJDnfFMa9ueZyM-EMawrrpnPHV6yWEvNV8f74qeW3GY4MyvJR8ie_ODpNImNC6QrpavDEuOUn92uAKtu_9KSe4GIYMJfRvOv4_kmBwAHzrCv-rD0zaA Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd49687bca82474b8bd196947f5be3be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}] Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2974c8af2aa84403b5af97a62382e485 Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1496394987", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: exception: min_count must be <= max_count Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1496394987', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 26 19:50:13.732710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.741429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65a82817-3bcc-4881-a40e-84e61930b694 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Returning 400 to user: min_count must be <= max_count {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:13.743145 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0ab5ff64-ad02-4cb5-bbb8-ef6fa39dfed7 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] HTTP exception thrown: Key pair 'tempest-keypair-774511115' already exists. Jul 26 19:50:13.743578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65a82817-3bcc-4881-a40e-84e61930b694 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.122656 Jul 26 19:50:13.744814 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 903/1818] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:13 2022] POST /compute/v2.1/servers => generated 74 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ab5ff64-ad02-4cb5-bbb8-ef6fa39dfed7 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Request method failure captured: Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 272 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0JMCfVHZSkMmPlQ6-0iR2C9SKmf6AfMQshXrRaQIx690sfOwk0zvWZmkRLtisKqjw12n43vRrlivuqs6_Z7YC59BZDyBQJJnPPpIVi0HGUI6-Dq9r3XqvBRi4M0g94cS7r0K51nrU0vy2hTI7VyW-UaAQ71dI3wCSMn8JfEha1wU Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b6b95db2ed14b38b2eadc3e96b9c998", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}] Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: {"keypair": {"name": "tempest-keypair-774511115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPDrvy5BD9/5iecCbB98hRTc86fhPfSk3balgjp2EufhcSoG/cUsXRnw5NmkJJ3Zd0M7qi6Do9Q3E3TJn4hIQpYv6m9LlMbJvQfY7gqo+e92tCsbOYcHZAtmSb/9JdLJw=="}} Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: exception: Key pair 'tempest-keypair-774511115' already exists. Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-774511115', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPDrvy5BD9/5iecCbB98hRTc86fhPfSk3balgjp2EufhcSoG/cUsXRnw5NmkJJ3Zd0M7qi6Do9Q3E3TJn4hIQpYv6m9LlMbJvQfY7gqo+e92tCsbOYcHZAtmSb/9JdLJw=='}}} Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result.read() Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b77ba6c6e7894b0eb516deb370817fb6-tempest-keypair-774511115' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 26 19:50:13.813179 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result.read() Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 19:50:13.818769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b77ba6c6e7894b0eb516deb370817fb6-tempest-keypair-774511115' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 19, 50, 13, 724476), 'updated_at': None, 'name': 'tempest-keypair-774511115', 'user_id': 'b77ba6c6e7894b0eb516deb370817fb6', 'fingerprint': '33:bb:e6:02:f6:c6:b5:2b:97:e8:ed:0b:2f:56:2a:55', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPDrvy5BD9/5iecCbB98hRTc86fhPfSk3balgjp2EufhcSoG/cUsXRnw5NmkJJ3Zd0M7qi6Do9Q3E3TJn4hIQpYv6m9LlMbJvQfY7gqo+e92tCsbOYcHZAtmSb/9JdLJw==', 'type': 'ssh'}] Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi keypair.create() Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._create() Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-774511115' already exists. Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 26 19:50:13.824156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-774511115' already exists. Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-774511115' already exists. Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.828962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ab5ff64-ad02-4cb5-bbb8-ef6fa39dfed7 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Returning 409 to user: Key pair 'tempest-keypair-774511115' already exists. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:13.831385 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ab5ff64-ad02-4cb5-bbb8-ef6fa39dfed7 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.179398 Jul 26 19:50:13.831385 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 916/1819] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:50:13 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:50:13.852808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29efa061-b0ae-4212-a232-39d85601d42c tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Calling method '.version_select at 0x7f8756f895e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:13.873601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c9c6f81c-5376-4b8e-9f42-08b9970a5790 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-167610340", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "max_count": 0}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c9c6f81c-5376-4b8e-9f42-08b9970a5790 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Request method failure captured: Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 167 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0WF7T_MSCVCvExtpgVajhzEsgwbnxX-7UR0W8S7VX5hrGSkBBmzxW_7yiCJDnfFMa9ueZyM-EMawrrpnPHV6yWEvNV8f74qeW3GY4MyvJR8ie_ODpNImNC6QrpavDEuOUn92uAKtu_9KSe4GIYMJfRvOv4_kmBwAHzrCv-rD0zaA Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd49687bca82474b8bd196947f5be3be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}] Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 2974c8af2aa84403b5af97a62382e485 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-167610340", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "max_count": 0}} Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-167610340', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'max_count': 0}}} Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 0 Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:50:13.880860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 19:50:13.886791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.889492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c9c6f81c-5376-4b8e-9f42-08b9970a5790 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:13.890537 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c9c6f81c-5376-4b8e-9f42-08b9970a5790 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023059 Jul 26 19:50:13.902895 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 917/1820] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:13 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:50:13.951348 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29efa061-b0ae-4212-a232-39d85601d42c tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774511115" status: 202 len: 0 microversion: 2.1 time: 0.113964 Jul 26 19:50:13.953523 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 904/1821] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774511115 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:50:13.966657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4daff0b6-773f-46aa-b2c8-72df9cdfdfc6 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Action: 'create', calling method: .version_select at 0x7f875ed34c10>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyvyTYt3B0ISvxSpLSBqJML7ccTFjMUSzuuLcCB8S4BqnTNIbXSP4P/ffURYroEZjzwg4T8XYs00pjo/665beXzajiVntyzAeGT3t16nQPQjeZCtg4+941RgCfbpqDOfg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4daff0b6-773f-46aa-b2c8-72df9cdfdfc6 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Request method failure captured: Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 247 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0JMCfVHZSkMmPlQ6-0iR2C9SKmf6AfMQshXrRaQIx690sfOwk0zvWZmkRLtisKqjw12n43vRrlivuqs6_Z7YC59BZDyBQJJnPPpIVi0HGUI6-Dq9r3XqvBRi4M0g94cS7r0K51nrU0vy2hTI7VyW-UaAQ71dI3wCSMn8JfEha1wU Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b6b95db2ed14b38b2eadc3e96b9c998", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}] Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyvyTYt3B0ISvxSpLSBqJML7ccTFjMUSzuuLcCB8S4BqnTNIbXSP4P/ffURYroEZjzwg4T8XYs00pjo/665beXzajiVntyzAeGT3t16nQPQjeZCtg4+941RgCfbpqDOfg=="}} Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyvyTYt3B0ISvxSpLSBqJML7ccTFjMUSzuuLcCB8S4BqnTNIbXSP4P/ffURYroEZjzwg4T8XYs00pjo/665beXzajiVntyzAeGT3t16nQPQjeZCtg4+941RgCfbpqDOfg=='}}} Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi '' Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:50:13.970829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 19:50:13.976943 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:13.985415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4daff0b6-773f-46aa-b2c8-72df9cdfdfc6 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:13.985415 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4daff0b6-773f-46aa-b2c8-72df9cdfdfc6 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.017758 Jul 26 19:50:13.988600 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 918/1822] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:50:13 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:50:13.992440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba123544-a547-4011-b3fa-27901b664b03 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Action: 'create', calling method: .version_select at 0x7f8756decb80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1595282870", "public_key": " "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:14.040282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4738fe0-dbd6-475c-a578-cbe404ae968e tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1869165964", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "max_count": 2.5}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4738fe0-dbd6-475c-a578-cbe404ae968e tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Request method failure captured: Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 170 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0WF7T_MSCVCvExtpgVajhzEsgwbnxX-7UR0W8S7VX5hrGSkBBmzxW_7yiCJDnfFMa9ueZyM-EMawrrpnPHV6yWEvNV8f74qeW3GY4MyvJR8ie_ODpNImNC6QrpavDEuOUn92uAKtu_9KSe4GIYMJfRvOv4_kmBwAHzrCv-rD0zaA Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd49687bca82474b8bd196947f5be3be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}] Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 2974c8af2aa84403b5af97a62382e485 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1869165964", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "max_count": 2.5}} Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1869165964', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'max_count': 2.5}}} Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 2.5 Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:50:14.045277 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 19:50:14.051583 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.058089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4738fe0-dbd6-475c-a578-cbe404ae968e tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:14.059232 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4738fe0-dbd6-475c-a578-cbe404ae968e tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042970 Jul 26 19:50:14.060582 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 919/1823] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:50:14.082268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ba123544-a547-4011-b3fa-27901b664b03 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:14.088382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ba123544-a547-4011-b3fa-27901b664b03 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for user b77ba6c6e7894b0eb516deb370817fb6 and project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:14.107399 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ba123544-a547-4011-b3fa-27901b664b03 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba123544-a547-4011-b3fa-27901b664b03 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Request method failure captured: Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 95 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EV0JMCfVHZSkMmPlQ6-0iR2C9SKmf6AfMQshXrRaQIx690sfOwk0zvWZmkRLtisKqjw12n43vRrlivuqs6_Z7YC59BZDyBQJJnPPpIVi0HGUI6-Dq9r3XqvBRi4M0g94cS7r0K51nrU0vy2hTI7VyW-UaAQ71dI3wCSMn8JfEha1wU Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b6b95db2ed14b38b2eadc3e96b9c998", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}] Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1595282870", "public_key": " "}} Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1595282870', 'public_key': ' '}}} Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.112652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.118577 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.122898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba123544-a547-4011-b3fa-27901b664b03 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:14.126608 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba123544-a547-4011-b3fa-27901b664b03 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.137250 Jul 26 19:50:14.141892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1bcf821b-4f04-437e-b808-e76f46ebb920 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Action: 'create', calling method: .version_select at 0x7f875ed34160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJiPQPVY/x2hw0u96MlunXxb6etpKRrs1634YTPxUlzlDTEju76i2sPOJ13qhfyYFP2nPp9N5aSRvXrzhlmHj9xqDsG9EVl0Hkf7KWzKe4Hgrtk4A8YW03cNO2ihN4/vg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1bcf821b-4f04-437e-b808-e76f46ebb920 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Request method failure captured: Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 507 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0JMCfVHZSkMmPlQ6-0iR2C9SKmf6AfMQshXrRaQIx690sfOwk0zvWZmkRLtisKqjw12n43vRrlivuqs6_Z7YC59BZDyBQJJnPPpIVi0HGUI6-Dq9r3XqvBRi4M0g94cS7r0K51nrU0vy2hTI7VyW-UaAQ71dI3wCSMn8JfEha1wU Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b6b95db2ed14b38b2eadc3e96b9c998", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}] Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJiPQPVY/x2hw0u96MlunXxb6etpKRrs1634YTPxUlzlDTEju76i2sPOJ13qhfyYFP2nPp9N5aSRvXrzhlmHj9xqDsG9EVl0Hkf7KWzKe4Hgrtk4A8YW03cNO2ihN4/vg=="}} Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJiPQPVY/x2hw0u96MlunXxb6etpKRrs1634YTPxUlzlDTEju76i2sPOJ13qhfyYFP2nPp9N5aSRvXrzhlmHj9xqDsG9EVl0Hkf7KWzKe4Hgrtk4A8YW03cNO2ihN4/vg=='}}} Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 26 19:50:14.147832 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1bcf821b-4f04-437e-b808-e76f46ebb920 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:14.152258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1bcf821b-4f04-437e-b808-e76f46ebb920 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011727 Jul 26 19:50:14.155168 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 905/1824] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Jul 26 19:50:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:50:14.157635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 920/1825] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:50:14 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:50:14.160049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74a0f9eb-6d5d-4496-bf30-84b09084a041 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Action: 'create', calling method: .version_select at 0x7f8756e63d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-863939151", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:14.179812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5bc7d8e-f2c6-482a-aee0-886fc70f524b tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-125708031", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 0}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5bc7d8e-f2c6-482a-aee0-886fc70f524b tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Request method failure captured: Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 167 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0WF7T_MSCVCvExtpgVajhzEsgwbnxX-7UR0W8S7VX5hrGSkBBmzxW_7yiCJDnfFMa9ueZyM-EMawrrpnPHV6yWEvNV8f74qeW3GY4MyvJR8ie_ODpNImNC6QrpavDEuOUn92uAKtu_9KSe4GIYMJfRvOv4_kmBwAHzrCv-rD0zaA Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd49687bca82474b8bd196947f5be3be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}] Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 2974c8af2aa84403b5af97a62382e485 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-125708031", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 0}} Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-125708031', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'min_count': 0}}} Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 0 Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:50:14.185641 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5bc7d8e-f2c6-482a-aee0-886fc70f524b tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:14.191757 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c5bc7d8e-f2c6-482a-aee0-886fc70f524b tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.014916 Jul 26 19:50:14.200626 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 921/1826] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:14 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:50:14.210888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-74a0f9eb-6d5d-4496-bf30-84b09084a041 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:14.217421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-74a0f9eb-6d5d-4496-bf30-84b09084a041 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Getting quotas for user b77ba6c6e7894b0eb516deb370817fb6 and project 8b6b95db2ed14b38b2eadc3e96b9c998. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:14.222708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:14.254339 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-74a0f9eb-6d5d-4496-bf30-84b09084a041 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74a0f9eb-6d5d-4496-bf30-84b09084a041 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Request method failure captured: Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 117 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EV0JMCfVHZSkMmPlQ6-0iR2C9SKmf6AfMQshXrRaQIx690sfOwk0zvWZmkRLtisKqjw12n43vRrlivuqs6_Z7YC59BZDyBQJJnPPpIVi0HGUI6-Dq9r3XqvBRi4M0g94cS7r0K51nrU0vy2hTI7VyW-UaAQ71dI3wCSMn8JfEha1wU Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b6b95db2ed14b38b2eadc3e96b9c998", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}] Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-863939151", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-863939151', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 19:50:14.256566 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74a0f9eb-6d5d-4496-bf30-84b09084a041 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:14.262087 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74a0f9eb-6d5d-4496-bf30-84b09084a041 tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.102976 Jul 26 19:50:14.266828 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 906/1827] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:50:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:50:14.269677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2a0bfab-1c1a-428f-99b0-bb68da0c1e0d tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Calling method '.version_select at 0x7f875ebe1820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:14.272456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1bd51a4-ce7e-48f1-95c4-85259f298488 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1904977240", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 2.5}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1bd51a4-ce7e-48f1-95c4-85259f298488 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Request method failure captured: Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 170 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EV0WF7T_MSCVCvExtpgVajhzEsgwbnxX-7UR0W8S7VX5hrGSkBBmzxW_7yiCJDnfFMa9ueZyM-EMawrrpnPHV6yWEvNV8f74qeW3GY4MyvJR8ie_ODpNImNC6QrpavDEuOUn92uAKtu_9KSe4GIYMJfRvOv4_kmBwAHzrCv-rD0zaA Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fd49687bca82474b8bd196947f5be3be", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fd49687bca82474b8bd196947f5be3be"}]}] Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fd49687bca82474b8bd196947f5be3be Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-642151210 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2974c8af2aa84403b5af97a62382e485 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-642151210-project Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1904977240", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 2.5}} Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1904977240', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'min_count': 2.5}}} Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 2.5 Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:50:14.282359 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 19:50:14.289196 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-e2a0bfab-1c1a-428f-99b0-bb68da0c1e0d tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-553011214 not found for user b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2a0bfab-1c1a-428f-99b0-bb68da0c1e0d tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Request method failure captured: Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-553011214 HTTP/1.1 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EV0JMCfVHZSkMmPlQ6-0iR2C9SKmf6AfMQshXrRaQIx690sfOwk0zvWZmkRLtisKqjw12n43vRrlivuqs6_Z7YC59BZDyBQJJnPPpIVi0HGUI6-Dq9r3XqvBRi4M0g94cS7r0K51nrU0vy2hTI7VyW-UaAQ71dI3wCSMn8JfEha1wU Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b6b95db2ed14b38b2eadc3e96b9c998", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b6b95db2ed14b38b2eadc3e96b9c998"}]}] Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8b6b95db2ed14b38b2eadc3e96b9c998 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1361612075 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1361612075-project Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: exception: Keypair tempest-keypair-non-existent-553011214 not found for user b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'tempest-keypair-non-existent-553011214'} Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 26 19:50:14.290747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-553011214 not found for user b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-553011214 not found for user b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-553011214 not found for user b77ba6c6e7894b0eb516deb370817fb6 Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2a0bfab-1c1a-428f-99b0-bb68da0c1e0d tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] Returning 404 to user: Keypair tempest-keypair-non-existent-553011214 not found for user b77ba6c6e7894b0eb516deb370817fb6 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e2a0bfab-1c1a-428f-99b0-bb68da0c1e0d tempest-KeyPairsNegativeTestJSON-1361612075 tempest-KeyPairsNegativeTestJSON-1361612075-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-553011214" status: 404 len: 144 microversion: 2.1 time: 0.022630 Jul 26 19:50:14.300204 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 922/1828] 10.222.0.58 () {58 vars in 1257 bytes} [Tue Jul 26 19:50:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-553011214 => generated 144 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:50:14.304981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1bd51a4-ce7e-48f1-95c4-85259f298488 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:14.307810 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1bd51a4-ce7e-48f1-95c4-85259f298488 tempest-MultipleCreateNegativeTestJSON-642151210 tempest-MultipleCreateNegativeTestJSON-642151210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.038449 Jul 26 19:50:14.310616 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 907/1829] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:50:14.487738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d6ac194c-0024-4968-9b86-8bb14024b941 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:14.489366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d6ac194c-0024-4968-9b86-8bb14024b941 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:14.498699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6ac194c-0024-4968-9b86-8bb14024b941 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:14.501372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6ac194c-0024-4968-9b86-8bb14024b941 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:14.505419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6ac194c-0024-4968-9b86-8bb14024b941 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:14.507801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6ac194c-0024-4968-9b86-8bb14024b941 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:14.670603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b0995fd-27e0-4eb8-a918-c55c2d11cc7f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:14.671231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1b0995fd-27e0-4eb8-a918-c55c2d11cc7f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:14.695718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b0995fd-27e0-4eb8-a918-c55c2d11cc7f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:14.696225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b0995fd-27e0-4eb8-a918-c55c2d11cc7f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:14.698784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b0995fd-27e0-4eb8-a918-c55c2d11cc7f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:14.699243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b0995fd-27e0-4eb8-a918-c55c2d11cc7f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:14.773306 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d6ac194c-0024-4968-9b86-8bb14024b941 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1629 microversion: 2.1 time: 0.285131 Jul 26 19:50:14.775546 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 923/1830] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:14 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1629 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:14.804840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-708768-8", "block_migration": true, "disk_over_commit": false}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:14.810156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:14.829845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:14.831692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:14.833736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:14.836954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:14.900682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lazy-loading 'flavor' on Instance uuid 13baaecc-fbee-455e-b19a-01055ffe15aa {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:50:14.944761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Going to try to live migrate instance to n-h1-708768-8 {{(pid=125963) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:50:15.366486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1b0995fd-27e0-4eb8-a918-c55c2d11cc7f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:15.396399 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b0995fd-27e0-4eb8-a918-c55c2d11cc7f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1314 microversion: 2.1 time: 0.722133 Jul 26 19:50:15.397585 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 908/1831] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:14 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:15.415384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9992305e-343a-4f2c-aa7f-c0d47da9616d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:15.422174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9992305e-343a-4f2c-aa7f-c0d47da9616d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:15.441346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9992305e-343a-4f2c-aa7f-c0d47da9616d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:15.444168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9992305e-343a-4f2c-aa7f-c0d47da9616d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:15.445773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9992305e-343a-4f2c-aa7f-c0d47da9616d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:15.447697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9992305e-343a-4f2c-aa7f-c0d47da9616d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:15.554143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9992305e-343a-4f2c-aa7f-c0d47da9616d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:50:15.812773 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9992305e-343a-4f2c-aa7f-c0d47da9616d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "DELETE /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 204 len: 0 microversion: 2.1 time: 0.412126 Jul 26 19:50:15.813312 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 909/1832] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:50:15 2022] DELETE /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:50:15.833239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6331c87c-3597-4fae-a230-9f03c63517d3 req-2bdeb832-c279-49ef-9089-8863583395df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009", "name": "network-vif-plugged", "status": "completed", "tag": "2cea112a-80c6-4def-ac26-fa83b4bdc72b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:15.868666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6331c87c-3597-4fae-a230-9f03c63517d3 req-2bdeb832-c279-49ef-9089-8863583395df service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:15.870373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6331c87c-3597-4fae-a230-9f03c63517d3 req-2bdeb832-c279-49ef-9089-8863583395df service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:15.892745 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6331c87c-3597-4fae-a230-9f03c63517d3 req-2bdeb832-c279-49ef-9089-8863583395df service nova] Creating event network-vif-plugged:2cea112a-80c6-4def-ac26-fa83b4bdc72b for instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 on n-h1-708768-8 Jul 26 19:50:15.900501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6331c87c-3597-4fae-a230-9f03c63517d3 req-2bdeb832-c279-49ef-9089-8863583395df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082052 Jul 26 19:50:15.901820 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 910/1833] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:15.912933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e31f544-1092-4114-8a04-0dea1409c883 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756ed8b80>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:16.066638 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e31f544-1092-4114-8a04-0dea1409c883 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/57a1bc3c-71b4-4e32-902c-408d3e45dbfc" status: 200 len: 661 microversion: 2.1 time: 0.160915 Jul 26 19:50:16.067684 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 911/1834] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:15 2022] GET /compute/v2.1/images/57a1bc3c-71b4-4e32-902c-408d3e45dbfc => generated 661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:16.081921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12c793b8-6395-4716-80eb-112759d4ce62 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:16.084150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-12c793b8-6395-4716-80eb-112759d4ce62 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:16.109402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12c793b8-6395-4716-80eb-112759d4ce62 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:16.112392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12c793b8-6395-4716-80eb-112759d4ce62 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:16.115939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12c793b8-6395-4716-80eb-112759d4ce62 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:16.116948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12c793b8-6395-4716-80eb-112759d4ce62 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:17.592653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-12c793b8-6395-4716-80eb-112759d4ce62 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:17.602457 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-12c793b8-6395-4716-80eb-112759d4ce62 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1513 microversion: 2.1 time: 1.533168 Jul 26 19:50:17.605008 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 912/1835] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:16 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1513 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:17.610656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4426a36c-ba2b-40ac-8792-8a94e7040929 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756ed81f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:17.690366 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4426a36c-ba2b-40ac-8792-8a94e7040929 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/57a1bc3c-71b4-4e32-902c-408d3e45dbfc" status: 200 len: 661 microversion: 2.1 time: 0.083442 Jul 26 19:50:17.695862 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 913/1836] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:17 2022] GET /compute/v2.1/images/57a1bc3c-71b4-4e32-902c-408d3e45dbfc => generated 661 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:17.719437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5d25e89d-552f-48ef-8d50-b8b748401602 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:17.734775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5d25e89d-552f-48ef-8d50-b8b748401602 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:17.756149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d25e89d-552f-48ef-8d50-b8b748401602 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:17.760521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d25e89d-552f-48ef-8d50-b8b748401602 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:17.762665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d25e89d-552f-48ef-8d50-b8b748401602 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:17.763281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d25e89d-552f-48ef-8d50-b8b748401602 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:18.197871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8db1f332-8224-416b-a1ef-fa0c7e0f00ba tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa/action" status: 202 len: 0 microversion: 2.1 time: 3.403769 Jul 26 19:50:18.202548 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 924/1837] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:50:14 2022] POST /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa/action => generated 0 bytes in 3409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:50:18.209581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1d40602-9f22-40fc-b761-401e68a72002 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:18.213259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1d40602-9f22-40fc-b761-401e68a72002 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:18.236520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1d40602-9f22-40fc-b761-401e68a72002 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:18.238355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1d40602-9f22-40fc-b761-401e68a72002 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:18.239774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1d40602-9f22-40fc-b761-401e68a72002 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:18.241346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1d40602-9f22-40fc-b761-401e68a72002 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:18.595404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5d25e89d-552f-48ef-8d50-b8b748401602 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:18.612550 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5d25e89d-552f-48ef-8d50-b8b748401602 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1314 microversion: 2.1 time: 0.909720 Jul 26 19:50:18.616947 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 914/1838] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:17 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1314 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:18.681227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1d40602-9f22-40fc-b761-401e68a72002 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:18.682328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46d33499-2d1a-4f53-893c-49625aa0c2e1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:18.686711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-46d33499-2d1a-4f53-893c-49625aa0c2e1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:18.691863 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1d40602-9f22-40fc-b761-401e68a72002 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 0.487996 Jul 26 19:50:18.695187 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 925/1839] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:18 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:18.704866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d33499-2d1a-4f53-893c-49625aa0c2e1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:18.706110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d33499-2d1a-4f53-893c-49625aa0c2e1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:18.707285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d33499-2d1a-4f53-893c-49625aa0c2e1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:18.710178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46d33499-2d1a-4f53-893c-49625aa0c2e1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:19.637428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0b813e27-2d86-45ea-b2ef-6ab1eabe0af1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:19.643037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0b813e27-2d86-45ea-b2ef-6ab1eabe0af1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:19.660598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b813e27-2d86-45ea-b2ef-6ab1eabe0af1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:19.661893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b813e27-2d86-45ea-b2ef-6ab1eabe0af1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:19.663546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b813e27-2d86-45ea-b2ef-6ab1eabe0af1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:19.664128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b813e27-2d86-45ea-b2ef-6ab1eabe0af1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:19.756860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-46d33499-2d1a-4f53-893c-49625aa0c2e1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:19.779998 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-46d33499-2d1a-4f53-893c-49625aa0c2e1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1513 microversion: 2.1 time: 1.118437 Jul 26 19:50:19.780777 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 915/1840] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:18 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1513 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:19.791175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eac8c40b-b4f2-4fce-8e3a-d2d92586333b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756e8f040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:19.895592 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eac8c40b-b4f2-4fce-8e3a-d2d92586333b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/c1172f1c-55fc-4d0a-b406-c8109c328ed6" status: 200 len: 662 microversion: 2.1 time: 0.113651 Jul 26 19:50:19.897635 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 916/1841] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:19 2022] GET /compute/v2.1/images/c1172f1c-55fc-4d0a-b406-c8109c328ed6 => generated 662 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:19.910904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88ab0e60-6c87-416e-947e-ba0a6393a88b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:19.911543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-88ab0e60-6c87-416e-947e-ba0a6393a88b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:19.927195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88ab0e60-6c87-416e-947e-ba0a6393a88b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:19.927666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88ab0e60-6c87-416e-947e-ba0a6393a88b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:19.929607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88ab0e60-6c87-416e-947e-ba0a6393a88b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:19.932340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88ab0e60-6c87-416e-947e-ba0a6393a88b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:20.081963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b813e27-2d86-45ea-b2ef-6ab1eabe0af1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:20.102209 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0b813e27-2d86-45ea-b2ef-6ab1eabe0af1 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1500 microversion: 2.1 time: 0.466025 Jul 26 19:50:20.103101 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 926/1842] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:19 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1500 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:50:20.119235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2452a19e-e396-42d0-ba82-86d75fa01855 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e9cdee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:20.192377 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2452a19e-e396-42d0-ba82-86d75fa01855 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/c1172f1c-55fc-4d0a-b406-c8109c328ed6" status: 200 len: 662 microversion: 2.1 time: 0.086104 Jul 26 19:50:20.194134 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 927/1843] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:20 2022] GET /compute/v2.1/images/c1172f1c-55fc-4d0a-b406-c8109c328ed6 => generated 662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:20.205299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a4d568f-0808-462f-ae64-3b9e09e6656f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:20.221658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a4d568f-0808-462f-ae64-3b9e09e6656f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:20.222145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a4d568f-0808-462f-ae64-3b9e09e6656f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:20.357178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a4d568f-0808-462f-ae64-3b9e09e6656f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Going to try to stop instance {{(pid=125963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 19:50:20.451446 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a4d568f-0808-462f-ae64-3b9e09e6656f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009/action" status: 202 len: 0 microversion: 2.1 time: 0.255558 Jul 26 19:50:20.452738 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 928/1844] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:50:20 2022] POST /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:50:20.494964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f6358f1-e783-4330-8375-e6a05ac1c6e3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:20.496180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5f6358f1-e783-4330-8375-e6a05ac1c6e3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:20.506883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f6358f1-e783-4330-8375-e6a05ac1c6e3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:20.507798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f6358f1-e783-4330-8375-e6a05ac1c6e3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:20.508823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f6358f1-e783-4330-8375-e6a05ac1c6e3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:20.509429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f6358f1-e783-4330-8375-e6a05ac1c6e3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:20.796963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-88ab0e60-6c87-416e-947e-ba0a6393a88b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:20.812093 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88ab0e60-6c87-416e-947e-ba0a6393a88b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 0.911760 Jul 26 19:50:20.815805 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 917/1845] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:19 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:20.825555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-836ab9b8-629b-49f0-8361-5f92bc531d67 req-ccf6ec16-6547-48ca-9739-639774d39a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b114d6-d4fa-425a-ae17-66f167139c42", "name": "network-vif-deleted", "tag": "3c20bc75-563d-451f-8538-81fb1b7c79f5"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:20.863322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5f6358f1-e783-4330-8375-e6a05ac1c6e3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:20.870695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-836ab9b8-629b-49f0-8361-5f92bc531d67 req-ccf6ec16-6547-48ca-9739-639774d39a1d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:20.872853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-836ab9b8-629b-49f0-8361-5f92bc531d67 req-ccf6ec16-6547-48ca-9739-639774d39a1d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:20.874530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f6358f1-e783-4330-8375-e6a05ac1c6e3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 0.400066 Jul 26 19:50:20.895408 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 929/1846] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:20 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:20.901784 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-836ab9b8-629b-49f0-8361-5f92bc531d67 req-ccf6ec16-6547-48ca-9739-639774d39a1d service nova] Creating event network-vif-deleted:3c20bc75-563d-451f-8538-81fb1b7c79f5 for instance 86b114d6-d4fa-425a-ae17-66f167139c42 on n-h1-708768-8 Jul 26 19:50:20.905050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:20.905904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:20.912149 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-836ab9b8-629b-49f0-8361-5f92bc531d67 req-ccf6ec16-6547-48ca-9739-639774d39a1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094078 Jul 26 19:50:20.914863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 918/1847] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:20.923275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:20.923771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:20.926712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:20.928031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:21.024006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:21.024893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:21.025431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lazy-loading 'fault' on Instance uuid 86b114d6-d4fa-425a-ae17-66f167139c42 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:50:21.120947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:21.135700 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ff3ad826-fa74-4811-b6c8-8faf8964de2c tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 200 len: 1307 microversion: 2.1 time: 0.238821 Jul 26 19:50:21.139656 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 930/1848] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:20 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:21.838292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b35f4f1-6601-42b7-b23c-930cef2d8d97 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:21.839872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6b35f4f1-6601-42b7-b23c-930cef2d8d97 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:21.856617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b35f4f1-6601-42b7-b23c-930cef2d8d97 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:21.862573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b35f4f1-6601-42b7-b23c-930cef2d8d97 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:21.863804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b35f4f1-6601-42b7-b23c-930cef2d8d97 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:21.864477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b35f4f1-6601-42b7-b23c-930cef2d8d97 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:21.902549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e446310d-eb83-4936-b5af-7f43435c0606 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:21.903299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e446310d-eb83-4936-b5af-7f43435c0606 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:21.916156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e446310d-eb83-4936-b5af-7f43435c0606 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:21.922581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e446310d-eb83-4936-b5af-7f43435c0606 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:21.923962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e446310d-eb83-4936-b5af-7f43435c0606 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:21.924947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e446310d-eb83-4936-b5af-7f43435c0606 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:22.292771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6b35f4f1-6601-42b7-b23c-930cef2d8d97 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:22.309532 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b35f4f1-6601-42b7-b23c-930cef2d8d97 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 0.475522 Jul 26 19:50:22.324801 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 919/1849] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:21 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:22.334419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65a932a9-c5c5-48a8-b657-4cf7da9e13e8 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756decca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:22.406291 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65a932a9-c5c5-48a8-b657-4cf7da9e13e8 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/e4158bc9-0b85-40bb-8007-cb2f0e29e1a2" status: 200 len: 662 microversion: 2.1 time: 0.075991 Jul 26 19:50:22.407021 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 920/1850] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:22 2022] GET /compute/v2.1/images/e4158bc9-0b85-40bb-8007-cb2f0e29e1a2 => generated 662 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:22.414836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:22.425536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: 86b114d6-d4fa-425a-ae17-66f167139c42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:22.435298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:22.438297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:22.440160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:22.448666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:22.478825 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] HTTP exception thrown: Instance 86b114d6-d4fa-425a-ae17-66f167139c42 could not be found. Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Request method failure captured: Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 HTTP/1.1 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ETjrnzxZD45P3OK-gRIqbDaYfm7NBCqYcX0KdaW0bIhqYY3kvwFq_ue-xeEdCdh6sUAodLV_t4-H2InEltjH8_O0RtZFbRpm7P9CMAvV8Ns1ZOKxdhdInTHHaqVp_Dn-BpEfGM7kfun7phZnyOJQx-kkr_aTyvszwbxuWm0GdeKoLA Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a12a08cdecac47df83d0fe375e823172 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-VolumesAdminNegativeTest-2132611989 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a12a08cdecac47df83d0fe375e823172"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a12a08cdecac47df83d0fe375e823172"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a12a08cdecac47df83d0fe375e823172", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a12a08cdecac47df83d0fe375e823172"}]}] Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-VolumesAdminNegativeTest-2132611989 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a12a08cdecac47df83d0fe375e823172 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2132611989 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-VolumesAdminNegativeTest-2132611989-project Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 43416bcbb5a747628d0594cf62819331 Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-VolumesAdminNegativeTest-2132611989-project Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 86b114d6-d4fa-425a-ae17-66f167139c42 could not be found. Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '86b114d6-d4fa-425a-ae17-66f167139c42'} Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b114d6-d4fa-425a-ae17-66f167139c42 could not be found. Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b114d6-d4fa-425a-ae17-66f167139c42 could not be found. Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:22.480555 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:22.485864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:22.485864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:22.485864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:22.485864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:22.485864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:22.485864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b114d6-d4fa-425a-ae17-66f167139c42 could not be found. Jul 26 19:50:22.485864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:22.485864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Returning 404 to user: Instance 86b114d6-d4fa-425a-ae17-66f167139c42 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:22.488217 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1786476-cec3-40e6-99c1-d1f7266a5c3a tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42" status: 404 len: 111 microversion: 2.1 time: 0.073240 Jul 26 19:50:22.491380 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 921/1851] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:22 2022] GET /compute/v2.1/servers/86b114d6-d4fa-425a-ae17-66f167139c42 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:50:22.508587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b1ff40b6-336a-440d-9687-6ce9b8ceaa93 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756dec280>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:22.604065 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b1ff40b6-336a-440d-9687-6ce9b8ceaa93 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/e4158bc9-0b85-40bb-8007-cb2f0e29e1a2" status: 200 len: 662 microversion: 2.1 time: 0.099186 Jul 26 19:50:22.610951 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 922/1852] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:22 2022] GET /compute/v2.1/images/e4158bc9-0b85-40bb-8007-cb2f0e29e1a2 => generated 662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:22.825886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-547629027", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:22.899193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:22.951455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:23.445672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e446310d-eb83-4936-b5af-7f43435c0606 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:23.456638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e446310d-eb83-4936-b5af-7f43435c0606 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 1.558363 Jul 26 19:50:23.463801 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 931/1853] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:21 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:23.476980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c7cac3d-2575-4be0-88b3-6b87bbac3172 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:23.480386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3c7cac3d-2575-4be0-88b3-6b87bbac3172 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:23.506008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c7cac3d-2575-4be0-88b3-6b87bbac3172 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:23.506841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c7cac3d-2575-4be0-88b3-6b87bbac3172 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:23.507927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c7cac3d-2575-4be0-88b3-6b87bbac3172 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:23.508729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c7cac3d-2575-4be0-88b3-6b87bbac3172 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:23.713228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:24.233924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=20 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:24.403357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c7cac3d-2575-4be0-88b3-6b87bbac3172 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:24.420788 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c7cac3d-2575-4be0-88b3-6b87bbac3172 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 0.954998 Jul 26 19:50:24.442456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 932/1854] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:23 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:24.448790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-82b059b7-365f-4440-9deb-f626af401557 req-c4e348a4-f692-42b2-ae0a-eb3ff71bae52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13baaecc-fbee-455e-b19a-01055ffe15aa", "name": "network-vif-unplugged", "status": "completed", "tag": "29c14f48-9d91-41cf-93b8-933d95135cb9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:24.492844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-82b059b7-365f-4440-9deb-f626af401557 req-c4e348a4-f692-42b2-ae0a-eb3ff71bae52 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:24.493294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-82b059b7-365f-4440-9deb-f626af401557 req-c4e348a4-f692-42b2-ae0a-eb3ff71bae52 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:24.506802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:24.507965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:24.508717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:24.509325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:24.509954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:24.515238 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-82b059b7-365f-4440-9deb-f626af401557 req-c4e348a4-f692-42b2-ae0a-eb3ff71bae52 service nova] Creating event network-vif-unplugged:29c14f48-9d91-41cf-93b8-933d95135cb9 for instance 13baaecc-fbee-455e-b19a-01055ffe15aa on n-h2-708768-8 Jul 26 19:50:24.529400 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-82b059b7-365f-4440-9deb-f626af401557 req-c4e348a4-f692-42b2-ae0a-eb3ff71bae52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085217 Jul 26 19:50:24.530293 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 933/1855] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:24.542494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03154478-8a23-434f-beba-635351b0296e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:24.553419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03154478-8a23-434f-beba-635351b0296e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:24.555737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:24.557663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:24.559240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:24.562910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:24.571134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03154478-8a23-434f-beba-635351b0296e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:24.581038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03154478-8a23-434f-beba-635351b0296e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:24.581895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03154478-8a23-434f-beba-635351b0296e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:24.582583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03154478-8a23-434f-beba-635351b0296e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:24.626457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Getting quotas for project f793318e056d4e04be4c0424fe43ef3f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:24.654025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Getting quotas for user 908bdad3c14b4f0a9043fd8f41b4c5eb and project f793318e056d4e04be4c0424fe43ef3f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:24.694522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:24.697010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:24.934204 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d94d6b03-5c62-443e-a18a-5d34b5598608 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.112707 Jul 26 19:50:24.952683 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 923/1856] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:50:25.095376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-98633600", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:25.267103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:25.825156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03154478-8a23-434f-beba-635351b0296e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:25.847213 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03154478-8a23-434f-beba-635351b0296e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 1.313218 Jul 26 19:50:25.848337 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 934/1857] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:24 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:25.895221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e642b2f-6bff-4f82-98cf-8cb124cc9ef5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:25.900706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e642b2f-6bff-4f82-98cf-8cb124cc9ef5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:25.917456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e642b2f-6bff-4f82-98cf-8cb124cc9ef5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:25.918873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e642b2f-6bff-4f82-98cf-8cb124cc9ef5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:25.921219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e642b2f-6bff-4f82-98cf-8cb124cc9ef5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:25.921919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e642b2f-6bff-4f82-98cf-8cb124cc9ef5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:26.010992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:26.011768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:26.012507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:26.014731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:26.015462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:26.043744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:26.044736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:26.046899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:26.047653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:26.137273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Getting quotas for project f793318e056d4e04be4c0424fe43ef3f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:26.173443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Getting quotas for user 908bdad3c14b4f0a9043fd8f41b4c5eb and project f793318e056d4e04be4c0424fe43ef3f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:26.195686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:26.215789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:26.315943 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b27bdab-bca2-494a-a423-e20af8209c82 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.228435 Jul 26 19:50:26.324850 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 924/1858] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:50:26.347848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1afad6c4-f731-40d8-9520-37a7275e8b45 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:26.348750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1afad6c4-f731-40d8-9520-37a7275e8b45 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:26.795774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1afad6c4-f731-40d8-9520-37a7275e8b45 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:26.824112 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1afad6c4-f731-40d8-9520-37a7275e8b45 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1216 microversion: 2.1 time: 0.496597 Jul 26 19:50:26.851650 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 925/1859] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:26 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1216 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:26.868560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2aecf8af-9314-4ff7-aed7-b889afd2689a req-3aa9e4fc-04d6-4d53-be0d-654affe6ee7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13baaecc-fbee-455e-b19a-01055ffe15aa", "tag": "29c14f48-9d91-41cf-93b8-933d95135cb9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:26.888577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2aecf8af-9314-4ff7-aed7-b889afd2689a req-3aa9e4fc-04d6-4d53-be0d-654affe6ee7d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:26.889321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2aecf8af-9314-4ff7-aed7-b889afd2689a req-3aa9e4fc-04d6-4d53-be0d-654affe6ee7d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:26.920680 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2aecf8af-9314-4ff7-aed7-b889afd2689a req-3aa9e4fc-04d6-4d53-be0d-654affe6ee7d service nova] Creating event network-changed:29c14f48-9d91-41cf-93b8-933d95135cb9 for instance 13baaecc-fbee-455e-b19a-01055ffe15aa on n-h2-708768-8 Jul 26 19:50:26.929208 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2aecf8af-9314-4ff7-aed7-b889afd2689a req-3aa9e4fc-04d6-4d53-be0d-654affe6ee7d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075846 Jul 26 19:50:26.930257 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 926/1860] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:26.937054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d41c5286-d931-4f66-9efa-5d7147a95250 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:26.938331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d41c5286-d931-4f66-9efa-5d7147a95250 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:26.949329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d41c5286-d931-4f66-9efa-5d7147a95250 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:26.950038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d41c5286-d931-4f66-9efa-5d7147a95250 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:26.950995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d41c5286-d931-4f66-9efa-5d7147a95250 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:26.951765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d41c5286-d931-4f66-9efa-5d7147a95250 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:27.327636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e642b2f-6bff-4f82-98cf-8cb124cc9ef5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:27.341214 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e642b2f-6bff-4f82-98cf-8cb124cc9ef5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 1.488524 Jul 26 19:50:27.341806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 935/1861] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:25 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:27.671729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d41c5286-d931-4f66-9efa-5d7147a95250 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:27.697554 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d41c5286-d931-4f66-9efa-5d7147a95250 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 0.765568 Jul 26 19:50:27.698632 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 927/1862] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:26 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:27.849459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-995047f4-5181-4b96-9266-1b93f0c0a168 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:27.849652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-995047f4-5181-4b96-9266-1b93f0c0a168 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:27.871479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-995047f4-5181-4b96-9266-1b93f0c0a168 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:27.872986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-995047f4-5181-4b96-9266-1b93f0c0a168 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:27.875469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-995047f4-5181-4b96-9266-1b93f0c0a168 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:27.877082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-995047f4-5181-4b96-9266-1b93f0c0a168 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:28.212599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-995047f4-5181-4b96-9266-1b93f0c0a168 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:28.228774 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-995047f4-5181-4b96-9266-1b93f0c0a168 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1268 microversion: 2.1 time: 0.385276 Jul 26 19:50:28.241725 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 936/1863] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:27 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1268 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:28.367925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bcffee50-5034-410a-b5d9-6d9787edece9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:28.368871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bcffee50-5034-410a-b5d9-6d9787edece9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:28.385650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bcffee50-5034-410a-b5d9-6d9787edece9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:28.386106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bcffee50-5034-410a-b5d9-6d9787edece9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:28.391225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bcffee50-5034-410a-b5d9-6d9787edece9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:28.394168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bcffee50-5034-410a-b5d9-6d9787edece9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:28.718316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ec722cbf-21fc-4fe1-a2ab-238068e4e77c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:28.719681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ec722cbf-21fc-4fe1-a2ab-238068e4e77c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:28.733911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec722cbf-21fc-4fe1-a2ab-238068e4e77c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:28.734701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec722cbf-21fc-4fe1-a2ab-238068e4e77c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:28.735919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec722cbf-21fc-4fe1-a2ab-238068e4e77c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:28.738824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec722cbf-21fc-4fe1-a2ab-238068e4e77c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:28.755010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:29.224902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bcffee50-5034-410a-b5d9-6d9787edece9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:29.240013 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bcffee50-5034-410a-b5d9-6d9787edece9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 0.875074 Jul 26 19:50:29.257085 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 928/1864] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:28 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:29.274503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-346326d8-f0d7-4010-94ee-e29c56867d57 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:29.280452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-346326d8-f0d7-4010-94ee-e29c56867d57 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:29.296911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-346326d8-f0d7-4010-94ee-e29c56867d57 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:29.297632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-346326d8-f0d7-4010-94ee-e29c56867d57 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:29.299207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-346326d8-f0d7-4010-94ee-e29c56867d57 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:29.300237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-346326d8-f0d7-4010-94ee-e29c56867d57 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:29.632264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-346326d8-f0d7-4010-94ee-e29c56867d57 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:29.640427 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-346326d8-f0d7-4010-94ee-e29c56867d57 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1274 microversion: 2.1 time: 0.379120 Jul 26 19:50:29.658519 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 929/1865] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:29 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1274 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:29.929018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1854763835", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d0042dc9-bd91-4ace-b601-8dec757755a8"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:30.043927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] validate_networks() for [('d0042dc9-bd91-4ace-b601-8dec757755a8', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:30.668890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ec722cbf-21fc-4fe1-a2ab-238068e4e77c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:30.716745 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ec722cbf-21fc-4fe1-a2ab-238068e4e77c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 1.999695 Jul 26 19:50:30.739842 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 937/1866] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:28 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:50:30.755115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8039714-92f4-4828-8474-0e03c2051fff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:30.759596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8039714-92f4-4828-8474-0e03c2051fff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:30.770746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8039714-92f4-4828-8474-0e03c2051fff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:30.771508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8039714-92f4-4828-8474-0e03c2051fff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:30.773219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8039714-92f4-4828-8474-0e03c2051fff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:30.773845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8039714-92f4-4828-8474-0e03c2051fff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:31.308784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b8039714-92f4-4828-8474-0e03c2051fff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:31.319722 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8039714-92f4-4828-8474-0e03c2051fff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 0.577167 Jul 26 19:50:31.320324 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 938/1867] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:30 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:31.341960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-94e5f1d8-53b1-40de-b7a3-6ac798be527b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:31.344891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-94e5f1d8-53b1-40de-b7a3-6ac798be527b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:31.371423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94e5f1d8-53b1-40de-b7a3-6ac798be527b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:31.374844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94e5f1d8-53b1-40de-b7a3-6ac798be527b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:31.375966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94e5f1d8-53b1-40de-b7a3-6ac798be527b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:31.378416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94e5f1d8-53b1-40de-b7a3-6ac798be527b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:31.667725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-94e5f1d8-53b1-40de-b7a3-6ac798be527b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:31.686114 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-94e5f1d8-53b1-40de-b7a3-6ac798be527b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1274 microversion: 2.1 time: 0.356143 Jul 26 19:50:31.691697 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 939/1868] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:31 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1274 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:31.699583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b379c308-bf4a-46df-98b5-3e6b5c49dfa9 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:31.710722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b379c308-bf4a-46df-98b5-3e6b5c49dfa9 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:31.732428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b379c308-bf4a-46df-98b5-3e6b5c49dfa9 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:31.733206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b379c308-bf4a-46df-98b5-3e6b5c49dfa9 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:31.734230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b379c308-bf4a-46df-98b5-3e6b5c49dfa9 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:31.734837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b379c308-bf4a-46df-98b5-3e6b5c49dfa9 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:31.813342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b379c308-bf4a-46df-98b5-3e6b5c49dfa9 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:50:32.049490 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b379c308-bf4a-46df-98b5-3e6b5c49dfa9 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 204 len: 0 microversion: 2.1 time: 0.355445 Jul 26 19:50:32.054347 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 940/1869] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:50:31 2022] DELETE /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:50:32.063469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b55dbc46-4cb8-4954-8553-b710b4d7ccab req-b9c9cd6d-bb3e-47c0-bb1c-8d439703ef19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13baaecc-fbee-455e-b19a-01055ffe15aa", "name": "network-vif-unplugged", "status": "completed", "tag": "29c14f48-9d91-41cf-93b8-933d95135cb9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:32.090032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b55dbc46-4cb8-4954-8553-b710b4d7ccab req-b9c9cd6d-bb3e-47c0-bb1c-8d439703ef19 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:32.090820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b55dbc46-4cb8-4954-8553-b710b4d7ccab req-b9c9cd6d-bb3e-47c0-bb1c-8d439703ef19 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:32.128468 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b55dbc46-4cb8-4954-8553-b710b4d7ccab req-b9c9cd6d-bb3e-47c0-bb1c-8d439703ef19 service nova] Creating event network-vif-unplugged:29c14f48-9d91-41cf-93b8-933d95135cb9 for instance 13baaecc-fbee-455e-b19a-01055ffe15aa on n-h2-708768-8 Jul 26 19:50:32.143938 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b55dbc46-4cb8-4954-8553-b710b4d7ccab req-b9c9cd6d-bb3e-47c0-bb1c-8d439703ef19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087500 Jul 26 19:50:32.147377 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 941/1870] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:32.164197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0d662946-d8b0-4816-90db-c2d41339c4f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:32.165262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0d662946-d8b0-4816-90db-c2d41339c4f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:32.186644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d662946-d8b0-4816-90db-c2d41339c4f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:32.191402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d662946-d8b0-4816-90db-c2d41339c4f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:32.192721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d662946-d8b0-4816-90db-c2d41339c4f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:32.195043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d662946-d8b0-4816-90db-c2d41339c4f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:32.845731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0d662946-d8b0-4816-90db-c2d41339c4f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:32.857602 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0d662946-d8b0-4816-90db-c2d41339c4f9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 0.705660 Jul 26 19:50:32.858459 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 942/1871] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:32 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:32.896518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1c181c8-9ef1-42bf-9462-04b8f464e236 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:32.900182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1c181c8-9ef1-42bf-9462-04b8f464e236 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:32.925738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1c181c8-9ef1-42bf-9462-04b8f464e236 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:32.926378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1c181c8-9ef1-42bf-9462-04b8f464e236 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:32.927807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1c181c8-9ef1-42bf-9462-04b8f464e236 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:32.932583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1c181c8-9ef1-42bf-9462-04b8f464e236 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:33.686867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1c181c8-9ef1-42bf-9462-04b8f464e236 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:33.697629 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1c181c8-9ef1-42bf-9462-04b8f464e236 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1679 microversion: 2.1 time: 0.823815 Jul 26 19:50:33.698981 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 943/1872] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:32 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1679 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:33.706086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7ca671a0-7c22-448b-aeda-7bdd6fa9b595 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:33.721311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7ca671a0-7c22-448b-aeda-7bdd6fa9b595 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:33.746153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ca671a0-7c22-448b-aeda-7bdd6fa9b595 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:33.746600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ca671a0-7c22-448b-aeda-7bdd6fa9b595 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:33.747382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ca671a0-7c22-448b-aeda-7bdd6fa9b595 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:33.747840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ca671a0-7c22-448b-aeda-7bdd6fa9b595 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:34.414318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ca671a0-7c22-448b-aeda-7bdd6fa9b595 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:34.437459 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7ca671a0-7c22-448b-aeda-7bdd6fa9b595 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 0.735402 Jul 26 19:50:34.444866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 944/1873] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:33 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:34.452327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eecb3289-d9d9-44da-8d4f-ea33aefc5b85 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:34.461173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eecb3289-d9d9-44da-8d4f-ea33aefc5b85 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:34.476586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eecb3289-d9d9-44da-8d4f-ea33aefc5b85 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:34.477804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eecb3289-d9d9-44da-8d4f-ea33aefc5b85 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:34.479883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eecb3289-d9d9-44da-8d4f-ea33aefc5b85 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:34.481791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eecb3289-d9d9-44da-8d4f-ea33aefc5b85 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:34.553633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:34.554207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:34.554717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:34.555117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:34.555529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:34.577652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:34.579176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:34.582870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:34.586884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:34.636937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Getting quotas for project b107f91246c7434c82b02811d7b320d4. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:34.652648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Getting quotas for user 66a43ec29c9a4c2fa9be914dad198a0f and project b107f91246c7434c82b02811d7b320d4. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:34.682011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:34.685337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:34.760254 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-170deb63-d254-4081-9d9a-91cd5d204d40 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.095711 Jul 26 19:50:34.761553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 930/1874] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 5102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:50:34.769136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3f135163-1b82-485f-9e15-f5453c1ed79c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:34.770240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3f135163-1b82-485f-9e15-f5453c1ed79c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:34.778460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f135163-1b82-485f-9e15-f5453c1ed79c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:34.779204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f135163-1b82-485f-9e15-f5453c1ed79c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:34.780503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f135163-1b82-485f-9e15-f5453c1ed79c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:34.782814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f135163-1b82-485f-9e15-f5453c1ed79c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:35.533599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eecb3289-d9d9-44da-8d4f-ea33aefc5b85 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:35.542592 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eecb3289-d9d9-44da-8d4f-ea33aefc5b85 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1316 microversion: 2.1 time: 1.093989 Jul 26 19:50:35.549265 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 945/1875] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:34 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1316 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:35.557427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a995464e-4f77-49b9-ac13-7fc36e883ae5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:35.559375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a995464e-4f77-49b9-ac13-7fc36e883ae5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:35.575915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a995464e-4f77-49b9-ac13-7fc36e883ae5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:35.579684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a995464e-4f77-49b9-ac13-7fc36e883ae5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:35.580859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a995464e-4f77-49b9-ac13-7fc36e883ae5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:35.583027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a995464e-4f77-49b9-ac13-7fc36e883ae5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:35.711323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f135163-1b82-485f-9e15-f5453c1ed79c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:35.721644 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3f135163-1b82-485f-9e15-f5453c1ed79c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 0.958671 Jul 26 19:50:35.724642 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 931/1876] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:34 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:35.735179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e428a631-a820-4030-a611-61d8ce2542c0 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:35.744587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e428a631-a820-4030-a611-61d8ce2542c0 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:35.751275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e428a631-a820-4030-a611-61d8ce2542c0 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:35.752552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e428a631-a820-4030-a611-61d8ce2542c0 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:35.760825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e428a631-a820-4030-a611-61d8ce2542c0 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:35.764224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e428a631-a820-4030-a611-61d8ce2542c0 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:35.951540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e428a631-a820-4030-a611-61d8ce2542c0 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:35.958858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:35.967592 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e428a631-a820-4030-a611-61d8ce2542c0 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1212 microversion: 2.1 time: 0.235327 Jul 26 19:50:35.969100 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 932/1877] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:35 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1212 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:35.979310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-114584519", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "ca7f5c97-fec0-4b42-bad4-1e41226d1325"}], "block_device_mapping_v2": [{"uuid": "0e84f69f-6416-4c2b-9fe6-6335d025bd28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:36.097871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a995464e-4f77-49b9-ac13-7fc36e883ae5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43416bcbb5a747628d0594cf62819331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12a08cdecac47df83d0fe375e823172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:36.113730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a995464e-4f77-49b9-ac13-7fc36e883ae5 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 200 len: 1679 microversion: 2.1 time: 0.562958 Jul 26 19:50:36.114881 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 946/1878] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:35 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 1679 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:36.126474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-56e7dec7-a279-41bf-b01b-e890b99cdf63 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:36.134894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-56e7dec7-a279-41bf-b01b-e890b99cdf63 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:36.136273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] validate_networks() for [('ca7f5c97-fec0-4b42-bad4-1e41226d1325', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:36.149702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56e7dec7-a279-41bf-b01b-e890b99cdf63 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:36.150875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56e7dec7-a279-41bf-b01b-e890b99cdf63 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:36.152389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56e7dec7-a279-41bf-b01b-e890b99cdf63 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:36.153130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56e7dec7-a279-41bf-b01b-e890b99cdf63 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:37.281441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-56e7dec7-a279-41bf-b01b-e890b99cdf63 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:37.296622 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-56e7dec7-a279-41bf-b01b-e890b99cdf63 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1503 microversion: 2.1 time: 1.174584 Jul 26 19:50:37.301223 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 947/1879] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:36 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1503 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:37.310308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d0b82ced-2a4d-409a-8d93-c926b5521237 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:37.311454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d0b82ced-2a4d-409a-8d93-c926b5521237 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:37.327985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0b82ced-2a4d-409a-8d93-c926b5521237 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:37.329045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0b82ced-2a4d-409a-8d93-c926b5521237 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:37.330315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0b82ced-2a4d-409a-8d93-c926b5521237 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:37.330987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0b82ced-2a4d-409a-8d93-c926b5521237 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:37.945002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:37.946106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:37.953358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:37.954184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:37.955374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:38.010403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:38.012676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:38.021958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:38.022708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:38.061164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for project 3d10540a08974fd0854fea20ae5c216b. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:38.082482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:38.086198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Getting quotas for user ccd551ea4e0641a0bf17d669481136fa and project 3d10540a08974fd0854fea20ae5c216b. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:38.246783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:38.249186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e84f69f-6416-4c2b-9fe6-6335d025bd28',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:38.307863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d0b82ced-2a4d-409a-8d93-c926b5521237 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:38.321312 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d0b82ced-2a4d-409a-8d93-c926b5521237 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1316 microversion: 2.1 time: 1.013611 Jul 26 19:50:38.321987 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 948/1880] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:37 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1316 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:38.367818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb7bc8e8-6e1e-4d56-9db0-c786201d4f8c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:38.369718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb7bc8e8-6e1e-4d56-9db0-c786201d4f8c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:38.395729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb7bc8e8-6e1e-4d56-9db0-c786201d4f8c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:38.398277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb7bc8e8-6e1e-4d56-9db0-c786201d4f8c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:38.402693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb7bc8e8-6e1e-4d56-9db0-c786201d4f8c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:38.404060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb7bc8e8-6e1e-4d56-9db0-c786201d4f8c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:38.557365 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06ad0c31-f8b9-4eef-94f2-7e164252c088 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.586776 Jul 26 19:50:38.576050 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 933/1881] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 19:50:38.589947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-210b14dd-fe1b-4d33-913c-e50ebe4f05eb tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:38.593024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-210b14dd-fe1b-4d33-913c-e50ebe4f05eb tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:38.615320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-210b14dd-fe1b-4d33-913c-e50ebe4f05eb tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:38.616200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-210b14dd-fe1b-4d33-913c-e50ebe4f05eb tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:38.617216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-210b14dd-fe1b-4d33-913c-e50ebe4f05eb tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:38.617892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-210b14dd-fe1b-4d33-913c-e50ebe4f05eb tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:38.864219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-210b14dd-fe1b-4d33-913c-e50ebe4f05eb tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:38.880713 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-210b14dd-fe1b-4d33-913c-e50ebe4f05eb tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1274 microversion: 2.1 time: 0.301286 Jul 26 19:50:38.901024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 934/1882] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:38 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1274 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:38.916179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:38.917299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] [instance: a882035e-ffcb-4327-8443-26bc7f4d9bca] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:38.931551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:38.933861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:38.937078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:38.945052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:38.984848 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] HTTP exception thrown: Instance a882035e-ffcb-4327-8443-26bc7f4d9bca could not be found. Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Request method failure captured: Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca HTTP/1.1 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ETjrnzxZD45P3OK-gRIqbDaYfm7NBCqYcX0KdaW0bIhqYY3kvwFq_ue-xeEdCdh6sUAodLV_t4-H2InEltjH8_O0RtZFbRpm7P9CMAvV8Ns1ZOKxdhdInTHHaqVp_Dn-BpEfGM7kfun7phZnyOJQx-kkr_aTyvszwbxuWm0GdeKoLA Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a12a08cdecac47df83d0fe375e823172 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-VolumesAdminNegativeTest-2132611989 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a12a08cdecac47df83d0fe375e823172"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a12a08cdecac47df83d0fe375e823172"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a12a08cdecac47df83d0fe375e823172", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a12a08cdecac47df83d0fe375e823172"}]}] Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-VolumesAdminNegativeTest-2132611989 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a12a08cdecac47df83d0fe375e823172 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2132611989 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-VolumesAdminNegativeTest-2132611989-project Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 43416bcbb5a747628d0594cf62819331 Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-VolumesAdminNegativeTest-2132611989-project Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance a882035e-ffcb-4327-8443-26bc7f4d9bca could not be found. Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a882035e-ffcb-4327-8443-26bc7f4d9bca'} Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a882035e-ffcb-4327-8443-26bc7f4d9bca could not be found. Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a882035e-ffcb-4327-8443-26bc7f4d9bca could not be found. Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:38.988963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:38.995014 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:38.995014 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:38.995014 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:38.995014 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:38.995014 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:38.995014 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a882035e-ffcb-4327-8443-26bc7f4d9bca could not be found. Jul 26 19:50:38.995014 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:50:39.005790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Returning 404 to user: Instance a882035e-ffcb-4327-8443-26bc7f4d9bca could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:39.006766 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eabccca0-9df4-4118-b806-9744b77ce3f1 tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca" status: 404 len: 111 microversion: 2.1 time: 0.104770 Jul 26 19:50:39.007745 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 935/1883] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:38 2022] GET /compute/v2.1/servers/a882035e-ffcb-4327-8443-26bc7f4d9bca => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:50:39.016389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-63802ebd-f58c-47f0-a3c5-94b786ef51a4 req-edd3d190-304c-4540-85e2-26b58903b0eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78f8c415-4c1d-4e8c-b3a6-2b1f20db3207", "tag": "6a23c3cf-1752-438a-abe4-d9745485a1b1"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:39.042694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-63802ebd-f58c-47f0-a3c5-94b786ef51a4 req-edd3d190-304c-4540-85e2-26b58903b0eb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:39.043143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-63802ebd-f58c-47f0-a3c5-94b786ef51a4 req-edd3d190-304c-4540-85e2-26b58903b0eb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:39.060733 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-63802ebd-f58c-47f0-a3c5-94b786ef51a4 req-edd3d190-304c-4540-85e2-26b58903b0eb service nova] Creating event network-changed:6a23c3cf-1752-438a-abe4-d9745485a1b1 for instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 on n-h1-708768-8 Jul 26 19:50:39.068887 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-63802ebd-f58c-47f0-a3c5-94b786ef51a4 req-edd3d190-304c-4540-85e2-26b58903b0eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059647 Jul 26 19:50:39.073349 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 936/1884] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:39.082008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-84858602-9ece-4bfc-9757-d9bc026d6901 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:39.084451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-84858602-9ece-4bfc-9757-d9bc026d6901 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:39.094332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84858602-9ece-4bfc-9757-d9bc026d6901 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:39.095455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84858602-9ece-4bfc-9757-d9bc026d6901 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:39.096698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84858602-9ece-4bfc-9757-d9bc026d6901 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:39.097829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84858602-9ece-4bfc-9757-d9bc026d6901 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:39.352885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-84858602-9ece-4bfc-9757-d9bc026d6901 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:39.364290 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-84858602-9ece-4bfc-9757-d9bc026d6901 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1478 microversion: 2.1 time: 0.287377 Jul 26 19:50:39.365340 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 937/1885] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:39 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1478 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:39.372891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bad0c6f-2b03-4a4a-a056-1e69a5503620 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:39.373421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5bad0c6f-2b03-4a4a-a056-1e69a5503620 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:39.445993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5bad0c6f-2b03-4a4a-a056-1e69a5503620 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:39.457251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5bad0c6f-2b03-4a4a-a056-1e69a5503620 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:39.462685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5bad0c6f-2b03-4a4a-a056-1e69a5503620 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:39.464314 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5bad0c6f-2b03-4a4a-a056-1e69a5503620 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1103 microversion: 2.25 time: 0.097779 Jul 26 19:50:39.465425 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 938/1886] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:39 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1103 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:39.476857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5339e83f-6de5-4fe2-aecb-76e5d46c498d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] Calling method '.version_select at 0x7f87570e5dc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:39.524039 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5339e83f-6de5-4fe2-aecb-76e5d46c498d tempest-VolumesAdminNegativeTest-2132611989 tempest-VolumesAdminNegativeTest-2132611989-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-311569242" status: 202 len: 0 microversion: 2.1 time: 0.057180 Jul 26 19:50:39.526497 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 939/1887] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:50:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-311569242 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:50:39.639045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-752582782", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "8224157b-530a-462f-857d-03d7dabe6d77"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:39.732550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] validate_networks() for [('8224157b-530a-462f-857d-03d7dabe6d77', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:39.865383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb7bc8e8-6e1e-4d56-9db0-c786201d4f8c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:39.882493 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb7bc8e8-6e1e-4d56-9db0-c786201d4f8c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 1.541746 Jul 26 19:50:39.883444 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 949/1888] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:38 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:39.889872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb8b60d3-c5f0-427f-8658-a6c70e849155 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:39.890490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fb8b60d3-c5f0-427f-8658-a6c70e849155 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:39.909476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb8b60d3-c5f0-427f-8658-a6c70e849155 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:39.910393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb8b60d3-c5f0-427f-8658-a6c70e849155 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:39.912030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb8b60d3-c5f0-427f-8658-a6c70e849155 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:39.912584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb8b60d3-c5f0-427f-8658-a6c70e849155 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:40.885347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:40.886520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:40.887211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:40.887899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:40.888572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:40.909646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:40.910824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:40.913120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:40.920400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:40.968002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Getting quotas for project 3217b1b41e1e4274bc4442e54926f418. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:40.975486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fb8b60d3-c5f0-427f-8658-a6c70e849155 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:40.986571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Getting quotas for user c5abd3e457e042c3ba27040272c69ce4 and project 3217b1b41e1e4274bc4442e54926f418. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:40.989043 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fb8b60d3-c5f0-427f-8658-a6c70e849155 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1316 microversion: 2.1 time: 1.100698 Jul 26 19:50:41.005949 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 950/1889] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:39 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1316 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:41.016182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:41.019188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28b97b7b-71c4-44c6-8325-47da1e62c3e1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '.version_select at 0x7f875e9e60d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:41.031435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:41.052353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28b97b7b-71c4-44c6-8325-47da1e62c3e1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:41.053515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28b97b7b-71c4-44c6-8325-47da1e62c3e1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:41.086627 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-28b97b7b-71c4-44c6-8325-47da1e62c3e1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1936 microversion: 2.1 time: 0.076972 Jul 26 19:50:41.099756 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 951/1890] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:50:41 2022] GET /compute/v2.1/os-migrations => generated 1936 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:41.104257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-838b79e1-e14a-4aa6-9c30-3992f51fa76b tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:41.105298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-838b79e1-e14a-4aa6-9c30-3992f51fa76b tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:41.121549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-838b79e1-e14a-4aa6-9c30-3992f51fa76b tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:41.122278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-838b79e1-e14a-4aa6-9c30-3992f51fa76b tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:41.123170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-838b79e1-e14a-4aa6-9c30-3992f51fa76b tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:41.123763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-838b79e1-e14a-4aa6-9c30-3992f51fa76b tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:41.177308 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-042a04df-e19f-4568-a9bb-9ca561a4c0b0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.649193 Jul 26 19:50:41.177983 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 940/1891] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:50:41.194641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:41.195245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:41.218316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:41.218702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:41.232071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:41.232275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:41.494630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:41.521622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:41.530598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:41.533105 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f7b1254d-ec97-4662-a1a1-cd0b45383133 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1250 microversion: 2.25 time: 0.353364 Jul 26 19:50:41.538457 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 941/1892] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:41 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1250 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:41.543458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e137595c-fe16-472b-97b4-139a467c3f3f req-ef16cb60-f4c8-4c02-8695-d36e5445799b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc24d0ee-65ce-4620-a3b2-263af9715a2e", "tag": "86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:41.573513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e137595c-fe16-472b-97b4-139a467c3f3f req-ef16cb60-f4c8-4c02-8695-d36e5445799b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:41.574483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e137595c-fe16-472b-97b4-139a467c3f3f req-ef16cb60-f4c8-4c02-8695-d36e5445799b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:41.611870 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e137595c-fe16-472b-97b4-139a467c3f3f req-ef16cb60-f4c8-4c02-8695-d36e5445799b service nova] Creating event network-changed:86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8 for instance cc24d0ee-65ce-4620-a3b2-263af9715a2e on n-h2-708768-8 Jul 26 19:50:41.624560 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e137595c-fe16-472b-97b4-139a467c3f3f req-ef16cb60-f4c8-4c02-8695-d36e5445799b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084430 Jul 26 19:50:41.627582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 942/1893] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:41.767687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e7059a44-2ed8-40cf-ae84-d5a34e6588a1 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Action: 'create', calling method: .version_select at 0x7f8756ddc310>, body: {"keypair": {"name": "tempest-keypair-419891600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiQqiQHekpJo5/M25wunUT9HNXQDG+hx9t8WGrCFWqvNAWHeVI7a3+GGBUlp5s+4JVSjn1fxaL7y3vtmyexbil+C/FpoSzL+BREWHgpKCY97GaDsy5hdH3duCV5ddXGvg=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:41.822452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-e7059a44-2ed8-40cf-ae84-d5a34e6588a1 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Getting quotas for project db03cc70ec3449dba93baafb7a0762f4. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:41.835548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-e7059a44-2ed8-40cf-ae84-d5a34e6588a1 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Getting quotas for user 270af76b143f4e329b2e941d257b042f and project db03cc70ec3449dba93baafb7a0762f4. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:41.895295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e7059a44-2ed8-40cf-ae84-d5a34e6588a1 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.266140 Jul 26 19:50:41.902325 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 943/1894] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:50:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:41.924276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77e98b6b-67d3-4f84-83fb-a90446698f39 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:41.925412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77e98b6b-67d3-4f84-83fb-a90446698f39 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:41.942210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77e98b6b-67d3-4f84-83fb-a90446698f39 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:41.943915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77e98b6b-67d3-4f84-83fb-a90446698f39 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:41.945865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77e98b6b-67d3-4f84-83fb-a90446698f39 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:41.948183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77e98b6b-67d3-4f84-83fb-a90446698f39 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:42.394802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-838b79e1-e14a-4aa6-9c30-3992f51fa76b tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:42.411090 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-838b79e1-e14a-4aa6-9c30-3992f51fa76b tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1274 microversion: 2.1 time: 1.317126 Jul 26 19:50:42.411743 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 952/1895] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:41 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1274 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:42.432910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ed33eb6b-badb-4a0d-b34a-effb5d6b676b tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:42.436430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ed33eb6b-badb-4a0d-b34a-effb5d6b676b tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:42.470339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed33eb6b-badb-4a0d-b34a-effb5d6b676b tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:42.471425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed33eb6b-badb-4a0d-b34a-effb5d6b676b tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:42.472450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed33eb6b-badb-4a0d-b34a-effb5d6b676b tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:42.475475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed33eb6b-badb-4a0d-b34a-effb5d6b676b tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:42.562705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:42.818650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77e98b6b-67d3-4f84-83fb-a90446698f39 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:42.850929 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77e98b6b-67d3-4f84-83fb-a90446698f39 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 0.943063 Jul 26 19:50:42.868047 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 944/1896] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:41 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:42.873846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-de902e13-99fe-4a41-9e56-db7f2c3764ab req-49fc3247-8b54-4242-9fb3-da020cb9a5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a882035e-ffcb-4327-8443-26bc7f4d9bca", "name": "network-vif-deleted", "tag": "9ef206a7-38f6-4551-896a-8ab1a4ef7370"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:42.886953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-de902e13-99fe-4a41-9e56-db7f2c3764ab req-49fc3247-8b54-4242-9fb3-da020cb9a5b4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:42.890202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-de902e13-99fe-4a41-9e56-db7f2c3764ab req-49fc3247-8b54-4242-9fb3-da020cb9a5b4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:42.912745 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-de902e13-99fe-4a41-9e56-db7f2c3764ab req-49fc3247-8b54-4242-9fb3-da020cb9a5b4 service nova] Creating event network-vif-deleted:9ef206a7-38f6-4551-896a-8ab1a4ef7370 for instance a882035e-ffcb-4327-8443-26bc7f4d9bca on n-h1-708768-8 Jul 26 19:50:42.933777 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-de902e13-99fe-4a41-9e56-db7f2c3764ab req-49fc3247-8b54-4242-9fb3-da020cb9a5b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064019 Jul 26 19:50:42.935973 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 945/1897] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:42.958057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a6e6c3e4-8002-46ec-b6e8-f0e30a5f8d37 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:42.959089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a6e6c3e4-8002-46ec-b6e8-f0e30a5f8d37 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:42.969231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6e6c3e4-8002-46ec-b6e8-f0e30a5f8d37 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:42.977654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6e6c3e4-8002-46ec-b6e8-f0e30a5f8d37 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:42.978858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6e6c3e4-8002-46ec-b6e8-f0e30a5f8d37 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:42.979482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6e6c3e4-8002-46ec-b6e8-f0e30a5f8d37 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:43.389619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6e6c3e4-8002-46ec-b6e8-f0e30a5f8d37 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:43.406751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a6e6c3e4-8002-46ec-b6e8-f0e30a5f8d37 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1284 microversion: 2.1 time: 0.469180 Jul 26 19:50:43.408166 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 946/1898] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:42 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1284 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:43.421200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd11adeb-1aef-4b42-834c-6c0a29718b75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:43.421200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd11adeb-1aef-4b42-834c-6c0a29718b75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:43.437673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd11adeb-1aef-4b42-834c-6c0a29718b75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:43.438893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd11adeb-1aef-4b42-834c-6c0a29718b75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:43.440057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd11adeb-1aef-4b42-834c-6c0a29718b75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:43.440556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd11adeb-1aef-4b42-834c-6c0a29718b75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:43.827985 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ed33eb6b-badb-4a0d-b34a-effb5d6b676b tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1629 microversion: 2.1 time: 1.412482 Jul 26 19:50:43.829173 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 953/1899] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:42 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1629 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:43.839854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:43.846559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:43.856335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:43.868158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:43.869209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:43.870300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:43.870979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:44.064557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd11adeb-1aef-4b42-834c-6c0a29718b75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:44.073722 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd11adeb-1aef-4b42-834c-6c0a29718b75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1316 microversion: 2.1 time: 0.664455 Jul 26 19:50:44.083902 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 947/1900] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:43 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:44.089109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-daf9af58-33d7-43e4-a456-8d24e0135441 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:44.089944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-daf9af58-33d7-43e4-a456-8d24e0135441 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:44.108028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daf9af58-33d7-43e4-a456-8d24e0135441 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:44.108194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daf9af58-33d7-43e4-a456-8d24e0135441 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:44.109178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daf9af58-33d7-43e4-a456-8d24e0135441 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:44.109684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daf9af58-33d7-43e4-a456-8d24e0135441 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:44.128965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:44.150615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:44.152422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:44.154790 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4cd9a3a1-9052-4186-9373-68a1379da407 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1250 microversion: 2.25 time: 0.324315 Jul 26 19:50:44.156461 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 954/1901] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:43 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1250 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:44.163127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ea93feb-21aa-4764-96c2-6089b03234b3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Action: 'create', calling method: .version_select at 0x7f875e96f3a0>, body: {"keypair": {"name": "tempest-keypair-29173777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl3y9NvmmJQm6EZOY7QzEIiBak0OeBJoWJeu8vvRAVz4I5rM6cOx0u3Y0wFuK0XmddlXrIDciKsCnLhPIAv4QeboMEAL+Yhd6XNhfj4oeDXa5njMeryvaTaFO64iJfx/Q=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:44.185047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-3ea93feb-21aa-4764-96c2-6089b03234b3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:44.193252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-3ea93feb-21aa-4764-96c2-6089b03234b3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for user 678a9d8bb54a4fdb8997fcf480a3a355 and project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:44.238351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ea93feb-21aa-4764-96c2-6089b03234b3 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.078830 Jul 26 19:50:44.239831 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 955/1902] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:50:44 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:44.245905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-05f55c92-6c6c-4648-87bc-42b2f911229b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:44.246921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-05f55c92-6c6c-4648-87bc-42b2f911229b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:44.260526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05f55c92-6c6c-4648-87bc-42b2f911229b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:44.261007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05f55c92-6c6c-4648-87bc-42b2f911229b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:44.262509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05f55c92-6c6c-4648-87bc-42b2f911229b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:44.262955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05f55c92-6c6c-4648-87bc-42b2f911229b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:44.998218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-daf9af58-33d7-43e4-a456-8d24e0135441 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:45.012046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-05f55c92-6c6c-4648-87bc-42b2f911229b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:45.014306 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-daf9af58-33d7-43e4-a456-8d24e0135441 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 0.928921 Jul 26 19:50:45.017370 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 948/1903] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:44 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:45.021631 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-05f55c92-6c6c-4648-87bc-42b2f911229b tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1510 microversion: 2.1 time: 0.780462 Jul 26 19:50:45.039204 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 956/1904] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:44 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1510 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:45.081501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ae6f8dd-8443-4b00-9dd6-c799d372e898 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:45.084340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ae6f8dd-8443-4b00-9dd6-c799d372e898 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:45.108909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f592ffca-8be9-4837-8edd-9cf3439cea51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:45.109916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f592ffca-8be9-4837-8edd-9cf3439cea51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:45.121777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f592ffca-8be9-4837-8edd-9cf3439cea51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:45.126012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f592ffca-8be9-4837-8edd-9cf3439cea51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:45.127262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f592ffca-8be9-4837-8edd-9cf3439cea51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:45.127652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ae6f8dd-8443-4b00-9dd6-c799d372e898 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:45.129360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f592ffca-8be9-4837-8edd-9cf3439cea51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:45.155500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ae6f8dd-8443-4b00-9dd6-c799d372e898 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:45.156603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ae6f8dd-8443-4b00-9dd6-c799d372e898 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:45.166846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ae6f8dd-8443-4b00-9dd6-c799d372e898 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:45.478029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ae6f8dd-8443-4b00-9dd6-c799d372e898 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:45.494309 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ae6f8dd-8443-4b00-9dd6-c799d372e898 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1282 microversion: 2.1 time: 0.475592 Jul 26 19:50:45.496259 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 949/1905] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:45 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1282 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:45.517109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:45.518221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:45.544719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:45.545239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:45.548148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:45.549340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:46.162568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:46.173697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:46.175404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:46.188553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e7ddfac2-2030-48d8-9ed4-ff14940554ae tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1292 microversion: 2.25 time: 0.690259 Jul 26 19:50:46.191768 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 950/1906] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:45 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1292 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:46.203254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-740bb0ed-27b3-4669-b4fd-db95d92b3854 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:46.206113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-740bb0ed-27b3-4669-b4fd-db95d92b3854 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:46.234432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-740bb0ed-27b3-4669-b4fd-db95d92b3854 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:46.235441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-740bb0ed-27b3-4669-b4fd-db95d92b3854 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:46.236255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-740bb0ed-27b3-4669-b4fd-db95d92b3854 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:46.236693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-740bb0ed-27b3-4669-b4fd-db95d92b3854 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:46.908401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-740bb0ed-27b3-4669-b4fd-db95d92b3854 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:46.934725 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-740bb0ed-27b3-4669-b4fd-db95d92b3854 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 0.740566 Jul 26 19:50:46.936208 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 951/1907] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:46 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:46.958035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-963df81e-f2eb-47c6-a13b-10fbaaf7acae tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:46.960421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-963df81e-f2eb-47c6-a13b-10fbaaf7acae tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:46.986112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-963df81e-f2eb-47c6-a13b-10fbaaf7acae tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:46.986781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-963df81e-f2eb-47c6-a13b-10fbaaf7acae tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:46.987727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-963df81e-f2eb-47c6-a13b-10fbaaf7acae tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:46.994449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-963df81e-f2eb-47c6-a13b-10fbaaf7acae tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:47.321766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f592ffca-8be9-4837-8edd-9cf3439cea51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:47.331717 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f592ffca-8be9-4837-8edd-9cf3439cea51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1316 microversion: 2.1 time: 2.225639 Jul 26 19:50:47.334059 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 957/1908] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:45 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1316 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:47.345418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f2709f1b-3372-47c5-a7ed-0cd6383061a2 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:47.346169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f2709f1b-3372-47c5-a7ed-0cd6383061a2 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:47.361798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2709f1b-3372-47c5-a7ed-0cd6383061a2 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:47.362323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2709f1b-3372-47c5-a7ed-0cd6383061a2 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:47.363350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2709f1b-3372-47c5-a7ed-0cd6383061a2 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:47.364463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2709f1b-3372-47c5-a7ed-0cd6383061a2 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:47.491547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-963df81e-f2eb-47c6-a13b-10fbaaf7acae tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:47.501898 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-963df81e-f2eb-47c6-a13b-10fbaaf7acae tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1487 microversion: 2.1 time: 0.561454 Jul 26 19:50:47.503661 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 952/1909] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:46 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1487 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:47.518570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:47.521570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:47.549862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:47.550535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:47.551497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:47.552133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.217761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:48.227048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:48.233768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:48.235311 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d28cbf47-6fde-4578-89d7-256f649bffce tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1292 microversion: 2.25 time: 0.729292 Jul 26 19:50:48.254481 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 953/1910] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:47 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1292 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:48.260440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-904935fd-5e6d-4343-8f27-1d894b53d511 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:48.267519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-904935fd-5e6d-4343-8f27-1d894b53d511 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:48.280783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-904935fd-5e6d-4343-8f27-1d894b53d511 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.288451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-904935fd-5e6d-4343-8f27-1d894b53d511 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.289620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-904935fd-5e6d-4343-8f27-1d894b53d511 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.290239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-904935fd-5e6d-4343-8f27-1d894b53d511 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.341569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-904935fd-5e6d-4343-8f27-1d894b53d511 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:50:48.452980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:48.497191 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-904935fd-5e6d-4343-8f27-1d894b53d511 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 204 len: 0 microversion: 2.1 time: 0.240904 Jul 26 19:50:48.498134 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 954/1911] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:50:48 2022] DELETE /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:50:48.508249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-61c9fef4-bfdb-4957-b656-b408ddd8f38a req-913145cf-e28a-44c1-abc6-0cb148950783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f8c415-4c1d-4e8c-b3a6-2b1f20db3207", "name": "network-vif-plugged", "status": "completed", "tag": "6a23c3cf-1752-438a-abe4-d9745485a1b1"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:48.527981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-61c9fef4-bfdb-4957-b656-b408ddd8f38a req-913145cf-e28a-44c1-abc6-0cb148950783 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.528443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-61c9fef4-bfdb-4957-b656-b408ddd8f38a req-913145cf-e28a-44c1-abc6-0cb148950783 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.551053 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-61c9fef4-bfdb-4957-b656-b408ddd8f38a req-913145cf-e28a-44c1-abc6-0cb148950783 service nova] Creating event network-vif-plugged:6a23c3cf-1752-438a-abe4-d9745485a1b1 for instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 on n-h1-708768-8 Jul 26 19:50:48.560402 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-61c9fef4-bfdb-4957-b656-b408ddd8f38a req-913145cf-e28a-44c1-abc6-0cb148950783 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059969 Jul 26 19:50:48.561789 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 955/1912] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:48.569356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-81879e6e-1b79-4a2a-bafe-b0785217564e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:48.570643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-81879e6e-1b79-4a2a-bafe-b0785217564e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:48.580259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81879e6e-1b79-4a2a-bafe-b0785217564e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.580727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81879e6e-1b79-4a2a-bafe-b0785217564e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.581953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81879e6e-1b79-4a2a-bafe-b0785217564e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.581953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81879e6e-1b79-4a2a-bafe-b0785217564e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.689430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f2709f1b-3372-47c5-a7ed-0cd6383061a2 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:48.698052 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f2709f1b-3372-47c5-a7ed-0cd6383061a2 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1324 microversion: 2.1 time: 1.363002 Jul 26 19:50:48.712492 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 958/1913] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:47 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1324 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:48.718214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7e0d6a82-2894-4907-90de-7c4dc070ce62 req-9786e418-e49e-4183-a088-27b39229b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e730bb-a29a-4608-8c7a-37f0a157059a", "tag": "0eddb3a8-12a7-4dd0-a852-aa571ba0e978"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:48.728475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7e0d6a82-2894-4907-90de-7c4dc070ce62 req-9786e418-e49e-4183-a088-27b39229b0d8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.729314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7e0d6a82-2894-4907-90de-7c4dc070ce62 req-9786e418-e49e-4183-a088-27b39229b0d8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.744626 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7e0d6a82-2894-4907-90de-7c4dc070ce62 req-9786e418-e49e-4183-a088-27b39229b0d8 service nova] Creating event network-changed:0eddb3a8-12a7-4dd0-a852-aa571ba0e978 for instance 47e730bb-a29a-4608-8c7a-37f0a157059a on n-h2-708768-8 Jul 26 19:50:48.751790 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7e0d6a82-2894-4907-90de-7c4dc070ce62 req-9786e418-e49e-4183-a088-27b39229b0d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036218 Jul 26 19:50:48.752991 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 959/1914] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:48.758496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c58f4efc-a737-4863-b11f-a98f51d0f42f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:48.759519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c58f4efc-a737-4863-b11f-a98f51d0f42f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:48.767403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c58f4efc-a737-4863-b11f-a98f51d0f42f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.768127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c58f4efc-a737-4863-b11f-a98f51d0f42f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.769156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c58f4efc-a737-4863-b11f-a98f51d0f42f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.769826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c58f4efc-a737-4863-b11f-a98f51d0f42f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.929275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-81879e6e-1b79-4a2a-bafe-b0785217564e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:48.939401 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-81879e6e-1b79-4a2a-bafe-b0785217564e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 0.376280 Jul 26 19:50:48.940229 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 956/1915] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:48 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:48.967779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-015b4fdc-035c-4904-a974-b01c2e585348 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:48.969552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-015b4fdc-035c-4904-a974-b01c2e585348 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:48.976023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-015b4fdc-035c-4904-a974-b01c2e585348 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.976545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-015b4fdc-035c-4904-a974-b01c2e585348 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:48.977325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-015b4fdc-035c-4904-a974-b01c2e585348 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:48.977761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-015b4fdc-035c-4904-a974-b01c2e585348 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:49.379400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-015b4fdc-035c-4904-a974-b01c2e585348 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:49.425805 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-015b4fdc-035c-4904-a974-b01c2e585348 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1493 microversion: 2.1 time: 0.472171 Jul 26 19:50:49.430746 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 957/1916] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:48 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1493 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:49.466982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-22d3bea5-f85a-4c68-9d0f-0a3d282d4535 req-405837d2-db69-4e2c-a1ce-6cc9f86e976a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400c42ab-aa78-434d-929d-9ee94f47440e", "tag": "72281411-bd74-4ea2-be77-739ac2da2d6c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:49.485502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-22d3bea5-f85a-4c68-9d0f-0a3d282d4535 req-405837d2-db69-4e2c-a1ce-6cc9f86e976a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:49.486833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-22d3bea5-f85a-4c68-9d0f-0a3d282d4535 req-405837d2-db69-4e2c-a1ce-6cc9f86e976a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:49.505602 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-22d3bea5-f85a-4c68-9d0f-0a3d282d4535 req-405837d2-db69-4e2c-a1ce-6cc9f86e976a service nova] Creating event network-changed:72281411-bd74-4ea2-be77-739ac2da2d6c for instance 400c42ab-aa78-434d-929d-9ee94f47440e on n-h1-708768-8 Jul 26 19:50:49.512871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-22d3bea5-f85a-4c68-9d0f-0a3d282d4535 req-405837d2-db69-4e2c-a1ce-6cc9f86e976a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064115 Jul 26 19:50:49.514525 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 958/1917] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:49.536591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:49.537983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:49.548946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:49.549779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:49.550976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:49.551571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:49.800170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c58f4efc-a737-4863-b11f-a98f51d0f42f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:49.808537 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c58f4efc-a737-4863-b11f-a98f51d0f42f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1316 microversion: 2.1 time: 1.054071 Jul 26 19:50:49.810975 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 960/1918] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:48 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1316 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:49.819185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-555855ac-b269-4074-a43a-165c80002614 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:49.824416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-555855ac-b269-4074-a43a-165c80002614 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:49.842444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-555855ac-b269-4074-a43a-165c80002614 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:49.843272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-555855ac-b269-4074-a43a-165c80002614 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:49.844511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-555855ac-b269-4074-a43a-165c80002614 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:49.845218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-555855ac-b269-4074-a43a-165c80002614 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:50.351660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:50.361938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:50.363873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:50.366320 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9abb7b95-923f-4197-84ad-4981ec03e9d9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1292 microversion: 2.25 time: 0.850538 Jul 26 19:50:50.371114 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 959/1919] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:49 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1292 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:50.382585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-022c408d-6414-4175-8223-2099eaf1001d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:50.385441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-022c408d-6414-4175-8223-2099eaf1001d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:50.421351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-022c408d-6414-4175-8223-2099eaf1001d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:50.423681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-022c408d-6414-4175-8223-2099eaf1001d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:50.424771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-022c408d-6414-4175-8223-2099eaf1001d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:50.427679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-022c408d-6414-4175-8223-2099eaf1001d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:50.784422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-555855ac-b269-4074-a43a-165c80002614 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:50.794875 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-555855ac-b269-4074-a43a-165c80002614 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1324 microversion: 2.1 time: 0.979234 Jul 26 19:50:50.798786 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 961/1920] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:49 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1324 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:50.812161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c25cc87-f092-464a-b770-c2c467dbc90f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:50.816184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c25cc87-f092-464a-b770-c2c467dbc90f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:50.830559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c25cc87-f092-464a-b770-c2c467dbc90f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:50.831391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c25cc87-f092-464a-b770-c2c467dbc90f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:50.832462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c25cc87-f092-464a-b770-c2c467dbc90f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:50.833164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c25cc87-f092-464a-b770-c2c467dbc90f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:50.932762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:51.389334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-022c408d-6414-4175-8223-2099eaf1001d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:51.402209 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-022c408d-6414-4175-8223-2099eaf1001d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 1.028640 Jul 26 19:50:51.403955 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 960/1921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:50 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:51.409772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9b2a6129-a5cc-4d57-b04c-c1c7325a294c req-01d97ca0-4fff-49c0-bcb2-74b8dd80a148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc24d0ee-65ce-4620-a3b2-263af9715a2e", "name": "network-vif-plugged", "status": "completed", "tag": "86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:51.421979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9b2a6129-a5cc-4d57-b04c-c1c7325a294c req-01d97ca0-4fff-49c0-bcb2-74b8dd80a148 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:51.423742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9b2a6129-a5cc-4d57-b04c-c1c7325a294c req-01d97ca0-4fff-49c0-bcb2-74b8dd80a148 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:51.436996 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9b2a6129-a5cc-4d57-b04c-c1c7325a294c req-01d97ca0-4fff-49c0-bcb2-74b8dd80a148 service nova] Creating event network-vif-plugged:86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8 for instance cc24d0ee-65ce-4620-a3b2-263af9715a2e on n-h2-708768-8 Jul 26 19:50:51.444130 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9b2a6129-a5cc-4d57-b04c-c1c7325a294c req-01d97ca0-4fff-49c0-bcb2-74b8dd80a148 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038532 Jul 26 19:50:51.445445 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 961/1922] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:51.454196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-818a40ff-e3ff-48d6-80fd-8a64c29545c2 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:51.455025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-818a40ff-e3ff-48d6-80fd-8a64c29545c2 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:51.457517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:51.465273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-818a40ff-e3ff-48d6-80fd-8a64c29545c2 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:51.465714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-818a40ff-e3ff-48d6-80fd-8a64c29545c2 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:51.467190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-818a40ff-e3ff-48d6-80fd-8a64c29545c2 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:51.467709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-818a40ff-e3ff-48d6-80fd-8a64c29545c2 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:51.680695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c25cc87-f092-464a-b770-c2c467dbc90f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:51.695881 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c25cc87-f092-464a-b770-c2c467dbc90f tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1493 microversion: 2.1 time: 0.895468 Jul 26 19:50:51.711258 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 962/1923] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:50 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1493 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:51.719810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:51.720432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:51.750793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:51.752817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:51.754822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:51.756177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:51.849200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=38 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:52.123507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-818a40ff-e3ff-48d6-80fd-8a64c29545c2 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:52.137568 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-818a40ff-e3ff-48d6-80fd-8a64c29545c2 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1316 microversion: 2.1 time: 0.688277 Jul 26 19:50:52.159783 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 962/1924] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:51 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1316 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:52.164848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4cca310b-bc01-4d6c-84c6-7ea3c2ee5361 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:52.165447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4cca310b-bc01-4d6c-84c6-7ea3c2ee5361 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:52.172696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cca310b-bc01-4d6c-84c6-7ea3c2ee5361 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:52.173312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cca310b-bc01-4d6c-84c6-7ea3c2ee5361 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:52.174579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cca310b-bc01-4d6c-84c6-7ea3c2ee5361 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:52.175112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4cca310b-bc01-4d6c-84c6-7ea3c2ee5361 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:52.322441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:52.332022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:52.333751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:52.334883 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8ea9df7e-f3a5-489a-9266-231c368c627a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1280 microversion: 2.25 time: 0.621812 Jul 26 19:50:52.335593 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 963/1925] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:51 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1280 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:52.340668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-cd83d303-ff6b-485b-a221-bae6a295255b req-bb58422b-90ff-4507-a9f4-43f28e8b7205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d006fe-7f67-4f51-9cb5-abb8917d2919", "tag": "791555ea-01a2-4ab1-b0e3-0549bea46651"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:52.352660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cd83d303-ff6b-485b-a221-bae6a295255b req-bb58422b-90ff-4507-a9f4-43f28e8b7205 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:52.353295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cd83d303-ff6b-485b-a221-bae6a295255b req-bb58422b-90ff-4507-a9f4-43f28e8b7205 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:52.367343 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-cd83d303-ff6b-485b-a221-bae6a295255b req-bb58422b-90ff-4507-a9f4-43f28e8b7205 service nova] Creating event network-changed:791555ea-01a2-4ab1-b0e3-0549bea46651 for instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 on n-h2-708768-8 Jul 26 19:50:52.373789 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-cd83d303-ff6b-485b-a221-bae6a295255b req-bb58422b-90ff-4507-a9f4-43f28e8b7205 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036563 Jul 26 19:50:52.374411 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 964/1926] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:52.383875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "277aaf64-9cfe-45ff-8133-1347d4658527"}], "security_groups": [{"name": "tempest-securitygroup--631332029"}], "key_name": "tempest-keypair-419891600", "user_data": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:52.646676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] validate_networks() for [('277aaf64-9cfe-45ff-8133-1347d4658527', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:52.740791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4cca310b-bc01-4d6c-84c6-7ea3c2ee5361 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:52.792288 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4cca310b-bc01-4d6c-84c6-7ea3c2ee5361 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1324 microversion: 2.1 time: 0.609300 Jul 26 19:50:52.808634 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 963/1927] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:52 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1324 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:52.831173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-52427e90-cf9a-4075-8d0c-9ee154f0a65c tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:52.832119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-52427e90-cf9a-4075-8d0c-9ee154f0a65c tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:52.847413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52427e90-cf9a-4075-8d0c-9ee154f0a65c tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:52.848140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52427e90-cf9a-4075-8d0c-9ee154f0a65c tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:52.849568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52427e90-cf9a-4075-8d0c-9ee154f0a65c tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:52.850232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52427e90-cf9a-4075-8d0c-9ee154f0a65c tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.279587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:53.280036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:53.280512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:53.280924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:53.282282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:53.291719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.292195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.293031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.293468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.312778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Getting quotas for project db03cc70ec3449dba93baafb7a0762f4. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:53.317939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Getting quotas for user 270af76b143f4e329b2e941d257b042f and project db03cc70ec3449dba93baafb7a0762f4. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:53.331212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:53.333635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:53.345768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-52427e90-cf9a-4075-8d0c-9ee154f0a65c tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:53.354834 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-52427e90-cf9a-4075-8d0c-9ee154f0a65c tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 0.538803 Jul 26 19:50:53.368928 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 964/1928] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:52 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:53.374145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3fc34eb-de52-4423-be22-2552569169ad tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:53.375546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3fc34eb-de52-4423-be22-2552569169ad tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:53.381962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3fc34eb-de52-4423-be22-2552569169ad tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.382662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3fc34eb-de52-4423-be22-2552569169ad tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.383647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3fc34eb-de52-4423-be22-2552569169ad tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.384248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3fc34eb-de52-4423-be22-2552569169ad tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.401579 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-381e3b82-68b0-4433-b976-598efd1f19f8 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.024518 Jul 26 19:50:53.402442 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 965/1929] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:50:53.410222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6c72f976-5920-4dd6-9ad3-0d6f99650125 req-1ab49d06-a1b5-4bcd-a481-ffd5d12f61d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009", "name": "network-vif-deleted", "tag": "2cea112a-80c6-4def-ac26-fa83b4bdc72b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:53.425940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6c72f976-5920-4dd6-9ad3-0d6f99650125 req-1ab49d06-a1b5-4bcd-a481-ffd5d12f61d0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.426897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6c72f976-5920-4dd6-9ad3-0d6f99650125 req-1ab49d06-a1b5-4bcd-a481-ffd5d12f61d0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.448688 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6c72f976-5920-4dd6-9ad3-0d6f99650125 req-1ab49d06-a1b5-4bcd-a481-ffd5d12f61d0 service nova] Creating event network-vif-deleted:2cea112a-80c6-4def-ac26-fa83b4bdc72b for instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 on n-h1-708768-8 Jul 26 19:50:53.456542 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6c72f976-5920-4dd6-9ad3-0d6f99650125 req-1ab49d06-a1b5-4bcd-a481-ffd5d12f61d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052363 Jul 26 19:50:53.457245 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 966/1930] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:53.462383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dc7d834-7b64-41c4-97b5-7b6e02365edf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:53.463482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1dc7d834-7b64-41c4-97b5-7b6e02365edf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:53.472587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dc7d834-7b64-41c4-97b5-7b6e02365edf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.473650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dc7d834-7b64-41c4-97b5-7b6e02365edf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.475492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dc7d834-7b64-41c4-97b5-7b6e02365edf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.476328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dc7d834-7b64-41c4-97b5-7b6e02365edf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.527952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3fc34eb-de52-4423-be22-2552569169ad tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:53.542689 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3fc34eb-de52-4423-be22-2552569169ad tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 200 len: 1451 microversion: 2.1 time: 0.172116 Jul 26 19:50:53.544532 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 965/1931] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:53 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:53.551174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:53.552043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:53.564076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.564884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.565671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.566109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.698002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1dc7d834-7b64-41c4-97b5-7b6e02365edf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:53.713258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1dc7d834-7b64-41c4-97b5-7b6e02365edf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1465 microversion: 2.1 time: 0.253393 Jul 26 19:50:53.717118 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 967/1932] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:53 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1465 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:53.731895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9f80b334-6959-4486-9d27-9babe10011d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:53.733053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9f80b334-6959-4486-9d27-9babe10011d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:53.821808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:53.836464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9f80b334-6959-4486-9d27-9babe10011d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:53.845757 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9f80b334-6959-4486-9d27-9babe10011d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1225 microversion: 2.1 time: 0.127292 Jul 26 19:50:53.846220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:53.859665 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 968/1933] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:53 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:53.862286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:53.864022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa9eff95-1521-4e81-8951-15e7ab5965ee tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:53.865424 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d2d6761f-2b03-414e-a923-681ef5ff32d5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1280 microversion: 2.25 time: 0.319665 Jul 26 19:50:53.865843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fa9eff95-1521-4e81-8951-15e7ab5965ee tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:53.877434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa9eff95-1521-4e81-8951-15e7ab5965ee tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.880940 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 966/1934] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:53 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:53.881667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa9eff95-1521-4e81-8951-15e7ab5965ee tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.882690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa9eff95-1521-4e81-8951-15e7ab5965ee tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.883342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa9eff95-1521-4e81-8951-15e7ab5965ee tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.885951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-128356a9-f1d0-4416-8822-271ad4a6206a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:53.886570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-128356a9-f1d0-4416-8822-271ad4a6206a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:53.895683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-128356a9-f1d0-4416-8822-271ad4a6206a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.896396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-128356a9-f1d0-4416-8822-271ad4a6206a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:53.897409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-128356a9-f1d0-4416-8822-271ad4a6206a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:53.898016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-128356a9-f1d0-4416-8822-271ad4a6206a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:54.139583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-128356a9-f1d0-4416-8822-271ad4a6206a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:54.148028 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-128356a9-f1d0-4416-8822-271ad4a6206a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1324 microversion: 2.1 time: 0.265911 Jul 26 19:50:54.149693 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 967/1935] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:53 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:54.160858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1121269615", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "0f695fb7-3303-409c-b910-73ee1e80f46d"}], "security_groups": [{"name": "tempest-securitygroup--1356656523"}], "key_name": "tempest-keypair-29173777", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:54.185771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fa9eff95-1521-4e81-8951-15e7ab5965ee tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:54.193805 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa9eff95-1521-4e81-8951-15e7ab5965ee tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 200 len: 1467 microversion: 2.1 time: 0.341660 Jul 26 19:50:54.194397 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 969/1936] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:53 2022] GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 1467 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:54.217276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3c657e8-209d-4336-9113-c6094314d999 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1394347602"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:54.221724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b3c657e8-209d-4336-9113-c6094314d999 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:54.228552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3c657e8-209d-4336-9113-c6094314d999 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:54.229004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3c657e8-209d-4336-9113-c6094314d999 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:54.229925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3c657e8-209d-4336-9113-c6094314d999 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:54.230564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3c657e8-209d-4336-9113-c6094314d999 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:54.431471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] validate_networks() for [('0f695fb7-3303-409c-b910-73ee1e80f46d', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:54.601681 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3c657e8-209d-4336-9113-c6094314d999 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "POST /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207/action" status: 202 len: 0 microversion: 2.1 time: 0.374401 Jul 26 19:50:54.605316 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 970/1937] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:50:54 2022] POST /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 26 19:50:54.623852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b82e1aad-211b-4753-85d7-e369952f7fe7 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:54.625779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b82e1aad-211b-4753-85d7-e369952f7fe7 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:54.644454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b82e1aad-211b-4753-85d7-e369952f7fe7 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:54.645540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b82e1aad-211b-4753-85d7-e369952f7fe7 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:54.650923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b82e1aad-211b-4753-85d7-e369952f7fe7 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:54.651427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b82e1aad-211b-4753-85d7-e369952f7fe7 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:54.924892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b82e1aad-211b-4753-85d7-e369952f7fe7 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:54.941839 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b82e1aad-211b-4753-85d7-e369952f7fe7 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 0.333109 Jul 26 19:50:54.944114 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 971/1938] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:54 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:54.949639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:54.950628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:54.978883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:54.979439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:54.984258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:54.984845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:55.012818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 HTTP/1.1 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009'} Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:50:55.016075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:55.021856 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:50:55.021856 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:50:55.021856 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:50:55.021856 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:50:55.021856 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:50:55.021856 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:50:55.021856 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:50:55.025685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:50:55.026905 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ca95cb1e-61ee-49b7-8d49-e41a1eb41752 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 404 len: 111 microversion: 2.1 time: 0.081521 Jul 26 19:50:55.027515 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 972/1939] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:54 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:50:55.049673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ddb64a9-01e5-494c-b292-d9f727abfb51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e979430>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:55.115804 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ddb64a9-01e5-494c-b292-d9f727abfb51 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.084979 Jul 26 19:50:55.124250 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 973/1940] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:55 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:55.130405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64f8e33a-6f8f-4f0c-8793-259be530ed4a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:55.134397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64f8e33a-6f8f-4f0c-8793-259be530ed4a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:55.152943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64f8e33a-6f8f-4f0c-8793-259be530ed4a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:55.154246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64f8e33a-6f8f-4f0c-8793-259be530ed4a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:55.155525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64f8e33a-6f8f-4f0c-8793-259be530ed4a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:55.157295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64f8e33a-6f8f-4f0c-8793-259be530ed4a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:55.320129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64f8e33a-6f8f-4f0c-8793-259be530ed4a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:55.335989 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64f8e33a-6f8f-4f0c-8793-259be530ed4a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1277 microversion: 2.1 time: 0.215446 Jul 26 19:50:55.337078 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 974/1941] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:55 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:55.344548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:55.345287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:55.353783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:55.354357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:55.355862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:55.356525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:55.363649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:55.629363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:55.638304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:55.639942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:55.641140 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ee565659-01ca-41f1-9828-b6b77dc5ddad tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1280 microversion: 2.25 time: 0.302981 Jul 26 19:50:55.642303 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 975/1942] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:55 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1280 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:55.646575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-16eb3e42-942e-44ee-ac93-ad64cd7e8636 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:55.647189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-16eb3e42-942e-44ee-ac93-ad64cd7e8636 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:55.653311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16eb3e42-942e-44ee-ac93-ad64cd7e8636 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:55.653767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16eb3e42-942e-44ee-ac93-ad64cd7e8636 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:55.654542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16eb3e42-942e-44ee-ac93-ad64cd7e8636 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:55.654996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16eb3e42-942e-44ee-ac93-ad64cd7e8636 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:55.847301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-16eb3e42-942e-44ee-ac93-ad64cd7e8636 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:55.855702 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-16eb3e42-942e-44ee-ac93-ad64cd7e8636 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1324 microversion: 2.1 time: 0.212517 Jul 26 19:50:55.864919 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 976/1943] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:55 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:55.864919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2042653375", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d609008d-caf9-4f78-8a5e-41e510179ad2"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:55.932598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] validate_networks() for [('d609008d-caf9-4f78-8a5e-41e510179ad2', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:50:56.143307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:56.144440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:56.145113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:56.145686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:56.146351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:56.164087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.164802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.165822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.166436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.192703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:56.198799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for user 678a9d8bb54a4fdb8997fcf480a3a355 and project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:56.216950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:56.220136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:56.317688 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-40386875-ae19-457a-b540-145c907a2796 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.166706 Jul 26 19:50:56.324992 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 968/1944] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:50:56.330610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-149332ac-7852-48ad-8a7d-a26516d8e187 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:56.334497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-149332ac-7852-48ad-8a7d-a26516d8e187 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:56.360936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-149332ac-7852-48ad-8a7d-a26516d8e187 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.361575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-149332ac-7852-48ad-8a7d-a26516d8e187 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.363783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-149332ac-7852-48ad-8a7d-a26516d8e187 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.364646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-149332ac-7852-48ad-8a7d-a26516d8e187 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.460912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:50:56.464075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:50:56.464818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:50:56.465232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:50:56.465651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:50:56.482207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.482759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.483565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.484107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.515419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:50:56.521231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Getting quotas for user 4e8808ff2c4341eca66334700ec25a82 and project 913c0fd2d4ec40af912b139762716033. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:50:56.539672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:50:56.542001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:50:56.599960 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32cf68d8-03c2-4692-b3c7-5ed446efdcc8 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741937 Jul 26 19:50:56.601286 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 977/1945] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:50:56.606883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e080f7e4-8277-4d6e-be0b-7d2debb7087b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e9e1d30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:56.683584 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e080f7e4-8277-4d6e-be0b-7d2debb7087b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.080877 Jul 26 19:50:56.684920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 978/1946] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:56 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:56.690733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1381fdad-1bb2-4ba2-be4b-c6fb55a33557 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:56.691897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1381fdad-1bb2-4ba2-be4b-c6fb55a33557 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:56.695182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-149332ac-7852-48ad-8a7d-a26516d8e187 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:56.704165 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-149332ac-7852-48ad-8a7d-a26516d8e187 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 0.377854 Jul 26 19:50:56.708301 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 969/1947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:56 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:56.713010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cb668cd0-9a23-4160-9657-49ae570574d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:56.724544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cb668cd0-9a23-4160-9657-49ae570574d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:56.733824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb668cd0-9a23-4160-9657-49ae570574d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.734987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb668cd0-9a23-4160-9657-49ae570574d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.735649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb668cd0-9a23-4160-9657-49ae570574d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.737455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb668cd0-9a23-4160-9657-49ae570574d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.753708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1381fdad-1bb2-4ba2-be4b-c6fb55a33557 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:56.760909 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1381fdad-1bb2-4ba2-be4b-c6fb55a33557 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1233 microversion: 2.1 time: 0.074909 Jul 26 19:50:56.761498 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 979/1948] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:56 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1233 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:56.768375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c765c10c-4aef-4820-8bee-284a58fc0761 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:56.768593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c765c10c-4aef-4820-8bee-284a58fc0761 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:56.844522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c765c10c-4aef-4820-8bee-284a58fc0761 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:56.851490 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c765c10c-4aef-4820-8bee-284a58fc0761 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1215 microversion: 2.1 time: 0.088988 Jul 26 19:50:56.852105 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 980/1949] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:56 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:56.854710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cb668cd0-9a23-4160-9657-49ae570574d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:56.858413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:56.859244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:56.866349 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cb668cd0-9a23-4160-9657-49ae570574d6 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1283 microversion: 2.1 time: 0.155359 Jul 26 19:50:56.867267 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 970/1950] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:56 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1283 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:56.867598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.868078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.868859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.870717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.898253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cb6d7c37-2e63-4a1b-b2af-e8456e6eaa7e tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:56.900559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cb6d7c37-2e63-4a1b-b2af-e8456e6eaa7e tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:56.918270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb6d7c37-2e63-4a1b-b2af-e8456e6eaa7e tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.920824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb6d7c37-2e63-4a1b-b2af-e8456e6eaa7e tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:56.922395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb6d7c37-2e63-4a1b-b2af-e8456e6eaa7e tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:56.923021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb6d7c37-2e63-4a1b-b2af-e8456e6eaa7e tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:57.057060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:57.079436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:57.081350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:57.083258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e95643d-ce1e-495f-8391-cb082d9d0ed8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1280 microversion: 2.25 time: 0.229073 Jul 26 19:50:57.084723 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 981/1951] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:56 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1280 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:57.277020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cb6d7c37-2e63-4a1b-b2af-e8456e6eaa7e tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:57.285020 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cb6d7c37-2e63-4a1b-b2af-e8456e6eaa7e tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1324 microversion: 2.1 time: 0.410769 Jul 26 19:50:57.296547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 971/1952] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:56 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:50:57.599143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b694d224-bd9e-496b-a5ff-c83010a7961a req-314af9a9-801d-479f-8abe-cc8814eed670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d006fe-7f67-4f51-9cb5-abb8917d2919", "name": "network-vif-plugged", "status": "completed", "tag": "791555ea-01a2-4ab1-b0e3-0549bea46651"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:50:57.610867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b694d224-bd9e-496b-a5ff-c83010a7961a req-314af9a9-801d-479f-8abe-cc8814eed670 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:57.611746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b694d224-bd9e-496b-a5ff-c83010a7961a req-314af9a9-801d-479f-8abe-cc8814eed670 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:57.635354 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b694d224-bd9e-496b-a5ff-c83010a7961a req-314af9a9-801d-479f-8abe-cc8814eed670 service nova] Creating event network-vif-plugged:791555ea-01a2-4ab1-b0e3-0549bea46651 for instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 on n-h2-708768-8 Jul 26 19:50:57.642461 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b694d224-bd9e-496b-a5ff-c83010a7961a req-314af9a9-801d-479f-8abe-cc8814eed670 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047430 Jul 26 19:50:57.644325 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 982/1953] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:50:57.700034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-418e1182-ea56-4c6c-b099-aeb3ef32f24c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756cfa3a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:57.734538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-89b13d96-516c-4a76-991f-48f84c4b6ed9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:57.735408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-89b13d96-516c-4a76-991f-48f84c4b6ed9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:57.738315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:57.758998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89b13d96-516c-4a76-991f-48f84c4b6ed9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:57.759468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89b13d96-516c-4a76-991f-48f84c4b6ed9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:57.761512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89b13d96-516c-4a76-991f-48f84c4b6ed9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:57.763260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89b13d96-516c-4a76-991f-48f84c4b6ed9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:57.854343 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-418e1182-ea56-4c6c-b099-aeb3ef32f24c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.159840 Jul 26 19:50:57.855297 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 972/1954] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:57 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:57.876922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cdc9629d-a680-48d7-a2b5-be6e96f9607d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:57.877553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cdc9629d-a680-48d7-a2b5-be6e96f9607d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:57.905647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc9629d-a680-48d7-a2b5-be6e96f9607d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:57.906659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc9629d-a680-48d7-a2b5-be6e96f9607d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:57.917161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc9629d-a680-48d7-a2b5-be6e96f9607d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:57.918678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc9629d-a680-48d7-a2b5-be6e96f9607d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:58.162506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cdc9629d-a680-48d7-a2b5-be6e96f9607d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:58.174337 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cdc9629d-a680-48d7-a2b5-be6e96f9607d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1293 microversion: 2.1 time: 0.311882 Jul 26 19:50:58.178286 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 973/1955] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:57 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1293 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:58.183686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d3f69715-8202-435b-930b-08689487f63c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:58.184830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d3f69715-8202-435b-930b-08689487f63c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:58.193082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3f69715-8202-435b-930b-08689487f63c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:58.193937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3f69715-8202-435b-930b-08689487f63c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:58.195220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3f69715-8202-435b-930b-08689487f63c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:58.196057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3f69715-8202-435b-930b-08689487f63c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:58.431632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3f69715-8202-435b-930b-08689487f63c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:58.441085 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d3f69715-8202-435b-930b-08689487f63c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1267 microversion: 2.1 time: 0.261213 Jul 26 19:50:58.456497 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 974/1956] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:58 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:58.462364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e121dd2b-e662-4592-bb6e-6ca0a9f98e37 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:58.463363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e121dd2b-e662-4592-bb6e-6ca0a9f98e37 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:58.470954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e121dd2b-e662-4592-bb6e-6ca0a9f98e37 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:58.471885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e121dd2b-e662-4592-bb6e-6ca0a9f98e37 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:58.473006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e121dd2b-e662-4592-bb6e-6ca0a9f98e37 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:58.473707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e121dd2b-e662-4592-bb6e-6ca0a9f98e37 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:58.506140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:50:58.533894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-89b13d96-516c-4a76-991f-48f84c4b6ed9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:58.550735 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-89b13d96-516c-4a76-991f-48f84c4b6ed9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 0.821277 Jul 26 19:50:58.551412 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 983/1957] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:57 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:58.572799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:58.574334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:58.582762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:58.583324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:58.584652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:58.585399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:58.926092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:58.941392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:58.947353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:58.947986 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14545f6e-fafb-4aa4-9154-daf7b8089224 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1280 microversion: 2.25 time: 0.380150 Jul 26 19:50:58.953632 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 984/1958] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:50:58 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1280 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:50:58.958633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ffe9d627-8f9a-4d5d-a2b1-4fd7faa74940 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:58.962879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ffe9d627-8f9a-4d5d-a2b1-4fd7faa74940 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:58.987276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ffe9d627-8f9a-4d5d-a2b1-4fd7faa74940 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:58.987931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ffe9d627-8f9a-4d5d-a2b1-4fd7faa74940 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:58.989081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ffe9d627-8f9a-4d5d-a2b1-4fd7faa74940 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:59.001064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ffe9d627-8f9a-4d5d-a2b1-4fd7faa74940 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:59.527259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ffe9d627-8f9a-4d5d-a2b1-4fd7faa74940 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:59.540241 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ffe9d627-8f9a-4d5d-a2b1-4fd7faa74940 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1324 microversion: 2.1 time: 0.583251 Jul 26 19:50:59.554404 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 985/1959] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:58 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1324 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:59.576386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d1bd7549-578d-4f21-8129-4cbd21db24b6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ed6f5e0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:59.692536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d1bd7549-578d-4f21-8129-4cbd21db24b6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.145609 Jul 26 19:50:59.694670 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 986/1960] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:50:59 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:59.695450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e121dd2b-e662-4592-bb6e-6ca0a9f98e37 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:50:59.708148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41f1db54-71b0-4fd6-9abc-5db89a3232ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:59.709695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41f1db54-71b0-4fd6-9abc-5db89a3232ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:59.713097 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e121dd2b-e662-4592-bb6e-6ca0a9f98e37 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 1.255117 Jul 26 19:50:59.725510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41f1db54-71b0-4fd6-9abc-5db89a3232ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:59.729178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41f1db54-71b0-4fd6-9abc-5db89a3232ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:59.729737 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 975/1961] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:58 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:50:59.730340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41f1db54-71b0-4fd6-9abc-5db89a3232ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:59.732196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41f1db54-71b0-4fd6-9abc-5db89a3232ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:59.759305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ec3ef05-dcd2-4eeb-a6dc-6f5c3a045c85 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:50:59.762287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ec3ef05-dcd2-4eeb-a6dc-6f5c3a045c85 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:50:59.792800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ec3ef05-dcd2-4eeb-a6dc-6f5c3a045c85 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:59.795129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ec3ef05-dcd2-4eeb-a6dc-6f5c3a045c85 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:50:59.796059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ec3ef05-dcd2-4eeb-a6dc-6f5c3a045c85 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:50:59.796746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ec3ef05-dcd2-4eeb-a6dc-6f5c3a045c85 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:00.057748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ec3ef05-dcd2-4eeb-a6dc-6f5c3a045c85 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:00.068632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ec3ef05-dcd2-4eeb-a6dc-6f5c3a045c85 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1273 microversion: 2.1 time: 0.332511 Jul 26 19:51:00.071921 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 976/1962] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:59 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:00.098698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-90f1d735-d8ea-4d34-9bf5-21e85c033e27 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:00.099841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-90f1d735-d8ea-4d34-9bf5-21e85c033e27 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:00.116905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f1d735-d8ea-4d34-9bf5-21e85c033e27 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:00.117739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f1d735-d8ea-4d34-9bf5-21e85c033e27 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:00.120129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f1d735-d8ea-4d34-9bf5-21e85c033e27 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:00.120858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f1d735-d8ea-4d34-9bf5-21e85c033e27 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:00.515843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-41f1db54-71b0-4fd6-9abc-5db89a3232ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:00.527016 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41f1db54-71b0-4fd6-9abc-5db89a3232ef tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1359 microversion: 2.1 time: 0.829011 Jul 26 19:51:00.529255 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 987/1963] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:50:59 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1359 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:00.540353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1f07f02b-a0df-4bcf-a062-20d99dc1779c req-7ccdd839-23f2-4f96-80fb-21f648fc3f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400c42ab-aa78-434d-929d-9ee94f47440e", "name": "network-vif-plugged", "status": "completed", "tag": "72281411-bd74-4ea2-be77-739ac2da2d6c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:00.576041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1f07f02b-a0df-4bcf-a062-20d99dc1779c req-7ccdd839-23f2-4f96-80fb-21f648fc3f00 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:00.576486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1f07f02b-a0df-4bcf-a062-20d99dc1779c req-7ccdd839-23f2-4f96-80fb-21f648fc3f00 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:00.609405 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1f07f02b-a0df-4bcf-a062-20d99dc1779c req-7ccdd839-23f2-4f96-80fb-21f648fc3f00 service nova] Creating event network-vif-plugged:72281411-bd74-4ea2-be77-739ac2da2d6c for instance 400c42ab-aa78-434d-929d-9ee94f47440e on n-h1-708768-8 Jul 26 19:51:00.617461 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1f07f02b-a0df-4bcf-a062-20d99dc1779c req-7ccdd839-23f2-4f96-80fb-21f648fc3f00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085311 Jul 26 19:51:00.618957 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 988/1964] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:00.626598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:00.632635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:00.642168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:00.658927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:00.659880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:00.660335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:00.876675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-90f1d735-d8ea-4d34-9bf5-21e85c033e27 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:00.896154 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-90f1d735-d8ea-4d34-9bf5-21e85c033e27 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1316 microversion: 2.1 time: 0.821896 Jul 26 19:51:00.910926 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 977/1965] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:00 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1316 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:00.917841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-40671b6a-b1c7-49e9-98c0-1222eb233387 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:00.918711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40671b6a-b1c7-49e9-98c0-1222eb233387 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:00.928450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40671b6a-b1c7-49e9-98c0-1222eb233387 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:00.929239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40671b6a-b1c7-49e9-98c0-1222eb233387 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:00.930262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40671b6a-b1c7-49e9-98c0-1222eb233387 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:00.931943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40671b6a-b1c7-49e9-98c0-1222eb233387 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:01.022666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:01.032762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:01.037141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:01.042969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a003515-7fa8-4655-8134-860ba46e6de2 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1280 microversion: 2.25 time: 0.422556 Jul 26 19:51:01.057394 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 989/1966] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:00 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1280 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:01.066370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c425d042-02ad-40c1-a226-4bc00feb9ce1 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e963ca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:01.178286 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c425d042-02ad-40c1-a226-4bc00feb9ce1 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.119551 Jul 26 19:51:01.179434 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 990/1967] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:01 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:01.184512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9dcd516e-9eca-4623-b12c-a12d226e1508 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:01.185891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9dcd516e-9eca-4623-b12c-a12d226e1508 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:01.207067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dcd516e-9eca-4623-b12c-a12d226e1508 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:01.208451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dcd516e-9eca-4623-b12c-a12d226e1508 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:01.210806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dcd516e-9eca-4623-b12c-a12d226e1508 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:01.216136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dcd516e-9eca-4623-b12c-a12d226e1508 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:01.560310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-40671b6a-b1c7-49e9-98c0-1222eb233387 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:01.576811 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-40671b6a-b1c7-49e9-98c0-1222eb233387 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1520 microversion: 2.1 time: 0.663367 Jul 26 19:51:01.578105 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 978/1968] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:00 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1520 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:01.582790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9aa170c0-7fed-4c69-9fed-2dd496414ba4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:01.587147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9aa170c0-7fed-4c69-9fed-2dd496414ba4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:01.605981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aa170c0-7fed-4c69-9fed-2dd496414ba4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:01.606653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aa170c0-7fed-4c69-9fed-2dd496414ba4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:01.611880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aa170c0-7fed-4c69-9fed-2dd496414ba4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:01.613127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aa170c0-7fed-4c69-9fed-2dd496414ba4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:01.703971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9dcd516e-9eca-4623-b12c-a12d226e1508 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:01.726244 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9dcd516e-9eca-4623-b12c-a12d226e1508 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 0.545423 Jul 26 19:51:01.739068 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 991/1969] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:01 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:01.754260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5fdafa0c-b01c-4e1c-857c-507dc0e8482f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:01.754954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5fdafa0c-b01c-4e1c-857c-507dc0e8482f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:01.784856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fdafa0c-b01c-4e1c-857c-507dc0e8482f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:01.815099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fdafa0c-b01c-4e1c-857c-507dc0e8482f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:01.818852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fdafa0c-b01c-4e1c-857c-507dc0e8482f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:01.819296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fdafa0c-b01c-4e1c-857c-507dc0e8482f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.217731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5fdafa0c-b01c-4e1c-857c-507dc0e8482f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:02.236334 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5fdafa0c-b01c-4e1c-857c-507dc0e8482f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1359 microversion: 2.1 time: 0.493539 Jul 26 19:51:02.237515 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 992/1970] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:01 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1359 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:02.243349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:02.248288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:02.272355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.276984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.280724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.280724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.288929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9aa170c0-7fed-4c69-9fed-2dd496414ba4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:02.302516 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9aa170c0-7fed-4c69-9fed-2dd496414ba4 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 0.723403 Jul 26 19:51:02.317279 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 979/1971] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:01 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:02.325236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0677101b-82a5-4fef-8e24-6a798ea0f1bb req-bfa867eb-c644-4831-9b00-10bf6abc16cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96e47b7-d312-4d66-bd84-8cee85866b25", "tag": "4c2b7e2a-35c8-4f6c-87db-eb905b409fbb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:02.352564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0677101b-82a5-4fef-8e24-6a798ea0f1bb req-bfa867eb-c644-4831-9b00-10bf6abc16cf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.353014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0677101b-82a5-4fef-8e24-6a798ea0f1bb req-bfa867eb-c644-4831-9b00-10bf6abc16cf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.357613 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] HTTP exception thrown: Instance is not a member of specified network Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Request method failure captured: Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919/ips/invalid HTTP/1.1 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EWODdBMdDaQ__tt2goENaRGZuZzs-s-enPYDvd0VpOhMAjn61-h24NSkHI66aRu7uocAOVVV-5SVpQj7TIwme55NUyYxH01469I5d_UGaRLfTAlE8QkdtpJuWuHEvztT059EFrwxVV7GZciuau3OMgiHPq1z0i-KMLptWLQPSBlYg8 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 3217b1b41e1e4274bc4442e54926f418 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3217b1b41e1e4274bc4442e54926f418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217b1b41e1e4274bc4442e54926f418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3217b1b41e1e4274bc4442e54926f418", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217b1b41e1e4274bc4442e54926f418"}]}] Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 3217b1b41e1e4274bc4442e54926f418 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerAddressesNegativeTestJSON-14916280-project Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5abd3e457e042c3ba27040272c69ce4 Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-14916280-project Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance is not a member of specified network Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': 'd9d006fe-7f67-4f51-9cb5-abb8917d2919', 'id': 'invalid'} Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 26 19:51:02.369376 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:02.374002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Returning 404 to user: Instance is not a member of specified network {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:02.374002 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f65db51-0231-4159-a5e4-1551c0b96d65 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.131237 Jul 26 19:51:02.374002 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 993/1972] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:51:02 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919/ips/invalid => generated 91 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:51:02.379258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-edb1f143-206c-4517-a829-479f53baab00 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:02.379914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-edb1f143-206c-4517-a829-479f53baab00 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:02.381014 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0677101b-82a5-4fef-8e24-6a798ea0f1bb req-bfa867eb-c644-4831-9b00-10bf6abc16cf service nova] Creating event network-changed:4c2b7e2a-35c8-4f6c-87db-eb905b409fbb for instance a96e47b7-d312-4d66-bd84-8cee85866b25 on n-h1-708768-8 Jul 26 19:51:02.394494 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0677101b-82a5-4fef-8e24-6a798ea0f1bb req-bfa867eb-c644-4831-9b00-10bf6abc16cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075841 Jul 26 19:51:02.395117 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 980/1973] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:02.399542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb1f143-206c-4517-a829-479f53baab00 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.400150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb1f143-206c-4517-a829-479f53baab00 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.401877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb1f143-206c-4517-a829-479f53baab00 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.402332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb1f143-206c-4517-a829-479f53baab00 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.420168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:02.420953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:02.454580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.455031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.455861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.464775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.740370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-edb1f143-206c-4517-a829-479f53baab00 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:02.751506 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-edb1f143-206c-4517-a829-479f53baab00 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1505 microversion: 2.1 time: 0.378966 Jul 26 19:51:02.767637 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 994/1974] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:02 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:02.767637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7d7560a9-cc3d-478f-9f43-affa97d07b08 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f876843d0d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:02.859209 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7d7560a9-cc3d-478f-9f43-affa97d07b08 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.100862 Jul 26 19:51:02.866674 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 995/1975] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:02 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:02.866674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dca0afe-cb2a-4d44-88b7-da5be2c7ce87 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:02.866674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1dca0afe-cb2a-4d44-88b7-da5be2c7ce87 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Failed to fetch instance by id 999 {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 19:51:02.866674 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-1dca0afe-cb2a-4d44-88b7-da5be2c7ce87 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] HTTP exception thrown: Instance 999 could not be found. Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dca0afe-cb2a-4d44-88b7-da5be2c7ce87 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Request method failure captured: Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EWODdBMdDaQ__tt2goENaRGZuZzs-s-enPYDvd0VpOhMAjn61-h24NSkHI66aRu7uocAOVVV-5SVpQj7TIwme55NUyYxH01469I5d_UGaRLfTAlE8QkdtpJuWuHEvztT059EFrwxVV7GZciuau3OMgiHPq1z0i-KMLptWLQPSBlYg8 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 3217b1b41e1e4274bc4442e54926f418 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3217b1b41e1e4274bc4442e54926f418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217b1b41e1e4274bc4442e54926f418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3217b1b41e1e4274bc4442e54926f418", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217b1b41e1e4274bc4442e54926f418"}]}] Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 3217b1b41e1e4274bc4442e54926f418 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerAddressesNegativeTestJSON-14916280-project Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5abd3e457e042c3ba27040272c69ce4 Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-14916280-project Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 999 could not be found. Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '999'} Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 26 19:51:02.867355 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:02.874490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dca0afe-cb2a-4d44-88b7-da5be2c7ce87 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Returning 404 to user: Instance 999 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:02.874490 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1dca0afe-cb2a-4d44-88b7-da5be2c7ce87 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007598 Jul 26 19:51:02.874490 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 996/1976] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Jul 26 19:51:02 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:51:02.877025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a0580d6e-8e6a-41e9-8de9-0b8c5f06247a req-b1253c5d-cf2a-4e04-ab98-80c6d19217a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f8c415-4c1d-4e8c-b3a6-2b1f20db3207", "name": "network-vif-plugged", "status": "completed", "tag": "6a23c3cf-1752-438a-abe4-d9745485a1b1"}, {"server_uuid": "47e730bb-a29a-4608-8c7a-37f0a157059a", "name": "network-vif-plugged", "status": "completed", "tag": "0eddb3a8-12a7-4dd0-a852-aa571ba0e978"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:02.891854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a0580d6e-8e6a-41e9-8de9-0b8c5f06247a req-b1253c5d-cf2a-4e04-ab98-80c6d19217a8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.892303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a0580d6e-8e6a-41e9-8de9-0b8c5f06247a req-b1253c5d-cf2a-4e04-ab98-80c6d19217a8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.906455 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a0580d6e-8e6a-41e9-8de9-0b8c5f06247a req-b1253c5d-cf2a-4e04-ab98-80c6d19217a8 service nova] Creating event network-vif-plugged:6a23c3cf-1752-438a-abe4-d9745485a1b1 for instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 on n-h1-708768-8 Jul 26 19:51:02.907249 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a0580d6e-8e6a-41e9-8de9-0b8c5f06247a req-b1253c5d-cf2a-4e04-ab98-80c6d19217a8 service nova] Creating event network-vif-plugged:0eddb3a8-12a7-4dd0-a852-aa571ba0e978 for instance 47e730bb-a29a-4608-8c7a-37f0a157059a on n-h2-708768-8 Jul 26 19:51:02.916474 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a0580d6e-8e6a-41e9-8de9-0b8c5f06247a req-b1253c5d-cf2a-4e04-ab98-80c6d19217a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045673 Jul 26 19:51:02.918592 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 997/1977] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:02.924352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e53303f0-1764-4e0c-805f-038ddacf0923 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:02.925937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e53303f0-1764-4e0c-805f-038ddacf0923 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:02.933646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e53303f0-1764-4e0c-805f-038ddacf0923 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.934494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e53303f0-1764-4e0c-805f-038ddacf0923 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:02.935534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e53303f0-1764-4e0c-805f-038ddacf0923 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:02.936239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e53303f0-1764-4e0c-805f-038ddacf0923 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.113082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e53303f0-1764-4e0c-805f-038ddacf0923 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:03.129446 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e53303f0-1764-4e0c-805f-038ddacf0923 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 0.209060 Jul 26 19:51:03.130332 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 998/1978] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:02 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:03.151765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4056ca3f-6943-4c63-8251-e3c97b68cfde tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:03.152713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4056ca3f-6943-4c63-8251-e3c97b68cfde tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:03.164446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4056ca3f-6943-4c63-8251-e3c97b68cfde tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.165509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4056ca3f-6943-4c63-8251-e3c97b68cfde tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.167266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4056ca3f-6943-4c63-8251-e3c97b68cfde tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.167988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4056ca3f-6943-4c63-8251-e3c97b68cfde tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.257632 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4056ca3f-6943-4c63-8251-e3c97b68cfde tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "DELETE /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.110238 Jul 26 19:51:03.258672 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 999/1979] 10.222.0.58 () {58 vars in 1296 bytes} [Tue Jul 26 19:51:03 2022] DELETE /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e/os-server-password => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:51:03.264719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a446a0f-a1a2-4038-a43f-d0075ed5d391 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:03.265941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a446a0f-a1a2-4038-a43f-d0075ed5d391 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:03.272001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:03.275769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a446a0f-a1a2-4038-a43f-d0075ed5d391 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.276290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a446a0f-a1a2-4038-a43f-d0075ed5d391 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.279788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a446a0f-a1a2-4038-a43f-d0075ed5d391 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.280970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a446a0f-a1a2-4038-a43f-d0075ed5d391 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.285166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:03.295475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:03.301882 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-564a4708-391e-45a9-b71c-48dd248145d3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1280 microversion: 2.25 time: 0.905516 Jul 26 19:51:03.324798 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 981/1980] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:02 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1280 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:03.325859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:03.346875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-3d3cea7b-40b5-455b-b540-0473a18f6d19 req-647c124b-c3d8-4094-8c40-fc50d8831e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7590d85-2a5f-4738-b35c-7958afa834a1", "tag": "5ede25db-702f-4589-b58b-60c96d75d1a8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:03.347911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a446a0f-a1a2-4038-a43f-d0075ed5d391 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:51:03.398486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3d3cea7b-40b5-455b-b540-0473a18f6d19 req-647c124b-c3d8-4094-8c40-fc50d8831e0f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.399907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3d3cea7b-40b5-455b-b540-0473a18f6d19 req-647c124b-c3d8-4094-8c40-fc50d8831e0f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.420338 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3d3cea7b-40b5-455b-b540-0473a18f6d19 req-647c124b-c3d8-4094-8c40-fc50d8831e0f service nova] Creating event network-changed:5ede25db-702f-4589-b58b-60c96d75d1a8 for instance b7590d85-2a5f-4738-b35c-7958afa834a1 on n-h1-708768-8 Jul 26 19:51:03.433514 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-3d3cea7b-40b5-455b-b540-0473a18f6d19 req-647c124b-c3d8-4094-8c40-fc50d8831e0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107418 Jul 26 19:51:03.434393 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 982/1981] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:03.444012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1eddb3f6-ae5d-4e57-89e8-28d9b8fc5264 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:03.444733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1eddb3f6-ae5d-4e57-89e8-28d9b8fc5264 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:03.472840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1eddb3f6-ae5d-4e57-89e8-28d9b8fc5264 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.473371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1eddb3f6-ae5d-4e57-89e8-28d9b8fc5264 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.475327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1eddb3f6-ae5d-4e57-89e8-28d9b8fc5264 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.477045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1eddb3f6-ae5d-4e57-89e8-28d9b8fc5264 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.507896 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a446a0f-a1a2-4038-a43f-d0075ed5d391 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 204 len: 0 microversion: 2.1 time: 0.247727 Jul 26 19:51:03.509145 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1000/1982] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:03 2022] DELETE /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:51:03.516852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4626467e-d715-4d03-8f91-f69aa0208a64 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:03.517846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4626467e-d715-4d03-8f91-f69aa0208a64 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:03.527094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4626467e-d715-4d03-8f91-f69aa0208a64 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.527936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4626467e-d715-4d03-8f91-f69aa0208a64 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.528957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4626467e-d715-4d03-8f91-f69aa0208a64 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.529621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4626467e-d715-4d03-8f91-f69aa0208a64 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.571108 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4626467e-d715-4d03-8f91-f69aa0208a64 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.059850 Jul 26 19:51:03.572972 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1001/1983] 10.222.0.58 () {58 vars in 1293 bytes} [Tue Jul 26 19:51:03 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e/os-server-password => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:51:03.583199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a29feb2-cf81-45a8-8fed-922335dea6ef tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:03.584296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3a29feb2-cf81-45a8-8fed-922335dea6ef tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:03.596233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a29feb2-cf81-45a8-8fed-922335dea6ef tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.597260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a29feb2-cf81-45a8-8fed-922335dea6ef tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.602682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a29feb2-cf81-45a8-8fed-922335dea6ef tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.603602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a29feb2-cf81-45a8-8fed-922335dea6ef tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.823454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3a29feb2-cf81-45a8-8fed-922335dea6ef tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:03.832919 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a29feb2-cf81-45a8-8fed-922335dea6ef tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 0.258621 Jul 26 19:51:03.850943 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1002/1984] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:03 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:03.856007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f99c3f9f-529d-444d-afc2-5063b4fb91f3 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:03.856556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f99c3f9f-529d-444d-afc2-5063b4fb91f3 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:03.864251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f99c3f9f-529d-444d-afc2-5063b4fb91f3 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.864703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f99c3f9f-529d-444d-afc2-5063b4fb91f3 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:03.865493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f99c3f9f-529d-444d-afc2-5063b4fb91f3 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:03.865932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f99c3f9f-529d-444d-afc2-5063b4fb91f3 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:04.275715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f99c3f9f-529d-444d-afc2-5063b4fb91f3 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:04.300419 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f99c3f9f-529d-444d-afc2-5063b4fb91f3 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1526 microversion: 2.1 time: 0.448269 Jul 26 19:51:04.301378 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1003/1985] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:03 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1526 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:04.312045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b7e375c2-ceb5-48e7-b315-8951ff142be9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:04.312255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b7e375c2-ceb5-48e7-b315-8951ff142be9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:04.324862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7e375c2-ceb5-48e7-b315-8951ff142be9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:04.325123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7e375c2-ceb5-48e7-b315-8951ff142be9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:04.325882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7e375c2-ceb5-48e7-b315-8951ff142be9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:04.326510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7e375c2-ceb5-48e7-b315-8951ff142be9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:04.372968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b7e375c2-ceb5-48e7-b315-8951ff142be9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:51:04.598741 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b7e375c2-ceb5-48e7-b315-8951ff142be9 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "DELETE /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 204 len: 0 microversion: 2.1 time: 0.290224 Jul 26 19:51:04.599935 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1004/1986] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:04 2022] DELETE /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:51:04.621817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b24593a-459d-46d4-96cd-5d537406e8cb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e940310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:04.685702 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9b24593a-459d-46d4-96cd-5d537406e8cb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.084397 Jul 26 19:51:04.686507 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1005/1987] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:04 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:04.691481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3b8f6fd3-7fbb-4c6f-bf7f-3c94f6b5080a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:04.692260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3b8f6fd3-7fbb-4c6f-bf7f-3c94f6b5080a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:04.714707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b8f6fd3-7fbb-4c6f-bf7f-3c94f6b5080a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:04.715824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b8f6fd3-7fbb-4c6f-bf7f-3c94f6b5080a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:04.717017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b8f6fd3-7fbb-4c6f-bf7f-3c94f6b5080a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:04.722389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b8f6fd3-7fbb-4c6f-bf7f-3c94f6b5080a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:04.817159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1eddb3f6-ae5d-4e57-89e8-28d9b8fc5264 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:04.829618 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1eddb3f6-ae5d-4e57-89e8-28d9b8fc5264 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1359 microversion: 2.1 time: 1.393718 Jul 26 19:51:04.845431 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 983/1988] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:03 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1359 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:04.856700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:04.870263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:04.881396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:04.882389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:04.883584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:04.884223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:04.940078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3b8f6fd3-7fbb-4c6f-bf7f-3c94f6b5080a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:04.948604 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3b8f6fd3-7fbb-4c6f-bf7f-3c94f6b5080a tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 0.260621 Jul 26 19:51:04.962971 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1006/1989] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:04 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:04.962971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c80c8d57-e53e-408e-a3ea-5bebb4adc58e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:04.962971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c80c8d57-e53e-408e-a3ea-5bebb4adc58e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:04.962971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c80c8d57-e53e-408e-a3ea-5bebb4adc58e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:04.962971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c80c8d57-e53e-408e-a3ea-5bebb4adc58e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:04.963633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c80c8d57-e53e-408e-a3ea-5bebb4adc58e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:04.964234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c80c8d57-e53e-408e-a3ea-5bebb4adc58e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:05.137566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c80c8d57-e53e-408e-a3ea-5bebb4adc58e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:05.147451 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c80c8d57-e53e-408e-a3ea-5bebb4adc58e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1511 microversion: 2.1 time: 0.196534 Jul 26 19:51:05.148550 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1007/1990] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:04 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:05.154511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-478066aa-853c-4707-8695-fc5c44b70d81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:05.155356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-478066aa-853c-4707-8695-fc5c44b70d81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:05.162201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-478066aa-853c-4707-8695-fc5c44b70d81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:05.162788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-478066aa-853c-4707-8695-fc5c44b70d81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:05.163696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-478066aa-853c-4707-8695-fc5c44b70d81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:05.164231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-478066aa-853c-4707-8695-fc5c44b70d81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:05.367386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-478066aa-853c-4707-8695-fc5c44b70d81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:05.377642 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-478066aa-853c-4707-8695-fc5c44b70d81 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 0.227941 Jul 26 19:51:05.378805 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1008/1991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:05 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:05.385384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b31511ae-3797-4a6f-8fea-fd16a9f79cf9 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:05.386000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b31511ae-3797-4a6f-8fea-fd16a9f79cf9 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:05.401897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b31511ae-3797-4a6f-8fea-fd16a9f79cf9 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:05.402707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b31511ae-3797-4a6f-8fea-fd16a9f79cf9 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:05.404262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b31511ae-3797-4a6f-8fea-fd16a9f79cf9 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:05.404756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b31511ae-3797-4a6f-8fea-fd16a9f79cf9 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:05.413151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:05.432832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:05.434644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:05.435994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-477bd399-e930-4094-8ee9-1c17bd5014f5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1280 microversion: 2.25 time: 0.589406 Jul 26 19:51:05.448575 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 984/1992] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:04 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1280 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:05.621539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b31511ae-3797-4a6f-8fea-fd16a9f79cf9 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:05.630895 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b31511ae-3797-4a6f-8fea-fd16a9f79cf9 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1526 microversion: 2.1 time: 0.250904 Jul 26 19:51:05.631498 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1009/1993] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:05 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1526 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:05.700736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c3c474f-c782-4f98-a163-efb594ddb98c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756ed84c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:05.796005 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c3c474f-c782-4f98-a163-efb594ddb98c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.098996 Jul 26 19:51:05.796613 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 985/1994] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:05 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:05.852265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bab3aa8-cc45-4d40-ab09-df353f65460d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:05.853123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bab3aa8-cc45-4d40-ab09-df353f65460d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:05.862378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bab3aa8-cc45-4d40-ab09-df353f65460d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:05.862825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bab3aa8-cc45-4d40-ab09-df353f65460d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:05.863620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bab3aa8-cc45-4d40-ab09-df353f65460d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:05.867988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bab3aa8-cc45-4d40-ab09-df353f65460d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:05.971875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d8103fb1-66f8-4742-a6c6-8813b0a22c4e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:05.972507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d8103fb1-66f8-4742-a6c6-8813b0a22c4e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:05.985746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8103fb1-66f8-4742-a6c6-8813b0a22c4e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:05.986215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8103fb1-66f8-4742-a6c6-8813b0a22c4e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:05.986989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8103fb1-66f8-4742-a6c6-8813b0a22c4e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:05.987459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8103fb1-66f8-4742-a6c6-8813b0a22c4e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:06.183129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:06.208467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:06.366528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d8103fb1-66f8-4742-a6c6-8813b0a22c4e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:06.378729 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d8103fb1-66f8-4742-a6c6-8813b0a22c4e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 0.411851 Jul 26 19:51:06.379317 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 986/1995] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:05 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:06.383980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7aac45b7-33f9-4309-8557-396c02bb6cba req-e37e9bf3-4212-49b3-ba38-b8afa929f38e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07761577-9bbe-4184-abd9-96ff9becd423", "tag": "83f3de90-e8f5-4e1e-9d60-d2a492302897"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:06.408605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7aac45b7-33f9-4309-8557-396c02bb6cba req-e37e9bf3-4212-49b3-ba38-b8afa929f38e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:06.412211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7aac45b7-33f9-4309-8557-396c02bb6cba req-e37e9bf3-4212-49b3-ba38-b8afa929f38e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:06.440946 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7aac45b7-33f9-4309-8557-396c02bb6cba req-e37e9bf3-4212-49b3-ba38-b8afa929f38e service nova] Creating event network-changed:83f3de90-e8f5-4e1e-9d60-d2a492302897 for instance 07761577-9bbe-4184-abd9-96ff9becd423 on n-h1-708768-8 Jul 26 19:51:06.446448 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7aac45b7-33f9-4309-8557-396c02bb6cba req-e37e9bf3-4212-49b3-ba38-b8afa929f38e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065732 Jul 26 19:51:06.449085 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 987/1996] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:06.461772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7254804-4ff1-47b2-b24e-6212ed55909e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:06.462510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7254804-4ff1-47b2-b24e-6212ed55909e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:06.477445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7254804-4ff1-47b2-b24e-6212ed55909e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:06.477903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7254804-4ff1-47b2-b24e-6212ed55909e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:06.478688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7254804-4ff1-47b2-b24e-6212ed55909e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:06.479328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7254804-4ff1-47b2-b24e-6212ed55909e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:06.502285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:06.520511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bab3aa8-cc45-4d40-ab09-df353f65460d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:06.530441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bab3aa8-cc45-4d40-ab09-df353f65460d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1359 microversion: 2.1 time: 0.683789 Jul 26 19:51:06.532967 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1010/1997] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:05 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1359 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:06.548098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f82b3fa0-b46c-478f-8df2-4c99c684edf9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:06.549549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f82b3fa0-b46c-478f-8df2-4c99c684edf9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:06.561257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f82b3fa0-b46c-478f-8df2-4c99c684edf9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:06.563307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f82b3fa0-b46c-478f-8df2-4c99c684edf9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:06.564862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f82b3fa0-b46c-478f-8df2-4c99c684edf9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:06.565492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f82b3fa0-b46c-478f-8df2-4c99c684edf9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:06.850799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=22 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:06.967079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7254804-4ff1-47b2-b24e-6212ed55909e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:07.003079 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7254804-4ff1-47b2-b24e-6212ed55909e tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1511 microversion: 2.1 time: 0.552547 Jul 26 19:51:07.005368 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 988/1998] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:06 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1511 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:07.012653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:07.013690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:07.050157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:07.051100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:07.052273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:07.053747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:07.094164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f82b3fa0-b46c-478f-8df2-4c99c684edf9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:07.105241 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f82b3fa0-b46c-478f-8df2-4c99c684edf9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 0.567448 Jul 26 19:51:07.107749 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1011/1999] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:06 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:07.121825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dd48f3a1-687d-48e9-9a45-f2eaa990a80a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:07.122745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dd48f3a1-687d-48e9-9a45-f2eaa990a80a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:07.146345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd48f3a1-687d-48e9-9a45-f2eaa990a80a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:07.147110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd48f3a1-687d-48e9-9a45-f2eaa990a80a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:07.148108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd48f3a1-687d-48e9-9a45-f2eaa990a80a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:07.148734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd48f3a1-687d-48e9-9a45-f2eaa990a80a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:07.476993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:07.508916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:07.511175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:07.512793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-908be21d-1864-4d6f-813a-c3b8f5eceb92 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1475 microversion: 2.25 time: 0.505442 Jul 26 19:51:07.515312 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 989/2000] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:07 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1475 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:07.528575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d692604d-f199-4ac3-b968-a168e04a0f0a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768419f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:07.605193 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d692604d-f199-4ac3-b968-a168e04a0f0a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.088379 Jul 26 19:51:07.605802 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 990/2001] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:07 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:07.614935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cf921b2-02a9-4c3f-a21d-8b2eee06e08b tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:07.615962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2cf921b2-02a9-4c3f-a21d-8b2eee06e08b tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:07.624482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cf921b2-02a9-4c3f-a21d-8b2eee06e08b tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:07.625177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cf921b2-02a9-4c3f-a21d-8b2eee06e08b tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:07.626261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cf921b2-02a9-4c3f-a21d-8b2eee06e08b tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:07.626874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cf921b2-02a9-4c3f-a21d-8b2eee06e08b tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:07.888784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cf921b2-02a9-4c3f-a21d-8b2eee06e08b tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:07.897638 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cf921b2-02a9-4c3f-a21d-8b2eee06e08b tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 0.290751 Jul 26 19:51:07.913704 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 991/2002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:07 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:07.930708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b3be9be5-63cd-4591-80d8-a17d4637a3ec req-ed09f795-ad50-4691-99a8-dda00b0f3b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400c42ab-aa78-434d-929d-9ee94f47440e", "name": "network-vif-deleted", "tag": "72281411-bd74-4ea2-be77-739ac2da2d6c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:07.961315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b3be9be5-63cd-4591-80d8-a17d4637a3ec req-ed09f795-ad50-4691-99a8-dda00b0f3b8e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:07.962976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b3be9be5-63cd-4591-80d8-a17d4637a3ec req-ed09f795-ad50-4691-99a8-dda00b0f3b8e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.004399 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b3be9be5-63cd-4591-80d8-a17d4637a3ec req-ed09f795-ad50-4691-99a8-dda00b0f3b8e service nova] Creating event network-vif-deleted:72281411-bd74-4ea2-be77-739ac2da2d6c for instance 400c42ab-aa78-434d-929d-9ee94f47440e on n-h1-708768-8 Jul 26 19:51:08.021436 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b3be9be5-63cd-4591-80d8-a17d4637a3ec req-ed09f795-ad50-4691-99a8-dda00b0f3b8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104500 Jul 26 19:51:08.023551 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 992/2003] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:08.237574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dd48f3a1-687d-48e9-9a45-f2eaa990a80a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abd3e457e042c3ba27040272c69ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3217b1b41e1e4274bc4442e54926f418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:08.249615 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dd48f3a1-687d-48e9-9a45-f2eaa990a80a tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 200 len: 1526 microversion: 2.1 time: 1.138098 Jul 26 19:51:08.250892 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1012/2004] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:07 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 1526 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:08.263919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9f852f50-6666-4c8a-81d7-b47f3a096b36 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:08.265680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9f852f50-6666-4c8a-81d7-b47f3a096b36 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:08.280728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f852f50-6666-4c8a-81d7-b47f3a096b36 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.281258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f852f50-6666-4c8a-81d7-b47f3a096b36 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.282336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f852f50-6666-4c8a-81d7-b47f3a096b36 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.282777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f852f50-6666-4c8a-81d7-b47f3a096b36 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.305183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-407ee7c1-643b-4f43-9c84-d3c2d45c56a8 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:08.305894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-407ee7c1-643b-4f43-9c84-d3c2d45c56a8 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:08.332012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-407ee7c1-643b-4f43-9c84-d3c2d45c56a8 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.335993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-407ee7c1-643b-4f43-9c84-d3c2d45c56a8 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.342080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-407ee7c1-643b-4f43-9c84-d3c2d45c56a8 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.344034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-407ee7c1-643b-4f43-9c84-d3c2d45c56a8 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.562869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-407ee7c1-643b-4f43-9c84-d3c2d45c56a8 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 47e730bb-a29a-4608-8c7a-37f0a157059a {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:51:08.582011 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-407ee7c1-643b-4f43-9c84-d3c2d45c56a8 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1967 microversion: 2.25 time: 0.556275 Jul 26 19:51:08.582611 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 993/2005] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:08 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1967 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:08.608885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f5a1f090-7819-46e3-997a-b42e39b0f768 req-79967936-a37d-4c29-830a-e24b18e0f431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96e47b7-d312-4d66-bd84-8cee85866b25", "name": "network-vif-plugged", "status": "completed", "tag": "4c2b7e2a-35c8-4f6c-87db-eb905b409fbb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:08.619467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9f852f50-6666-4c8a-81d7-b47f3a096b36 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:08.621117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f5a1f090-7819-46e3-997a-b42e39b0f768 req-79967936-a37d-4c29-830a-e24b18e0f431 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.621799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f5a1f090-7819-46e3-997a-b42e39b0f768 req-79967936-a37d-4c29-830a-e24b18e0f431 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.633647 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9f852f50-6666-4c8a-81d7-b47f3a096b36 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1359 microversion: 2.1 time: 0.380436 Jul 26 19:51:08.634241 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f5a1f090-7819-46e3-997a-b42e39b0f768 req-79967936-a37d-4c29-830a-e24b18e0f431 service nova] Creating event network-vif-plugged:4c2b7e2a-35c8-4f6c-87db-eb905b409fbb for instance a96e47b7-d312-4d66-bd84-8cee85866b25 on n-h1-708768-8 Jul 26 19:51:08.634554 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1013/2006] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:08 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1359 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:08.639286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:08.642724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:08.655874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f5a1f090-7819-46e3-997a-b42e39b0f768 req-79967936-a37d-4c29-830a-e24b18e0f431 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050885 Jul 26 19:51:08.657062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.657532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.658520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.658775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.659762 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 994/2007] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:08.670337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-30908682-b416-4920-b3da-7ddea4f32598 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:08.671220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-30908682-b416-4920-b3da-7ddea4f32598 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:08.685628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30908682-b416-4920-b3da-7ddea4f32598 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.686085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30908682-b416-4920-b3da-7ddea4f32598 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.687576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30908682-b416-4920-b3da-7ddea4f32598 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.688044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30908682-b416-4920-b3da-7ddea4f32598 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.724830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.726015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.727159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lazy-loading 'fault' on Instance uuid 400c42ab-aa78-434d-929d-9ee94f47440e {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:51:08.806481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a43ec29c9a4c2fa9be914dad198a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b107f91246c7434c82b02811d7b320d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:08.812157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:08.826744 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-816a9cf7-64ce-4c7c-830b-eaf843a2527d tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 200 len: 1306 microversion: 2.1 time: 0.190578 Jul 26 19:51:08.828989 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1014/2008] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:08 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:08.835949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f600df7c-1802-4bb6-bad1-7b3ac9cb3fce req-0f6c41d9-de3b-45cb-b51a-6eacdb2f4727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d006fe-7f67-4f51-9cb5-abb8917d2919", "name": "network-vif-deleted", "tag": "791555ea-01a2-4ab1-b0e3-0549bea46651"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:08.848918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f600df7c-1802-4bb6-bad1-7b3ac9cb3fce req-0f6c41d9-de3b-45cb-b51a-6eacdb2f4727 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.849552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f600df7c-1802-4bb6-bad1-7b3ac9cb3fce req-0f6c41d9-de3b-45cb-b51a-6eacdb2f4727 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.871640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f600df7c-1802-4bb6-bad1-7b3ac9cb3fce req-0f6c41d9-de3b-45cb-b51a-6eacdb2f4727 service nova] Creating event network-vif-deleted:791555ea-01a2-4ab1-b0e3-0549bea46651 for instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 on n-h2-708768-8 Jul 26 19:51:08.879024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f600df7c-1802-4bb6-bad1-7b3ac9cb3fce req-0f6c41d9-de3b-45cb-b51a-6eacdb2f4727 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048343 Jul 26 19:51:08.879661 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1015/2009] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:08.880250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-30908682-b416-4920-b3da-7ddea4f32598 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:08.884553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e1a88e0-94d8-4faa-8ef2-e813bd64be6c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:08.885459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2e1a88e0-94d8-4faa-8ef2-e813bd64be6c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:08.891458 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-30908682-b416-4920-b3da-7ddea4f32598 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 0.230103 Jul 26 19:51:08.893237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e1a88e0-94d8-4faa-8ef2-e813bd64be6c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.893693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e1a88e0-94d8-4faa-8ef2-e813bd64be6c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.893907 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 995/2010] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:08 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:08.900285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e1a88e0-94d8-4faa-8ef2-e813bd64be6c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.901805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e1a88e0-94d8-4faa-8ef2-e813bd64be6c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.904460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e000d83e-8364-45bb-b9e8-352053bc04e9 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756e04ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:08.963475 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e000d83e-8364-45bb-b9e8-352053bc04e9 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.068432 Jul 26 19:51:08.973207 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 996/2011] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:08 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:08.978926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ffafd3a7-4733-4d2a-b80f-59913c4c9848 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:08.979803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ffafd3a7-4733-4d2a-b80f-59913c4c9848 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:08.986670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffafd3a7-4733-4d2a-b80f-59913c4c9848 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.987505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffafd3a7-4733-4d2a-b80f-59913c4c9848 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:08.988502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffafd3a7-4733-4d2a-b80f-59913c4c9848 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:08.989122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffafd3a7-4733-4d2a-b80f-59913c4c9848 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:09.126607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-2e1a88e0-94d8-4faa-8ef2-e813bd64be6c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 47e730bb-a29a-4608-8c7a-37f0a157059a {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:51:09.143506 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e1a88e0-94d8-4faa-8ef2-e813bd64be6c tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1967 microversion: 2.25 time: 0.262645 Jul 26 19:51:09.144750 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1016/2012] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:08 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1967 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:09.170906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3d91db6b-e1db-444e-8853-b7a35d73bfe5 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:09.178370 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:51:09.178370 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:51:09.180216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d91db6b-e1db-444e-8853-b7a35d73bfe5 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:09.180897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d91db6b-e1db-444e-8853-b7a35d73bfe5 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:09.181959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d91db6b-e1db-444e-8853-b7a35d73bfe5 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:09.182618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d91db6b-e1db-444e-8853-b7a35d73bfe5 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:09.215288 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3d91db6b-e1db-444e-8853-b7a35d73bfe5 tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051528 Jul 26 19:51:09.216684 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1017/2013] 10.222.0.58 () {60 vars in 1217 bytes} [Tue Jul 26 19:51:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:51:09.236858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-708768-8", "block_migration": "auto"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:09.243160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:09.252328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:09.253115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:09.254435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:09.255288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:09.274960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ffafd3a7-4733-4d2a-b80f-59913c4c9848 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:09.278706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:09.284799 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ffafd3a7-4733-4d2a-b80f-59913c4c9848 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 0.310119 Jul 26 19:51:09.296011 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 997/2014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:08 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:09.303537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:09.304445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] [instance: d9d006fe-7f67-4f51-9cb5-abb8917d2919] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:09.305339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'flavor' on Instance uuid 47e730bb-a29a-4608-8c7a-37f0a157059a {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:51:09.311908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:09.312715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:09.313731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:09.314368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:09.330247 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] HTTP exception thrown: Instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 could not be found. Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Request method failure captured: Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 HTTP/1.1 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EWODdBMdDaQ__tt2goENaRGZuZzs-s-enPYDvd0VpOhMAjn61-h24NSkHI66aRu7uocAOVVV-5SVpQj7TIwme55NUyYxH01469I5d_UGaRLfTAlE8QkdtpJuWuHEvztT059EFrwxVV7GZciuau3OMgiHPq1z0i-KMLptWLQPSBlYg8 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 3217b1b41e1e4274bc4442e54926f418 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3217b1b41e1e4274bc4442e54926f418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217b1b41e1e4274bc4442e54926f418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3217b1b41e1e4274bc4442e54926f418", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3217b1b41e1e4274bc4442e54926f418"}]}] Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 3217b1b41e1e4274bc4442e54926f418 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-14916280 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerAddressesNegativeTestJSON-14916280-project Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5abd3e457e042c3ba27040272c69ce4 Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-14916280-project Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 could not be found. Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd9d006fe-7f67-4f51-9cb5-abb8917d2919'} Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 could not be found. Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 could not be found. Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:09.332259 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:09.336966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:09.336966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:09.336966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:09.336966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:09.336966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:09.336966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:09.336966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 could not be found. Jul 26 19:51:09.336966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:09.337675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Going to try to live migrate instance to n-h1-708768-8 {{(pid=125963) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:51:09.339450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] Returning 404 to user: Instance d9d006fe-7f67-4f51-9cb5-abb8917d2919 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:09.340575 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a8c32d7-66f1-40fe-a73a-6911982990a0 tempest-ServerAddressesNegativeTestJSON-14916280 tempest-ServerAddressesNegativeTestJSON-14916280-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919" status: 404 len: 111 microversion: 2.1 time: 0.043186 Jul 26 19:51:09.341668 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 998/2015] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:09 2022] GET /compute/v2.1/servers/d9d006fe-7f67-4f51-9cb5-abb8917d2919 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:09.658330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3cfbd575-7623-45fd-b59c-2f94312ca3e7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:09.658933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3cfbd575-7623-45fd-b59c-2f94312ca3e7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:09.674429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3cfbd575-7623-45fd-b59c-2f94312ca3e7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:09.675199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3cfbd575-7623-45fd-b59c-2f94312ca3e7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:09.676232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3cfbd575-7623-45fd-b59c-2f94312ca3e7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:09.679245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3cfbd575-7623-45fd-b59c-2f94312ca3e7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:10.720606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3cfbd575-7623-45fd-b59c-2f94312ca3e7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:10.730778 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3cfbd575-7623-45fd-b59c-2f94312ca3e7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1359 microversion: 2.1 time: 1.076439 Jul 26 19:51:10.747907 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 999/2016] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:09 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1359 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:10.764800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:10.765880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] [instance: 400c42ab-aa78-434d-929d-9ee94f47440e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:10.786554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:10.793226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:10.795007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:10.796372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:10.836651 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] HTTP exception thrown: Instance 400c42ab-aa78-434d-929d-9ee94f47440e could not be found. Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Request method failure captured: Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e HTTP/1.1 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EWFaBS0CJ6td6fCfvHdM3e96r7zrWkTml1SsnnhJIF1mKiLWE7ICcmAnV8NmM4jnksq4HqeoZvhwyDF73RwMDeD1tCmL6MkRxFFBVxSNmQVT4Zt2wI2OQdjsTKV5RpOC6WgPx5hGreOpctfBjJrVPacpyZDdIhWv_zO_AQsKK6JMIY Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: b107f91246c7434c82b02811d7b320d4 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerPasswordTestJSON-245889790 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b107f91246c7434c82b02811d7b320d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b107f91246c7434c82b02811d7b320d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b107f91246c7434c82b02811d7b320d4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b107f91246c7434c82b02811d7b320d4"}]}] Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerPasswordTestJSON-245889790 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: b107f91246c7434c82b02811d7b320d4 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerPasswordTestJSON-245889790 Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerPasswordTestJSON-245889790-project Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 66a43ec29c9a4c2fa9be914dad198a0f Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerPasswordTestJSON-245889790-project Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 400c42ab-aa78-434d-929d-9ee94f47440e could not be found. Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '400c42ab-aa78-434d-929d-9ee94f47440e'} Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400c42ab-aa78-434d-929d-9ee94f47440e could not be found. Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400c42ab-aa78-434d-929d-9ee94f47440e could not be found. Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:10.841371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:10.846666 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:10.846666 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:10.846666 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:10.846666 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:10.846666 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:10.846666 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400c42ab-aa78-434d-929d-9ee94f47440e could not be found. Jul 26 19:51:10.846666 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:10.846666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] Returning 404 to user: Instance 400c42ab-aa78-434d-929d-9ee94f47440e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:10.849178 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74156c5c-7a35-4cfe-8f27-52845c126ea2 tempest-ServerPasswordTestJSON-245889790 tempest-ServerPasswordTestJSON-245889790-project] 10.222.0.58 "GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e" status: 404 len: 111 microversion: 2.1 time: 0.099307 Jul 26 19:51:10.849766 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1000/2017] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:10 2022] GET /compute/v2.1/servers/400c42ab-aa78-434d-929d-9ee94f47440e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:10.866799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ec12eae-d319-40cd-9eeb-cb46cae63f89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:10.867426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ec12eae-d319-40cd-9eeb-cb46cae63f89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:10.895339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ec12eae-d319-40cd-9eeb-cb46cae63f89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:10.895952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ec12eae-d319-40cd-9eeb-cb46cae63f89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:10.896747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ec12eae-d319-40cd-9eeb-cb46cae63f89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:10.897189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ec12eae-d319-40cd-9eeb-cb46cae63f89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:11.410740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ec12eae-d319-40cd-9eeb-cb46cae63f89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:11.423211 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ec12eae-d319-40cd-9eeb-cb46cae63f89 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 0.569767 Jul 26 19:51:11.426403 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1001/2018] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:10 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:11.435805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b2af27b-c053-463e-b3ce-94607ea36bcb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768411280>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:11.510730 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b2af27b-c053-463e-b3ce-94607ea36bcb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.082964 Jul 26 19:51:11.514215 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1002/2019] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:11 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:11.526309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3a9aabcc-b150-4ac5-a2c2-ee87876523ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:11.527065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3a9aabcc-b150-4ac5-a2c2-ee87876523ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:11.587811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a9aabcc-b150-4ac5-a2c2-ee87876523ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:11.588397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a9aabcc-b150-4ac5-a2c2-ee87876523ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:11.589241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a9aabcc-b150-4ac5-a2c2-ee87876523ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:11.605053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a9aabcc-b150-4ac5-a2c2-ee87876523ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:12.563819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3a9aabcc-b150-4ac5-a2c2-ee87876523ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:12.577544 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3a9aabcc-b150-4ac5-a2c2-ee87876523ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 1.060701 Jul 26 19:51:12.581524 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1003/2020] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:11 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:12.604871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d29086c1-d77d-4fab-bd3b-4e98b10c50cf tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:12.609891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d29086c1-d77d-4fab-bd3b-4e98b10c50cf tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:12.633288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d29086c1-d77d-4fab-bd3b-4e98b10c50cf tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:12.638749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d29086c1-d77d-4fab-bd3b-4e98b10c50cf tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:12.645184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d29086c1-d77d-4fab-bd3b-4e98b10c50cf tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:12.645981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d29086c1-d77d-4fab-bd3b-4e98b10c50cf tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:12.982469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d29086c1-d77d-4fab-bd3b-4e98b10c50cf tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:12.996797 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d29086c1-d77d-4fab-bd3b-4e98b10c50cf tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1543 microversion: 2.1 time: 0.410901 Jul 26 19:51:13.001379 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1004/2021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:12 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1543 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:13.016378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fd6f131a-48b6-43a6-b222-bfe7394a28e6 req-3e4596d0-aad1-4c3e-b286-48aff30f7c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7590d85-2a5f-4738-b35c-7958afa834a1", "name": "network-vif-plugged", "status": "completed", "tag": "5ede25db-702f-4589-b58b-60c96d75d1a8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:13.066215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fd6f131a-48b6-43a6-b222-bfe7394a28e6 req-3e4596d0-aad1-4c3e-b286-48aff30f7c61 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:13.066664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fd6f131a-48b6-43a6-b222-bfe7394a28e6 req-3e4596d0-aad1-4c3e-b286-48aff30f7c61 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:13.123466 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fd6f131a-48b6-43a6-b222-bfe7394a28e6 req-3e4596d0-aad1-4c3e-b286-48aff30f7c61 service nova] Creating event network-vif-plugged:5ede25db-702f-4589-b58b-60c96d75d1a8 for instance b7590d85-2a5f-4738-b35c-7958afa834a1 on n-h1-708768-8 Jul 26 19:51:13.166350 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fd6f131a-48b6-43a6-b222-bfe7394a28e6 req-3e4596d0-aad1-4c3e-b286-48aff30f7c61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155898 Jul 26 19:51:13.167176 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1005/2022] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:13.183172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc053a24-2a44-4bc6-a627-723251b1cee0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:13.188543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fc053a24-2a44-4bc6-a627-723251b1cee0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:13.206858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc053a24-2a44-4bc6-a627-723251b1cee0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:13.209821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc053a24-2a44-4bc6-a627-723251b1cee0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:13.212813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc053a24-2a44-4bc6-a627-723251b1cee0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:13.220175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc053a24-2a44-4bc6-a627-723251b1cee0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:13.767683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fc053a24-2a44-4bc6-a627-723251b1cee0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:13.786258 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc053a24-2a44-4bc6-a627-723251b1cee0 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 0.617924 Jul 26 19:51:13.787593 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1006/2023] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:13 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:13.810784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c658511-a24d-4370-8e07-55b65d975d12 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683c9040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:13.928305 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c658511-a24d-4370-8e07-55b65d975d12 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.131999 Jul 26 19:51:13.937221 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1007/2024] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:13 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:13.948470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-92466f63-224d-4cd7-9b74-814b3bc4f0eb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:13.949110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92466f63-224d-4cd7-9b74-814b3bc4f0eb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:13.968918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92466f63-224d-4cd7-9b74-814b3bc4f0eb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:13.969576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92466f63-224d-4cd7-9b74-814b3bc4f0eb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:13.970505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92466f63-224d-4cd7-9b74-814b3bc4f0eb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:13.971094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92466f63-224d-4cd7-9b74-814b3bc4f0eb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:14.168974 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-92466f63-224d-4cd7-9b74-814b3bc4f0eb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230451 Jul 26 19:51:14.169757 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1008/2025] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:51:13 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:14.175468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-55cf6fc8-5730-4c03-b312-237abad9cb8f tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:14.176501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-55cf6fc8-5730-4c03-b312-237abad9cb8f tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:14.193361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55cf6fc8-5730-4c03-b312-237abad9cb8f tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:14.194220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55cf6fc8-5730-4c03-b312-237abad9cb8f tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:14.195256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55cf6fc8-5730-4c03-b312-237abad9cb8f tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:14.195984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55cf6fc8-5730-4c03-b312-237abad9cb8f tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:14.602353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-55cf6fc8-5730-4c03-b312-237abad9cb8f tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:14.611275 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-55cf6fc8-5730-4c03-b312-237abad9cb8f tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1350 microversion: 2.1 time: 0.439430 Jul 26 19:51:14.623103 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1009/2026] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:14 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1350 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:14.811908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f544ec5-be3b-4b09-8ca4-dfd7aab124f3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:14.813224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f544ec5-be3b-4b09-8ca4-dfd7aab124f3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:14.815944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:14.835526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f544ec5-be3b-4b09-8ca4-dfd7aab124f3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:14.851802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f544ec5-be3b-4b09-8ca4-dfd7aab124f3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:14.852893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f544ec5-be3b-4b09-8ca4-dfd7aab124f3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:14.853537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f544ec5-be3b-4b09-8ca4-dfd7aab124f3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:14.924789 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32c6efa6-ba31-4223-8999-711c42651f3e tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a/action" status: 202 len: 0 microversion: 2.25 time: 5.699186 Jul 26 19:51:14.925731 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1018/2027] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 19:51:09 2022] POST /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a/action => generated 0 bytes in 5701 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:51:14.934572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:14.939753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:14.966166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:14.973544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:14.974723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:14.977090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:15.492255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:15.501770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:15.504098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:15.505884 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e033c78-1789-4e42-a81d-8b1ffd19ac3c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.576007 Jul 26 19:51:15.507009 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1019/2028] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:14 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:51:15.512104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-969c61de-1673-4d84-a45d-f710b2e9b72c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683f54c0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:15.581548 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-969c61de-1673-4d84-a45d-f710b2e9b72c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.071340 Jul 26 19:51:15.582335 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1020/2029] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:15 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:15.587301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-40976718-1b7a-4ed3-9989-a79766f4f453 req-a647bd32-f929-40b7-8c15-543474554e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07761577-9bbe-4184-abd9-96ff9becd423", "name": "network-vif-plugged", "status": "completed", "tag": "83f3de90-e8f5-4e1e-9d60-d2a492302897"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:15.615588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-40976718-1b7a-4ed3-9989-a79766f4f453 req-a647bd32-f929-40b7-8c15-543474554e1d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:15.618962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-40976718-1b7a-4ed3-9989-a79766f4f453 req-a647bd32-f929-40b7-8c15-543474554e1d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:15.650218 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-40976718-1b7a-4ed3-9989-a79766f4f453 req-a647bd32-f929-40b7-8c15-543474554e1d service nova] Creating event network-vif-plugged:83f3de90-e8f5-4e1e-9d60-d2a492302897 for instance 07761577-9bbe-4184-abd9-96ff9becd423 on n-h1-708768-8 Jul 26 19:51:15.656771 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-40976718-1b7a-4ed3-9989-a79766f4f453 req-a647bd32-f929-40b7-8c15-543474554e1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072683 Jul 26 19:51:15.662115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1021/2030] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:15.672104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-34e0aac1-993f-440e-a052-88858214ae3e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:15.676363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-34e0aac1-993f-440e-a052-88858214ae3e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:15.689901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34e0aac1-993f-440e-a052-88858214ae3e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:15.690741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34e0aac1-993f-440e-a052-88858214ae3e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:15.693579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34e0aac1-993f-440e-a052-88858214ae3e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:15.698500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34e0aac1-993f-440e-a052-88858214ae3e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:16.237002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f544ec5-be3b-4b09-8ca4-dfd7aab124f3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:16.255440 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f544ec5-be3b-4b09-8ca4-dfd7aab124f3 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 1.447636 Jul 26 19:51:16.257587 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1010/2031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:14 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:16.533316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:16.534393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:16.554192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:16.556010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:16.557246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:16.559243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:16.928835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:16.945815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:16.956840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:16.960691 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe1a1574-284c-49d1-b8a1-83d5e92da9e0 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.433625 Jul 26 19:51:16.964631 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1011/2032] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:16 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:16.982379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a96bbfed-fec3-49a8-8c63-5db9a41b9401 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756cfa1f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:17.107589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-34e0aac1-993f-440e-a052-88858214ae3e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:17.111066 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a96bbfed-fec3-49a8-8c63-5db9a41b9401 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.144520 Jul 26 19:51:17.111792 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1012/2033] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:16 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:17.130859 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-34e0aac1-993f-440e-a052-88858214ae3e tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1540 microversion: 2.1 time: 1.466844 Jul 26 19:51:17.132029 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1022/2034] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:15 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1540 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:17.152930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa1f3722-1fb1-4d1f-9a39-99e6518377ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:17.153372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa1f3722-1fb1-4d1f-9a39-99e6518377ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:17.184307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa1f3722-1fb1-4d1f-9a39-99e6518377ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:17.184771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa1f3722-1fb1-4d1f-9a39-99e6518377ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:17.185813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa1f3722-1fb1-4d1f-9a39-99e6518377ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:17.186931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa1f3722-1fb1-4d1f-9a39-99e6518377ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:17.282656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e314697-b75b-4b60-84c8-ab624fe2a298 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:17.287011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e314697-b75b-4b60-84c8-ab624fe2a298 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:17.303687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e314697-b75b-4b60-84c8-ab624fe2a298 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:17.306332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e314697-b75b-4b60-84c8-ab624fe2a298 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:17.321950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e314697-b75b-4b60-84c8-ab624fe2a298 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:17.323352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e314697-b75b-4b60-84c8-ab624fe2a298 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:17.437501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa1f3722-1fb1-4d1f-9a39-99e6518377ed tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.288847 Jul 26 19:51:17.438865 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1013/2035] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:51:17 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:17.991459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:17.992257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:18.006671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:18.007133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:18.012172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:18.013065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:18.388193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:18.410604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:18.412672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:18.414187 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a3f2db41-4a2f-4908-b36b-aa4e78cb4ff9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.427671 Jul 26 19:51:18.415990 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1014/2036] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:17 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:51:18.431936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eea37867-eaa5-4b30-b89b-98232e7f6004 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87684038b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:18.550909 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eea37867-eaa5-4b30-b89b-98232e7f6004 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.133623 Jul 26 19:51:18.560012 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1015/2037] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:18 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:18.640786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e314697-b75b-4b60-84c8-ab624fe2a298 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:18.660767 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e314697-b75b-4b60-84c8-ab624fe2a298 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1315 microversion: 2.1 time: 1.385514 Jul 26 19:51:18.666529 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1023/2038] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:17 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1315 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:19.489042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:19.490760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:19.525595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:19.526480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:19.527520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:19.528321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:19.567394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38b0d78e-619a-4885-8e12-97ab946d4c0f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f876843d790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:19.581300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:19.696334 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-38b0d78e-619a-4885-8e12-97ab946d4c0f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.133921 Jul 26 19:51:19.707046 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1024/2039] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:19 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:19.715752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e44a05f5-46e8-49da-bdcb-d1f0ed849fc7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:19.716385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e44a05f5-46e8-49da-bdcb-d1f0ed849fc7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:19.737469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e44a05f5-46e8-49da-bdcb-d1f0ed849fc7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:19.737934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e44a05f5-46e8-49da-bdcb-d1f0ed849fc7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:19.743863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e44a05f5-46e8-49da-bdcb-d1f0ed849fc7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:19.744425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e44a05f5-46e8-49da-bdcb-d1f0ed849fc7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:20.434831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:20.463495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:20.469383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:20.472213 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06cf6b8a-3799-453e-95c6-65411e3a2aaa tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 1.029335 Jul 26 19:51:20.474143 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1016/2040] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:19 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:20.487157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fa29a621-78f9-47f6-b55d-d54a74242f68 req-e429287a-2f9f-444a-a7a3-45f4c373a1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96e47b7-d312-4d66-bd84-8cee85866b25", "tag": "4c2b7e2a-35c8-4f6c-87db-eb905b409fbb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:20.516347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fa29a621-78f9-47f6-b55d-d54a74242f68 req-e429287a-2f9f-444a-a7a3-45f4c373a1b1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:20.517033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fa29a621-78f9-47f6-b55d-d54a74242f68 req-e429287a-2f9f-444a-a7a3-45f4c373a1b1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:20.545054 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fa29a621-78f9-47f6-b55d-d54a74242f68 req-e429287a-2f9f-444a-a7a3-45f4c373a1b1 service nova] Creating event network-changed:4c2b7e2a-35c8-4f6c-87db-eb905b409fbb for instance a96e47b7-d312-4d66-bd84-8cee85866b25 on n-h1-708768-8 Jul 26 19:51:20.560840 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fa29a621-78f9-47f6-b55d-d54a74242f68 req-e429287a-2f9f-444a-a7a3-45f4c373a1b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082086 Jul 26 19:51:20.563911 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1017/2041] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:20.712875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74aabb33-e32b-40f1-a706-baca10056a35 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756e04ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:20.803007 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74aabb33-e32b-40f1-a706-baca10056a35 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1455 microversion: 2.1 time: 0.094776 Jul 26 19:51:20.804188 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1018/2042] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:20 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:21.501652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:21.502413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:21.524381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:21.530146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:21.533743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:21.534356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:21.635651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e44a05f5-46e8-49da-bdcb-d1f0ed849fc7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:21.647561 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e44a05f5-46e8-49da-bdcb-d1f0ed849fc7 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1501 microversion: 2.1 time: 1.939316 Jul 26 19:51:21.652620 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1025/2043] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:19 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1501 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:21.673742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e448d914-ae3b-4f9c-8204-308200525849 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:21.674596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e448d914-ae3b-4f9c-8204-308200525849 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:21.685475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e448d914-ae3b-4f9c-8204-308200525849 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:21.686189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e448d914-ae3b-4f9c-8204-308200525849 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:21.688520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e448d914-ae3b-4f9c-8204-308200525849 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:21.689170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e448d914-ae3b-4f9c-8204-308200525849 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:21.751228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-e448d914-ae3b-4f9c-8204-308200525849 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lazy-loading 'flavor' on Instance uuid 07761577-9bbe-4184-abd9-96ff9becd423 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:51:21.899341 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e448d914-ae3b-4f9c-8204-308200525849 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "POST /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423/action" status: 202 len: 0 microversion: 2.1 time: 0.230286 Jul 26 19:51:21.900369 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1026/2044] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:51:21 2022] POST /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:51:21.910980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a304071-08fd-48f8-a240-cbdc8f82aab1 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768385940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:21.979178 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a304071-08fd-48f8-a240-cbdc8f82aab1 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1464 microversion: 2.1 time: 0.077245 Jul 26 19:51:21.980659 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1027/2045] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:21 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1464 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:21.987274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c97f73fc-8fc3-4f02-8328-193439cb03aa tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:21.989405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c97f73fc-8fc3-4f02-8328-193439cb03aa tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:22.005614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c97f73fc-8fc3-4f02-8328-193439cb03aa tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:22.006624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c97f73fc-8fc3-4f02-8328-193439cb03aa tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:22.008126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c97f73fc-8fc3-4f02-8328-193439cb03aa tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:22.009172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c97f73fc-8fc3-4f02-8328-193439cb03aa tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:22.058423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:22.068020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:22.069800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:22.071205 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65f4e815-d5a1-43ff-8327-fff20d450011 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.573674 Jul 26 19:51:22.072361 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1019/2046] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:21 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:22.081210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e64f9be0-35f0-4939-a82c-a627b2df8924 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683ec790>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:22.149690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e64f9be0-35f0-4939-a82c-a627b2df8924 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 200 len: 1464 microversion: 2.1 time: 0.075960 Jul 26 19:51:22.150453 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1020/2047] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:22 2022] GET /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 1464 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:22.164384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2c5dd7c-5619-4aab-b209-4b7cc3367784 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:22.165237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f2c5dd7c-5619-4aab-b209-4b7cc3367784 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:22.174501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2c5dd7c-5619-4aab-b209-4b7cc3367784 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:22.175194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2c5dd7c-5619-4aab-b209-4b7cc3367784 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:22.176280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2c5dd7c-5619-4aab-b209-4b7cc3367784 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:22.176910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2c5dd7c-5619-4aab-b209-4b7cc3367784 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:22.454339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f2c5dd7c-5619-4aab-b209-4b7cc3367784 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:22.466687 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f2c5dd7c-5619-4aab-b209-4b7cc3367784 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 200 len: 1467 microversion: 2.1 time: 0.306082 Jul 26 19:51:22.489338 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1021/2048] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:22 2022] GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:22.502958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-202d919b-1439-4fae-9451-a1d8a614f4f3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1894868"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:22.506882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-202d919b-1439-4fae-9451-a1d8a614f4f3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:22.514566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202d919b-1439-4fae-9451-a1d8a614f4f3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:22.515664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202d919b-1439-4fae-9451-a1d8a614f4f3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:22.516599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202d919b-1439-4fae-9451-a1d8a614f4f3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:22.517200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202d919b-1439-4fae-9451-a1d8a614f4f3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:22.593840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c97f73fc-8fc3-4f02-8328-193439cb03aa tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:22.603086 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c97f73fc-8fc3-4f02-8328-193439cb03aa tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1509 microversion: 2.1 time: 0.621127 Jul 26 19:51:22.620561 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1028/2049] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:21 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1509 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:22.812676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:22.858820 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-202d919b-1439-4fae-9451-a1d8a614f4f3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "POST /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.360778 Jul 26 19:51:22.858820 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1022/2050] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:51:22 2022] POST /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 19:51:22.868413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73265ba4-f305-4097-a20c-171d860a705a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e9534c0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:22.899476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2d7db6ae-fec9-468c-a48f-525e049efbf9 req-a8787826-08d6-4fc3-b86e-c25038c78911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7590d85-2a5f-4738-b35c-7958afa834a1", "tag": "5ede25db-702f-4589-b58b-60c96d75d1a8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:22.924636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2d7db6ae-fec9-468c-a48f-525e049efbf9 req-a8787826-08d6-4fc3-b86e-c25038c78911 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:22.925089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2d7db6ae-fec9-468c-a48f-525e049efbf9 req-a8787826-08d6-4fc3-b86e-c25038c78911 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:22.930504 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73265ba4-f305-4097-a20c-171d860a705a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.065949 Jul 26 19:51:22.931099 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1029/2051] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:22 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:22.942784 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2d7db6ae-fec9-468c-a48f-525e049efbf9 req-a8787826-08d6-4fc3-b86e-c25038c78911 service nova] Creating event network-changed:5ede25db-702f-4589-b58b-60c96d75d1a8 for instance b7590d85-2a5f-4738-b35c-7958afa834a1 on n-h1-708768-8 Jul 26 19:51:22.951067 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2d7db6ae-fec9-468c-a48f-525e049efbf9 req-a8787826-08d6-4fc3-b86e-c25038c78911 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056865 Jul 26 19:51:22.952274 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1023/2052] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:51:23.097428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:23.098113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:23.127213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:23.140075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:23.141627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:23.142082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:23.634253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1ac2d2dd-2f08-4ce2-b9f1-20a9f831754c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:23.635102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1ac2d2dd-2f08-4ce2-b9f1-20a9f831754c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:23.657330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ac2d2dd-2f08-4ce2-b9f1-20a9f831754c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:23.657792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ac2d2dd-2f08-4ce2-b9f1-20a9f831754c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:23.658589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ac2d2dd-2f08-4ce2-b9f1-20a9f831754c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:23.659032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ac2d2dd-2f08-4ce2-b9f1-20a9f831754c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:23.721026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:23.734879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:23.737589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:23.744670 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8a26ab01-b213-4d9a-868a-7037758a36da tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.653415 Jul 26 19:51:23.745828 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1030/2053] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:23 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:23.947541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1428bff0-3467-4b70-af59-dc5132e39266 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683e5f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:24.047806 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1428bff0-3467-4b70-af59-dc5132e39266 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.105254 Jul 26 19:51:24.049730 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1031/2054] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:23 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:24.212087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ac2d2dd-2f08-4ce2-b9f1-20a9f831754c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:24.225211 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1ac2d2dd-2f08-4ce2-b9f1-20a9f831754c tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1492 microversion: 2.1 time: 0.597642 Jul 26 19:51:24.227091 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1024/2055] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:23 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1492 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:24.253562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6d40c127-810a-4a09-b228-bf63dffc600a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:24.255045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6d40c127-810a-4a09-b228-bf63dffc600a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:24.268753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d40c127-810a-4a09-b228-bf63dffc600a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:24.270456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d40c127-810a-4a09-b228-bf63dffc600a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:24.271419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d40c127-810a-4a09-b228-bf63dffc600a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:24.274085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d40c127-810a-4a09-b228-bf63dffc600a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:24.346756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6d40c127-810a-4a09-b228-bf63dffc600a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:51:24.467123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:24.533743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:24.538999 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6d40c127-810a-4a09-b228-bf63dffc600a tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 204 len: 0 microversion: 2.1 time: 0.295511 Jul 26 19:51:24.556683 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1032/2056] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:24 2022] DELETE /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:51:24.563983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7812ec15-5f64-4b7b-a8a9-b23e8ea8b226 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:24.564813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7812ec15-5f64-4b7b-a8a9-b23e8ea8b226 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:24.584375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7812ec15-5f64-4b7b-a8a9-b23e8ea8b226 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:24.585527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7812ec15-5f64-4b7b-a8a9-b23e8ea8b226 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:24.586317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7812ec15-5f64-4b7b-a8a9-b23e8ea8b226 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:24.589544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7812ec15-5f64-4b7b-a8a9-b23e8ea8b226 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:24.775261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:24.776160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:24.801611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:24.802522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:24.802865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:24.804649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:24.887471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7812ec15-5f64-4b7b-a8a9-b23e8ea8b226 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:24.897374 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7812ec15-5f64-4b7b-a8a9-b23e8ea8b226 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1498 microversion: 2.1 time: 0.339437 Jul 26 19:51:24.901172 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1025/2057] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:24 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1498 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:25.072199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57691020-84fd-4699-b530-0ce7ce4497de tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87684113a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:25.142562 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-57691020-84fd-4699-b530-0ce7ce4497de tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.082409 Jul 26 19:51:25.144627 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1026/2058] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:25 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:25.363474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-575c3606-e4e3-4194-a8af-28107293d1fa req-f2e2d383-4468-4630-9139-ce37cb9cb72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f8c415-4c1d-4e8c-b3a6-2b1f20db3207", "name": "network-vif-unplugged", "status": "completed", "tag": "6a23c3cf-1752-438a-abe4-d9745485a1b1"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:25.387639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-575c3606-e4e3-4194-a8af-28107293d1fa req-f2e2d383-4468-4630-9139-ce37cb9cb72f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:25.392012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-575c3606-e4e3-4194-a8af-28107293d1fa req-f2e2d383-4468-4630-9139-ce37cb9cb72f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:25.422491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-575c3606-e4e3-4194-a8af-28107293d1fa req-f2e2d383-4468-4630-9139-ce37cb9cb72f service nova] Creating event network-vif-unplugged:6a23c3cf-1752-438a-abe4-d9745485a1b1 for instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 on n-h1-708768-8 Jul 26 19:51:25.431692 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-575c3606-e4e3-4194-a8af-28107293d1fa req-f2e2d383-4468-4630-9139-ce37cb9cb72f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073167 Jul 26 19:51:25.436034 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1027/2059] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:25.519743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:25.530556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:25.533324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:25.542833 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a7f05e56-b054-44fd-8618-28f3926992e7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.768768 Jul 26 19:51:25.548424 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1033/2060] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:24 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:25.921128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e53a3726-c6cd-45e1-9942-f9c91b0e0145 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:25.922283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e53a3726-c6cd-45e1-9942-f9c91b0e0145 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:25.954132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e53a3726-c6cd-45e1-9942-f9c91b0e0145 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:25.954983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e53a3726-c6cd-45e1-9942-f9c91b0e0145 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:25.960692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e53a3726-c6cd-45e1-9942-f9c91b0e0145 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:25.961464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e53a3726-c6cd-45e1-9942-f9c91b0e0145 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:26.165186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b42dbcd6-b894-4f95-adb7-b0a21ff6bc24 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f876843dee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:26.245842 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b42dbcd6-b894-4f95-adb7-b0a21ff6bc24 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.089830 Jul 26 19:51:26.256579 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1034/2061] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:26 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:26.574595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:26.576063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:26.584311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e53a3726-c6cd-45e1-9942-f9c91b0e0145 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:26.596868 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e53a3726-c6cd-45e1-9942-f9c91b0e0145 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1498 microversion: 2.1 time: 0.681718 Jul 26 19:51:26.605079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:26.605766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:26.611945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:26.612547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:26.613019 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1028/2062] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:25 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1498 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:27.098695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:27.117491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:27.119429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:27.120954 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4437f260-9ca4-4cb5-8d63-968ae2e78787 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.551374 Jul 26 19:51:27.122735 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1035/2063] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:26 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:51:27.262464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d80dc79e-ff25-4f16-8586-e523b4153606 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768411af0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:27.348752 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d80dc79e-ff25-4f16-8586-e523b4153606 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.090278 Jul 26 19:51:27.351250 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1029/2064] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:27 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:27.521857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6565db7f-6b34-4c50-ba2d-a55680949e8c req-859c4e13-d779-4d53-a28f-1bd8b09ca6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07761577-9bbe-4184-abd9-96ff9becd423", "name": "network-vif-deleted", "tag": "83f3de90-e8f5-4e1e-9d60-d2a492302897"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:27.548920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6565db7f-6b34-4c50-ba2d-a55680949e8c req-859c4e13-d779-4d53-a28f-1bd8b09ca6d6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:27.552268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6565db7f-6b34-4c50-ba2d-a55680949e8c req-859c4e13-d779-4d53-a28f-1bd8b09ca6d6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:27.586151 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6565db7f-6b34-4c50-ba2d-a55680949e8c req-859c4e13-d779-4d53-a28f-1bd8b09ca6d6 service nova] Creating event network-vif-deleted:83f3de90-e8f5-4e1e-9d60-d2a492302897 for instance 07761577-9bbe-4184-abd9-96ff9becd423 on n-h1-708768-8 Jul 26 19:51:27.600991 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6565db7f-6b34-4c50-ba2d-a55680949e8c req-859c4e13-d779-4d53-a28f-1bd8b09ca6d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081760 Jul 26 19:51:27.604773 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1036/2065] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:27.635891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-19f296ae-85ea-4664-9158-396d5384b3b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:27.640565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-19f296ae-85ea-4664-9158-396d5384b3b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:27.679801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19f296ae-85ea-4664-9158-396d5384b3b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:27.682111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19f296ae-85ea-4664-9158-396d5384b3b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:27.687420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19f296ae-85ea-4664-9158-396d5384b3b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:27.692198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19f296ae-85ea-4664-9158-396d5384b3b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:28.041277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-19f296ae-85ea-4664-9158-396d5384b3b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8808ff2c4341eca66334700ec25a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913c0fd2d4ec40af912b139762716033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:28.050858 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-19f296ae-85ea-4664-9158-396d5384b3b9 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 200 len: 1291 microversion: 2.1 time: 0.430089 Jul 26 19:51:28.054241 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1030/2066] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:27 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 1291 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:28.147973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:28.148674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:28.156893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:28.157337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:28.160060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:28.160513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:28.366774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-918ef931-14cd-4993-8a6a-9532d23795a9 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756ce9b80>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:28.460156 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-918ef931-14cd-4993-8a6a-9532d23795a9 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.098612 Jul 26 19:51:28.460809 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1031/2067] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:28 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:28.652535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:28.680601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:28.683375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:28.688005 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-33e07131-677f-47ce-879b-02a736fa20f3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.543792 Jul 26 19:51:28.700862 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1037/2068] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:28 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:29.821134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1984547145", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "07bc5316-7c4a-4225-9806-6105d63a8afa"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:29.842933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:29.844134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:29.861386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:29.862287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:29.863312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:29.863900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:29.885913 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 HTTP/1.1 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '07761577-9bbe-4184-abd9-96ff9becd423'} Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:29.887825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:29.891710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:29.891710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:29.891710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:29.891710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:29.891710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:29.891710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:29.891710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:29.897070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:29.898269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-648f7bb5-a1cf-43c2-96e5-3636dd503484 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 404 len: 111 microversion: 2.1 time: 0.821572 Jul 26 19:51:29.899149 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1032/2069] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:29 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 111 bytes in 824 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:29.911173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b29545e5-16f1-435e-963c-517a581e1293 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768425820>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:30.055139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] validate_networks() for [('07bc5316-7c4a-4225-9806-6105d63a8afa', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:51:30.076096 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b29545e5-16f1-435e-963c-517a581e1293 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.174447 Jul 26 19:51:30.078115 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1033/2070] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:29 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:30.085335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:30.088847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:30.110961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:30.111690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:30.112950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:30.113635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:30.593543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:30.605117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:30.606878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:30.608134 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-10ca99c0-26a1-40ba-9623-39366d7ece1d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.528876 Jul 26 19:51:30.608694 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1034/2071] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:30 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:30.621961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:30.622722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:30.651342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:30.651830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:30.661632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:30.662242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:30.727414 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 HTTP/1.1 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '07761577-9bbe-4184-abd9-96ff9becd423'} Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:30.734793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.738576 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.743025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:30.744085 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1745d3b-58b6-44d8-98c6-1d42f5971e96 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 404 len: 111 microversion: 2.1 time: 0.134355 Jul 26 19:51:30.755924 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1035/2072] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:30 2022] DELETE /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:30.776765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-dedc5d4e-53dc-4941-9c0f-e74078bb9de8 req-42804b96-5179-4b16-8485-1756e7a8fb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc24d0ee-65ce-4620-a3b2-263af9715a2e", "name": "network-vif-plugged", "status": "completed", "tag": "86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:30.850624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-dedc5d4e-53dc-4941-9c0f-e74078bb9de8 req-42804b96-5179-4b16-8485-1756e7a8fb0b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:30.851300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-dedc5d4e-53dc-4941-9c0f-e74078bb9de8 req-42804b96-5179-4b16-8485-1756e7a8fb0b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:30.888681 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-dedc5d4e-53dc-4941-9c0f-e74078bb9de8 req-42804b96-5179-4b16-8485-1756e7a8fb0b service nova] Creating event network-vif-plugged:86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8 for instance cc24d0ee-65ce-4620-a3b2-263af9715a2e on n-h2-708768-8 Jul 26 19:51:30.901893 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-dedc5d4e-53dc-4941-9c0f-e74078bb9de8 req-42804b96-5179-4b16-8485-1756e7a8fb0b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142201 Jul 26 19:51:30.902723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1036/2073] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:30.921649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:30.923586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 07761577-9bbe-4184-abd9-96ff9becd423] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:30.943497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:30.943988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:30.944794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:30.945264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:30.988601 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 HTTP/1.1 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '07761577-9bbe-4184-abd9-96ff9becd423'} Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:30.990526 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.994194 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:30.994194 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:30.994194 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:30.994194 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:30.994194 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:30.994194 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. Jul 26 19:51:30.994194 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:30.996578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 07761577-9bbe-4184-abd9-96ff9becd423 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:30.997793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c84c300b-085b-47ab-9f07-231cf5d6b102 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423" status: 404 len: 111 microversion: 2.1 time: 0.089211 Jul 26 19:51:30.998587 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1037/2074] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:30 2022] GET /compute/v2.1/servers/07761577-9bbe-4184-abd9-96ff9becd423 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:31.007963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:31.008626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:31.016023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:31.016703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:31.018143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:31.018729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:31.061336 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 HTTP/1.1 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009'} Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:31.077966 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.081767 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.088792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:31.092497 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ee52cd90-825d-4a8c-8479-39cfc8e2d8b6 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 404 len: 111 microversion: 2.1 time: 0.088840 Jul 26 19:51:31.101157 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1038/2075] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:31 2022] DELETE /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:31.128317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-94de5952-3da7-48c0-9205-e0555d4955ef tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768403310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:31.273895 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-94de5952-3da7-48c0-9205-e0555d4955ef tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.169290 Jul 26 19:51:31.290296 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1039/2076] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:31 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:31.303439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:31.304348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:31.354121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:31.357690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:31.372125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:31.373453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:31.483568 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 HTTP/1.1 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009'} Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:31.485159 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:31.488497 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d9874009-69b3-426b-8bd3-441cb857c193 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009" status: 404 len: 111 microversion: 2.1 time: 0.194986 Jul 26 19:51:31.520899 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1040/2077] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:31 2022] GET /compute/v2.1/servers/23bbd1d7-79cb-4ca7-a775-8a4bd2cb5009 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:31.531918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:31.539287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:31.555589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:31.557754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:31.559414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:31.570816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:31.605200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 HTTP/1.1 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '52c880cc-b8a9-4167-aa94-5c52d9d130e0'} Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:31.611372 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:31.614691 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:31.618670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:31.623396 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd1bd30d-42c9-4743-b692-ee97b93bddff tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 404 len: 111 microversion: 2.1 time: 0.097928 Jul 26 19:51:31.624553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1041/2078] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:31 2022] DELETE /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:31.646284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:31.647215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:31.660978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:31.668833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:31.670110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:31.671262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:31.958387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:31.968638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:31.975066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:31.978890 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-55765bc3-1246-4737-8307-f50f391b45eb tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.351511 Jul 26 19:51:31.998624 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1042/2079] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:31 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:32.004531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:32.005543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 52c880cc-b8a9-4167-aa94-5c52d9d130e0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:32.012606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.018057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.019192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.020026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.051107 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 HTTP/1.1 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '52c880cc-b8a9-4167-aa94-5c52d9d130e0'} Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.053136 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.056389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.056389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.056389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.056389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:32.056389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:32.056389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. Jul 26 19:51:32.056389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.059307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 52c880cc-b8a9-4167-aa94-5c52d9d130e0 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:32.061221 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-46aaf127-c8e3-4e5a-bdaf-edc0fdbdbe6d tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0" status: 404 len: 111 microversion: 2.1 time: 0.061347 Jul 26 19:51:32.066863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1043/2080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:31 2022] GET /compute/v2.1/servers/52c880cc-b8a9-4167-aa94-5c52d9d130e0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:32.074884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:32.075832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:32.082290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:51:32.082860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:51:32.083081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.083428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:51:32.083829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.084803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.085452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.088745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:51:32.089377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:51:32.122019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.123280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.124339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.124791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.136773 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b HTTP/1.1 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7534f20c-a2cf-46f8-b462-33387eb39e2b'} Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:32.139336 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.142502 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.144737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:32.145851 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e47108f-0a09-4d2c-bb22-f57fc7125bcd tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 404 len: 111 microversion: 2.1 time: 0.074765 Jul 26 19:51:32.150008 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1044/2081] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:32 2022] DELETE /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:32.157388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:32.162024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 7534f20c-a2cf-46f8-b462-33387eb39e2b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:32.183313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.185785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.187118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.188881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.202559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Getting quotas for project e9f1debe663740729a7c1b0bda1f3be8. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:51:32.209419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Getting quotas for user d9a36048b1dd4b55a83ab53268489736 and project e9f1debe663740729a7c1b0bda1f3be8. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:51:32.225384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:51:32.234405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:51:32.235325 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b HTTP/1.1 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7534f20c-a2cf-46f8-b462-33387eb39e2b'} Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.236923 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 7534f20c-a2cf-46f8-b462-33387eb39e2b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:32.240379 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38a0c15e-bb99-4d1f-b4f6-554df35d0e25 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b" status: 404 len: 111 microversion: 2.1 time: 0.087083 Jul 26 19:51:32.257342 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1045/2082] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:32 2022] GET /compute/v2.1/servers/7534f20c-a2cf-46f8-b462-33387eb39e2b => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:32.266482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:32.268033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:32.285458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.287316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.288963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.289612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.329491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e HTTP/1.1 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e'} Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:32.332676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.335864 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.342836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:32.344690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cfe66026-8a94-4318-8f07-7ed0c7c46fce tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e" status: 404 len: 111 microversion: 2.1 time: 0.082841 Jul 26 19:51:32.362212 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1046/2083] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:32 2022] DELETE /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:32.368616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be05b039-06dd-455c-b1a2-a9aeb0045124 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87572d4c10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:32.412334 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc7c3e76-7902-4ac9-9f5f-ad58ca8fce77 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.959169 Jul 26 19:51:32.412995 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1038/2084] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:51:32.431360 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-be05b039-06dd-455c-b1a2-a9aeb0045124 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.067156 Jul 26 19:51:32.433099 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1047/2085] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:32 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:32.439344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-40c48a04-ed3a-45c5-a7c7-cff60ca117fb tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:32.440402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40c48a04-ed3a-45c5-a7c7-cff60ca117fb tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:32.462721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:32.463347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:32.493016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.493464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.494251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:32.494690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:32.545648 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e HTTP/1.1 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e'} Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:32.547414 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.551338 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:32.551338 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:32.551338 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:32.551338 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:32.551338 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:32.551338 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. Jul 26 19:51:32.551338 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:32.575102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance 6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:32.579836 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-896953c5-effb-482b-b0aa-a4faf3ea4857 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e" status: 404 len: 111 microversion: 2.1 time: 0.165623 Jul 26 19:51:32.585958 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1039/2086] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:32 2022] GET /compute/v2.1/servers/6b976e3e-c6be-4da6-be1a-4cf9b87f1c4e => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:32.966796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-40c48a04-ed3a-45c5-a7c7-cff60ca117fb tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:32.984227 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-40c48a04-ed3a-45c5-a7c7-cff60ca117fb tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1224 microversion: 2.1 time: 0.549531 Jul 26 19:51:32.984852 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1048/2087] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:32 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1224 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:33.024843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:33.025470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:33.041309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:33.042158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:33.049155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:33.052542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:33.448173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-199d5227-113c-43c9-ac56-ba809d162d95 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87684259d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:33.542819 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-199d5227-113c-43c9-ac56-ba809d162d95 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.098881 Jul 26 19:51:33.549254 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1049/2088] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:33 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:33.947929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:33.988538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:33.999284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:34.009453 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-430bea31-9d37-4c18-a0ac-b2ac9af9dece tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.985972 Jul 26 19:51:34.015184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-541342dc-00fb-4627-89a9-06b5ae55dfe1 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:34.016637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-541342dc-00fb-4627-89a9-06b5ae55dfe1 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:34.016931 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1040/2089] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:33 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:51:34.050384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-541342dc-00fb-4627-89a9-06b5ae55dfe1 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:34.058801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-541342dc-00fb-4627-89a9-06b5ae55dfe1 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:34.067041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-541342dc-00fb-4627-89a9-06b5ae55dfe1 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:34.068204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-541342dc-00fb-4627-89a9-06b5ae55dfe1 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:34.413962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-541342dc-00fb-4627-89a9-06b5ae55dfe1 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:34.427488 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-541342dc-00fb-4627-89a9-06b5ae55dfe1 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1220 microversion: 2.1 time: 0.425620 Jul 26 19:51:34.430242 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1050/2090] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:34 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1220 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:34.567422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b253e3bf-6e12-4000-822a-e9fd850ba6d4 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683adf70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:34.712245 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b253e3bf-6e12-4000-822a-e9fd850ba6d4 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.154091 Jul 26 19:51:34.713575 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1041/2091] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:34 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:35.049664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:35.050936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:35.067270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:35.081169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:35.082379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:35.083413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:35.456286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-759efe1a-15e4-4c4a-8401-fc05a063b2a5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:35.456910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-759efe1a-15e4-4c4a-8401-fc05a063b2a5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:35.465072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-759efe1a-15e4-4c4a-8401-fc05a063b2a5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:35.465522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-759efe1a-15e4-4c4a-8401-fc05a063b2a5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:35.466856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-759efe1a-15e4-4c4a-8401-fc05a063b2a5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:35.467295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-759efe1a-15e4-4c4a-8401-fc05a063b2a5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:35.746612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-759efe1a-15e4-4c4a-8401-fc05a063b2a5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:35.755095 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-759efe1a-15e4-4c4a-8401-fc05a063b2a5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1282 microversion: 2.1 time: 0.302760 Jul 26 19:51:35.763750 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1042/2092] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:35 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1282 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:35.776872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-519a1d5c-255b-4722-8674-aaf511a1d076 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e96fd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:35.878728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-519a1d5c-255b-4722-8674-aaf511a1d076 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.113554 Jul 26 19:51:35.886336 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1043/2093] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:35 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:36.353760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:36.378984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:36.384326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:36.385943 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4658e998-695c-4b01-90ab-6c0f7e518ebd tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 1.340813 Jul 26 19:51:36.389891 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1051/2094] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:35 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:36.787922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55614348-49d1-40da-99ad-a587b44efb14 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:36.789276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55614348-49d1-40da-99ad-a587b44efb14 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:36.816984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55614348-49d1-40da-99ad-a587b44efb14 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:36.819536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55614348-49d1-40da-99ad-a587b44efb14 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:36.826942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55614348-49d1-40da-99ad-a587b44efb14 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:36.828771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55614348-49d1-40da-99ad-a587b44efb14 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:36.900938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4c826e3d-98d5-4446-b782-144b5d9964da tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87684113a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:37.056725 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4c826e3d-98d5-4446-b782-144b5d9964da tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.160660 Jul 26 19:51:37.057327 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1052/2095] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:36 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:37.108426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6b6fb10b-85b2-458f-865a-47e435a99d53 req-4b9121ff-b493-41c0-b1f2-3467127a2db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e730bb-a29a-4608-8c7a-37f0a157059a", "name": "network-vif-unplugged", "status": "completed", "tag": "0eddb3a8-12a7-4dd0-a852-aa571ba0e978"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:37.147674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55614348-49d1-40da-99ad-a587b44efb14 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:37.160532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6b6fb10b-85b2-458f-865a-47e435a99d53 req-4b9121ff-b493-41c0-b1f2-3467127a2db9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:37.166679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6b6fb10b-85b2-458f-865a-47e435a99d53 req-4b9121ff-b493-41c0-b1f2-3467127a2db9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:37.172829 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55614348-49d1-40da-99ad-a587b44efb14 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1282 microversion: 2.1 time: 0.386664 Jul 26 19:51:37.191771 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1044/2096] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:36 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1282 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:37.211395 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6b6fb10b-85b2-458f-865a-47e435a99d53 req-4b9121ff-b493-41c0-b1f2-3467127a2db9 service nova] Creating event network-vif-unplugged:0eddb3a8-12a7-4dd0-a852-aa571ba0e978 for instance 47e730bb-a29a-4608-8c7a-37f0a157059a on n-h2-708768-8 Jul 26 19:51:37.238385 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6b6fb10b-85b2-458f-865a-47e435a99d53 req-4b9121ff-b493-41c0-b1f2-3467127a2db9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135651 Jul 26 19:51:37.243906 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1053/2097] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:37.423365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:37.424463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:37.431591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:37.444441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:37.448529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:37.449281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:38.059944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:38.072869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:38.073478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4c467a9e-6701-43e1-85b7-50e001ce5e2a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87684251f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:38.081531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:38.084498 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18670e49-42dd-4aac-8d93-74019b53793e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.664368 Jul 26 19:51:38.104934 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1045/2098] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:37 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:38.198374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb998503-72e6-42e9-a0c5-6f725c8ba003 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:38.199476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb998503-72e6-42e9-a0c5-6f725c8ba003 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:38.203551 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4c467a9e-6701-43e1-85b7-50e001ce5e2a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.134684 Jul 26 19:51:38.210730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb998503-72e6-42e9-a0c5-6f725c8ba003 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:38.212145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb998503-72e6-42e9-a0c5-6f725c8ba003 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:38.213162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb998503-72e6-42e9-a0c5-6f725c8ba003 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:38.216895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb998503-72e6-42e9-a0c5-6f725c8ba003 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:38.217913 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1054/2099] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:38 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:38.432227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb998503-72e6-42e9-a0c5-6f725c8ba003 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:38.444752 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb998503-72e6-42e9-a0c5-6f725c8ba003 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1282 microversion: 2.1 time: 0.250850 Jul 26 19:51:38.446968 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1046/2100] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:38 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1282 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:39.112495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:39.114055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:39.148250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:39.149624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:39.155542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:39.157526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:39.224198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-23faa22b-3e23-45f3-bfe5-92f73736a367 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683c8a60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:39.332024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-23faa22b-3e23-45f3-bfe5-92f73736a367 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.116111 Jul 26 19:51:39.337595 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1047/2101] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:39 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:39.349234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1dd97bd1-ee8e-4663-8708-ba27e6454c03 req-494971c4-8d32-48e1-8c6f-4b3b90f6e08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e730bb-a29a-4608-8c7a-37f0a157059a", "tag": "0eddb3a8-12a7-4dd0-a852-aa571ba0e978"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:39.381968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1dd97bd1-ee8e-4663-8708-ba27e6454c03 req-494971c4-8d32-48e1-8c6f-4b3b90f6e08e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:39.384943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1dd97bd1-ee8e-4663-8708-ba27e6454c03 req-494971c4-8d32-48e1-8c6f-4b3b90f6e08e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:39.415666 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1dd97bd1-ee8e-4663-8708-ba27e6454c03 req-494971c4-8d32-48e1-8c6f-4b3b90f6e08e service nova] Creating event network-changed:0eddb3a8-12a7-4dd0-a852-aa571ba0e978 for instance 47e730bb-a29a-4608-8c7a-37f0a157059a on n-h2-708768-8 Jul 26 19:51:39.433338 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1dd97bd1-ee8e-4663-8708-ba27e6454c03 req-494971c4-8d32-48e1-8c6f-4b3b90f6e08e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090902 Jul 26 19:51:39.434954 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1048/2102] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:39.659548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e8266df-ddf6-4d40-87b3-0141051a8648 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Action: 'create', calling method: .version_select at 0x7f876838e040>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:39.713149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-3e8266df-ddf6-4d40-87b3-0141051a8648 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Getting quotas for project 255dca9526624252a6bd0879d4b9c09c. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:51:39.739461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-3e8266df-ddf6-4d40-87b3-0141051a8648 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Getting quotas for user ca53821351c5405788babffb21e472cf and project 255dca9526624252a6bd0879d4b9c09c. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:51:39.905162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-3e8266df-ddf6-4d40-87b3-0141051a8648 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Getting quotas for project 255dca9526624252a6bd0879d4b9c09c. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:51:39.923852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-3e8266df-ddf6-4d40-87b3-0141051a8648 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Getting quotas for user ca53821351c5405788babffb21e472cf and project 255dca9526624252a6bd0879d4b9c09c. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:51:39.978102 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e8266df-ddf6-4d40-87b3-0141051a8648 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.526737 Jul 26 19:51:39.988765 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1049/2103] 10.222.0.58 () {62 vars in 1214 bytes} [Tue Jul 26 19:51:39 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:51:40.006786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-47131ce6-5d29-4821-b309-c5dcaa6955c3 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:40.008448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-47131ce6-5d29-4821-b309-c5dcaa6955c3 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:40.012546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:40.028067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:40.030567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:40.031234 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2de78a82-6326-4f95-817a-91025ae2c148 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.922647 Jul 26 19:51:40.038481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47131ce6-5d29-4821-b309-c5dcaa6955c3 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:40.038885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47131ce6-5d29-4821-b309-c5dcaa6955c3 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:40.041900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47131ce6-5d29-4821-b309-c5dcaa6955c3 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:40.042431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47131ce6-5d29-4821-b309-c5dcaa6955c3 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:40.045761 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1055/2104] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:39 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:40.180507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1735597225", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:40.302848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] validate_networks() for [('345475dc-76e4-4954-a940-170585f94095', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:51:40.523537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-47131ce6-5d29-4821-b309-c5dcaa6955c3 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:40.535504 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-47131ce6-5d29-4821-b309-c5dcaa6955c3 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 0.545293 Jul 26 19:51:40.536452 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1050/2105] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:39 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:40.543161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8e65018-cb6a-4923-b986-85b832c5d975 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:40.587152 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8e65018-cb6a-4923-b986-85b832c5d975 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.049561 Jul 26 19:51:40.588564 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1051/2106] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Jul 26 19:51:40 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:51:40.598579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2690c7b-3bcd-45ec-a29a-3c210dd5c213 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683e54c0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:40.687841 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2690c7b-3bcd-45ec-a29a-3c210dd5c213 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.097815 Jul 26 19:51:40.689185 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1052/2107] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:40 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:40.707258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4667a247-228d-41d4-ab3c-ead3877306f0 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:40.740865 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4667a247-228d-41d4-ab3c-ead3877306f0 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/e59bc9e4-fe21-469b-b692-04c74bc07c44" status: 200 len: 235 microversion: 2.64 time: 0.050800 Jul 26 19:51:40.748838 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1053/2108] 10.222.0.58 () {60 vars in 1304 bytes} [Tue Jul 26 19:51:40 2022] GET /compute/v2.1/os-server-groups/e59bc9e4-fe21-469b-b692-04c74bc07c44 => generated 235 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 19:51:40.769840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:40.773185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:40.813693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:40.818270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:40.819689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:40.828357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:40.890748 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 HTTP/1.1 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'd2b0264e-b656-49c4-b9cf-ff371219e527'} Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:40.906287 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:40.910680 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:40.921719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:40.923157 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0da35c6e-9d03-4e3e-b274-91ca52e90642 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 404 len: 111 microversion: 2.1 time: 0.170527 Jul 26 19:51:40.927296 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1054/2109] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:40 2022] DELETE /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:40.938606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5432b405-831a-47bc-9e1e-2e254d82b504 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:41.069682 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5432b405-831a-47bc-9e1e-2e254d82b504 tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/e59bc9e4-fe21-469b-b692-04c74bc07c44" status: 204 len: 0 microversion: 2.64 time: 0.141087 Jul 26 19:51:41.076883 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1055/2110] 10.222.0.58 () {60 vars in 1307 bytes} [Tue Jul 26 19:51:40 2022] DELETE /compute/v2.1/os-server-groups/e59bc9e4-fe21-469b-b692-04c74bc07c44 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:51:41.099251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:41.100231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: d2b0264e-b656-49c4-b9cf-ff371219e527] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:41.124450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:41.129175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:41.130313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:41.132777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:41.182787 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 HTTP/1.1 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'd2b0264e-b656-49c4-b9cf-ff371219e527'} Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:41.185610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.189072 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:41.189072 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:41.189072 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:41.189072 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:41.189072 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:41.189072 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. Jul 26 19:51:41.189072 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.191982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance d2b0264e-b656-49c4-b9cf-ff371219e527 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:41.193674 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2bc14d24-8015-4180-8823-19e049f2565e tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527" status: 404 len: 111 microversion: 2.1 time: 0.114649 Jul 26 19:51:41.194831 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1056/2111] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:41 2022] GET /compute/v2.1/servers/d2b0264e-b656-49c4-b9cf-ff371219e527 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:41.201125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-463bd35c-8ea0-4ea0-a780-97549ef981ab tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:41.223815 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-463bd35c-8ea0-4ea0-a780-97549ef981ab tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] HTTP exception thrown: Instance group e59bc9e4-fe21-469b-b692-04c74bc07c44 could not be found. Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-463bd35c-8ea0-4ea0-a780-97549ef981ab tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Request method failure captured: Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-server-groups/e59bc9e4-fe21-469b-b692-04c74bc07c44 HTTP/1.1 Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EXLZIojEuMxOfQy41x-fee_1mINBXOdKCqTGr8kPwLFTPoNP5zWoIz16L_GgikcTwoEzZGQaxAoLSvt43b9SUiaR-oZup5YeBcQv3GcHvzcw5FI79no3OrWGcktM2rDlKXzlvKiS1M4onU7AZ1-2YPraqdo8_alAjauiw5-FehQvNE Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.64 Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 255dca9526624252a6bd0879d4b9c09c Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerGroup264TestJSON-5185595 Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/255dca9526624252a6bd0879d4b9c09c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/255dca9526624252a6bd0879d4b9c09c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_255dca9526624252a6bd0879d4b9c09c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/255dca9526624252a6bd0879d4b9c09c"}]}] Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerGroup264TestJSON-5185595 Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 255dca9526624252a6bd0879d4b9c09c Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerGroup264TestJSON-5185595 Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerGroup264TestJSON-5185595-project Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ca53821351c5405788babffb21e472cf Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerGroup264TestJSON-5185595-project Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance group e59bc9e4-fe21-469b-b692-04c74bc07c44 could not be found. Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e59bc9e4-fe21-469b-b692-04c74bc07c44'} Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e59bc9e4-fe21-469b-b692-04c74bc07c44 could not be found. Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e59bc9e4-fe21-469b-b692-04c74bc07c44 could not be found. Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.233974 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:41.238882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:41.238882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:41.238882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:41.238882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:41.238882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e59bc9e4-fe21-469b-b692-04c74bc07c44 could not be found. Jul 26 19:51:41.238882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:51:41.238882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-463bd35c-8ea0-4ea0-a780-97549ef981ab tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] Returning 404 to user: Instance group e59bc9e4-fe21-469b-b692-04c74bc07c44 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:41.238882 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-463bd35c-8ea0-4ea0-a780-97549ef981ab tempest-ServerGroup264TestJSON-5185595 tempest-ServerGroup264TestJSON-5185595-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/e59bc9e4-fe21-469b-b692-04c74bc07c44" status: 404 len: 117 microversion: 2.64 time: 0.040186 Jul 26 19:51:41.240596 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1057/2112] 10.222.0.58 () {60 vars in 1307 bytes} [Tue Jul 26 19:51:41 2022] DELETE /compute/v2.1/os-server-groups/e59bc9e4-fe21-469b-b692-04c74bc07c44 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:51:41.251298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:41.251964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:41.269708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:41.270160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:41.271006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:41.271472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:41.546368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:51:41.547094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:51:41.547739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:51:41.548386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:51:41.548915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:51:41.565647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:41.571073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:41.573562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:41.576667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:41.628672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Getting quotas for project 8ab624e048d647aeaed6b3d871e4adac. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:51:41.643584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Getting quotas for user 72e321f4321e4ef38621b3d4cddb490b and project 8ab624e048d647aeaed6b3d871e4adac. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:51:41.682714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:51:41.703477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:51:41.925449 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06893519-0b50-457f-927c-ba30b735591c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.872550 Jul 26 19:51:41.936026 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1056/2113] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:51:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:51:41.964092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:41.969669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:41.983572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:41.984348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:41.985325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:41.985934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:42.049876 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 HTTP/1.1 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f8fe3d9a-2c77-474b-b76c-18e646136479'} Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:42.059289 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:42.066353 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:42.068854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:42.075910 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-37667073-e639-438b-bf2b-896430529d28 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 404 len: 111 microversion: 2.1 time: 0.137627 Jul 26 19:51:42.084293 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1057/2114] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:41 2022] DELETE /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:42.102746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f11d732e-bc90-4403-aac3-aabf9aa92b44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:42.109464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f11d732e-bc90-4403-aac3-aabf9aa92b44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:42.164966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f11d732e-bc90-4403-aac3-aabf9aa92b44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:42.165498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f11d732e-bc90-4403-aac3-aabf9aa92b44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:42.166758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f11d732e-bc90-4403-aac3-aabf9aa92b44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:42.167209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f11d732e-bc90-4403-aac3-aabf9aa92b44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:42.176884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:42.871669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:42.887064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:42.888732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:42.889935 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c620ccdb-1320-409a-9473-d4c34fce41bc tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 1.648537 Jul 26 19:51:42.890719 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1058/2115] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:41 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:42.922932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fed9cc02-a1de-4f1a-be6d-fef6b1e1755c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683e5940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:43.043122 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fed9cc02-a1de-4f1a-be6d-fef6b1e1755c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.138449 Jul 26 19:51:43.048061 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1059/2116] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:42 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:43.069336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-51a895b0-53e9-43c4-85d6-52894a1c5cdd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:43.070353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-51a895b0-53e9-43c4-85d6-52894a1c5cdd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:43.258074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f11d732e-bc90-4403-aac3-aabf9aa92b44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:43.281702 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f11d732e-bc90-4403-aac3-aabf9aa92b44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 1.192600 Jul 26 19:51:43.299841 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1058/2117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:42 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:43.316984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:43.320703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] [instance: f8fe3d9a-2c77-474b-b76c-18e646136479] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:43.335136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:43.337904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-51a895b0-53e9-43c4-85d6-52894a1c5cdd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:43.339052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:43.340186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:43.342800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:43.355075 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-51a895b0-53e9-43c4-85d6-52894a1c5cdd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1222 microversion: 2.1 time: 0.305797 Jul 26 19:51:43.362086 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1060/2118] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:43 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1222 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:43.449545 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] HTTP exception thrown: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:43.451575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d4a4c86c-7020-4633-b1e5-56abc24fa503 req-3759179b-092b-420f-b1ed-3d2d1d4b1810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f63e6b1-f0f3-4728-9d81-55e213d76670", "tag": "57157a04-5595-4f99-80d3-334f6ed29d8b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Request method failure captured: Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 HTTP/1.1 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ESUmHg9-6t_rCEvHWX8r1jOttig12q4DyFpg3UJ-GRrsxtBFRzRu2XG4KB8eOkt3G1vUSdGNQAuu1a6kaSxRDWBD4pTQOQ9217BSG69Z3jmogELF-hwctfH1o3u8eqgk6krdl3MOArz7Tgv6m2qP2w0eNe2wWdojqWQXwjSovV0hxI Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/913c0fd2d4ec40af912b139762716033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_913c0fd2d4ec40af912b139762716033", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/913c0fd2d4ec40af912b139762716033"}]}] Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 913c0fd2d4ec40af912b139762716033 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-1571080580 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4e8808ff2c4341eca66334700ec25a82 Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-1571080580-project Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f8fe3d9a-2c77-474b-b76c-18e646136479'} Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:51:43.472170 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:43.476142 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:51:43.476142 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:51:43.476142 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:51:43.476142 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:51:43.476142 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:51:43.476142 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. Jul 26 19:51:43.476142 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:51:43.477617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] Returning 404 to user: Instance f8fe3d9a-2c77-474b-b76c-18e646136479 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:51:43.483986 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8b388230-4fdc-42de-abcb-a65d29731159 tempest-DeleteServersTestJSON-1571080580 tempest-DeleteServersTestJSON-1571080580-project] 10.222.0.58 "GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479" status: 404 len: 111 microversion: 2.1 time: 0.181860 Jul 26 19:51:43.495933 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1059/2119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:43 2022] GET /compute/v2.1/servers/f8fe3d9a-2c77-474b-b76c-18e646136479 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:51:43.507834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d4a4c86c-7020-4633-b1e5-56abc24fa503 req-3759179b-092b-420f-b1ed-3d2d1d4b1810 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:43.508779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d4a4c86c-7020-4633-b1e5-56abc24fa503 req-3759179b-092b-420f-b1ed-3d2d1d4b1810 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:43.557256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1759671713", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:43.601564 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d4a4c86c-7020-4633-b1e5-56abc24fa503 req-3759179b-092b-420f-b1ed-3d2d1d4b1810 service nova] Creating event network-changed:57157a04-5595-4f99-80d3-334f6ed29d8b for instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 on n-h2-708768-8 Jul 26 19:51:43.618523 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d4a4c86c-7020-4633-b1e5-56abc24fa503 req-3759179b-092b-420f-b1ed-3d2d1d4b1810 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171765 Jul 26 19:51:43.633828 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1061/2120] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 19:51:43.747449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] validate_networks() for [('345475dc-76e4-4954-a940-170585f94095', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:51:43.918465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:43.919198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:43.936250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:43.936698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:43.937598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:43.937909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:44.333439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:44.346833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:44.352143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:44.373945 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a112693b-1f2d-41bf-a3ff-ed49a676af98 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.460506 Jul 26 19:51:44.379770 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1062/2121] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:43 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:51:44.395347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8328850f-f048-425c-80da-d9dcb09f6cc4 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683e5a60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:44.511326 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8328850f-f048-425c-80da-d9dcb09f6cc4 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.129698 Jul 26 19:51:44.513943 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1063/2122] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:44 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:44.535988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe902ec0-b1e2-4294-a09a-0b81abd47192 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:44.537063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe902ec0-b1e2-4294-a09a-0b81abd47192 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:44.540387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:44.569463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe902ec0-b1e2-4294-a09a-0b81abd47192 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:44.570253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe902ec0-b1e2-4294-a09a-0b81abd47192 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:44.571259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe902ec0-b1e2-4294-a09a-0b81abd47192 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:44.577183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe902ec0-b1e2-4294-a09a-0b81abd47192 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:45.058167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fe902ec0-b1e2-4294-a09a-0b81abd47192 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:45.073644 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe902ec0-b1e2-4294-a09a-0b81abd47192 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 0.556466 Jul 26 19:51:45.074266 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1064/2123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:44 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:45.400945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:45.401582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:45.419667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:45.420130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:45.421392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:45.421929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:46.150371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:46.159856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:46.167167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:46.169242 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0df546bf-63ce-4f91-a26a-7dc1a04eba1f tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.771560 Jul 26 19:51:46.177724 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1065/2124] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:45 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:46.187342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7958761e-4970-4d56-b054-b8c4583bddba tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768393f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:46.354835 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7958761e-4970-4d56-b054-b8c4583bddba tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.175119 Jul 26 19:51:46.355355 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1066/2125] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:46 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:46.377220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c34bf67d-48cb-47a2-aa6f-d3558a096a4b req-31fc158c-224b-4ebc-bb95-fc2a776a2e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e730bb-a29a-4608-8c7a-37f0a157059a", "name": "network-vif-unplugged", "status": "completed", "tag": "0eddb3a8-12a7-4dd0-a852-aa571ba0e978"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:46.425704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c34bf67d-48cb-47a2-aa6f-d3558a096a4b req-31fc158c-224b-4ebc-bb95-fc2a776a2e2c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:46.426829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c34bf67d-48cb-47a2-aa6f-d3558a096a4b req-31fc158c-224b-4ebc-bb95-fc2a776a2e2c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:46.456250 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c34bf67d-48cb-47a2-aa6f-d3558a096a4b req-31fc158c-224b-4ebc-bb95-fc2a776a2e2c service nova] Creating event network-vif-unplugged:0eddb3a8-12a7-4dd0-a852-aa571ba0e978 for instance 47e730bb-a29a-4608-8c7a-37f0a157059a on n-h2-708768-8 Jul 26 19:51:46.465084 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c34bf67d-48cb-47a2-aa6f-d3558a096a4b req-31fc158c-224b-4ebc-bb95-fc2a776a2e2c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106603 Jul 26 19:51:46.473263 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1067/2126] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:46.489579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f474db42-749b-4d59-bde4-319ae719f8c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:46.490298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f474db42-749b-4d59-bde4-319ae719f8c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:46.503604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f474db42-749b-4d59-bde4-319ae719f8c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:46.512828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f474db42-749b-4d59-bde4-319ae719f8c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:46.516833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f474db42-749b-4d59-bde4-319ae719f8c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:46.518879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f474db42-749b-4d59-bde4-319ae719f8c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:47.389145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f474db42-749b-4d59-bde4-319ae719f8c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:47.395380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:47.397835 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f474db42-749b-4d59-bde4-319ae719f8c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 0.916690 Jul 26 19:51:47.407164 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1068/2127] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:46 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:47.416868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:47.417691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:47.445969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:47.446611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:47.452505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:47.453060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:47.633601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:51:47.634074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:51:47.634478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:51:47.634880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:51:47.635464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:51:47.644423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:47.676900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:47.677442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:47.678408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:47.679672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:47.733407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Getting quotas for project 8ab624e048d647aeaed6b3d871e4adac. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:51:47.747944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Getting quotas for user 72e321f4321e4ef38621b3d4cddb490b and project 8ab624e048d647aeaed6b3d871e4adac. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:51:47.795350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:51:47.801043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:51:47.938556 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d79f9c87-59ab-45c0-9631-576499c6ed5c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.386408 Jul 26 19:51:47.952419 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1060/2128] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:51:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 4401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:51:47.957747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ccd7b12b-0aea-45ce-b88f-606bea1a4453 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683fd280>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:48.142776 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ccd7b12b-0aea-45ce-b88f-606bea1a4453 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.188400 Jul 26 19:51:48.143675 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1061/2129] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:47 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:48.161821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-339e3a53-f623-4844-b52e-d11a6452e32f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:48.163454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-339e3a53-f623-4844-b52e-d11a6452e32f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:48.360461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:48.374130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:48.381423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:48.382431 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c455f30-9c76-4489-b453-809127ef983d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.973957 Jul 26 19:51:48.383385 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1069/2130] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:47 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:48.436227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-380e0d77-ccf6-4eb0-a0f9-fcdab4b929d5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:48.438041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-380e0d77-ccf6-4eb0-a0f9-fcdab4b929d5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:48.449184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-380e0d77-ccf6-4eb0-a0f9-fcdab4b929d5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:48.451514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-380e0d77-ccf6-4eb0-a0f9-fcdab4b929d5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:48.452856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-380e0d77-ccf6-4eb0-a0f9-fcdab4b929d5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:48.453462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-380e0d77-ccf6-4eb0-a0f9-fcdab4b929d5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:48.532124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-339e3a53-f623-4844-b52e-d11a6452e32f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:48.555597 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-339e3a53-f623-4844-b52e-d11a6452e32f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1222 microversion: 2.1 time: 0.403649 Jul 26 19:51:48.568060 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1062/2131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:48 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1222 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:48.992913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-380e0d77-ccf6-4eb0-a0f9-fcdab4b929d5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:49.012554 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-380e0d77-ccf6-4eb0-a0f9-fcdab4b929d5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 0.582055 Jul 26 19:51:49.016370 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1070/2132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:48 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:49.160347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79ad8a7f-698a-45eb-ab4c-2121b59c62d9 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683a1670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:49.298505 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79ad8a7f-698a-45eb-ab4c-2121b59c62d9 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.143351 Jul 26 19:51:49.301543 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1063/2133] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:49 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:49.409703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:49.410687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:49.427195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:49.428245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:49.430451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:49.432235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:49.592900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6689e4dc-9f8e-4444-ab5b-c8b04e299f7b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:49.593462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6689e4dc-9f8e-4444-ab5b-c8b04e299f7b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:49.606969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6689e4dc-9f8e-4444-ab5b-c8b04e299f7b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:49.607734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6689e4dc-9f8e-4444-ab5b-c8b04e299f7b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:49.614315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6689e4dc-9f8e-4444-ab5b-c8b04e299f7b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:49.615021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6689e4dc-9f8e-4444-ab5b-c8b04e299f7b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:49.641329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:50.095385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6689e4dc-9f8e-4444-ab5b-c8b04e299f7b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:50.116064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:50.125075 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6689e4dc-9f8e-4444-ab5b-c8b04e299f7b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1274 microversion: 2.1 time: 0.519327 Jul 26 19:51:50.129268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:50.133081 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1064/2134] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:49 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1274 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:50.143586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:50.144865 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e8b5de30-ab18-41c6-b842-258a46469f76 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.740638 Jul 26 19:51:50.150991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ab4a0a9-27fb-47ca-852a-c7e5cefeb689 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:50.153158 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1071/2135] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:49 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:50.156988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ab4a0a9-27fb-47ca-852a-c7e5cefeb689 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:50.171242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ab4a0a9-27fb-47ca-852a-c7e5cefeb689 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:50.177809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ab4a0a9-27fb-47ca-852a-c7e5cefeb689 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:50.180914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ab4a0a9-27fb-47ca-852a-c7e5cefeb689 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:50.186398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ab4a0a9-27fb-47ca-852a-c7e5cefeb689 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:50.315916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aea5751b-0b31-4117-9bab-b73b7d8556bf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768346a60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:50.388593 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aea5751b-0b31-4117-9bab-b73b7d8556bf tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.077511 Jul 26 19:51:50.392139 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1072/2136] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:50 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:50.945443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ab4a0a9-27fb-47ca-852a-c7e5cefeb689 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:50.955256 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ab4a0a9-27fb-47ca-852a-c7e5cefeb689 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 0.821014 Jul 26 19:51:50.959385 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1065/2137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:50 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:51.161680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-48a451c5-ef52-44b6-850a-8f584bd3bdca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:51.163593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-48a451c5-ef52-44b6-850a-8f584bd3bdca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:51.185044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:51.185874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:51.197691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48a451c5-ef52-44b6-850a-8f584bd3bdca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:51.202820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48a451c5-ef52-44b6-850a-8f584bd3bdca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:51.203044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:51.203495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:51.204348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:51.205824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48a451c5-ef52-44b6-850a-8f584bd3bdca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:51.206448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48a451c5-ef52-44b6-850a-8f584bd3bdca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:51.223477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:51.699554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-48a451c5-ef52-44b6-850a-8f584bd3bdca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:51.707651 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-48a451c5-ef52-44b6-850a-8f584bd3bdca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1282 microversion: 2.1 time: 0.552549 Jul 26 19:51:51.721737 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1073/2138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:51 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1282 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:51.757299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7caaac26-6222-4a0f-966e-7a0bcf644823 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768385790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:51.888547 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7caaac26-6222-4a0f-966e-7a0bcf644823 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.164291 Jul 26 19:51:51.889152 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1074/2139] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:51 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:51.983062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a88d9ac-c245-478b-885e-fdefc1a4d6e0 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:51.983710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a88d9ac-c245-478b-885e-fdefc1a4d6e0 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:52.013129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a88d9ac-c245-478b-885e-fdefc1a4d6e0 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:52.013845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a88d9ac-c245-478b-885e-fdefc1a4d6e0 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:52.014855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a88d9ac-c245-478b-885e-fdefc1a4d6e0 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:52.016143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a88d9ac-c245-478b-885e-fdefc1a4d6e0 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:52.456761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:52.476333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:52.477844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:52.487546 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-065708c1-f50e-4dbb-b83c-2bfb33b2b7e8 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 1.306360 Jul 26 19:51:52.506341 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1066/2140] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:51 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:52.512717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a88d9ac-c245-478b-885e-fdefc1a4d6e0 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:52.532741 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a88d9ac-c245-478b-885e-fdefc1a4d6e0 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 0.555871 Jul 26 19:51:52.533604 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1075/2141] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:51 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:52.749230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-655f04cb-4204-471f-b23f-6d4d72697746 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:52.751010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-655f04cb-4204-471f-b23f-6d4d72697746 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:52.781649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-655f04cb-4204-471f-b23f-6d4d72697746 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:52.788993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-655f04cb-4204-471f-b23f-6d4d72697746 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:52.789964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-655f04cb-4204-471f-b23f-6d4d72697746 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:52.792094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-655f04cb-4204-471f-b23f-6d4d72697746 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:52.904858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c7b38dc-5c50-4c1c-b7ef-63ef9eb23d73 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683469d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:53.036999 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c7b38dc-5c50-4c1c-b7ef-63ef9eb23d73 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.118982 Jul 26 19:51:53.045327 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1076/2142] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:52 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:53.083800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-655f04cb-4204-471f-b23f-6d4d72697746 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:53.092978 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-655f04cb-4204-471f-b23f-6d4d72697746 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1280 microversion: 2.1 time: 0.348620 Jul 26 19:51:53.101112 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1067/2143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:52 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1280 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:53.520968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:53.522753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:53.527192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=16 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:53.545529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:53.546370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:53.561189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0be5451c-bbe4-4275-9606-7d9fffd3d716 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:53.563240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0be5451c-bbe4-4275-9606-7d9fffd3d716 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:53.580167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:53.581218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:53.594668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0be5451c-bbe4-4275-9606-7d9fffd3d716 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:53.599011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0be5451c-bbe4-4275-9606-7d9fffd3d716 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:53.605259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0be5451c-bbe4-4275-9606-7d9fffd3d716 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:53.605942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0be5451c-bbe4-4275-9606-7d9fffd3d716 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:53.970452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:53.986093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:53.994029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:54.000511 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f8a4f140-a11c-4ebd-ba8c-f21b6b28572b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1485 microversion: 2.25 time: 0.483485 Jul 26 19:51:54.003786 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1077/2144] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:53 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1485 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:54.011753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7ad7135-e21a-4214-8705-e4d72056a6e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:54.014694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e7ad7135-e21a-4214-8705-e4d72056a6e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:54.053980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ad7135-e21a-4214-8705-e4d72056a6e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:54.054444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ad7135-e21a-4214-8705-e4d72056a6e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:54.055245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ad7135-e21a-4214-8705-e4d72056a6e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:54.055707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ad7135-e21a-4214-8705-e4d72056a6e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:54.356413 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7ad7135-e21a-4214-8705-e4d72056a6e8 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1812 microversion: 2.1 time: 0.350695 Jul 26 19:51:54.373629 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1078/2145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:54 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1812 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:54.373629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e4c9ef3c-7fc4-4c76-a416-f1b6b4cb6cbc tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e96a790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:54.444379 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e4c9ef3c-7fc4-4c76-a416-f1b6b4cb6cbc tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.082784 Jul 26 19:51:54.445281 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1079/2146] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:54 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:54.462232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b5535ef1-1c4d-4728-ac1d-d025f89586d7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:54.462883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b5535ef1-1c4d-4728-ac1d-d025f89586d7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:54.470598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5535ef1-1c4d-4728-ac1d-d025f89586d7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:54.471055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5535ef1-1c4d-4728-ac1d-d025f89586d7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:54.471932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5535ef1-1c4d-4728-ac1d-d025f89586d7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:54.472348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5535ef1-1c4d-4728-ac1d-d025f89586d7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:54.550285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0be5451c-bbe4-4275-9606-7d9fffd3d716 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:54.559204 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0be5451c-bbe4-4275-9606-7d9fffd3d716 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 1.008949 Jul 26 19:51:54.565546 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1068/2147] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:53 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:54.596859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9af14c8-a44c-4d0c-ab69-23703b38d661 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:54.610944 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:51:54.610944 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:51:54.616449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9af14c8-a44c-4d0c-ab69-23703b38d661 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:54.617116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9af14c8-a44c-4d0c-ab69-23703b38d661 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:54.618008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9af14c8-a44c-4d0c-ab69-23703b38d661 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:54.618432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9af14c8-a44c-4d0c-ab69-23703b38d661 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:54.631335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5535ef1-1c4d-4728-ac1d-d025f89586d7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:54.656922 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b5535ef1-1c4d-4728-ac1d-d025f89586d7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1280 microversion: 2.1 time: 0.201821 Jul 26 19:51:54.681310 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1080/2148] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:54 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1280 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:54.708387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0be8993a-2e22-41b6-ae35-eaf4d5ac1836 req-e7ec843a-31be-4a27-a018-12750f9528a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a15e74a-9354-4cf2-908d-2c9191b2ef96", "tag": "c56a0e33-dd68-4bcf-b1d1-6aa56969b87d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:54.728675 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9af14c8-a44c-4d0c-ab69-23703b38d661 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.149217 Jul 26 19:51:54.729300 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1069/2149] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 19:51:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:54.759938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0be8993a-2e22-41b6-ae35-eaf4d5ac1836 req-e7ec843a-31be-4a27-a018-12750f9528a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:54.760392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0be8993a-2e22-41b6-ae35-eaf4d5ac1836 req-e7ec843a-31be-4a27-a018-12750f9528a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:54.797866 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0be8993a-2e22-41b6-ae35-eaf4d5ac1836 req-e7ec843a-31be-4a27-a018-12750f9528a5 service nova] Creating event network-changed:c56a0e33-dd68-4bcf-b1d1-6aa56969b87d for instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 on n-h1-708768-8 Jul 26 19:51:54.819385 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0be8993a-2e22-41b6-ae35-eaf4d5ac1836 req-e7ec843a-31be-4a27-a018-12750f9528a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132848 Jul 26 19:51:54.822997 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1081/2150] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:54.910691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a8d16132-bece-4185-8ffd-0269d9a57228 req-7010c46d-175c-4246-8b32-6eff01feabad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f63e6b1-f0f3-4728-9d81-55e213d76670", "name": "network-vif-plugged", "status": "completed", "tag": "57157a04-5595-4f99-80d3-334f6ed29d8b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:54.940723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a8d16132-bece-4185-8ffd-0269d9a57228 req-7010c46d-175c-4246-8b32-6eff01feabad service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:54.941945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a8d16132-bece-4185-8ffd-0269d9a57228 req-7010c46d-175c-4246-8b32-6eff01feabad service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:54.988558 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a8d16132-bece-4185-8ffd-0269d9a57228 req-7010c46d-175c-4246-8b32-6eff01feabad service nova] Creating event network-vif-plugged:57157a04-5595-4f99-80d3-334f6ed29d8b for instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 on n-h2-708768-8 Jul 26 19:51:55.006657 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a8d16132-bece-4185-8ffd-0269d9a57228 req-7010c46d-175c-4246-8b32-6eff01feabad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101689 Jul 26 19:51:55.013346 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1070/2151] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:55.032012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:55.032803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:55.049871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:55.068104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:55.069217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:55.070015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:55.342902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:55.357131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:55.359513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:55.361306 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b01dbd84-49ab-439f-ae7c-3728a00ba30d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1475 microversion: 2.25 time: 0.338323 Jul 26 19:51:55.362879 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1082/2152] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:55 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1475 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:55.391462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96c3df23-b129-474a-866c-374db1c03deb tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '.version_select at 0x7f8768439b80>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:55.397075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96c3df23-b129-474a-866c-374db1c03deb tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:55.397789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96c3df23-b129-474a-866c-374db1c03deb tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:55.426322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96c3df23-b129-474a-866c-374db1c03deb tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2780 microversion: 2.25 time: 0.039259 Jul 26 19:51:55.428270 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1071/2153] 10.222.0.58 () {60 vars in 1184 bytes} [Tue Jul 26 19:51:55 2022] GET /compute/v2.1/os-migrations => generated 2780 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:55.446598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-43998771-4e7f-4119-903e-3524082c909b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:55.447626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-43998771-4e7f-4119-903e-3524082c909b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:55.463302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e64a365c-ef05-4c87-b751-141aea2bfc47 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683e5f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:55.473885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43998771-4e7f-4119-903e-3524082c909b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:55.475324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43998771-4e7f-4119-903e-3524082c909b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:55.477552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43998771-4e7f-4119-903e-3524082c909b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:55.478075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43998771-4e7f-4119-903e-3524082c909b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:55.569670 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e64a365c-ef05-4c87-b751-141aea2bfc47 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.112473 Jul 26 19:51:55.576610 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1072/2154] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:55 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:55.607567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3762b708-b45f-462f-a39a-ec2c5e10d0de tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:55.608364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3762b708-b45f-462f-a39a-ec2c5e10d0de tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:55.639529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3762b708-b45f-462f-a39a-ec2c5e10d0de tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:55.640280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3762b708-b45f-462f-a39a-ec2c5e10d0de tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:55.644857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3762b708-b45f-462f-a39a-ec2c5e10d0de tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:55.645587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3762b708-b45f-462f-a39a-ec2c5e10d0de tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:56.038252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-43998771-4e7f-4119-903e-3524082c909b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] Lazy-loading 'services' on Instance uuid 47e730bb-a29a-4608-8c7a-37f0a157059a {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:51:56.077734 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-43998771-4e7f-4119-903e-3524082c909b tempest-LiveAutoBlockMigrationV225Test-639402627 tempest-LiveAutoBlockMigrationV225Test-639402627-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1967 microversion: 2.25 time: 0.637901 Jul 26 19:51:56.082983 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1083/2155] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:55 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1967 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:56.110996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7cbb245e-6d4c-4afe-b717-85c7723ad7b7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:56.115718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7cbb245e-6d4c-4afe-b717-85c7723ad7b7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:56.125998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cbb245e-6d4c-4afe-b717-85c7723ad7b7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:56.126718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cbb245e-6d4c-4afe-b717-85c7723ad7b7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:56.127735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cbb245e-6d4c-4afe-b717-85c7723ad7b7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:56.128325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cbb245e-6d4c-4afe-b717-85c7723ad7b7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:56.597938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7cbb245e-6d4c-4afe-b717-85c7723ad7b7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:56.609362 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7cbb245e-6d4c-4afe-b717-85c7723ad7b7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1322 microversion: 2.1 time: 0.507548 Jul 26 19:51:56.610526 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1084/2156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:56 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:56.610653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3762b708-b45f-462f-a39a-ec2c5e10d0de tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:56.620037 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3762b708-b45f-462f-a39a-ec2c5e10d0de tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1324 microversion: 2.1 time: 1.028983 Jul 26 19:51:56.631204 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1073/2157] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:55 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1324 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:51:56.634669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9c80f77b-d378-4fe3-9e57-4573c7ee7c37 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:56.647272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d030687d-5c8f-44d3-ac8b-3c32903dd1b1 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8756e633a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:56.648319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9c80f77b-d378-4fe3-9e57-4573c7ee7c37 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:56.675843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c80f77b-d378-4fe3-9e57-4573c7ee7c37 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:56.675843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c80f77b-d378-4fe3-9e57-4573c7ee7c37 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:56.679251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c80f77b-d378-4fe3-9e57-4573c7ee7c37 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:56.681817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c80f77b-d378-4fe3-9e57-4573c7ee7c37 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:56.754906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9c80f77b-d378-4fe3-9e57-4573c7ee7c37 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:51:56.813581 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d030687d-5c8f-44d3-ac8b-3c32903dd1b1 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.179525 Jul 26 19:51:56.816211 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1074/2158] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:56 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:57.029245 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9c80f77b-d378-4fe3-9e57-4573c7ee7c37 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 204 len: 0 microversion: 2.25 time: 0.415271 Jul 26 19:51:57.030935 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1085/2159] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:51:56 2022] DELETE /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:51:57.039641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:57.051145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:57.075496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:57.075989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:57.076803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:57.077253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:57.272123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7df655ac-6841-419e-b5fa-56be11c810fa tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:57.273809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7df655ac-6841-419e-b5fa-56be11c810fa tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:57.283962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7df655ac-6841-419e-b5fa-56be11c810fa tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:57.284765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7df655ac-6841-419e-b5fa-56be11c810fa tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:57.285783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7df655ac-6841-419e-b5fa-56be11c810fa tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:57.286439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7df655ac-6841-419e-b5fa-56be11c810fa tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:57.325218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7df655ac-6841-419e-b5fa-56be11c810fa tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:51:57.396452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:57.474956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7df655ac-6841-419e-b5fa-56be11c810fa tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 204 len: 0 microversion: 2.1 time: 0.205756 Jul 26 19:51:57.479796 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1086/2160] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:51:57 2022] DELETE /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:51:57.488472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-be799587-7d1b-4af2-97c6-1919cdc6a7f2 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:57.490632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-be799587-7d1b-4af2-97c6-1919cdc6a7f2 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:57.498366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be799587-7d1b-4af2-97c6-1919cdc6a7f2 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:57.498819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be799587-7d1b-4af2-97c6-1919cdc6a7f2 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:57.499622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be799587-7d1b-4af2-97c6-1919cdc6a7f2 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:57.500228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be799587-7d1b-4af2-97c6-1919cdc6a7f2 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:57.941234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-be799587-7d1b-4af2-97c6-1919cdc6a7f2 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:57.952236 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-be799587-7d1b-4af2-97c6-1919cdc6a7f2 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1665 microversion: 2.1 time: 0.470212 Jul 26 19:51:57.953036 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1087/2161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:57 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1665 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:57.983747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d537a478-a350-483e-ac68-0d07c505a0e9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:57.986328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d537a478-a350-483e-ac68-0d07c505a0e9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:58.000570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d537a478-a350-483e-ac68-0d07c505a0e9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:58.001048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d537a478-a350-483e-ac68-0d07c505a0e9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:58.001835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d537a478-a350-483e-ac68-0d07c505a0e9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:58.002274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d537a478-a350-483e-ac68-0d07c505a0e9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:58.094517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:58.115833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:58.120590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:58.124741 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1366819-5e85-4019-a5f2-f6f2513e9b01 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1481 microversion: 2.25 time: 1.087892 Jul 26 19:51:58.145731 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1075/2162] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:51:57 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1481 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:51:58.150109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2561cfd7-b234-4da6-b3a4-9e8a8316fc17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:58.150512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2561cfd7-b234-4da6-b3a4-9e8a8316fc17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:58.169097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2561cfd7-b234-4da6-b3a4-9e8a8316fc17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:58.169546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2561cfd7-b234-4da6-b3a4-9e8a8316fc17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:58.170327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2561cfd7-b234-4da6-b3a4-9e8a8316fc17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:58.180387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2561cfd7-b234-4da6-b3a4-9e8a8316fc17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:58.402953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d537a478-a350-483e-ac68-0d07c505a0e9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:58.414436 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d537a478-a350-483e-ac68-0d07c505a0e9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1322 microversion: 2.1 time: 0.445533 Jul 26 19:51:58.415423 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1088/2163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:57 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:58.436843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de19f876-9033-447f-968c-3afb38d4c129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58a249e2-eee3-4375-b223-2d14404f577f", "device": "/dev/xvdb"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:58.440983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de19f876-9033-447f-968c-3afb38d4c129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:58.450624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de19f876-9033-447f-968c-3afb38d4c129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:58.451171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de19f876-9033-447f-968c-3afb38d4c129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:58.452138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de19f876-9033-447f-968c-3afb38d4c129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:58.452719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de19f876-9033-447f-968c-3afb38d4c129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:58.547316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=16 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:51:58.690633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2561cfd7-b234-4da6-b3a4-9e8a8316fc17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:51:58.698478 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2561cfd7-b234-4da6-b3a4-9e8a8316fc17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1520 microversion: 2.1 time: 0.552350 Jul 26 19:51:58.699037 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1076/2164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:58 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1520 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:58.703582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-07cd1076-bb21-401f-a675-365eda7a3b0d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683dd1f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:58.796251 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-07cd1076-bb21-401f-a675-365eda7a3b0d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1452 microversion: 2.1 time: 0.096113 Jul 26 19:51:58.804136 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1077/2165] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:51:58 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:51:58.809540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b039d7ec-6cec-4f3c-b89d-e78c170e4837 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'create', calling method: .version_select at 0x7f87683ec280>, body: {"pool": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:51:59.891033 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de19f876-9033-447f-968c-3afb38d4c129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "POST /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.459819 Jul 26 19:51:59.892628 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1089/2166] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 19:51:58 2022] POST /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments => generated 194 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:51:59.908295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bcd9427-61ef-499c-9e99-ac9e6c8b10b0 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:51:59.912183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bcd9427-61ef-499c-9e99-ac9e6c8b10b0 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:51:59.937697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bcd9427-61ef-499c-9e99-ac9e6c8b10b0 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:59.948039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bcd9427-61ef-499c-9e99-ac9e6c8b10b0 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:51:59.952872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bcd9427-61ef-499c-9e99-ac9e6c8b10b0 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:51:59.953557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bcd9427-61ef-499c-9e99-ac9e6c8b10b0 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:00.631969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bcd9427-61ef-499c-9e99-ac9e6c8b10b0 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:00.646901 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bcd9427-61ef-499c-9e99-ac9e6c8b10b0 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1665 microversion: 2.1 time: 0.752303 Jul 26 19:52:00.664495 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1090/2167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:51:59 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1665 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:00.671955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-289a839d-83ee-4320-a5f1-bcdd5b34ce0d req-937bbf6b-c9da-4a24-9e47-e985d4decffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e85cae1-2beb-4a4f-9ff6-b6f594b088b2", "tag": "df3b4566-8e9d-48e1-ab1e-4fdc624c5211"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:00.687655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-289a839d-83ee-4320-a5f1-bcdd5b34ce0d req-937bbf6b-c9da-4a24-9e47-e985d4decffa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:00.688441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-289a839d-83ee-4320-a5f1-bcdd5b34ce0d req-937bbf6b-c9da-4a24-9e47-e985d4decffa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:00.703588 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-289a839d-83ee-4320-a5f1-bcdd5b34ce0d req-937bbf6b-c9da-4a24-9e47-e985d4decffa service nova] Creating event network-changed:df3b4566-8e9d-48e1-ab1e-4fdc624c5211 for instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 on n-h2-708768-8 Jul 26 19:52:00.710805 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-289a839d-83ee-4320-a5f1-bcdd5b34ce0d req-937bbf6b-c9da-4a24-9e47-e985d4decffa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047111 Jul 26 19:52:00.712639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1091/2168] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:00.723781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:00.724815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:00.740790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:00.744584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:00.747249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:00.748008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:01.528847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:01.548049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:01.551763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:01.553781 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2bc08b2-240a-435b-9172-0fd2f4a36aa3 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1481 microversion: 2.25 time: 0.839669 Jul 26 19:52:01.561068 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1092/2169] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:00 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1481 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:01.566698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dd365ecf-29cc-4429-900a-af4fee0b9eb7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:01.575176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dd365ecf-29cc-4429-900a-af4fee0b9eb7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:01.587719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd365ecf-29cc-4429-900a-af4fee0b9eb7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:01.588651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd365ecf-29cc-4429-900a-af4fee0b9eb7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:01.590952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd365ecf-29cc-4429-900a-af4fee0b9eb7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:01.601737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd365ecf-29cc-4429-900a-af4fee0b9eb7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:02.023519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dd365ecf-29cc-4429-900a-af4fee0b9eb7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:02.038470 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dd365ecf-29cc-4429-900a-af4fee0b9eb7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1322 microversion: 2.1 time: 0.476010 Jul 26 19:52:02.052866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1093/2170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:01 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:02.066281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26cb68a4-4201-4ccc-97d4-d87f0094ef75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768385af0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:02.161325 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26cb68a4-4201-4ccc-97d4-d87f0094ef75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1461 microversion: 2.1 time: 0.099084 Jul 26 19:52:02.162901 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1094/2171] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:02 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1461 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:02.174332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ea7af58-da73-4b95-8010-3c56581a3846 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:02.174969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5ea7af58-da73-4b95-8010-3c56581a3846 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:02.190087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ea7af58-da73-4b95-8010-3c56581a3846 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:02.192564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ea7af58-da73-4b95-8010-3c56581a3846 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:02.195101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ea7af58-da73-4b95-8010-3c56581a3846 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:02.195760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ea7af58-da73-4b95-8010-3c56581a3846 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:02.283997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ea7af58-da73-4b95-8010-3c56581a3846 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270af76b143f4e329b2e941d257b042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03cc70ec3449dba93baafb7a0762f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:02.295311 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ea7af58-da73-4b95-8010-3c56581a3846 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 200 len: 1598 microversion: 2.1 time: 0.131031 Jul 26 19:52:02.296682 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1095/2172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:02 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 1598 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:02.302049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e620242-4432-4d82-9ce3-280deedd3de6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683b2d30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:02.370144 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e620242-4432-4d82-9ce3-280deedd3de6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 200 len: 1461 microversion: 2.1 time: 0.069826 Jul 26 19:52:02.370144 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1096/2173] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:02 2022] GET /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 1461 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:02.383890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6248afdb-7545-4272-bee2-8b1e450f474d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:02.384799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6248afdb-7545-4272-bee2-8b1e450f474d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:02.392353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6248afdb-7545-4272-bee2-8b1e450f474d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:02.393200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6248afdb-7545-4272-bee2-8b1e450f474d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:02.394248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6248afdb-7545-4272-bee2-8b1e450f474d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:02.394900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6248afdb-7545-4272-bee2-8b1e450f474d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:02.647465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6248afdb-7545-4272-bee2-8b1e450f474d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:02.670668 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6248afdb-7545-4272-bee2-8b1e450f474d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1465 microversion: 2.1 time: 0.290883 Jul 26 19:52:02.674407 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1097/2174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:02 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1465 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:02.689430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:02.690841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:02.699161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:02.702928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:02.705300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:02.708431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:02.904354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:02.932750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:02.937516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:02.938736 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c236f765-4359-4055-89c3-62305017f6a5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1265 microversion: 2.25 time: 0.263109 Jul 26 19:52:02.939560 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1098/2175] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:02 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:02.964586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d71a34a1-c7ec-46ca-a86e-e83c82669503 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2066440316"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:02.968975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d71a34a1-c7ec-46ca-a86e-e83c82669503 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:02.980864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d71a34a1-c7ec-46ca-a86e-e83c82669503 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:02.981503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d71a34a1-c7ec-46ca-a86e-e83c82669503 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:02.982522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d71a34a1-c7ec-46ca-a86e-e83c82669503 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:02.983113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d71a34a1-c7ec-46ca-a86e-e83c82669503 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:03.382362 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d71a34a1-c7ec-46ca-a86e-e83c82669503 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "POST /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207/action" status: 202 len: 0 microversion: 2.1 time: 0.422286 Jul 26 19:52:03.392352 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1099/2176] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:02 2022] POST /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 19:52:03.402498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0e86ebcd-6f8a-4d21-b5c0-1a3e1bef4d35 req-d32a61af-60ce-4feb-afdb-73a4bd997645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7590d85-2a5f-4738-b35c-7958afa834a1", "name": "network-vif-deleted", "tag": "5ede25db-702f-4589-b58b-60c96d75d1a8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:03.439956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0e86ebcd-6f8a-4d21-b5c0-1a3e1bef4d35 req-d32a61af-60ce-4feb-afdb-73a4bd997645 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:03.440401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0e86ebcd-6f8a-4d21-b5c0-1a3e1bef4d35 req-d32a61af-60ce-4feb-afdb-73a4bd997645 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:03.470645 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0e86ebcd-6f8a-4d21-b5c0-1a3e1bef4d35 req-d32a61af-60ce-4feb-afdb-73a4bd997645 service nova] Creating event network-vif-deleted:5ede25db-702f-4589-b58b-60c96d75d1a8 for instance b7590d85-2a5f-4738-b35c-7958afa834a1 on n-h1-708768-8 Jul 26 19:52:03.488622 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0e86ebcd-6f8a-4d21-b5c0-1a3e1bef4d35 req-d32a61af-60ce-4feb-afdb-73a4bd997645 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099360 Jul 26 19:52:03.489240 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1100/2177] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:03.509771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3d87ff06-bf5c-48d5-a50a-931ff8c37ced tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:03.511991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3d87ff06-bf5c-48d5-a50a-931ff8c37ced tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:03.530959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d87ff06-bf5c-48d5-a50a-931ff8c37ced tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:03.530959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d87ff06-bf5c-48d5-a50a-931ff8c37ced tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:03.532507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d87ff06-bf5c-48d5-a50a-931ff8c37ced tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:03.536717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d87ff06-bf5c-48d5-a50a-931ff8c37ced tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:03.838626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3d87ff06-bf5c-48d5-a50a-931ff8c37ced tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:03.856876 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3d87ff06-bf5c-48d5-a50a-931ff8c37ced tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1322 microversion: 2.1 time: 0.362333 Jul 26 19:52:03.871716 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1101/2178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:03 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:03.877292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-05fad096-193a-4737-a680-8bab2609e425 req-3852ece9-90ae-440f-a8a3-9bd11feb532d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e730bb-a29a-4608-8c7a-37f0a157059a", "name": "network-vif-deleted", "tag": "0eddb3a8-12a7-4dd0-a852-aa571ba0e978"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:03.900990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-05fad096-193a-4737-a680-8bab2609e425 req-3852ece9-90ae-440f-a8a3-9bd11feb532d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:03.901441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-05fad096-193a-4737-a680-8bab2609e425 req-3852ece9-90ae-440f-a8a3-9bd11feb532d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:03.924492 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-05fad096-193a-4737-a680-8bab2609e425 req-3852ece9-90ae-440f-a8a3-9bd11feb532d service nova] Creating event network-vif-deleted:0eddb3a8-12a7-4dd0-a852-aa571ba0e978 for instance 47e730bb-a29a-4608-8c7a-37f0a157059a on n-h1-708768-8 Jul 26 19:52:03.939550 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-05fad096-193a-4737-a680-8bab2609e425 req-3852ece9-90ae-440f-a8a3-9bd11feb532d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066078 Jul 26 19:52:03.942557 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1102/2179] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:03.957608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:03.966753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] [instance: b7590d85-2a5f-4738-b35c-7958afa834a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:03.979208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:03.980186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:03.982111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:03.982552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:04.013234 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] HTTP exception thrown: Instance b7590d85-2a5f-4738-b35c-7958afa834a1 could not be found. Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Request method failure captured: Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 HTTP/1.1 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EWQaO6nxLYgvyxu86Rl6hGns5mhqlPn0JOuv3wxNXoL-RxbwPGfX87aEinUBQa-P7M-hohyzahRumv40nsG8zNZh-dlIm72wxdGMyB0Pkz939NoU8qvTZdTMH8JbcsX4rF58RifYqMlzWVDaCHC4DtF3JcpE3o0bID-7bU5e02TT1g Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: db03cc70ec3449dba93baafb7a0762f4 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestFqdnHostnames-850265188 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/db03cc70ec3449dba93baafb7a0762f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db03cc70ec3449dba93baafb7a0762f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_db03cc70ec3449dba93baafb7a0762f4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/db03cc70ec3449dba93baafb7a0762f4"}]}] Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestFqdnHostnames-850265188 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: db03cc70ec3449dba93baafb7a0762f4 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-850265188 Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestFqdnHostnames-850265188-project Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 270af76b143f4e329b2e941d257b042f Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestFqdnHostnames-850265188-project Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance b7590d85-2a5f-4738-b35c-7958afa834a1 could not be found. Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'b7590d85-2a5f-4738-b35c-7958afa834a1'} Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7590d85-2a5f-4738-b35c-7958afa834a1 could not be found. Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7590d85-2a5f-4738-b35c-7958afa834a1 could not be found. Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:04.018816 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:04.022467 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:04.022467 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:04.022467 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:04.022467 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:52:04.022467 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:52:04.022467 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7590d85-2a5f-4738-b35c-7958afa834a1 could not be found. Jul 26 19:52:04.022467 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:04.022467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Returning 404 to user: Instance b7590d85-2a5f-4738-b35c-7958afa834a1 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:52:04.023638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8b0c3aa-7702-4b1b-b2f6-6d94623ede85 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1" status: 404 len: 111 microversion: 2.1 time: 0.079659 Jul 26 19:52:04.024432 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1103/2180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:03 2022] GET /compute/v2.1/servers/b7590d85-2a5f-4738-b35c-7958afa834a1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:52:04.035282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ea699eae-3f0a-49ee-8dae-049bd0c19b0b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e96a1f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:04.057615 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b039d7ec-6cec-4f3c-b89d-e78c170e4837 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.252237 Jul 26 19:52:04.070696 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1078/2181] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:51:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:04.070696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:04.070696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:04.081398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:04.081856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:04.082654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:04.083100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:04.168596 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ea699eae-3f0a-49ee-8dae-049bd0c19b0b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.138342 Jul 26 19:52:04.170789 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1104/2182] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:04 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:04.191031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-739fe585-6826-461a-8400-8f72c8879641 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] Calling method '.version_select at 0x7f87683463a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:04.232008 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-739fe585-6826-461a-8400-8f72c8879641 tempest-ServersTestFqdnHostnames-850265188 tempest-ServersTestFqdnHostnames-850265188-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-419891600" status: 202 len: 0 microversion: 2.1 time: 0.057458 Jul 26 19:52:04.233937 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1105/2183] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-419891600 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:52:04.254170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1839053429", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "07bc5316-7c4a-4225-9806-6105d63a8afa"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:04.290738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:04.300443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:04.321657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:04.324717 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-842599eb-a6fb-416e-b6b2-3c32b3290ec5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1265 microversion: 2.25 time: 0.264260 Jul 26 19:52:04.342315 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1079/2184] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:04 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:04.370360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] validate_networks() for [('07bc5316-7c4a-4225-9806-6105d63a8afa', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:52:04.630203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-84317f15-7d12-4efa-8fa2-195efd6d504d req-dde9b52d-f9d0-4ca4-b4ca-494319492a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc24d0ee-65ce-4620-a3b2-263af9715a2e", "name": "network-vif-unplugged", "status": "completed", "tag": "86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:04.647722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-84317f15-7d12-4efa-8fa2-195efd6d504d req-dde9b52d-f9d0-4ca4-b4ca-494319492a30 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:04.648473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-84317f15-7d12-4efa-8fa2-195efd6d504d req-dde9b52d-f9d0-4ca4-b4ca-494319492a30 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:04.662908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:04.665520 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-84317f15-7d12-4efa-8fa2-195efd6d504d req-dde9b52d-f9d0-4ca4-b4ca-494319492a30 service nova] Creating event network-vif-unplugged:86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8 for instance cc24d0ee-65ce-4620-a3b2-263af9715a2e on n-h2-708768-8 Jul 26 19:52:04.681923 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-84317f15-7d12-4efa-8fa2-195efd6d504d req-dde9b52d-f9d0-4ca4-b4ca-494319492a30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064460 Jul 26 19:52:04.683879 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1080/2185] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:52:04.921745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab0c5a9f-0e53-4f7c-bcb5-3b860778f6b8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:04.924485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ab0c5a9f-0e53-4f7c-bcb5-3b860778f6b8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:04.951110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0c5a9f-0e53-4f7c-bcb5-3b860778f6b8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:04.951974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0c5a9f-0e53-4f7c-bcb5-3b860778f6b8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:04.953243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0c5a9f-0e53-4f7c-bcb5-3b860778f6b8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:04.953979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0c5a9f-0e53-4f7c-bcb5-3b860778f6b8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:05.528429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ab0c5a9f-0e53-4f7c-bcb5-3b860778f6b8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:05.538649 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ab0c5a9f-0e53-4f7c-bcb5-3b860778f6b8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1322 microversion: 2.1 time: 0.661142 Jul 26 19:52:05.561299 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1081/2186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:04 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1322 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:05.569613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1bcb591d-6879-4688-a6a3-5aa506789c36 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683acdc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:05.628190 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1bcb591d-6879-4688-a6a3-5aa506789c36 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.065359 Jul 26 19:52:05.629395 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1082/2187] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:05 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:05.635792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:05.637432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:05.645902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:05.646713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:05.647866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:05.648586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:05.755487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:05.769151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:05.772116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:05.773440 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b3e1b19-a0b9-483f-b8df-af543495b90b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1265 microversion: 2.25 time: 0.142532 Jul 26 19:52:05.774474 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1083/2188] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:05 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:05.906765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:52:05.908380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:52:05.908889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:52:05.909312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:52:05.909733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:52:05.926000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:05.926452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:05.927271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:05.927742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:05.947842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Getting quotas for project e9f1debe663740729a7c1b0bda1f3be8. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:52:05.954044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Getting quotas for user d9a36048b1dd4b55a83ab53268489736 and project e9f1debe663740729a7c1b0bda1f3be8. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:52:05.969881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:52:05.972214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:52:06.038413 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7aee1366-4155-4929-9cf4-56c243720fec tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.799325 Jul 26 19:52:06.039271 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1106/2189] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:52:06.054237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2a85efbc-1ea1-48db-93e8-468d2e6f549a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:06.056531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2a85efbc-1ea1-48db-93e8-468d2e6f549a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:06.207754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2a85efbc-1ea1-48db-93e8-468d2e6f549a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:06.219577 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2a85efbc-1ea1-48db-93e8-468d2e6f549a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1224 microversion: 2.1 time: 0.169699 Jul 26 19:52:06.235526 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1084/2190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:06 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1224 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:06.574375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aec75001-2665-43d0-a556-0264a4758e00 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:06.575264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aec75001-2665-43d0-a556-0264a4758e00 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:06.606516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aec75001-2665-43d0-a556-0264a4758e00 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:06.607955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aec75001-2665-43d0-a556-0264a4758e00 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:06.608982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aec75001-2665-43d0-a556-0264a4758e00 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:06.611889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aec75001-2665-43d0-a556-0264a4758e00 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:06.644666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-645a4fcf-da01-4552-947a-7b9694ec1c71 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683fd040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:06.717201 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-645a4fcf-da01-4552-947a-7b9694ec1c71 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.076634 Jul 26 19:52:06.728006 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1085/2191] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:06 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:06.740026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-320dfafa-9f01-4c5b-a104-f459c4fd86da req-a0c758d5-bc61-41af-97fc-9481e1aa33f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a15e74a-9354-4cf2-908d-2c9191b2ef96", "name": "network-vif-plugged", "status": "completed", "tag": "c56a0e33-dd68-4bcf-b1d1-6aa56969b87d"}, {"server_uuid": "2e85cae1-2beb-4a4f-9ff6-b6f594b088b2", "name": "network-vif-plugged", "status": "completed", "tag": "df3b4566-8e9d-48e1-ab1e-4fdc624c5211"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:06.766946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-320dfafa-9f01-4c5b-a104-f459c4fd86da req-a0c758d5-bc61-41af-97fc-9481e1aa33f6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:06.767396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-320dfafa-9f01-4c5b-a104-f459c4fd86da req-a0c758d5-bc61-41af-97fc-9481e1aa33f6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:06.800944 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-320dfafa-9f01-4c5b-a104-f459c4fd86da req-a0c758d5-bc61-41af-97fc-9481e1aa33f6 service nova] Creating event network-vif-plugged:c56a0e33-dd68-4bcf-b1d1-6aa56969b87d for instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 on n-h1-708768-8 Jul 26 19:52:06.803583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-320dfafa-9f01-4c5b-a104-f459c4fd86da req-a0c758d5-bc61-41af-97fc-9481e1aa33f6 service nova] Creating event network-vif-plugged:df3b4566-8e9d-48e1-ab1e-4fdc624c5211 for instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 on n-h2-708768-8 Jul 26 19:52:06.829651 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-320dfafa-9f01-4c5b-a104-f459c4fd86da req-a0c758d5-bc61-41af-97fc-9481e1aa33f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099526 Jul 26 19:52:06.830333 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1086/2192] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:06.837010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:06.838029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:06.846142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:06.846896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:06.847903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:06.848562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:07.355531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:07.371192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:07.377736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:07.382439 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-997be5ec-3577-4acf-9c03-6761c12d357a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1265 microversion: 2.25 time: 0.550023 Jul 26 19:52:07.388082 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1087/2193] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:06 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1265 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:07.406349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-07385192-ee63-44aa-867e-457fd85cf095 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:07.406874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-07385192-ee63-44aa-867e-457fd85cf095 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:07.423257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-07385192-ee63-44aa-867e-457fd85cf095 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:07.423742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-07385192-ee63-44aa-867e-457fd85cf095 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:07.429184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-07385192-ee63-44aa-867e-457fd85cf095 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:07.429689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-07385192-ee63-44aa-867e-457fd85cf095 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:07.687217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aec75001-2665-43d0-a556-0264a4758e00 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:07.694658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:07.710162 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aec75001-2665-43d0-a556-0264a4758e00 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1322 microversion: 2.1 time: 1.139944 Jul 26 19:52:07.712168 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1107/2194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:06 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1322 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:07.737286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09d8392c-fe68-4357-846a-40fc1066705c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683468b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:07.816065 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09d8392c-fe68-4357-846a-40fc1066705c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.084388 Jul 26 19:52:07.817025 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1108/2195] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:07 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:08.336922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-07385192-ee63-44aa-867e-457fd85cf095 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:08.352641 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-07385192-ee63-44aa-867e-457fd85cf095 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1276 microversion: 2.1 time: 0.963432 Jul 26 19:52:08.355530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1088/2196] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:07 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1276 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:08.413864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:08.414482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:08.417795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:08.423137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:08.423590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:08.444788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:08.445256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:08.641320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:08.657186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:08.664488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:08.665978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8cb8b754-aa24-4d96-b108-1698e1a1a2e5 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1265 microversion: 2.25 time: 0.256584 Jul 26 19:52:08.681467 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1109/2197] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:08 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:08.733808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-31a93a22-6ce3-4728-aa23-44c6e73f412a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:08.734848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-31a93a22-6ce3-4728-aa23-44c6e73f412a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:08.748543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31a93a22-6ce3-4728-aa23-44c6e73f412a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:08.764511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31a93a22-6ce3-4728-aa23-44c6e73f412a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:08.768397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31a93a22-6ce3-4728-aa23-44c6e73f412a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:08.771474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31a93a22-6ce3-4728-aa23-44c6e73f412a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:08.835008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c2af30fd-4d5d-41f1-aefa-aba4ef14cab3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e96a9d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:08.924353 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c2af30fd-4d5d-41f1-aefa-aba4ef14cab3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.092906 Jul 26 19:52:08.931586 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1110/2198] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:08 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:09.379470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ccde687-ee16-44e4-ba20-04981af82d44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:09.380142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6ccde687-ee16-44e4-ba20-04981af82d44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:09.407244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ccde687-ee16-44e4-ba20-04981af82d44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:09.409043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ccde687-ee16-44e4-ba20-04981af82d44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:09.412567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ccde687-ee16-44e4-ba20-04981af82d44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:09.415961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ccde687-ee16-44e4-ba20-04981af82d44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:09.647254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6ccde687-ee16-44e4-ba20-04981af82d44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:09.660210 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6ccde687-ee16-44e4-ba20-04981af82d44 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1282 microversion: 2.1 time: 0.286131 Jul 26 19:52:09.684299 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1111/2199] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:09 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1282 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:09.700072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:09.701217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:09.722590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:09.723221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:09.724157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:09.728970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:09.891841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:09.907081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:09.916222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:09.917516 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-74a58f1b-8fd5-43dd-9bce-176c3f6e49ec tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1265 microversion: 2.25 time: 0.224307 Jul 26 19:52:09.950437 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1112/2200] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:09 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:09.957210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-dbd16ae2-4bf6-4966-b641-baad7df5e9cf req-1e41688d-467c-4814-9df6-18ad9020aecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f8c415-4c1d-4e8c-b3a6-2b1f20db3207", "name": "network-vif-plugged", "status": "completed", "tag": "6a23c3cf-1752-438a-abe4-d9745485a1b1"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:09.981932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dbd16ae2-4bf6-4966-b641-baad7df5e9cf req-1e41688d-467c-4814-9df6-18ad9020aecc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:09.982526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dbd16ae2-4bf6-4966-b641-baad7df5e9cf req-1e41688d-467c-4814-9df6-18ad9020aecc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:09.999438 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-dbd16ae2-4bf6-4966-b641-baad7df5e9cf req-1e41688d-467c-4814-9df6-18ad9020aecc service nova] Creating event network-vif-plugged:6a23c3cf-1752-438a-abe4-d9745485a1b1 for instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 on n-h1-708768-8 Jul 26 19:52:10.007157 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-dbd16ae2-4bf6-4966-b641-baad7df5e9cf req-1e41688d-467c-4814-9df6-18ad9020aecc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054566 Jul 26 19:52:10.009586 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1113/2201] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:10.020412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1fc2895-130f-48fb-8fb1-c97155115477 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683b2280>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:10.142621 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1fc2895-130f-48fb-8fb1-c97155115477 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.130983 Jul 26 19:52:10.144367 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1114/2202] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:10 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:10.363409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-31a93a22-6ce3-4728-aa23-44c6e73f412a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:10.371925 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-31a93a22-6ce3-4728-aa23-44c6e73f412a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1322 microversion: 2.1 time: 1.644094 Jul 26 19:52:10.372519 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1089/2203] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:08 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1322 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:10.687109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3f8e325-759c-44ee-adb9-e2f7f26a9355 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:10.688026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b3f8e325-759c-44ee-adb9-e2f7f26a9355 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:10.716740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3f8e325-759c-44ee-adb9-e2f7f26a9355 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:10.717201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3f8e325-759c-44ee-adb9-e2f7f26a9355 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:10.718014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3f8e325-759c-44ee-adb9-e2f7f26a9355 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:10.718457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3f8e325-759c-44ee-adb9-e2f7f26a9355 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:10.953601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:10.954417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:10.960482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b3f8e325-759c-44ee-adb9-e2f7f26a9355 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:10.967087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:10.970592 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3f8e325-759c-44ee-adb9-e2f7f26a9355 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1282 microversion: 2.1 time: 0.288868 Jul 26 19:52:10.971425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:10.973757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:10.980490 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1115/2204] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:10 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1282 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:10.981740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:11.159430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0249cfd2-501c-4665-bcba-b01e28a2c7a8 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683b2310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:11.257116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:11.258224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0249cfd2-501c-4665-bcba-b01e28a2c7a8 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.103127 Jul 26 19:52:11.259153 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1116/2205] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:11 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:11.285241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:11.287095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:11.288981 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba4a341d-20b7-48fd-a07d-7fc2b3847254 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1265 microversion: 2.25 time: 0.348274 Jul 26 19:52:11.294162 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1090/2206] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:10 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:52:11.394914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bb101091-0eeb-43b3-a06c-993536b20350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:11.395543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb101091-0eeb-43b3-a06c-993536b20350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:11.407390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb101091-0eeb-43b3-a06c-993536b20350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:11.409109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb101091-0eeb-43b3-a06c-993536b20350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:11.409926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb101091-0eeb-43b3-a06c-993536b20350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:11.410380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb101091-0eeb-43b3-a06c-993536b20350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:11.890792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bb101091-0eeb-43b3-a06c-993536b20350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:11.906453 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bb101091-0eeb-43b3-a06c-993536b20350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1517 microversion: 2.1 time: 0.515983 Jul 26 19:52:11.917227 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1117/2207] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:11 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1517 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:11.938260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5a27a09-fe3d-44f4-b7d0-f524c304e118 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:11.941432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f5a27a09-fe3d-44f4-b7d0-f524c304e118 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:11.963503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5a27a09-fe3d-44f4-b7d0-f524c304e118 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:11.974510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5a27a09-fe3d-44f4-b7d0-f524c304e118 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:11.978159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5a27a09-fe3d-44f4-b7d0-f524c304e118 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:11.978934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5a27a09-fe3d-44f4-b7d0-f524c304e118 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:12.000145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c42fcd07-4883-4cee-a2d9-f32b173da853 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:12.001467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c42fcd07-4883-4cee-a2d9-f32b173da853 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:12.025343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c42fcd07-4883-4cee-a2d9-f32b173da853 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:12.025808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c42fcd07-4883-4cee-a2d9-f32b173da853 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:12.027458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c42fcd07-4883-4cee-a2d9-f32b173da853 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:12.028161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c42fcd07-4883-4cee-a2d9-f32b173da853 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:12.108815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:12.159868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-f5a27a09-fe3d-44f4-b7d0-f524c304e118 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lazy-loading 'flavor' on Instance uuid 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:52:12.341426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c42fcd07-4883-4cee-a2d9-f32b173da853 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:12.354035 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c42fcd07-4883-4cee-a2d9-f32b173da853 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1282 microversion: 2.1 time: 0.358186 Jul 26 19:52:12.371501 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1118/2208] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:11 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1282 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:12.376621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c4cf2505-b4cd-4c5d-8ece-090a70aa8915 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ec61af0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:12.458003 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c4cf2505-b4cd-4c5d-8ece-090a70aa8915 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.085094 Jul 26 19:52:12.459783 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1119/2209] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:12 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:12.466786 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5a27a09-fe3d-44f4-b7d0-f524c304e118 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2/action" status: 200 len: 32 microversion: 2.1 time: 0.526081 Jul 26 19:52:12.469909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:12.471577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:12.485767 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1091/2210] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:11 2022] POST /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:52:12.492027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:12.494282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:12.497006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:12.499256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:12.505357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-028da5f6-cfc7-41e3-8a7c-6ac00ae3a4e4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:12.507969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-028da5f6-cfc7-41e3-8a7c-6ac00ae3a4e4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:12.530433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-028da5f6-cfc7-41e3-8a7c-6ac00ae3a4e4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:12.530890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-028da5f6-cfc7-41e3-8a7c-6ac00ae3a4e4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:12.532143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-028da5f6-cfc7-41e3-8a7c-6ac00ae3a4e4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:12.532584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-028da5f6-cfc7-41e3-8a7c-6ac00ae3a4e4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:12.692821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:12.707657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:12.713524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:12.716683 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-942dca2d-b933-4c9e-a0fa-70827bd243a1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 200 len: 1265 microversion: 2.25 time: 0.255587 Jul 26 19:52:12.717287 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1120/2211] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:12 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:13.258112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1702344997", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:13.371479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] validate_networks() for [('787ab92c-cec3-424a-8023-2c91a1c73011', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:52:13.408813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-028da5f6-cfc7-41e3-8a7c-6ac00ae3a4e4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:13.448795 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-028da5f6-cfc7-41e3-8a7c-6ac00ae3a4e4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 0.955173 Jul 26 19:52:13.454471 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1092/2212] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:12 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:13.478544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fca439f4-2108-4f89-b8f7-6049146319e5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:13.479183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fca439f4-2108-4f89-b8f7-6049146319e5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:13.506999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fca439f4-2108-4f89-b8f7-6049146319e5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:13.507459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fca439f4-2108-4f89-b8f7-6049146319e5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:13.517375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fca439f4-2108-4f89-b8f7-6049146319e5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:13.517891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fca439f4-2108-4f89-b8f7-6049146319e5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:14.363807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:52:14.364232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:52:14.365527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:52:14.365948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:52:14.366637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:52:14.408801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:14.409397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:14.412744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:14.413620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:14.468833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Getting quotas for project e0c99967c0194f28b724c14859ca05ab. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:52:14.475672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Getting quotas for user e7f38af412694fbcaa276d2f166b21c1 and project e0c99967c0194f28b724c14859ca05ab. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:52:14.493685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:52:14.497486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:52:14.607423 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-71a63349-e39a-4a42-bfab-9f48beb9c192 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.525176 Jul 26 19:52:14.613690 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1121/2213] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:52:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:52:14.624183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de1d6121-7cd0-40b0-abe6-a4184d32fe63 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ec61ca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:14.704446 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de1d6121-7cd0-40b0-abe6-a4184d32fe63 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.089452 Jul 26 19:52:14.705793 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1122/2214] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:14 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:14.713288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:14.714626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 47e730bb-a29a-4608-8c7a-37f0a157059a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:14.722644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:14.723371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:14.724338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:14.724925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:14.759588 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] HTTP exception thrown: Instance 47e730bb-a29a-4608-8c7a-37f0a157059a could not be found. Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Request method failure captured: Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a HTTP/1.1 Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERVjQqDqk9BRBOz-OErVSdqFFSSuBz9r1VRmcBWZQ3R5kTDW9mYA2PYlueUYWfDP79tndE4CtlO_70oPMiPDN_LiHmDjD_BEyjER-BQhrRgLiYBV0rA1ITDA5psJ6P36zM_H_Jb7m8ptmSL2O3eygnpXmGrKPbR814wrRWw6TwEhBI Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 3d10540a08974fd0854fea20ae5c216b Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d10540a08974fd0854fea20ae5c216b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d10540a08974fd0854fea20ae5c216b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d10540a08974fd0854fea20ae5c216b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d10540a08974fd0854fea20ae5c216b"}]}] Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 3d10540a08974fd0854fea20ae5c216b Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-LiveAutoBlockMigrationV225Test-1024770381-project Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ccd551ea4e0641a0bf17d669481136fa Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381-project Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 47e730bb-a29a-4608-8c7a-37f0a157059a could not be found. Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '47e730bb-a29a-4608-8c7a-37f0a157059a'} Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e730bb-a29a-4608-8c7a-37f0a157059a could not be found. Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e730bb-a29a-4608-8c7a-37f0a157059a could not be found. Jul 26 19:52:14.781326 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e730bb-a29a-4608-8c7a-37f0a157059a could not be found. Jul 26 19:52:14.784687 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:14.786654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Returning 404 to user: Instance 47e730bb-a29a-4608-8c7a-37f0a157059a could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:52:14.787846 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d7191252-cba1-4ac4-9bdf-8dcf6c26ac7e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a" status: 404 len: 111 microversion: 2.25 time: 0.080677 Jul 26 19:52:14.788859 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1123/2215] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:14 2022] GET /compute/v2.1/servers/47e730bb-a29a-4608-8c7a-37f0a157059a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:52:14.806747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7bf903d1-aba7-40f1-b0ca-43d81f9f8bb9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:14.807395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7bf903d1-aba7-40f1-b0ca-43d81f9f8bb9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:14.826386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bf903d1-aba7-40f1-b0ca-43d81f9f8bb9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:14.826857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bf903d1-aba7-40f1-b0ca-43d81f9f8bb9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:14.827689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bf903d1-aba7-40f1-b0ca-43d81f9f8bb9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:14.828137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bf903d1-aba7-40f1-b0ca-43d81f9f8bb9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:15.039144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fca439f4-2108-4f89-b8f7-6049146319e5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:15.054601 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fca439f4-2108-4f89-b8f7-6049146319e5 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1282 microversion: 2.1 time: 1.598916 Jul 26 19:52:15.060722 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1093/2216] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:13 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1282 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:15.072200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d214b7eb-d19b-47ba-8ec2-6aca054517a8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:15.072830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d214b7eb-d19b-47ba-8ec2-6aca054517a8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:15.236431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d214b7eb-d19b-47ba-8ec2-6aca054517a8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:15.244429 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d214b7eb-d19b-47ba-8ec2-6aca054517a8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1223 microversion: 2.1 time: 0.182578 Jul 26 19:52:15.257764 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1094/2217] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:15 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1223 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:15.724608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b52e5355-5aa3-468b-974b-0057fe74251a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768399040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:15.824917 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b52e5355-5aa3-468b-974b-0057fe74251a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.105154 Jul 26 19:52:15.825841 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1095/2218] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:15 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:16.081522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e873a6f4-84e1-410e-8ced-a7c2b044cee7 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:16.082259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e873a6f4-84e1-410e-8ced-a7c2b044cee7 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:16.092639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e873a6f4-84e1-410e-8ced-a7c2b044cee7 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:16.094853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e873a6f4-84e1-410e-8ced-a7c2b044cee7 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:16.096042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e873a6f4-84e1-410e-8ced-a7c2b044cee7 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:16.102014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e873a6f4-84e1-410e-8ced-a7c2b044cee7 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:16.104262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7bf903d1-aba7-40f1-b0ca-43d81f9f8bb9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:16.117007 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7bf903d1-aba7-40f1-b0ca-43d81f9f8bb9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 1.321011 Jul 26 19:52:16.117601 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1124/2219] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:14 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:16.266647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad4285e7-1714-47e8-ae93-a4cd167d4f34 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:16.267761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ad4285e7-1714-47e8-ae93-a4cd167d4f34 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:16.286288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad4285e7-1714-47e8-ae93-a4cd167d4f34 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:16.289894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad4285e7-1714-47e8-ae93-a4cd167d4f34 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:16.296313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad4285e7-1714-47e8-ae93-a4cd167d4f34 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:16.297279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad4285e7-1714-47e8-ae93-a4cd167d4f34 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:16.917126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ad4285e7-1714-47e8-ae93-a4cd167d4f34 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:16.927201 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ad4285e7-1714-47e8-ae93-a4cd167d4f34 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1275 microversion: 2.1 time: 0.665455 Jul 26 19:52:16.928546 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1125/2220] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:16 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1275 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:16.943759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e1e60012-a4e0-47b2-9bb7-512a55d4e86f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ecdcd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:17.046441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e1e60012-a4e0-47b2-9bb7-512a55d4e86f tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.115766 Jul 26 19:52:17.053317 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1126/2221] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:16 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:17.139414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-faf71369-9eef-4288-a058-fa1e4520d350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:17.140016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-faf71369-9eef-4288-a058-fa1e4520d350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:17.157293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faf71369-9eef-4288-a058-fa1e4520d350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:17.161685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faf71369-9eef-4288-a058-fa1e4520d350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:17.164883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faf71369-9eef-4288-a058-fa1e4520d350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:17.165739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faf71369-9eef-4288-a058-fa1e4520d350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:17.416951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e873a6f4-84e1-410e-8ced-a7c2b044cee7 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:17.438418 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e873a6f4-84e1-410e-8ced-a7c2b044cee7 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 1.361141 Jul 26 19:52:17.439021 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1096/2222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:16 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:17.951294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29730bcd-c94e-4d86-a3b9-d6393010e451 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:17.952372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-29730bcd-c94e-4d86-a3b9-d6393010e451 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:17.961251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:17.965433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29730bcd-c94e-4d86-a3b9-d6393010e451 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:17.974946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29730bcd-c94e-4d86-a3b9-d6393010e451 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:17.976944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29730bcd-c94e-4d86-a3b9-d6393010e451 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:17.981098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29730bcd-c94e-4d86-a3b9-d6393010e451 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:17.985992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-faf71369-9eef-4288-a058-fa1e4520d350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:17.997383 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-faf71369-9eef-4288-a058-fa1e4520d350 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 0.862538 Jul 26 19:52:18.011777 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1127/2223] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:17 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:18.068380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88cfa78d-1b9f-4cf6-bcb3-a465449cd335 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875e96a3a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:18.149789 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-88cfa78d-1b9f-4cf6-bcb3-a465449cd335 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.085015 Jul 26 19:52:18.160264 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1128/2224] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:18 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:18.459667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dab23c12-d3b0-4062-abc2-f779f8cd2636 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:18.460662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dab23c12-d3b0-4062-abc2-f779f8cd2636 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:18.475591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dab23c12-d3b0-4062-abc2-f779f8cd2636 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:18.477879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dab23c12-d3b0-4062-abc2-f779f8cd2636 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:18.484253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dab23c12-d3b0-4062-abc2-f779f8cd2636 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:18.485173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dab23c12-d3b0-4062-abc2-f779f8cd2636 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:18.751748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-29730bcd-c94e-4d86-a3b9-d6393010e451 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:18.761984 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29730bcd-c94e-4d86-a3b9-d6393010e451 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1281 microversion: 2.1 time: 0.816107 Jul 26 19:52:18.762544 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1097/2225] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:17 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1281 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:19.018224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-140c01e9-241c-483e-ae82-bf3ff6a241da tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:19.019208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-140c01e9-241c-483e-ae82-bf3ff6a241da tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:19.026920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-140c01e9-241c-483e-ae82-bf3ff6a241da tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:19.031196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-140c01e9-241c-483e-ae82-bf3ff6a241da tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:19.033076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-140c01e9-241c-483e-ae82-bf3ff6a241da tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:19.033732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-140c01e9-241c-483e-ae82-bf3ff6a241da tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:19.209728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dab23c12-d3b0-4062-abc2-f779f8cd2636 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:19.224194 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dab23c12-d3b0-4062-abc2-f779f8cd2636 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 0.766387 Jul 26 19:52:19.225701 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1129/2226] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:18 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:19.249383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7670ea0b-adc0-4d65-8745-e5e0b3a2c138 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768346e50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:19.382274 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7670ea0b-adc0-4d65-8745-e5e0b3a2c138 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.155229 Jul 26 19:52:19.382790 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1130/2227] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:19 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:19.584468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-140c01e9-241c-483e-ae82-bf3ff6a241da tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:19.594948 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-140c01e9-241c-483e-ae82-bf3ff6a241da tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 0.580412 Jul 26 19:52:19.598917 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1098/2228] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:19 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:19.785084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1b748611-adcf-4d5c-b890-7229d6be67f9 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:19.786152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1b748611-adcf-4d5c-b890-7229d6be67f9 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:19.808678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b748611-adcf-4d5c-b890-7229d6be67f9 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:19.809406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b748611-adcf-4d5c-b890-7229d6be67f9 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:19.811902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b748611-adcf-4d5c-b890-7229d6be67f9 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:19.812586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b748611-adcf-4d5c-b890-7229d6be67f9 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:20.126278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1eb0ba62-69d2-480d-9efc-0d7094cd6432 req-4861081f-34fc-4d08-bc5d-a99373fbe66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0431a82-56a4-4caf-ae0b-8d3134cdd4ac", "tag": "6d1f569e-4ea6-4590-af93-3af715e57391"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:20.159327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1eb0ba62-69d2-480d-9efc-0d7094cd6432 req-4861081f-34fc-4d08-bc5d-a99373fbe66a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:20.162012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1eb0ba62-69d2-480d-9efc-0d7094cd6432 req-4861081f-34fc-4d08-bc5d-a99373fbe66a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:20.197612 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1eb0ba62-69d2-480d-9efc-0d7094cd6432 req-4861081f-34fc-4d08-bc5d-a99373fbe66a service nova] Creating event network-changed:6d1f569e-4ea6-4590-af93-3af715e57391 for instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac on n-h1-708768-8 Jul 26 19:52:20.229891 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1eb0ba62-69d2-480d-9efc-0d7094cd6432 req-4861081f-34fc-4d08-bc5d-a99373fbe66a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109809 Jul 26 19:52:20.231196 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1099/2229] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:52:20.246914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-55580067-9d6a-4c65-83bb-e27b0c1834a6 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:20.252667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-55580067-9d6a-4c65-83bb-e27b0c1834a6 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:20.275136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55580067-9d6a-4c65-83bb-e27b0c1834a6 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:20.276794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55580067-9d6a-4c65-83bb-e27b0c1834a6 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:20.278317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55580067-9d6a-4c65-83bb-e27b0c1834a6 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:20.279841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55580067-9d6a-4c65-83bb-e27b0c1834a6 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:20.336652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1b748611-adcf-4d5c-b890-7229d6be67f9 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:20.349713 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1b748611-adcf-4d5c-b890-7229d6be67f9 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1281 microversion: 2.1 time: 0.570189 Jul 26 19:52:20.358576 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1131/2230] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:19 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1281 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:20.399145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a841ef91-dcee-4b62-b011-e59a4ea51e45 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ec00790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:20.503712 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a841ef91-dcee-4b62-b011-e59a4ea51e45 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.108808 Jul 26 19:52:20.504303 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1132/2231] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:20 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:20.619141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5770415c-66d3-4a0d-8ec7-c30ec76deba0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:20.627353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5770415c-66d3-4a0d-8ec7-c30ec76deba0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:20.642773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5770415c-66d3-4a0d-8ec7-c30ec76deba0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:20.643509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5770415c-66d3-4a0d-8ec7-c30ec76deba0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:20.644704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5770415c-66d3-4a0d-8ec7-c30ec76deba0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:20.645294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5770415c-66d3-4a0d-8ec7-c30ec76deba0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:20.837131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-55580067-9d6a-4c65-83bb-e27b0c1834a6 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:20.852262 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-55580067-9d6a-4c65-83bb-e27b0c1834a6 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 0.609434 Jul 26 19:52:20.853409 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1100/2232] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:20 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:21.379282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f816983-bcfe-4fd2-bdd5-1960e01b609d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:21.381121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f816983-bcfe-4fd2-bdd5-1960e01b609d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:21.418080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f816983-bcfe-4fd2-bdd5-1960e01b609d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:21.421162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f816983-bcfe-4fd2-bdd5-1960e01b609d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:21.424821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f816983-bcfe-4fd2-bdd5-1960e01b609d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:21.426626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f816983-bcfe-4fd2-bdd5-1960e01b609d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:21.559222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5770415c-66d3-4a0d-8ec7-c30ec76deba0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:21.577309 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5770415c-66d3-4a0d-8ec7-c30ec76deba0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 0.961902 Jul 26 19:52:21.591700 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1133/2233] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:20 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:21.601775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0e2ef57-5f99-4e7f-bad3-bc4fcc9e5c41 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ed13b80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:21.725739 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0e2ef57-5f99-4e7f-bad3-bc4fcc9e5c41 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.140493 Jul 26 19:52:21.727912 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1134/2234] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:21 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:21.875978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15e3541e-69b6-4e27-8b03-e8e26c3d1bcc tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:21.876789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-15e3541e-69b6-4e27-8b03-e8e26c3d1bcc tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:21.899486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15e3541e-69b6-4e27-8b03-e8e26c3d1bcc tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:21.900620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15e3541e-69b6-4e27-8b03-e8e26c3d1bcc tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:21.904162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15e3541e-69b6-4e27-8b03-e8e26c3d1bcc tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:21.905704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15e3541e-69b6-4e27-8b03-e8e26c3d1bcc tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:22.063205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f816983-bcfe-4fd2-bdd5-1960e01b609d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:22.088499 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f816983-bcfe-4fd2-bdd5-1960e01b609d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1323 microversion: 2.1 time: 0.713320 Jul 26 19:52:22.099174 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1101/2235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:21 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1323 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:22.600934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c7bef12-4613-498b-a932-d1d91d42a612 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:22.602469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2c7bef12-4613-498b-a932-d1d91d42a612 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:22.617141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c7bef12-4613-498b-a932-d1d91d42a612 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:22.624380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c7bef12-4613-498b-a932-d1d91d42a612 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:22.630847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c7bef12-4613-498b-a932-d1d91d42a612 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:22.631362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c7bef12-4613-498b-a932-d1d91d42a612 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:23.477529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c7bef12-4613-498b-a932-d1d91d42a612 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:23.487376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c7bef12-4613-498b-a932-d1d91d42a612 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 0.892212 Jul 26 19:52:23.506490 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1102/2236] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:22 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:23.516816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-58c997d9-97a0-4733-8a54-47d9bdb35946 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683a1a60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:23.666200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-58c997d9-97a0-4733-8a54-47d9bdb35946 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.156563 Jul 26 19:52:23.681025 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1103/2237] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:23 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:23.723134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5271265-426d-4dc3-84ad-43cecb6c5770 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:23.723833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5271265-426d-4dc3-84ad-43cecb6c5770 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:23.788603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5271265-426d-4dc3-84ad-43cecb6c5770 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:23.789067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5271265-426d-4dc3-84ad-43cecb6c5770 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:23.789872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5271265-426d-4dc3-84ad-43cecb6c5770 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:23.790319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5271265-426d-4dc3-84ad-43cecb6c5770 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:23.793515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15e3541e-69b6-4e27-8b03-e8e26c3d1bcc tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:23.810710 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15e3541e-69b6-4e27-8b03-e8e26c3d1bcc tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 1.939236 Jul 26 19:52:23.820258 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1135/2238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:21 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:24.209552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a34bcfbe-dce0-43cb-aaa8-0b18da187b9e tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:24.210340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a34bcfbe-dce0-43cb-aaa8-0b18da187b9e tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:24.221654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a34bcfbe-dce0-43cb-aaa8-0b18da187b9e tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:24.227361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a34bcfbe-dce0-43cb-aaa8-0b18da187b9e tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:24.230832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a34bcfbe-dce0-43cb-aaa8-0b18da187b9e tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:24.233124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a34bcfbe-dce0-43cb-aaa8-0b18da187b9e tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:24.435324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:24.485993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:25.063116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c5271265-426d-4dc3-84ad-43cecb6c5770 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:25.073966 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5271265-426d-4dc3-84ad-43cecb6c5770 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1323 microversion: 2.1 time: 1.383316 Jul 26 19:52:25.076910 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1104/2239] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:23 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1323 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:25.081860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-92373d47-3c37-4c8b-bad6-7ff27cacfcbd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:25.088693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92373d47-3c37-4c8b-bad6-7ff27cacfcbd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:25.096596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92373d47-3c37-4c8b-bad6-7ff27cacfcbd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:25.098727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92373d47-3c37-4c8b-bad6-7ff27cacfcbd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:25.099858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92373d47-3c37-4c8b-bad6-7ff27cacfcbd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:25.100537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92373d47-3c37-4c8b-bad6-7ff27cacfcbd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:25.253227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:25.399831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-92373d47-3c37-4c8b-bad6-7ff27cacfcbd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:25.413172 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-92373d47-3c37-4c8b-bad6-7ff27cacfcbd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 0.334908 Jul 26 19:52:25.418163 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1105/2240] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:25 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:25.431822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-250fef46-0d03-4248-ae39-9cd21d756370 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683a1310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:25.533320 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-250fef46-0d03-4248-ae39-9cd21d756370 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.112687 Jul 26 19:52:25.533931 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1106/2241] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:25 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:25.573569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-856c3f06-b86b-4f3d-94a9-92e9afb6aa7d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:25.577739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-856c3f06-b86b-4f3d-94a9-92e9afb6aa7d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:25.601147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-856c3f06-b86b-4f3d-94a9-92e9afb6aa7d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:25.601599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-856c3f06-b86b-4f3d-94a9-92e9afb6aa7d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:25.602389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-856c3f06-b86b-4f3d-94a9-92e9afb6aa7d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:25.602829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-856c3f06-b86b-4f3d-94a9-92e9afb6aa7d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:25.915706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-856c3f06-b86b-4f3d-94a9-92e9afb6aa7d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:25.925741 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-856c3f06-b86b-4f3d-94a9-92e9afb6aa7d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 0.390663 Jul 26 19:52:25.934368 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a34bcfbe-dce0-43cb-aaa8-0b18da187b9e tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1858 microversion: 2.1 time: 1.728375 Jul 26 19:52:25.934959 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1136/2242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:24 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1858 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:25.935653 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1107/2243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:25 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:25.962785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-708768-8", "block_migration": true, "disk_over_commit": false}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:25.966277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:25.979027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:25.985505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:25.986540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:25.997068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:26.026911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:26.048805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lazy-loading 'flavor' on Instance uuid a96e47b7-d312-4d66-bd84-8cee85866b25 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:52:26.076822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Going to try to live migrate instance to n-h2-708768-8 {{(pid=125963) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:52:26.098515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-51d0d560-48a5-4aac-a7d3-a899f78306c7 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:26.099772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-51d0d560-48a5-4aac-a7d3-a899f78306c7 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:26.123270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51d0d560-48a5-4aac-a7d3-a899f78306c7 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:26.127788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51d0d560-48a5-4aac-a7d3-a899f78306c7 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:26.128839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51d0d560-48a5-4aac-a7d3-a899f78306c7 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:26.132501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51d0d560-48a5-4aac-a7d3-a899f78306c7 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:26.458171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-51d0d560-48a5-4aac-a7d3-a899f78306c7 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:26.468420 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-51d0d560-48a5-4aac-a7d3-a899f78306c7 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1323 microversion: 2.1 time: 0.374700 Jul 26 19:52:26.469965 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1108/2244] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:26 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1323 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:26.476654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d6bf9822-cb31-4436-92bc-560ceb48cb24 req-28ca1bb8-9402-4317-a342-d67979c43d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d76780-8750-4ef5-9699-2baef38358c3", "tag": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:26.490613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d6bf9822-cb31-4436-92bc-560ceb48cb24 req-28ca1bb8-9402-4317-a342-d67979c43d61 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:26.491473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d6bf9822-cb31-4436-92bc-560ceb48cb24 req-28ca1bb8-9402-4317-a342-d67979c43d61 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:26.506815 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d6bf9822-cb31-4436-92bc-560ceb48cb24 req-28ca1bb8-9402-4317-a342-d67979c43d61 service nova] Creating event network-changed:d62a1a3c-ef55-4efa-9ba6-5bdd693c678c for instance 16d76780-8750-4ef5-9699-2baef38358c3 on n-h2-708768-8 Jul 26 19:52:26.516878 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d6bf9822-cb31-4436-92bc-560ceb48cb24 req-28ca1bb8-9402-4317-a342-d67979c43d61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045369 Jul 26 19:52:26.519327 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1109/2245] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:26.526985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-991bd883-8f19-4420-8eac-fb07f20a2d0d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:26.527975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-991bd883-8f19-4420-8eac-fb07f20a2d0d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:26.536169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-991bd883-8f19-4420-8eac-fb07f20a2d0d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:26.537963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-991bd883-8f19-4420-8eac-fb07f20a2d0d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:26.539015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-991bd883-8f19-4420-8eac-fb07f20a2d0d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:26.539752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-991bd883-8f19-4420-8eac-fb07f20a2d0d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:28.040352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-991bd883-8f19-4420-8eac-fb07f20a2d0d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:28.051747 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-991bd883-8f19-4420-8eac-fb07f20a2d0d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 1.530468 Jul 26 19:52:28.052878 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1110/2246] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:26 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:28.060480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d93fcf14-b9f4-4afc-a50f-8a1b72572fe6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683a13a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:28.162110 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d93fcf14-b9f4-4afc-a50f-8a1b72572fe6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.102594 Jul 26 19:52:28.167126 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1111/2247] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:28 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:28.198007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-277db0a7-60c0-49db-833a-c3e224e945bf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:28.201206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-277db0a7-60c0-49db-833a-c3e224e945bf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:28.232822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-277db0a7-60c0-49db-833a-c3e224e945bf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:28.234127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-277db0a7-60c0-49db-833a-c3e224e945bf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:28.245586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-277db0a7-60c0-49db-833a-c3e224e945bf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:28.246423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-277db0a7-60c0-49db-833a-c3e224e945bf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:28.257304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:28.532130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-277db0a7-60c0-49db-833a-c3e224e945bf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:28.557283 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-277db0a7-60c0-49db-833a-c3e224e945bf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 0.381725 Jul 26 19:52:28.558143 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1112/2248] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:28 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:28.576051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd9c98ca-a225-4447-be68-7617e2e2a558 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:28.576678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd9c98ca-a225-4447-be68-7617e2e2a558 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:28.596344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd9c98ca-a225-4447-be68-7617e2e2a558 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:28.598535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd9c98ca-a225-4447-be68-7617e2e2a558 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:28.600529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd9c98ca-a225-4447-be68-7617e2e2a558 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:28.601913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd9c98ca-a225-4447-be68-7617e2e2a558 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:29.471634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd9c98ca-a225-4447-be68-7617e2e2a558 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:29.484851 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd9c98ca-a225-4447-be68-7617e2e2a558 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1323 microversion: 2.1 time: 0.915913 Jul 26 19:52:29.486034 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1113/2249] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:28 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1323 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:29.500969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ebfb3eb-92f6-4626-8a72-d2bf2078e80c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:29.501680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ebfb3eb-92f6-4626-8a72-d2bf2078e80c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:29.512569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ebfb3eb-92f6-4626-8a72-d2bf2078e80c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:29.519684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ebfb3eb-92f6-4626-8a72-d2bf2078e80c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:29.521496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ebfb3eb-92f6-4626-8a72-d2bf2078e80c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:29.521942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ebfb3eb-92f6-4626-8a72-d2bf2078e80c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:29.599478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ebfb3eb-92f6-4626-8a72-d2bf2078e80c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:52:29.807910 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ebfb3eb-92f6-4626-8a72-d2bf2078e80c tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 204 len: 0 microversion: 2.25 time: 0.320052 Jul 26 19:52:29.812442 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1114/2250] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:52:29 2022] DELETE /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:52:29.826884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1297f1ab-9ab7-4bff-b839-efe13e3f05d9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:29.828054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1297f1ab-9ab7-4bff-b839-efe13e3f05d9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:29.835852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1297f1ab-9ab7-4bff-b839-efe13e3f05d9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:29.836598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1297f1ab-9ab7-4bff-b839-efe13e3f05d9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:29.837545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1297f1ab-9ab7-4bff-b839-efe13e3f05d9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:29.838191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1297f1ab-9ab7-4bff-b839-efe13e3f05d9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:30.171933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1297f1ab-9ab7-4bff-b839-efe13e3f05d9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:30.186249 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1297f1ab-9ab7-4bff-b839-efe13e3f05d9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 0.372313 Jul 26 19:52:30.190035 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1115/2251] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:29 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:30.199476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0fe5ff49-e7c6-4972-93bb-d8888c4eb2a0 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683a1040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:30.322673 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e7889e6-afc8-425e-9a8a-151085b717eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/action" status: 202 len: 0 microversion: 2.1 time: 4.363911 Jul 26 19:52:30.324260 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1137/2252] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:25 2022] POST /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/action => generated 0 bytes in 4366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:52:30.330943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4900a74a-f181-4bd8-b15b-01b72306b87b tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:30.331761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4900a74a-f181-4bd8-b15b-01b72306b87b tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:30.364237 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0fe5ff49-e7c6-4972-93bb-d8888c4eb2a0 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.172235 Jul 26 19:52:30.364827 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1116/2253] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:30 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:30.381298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4900a74a-f181-4bd8-b15b-01b72306b87b tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:30.382032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4900a74a-f181-4bd8-b15b-01b72306b87b tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:30.382992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4900a74a-f181-4bd8-b15b-01b72306b87b tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:30.383118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:30.383683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:30.390899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4900a74a-f181-4bd8-b15b-01b72306b87b tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:30.413611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:30.427601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:30.432389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:30.436811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:30.874923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4900a74a-f181-4bd8-b15b-01b72306b87b tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:30.883708 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4900a74a-f181-4bd8-b15b-01b72306b87b tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 0.557919 Jul 26 19:52:30.888562 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1138/2254] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:30 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:30.897755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5adfa256-b91b-4acc-a2f2-f98bf38c16ff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:30.899577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5adfa256-b91b-4acc-a2f2-f98bf38c16ff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:30.911991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5adfa256-b91b-4acc-a2f2-f98bf38c16ff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:30.912429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5adfa256-b91b-4acc-a2f2-f98bf38c16ff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:30.913321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5adfa256-b91b-4acc-a2f2-f98bf38c16ff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:30.919323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5adfa256-b91b-4acc-a2f2-f98bf38c16ff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:30.920823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:30.937435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:30.943575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:30.948228 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5351ea2-a6fc-433f-8d48-4374f4d46483 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1730 microversion: 2.25 time: 0.581755 Jul 26 19:52:30.951568 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1117/2255] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:30 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1730 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:30.965807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-acbb19e2-23c1-4d06-837c-e39167abe505 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:30.968076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-acbb19e2-23c1-4d06-837c-e39167abe505 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:30.986356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-acbb19e2-23c1-4d06-837c-e39167abe505 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:30.986814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-acbb19e2-23c1-4d06-837c-e39167abe505 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:30.987723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-acbb19e2-23c1-4d06-837c-e39167abe505 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:30.988070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-acbb19e2-23c1-4d06-837c-e39167abe505 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:31.481573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-acbb19e2-23c1-4d06-837c-e39167abe505 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:31.489280 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-acbb19e2-23c1-4d06-837c-e39167abe505 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1323 microversion: 2.1 time: 0.536352 Jul 26 19:52:31.489866 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1118/2256] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:30 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:31.503416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7dadb372-4591-421f-aff2-d54e3a45f113 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:31.508601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7dadb372-4591-421f-aff2-d54e3a45f113 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:31.517613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5adfa256-b91b-4acc-a2f2-f98bf38c16ff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:31.525957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dadb372-4591-421f-aff2-d54e3a45f113 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:31.540748 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5adfa256-b91b-4acc-a2f2-f98bf38c16ff tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.650817 Jul 26 19:52:31.542266 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1139/2257] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:30 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:31.544472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dadb372-4591-421f-aff2-d54e3a45f113 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:31.545558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dadb372-4591-421f-aff2-d54e3a45f113 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:31.549357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bdce49ce-150e-4bf0-b383-85c95e4cc843 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ec61a60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:31.550571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dadb372-4591-421f-aff2-d54e3a45f113 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:31.641675 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bdce49ce-150e-4bf0-b383-85c95e4cc843 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.097943 Jul 26 19:52:31.642679 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1140/2258] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:31 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:31.648364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d2c41dc5-3663-47fa-92b4-82ea35ddbfdd req-a98a1d1c-a3d8-434b-b884-9d73ed0d3870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0431a82-56a4-4caf-ae0b-8d3134cdd4ac", "name": "network-vif-plugged", "status": "completed", "tag": "6d1f569e-4ea6-4590-af93-3af715e57391"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:31.674211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d2c41dc5-3663-47fa-92b4-82ea35ddbfdd req-a98a1d1c-a3d8-434b-b884-9d73ed0d3870 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:31.684304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d2c41dc5-3663-47fa-92b4-82ea35ddbfdd req-a98a1d1c-a3d8-434b-b884-9d73ed0d3870 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:31.700634 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d2c41dc5-3663-47fa-92b4-82ea35ddbfdd req-a98a1d1c-a3d8-434b-b884-9d73ed0d3870 service nova] Creating event network-vif-plugged:6d1f569e-4ea6-4590-af93-3af715e57391 for instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac on n-h1-708768-8 Jul 26 19:52:31.719098 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d2c41dc5-3663-47fa-92b4-82ea35ddbfdd req-a98a1d1c-a3d8-434b-b884-9d73ed0d3870 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071424 Jul 26 19:52:31.720525 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1141/2259] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:31.909972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-703fe806-0850-46a7-878d-e104de1bd898 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:31.910924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-703fe806-0850-46a7-878d-e104de1bd898 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:31.927449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-703fe806-0850-46a7-878d-e104de1bd898 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:31.938881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-703fe806-0850-46a7-878d-e104de1bd898 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:31.939403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-703fe806-0850-46a7-878d-e104de1bd898 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:31.939871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-703fe806-0850-46a7-878d-e104de1bd898 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:32.290671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-703fe806-0850-46a7-878d-e104de1bd898 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:32.303733 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-703fe806-0850-46a7-878d-e104de1bd898 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 0.398054 Jul 26 19:52:32.304928 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1142/2260] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:31 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:32.311458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:32.317607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:32.324853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:32.325678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:32.326952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:32.327679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:32.712301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:32.729787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:32.733229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:32.734949 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a7d68ae8-324c-4eae-929f-dcccc6fd7a04 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1730 microversion: 2.25 time: 0.428524 Jul 26 19:52:32.736460 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1143/2261] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:32 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1730 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:32.760820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d9687dea-556e-48a8-b708-0f64372bb52e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:32.763837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d9687dea-556e-48a8-b708-0f64372bb52e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:32.779538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9687dea-556e-48a8-b708-0f64372bb52e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:32.781029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9687dea-556e-48a8-b708-0f64372bb52e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:32.782301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9687dea-556e-48a8-b708-0f64372bb52e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:32.783991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9687dea-556e-48a8-b708-0f64372bb52e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:32.924654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7dadb372-4591-421f-aff2-d54e3a45f113 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:32.934802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7dadb372-4591-421f-aff2-d54e3a45f113 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 1.437614 Jul 26 19:52:32.951388 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1119/2262] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:31 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:32.965140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1ce23820-206e-46ce-aec8-ac6954598143 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:32.965772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1ce23820-206e-46ce-aec8-ac6954598143 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:32.991338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ce23820-206e-46ce-aec8-ac6954598143 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:32.998203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ce23820-206e-46ce-aec8-ac6954598143 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:33.005750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ce23820-206e-46ce-aec8-ac6954598143 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:33.008330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ce23820-206e-46ce-aec8-ac6954598143 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:33.097975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d9687dea-556e-48a8-b708-0f64372bb52e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:33.106198 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d9687dea-556e-48a8-b708-0f64372bb52e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1323 microversion: 2.1 time: 0.365202 Jul 26 19:52:33.115629 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1144/2263] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:32 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1323 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:33.122840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ba0a881-67a8-4575-b2eb-d0005f0776a6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683b2c10>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:33.219433 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6ba0a881-67a8-4575-b2eb-d0005f0776a6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.101325 Jul 26 19:52:33.223588 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1145/2264] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:33 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:33.327712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4cbd7335-76d5-40ca-8150-48db78e5b943 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:33.328246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4cbd7335-76d5-40ca-8150-48db78e5b943 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:33.350561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cbd7335-76d5-40ca-8150-48db78e5b943 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:33.351261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cbd7335-76d5-40ca-8150-48db78e5b943 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:33.352608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cbd7335-76d5-40ca-8150-48db78e5b943 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:33.359122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cbd7335-76d5-40ca-8150-48db78e5b943 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:33.674132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cbd7335-76d5-40ca-8150-48db78e5b943 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:33.685966 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4cbd7335-76d5-40ca-8150-48db78e5b943 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1324 microversion: 2.1 time: 0.363596 Jul 26 19:52:33.691720 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1146/2265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:33 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:33.764546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:33.765486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:33.786272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:33.786731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:33.787536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:33.795298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:33.927414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:33.938249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:33.940321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:33.941696 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c89abcfa-ab8f-4d84-a02b-7e74bba88078 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1663 microversion: 2.25 time: 0.184109 Jul 26 19:52:33.943030 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1147/2266] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:33 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:52:33.987520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f9383298-90e8-4c8f-ac8a-5df07835c0d3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:33.988442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f9383298-90e8-4c8f-ac8a-5df07835c0d3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:34.012044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9383298-90e8-4c8f-ac8a-5df07835c0d3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:34.012793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9383298-90e8-4c8f-ac8a-5df07835c0d3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:34.013923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9383298-90e8-4c8f-ac8a-5df07835c0d3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:34.014507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9383298-90e8-4c8f-ac8a-5df07835c0d3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:34.446893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f9383298-90e8-4c8f-ac8a-5df07835c0d3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:34.458718 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f9383298-90e8-4c8f-ac8a-5df07835c0d3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1523 microversion: 2.1 time: 0.483514 Jul 26 19:52:34.469976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1148/2267] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:33 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:52:34.484819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d790adaa-a270-4f92-bdad-461f7748c337 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:34.485448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d790adaa-a270-4f92-bdad-461f7748c337 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:34.496460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d790adaa-a270-4f92-bdad-461f7748c337 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:34.496916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d790adaa-a270-4f92-bdad-461f7748c337 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:34.512735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d790adaa-a270-4f92-bdad-461f7748c337 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:34.513261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d790adaa-a270-4f92-bdad-461f7748c337 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:34.764696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ce23820-206e-46ce-aec8-ac6954598143 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:34.779173 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1ce23820-206e-46ce-aec8-ac6954598143 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 1.821285 Jul 26 19:52:34.780660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1120/2268] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:32 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:34.791370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11e3c40e-49e9-4b9e-b735-7d23a4192d50 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f876830e4c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:34.863366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d790adaa-a270-4f92-bdad-461f7748c337 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:34.879154 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d790adaa-a270-4f92-bdad-461f7748c337 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1323 microversion: 2.1 time: 0.406796 Jul 26 19:52:34.880467 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1149/2269] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:34 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:34.894574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6212c1d9-d1ef-4a64-b6e5-69457c8a3abf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:34.895204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6212c1d9-d1ef-4a64-b6e5-69457c8a3abf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:34.909260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6212c1d9-d1ef-4a64-b6e5-69457c8a3abf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:34.909715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6212c1d9-d1ef-4a64-b6e5-69457c8a3abf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:34.916131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6212c1d9-d1ef-4a64-b6e5-69457c8a3abf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:34.917375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6212c1d9-d1ef-4a64-b6e5-69457c8a3abf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:34.937615 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11e3c40e-49e9-4b9e-b735-7d23a4192d50 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.152850 Jul 26 19:52:34.951808 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1121/2270] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:34 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:34.968864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:34.969476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:34.987305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:34.987791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:34.988566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:34.988980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:35.252692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:35.267137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:35.277130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:35.286666 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd2734d3-32e6-42fa-a915-50ac63c08b2e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 200 len: 1663 microversion: 2.25 time: 0.321802 Jul 26 19:52:35.295966 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1122/2271] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:34 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 1663 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:35.300991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d2800cab-591f-489a-a085-36cd959e3063 req-85486763-dff8-4301-bfca-ab7942c914ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d76780-8750-4ef5-9699-2baef38358c3", "name": "network-vif-plugged", "status": "completed", "tag": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:35.327539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d2800cab-591f-489a-a085-36cd959e3063 req-85486763-dff8-4301-bfca-ab7942c914ee service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:35.330318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6212c1d9-d1ef-4a64-b6e5-69457c8a3abf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:35.331077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d2800cab-591f-489a-a085-36cd959e3063 req-85486763-dff8-4301-bfca-ab7942c914ee service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:35.339219 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6212c1d9-d1ef-4a64-b6e5-69457c8a3abf tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 200 len: 1519 microversion: 2.1 time: 0.456198 Jul 26 19:52:35.339855 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1150/2272] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:34 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 1519 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:35.368261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'action', calling method: .version_select at 0x7f8765d2bca0>, body: {"addFloatingIp": {"address": "172.25.0.205"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:35.371434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:35.387932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:35.388410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:35.389269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:35.389935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:35.398015 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d2800cab-591f-489a-a085-36cd959e3063 req-85486763-dff8-4301-bfca-ab7942c914ee service nova] Creating event network-vif-plugged:d62a1a3c-ef55-4efa-9ba6-5bdd693c678c for instance 16d76780-8750-4ef5-9699-2baef38358c3 on n-h2-708768-8 Jul 26 19:52:35.403649 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d2800cab-591f-489a-a085-36cd959e3063 req-85486763-dff8-4301-bfca-ab7942c914ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105897 Jul 26 19:52:35.404263 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1123/2273] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:35.497360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cc2db09c-a338-4d19-bc79-3ad837246ca2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:35.498485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc2db09c-a338-4d19-bc79-3ad837246ca2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:35.520438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc2db09c-a338-4d19-bc79-3ad837246ca2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:35.521207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc2db09c-a338-4d19-bc79-3ad837246ca2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:35.522227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc2db09c-a338-4d19-bc79-3ad837246ca2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:35.522962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc2db09c-a338-4d19-bc79-3ad837246ca2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:35.578793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Acquired lock "refresh_cache-9f63e6b1-f0f3-4728-9d81-55e213d76670" {{(pid=125963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:52:37.377553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cc2db09c-a338-4d19-bc79-3ad837246ca2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:37.402926 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cc2db09c-a338-4d19-bc79-3ad837246ca2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1503 microversion: 2.1 time: 1.911143 Jul 26 19:52:37.417845 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1124/2274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:35 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1503 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:37.424550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56bd53b8-b84e-4edc-ad1d-51f3c45beadd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:37.425371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56bd53b8-b84e-4edc-ad1d-51f3c45beadd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:37.443798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56bd53b8-b84e-4edc-ad1d-51f3c45beadd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:37.444750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56bd53b8-b84e-4edc-ad1d-51f3c45beadd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:37.445738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56bd53b8-b84e-4edc-ad1d-51f3c45beadd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:37.446317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56bd53b8-b84e-4edc-ad1d-51f3c45beadd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:37.984286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56bd53b8-b84e-4edc-ad1d-51f3c45beadd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:37.992579 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56bd53b8-b84e-4edc-ad1d-51f3c45beadd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.572160 Jul 26 19:52:38.000372 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1125/2275] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:37 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:38.005328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74f4e5a3-bf5b-4688-8ca7-106985859b21 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:38.008311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74f4e5a3-bf5b-4688-8ca7-106985859b21 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:38.019174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74f4e5a3-bf5b-4688-8ca7-106985859b21 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:38.033524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74f4e5a3-bf5b-4688-8ca7-106985859b21 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:38.044786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74f4e5a3-bf5b-4688-8ca7-106985859b21 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:38.045469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74f4e5a3-bf5b-4688-8ca7-106985859b21 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:38.543264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-74f4e5a3-bf5b-4688-8ca7-106985859b21 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:38.552320 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74f4e5a3-bf5b-4688-8ca7-106985859b21 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1518 microversion: 2.1 time: 0.550649 Jul 26 19:52:38.559474 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1126/2276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:38 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1518 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:38.578433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-90b17786-c7fd-42d4-866e-0d1acde40b96 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683ec3a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:38.731119 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-90b17786-c7fd-42d4-866e-0d1acde40b96 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.167093 Jul 26 19:52:38.735905 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1127/2277] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:38 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:38.748673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:38.749495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 3f39e3c9-d789-460b-a36b-c5b9e3527888] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:38.757161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:38.758289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:38.759284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:38.760792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:38.810463 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] HTTP exception thrown: Instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 could not be found. Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Request method failure captured: Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 HTTP/1.1 Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ERVjQqDqk9BRBOz-OErVSdqFFSSuBz9r1VRmcBWZQ3R5kTDW9mYA2PYlueUYWfDP79tndE4CtlO_70oPMiPDN_LiHmDjD_BEyjER-BQhrRgLiYBV0rA1ITDA5psJ6P36zM_H_Jb7m8ptmSL2O3eygnpXmGrKPbR814wrRWw6TwEhBI Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 3d10540a08974fd0854fea20ae5c216b Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d10540a08974fd0854fea20ae5c216b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d10540a08974fd0854fea20ae5c216b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d10540a08974fd0854fea20ae5c216b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d10540a08974fd0854fea20ae5c216b"}]}] Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 3d10540a08974fd0854fea20ae5c216b Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-LiveAutoBlockMigrationV225Test-1024770381-project Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ccd551ea4e0641a0bf17d669481136fa Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381-project Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 could not be found. Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '3f39e3c9-d789-460b-a36b-c5b9e3527888'} Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 could not be found. Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 could not be found. Jul 26 19:52:38.815764 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 could not be found. Jul 26 19:52:38.820085 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:38.821372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Returning 404 to user: Instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:52:38.824201 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5a58aa1-f778-4a23-b891-f6279bad43a7 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888" status: 404 len: 111 microversion: 2.25 time: 0.086810 Jul 26 19:52:38.824954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1128/2278] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:38 2022] GET /compute/v2.1/servers/3f39e3c9-d789-460b-a36b-c5b9e3527888 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:52:38.835600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d25653a-4c9b-4f3a-b6fb-9db6f45ad6b3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:38.836234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d25653a-4c9b-4f3a-b6fb-9db6f45ad6b3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:38.852883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d25653a-4c9b-4f3a-b6fb-9db6f45ad6b3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:38.856993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d25653a-4c9b-4f3a-b6fb-9db6f45ad6b3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:38.862437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d25653a-4c9b-4f3a-b6fb-9db6f45ad6b3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:38.863044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d25653a-4c9b-4f3a-b6fb-9db6f45ad6b3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:38.863512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Building network info cache for instance {{(pid=125963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:52:39.486855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d25653a-4c9b-4f3a-b6fb-9db6f45ad6b3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:39.506560 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d25653a-4c9b-4f3a-b6fb-9db6f45ad6b3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1516 microversion: 2.1 time: 0.673678 Jul 26 19:52:39.507226 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1129/2279] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:38 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1516 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:39.514147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-17931634-978b-44b2-bf8a-a45102735996 req-146cbca5-12fb-4926-aaa5-7b624cb667f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f39e3c9-d789-460b-a36b-c5b9e3527888", "name": "network-vif-deleted", "tag": "643df902-6645-4b6e-9c71-22da5df80018"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:39.543334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-17931634-978b-44b2-bf8a-a45102735996 req-146cbca5-12fb-4926-aaa5-7b624cb667f7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:39.544529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-17931634-978b-44b2-bf8a-a45102735996 req-146cbca5-12fb-4926-aaa5-7b624cb667f7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:39.581903 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-17931634-978b-44b2-bf8a-a45102735996 req-146cbca5-12fb-4926-aaa5-7b624cb667f7 service nova] Creating event network-vif-deleted:643df902-6645-4b6e-9c71-22da5df80018 for instance 3f39e3c9-d789-460b-a36b-c5b9e3527888 on n-h2-708768-8 Jul 26 19:52:39.589999 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-17931634-978b-44b2-bf8a-a45102735996 req-146cbca5-12fb-4926-aaa5-7b624cb667f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079072 Jul 26 19:52:39.592694 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1130/2280] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:39.607400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-864e2537-d578-43ef-889d-f591fc21b419 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:39.611471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-864e2537-d578-43ef-889d-f591fc21b419 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:39.618312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-864e2537-d578-43ef-889d-f591fc21b419 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:39.618802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-864e2537-d578-43ef-889d-f591fc21b419 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:39.620044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-864e2537-d578-43ef-889d-f591fc21b419 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:39.620430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-864e2537-d578-43ef-889d-f591fc21b419 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:39.667932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-864e2537-d578-43ef-889d-f591fc21b419 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lazy-loading 'flavor' on Instance uuid 16d76780-8750-4ef5-9699-2baef38358c3 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:52:39.702247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:39.794407 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-864e2537-d578-43ef-889d-f591fc21b419 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action" status: 200 len: 32 microversion: 2.1 time: 0.200123 Jul 26 19:52:39.796415 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1131/2281] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:39 2022] POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:52:39.808132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39fb91f4-adbc-476e-bf37-acba0b2fabe1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '.version_select at 0x7f8768425c10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:39.849643 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39fb91f4-adbc-476e-bf37-acba0b2fabe1 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698021275" status: 204 len: 0 microversion: 2.25 time: 0.051694 Jul 26 19:52:39.850944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1132/2282] 10.222.0.58 () {60 vars in 1259 bytes} [Tue Jul 26 19:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698021275 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:52:39.860930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e66b7367-b7a3-48f4-98f5-e34a6c751be0 req-7416d709-f0c8-407b-be76-bc3416763246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f63e6b1-f0f3-4728-9d81-55e213d76670", "tag": "57157a04-5595-4f99-80d3-334f6ed29d8b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:39.887978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e66b7367-b7a3-48f4-98f5-e34a6c751be0 req-7416d709-f0c8-407b-be76-bc3416763246 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:39.893390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e66b7367-b7a3-48f4-98f5-e34a6c751be0 req-7416d709-f0c8-407b-be76-bc3416763246 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:39.913562 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e66b7367-b7a3-48f4-98f5-e34a6c751be0 req-7416d709-f0c8-407b-be76-bc3416763246 service nova] Creating event network-changed:57157a04-5595-4f99-80d3-334f6ed29d8b for instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 on n-h2-708768-8 Jul 26 19:52:39.926508 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e66b7367-b7a3-48f4-98f5-e34a6c751be0 req-7416d709-f0c8-407b-be76-bc3416763246 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072817 Jul 26 19:52:39.929855 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1133/2283] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:39.942820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f904099-a233-47bf-a5ca-16a9ef7838dd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:39.948089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2f904099-a233-47bf-a5ca-16a9ef7838dd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:39.964423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f904099-a233-47bf-a5ca-16a9ef7838dd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:39.969995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f904099-a233-47bf-a5ca-16a9ef7838dd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:39.978254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f904099-a233-47bf-a5ca-16a9ef7838dd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:39.979330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f904099-a233-47bf-a5ca-16a9ef7838dd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:40.032496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Updating instance_info_cache with network_info: [{"id": "57157a04-5595-4f99-80d3-334f6ed29d8b", "address": "fa:16:3e:d3:60:e8", "network": {"id": "07bc5316-7c4a-4225-9806-6105d63a8afa", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-655456488-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e9f1debe663740729a7c1b0bda1f3be8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap57157a04-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:52:40.047556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Releasing lock "refresh_cache-9f63e6b1-f0f3-4728-9d81-55e213d76670" {{(pid=125963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:52:40.048552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14993c23-fc0d-4397-9f79-57b76ceee34d tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action" status: 202 len: 0 microversion: 2.1 time: 4.684834 Jul 26 19:52:40.050254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1151/2284] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:35 2022] POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action => generated 0 bytes in 4687 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 26 19:52:40.070766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-073a7271-ba4d-4a24-a78c-6d8d8ddb767b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:40.078049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-073a7271-ba4d-4a24-a78c-6d8d8ddb767b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: a427c01a-6b3a-4240-b2de-c5076aa67a90] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:40.097124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:40.116857 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-073a7271-ba4d-4a24-a78c-6d8d8ddb767b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Instance a427c01a-6b3a-4240-b2de-c5076aa67a90 could not be found. Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-073a7271-ba4d-4a24-a78c-6d8d8ddb767b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/a427c01a-6b3a-4240-b2de-c5076aa67a90/action HTTP/1.1 Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 14 Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: {"rescue": {}} Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance a427c01a-6b3a-4240-b2de-c5076aa67a90 could not be found. Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a427c01a-6b3a-4240-b2de-c5076aa67a90', 'body': {'rescue': {}}} Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a427c01a-6b3a-4240-b2de-c5076aa67a90 could not be found. Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a427c01a-6b3a-4240-b2de-c5076aa67a90 could not be found. Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:40.138016 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:40.142358 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:40.142358 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:40.142358 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:52:40.142358 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:52:40.142358 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a427c01a-6b3a-4240-b2de-c5076aa67a90 could not be found. Jul 26 19:52:40.142358 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:40.143632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-073a7271-ba4d-4a24-a78c-6d8d8ddb767b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 404 to user: Instance a427c01a-6b3a-4240-b2de-c5076aa67a90 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:52:40.144665 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-073a7271-ba4d-4a24-a78c-6d8d8ddb767b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/a427c01a-6b3a-4240-b2de-c5076aa67a90/action" status: 404 len: 111 microversion: 2.1 time: 0.091040 Jul 26 19:52:40.146456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1152/2285] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:40 2022] POST /compute/v2.1/servers/a427c01a-6b3a-4240-b2de-c5076aa67a90/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:52:40.160378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31739300-014a-4bf5-a04b-8a1552ef5566 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683c3550>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:40.263671 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31739300-014a-4bf5-a04b-8a1552ef5566 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1455 microversion: 2.1 time: 0.115945 Jul 26 19:52:40.272996 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1153/2286] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:40 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:40.288754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c62a2e9d-d500-4aff-85e9-d6ecab7e4573 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:40.293327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c62a2e9d-d500-4aff-85e9-d6ecab7e4573 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:40.310011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c62a2e9d-d500-4aff-85e9-d6ecab7e4573 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:40.310474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c62a2e9d-d500-4aff-85e9-d6ecab7e4573 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:40.311268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c62a2e9d-d500-4aff-85e9-d6ecab7e4573 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:40.315732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c62a2e9d-d500-4aff-85e9-d6ecab7e4573 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:40.603481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c62a2e9d-d500-4aff-85e9-d6ecab7e4573 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:40.613249 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c62a2e9d-d500-4aff-85e9-d6ecab7e4573 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.338137 Jul 26 19:52:40.627399 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1154/2287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:40 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:40.632674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.205"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:40.636808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:40.644039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:40.644664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:40.645599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:40.646209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:40.685613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Acquired lock "refresh_cache-f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" {{(pid=125963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:52:41.007552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f904099-a233-47bf-a5ca-16a9ef7838dd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:41.016531 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f904099-a233-47bf-a5ca-16a9ef7838dd tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 1.085170 Jul 26 19:52:41.032124 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1134/2288] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:39 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:41.038081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef83f6bb-0b1e-4cea-97f8-70225afa861d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:41.038798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef83f6bb-0b1e-4cea-97f8-70225afa861d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:41.051337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef83f6bb-0b1e-4cea-97f8-70225afa861d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:41.052049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef83f6bb-0b1e-4cea-97f8-70225afa861d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:41.053574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef83f6bb-0b1e-4cea-97f8-70225afa861d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:41.054170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef83f6bb-0b1e-4cea-97f8-70225afa861d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:41.195266 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef83f6bb-0b1e-4cea-97f8-70225afa861d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action" status: 202 len: 0 microversion: 2.1 time: 0.161456 Jul 26 19:52:41.197208 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1135/2289] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:41 2022] POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:52:41.205678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3114d047-554c-449c-a9b9-6e2e4e6aceba tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:41.206562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3114d047-554c-449c-a9b9-6e2e4e6aceba tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:41.226416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3114d047-554c-449c-a9b9-6e2e4e6aceba tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:41.226862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3114d047-554c-449c-a9b9-6e2e4e6aceba tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:41.227662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3114d047-554c-449c-a9b9-6e2e4e6aceba tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:41.228212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3114d047-554c-449c-a9b9-6e2e4e6aceba tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:42.231806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3114d047-554c-449c-a9b9-6e2e4e6aceba tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:42.271166 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3114d047-554c-449c-a9b9-6e2e4e6aceba tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1521 microversion: 2.1 time: 1.066817 Jul 26 19:52:42.272653 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1136/2290] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:41 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1521 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:42.310421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d709947-d35f-46eb-8a6a-cbf65502adc6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683c98b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:42.397321 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d709947-d35f-46eb-8a6a-cbf65502adc6 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1464 microversion: 2.1 time: 0.123155 Jul 26 19:52:42.399024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1137/2291] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:42 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1464 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:42.421082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-81c5b7ab-c24f-4aea-9649-64af60c9dba2 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:42.421955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-81c5b7ab-c24f-4aea-9649-64af60c9dba2 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:42.430755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81c5b7ab-c24f-4aea-9649-64af60c9dba2 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:42.434148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81c5b7ab-c24f-4aea-9649-64af60c9dba2 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:42.438546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81c5b7ab-c24f-4aea-9649-64af60c9dba2 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:42.440700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81c5b7ab-c24f-4aea-9649-64af60c9dba2 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:43.038920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-81c5b7ab-c24f-4aea-9649-64af60c9dba2 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:43.067071 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-81c5b7ab-c24f-4aea-9649-64af60c9dba2 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.656497 Jul 26 19:52:43.081022 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1138/2292] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:42 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:43.115009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-42177c18-904d-4bb8-9e3f-644e9d1192a4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:43.115851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-42177c18-904d-4bb8-9e3f-644e9d1192a4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:43.127477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42177c18-904d-4bb8-9e3f-644e9d1192a4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:43.127965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42177c18-904d-4bb8-9e3f-644e9d1192a4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:43.128745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42177c18-904d-4bb8-9e3f-644e9d1192a4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:43.129180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42177c18-904d-4bb8-9e3f-644e9d1192a4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:43.607154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-42177c18-904d-4bb8-9e3f-644e9d1192a4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:43.632276 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-42177c18-904d-4bb8-9e3f-644e9d1192a4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.540202 Jul 26 19:52:43.635422 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1139/2293] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:43 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:43.644342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d29715c-b921-4285-9876-29f58997043b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683990d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:43.738801 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d29715c-b921-4285-9876-29f58997043b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 200 len: 1464 microversion: 2.1 time: 0.100706 Jul 26 19:52:43.740583 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1140/2294] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:52:43 2022] GET /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 1464 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:43.746726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-59609a47-5c4d-438f-8261-e3b6a376b865 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:43.747757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-59609a47-5c4d-438f-8261-e3b6a376b865 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:43.754980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59609a47-5c4d-438f-8261-e3b6a376b865 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:43.758148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59609a47-5c4d-438f-8261-e3b6a376b865 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:43.760228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59609a47-5c4d-438f-8261-e3b6a376b865 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:43.762124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59609a47-5c4d-438f-8261-e3b6a376b865 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:43.826911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-59609a47-5c4d-438f-8261-e3b6a376b865 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:52:43.972890 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-59609a47-5c4d-438f-8261-e3b6a376b865 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 204 len: 0 microversion: 2.25 time: 0.230706 Jul 26 19:52:43.973898 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1141/2295] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:52:43 2022] DELETE /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:52:43.980002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4b82f8a2-23d8-4dfd-b160-e5c2f5826759 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:43.988697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4b82f8a2-23d8-4dfd-b160-e5c2f5826759 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:43.995996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b82f8a2-23d8-4dfd-b160-e5c2f5826759 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:43.997188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b82f8a2-23d8-4dfd-b160-e5c2f5826759 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:43.999887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b82f8a2-23d8-4dfd-b160-e5c2f5826759 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:44.000492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b82f8a2-23d8-4dfd-b160-e5c2f5826759 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:44.021515 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.neutron [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] re-assign floating IP 172.25.0.205 from instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 Jul 26 19:52:44.050173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Building network info cache for instance {{(pid=125963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:52:44.070510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:44.458469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4b82f8a2-23d8-4dfd-b160-e5c2f5826759 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:44.467692 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4b82f8a2-23d8-4dfd-b160-e5c2f5826759 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1501 microversion: 2.1 time: 0.492238 Jul 26 19:52:44.468297 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1142/2296] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:43 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1501 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:44.484049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7303e3cc-0a05-4fb4-b3a4-def1025b6d0c req-17156958-648c-4317-a0fc-0b09b0e366e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f63e6b1-f0f3-4728-9d81-55e213d76670", "tag": "57157a04-5595-4f99-80d3-334f6ed29d8b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:44.506957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7303e3cc-0a05-4fb4-b3a4-def1025b6d0c req-17156958-648c-4317-a0fc-0b09b0e366e4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:44.507663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7303e3cc-0a05-4fb4-b3a4-def1025b6d0c req-17156958-648c-4317-a0fc-0b09b0e366e4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:44.528376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7303e3cc-0a05-4fb4-b3a4-def1025b6d0c req-17156958-648c-4317-a0fc-0b09b0e366e4 service nova] Creating event network-changed:57157a04-5595-4f99-80d3-334f6ed29d8b for instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 on n-h2-708768-8 Jul 26 19:52:44.545345 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7303e3cc-0a05-4fb4-b3a4-def1025b6d0c req-17156958-648c-4317-a0fc-0b09b0e366e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075791 Jul 26 19:52:44.546272 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1143/2297] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:44.553729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-19dc8a54-731b-4188-bf83-5224fa1ce188 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:44.554529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-19dc8a54-731b-4188-bf83-5224fa1ce188 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:44.576187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19dc8a54-731b-4188-bf83-5224fa1ce188 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:44.576921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19dc8a54-731b-4188-bf83-5224fa1ce188 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:44.577894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19dc8a54-731b-4188-bf83-5224fa1ce188 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:44.578490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19dc8a54-731b-4188-bf83-5224fa1ce188 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:44.988725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Updating instance_info_cache with network_info: [{"id": "57157a04-5595-4f99-80d3-334f6ed29d8b", "address": "fa:16:3e:d3:60:e8", "network": {"id": "07bc5316-7c4a-4225-9806-6105d63a8afa", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-655456488-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e9f1debe663740729a7c1b0bda1f3be8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap57157a04-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:52:45.007717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Building network info cache for instance {{(pid=125963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:52:45.653369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-19dc8a54-731b-4188-bf83-5224fa1ce188 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:45.669023 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-19dc8a54-731b-4188-bf83-5224fa1ce188 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 200 len: 1467 microversion: 2.1 time: 1.121317 Jul 26 19:52:45.669649 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1144/2298] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:44 2022] GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 1467 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:45.674486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:45.675079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:45.723238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:45.723744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:45.725180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:45.725639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.190664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Updating instance_info_cache with network_info: [{"id": "6d1f569e-4ea6-4590-af93-3af715e57391", "address": "fa:16:3e:69:2b:e5", "network": {"id": "07bc5316-7c4a-4225-9806-6105d63a8afa", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-655456488-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e9f1debe663740729a7c1b0bda1f3be8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d1f569e-4e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:52:46.204275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Releasing lock "refresh_cache-f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" {{(pid=125963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:52:46.205775 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90d7209e-57cb-45ad-b78e-a3bda51aec9a tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac/action" status: 202 len: 0 microversion: 2.1 time: 5.577053 Jul 26 19:52:46.210288 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1155/2299] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:40 2022] POST /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac/action => generated 0 bytes in 5582 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 19:52:46.217339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2fbe42f5-c5ab-4ca1-8b03-be110c88c639 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:46.218271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2fbe42f5-c5ab-4ca1-8b03-be110c88c639 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:46.225514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fbe42f5-c5ab-4ca1-8b03-be110c88c639 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.226256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fbe42f5-c5ab-4ca1-8b03-be110c88c639 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.227267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fbe42f5-c5ab-4ca1-8b03-be110c88c639 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.228498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fbe42f5-c5ab-4ca1-8b03-be110c88c639 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.409582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2fbe42f5-c5ab-4ca1-8b03-be110c88c639 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:46.420566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:46.424878 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2fbe42f5-c5ab-4ca1-8b03-be110c88c639 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.212636 Jul 26 19:52:46.425879 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1156/2300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:46 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:46.429478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:46.431008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ec6b1b0d-1ca5-4da6-8d33-3a68cfd60af5 req-a4a48abc-7f5a-4d47-9926-2d06e42b0722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f8c415-4c1d-4e8c-b3a6-2b1f20db3207", "name": "network-vif-unplugged", "status": "completed", "tag": "6a23c3cf-1752-438a-abe4-d9745485a1b1"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:46.431155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:46.436557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca84544d-76ff-41d2-8325-95de36fbc2db tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 200 len: 1548 microversion: 2.25 time: 0.765753 Jul 26 19:52:46.440249 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1145/2301] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:45 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 1548 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:46.446412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:46.453316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ec6b1b0d-1ca5-4da6-8d33-3a68cfd60af5 req-a4a48abc-7f5a-4d47-9926-2d06e42b0722 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.454982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:46.460528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ec6b1b0d-1ca5-4da6-8d33-3a68cfd60af5 req-a4a48abc-7f5a-4d47-9926-2d06e42b0722 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.467532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.468281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.469275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.469874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.476048 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ec6b1b0d-1ca5-4da6-8d33-3a68cfd60af5 req-a4a48abc-7f5a-4d47-9926-2d06e42b0722 service nova] Creating event network-vif-unplugged:6a23c3cf-1752-438a-abe4-d9745485a1b1 for instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 on n-h1-708768-8 Jul 26 19:52:46.482290 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ec6b1b0d-1ca5-4da6-8d33-3a68cfd60af5 req-a4a48abc-7f5a-4d47-9926-2d06e42b0722 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054942 Jul 26 19:52:46.482917 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1157/2302] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:46.492060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bca78c3-943c-43af-b713-9e04e6ff51af tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:46.492785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bca78c3-943c-43af-b713-9e04e6ff51af tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:46.500783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lazy-loading 'flavor' on Instance uuid 4a15e74a-9354-4cf2-908d-2c9191b2ef96 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:52:46.503638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bca78c3-943c-43af-b713-9e04e6ff51af tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.504108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bca78c3-943c-43af-b713-9e04e6ff51af tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.504914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bca78c3-943c-43af-b713-9e04e6ff51af tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.505358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bca78c3-943c-43af-b713-9e04e6ff51af tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.535824 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Cannot 'rescue' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state paused Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action HTTP/1.1 Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 14 Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: {"rescue": {}} Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'rescue' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state paused Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '4a15e74a-9354-4cf2-908d-2c9191b2ef96', 'body': {'rescue': {}}} Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 in vm_state paused. Cannot rescue while the instance is in this state. Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state paused Jul 26 19:52:46.537883 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state paused Jul 26 19:52:46.542040 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:52:46.543041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 409 to user: Cannot 'rescue' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state paused {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:52:46.544074 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d99e98a-30b7-4572-9cb9-6a85a2151cc3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action" status: 409 len: 144 microversion: 2.1 time: 0.102669 Jul 26 19:52:46.545090 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1146/2303] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:46 2022] POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action => generated 144 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:52:46.550394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1128e3f6-7af1-42c8-a958-02ddcb2d6a21 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683ace50>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:46.826672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bca78c3-943c-43af-b713-9e04e6ff51af tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:46.854416 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bca78c3-943c-43af-b713-9e04e6ff51af tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.367193 Jul 26 19:52:46.859469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1128e3f6-7af1-42c8-a958-02ddcb2d6a21 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images?changes-since=2022-07-26T19%3A50%3A20Z" status: 200 len: 2374 microversion: 2.1 time: 0.298584 Jul 26 19:52:46.860254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1158/2304] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:46 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:46.863913 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1147/2305] 10.222.0.58 () {58 vars in 1199 bytes} [Tue Jul 26 19:52:46 2022] GET /compute/v2.1/images?changes-since=2022-07-26T19%3A50%3A20Z => generated 2374 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:46.883139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38f8ed47-73af-41ef-966c-74bcb5df9db6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:46.884389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38f8ed47-73af-41ef-966c-74bcb5df9db6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:46.889743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'action', calling method: .version_select at 0x7f8765f14a60>, body: {"removeFloatingIp": {"address": "172.25.0.205"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:46.915287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f8ed47-73af-41ef-966c-74bcb5df9db6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.917608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f8ed47-73af-41ef-966c-74bcb5df9db6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:46.925247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f8ed47-73af-41ef-966c-74bcb5df9db6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:46.925873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f8ed47-73af-41ef-966c-74bcb5df9db6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:47.122463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:47.190155 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38f8ed47-73af-41ef-966c-74bcb5df9db6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action" status: 202 len: 0 microversion: 2.1 time: 0.320284 Jul 26 19:52:47.193639 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1148/2306] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:46 2022] POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:52:47.216115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-377221bb-e432-4bf5-96ab-219785bc0825 req-ea2b182a-7cd3-4df8-b670-7690bdbc1f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0431a82-56a4-4caf-ae0b-8d3134cdd4ac", "tag": "6d1f569e-4ea6-4590-af93-3af715e57391"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:47.239514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:47.246668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:47.247115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:47.247987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:47.250334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:47.266697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:47.276498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-377221bb-e432-4bf5-96ab-219785bc0825 req-ea2b182a-7cd3-4df8-b670-7690bdbc1f6b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:47.281485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-377221bb-e432-4bf5-96ab-219785bc0825 req-ea2b182a-7cd3-4df8-b670-7690bdbc1f6b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:47.325665 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-377221bb-e432-4bf5-96ab-219785bc0825 req-ea2b182a-7cd3-4df8-b670-7690bdbc1f6b service nova] Creating event network-changed:6d1f569e-4ea6-4590-af93-3af715e57391 for instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac on n-h1-708768-8 Jul 26 19:52:47.334253 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-377221bb-e432-4bf5-96ab-219785bc0825 req-ea2b182a-7cd3-4df8-b670-7690bdbc1f6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138632 Jul 26 19:52:47.336433 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1149/2307] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:47.344643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c73865d4-6063-40cc-9de1-4d8d034c294f req-2a3b12d6-40bb-4e9e-8929-07124f7255f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3", "name": "network-vif-deleted", "tag": "3f861fc9-a37c-4773-a6a3-1162bda6dcd8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:47.356474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c73865d4-6063-40cc-9de1-4d8d034c294f req-2a3b12d6-40bb-4e9e-8929-07124f7255f9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:47.357408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c73865d4-6063-40cc-9de1-4d8d034c294f req-2a3b12d6-40bb-4e9e-8929-07124f7255f9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:47.369518 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c73865d4-6063-40cc-9de1-4d8d034c294f req-2a3b12d6-40bb-4e9e-8929-07124f7255f9 service nova] Creating event network-vif-deleted:3f861fc9-a37c-4773-a6a3-1162bda6dcd8 for instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 on n-h2-708768-8 Jul 26 19:52:47.376309 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c73865d4-6063-40cc-9de1-4d8d034c294f req-2a3b12d6-40bb-4e9e-8929-07124f7255f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037792 Jul 26 19:52:47.377506 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1150/2308] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:47.394348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fdbc34cc-2284-4293-939b-dd5a9ab2493c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683413a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:47.608430 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fdbc34cc-2284-4293-939b-dd5a9ab2493c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-202449058" status: 200 len: 484 microversion: 2.1 time: 0.229450 Jul 26 19:52:47.609016 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1151/2309] 10.222.0.58 () {58 vars in 1229 bytes} [Tue Jul 26 19:52:47 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-202449058 => generated 484 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:47.622033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f5325d0-010c-443a-a53d-21b6ec78b6e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:47.623196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f5325d0-010c-443a-a53d-21b6ec78b6e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:47.637278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f5325d0-010c-443a-a53d-21b6ec78b6e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:47.638019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f5325d0-010c-443a-a53d-21b6ec78b6e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:47.638812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f5325d0-010c-443a-a53d-21b6ec78b6e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:47.639254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f5325d0-010c-443a-a53d-21b6ec78b6e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:47.776313 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] HTTP exception thrown: Floating IP 172.25.0.205 is not associated with instance 9f63e6b1-f0f3-4728-9d81-55e213d76670. Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Request method failure captured: Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action HTTP/1.1 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 49 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EXBEr2ZxhG7uf_uREebmXkiAWF0xEvO2af8mHHlA_n5ygj9HbQ1BtO7k83dWtR7J-xFxlZpdI4jm7pL-x_fDZbwIPnDS4GGguxXAIfb71GaptWILvbxpdcSo9nYYM63fhjE_avRnxzM6nwz-V_FeWzWHNq9_JMGqfH8NnNxUvwx5MU Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e9f1debe663740729a7c1b0bda1f3be8 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f1debe663740729a7c1b0bda1f3be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f1debe663740729a7c1b0bda1f3be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f1debe663740729a7c1b0bda1f3be8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f1debe663740729a7c1b0bda1f3be8"}]}] Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e9f1debe663740729a7c1b0bda1f3be8 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FloatingIPsAssociationTestJSON-439926085-project Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: d9a36048b1dd4b55a83ab53268489736 Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-439926085-project Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: {"removeFloatingIp": {"address": "172.25.0.205"}} Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: exception: Floating IP 172.25.0.205 is not associated with instance 9f63e6b1-f0f3-4728-9d81-55e213d76670. Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '9f63e6b1-f0f3-4728-9d81-55e213d76670', 'body': {'removeFloatingIp': {'address': '172.25.0.205'}}} Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.205 is not associated with instance 9f63e6b1-f0f3-4728-9d81-55e213d76670. Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.205 is not associated with instance 9f63e6b1-f0f3-4728-9d81-55e213d76670. Jul 26 19:52:47.782441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:47.791143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Returning 409 to user: Floating IP 172.25.0.205 is not associated with instance 9f63e6b1-f0f3-4728-9d81-55e213d76670. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:52:47.792426 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1e2c55c3-db9b-4563-a555-07e6a2da1487 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action" status: 409 len: 146 microversion: 2.1 time: 0.928455 Jul 26 19:52:47.795032 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1159/2310] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:46 2022] POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action => generated 146 bytes in 934 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:52:47.809675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a268657-8a24-4768-889a-aa44af0992ea tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:47.812626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a268657-8a24-4768-889a-aa44af0992ea tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:47.850759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a268657-8a24-4768-889a-aa44af0992ea tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:47.851527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a268657-8a24-4768-889a-aa44af0992ea tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:47.854296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a268657-8a24-4768-889a-aa44af0992ea tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:47.854988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a268657-8a24-4768-889a-aa44af0992ea tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:48.064705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f5325d0-010c-443a-a53d-21b6ec78b6e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:48.074151 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f5325d0-010c-443a-a53d-21b6ec78b6e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1516 microversion: 2.1 time: 0.463897 Jul 26 19:52:48.074753 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1152/2311] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:47 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1516 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:48.113006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a268657-8a24-4768-889a-aa44af0992ea tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:48.131181 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a268657-8a24-4768-889a-aa44af0992ea tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.334712 Jul 26 19:52:48.132187 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1160/2312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:47 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:48.139327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:48.143018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:48.171791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:48.172243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:48.173034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:48.173471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:48.213654 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] HTTP exception thrown: Instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 could not be found. Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Request method failure captured: Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 HTTP/1.1 Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERVjQqDqk9BRBOz-OErVSdqFFSSuBz9r1VRmcBWZQ3R5kTDW9mYA2PYlueUYWfDP79tndE4CtlO_70oPMiPDN_LiHmDjD_BEyjER-BQhrRgLiYBV0rA1ITDA5psJ6P36zM_H_Jb7m8ptmSL2O3eygnpXmGrKPbR814wrRWw6TwEhBI Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 3d10540a08974fd0854fea20ae5c216b Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d10540a08974fd0854fea20ae5c216b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d10540a08974fd0854fea20ae5c216b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d10540a08974fd0854fea20ae5c216b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d10540a08974fd0854fea20ae5c216b"}]}] Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 3d10540a08974fd0854fea20ae5c216b Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-LiveAutoBlockMigrationV225Test-1024770381-project Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ccd551ea4e0641a0bf17d669481136fa Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381-project Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 could not be found. Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3'} Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 could not be found. Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 could not be found. Jul 26 19:52:48.221914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 could not be found. Jul 26 19:52:48.227183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:48.240669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Returning 404 to user: Instance 2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:52:48.242275 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-01e2fb0d-3fbe-45f4-ad67-c7a4752d504a tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3" status: 404 len: 111 microversion: 2.25 time: 0.108600 Jul 26 19:52:48.249204 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1161/2313] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:48 2022] GET /compute/v2.1/servers/2ca2fd9c-1c49-403d-b3f4-8209cefe8ee3 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:52:48.254821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d80fc677-f72c-4e41-ab14-2113d143351a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ec61b80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:48.323416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1450844383", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "bfce3438-2c48-4d69-a176-e6862181a71c"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:48.413763 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d80fc677-f72c-4e41-ab14-2113d143351a tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images?server=78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 200 len: 958 microversion: 2.1 time: 0.159956 Jul 26 19:52:48.414793 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1162/2314] 10.222.0.58 () {58 vars in 1209 bytes} [Tue Jul 26 19:52:48 2022] GET /compute/v2.1/images?server=78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 958 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:48.425388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.205"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:48.429458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] validate_networks() for [('bfce3438-2c48-4d69-a176-e6862181a71c', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:52:48.596041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:48.603684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:48.604923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:48.606053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:48.606567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:48.908525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Acquired lock "refresh_cache-f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" {{(pid=125963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:52:50.084935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Building network info cache for instance {{(pid=125963) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:52:50.090089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:52:50.090595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:52:50.090965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:52:50.091429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:52:50.091807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:52:50.124524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:50.125111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:50.126032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:50.126686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:50.175760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Getting quotas for project 9e89a1ef46964bff9f18f143fd404644. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:52:50.213338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Getting quotas for user 8d7ad3300c714b0789cb202c0c1f3a94 and project 9e89a1ef46964bff9f18f143fd404644. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:52:50.256317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:52:50.272912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:52:50.393459 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-41f318d3-4988-4d1f-9b8e-e03972533142 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.311828 Jul 26 19:52:50.397837 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1153/2315] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:52:50.403425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-28b6fd4b-1b7b-46c7-a9d8-4627c70d7911 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:50.414142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-28b6fd4b-1b7b-46c7-a9d8-4627c70d7911 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:50.429803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28b6fd4b-1b7b-46c7-a9d8-4627c70d7911 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:50.433307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28b6fd4b-1b7b-46c7-a9d8-4627c70d7911 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:50.436987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28b6fd4b-1b7b-46c7-a9d8-4627c70d7911 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:50.437649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28b6fd4b-1b7b-46c7-a9d8-4627c70d7911 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.198179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-28b6fd4b-1b7b-46c7-a9d8-4627c70d7911 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:51.213944 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-28b6fd4b-1b7b-46c7-a9d8-4627c70d7911 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.814880 Jul 26 19:52:51.218608 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1154/2316] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:50 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:51.236906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fbf315ee-e535-4f17-8499-b3fe0ff5167d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:51.244885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fbf315ee-e535-4f17-8499-b3fe0ff5167d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:51.265730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fbf315ee-e535-4f17-8499-b3fe0ff5167d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:51.270121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fbf315ee-e535-4f17-8499-b3fe0ff5167d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.273697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fbf315ee-e535-4f17-8499-b3fe0ff5167d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:51.276855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fbf315ee-e535-4f17-8499-b3fe0ff5167d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.277152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Updating instance_info_cache with network_info: [{"id": "6d1f569e-4ea6-4590-af93-3af715e57391", "address": "fa:16:3e:69:2b:e5", "network": {"id": "07bc5316-7c4a-4225-9806-6105d63a8afa", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-655456488-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e9f1debe663740729a7c1b0bda1f3be8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d1f569e-4e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125963) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:52:51.288940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Releasing lock "refresh_cache-f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" {{(pid=125963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:52:51.293037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7bcc454b-ae04-48ed-ae68-6a5bbc3fad11 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac/action" status: 202 len: 0 microversion: 2.1 time: 2.877111 Jul 26 19:52:51.294125 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1163/2317] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:48 2022] POST /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac/action => generated 0 bytes in 2879 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 19:52:51.301231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-641bac60-9434-4960-b6b7-78a4440c1b5c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875f43c9d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:51.368905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fbf315ee-e535-4f17-8499-b3fe0ff5167d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:52:51.575411 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-641bac60-9434-4960-b6b7-78a4440c1b5c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2Fcc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 482 microversion: 2.1 time: 0.278712 Jul 26 19:52:51.577098 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1164/2318] 10.222.0.58 () {58 vars in 1317 bytes} [Tue Jul 26 19:52:51 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2Fcc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 482 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:51.594842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1ada85e4-ea8e-4bba-9c89-5d5b3e0c724e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:51.598047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1ada85e4-ea8e-4bba-9c89-5d5b3e0c724e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:51.627127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1ada85e4-ea8e-4bba-9c89-5d5b3e0c724e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:51.629895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1ada85e4-ea8e-4bba-9c89-5d5b3e0c724e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.634285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1ada85e4-ea8e-4bba-9c89-5d5b3e0c724e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:51.637952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1ada85e4-ea8e-4bba-9c89-5d5b3e0c724e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.667408 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fbf315ee-e535-4f17-8499-b3fe0ff5167d tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 204 len: 0 microversion: 2.25 time: 0.443542 Jul 26 19:52:51.673511 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1155/2319] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:52:51 2022] DELETE /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:52:51.685318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6dcd06a2-1265-47d8-8161-0f953ff6baa8 req-469f8541-9b88-4330-b46d-3271bc8acc9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0431a82-56a4-4caf-ae0b-8d3134cdd4ac", "tag": "6d1f569e-4ea6-4590-af93-3af715e57391"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:51.713031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6dcd06a2-1265-47d8-8161-0f953ff6baa8 req-469f8541-9b88-4330-b46d-3271bc8acc9b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:51.713737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6dcd06a2-1265-47d8-8161-0f953ff6baa8 req-469f8541-9b88-4330-b46d-3271bc8acc9b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.737268 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6dcd06a2-1265-47d8-8161-0f953ff6baa8 req-469f8541-9b88-4330-b46d-3271bc8acc9b service nova] Creating event network-changed:6d1f569e-4ea6-4590-af93-3af715e57391 for instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac on n-h1-708768-8 Jul 26 19:52:51.743812 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6dcd06a2-1265-47d8-8161-0f953ff6baa8 req-469f8541-9b88-4330-b46d-3271bc8acc9b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068047 Jul 26 19:52:51.749387 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1156/2320] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:51.755461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b09379ab-dba9-4b77-a4f1-8fddc404a718 req-34905065-9494-4078-89eb-9e63c8b6d639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96e47b7-d312-4d66-bd84-8cee85866b25", "name": "network-vif-unplugged", "status": "completed", "tag": "4c2b7e2a-35c8-4f6c-87db-eb905b409fbb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:51.786446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b09379ab-dba9-4b77-a4f1-8fddc404a718 req-34905065-9494-4078-89eb-9e63c8b6d639 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:51.789441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b09379ab-dba9-4b77-a4f1-8fddc404a718 req-34905065-9494-4078-89eb-9e63c8b6d639 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.820256 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b09379ab-dba9-4b77-a4f1-8fddc404a718 req-34905065-9494-4078-89eb-9e63c8b6d639 service nova] Creating event network-vif-unplugged:4c2b7e2a-35c8-4f6c-87db-eb905b409fbb for instance a96e47b7-d312-4d66-bd84-8cee85866b25 on n-h1-708768-8 Jul 26 19:52:51.829093 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b09379ab-dba9-4b77-a4f1-8fddc404a718 req-34905065-9494-4078-89eb-9e63c8b6d639 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077874 Jul 26 19:52:51.832248 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1157/2321] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:51.848619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d4bdc1b2-58eb-4a0d-be0e-ed19df78cafc tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:51.850489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d4bdc1b2-58eb-4a0d-be0e-ed19df78cafc tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:51.873556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4bdc1b2-58eb-4a0d-be0e-ed19df78cafc tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:51.874196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4bdc1b2-58eb-4a0d-be0e-ed19df78cafc tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.875153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4bdc1b2-58eb-4a0d-be0e-ed19df78cafc tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:51.875779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4bdc1b2-58eb-4a0d-be0e-ed19df78cafc tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:51.998386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1ada85e4-ea8e-4bba-9c89-5d5b3e0c724e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:52.008368 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1ada85e4-ea8e-4bba-9c89-5d5b3e0c724e tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.430166 Jul 26 19:52:52.010116 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1165/2322] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:51 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:52.029026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a591655-0a3f-4eb3-bc85-c2dace6ff9d1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:52.038765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a591655-0a3f-4eb3-bc85-c2dace6ff9d1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:52.056859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a591655-0a3f-4eb3-bc85-c2dace6ff9d1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:52.057316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a591655-0a3f-4eb3-bc85-c2dace6ff9d1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:52.058110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a591655-0a3f-4eb3-bc85-c2dace6ff9d1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:52.058548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a591655-0a3f-4eb3-bc85-c2dace6ff9d1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:52.113267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-7a591655-0a3f-4eb3-bc85-c2dace6ff9d1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lazy-loading 'flavor' on Instance uuid 4a15e74a-9354-4cf2-908d-2c9191b2ef96 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:52:52.259337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d4bdc1b2-58eb-4a0d-be0e-ed19df78cafc tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:52.273016 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a591655-0a3f-4eb3-bc85-c2dace6ff9d1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action" status: 200 len: 32 microversion: 2.1 time: 0.259927 Jul 26 19:52:52.279867 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d4bdc1b2-58eb-4a0d-be0e-ed19df78cafc tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1280 microversion: 2.1 time: 0.439293 Jul 26 19:52:52.280719 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1166/2323] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:52 2022] POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action => generated 32 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:52:52.283124 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1158/2324] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:51 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1280 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:52.293486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f68a8ef-c6e6-4a9f-a93f-745955938502 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:52.293975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-31c7f2c9-5ea1-4293-94a4-a279c8621d4c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768403940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:52.295574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f68a8ef-c6e6-4a9f-a93f-745955938502 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:52.323437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f68a8ef-c6e6-4a9f-a93f-745955938502 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:52.325801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f68a8ef-c6e6-4a9f-a93f-745955938502 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:52.326879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f68a8ef-c6e6-4a9f-a93f-745955938502 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:52.334090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f68a8ef-c6e6-4a9f-a93f-745955938502 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:52.390417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f68a8ef-c6e6-4a9f-a93f-745955938502 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:52:52.445152 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-31c7f2c9-5ea1-4293-94a4-a279c8621d4c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2Fcc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 482 microversion: 2.1 time: 0.159689 Jul 26 19:52:52.458921 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1159/2325] 10.222.0.58 () {58 vars in 1303 bytes} [Tue Jul 26 19:52:52 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2Fcc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 482 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:52.468026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:52.468893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:52.514197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:52.518345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:52.520856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:52.525602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:52.631732 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f68a8ef-c6e6-4a9f-a93f-745955938502 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 204 len: 0 microversion: 2.1 time: 0.348824 Jul 26 19:52:52.632827 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1167/2326] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:52:52 2022] DELETE /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:52:52.654429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-194b4580-521a-4311-9841-c5f1381ccca4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:52.655718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-194b4580-521a-4311-9841-c5f1381ccca4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:52.662474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-194b4580-521a-4311-9841-c5f1381ccca4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:52.671358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-194b4580-521a-4311-9841-c5f1381ccca4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:52.672487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-194b4580-521a-4311-9841-c5f1381ccca4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:52.672935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-194b4580-521a-4311-9841-c5f1381ccca4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:52.963054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:52.982964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:52.986965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:52.991874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7aca9c5b-1758-415b-9b80-25cd1a4aca5b tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1563 microversion: 2.25 time: 0.528864 Jul 26 19:52:52.992575 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1160/2327] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:52 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1563 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:53.008119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d7c6c695-37a8-47fe-92f8-48485ee45297 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:53.011160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d7c6c695-37a8-47fe-92f8-48485ee45297 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:53.044084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7c6c695-37a8-47fe-92f8-48485ee45297 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:53.044741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7c6c695-37a8-47fe-92f8-48485ee45297 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:53.045710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7c6c695-37a8-47fe-92f8-48485ee45297 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:53.046308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7c6c695-37a8-47fe-92f8-48485ee45297 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:53.147711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-194b4580-521a-4311-9841-c5f1381ccca4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:53.171435 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-194b4580-521a-4311-9841-c5f1381ccca4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.529212 Jul 26 19:52:53.173153 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1168/2328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:52 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:53.204350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f427b9c1-aed1-4481-8910-aa51b86c9ab3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ee0fe50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:53.260828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d7c6c695-37a8-47fe-92f8-48485ee45297 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:53.273922 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d7c6c695-37a8-47fe-92f8-48485ee45297 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.277234 Jul 26 19:52:53.278484 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1161/2329] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:52 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:53.318174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.205"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:53.328381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:53.355220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:53.357846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:53.360914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:53.361401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:53.446069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Acquired lock "refresh_cache-9f63e6b1-f0f3-4728-9d81-55e213d76670" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:52:53.476677 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f427b9c1-aed1-4481-8910-aa51b86c9ab3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.293547 Jul 26 19:52:53.482684 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1169/2330] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Jul 26 19:52:53 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:53.488440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9c246b1a-0393-480d-b2ad-910f437d7ce8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:53.489684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9c246b1a-0393-480d-b2ad-910f437d7ce8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:53.499511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c246b1a-0393-480d-b2ad-910f437d7ce8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:53.500357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c246b1a-0393-480d-b2ad-910f437d7ce8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:53.501374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c246b1a-0393-480d-b2ad-910f437d7ce8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:53.502046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c246b1a-0393-480d-b2ad-910f437d7ce8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:53.546147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=6,nova_cell1:RELEASE=3,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:52:53.996867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9c246b1a-0393-480d-b2ad-910f437d7ce8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:54.006306 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9c246b1a-0393-480d-b2ad-910f437d7ce8 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.521936 Jul 26 19:52:54.019109 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1170/2331] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:53 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:54.025118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6274977a-16f2-4654-82b9-9d3d16b8bf05 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:54.027968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6274977a-16f2-4654-82b9-9d3d16b8bf05 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:54.046588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6274977a-16f2-4654-82b9-9d3d16b8bf05 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.047275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6274977a-16f2-4654-82b9-9d3d16b8bf05 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:54.049468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6274977a-16f2-4654-82b9-9d3d16b8bf05 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.051165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6274977a-16f2-4654-82b9-9d3d16b8bf05 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:54.187994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6274977a-16f2-4654-82b9-9d3d16b8bf05 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:54.200820 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6274977a-16f2-4654-82b9-9d3d16b8bf05 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1286 microversion: 2.1 time: 0.178096 Jul 26 19:52:54.215205 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1171/2332] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:54 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:54.217378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dcfdfe9-3103-4e7f-821e-d16914fbb906 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683b20d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:54.339584 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1dcfdfe9-3103-4e7f-821e-d16914fbb906 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.133903 Jul 26 19:52:54.340241 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1172/2333] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Jul 26 19:52:54 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:54.357233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-2feabb1e-52ed-4a36-9a71-7a9e360ac9d0 req-9650b176-f72a-45e1-bdf7-83975b562f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c305d3d-37c5-4ee8-81cc-3ff8f2998d52", "name": "network-vif-deleted", "tag": "8b554828-b715-42fe-9f30-38b72c6f49f2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:54.369486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2feabb1e-52ed-4a36-9a71-7a9e360ac9d0 req-9650b176-f72a-45e1-bdf7-83975b562f4f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.370222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2feabb1e-52ed-4a36-9a71-7a9e360ac9d0 req-9650b176-f72a-45e1-bdf7-83975b562f4f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:54.385385 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2feabb1e-52ed-4a36-9a71-7a9e360ac9d0 req-9650b176-f72a-45e1-bdf7-83975b562f4f service nova] Creating event network-vif-deleted:8b554828-b715-42fe-9f30-38b72c6f49f2 for instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 on n-h2-708768-8 Jul 26 19:52:54.394302 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-2feabb1e-52ed-4a36-9a71-7a9e360ac9d0 req-9650b176-f72a-45e1-bdf7-83975b562f4f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045645 Jul 26 19:52:54.398463 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1173/2334] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:54.403896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:54.404866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:54.411734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.412993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:54.413950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.414546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:54.455849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.457026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:54.457676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lazy-loading 'fault' on Instance uuid 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:52:54.582997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:54.606337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:54.610107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd551ea4e0641a0bf17d669481136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d10540a08974fd0854fea20ae5c216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:54.634649 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c2bea261-8200-4577-ab1b-272d0d12d68e tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 200 len: 1352 microversion: 2.25 time: 0.221570 Jul 26 19:52:54.635673 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1174/2335] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:54 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 1352 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:52:54.643708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-628f2cac-85c6-4b3d-9567-742fd3757947 req-be57082d-2e6b-478e-a052-da1d44934640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96e47b7-d312-4d66-bd84-8cee85866b25", "tag": "4c2b7e2a-35c8-4f6c-87db-eb905b409fbb"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:54.671585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-628f2cac-85c6-4b3d-9567-742fd3757947 req-be57082d-2e6b-478e-a052-da1d44934640 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.672363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-628f2cac-85c6-4b3d-9567-742fd3757947 req-be57082d-2e6b-478e-a052-da1d44934640 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:54.688600 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-628f2cac-85c6-4b3d-9567-742fd3757947 req-be57082d-2e6b-478e-a052-da1d44934640 service nova] Creating event network-changed:4c2b7e2a-35c8-4f6c-87db-eb905b409fbb for instance a96e47b7-d312-4d66-bd84-8cee85866b25 on n-h1-708768-8 Jul 26 19:52:54.712776 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-628f2cac-85c6-4b3d-9567-742fd3757947 req-be57082d-2e6b-478e-a052-da1d44934640 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075567 Jul 26 19:52:54.713638 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1175/2336] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:54.719094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-20a9deba-8057-4dae-8022-61a9e547d621 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:54.721933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-20a9deba-8057-4dae-8022-61a9e547d621 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:54.740314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20a9deba-8057-4dae-8022-61a9e547d621 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.740945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20a9deba-8057-4dae-8022-61a9e547d621 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:54.742068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20a9deba-8057-4dae-8022-61a9e547d621 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:54.743257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20a9deba-8057-4dae-8022-61a9e547d621 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:55.750453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-20a9deba-8057-4dae-8022-61a9e547d621 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:55.760860 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-20a9deba-8057-4dae-8022-61a9e547d621 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 1.045772 Jul 26 19:52:55.777723 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1176/2337] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:54 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:55.783464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d6631029-a11f-4abf-a4dd-ddcccb9e70d0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:55.784307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d6631029-a11f-4abf-a4dd-ddcccb9e70d0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:55.791584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6631029-a11f-4abf-a4dd-ddcccb9e70d0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:55.792337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6631029-a11f-4abf-a4dd-ddcccb9e70d0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:55.793289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6631029-a11f-4abf-a4dd-ddcccb9e70d0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:55.793879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6631029-a11f-4abf-a4dd-ddcccb9e70d0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:56.508845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d6631029-a11f-4abf-a4dd-ddcccb9e70d0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:56.522916 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d6631029-a11f-4abf-a4dd-ddcccb9e70d0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.742989 Jul 26 19:52:56.535636 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1177/2338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:55 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:56.535636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0090502-5fea-4ee1-82a7-509565b1d31c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ec70310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:56.585638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Building network info cache for instance {{(pid=125964) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:52:56.749023 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c0090502-5fea-4ee1-82a7-509565b1d31c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.219859 Jul 26 19:52:56.750447 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1178/2339] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:52:56 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:56.758331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-53e8b362-403f-4edc-9650-4c349b50b701 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:56.760355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-53e8b362-403f-4edc-9650-4c349b50b701 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:56.786415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53e8b362-403f-4edc-9650-4c349b50b701 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:56.787165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53e8b362-403f-4edc-9650-4c349b50b701 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:56.788242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53e8b362-403f-4edc-9650-4c349b50b701 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:56.788959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53e8b362-403f-4edc-9650-4c349b50b701 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:57.636337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Updating instance_info_cache with network_info: [{"id": "57157a04-5595-4f99-80d3-334f6ed29d8b", "address": "fa:16:3e:d3:60:e8", "network": {"id": "07bc5316-7c4a-4225-9806-6105d63a8afa", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-655456488-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e9f1debe663740729a7c1b0bda1f3be8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap57157a04-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125964) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:52:57.653745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Releasing lock "refresh_cache-9f63e6b1-f0f3-4728-9d81-55e213d76670" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:52:57.661296 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-efe5f9d2-b050-48ef-9da3-e41d7e217e17 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action" status: 202 len: 0 microversion: 2.1 time: 4.365123 Jul 26 19:52:57.663021 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1162/2340] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:53 2022] POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action => generated 0 bytes in 4384 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 19:52:57.670909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ed05199-eb86-4468-ad53-a91230663ae3 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:57.672085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ed05199-eb86-4468-ad53-a91230663ae3 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:57.681097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ed05199-eb86-4468-ad53-a91230663ae3 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:57.681846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ed05199-eb86-4468-ad53-a91230663ae3 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:57.684039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ed05199-eb86-4468-ad53-a91230663ae3 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:57.684965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ed05199-eb86-4468-ad53-a91230663ae3 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:57.970495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ed05199-eb86-4468-ad53-a91230663ae3 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:57.989347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-53e8b362-403f-4edc-9650-4c349b50b701 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:58.000915 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-53e8b362-403f-4edc-9650-4c349b50b701 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 1.248070 Jul 26 19:52:58.005058 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ed05199-eb86-4468-ad53-a91230663ae3 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1328 microversion: 2.1 time: 0.339943 Jul 26 19:52:58.006173 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1179/2341] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:56 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:58.007875 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1163/2342] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:57 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1328 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:58.033422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d69b1619-1c31-4dc0-bf03-4788ea232108 req-f0ba02ce-8257-48b9-8893-fa236504c0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f63e6b1-f0f3-4728-9d81-55e213d76670", "tag": "57157a04-5595-4f99-80d3-334f6ed29d8b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:58.039229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:58.040764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] [instance: 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:58.049314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:58.050525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:58.051331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:58.052162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:58.058387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d69b1619-1c31-4dc0-bf03-4788ea232108 req-f0ba02ce-8257-48b9-8893-fa236504c0fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:58.058978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d69b1619-1c31-4dc0-bf03-4788ea232108 req-f0ba02ce-8257-48b9-8893-fa236504c0fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:58.075297 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] HTTP exception thrown: Instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 could not be found. Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Request method failure captured: Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 HTTP/1.1 Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ERVjQqDqk9BRBOz-OErVSdqFFSSuBz9r1VRmcBWZQ3R5kTDW9mYA2PYlueUYWfDP79tndE4CtlO_70oPMiPDN_LiHmDjD_BEyjER-BQhrRgLiYBV0rA1ITDA5psJ6P36zM_H_Jb7m8ptmSL2O3eygnpXmGrKPbR814wrRWw6TwEhBI Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 3d10540a08974fd0854fea20ae5c216b Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d10540a08974fd0854fea20ae5c216b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d10540a08974fd0854fea20ae5c216b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d10540a08974fd0854fea20ae5c216b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d10540a08974fd0854fea20ae5c216b"}]}] Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 3d10540a08974fd0854fea20ae5c216b Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381 Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-LiveAutoBlockMigrationV225Test-1024770381-project Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ccd551ea4e0641a0bf17d669481136fa Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1024770381-project Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 could not be found. Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '0c305d3d-37c5-4ee8-81cc-3ff8f2998d52'} Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 could not be found. Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 could not be found. Jul 26 19:52:58.077083 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 could not be found. Jul 26 19:52:58.081640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:52:58.082755 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d69b1619-1c31-4dc0-bf03-4788ea232108 req-f0ba02ce-8257-48b9-8893-fa236504c0fe service nova] Creating event network-changed:57157a04-5595-4f99-80d3-334f6ed29d8b for instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 on n-h2-708768-8 Jul 26 19:52:58.083931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] Returning 404 to user: Instance 0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:52:58.085075 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-528220f6-0a13-42e5-ac88-e261ee6bacd9 tempest-LiveAutoBlockMigrationV225Test-1024770381 tempest-LiveAutoBlockMigrationV225Test-1024770381-project] 10.222.0.58 "GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52" status: 404 len: 111 microversion: 2.25 time: 0.064437 Jul 26 19:52:58.086252 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1180/2343] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:52:58 2022] GET /compute/v2.1/servers/0c305d3d-37c5-4ee8-81cc-3ff8f2998d52 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:52:58.094535 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d69b1619-1c31-4dc0-bf03-4788ea232108 req-f0ba02ce-8257-48b9-8893-fa236504c0fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083376 Jul 26 19:52:58.095688 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1164/2344] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:58.106154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-52693db9-251c-41bd-a259-0d8f52172e75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ecfef70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:58.116461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3bccffa0-2d85-498d-8a63-ca212b19f10f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:58.117315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3bccffa0-2d85-498d-8a63-ca212b19f10f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:58.148595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bccffa0-2d85-498d-8a63-ca212b19f10f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:58.152764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bccffa0-2d85-498d-8a63-ca212b19f10f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:58.154679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bccffa0-2d85-498d-8a63-ca212b19f10f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:58.157265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bccffa0-2d85-498d-8a63-ca212b19f10f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:58.286262 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-52693db9-251c-41bd-a259-0d8f52172e75 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/detail?changes-since=2022-07-26T19%3A50%3A14Z" status: 200 len: 6332 microversion: 2.1 time: 0.197532 Jul 26 19:52:58.305764 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1181/2345] 10.222.0.58 () {58 vars in 1220 bytes} [Tue Jul 26 19:52:58 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-26T19%3A50%3A14Z => generated 6332 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:58.323895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb00d2b8-be9a-43d8-9b33-8d777162fe2c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:58.326826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb00d2b8-be9a-43d8-9b33-8d777162fe2c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:58.357090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb00d2b8-be9a-43d8-9b33-8d777162fe2c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:58.357553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb00d2b8-be9a-43d8-9b33-8d777162fe2c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:58.358364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb00d2b8-be9a-43d8-9b33-8d777162fe2c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:58.358809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb00d2b8-be9a-43d8-9b33-8d777162fe2c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:58.435885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3bccffa0-2d85-498d-8a63-ca212b19f10f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:58.449122 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3bccffa0-2d85-498d-8a63-ca212b19f10f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.350349 Jul 26 19:52:58.462855 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1165/2346] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:58 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:58.462855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef9b4c01-2a18-4097-83d0-e5fab7076167 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '.version_select at 0x7f87682eeb80>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:59.110495 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef9b4c01-2a18-4097-83d0-e5fab7076167 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/951d70b0-e87e-4d5a-9576-0a41fa0374de" status: 200 len: 185 microversion: 2.1 time: 0.659123 Jul 26 19:52:59.111249 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1166/2347] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 19:52:58 2022] GET /compute/v2.1/os-floating-ips/951d70b0-e87e-4d5a-9576-0a41fa0374de => generated 185 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:59.122141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-412c4323-81b6-48a5-8213-b0920be72966 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768399d30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:59.275442 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-412c4323-81b6-48a5-8213-b0920be72966 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-202449058" status: 200 len: 664 microversion: 2.1 time: 0.162595 Jul 26 19:52:59.278577 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1167/2348] 10.222.0.58 () {58 vars in 1250 bytes} [Tue Jul 26 19:52:59 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-202449058 => generated 664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:59.290686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-348a7255-44f8-42b7-9c9f-5b697ff008e5 req-c1e19101-2459-4ff1-b6be-8394e1c15f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0431a82-56a4-4caf-ae0b-8d3134cdd4ac", "name": "network-vif-deleted", "tag": "6d1f569e-4ea6-4590-af93-3af715e57391"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:52:59.315236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-348a7255-44f8-42b7-9c9f-5b697ff008e5 req-c1e19101-2459-4ff1-b6be-8394e1c15f96 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:59.325448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-348a7255-44f8-42b7-9c9f-5b697ff008e5 req-c1e19101-2459-4ff1-b6be-8394e1c15f96 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:59.343474 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-348a7255-44f8-42b7-9c9f-5b697ff008e5 req-c1e19101-2459-4ff1-b6be-8394e1c15f96 service nova] Creating event network-vif-deleted:6d1f569e-4ea6-4590-af93-3af715e57391 for instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac on n-h1-708768-8 Jul 26 19:52:59.350706 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-348a7255-44f8-42b7-9c9f-5b697ff008e5 req-c1e19101-2459-4ff1-b6be-8394e1c15f96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070736 Jul 26 19:52:59.359300 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1168/2349] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:52:59.380678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12008bf1-e3b6-4d9c-bc34-f47748769084 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:59.383068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-12008bf1-e3b6-4d9c-bc34-f47748769084 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:59.393170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12008bf1-e3b6-4d9c-bc34-f47748769084 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:59.394013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12008bf1-e3b6-4d9c-bc34-f47748769084 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:59.395453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12008bf1-e3b6-4d9c-bc34-f47748769084 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:59.396145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12008bf1-e3b6-4d9c-bc34-f47748769084 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:59.646201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb00d2b8-be9a-43d8-9b33-8d777162fe2c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:59.661271 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb00d2b8-be9a-43d8-9b33-8d777162fe2c tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 1.354049 Jul 26 19:52:59.668226 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1182/2350] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:58 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:59.693152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7e3184d8-4e11-4b38-a5b9-c07fc1b43082 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:52:59.695184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7e3184d8-4e11-4b38-a5b9-c07fc1b43082 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:52:59.715711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7e3184d8-4e11-4b38-a5b9-c07fc1b43082 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:59.716170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7e3184d8-4e11-4b38-a5b9-c07fc1b43082 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:59.721950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7e3184d8-4e11-4b38-a5b9-c07fc1b43082 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:52:59.722426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7e3184d8-4e11-4b38-a5b9-c07fc1b43082 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:52:59.813783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-12008bf1-e3b6-4d9c-bc34-f47748769084 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:52:59.822189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-12008bf1-e3b6-4d9c-bc34-f47748769084 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.461327 Jul 26 19:52:59.823032 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1169/2351] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:59 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:52:59.827983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.205"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:00.098138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:00.109953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:00.110613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:00.112086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:00.112739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:00.152113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:00.241072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:00.431411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7e3184d8-4e11-4b38-a5b9-c07fc1b43082 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:00.465448 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7e3184d8-4e11-4b38-a5b9-c07fc1b43082 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1328 microversion: 2.1 time: 0.783724 Jul 26 19:53:00.482702 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1183/2352] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:52:59 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1328 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:00.490395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f4dc28c-e8ea-4f28-b60c-1bdf39a9dc9b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ebe31f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:00.502948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Acquired lock "refresh_cache-9f63e6b1-f0f3-4728-9d81-55e213d76670" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:53:00.561058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f4dc28c-e8ea-4f28-b60c-1bdf39a9dc9b tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2Fcc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1464 microversion: 2.1 time: 0.076693 Jul 26 19:53:00.562133 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1184/2353] 10.222.0.58 () {58 vars in 1338 bytes} [Tue Jul 26 19:53:00 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2Fcc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1464 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:00.570312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ca6e98d-511e-4dd3-9ed3-81aafde54804 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:00.574469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ca6e98d-511e-4dd3-9ed3-81aafde54804 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:00.627070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ca6e98d-511e-4dd3-9ed3-81aafde54804 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:00.627544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ca6e98d-511e-4dd3-9ed3-81aafde54804 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:00.628369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ca6e98d-511e-4dd3-9ed3-81aafde54804 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:00.628806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ca6e98d-511e-4dd3-9ed3-81aafde54804 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:00.940198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ca6e98d-511e-4dd3-9ed3-81aafde54804 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:00.962406 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ca6e98d-511e-4dd3-9ed3-81aafde54804 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.398539 Jul 26 19:53:00.964134 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1185/2354] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:00 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:00.969463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-427d6534-a7d1-4fca-ab53-8c801b6c8c0e tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ebe1ee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:01.081141 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-427d6534-a7d1-4fca-ab53-8c801b6c8c0e tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2Fcc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1464 microversion: 2.1 time: 0.115484 Jul 26 19:53:01.088919 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1186/2355] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Jul 26 19:53:00 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2Fcc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1464 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:01.098141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-72c2a30a-48e6-49e6-9f09-f157e59e04ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:01.099006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-72c2a30a-48e6-49e6-9f09-f157e59e04ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:01.108450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72c2a30a-48e6-49e6-9f09-f157e59e04ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:01.109137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72c2a30a-48e6-49e6-9f09-f157e59e04ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:01.110169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72c2a30a-48e6-49e6-9f09-f157e59e04ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:01.110779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72c2a30a-48e6-49e6-9f09-f157e59e04ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:01.533721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-72c2a30a-48e6-49e6-9f09-f157e59e04ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:01.544829 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-72c2a30a-48e6-49e6-9f09-f157e59e04ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.454465 Jul 26 19:53:01.559650 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1187/2356] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:01 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:01.559650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-113d0976-bdad-4005-909d-849055673d59 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:01.560282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-113d0976-bdad-4005-909d-849055673d59 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:01.576405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-113d0976-bdad-4005-909d-849055673d59 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:01.576910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-113d0976-bdad-4005-909d-849055673d59 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:01.577658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-113d0976-bdad-4005-909d-849055673d59 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:01.579710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-113d0976-bdad-4005-909d-849055673d59 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:01.919411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-113d0976-bdad-4005-909d-849055673d59 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:01.930034 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-113d0976-bdad-4005-909d-849055673d59 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.383428 Jul 26 19:53:01.938873 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1188/2357] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:01 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:01.947551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab922fa1-8c1b-4916-9a99-2a6aa16d3d21 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875f13d040>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:02.039045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Building network info cache for instance {{(pid=125964) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:53:02.163073 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab922fa1-8c1b-4916-9a99-2a6aa16d3d21 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.222747 Jul 26 19:53:02.191991 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1189/2358] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Jul 26 19:53:01 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:02.197630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4e9520f7-5905-4bc7-9658-f6fdc6e26238 req-9694499f-6381-4897-b5be-ffcfdb044b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5aa6cf-6d71-476b-8eab-a84d73556c54", "tag": "e46fdec1-bb14-40ce-943b-7f7f98cd144c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:02.218211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4e9520f7-5905-4bc7-9658-f6fdc6e26238 req-9694499f-6381-4897-b5be-ffcfdb044b7b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:02.218657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4e9520f7-5905-4bc7-9658-f6fdc6e26238 req-9694499f-6381-4897-b5be-ffcfdb044b7b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:02.241454 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-4e9520f7-5905-4bc7-9658-f6fdc6e26238 req-9694499f-6381-4897-b5be-ffcfdb044b7b service nova] Creating event network-changed:e46fdec1-bb14-40ce-943b-7f7f98cd144c for instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 on n-h1-708768-8 Jul 26 19:53:02.257542 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4e9520f7-5905-4bc7-9658-f6fdc6e26238 req-9694499f-6381-4897-b5be-ffcfdb044b7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064129 Jul 26 19:53:02.259358 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1190/2359] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:02.277273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-503f0f23-851e-4d31-ad9c-96166950b304 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:02.278290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-503f0f23-851e-4d31-ad9c-96166950b304 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:02.285211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-503f0f23-851e-4d31-ad9c-96166950b304 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:02.285887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-503f0f23-851e-4d31-ad9c-96166950b304 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:02.286835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-503f0f23-851e-4d31-ad9c-96166950b304 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:02.287427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-503f0f23-851e-4d31-ad9c-96166950b304 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:02.985516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-503f0f23-851e-4d31-ad9c-96166950b304 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:02.996803 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-503f0f23-851e-4d31-ad9c-96166950b304 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1328 microversion: 2.1 time: 0.736009 Jul 26 19:53:03.000279 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1191/2360] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:02 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1328 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:03.009690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-8c7734c4-c20d-48f6-903a-74350ee92396 req-231ceec7-c4ec-4b87-b2b0-8de319687030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96e47b7-d312-4d66-bd84-8cee85866b25", "name": "network-vif-unplugged", "status": "completed", "tag": "4c2b7e2a-35c8-4f6c-87db-eb905b409fbb"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:03.032237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8c7734c4-c20d-48f6-903a-74350ee92396 req-231ceec7-c4ec-4b87-b2b0-8de319687030 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:03.032872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8c7734c4-c20d-48f6-903a-74350ee92396 req-231ceec7-c4ec-4b87-b2b0-8de319687030 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:03.074291 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-8c7734c4-c20d-48f6-903a-74350ee92396 req-231ceec7-c4ec-4b87-b2b0-8de319687030 service nova] Creating event network-vif-unplugged:4c2b7e2a-35c8-4f6c-87db-eb905b409fbb for instance a96e47b7-d312-4d66-bd84-8cee85866b25 on n-h1-708768-8 Jul 26 19:53:03.079801 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-8c7734c4-c20d-48f6-903a-74350ee92396 req-231ceec7-c4ec-4b87-b2b0-8de319687030 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077793 Jul 26 19:53:03.082531 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1192/2361] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:03.091367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4c4cd21a-b122-4278-9443-e6dc917486c6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:03.092389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4c4cd21a-b122-4278-9443-e6dc917486c6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:03.099751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c4cd21a-b122-4278-9443-e6dc917486c6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:03.100436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c4cd21a-b122-4278-9443-e6dc917486c6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:03.101426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c4cd21a-b122-4278-9443-e6dc917486c6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:03.102877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c4cd21a-b122-4278-9443-e6dc917486c6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:03.213767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Updating instance_info_cache with network_info: [{"id": "57157a04-5595-4f99-80d3-334f6ed29d8b", "address": "fa:16:3e:d3:60:e8", "network": {"id": "07bc5316-7c4a-4225-9806-6105d63a8afa", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-655456488-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e9f1debe663740729a7c1b0bda1f3be8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap57157a04-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125964) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:53:03.219734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:03.239366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Releasing lock "refresh_cache-9f63e6b1-f0f3-4728-9d81-55e213d76670" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:53:03.240758 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89c82ece-e1c4-4052-859d-44a61c262515 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action" status: 202 len: 0 microversion: 2.1 time: 3.416498 Jul 26 19:53:03.241755 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1170/2362] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:52:59 2022] POST /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670/action => generated 0 bytes in 3418 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 19:53:03.261601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-14e1ecff-dfc4-43da-91dc-f2e11f8bb7aa req-2d010f1f-2968-4f78-b9e1-5d80a13d3111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f63e6b1-f0f3-4728-9d81-55e213d76670", "tag": "57157a04-5595-4f99-80d3-334f6ed29d8b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:03.285248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-14e1ecff-dfc4-43da-91dc-f2e11f8bb7aa req-2d010f1f-2968-4f78-b9e1-5d80a13d3111 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:03.285876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-14e1ecff-dfc4-43da-91dc-f2e11f8bb7aa req-2d010f1f-2968-4f78-b9e1-5d80a13d3111 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:03.324077 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-14e1ecff-dfc4-43da-91dc-f2e11f8bb7aa req-2d010f1f-2968-4f78-b9e1-5d80a13d3111 service nova] Creating event network-changed:57157a04-5595-4f99-80d3-334f6ed29d8b for instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 on n-h2-708768-8 Jul 26 19:53:03.335982 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-14e1ecff-dfc4-43da-91dc-f2e11f8bb7aa req-2d010f1f-2968-4f78-b9e1-5d80a13d3111 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090159 Jul 26 19:53:03.337476 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1171/2363] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:03.355370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e9fdad40-440a-42b7-b6b4-903d155e5e6c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768375790>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:03.452562 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e9fdad40-440a-42b7-b6b4-903d155e5e6c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.111444 Jul 26 19:53:03.465857 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1172/2364] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Jul 26 19:53:03 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:03.467157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22659b98-e717-44af-b2b0-bc070774f9e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:03.467953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-22659b98-e717-44af-b2b0-bc070774f9e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:03.491558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22659b98-e717-44af-b2b0-bc070774f9e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:03.492061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22659b98-e717-44af-b2b0-bc070774f9e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:03.496362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22659b98-e717-44af-b2b0-bc070774f9e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:03.496823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22659b98-e717-44af-b2b0-bc070774f9e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:03.704648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4c4cd21a-b122-4278-9443-e6dc917486c6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:03.720653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4c4cd21a-b122-4278-9443-e6dc917486c6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.636165 Jul 26 19:53:03.721634 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1193/2365] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:03 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:03.732789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e7684ec-ab35-42be-9345-e3efed88eebf tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:03.735046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e7684ec-ab35-42be-9345-e3efed88eebf tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:03.749908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e7684ec-ab35-42be-9345-e3efed88eebf tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:03.755079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e7684ec-ab35-42be-9345-e3efed88eebf tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:03.759864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e7684ec-ab35-42be-9345-e3efed88eebf tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:03.760523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e7684ec-ab35-42be-9345-e3efed88eebf tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:04.235715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22659b98-e717-44af-b2b0-bc070774f9e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:04.244368 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22659b98-e717-44af-b2b0-bc070774f9e7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.786746 Jul 26 19:53:04.258569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e7684ec-ab35-42be-9345-e3efed88eebf tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:04.261410 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1173/2366] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:03 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:04.265928 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e7684ec-ab35-42be-9345-e3efed88eebf tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.542120 Jul 26 19:53:04.266737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:04.266886 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1194/2367] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:03 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:04.267532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:04.271425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4442e507-c36d-4199-9d1c-7972598a3fd4 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ee678b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:04.274160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:04.274794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:04.275828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:04.276424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:04.292071 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] HTTP exception thrown: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Request method failure captured: Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac HTTP/1.1 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EXBEr2ZxhG7uf_uREebmXkiAWF0xEvO2af8mHHlA_n5ygj9HbQ1BtO7k83dWtR7J-xFxlZpdI4jm7pL-x_fDZbwIPnDS4GGguxXAIfb71GaptWILvbxpdcSo9nYYM63fhjE_avRnxzM6nwz-V_FeWzWHNq9_JMGqfH8NnNxUvwx5MU Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e9f1debe663740729a7c1b0bda1f3be8 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f1debe663740729a7c1b0bda1f3be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f1debe663740729a7c1b0bda1f3be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f1debe663740729a7c1b0bda1f3be8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f1debe663740729a7c1b0bda1f3be8"}]}] Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e9f1debe663740729a7c1b0bda1f3be8 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsAssociationTestJSON-439926085-project Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: d9a36048b1dd4b55a83ab53268489736 Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-439926085-project Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f0431a82-56a4-4caf-ae0b-8d3134cdd4ac'} Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:04.294186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.298593 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.300186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Returning 404 to user: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:04.301482 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-49709790-24aa-4e78-8fe5-7c8b842b8158 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 404 len: 111 microversion: 2.1 time: 0.038857 Jul 26 19:53:04.302656 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1174/2368] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:53:04 2022] DELETE /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:04.308464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cb22cb20-c1a4-4b4d-b44f-869fe453a330 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:04.309092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cb22cb20-c1a4-4b4d-b44f-869fe453a330 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:04.315334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb22cb20-c1a4-4b4d-b44f-869fe453a330 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:04.316050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb22cb20-c1a4-4b4d-b44f-869fe453a330 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:04.317030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb22cb20-c1a4-4b4d-b44f-869fe453a330 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:04.317626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cb22cb20-c1a4-4b4d-b44f-869fe453a330 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:04.341980 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4442e507-c36d-4199-9d1c-7972598a3fd4 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/d3881918-9bf6-46c2-abd0-edc31f73f7fa" status: 200 len: 784 microversion: 2.1 time: 0.073894 Jul 26 19:53:04.359315 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1195/2369] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 19:53:04 2022] GET /compute/v2.1/images/d3881918-9bf6-46c2-abd0-edc31f73f7fa => generated 784 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:04.376969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:04.382471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: f0431a82-56a4-4caf-ae0b-8d3134cdd4ac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:04.399924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:04.400644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:04.401653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:04.402245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:04.421871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] HTTP exception thrown: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Request method failure captured: Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac HTTP/1.1 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EXBEr2ZxhG7uf_uREebmXkiAWF0xEvO2af8mHHlA_n5ygj9HbQ1BtO7k83dWtR7J-xFxlZpdI4jm7pL-x_fDZbwIPnDS4GGguxXAIfb71GaptWILvbxpdcSo9nYYM63fhjE_avRnxzM6nwz-V_FeWzWHNq9_JMGqfH8NnNxUvwx5MU Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e9f1debe663740729a7c1b0bda1f3be8 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f1debe663740729a7c1b0bda1f3be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f1debe663740729a7c1b0bda1f3be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f1debe663740729a7c1b0bda1f3be8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f1debe663740729a7c1b0bda1f3be8"}]}] Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e9f1debe663740729a7c1b0bda1f3be8 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FloatingIPsAssociationTestJSON-439926085-project Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: d9a36048b1dd4b55a83ab53268489736 Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-439926085-project Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f0431a82-56a4-4caf-ae0b-8d3134cdd4ac'} Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.426163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:04.430914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.430914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:04.430914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:04.430914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:04.430914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:04.430914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:04.430914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. Jul 26 19:53:04.430914 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:04.432531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Returning 404 to user: Instance f0431a82-56a4-4caf-ae0b-8d3134cdd4ac could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:04.433557 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d18ccfb-87e5-44a7-8c94-2ea83771a7cd tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac" status: 404 len: 111 microversion: 2.1 time: 0.072857 Jul 26 19:53:04.434830 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1196/2370] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:04 2022] GET /compute/v2.1/servers/f0431a82-56a4-4caf-ae0b-8d3134cdd4ac => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:04.440300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b96d2e39-67a7-43d1-ac65-0f59fd219afe tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ee67160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:04.518211 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b96d2e39-67a7-43d1-ac65-0f59fd219afe tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.081815 Jul 26 19:53:04.521412 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1197/2371] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:53:04 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:04.535730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-da64ebd5-e908-4f7f-932b-f3057e81242e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '.version_select at 0x7f875ee0f790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:05.348203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cb22cb20-c1a4-4b4d-b44f-869fe453a330 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:05.356635 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cb22cb20-c1a4-4b4d-b44f-869fe453a330 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1328 microversion: 2.1 time: 1.052948 Jul 26 19:53:05.357775 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1175/2372] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:04 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1328 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:05.362435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-13114753-0626-4ecf-933f-5c307ebcf6a9 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f876830ea60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:06.458126 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-13114753-0626-4ecf-933f-5c307ebcf6a9 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "DELETE /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711" status: 204 len: 0 microversion: 2.1 time: 1.098892 Jul 26 19:53:06.458753 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1176/2373] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:05 2022] DELETE /compute/v2.1/images/dcce0abf-f7ba-4646-8358-75a8ae9f6711 => generated 0 bytes in 1100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:06.469228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d54c145-36c6-493e-853c-79e945fcdfd5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:06.469852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d54c145-36c6-493e-853c-79e945fcdfd5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:06.483894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d54c145-36c6-493e-853c-79e945fcdfd5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:06.484739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d54c145-36c6-493e-853c-79e945fcdfd5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:06.485732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d54c145-36c6-493e-853c-79e945fcdfd5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:06.486327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d54c145-36c6-493e-853c-79e945fcdfd5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:06.942535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6d54c145-36c6-493e-853c-79e945fcdfd5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:06.953472 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d54c145-36c6-493e-853c-79e945fcdfd5 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.488783 Jul 26 19:53:06.954052 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1177/2374] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:06 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:06.958688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe36edb8-7cef-4e2f-b17d-f5827cae318e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:06.959297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fe36edb8-7cef-4e2f-b17d-f5827cae318e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:06.966177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe36edb8-7cef-4e2f-b17d-f5827cae318e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:06.966836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe36edb8-7cef-4e2f-b17d-f5827cae318e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:06.967796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe36edb8-7cef-4e2f-b17d-f5827cae318e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:06.968400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe36edb8-7cef-4e2f-b17d-f5827cae318e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:07.028578 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-da64ebd5-e908-4f7f-932b-f3057e81242e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/951d70b0-e87e-4d5a-9576-0a41fa0374de" status: 202 len: 0 microversion: 2.1 time: 2.497087 Jul 26 19:53:07.032494 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1198/2375] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:53:04 2022] DELETE /compute/v2.1/os-floating-ips/951d70b0-e87e-4d5a-9576-0a41fa0374de => generated 0 bytes in 2510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:07.036408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab28efed-834c-445d-81f8-77d881e7a0f4 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:07.037150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab28efed-834c-445d-81f8-77d881e7a0f4 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:07.046069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab28efed-834c-445d-81f8-77d881e7a0f4 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:07.048627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab28efed-834c-445d-81f8-77d881e7a0f4 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:07.049727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab28efed-834c-445d-81f8-77d881e7a0f4 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:07.050369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab28efed-834c-445d-81f8-77d881e7a0f4 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:07.333553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab28efed-834c-445d-81f8-77d881e7a0f4 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:07.334463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fe36edb8-7cef-4e2f-b17d-f5827cae318e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:07.338759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:07.343363 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab28efed-834c-445d-81f8-77d881e7a0f4 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.312788 Jul 26 19:53:07.345344 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe36edb8-7cef-4e2f-b17d-f5827cae318e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.390105 Jul 26 19:53:07.348576 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1178/2376] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:06 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:07.360262 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1199/2377] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:07 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:07.362246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4c445d52-15ad-4263-8db4-ef59f7b4e3ed tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f8768346e50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:07.369927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bbb8bd77-bec7-4f07-a3a9-6976b4de51ec tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:07.371023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bbb8bd77-bec7-4f07-a3a9-6976b4de51ec tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:07.377032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd77-bec7-4f07-a3a9-6976b4de51ec tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:07.377686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd77-bec7-4f07-a3a9-6976b4de51ec tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:07.378662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd77-bec7-4f07-a3a9-6976b4de51ec tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:07.379247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd77-bec7-4f07-a3a9-6976b4de51ec tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:07.972128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bbb8bd77-bec7-4f07-a3a9-6976b4de51ec tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:07.991081 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bbb8bd77-bec7-4f07-a3a9-6976b4de51ec tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1328 microversion: 2.1 time: 0.632177 Jul 26 19:53:07.991895 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1179/2378] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:07 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1328 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:08.007767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26b43790-87e4-4da6-98b0-abd31181a31c tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:08.009483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-26b43790-87e4-4da6-98b0-abd31181a31c tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:08.027548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26b43790-87e4-4da6-98b0-abd31181a31c tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.028578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26b43790-87e4-4da6-98b0-abd31181a31c tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.029005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26b43790-87e4-4da6-98b0-abd31181a31c tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.029717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26b43790-87e4-4da6-98b0-abd31181a31c tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.077806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-26b43790-87e4-4da6-98b0-abd31181a31c tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:53:08.152769 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4c445d52-15ad-4263-8db4-ef59f7b4e3ed tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "DELETE /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc" status: 204 len: 0 microversion: 2.1 time: 0.794537 Jul 26 19:53:08.153343 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1200/2379] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:07 2022] DELETE /compute/v2.1/images/988f7dc5-8160-405c-816f-820cfc49f4fc => generated 0 bytes in 796 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:08.158781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-201b3547-4544-4412-8247-ea3552971f01 req-1ba852aa-ff0d-45ce-a0f2-8ed1f0dedb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5aa6cf-6d71-476b-8eab-a84d73556c54", "name": "network-vif-plugged", "status": "completed", "tag": "e46fdec1-bb14-40ce-943b-7f7f98cd144c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:08.184326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-201b3547-4544-4412-8247-ea3552971f01 req-1ba852aa-ff0d-45ce-a0f2-8ed1f0dedb01 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.185489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-201b3547-4544-4412-8247-ea3552971f01 req-1ba852aa-ff0d-45ce-a0f2-8ed1f0dedb01 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.234721 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-201b3547-4544-4412-8247-ea3552971f01 req-1ba852aa-ff0d-45ce-a0f2-8ed1f0dedb01 service nova] Creating event network-vif-plugged:e46fdec1-bb14-40ce-943b-7f7f98cd144c for instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 on n-h1-708768-8 Jul 26 19:53:08.236683 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-26b43790-87e4-4da6-98b0-abd31181a31c tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 204 len: 0 microversion: 2.1 time: 0.234820 Jul 26 19:53:08.237642 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1180/2380] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:53:07 2022] DELETE /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:08.246580 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-201b3547-4544-4412-8247-ea3552971f01 req-1ba852aa-ff0d-45ce-a0f2-8ed1f0dedb01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090555 Jul 26 19:53:08.247392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e46e57d7-da21-49f3-928a-9d56225d0d25 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:08.247808 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1201/2381] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:08.249685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e46e57d7-da21-49f3-928a-9d56225d0d25 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:08.254079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-659147fc-5ffd-4bf0-85d1-a3c006e51107 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f875ed34b80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:08.275008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46e57d7-da21-49f3-928a-9d56225d0d25 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.275702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46e57d7-da21-49f3-928a-9d56225d0d25 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.277225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46e57d7-da21-49f3-928a-9d56225d0d25 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.277818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46e57d7-da21-49f3-928a-9d56225d0d25 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.523979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e46e57d7-da21-49f3-928a-9d56225d0d25 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:08.537715 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e46e57d7-da21-49f3-928a-9d56225d0d25 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.298480 Jul 26 19:53:08.549231 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1181/2382] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:08 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:08.549231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d97bee4b-f3ae-4e6d-951c-83541b8885c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:08.549231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d97bee4b-f3ae-4e6d-951c-83541b8885c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:08.553761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d97bee4b-f3ae-4e6d-951c-83541b8885c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.554420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d97bee4b-f3ae-4e6d-951c-83541b8885c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.556525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d97bee4b-f3ae-4e6d-951c-83541b8885c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.557120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d97bee4b-f3ae-4e6d-951c-83541b8885c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.796423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d97bee4b-f3ae-4e6d-951c-83541b8885c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:08.809707 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d97bee4b-f3ae-4e6d-951c-83541b8885c8 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1526 microversion: 2.1 time: 0.265258 Jul 26 19:53:08.814483 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1182/2383] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:08 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:08.821308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed0f98cb-bed4-4489-b3f9-be56e3343495 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:08.825701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed0f98cb-bed4-4489-b3f9-be56e3343495 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:08.844387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed0f98cb-bed4-4489-b3f9-be56e3343495 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.845269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed0f98cb-bed4-4489-b3f9-be56e3343495 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.847395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed0f98cb-bed4-4489-b3f9-be56e3343495 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.848074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed0f98cb-bed4-4489-b3f9-be56e3343495 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.895915 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-659147fc-5ffd-4bf0-85d1-a3c006e51107 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "DELETE /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44" status: 204 len: 0 microversion: 2.1 time: 0.645649 Jul 26 19:53:08.899690 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1202/2384] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:08 2022] DELETE /compute/v2.1/images/6430b7db-83ca-4f01-b37c-852f0de20a44 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:08.906167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d93a916-9eab-4966-bd2f-df0be76100be tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:08.907998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d93a916-9eab-4966-bd2f-df0be76100be tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:08.923287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d93a916-9eab-4966-bd2f-df0be76100be tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.923858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d93a916-9eab-4966-bd2f-df0be76100be tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:08.925777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d93a916-9eab-4966-bd2f-df0be76100be tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:08.927335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d93a916-9eab-4966-bd2f-df0be76100be tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:09.079268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ed0f98cb-bed4-4489-b3f9-be56e3343495 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:09.094135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed0f98cb-bed4-4489-b3f9-be56e3343495 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.278172 Jul 26 19:53:09.095556 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1183/2385] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:08 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:09.103448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e9d03258-936d-4df2-b010-28d63bc83f7d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:09.104991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e9d03258-936d-4df2-b010-28d63bc83f7d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:09.114394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9d03258-936d-4df2-b010-28d63bc83f7d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:09.114848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9d03258-936d-4df2-b010-28d63bc83f7d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:09.116209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9d03258-936d-4df2-b010-28d63bc83f7d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:09.116658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9d03258-936d-4df2-b010-28d63bc83f7d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:09.151436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e9d03258-936d-4df2-b010-28d63bc83f7d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:53:09.338545 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e9d03258-936d-4df2-b010-28d63bc83f7d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 204 len: 0 microversion: 2.1 time: 0.241447 Jul 26 19:53:09.349151 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1184/2386] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:53:09 2022] DELETE /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:09.361158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-daedccca-5e6d-4595-a197-4a462861fe3e tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:09.361884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-daedccca-5e6d-4595-a197-4a462861fe3e tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:09.379359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daedccca-5e6d-4595-a197-4a462861fe3e tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:09.379848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daedccca-5e6d-4595-a197-4a462861fe3e tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:09.380650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daedccca-5e6d-4595-a197-4a462861fe3e tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:09.381094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daedccca-5e6d-4595-a197-4a462861fe3e tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:09.477601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d93a916-9eab-4966-bd2f-df0be76100be tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:09.488131 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d93a916-9eab-4966-bd2f-df0be76100be tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.586610 Jul 26 19:53:09.488723 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1203/2387] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:08 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:09.498807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55588599-3e98-4cc3-b3ed-50d7e788fd11 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:09.499588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55588599-3e98-4cc3-b3ed-50d7e788fd11 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:09.540078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55588599-3e98-4cc3-b3ed-50d7e788fd11 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:09.542798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55588599-3e98-4cc3-b3ed-50d7e788fd11 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:09.543928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55588599-3e98-4cc3-b3ed-50d7e788fd11 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:09.544535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55588599-3e98-4cc3-b3ed-50d7e788fd11 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:09.743732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-daedccca-5e6d-4595-a197-4a462861fe3e tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:09.752843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-daedccca-5e6d-4595-a197-4a462861fe3e tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1328 microversion: 2.1 time: 0.402183 Jul 26 19:53:09.753440 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1185/2388] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:09 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1328 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:09.765522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dca1c77d-73f0-4619-bc57-1b4747587719 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:09.769140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dca1c77d-73f0-4619-bc57-1b4747587719 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:09.788332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dca1c77d-73f0-4619-bc57-1b4747587719 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:09.789117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dca1c77d-73f0-4619-bc57-1b4747587719 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:09.790593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dca1c77d-73f0-4619-bc57-1b4747587719 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:09.791195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dca1c77d-73f0-4619-bc57-1b4747587719 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.082686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dca1c77d-73f0-4619-bc57-1b4747587719 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:10.093799 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dca1c77d-73f0-4619-bc57-1b4747587719 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.339041 Jul 26 19:53:10.104821 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1186/2389] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:09 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:10.120139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d01f529f-11b8-4001-80f7-16bb3f3f7c71 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:10.121039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d01f529f-11b8-4001-80f7-16bb3f3f7c71 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:10.128497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d01f529f-11b8-4001-80f7-16bb3f3f7c71 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:10.129349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d01f529f-11b8-4001-80f7-16bb3f3f7c71 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.130372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d01f529f-11b8-4001-80f7-16bb3f3f7c71 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:10.131038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d01f529f-11b8-4001-80f7-16bb3f3f7c71 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.138425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:10.362288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d01f529f-11b8-4001-80f7-16bb3f3f7c71 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:10.374048 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d01f529f-11b8-4001-80f7-16bb3f3f7c71 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1526 microversion: 2.1 time: 0.267410 Jul 26 19:53:10.374808 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1187/2390] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:10 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1526 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:10.379793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf2d08d4-795b-4545-a596-ce30b899b514 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:10.380617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf2d08d4-795b-4545-a596-ce30b899b514 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:10.387920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf2d08d4-795b-4545-a596-ce30b899b514 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:10.388593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf2d08d4-795b-4545-a596-ce30b899b514 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.388996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55588599-3e98-4cc3-b3ed-50d7e788fd11 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:10.389718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf2d08d4-795b-4545-a596-ce30b899b514 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:10.390316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf2d08d4-795b-4545-a596-ce30b899b514 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.406246 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55588599-3e98-4cc3-b3ed-50d7e788fd11 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1471 microversion: 2.1 time: 0.914279 Jul 26 19:53:10.407716 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1204/2391] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:09 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1471 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:10.526325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87301fc2-6b67-4b30-ad1b-b7ee5f0b373e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:10.527068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87301fc2-6b67-4b30-ad1b-b7ee5f0b373e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:10.543343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:10.550508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87301fc2-6b67-4b30-ad1b-b7ee5f0b373e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:10.552539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87301fc2-6b67-4b30-ad1b-b7ee5f0b373e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.554253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87301fc2-6b67-4b30-ad1b-b7ee5f0b373e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:10.556561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87301fc2-6b67-4b30-ad1b-b7ee5f0b373e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.641551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf2d08d4-795b-4545-a596-ce30b899b514 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:10.651379 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf2d08d4-795b-4545-a596-ce30b899b514 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.275337 Jul 26 19:53:10.652089 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1188/2392] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:10 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:10.776922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a54b5e5-5ac9-4a93-99ad-90ceb0a28ad1 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:10.777474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a54b5e5-5ac9-4a93-99ad-90ceb0a28ad1 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:10.791032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:10.810207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a54b5e5-5ac9-4a93-99ad-90ceb0a28ad1 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:10.811770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a54b5e5-5ac9-4a93-99ad-90ceb0a28ad1 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.817615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a54b5e5-5ac9-4a93-99ad-90ceb0a28ad1 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:10.818574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a54b5e5-5ac9-4a93-99ad-90ceb0a28ad1 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:10.986108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-87301fc2-6b67-4b30-ad1b-b7ee5f0b373e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:11.003027 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87301fc2-6b67-4b30-ad1b-b7ee5f0b373e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.477848 Jul 26 19:53:11.004099 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1205/2393] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:10 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:11.120174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6aa1da42-fe11-40d6-921e-085499ca6fb2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:11.120811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6aa1da42-fe11-40d6-921e-085499ca6fb2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:11.132449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aa1da42-fe11-40d6-921e-085499ca6fb2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:11.134726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aa1da42-fe11-40d6-921e-085499ca6fb2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:11.144001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aa1da42-fe11-40d6-921e-085499ca6fb2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:11.145023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aa1da42-fe11-40d6-921e-085499ca6fb2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:11.209592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a54b5e5-5ac9-4a93-99ad-90ceb0a28ad1 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:11.222527 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a54b5e5-5ac9-4a93-99ad-90ceb0a28ad1 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1527 microversion: 2.1 time: 0.449816 Jul 26 19:53:11.224786 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1189/2394] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:10 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1527 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:11.253755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9ee5dc9c-b9f9-455d-bb3e-e1fbb31e90b5 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:11.262369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9ee5dc9c-b9f9-455d-bb3e-e1fbb31e90b5 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:11.275344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc9c-b9f9-455d-bb3e-e1fbb31e90b5 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:11.275777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc9c-b9f9-455d-bb3e-e1fbb31e90b5 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:11.276575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc9c-b9f9-455d-bb3e-e1fbb31e90b5 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:11.277015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc9c-b9f9-455d-bb3e-e1fbb31e90b5 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:11.574673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6aa1da42-fe11-40d6-921e-085499ca6fb2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:11.584364 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6aa1da42-fe11-40d6-921e-085499ca6fb2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1717 microversion: 2.1 time: 0.469766 Jul 26 19:53:11.600360 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1206/2395] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:11 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1717 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:11.607839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11421b99-1835-40a3-b9f3-3eb5f1a7be0e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:11.608814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11421b99-1835-40a3-b9f3-3eb5f1a7be0e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:11.615911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11421b99-1835-40a3-b9f3-3eb5f1a7be0e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:11.616614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11421b99-1835-40a3-b9f3-3eb5f1a7be0e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:11.617919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11421b99-1835-40a3-b9f3-3eb5f1a7be0e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:11.618527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11421b99-1835-40a3-b9f3-3eb5f1a7be0e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:11.831333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-11421b99-1835-40a3-b9f3-3eb5f1a7be0e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:11.843135 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11421b99-1835-40a3-b9f3-3eb5f1a7be0e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1526 microversion: 2.1 time: 0.239810 Jul 26 19:53:11.843887 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1207/2396] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:11 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1526 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:11.848672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cefa0f9c-d723-4743-ae7f-8e3d455930e3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:11.849505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cefa0f9c-d723-4743-ae7f-8e3d455930e3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:11.856291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cefa0f9c-d723-4743-ae7f-8e3d455930e3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:11.857010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cefa0f9c-d723-4743-ae7f-8e3d455930e3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:11.857857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cefa0f9c-d723-4743-ae7f-8e3d455930e3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:11.858445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cefa0f9c-d723-4743-ae7f-8e3d455930e3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:12.347150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9ee5dc9c-b9f9-455d-bb3e-e1fbb31e90b5 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:12.365062 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9ee5dc9c-b9f9-455d-bb3e-e1fbb31e90b5 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1527 microversion: 2.1 time: 1.119190 Jul 26 19:53:12.366213 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1190/2397] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:11 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1527 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:12.382166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff352837-264a-4171-93af-8172ca55095f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:12.382395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cefa0f9c-d723-4743-ae7f-8e3d455930e3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:12.383696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff352837-264a-4171-93af-8172ca55095f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:12.390391 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cefa0f9c-d723-4743-ae7f-8e3d455930e3 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1471 microversion: 2.1 time: 0.545217 Jul 26 19:53:12.390984 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1208/2398] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:11 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1471 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:12.392996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff352837-264a-4171-93af-8172ca55095f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:12.394285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff352837-264a-4171-93af-8172ca55095f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:12.395278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff352837-264a-4171-93af-8172ca55095f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:12.395913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff352837-264a-4171-93af-8172ca55095f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:12.421225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d2be519-eb2b-4f43-a9a0-3c5cafc644a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:12.421841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d2be519-eb2b-4f43-a9a0-3c5cafc644a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:12.430444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d2be519-eb2b-4f43-a9a0-3c5cafc644a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:12.435983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d2be519-eb2b-4f43-a9a0-3c5cafc644a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:12.437277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d2be519-eb2b-4f43-a9a0-3c5cafc644a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:12.437876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d2be519-eb2b-4f43-a9a0-3c5cafc644a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:12.793665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff352837-264a-4171-93af-8172ca55095f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:12.802967 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff352837-264a-4171-93af-8172ca55095f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.433422 Jul 26 19:53:12.816448 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1191/2399] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:12 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:12.879833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4d2be519-eb2b-4f43-a9a0-3c5cafc644a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:12.892313 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d2be519-eb2b-4f43-a9a0-3c5cafc644a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.475135 Jul 26 19:53:12.894937 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1209/2400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:12 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:12.903329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdc43cac-b98b-4b4d-9b17-95238589aaa6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:12.904185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cdc43cac-b98b-4b4d-9b17-95238589aaa6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:12.916068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdc43cac-b98b-4b4d-9b17-95238589aaa6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:12.926302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdc43cac-b98b-4b4d-9b17-95238589aaa6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:12.927436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdc43cac-b98b-4b4d-9b17-95238589aaa6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:12.928081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdc43cac-b98b-4b4d-9b17-95238589aaa6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:12.999529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:13.003719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:13.015355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.016106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.017585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.018467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.066677 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] HTTP exception thrown: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Request method failure captured: Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 HTTP/1.1 Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EYOEmPINQRMc8DdkFIzuLUA3QNoSPK-RmMEgWeiJO-Upbk0b3yC9yVzoFjP9AFzS99csfefe6CvhEKazAZsutfch_yAqZrc0-ZIJrvpxNtZN4rVUkEL-wgokNZLuwU-vHG85eTVlok4YW3sDPMygBqHglqqu7kKRQWNHQvUlLwmEQE Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a8a903a0c87a40909869991f15a970cf Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1165960865 Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8a903a0c87a40909869991f15a970cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8a903a0c87a40909869991f15a970cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8a903a0c87a40909869991f15a970cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8a903a0c87a40909869991f15a970cf"}]}] Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1165960865 Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a8a903a0c87a40909869991f15a970cf Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1165960865 Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1165960865-project Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 61b8e06611b84c7e9efb09bd5804c7cb Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1165960865-project Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7d5aa6cf-6d71-476b-8eab-a84d73556c54'} Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:13.068802 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:13.073582 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:13.079021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Returning 404 to user: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:13.080683 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02ab441e-78e4-415c-ab07-825ee87d2efe tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 404 len: 111 microversion: 2.1 time: 0.262837 Jul 26 19:53:13.084328 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1192/2401] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:53:12 2022] DELETE /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:13.094864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d1da6166-b068-40aa-8fb5-e9c42afd6489 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:13.097968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d1da6166-b068-40aa-8fb5-e9c42afd6489 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:13.108127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1da6166-b068-40aa-8fb5-e9c42afd6489 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.108948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1da6166-b068-40aa-8fb5-e9c42afd6489 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.111781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1da6166-b068-40aa-8fb5-e9c42afd6489 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.112801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1da6166-b068-40aa-8fb5-e9c42afd6489 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.277951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1da6166-b068-40aa-8fb5-e9c42afd6489 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a36048b1dd4b55a83ab53268489736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f1debe663740729a7c1b0bda1f3be8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:13.291791 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d1da6166-b068-40aa-8fb5-e9c42afd6489 tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 200 len: 1484 microversion: 2.1 time: 0.203359 Jul 26 19:53:13.292379 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1193/2402] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:13 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 1484 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:13.305601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6905d947-ac21-4eab-a4c9-86d5ab643516 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:13.306663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6905d947-ac21-4eab-a4c9-86d5ab643516 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:13.321208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6905d947-ac21-4eab-a4c9-86d5ab643516 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.323148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6905d947-ac21-4eab-a4c9-86d5ab643516 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.325761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cdc43cac-b98b-4b4d-9b17-95238589aaa6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:13.326925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6905d947-ac21-4eab-a4c9-86d5ab643516 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.327568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6905d947-ac21-4eab-a4c9-86d5ab643516 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.338854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cdc43cac-b98b-4b4d-9b17-95238589aaa6 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1707 microversion: 2.1 time: 0.436476 Jul 26 19:53:13.351783 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1210/2403] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:12 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1707 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:13.370978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b03379dc-f1bb-4f8d-b630-f6f0d34419eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '.version_select at 0x7f875f1175e0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:13.378696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b03379dc-f1bb-4f8d-b630-f6f0d34419eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.379251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b03379dc-f1bb-4f8d-b630-f6f0d34419eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.399684 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b03379dc-f1bb-4f8d-b630-f6f0d34419eb tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.037810 Jul 26 19:53:13.401887 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1211/2404] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:53:13 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:13.417389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f40cee1-9ded-4f40-9fcb-81c13f5dec74 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:13.420804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1f40cee1-9ded-4f40-9fcb-81c13f5dec74 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:13.440236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f40cee1-9ded-4f40-9fcb-81c13f5dec74 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.440399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f40cee1-9ded-4f40-9fcb-81c13f5dec74 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.442069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f40cee1-9ded-4f40-9fcb-81c13f5dec74 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.443394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f40cee1-9ded-4f40-9fcb-81c13f5dec74 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.557817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1f40cee1-9ded-4f40-9fcb-81c13f5dec74 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:13.574729 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1f40cee1-9ded-4f40-9fcb-81c13f5dec74 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 200 len: 1429 microversion: 2.1 time: 0.166621 Jul 26 19:53:13.590192 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1212/2405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:13 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 1429 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:13.597115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-39cac8c0-2790-421a-b0f5-5b7d56fb2463 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:13.598195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-39cac8c0-2790-421a-b0f5-5b7d56fb2463 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:13.608151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39cac8c0-2790-421a-b0f5-5b7d56fb2463 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.608904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39cac8c0-2790-421a-b0f5-5b7d56fb2463 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.610771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39cac8c0-2790-421a-b0f5-5b7d56fb2463 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.611475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39cac8c0-2790-421a-b0f5-5b7d56fb2463 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.847099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6905d947-ac21-4eab-a4c9-86d5ab643516 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:13.858061 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6905d947-ac21-4eab-a4c9-86d5ab643516 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1527 microversion: 2.1 time: 0.561262 Jul 26 19:53:13.858671 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1194/2406] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:13 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1527 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:13.888505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-21d269c2-fa2f-4439-8b98-99d0389b5cea req-ce44b44a-7cbc-4641-b3f6-6da15ee23d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f63e6b1-f0f3-4728-9d81-55e213d76670", "name": "network-vif-deleted", "tag": "57157a04-5595-4f99-80d3-334f6ed29d8b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:13.901295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-21d269c2-fa2f-4439-8b98-99d0389b5cea req-ce44b44a-7cbc-4641-b3f6-6da15ee23d5e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:13.901972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-21d269c2-fa2f-4439-8b98-99d0389b5cea req-ce44b44a-7cbc-4641-b3f6-6da15ee23d5e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:13.942922 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-21d269c2-fa2f-4439-8b98-99d0389b5cea req-ce44b44a-7cbc-4641-b3f6-6da15ee23d5e service nova] Creating event network-vif-deleted:57157a04-5595-4f99-80d3-334f6ed29d8b for instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 on n-h2-708768-8 Jul 26 19:53:13.974269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-21d269c2-fa2f-4439-8b98-99d0389b5cea req-ce44b44a-7cbc-4641-b3f6-6da15ee23d5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095026 Jul 26 19:53:13.976717 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1195/2407] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:13.985803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a50ab37c-ad4c-43e1-9c5f-31c3c13b1b6c req-8baf6377-394e-4fd9-a352-2576c32cee14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc24d0ee-65ce-4620-a3b2-263af9715a2e", "name": "network-vif-deleted", "tag": "86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:14.000086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a50ab37c-ad4c-43e1-9c5f-31c3c13b1b6c req-8baf6377-394e-4fd9-a352-2576c32cee14 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.000758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a50ab37c-ad4c-43e1-9c5f-31c3c13b1b6c req-8baf6377-394e-4fd9-a352-2576c32cee14 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.006586 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-39cac8c0-2790-421a-b0f5-5b7d56fb2463 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1858 microversion: 2.1 time: 0.412587 Jul 26 19:53:14.018557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a50ab37c-ad4c-43e1-9c5f-31c3c13b1b6c req-8baf6377-394e-4fd9-a352-2576c32cee14 service nova] Creating event network-vif-deleted:86f2f337-b2b4-44ba-80ec-9e5bd79fe4e8 for instance cc24d0ee-65ce-4620-a3b2-263af9715a2e on n-h2-708768-8 Jul 26 19:53:14.033744 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a50ab37c-ad4c-43e1-9c5f-31c3c13b1b6c req-8baf6377-394e-4fd9-a352-2576c32cee14 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054968 Jul 26 19:53:14.034953 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1196/2408] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:14.040872 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1213/2409] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:13 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1858 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:14.046384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b941d9d-68c2-4e21-87c4-e001c8666976 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:14.050324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0b941d9d-68c2-4e21-87c4-e001c8666976 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.053471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Action: 'update', calling method: >, body: {"server": {"name": "7d5aa6cf-6d71-476b-8eab-a84d73556c54_new"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:14.067641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.071526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b941d9d-68c2-4e21-87c4-e001c8666976 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.072332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b941d9d-68c2-4e21-87c4-e001c8666976 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.073363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b941d9d-68c2-4e21-87c4-e001c8666976 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.074032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b941d9d-68c2-4e21-87c4-e001c8666976 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.083777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.086483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.089903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.091976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.141755 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] HTTP exception thrown: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Request method failure captured: Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: request: PUT /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 HTTP/1.1 Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 64 Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EYOEmPINQRMc8DdkFIzuLUA3QNoSPK-RmMEgWeiJO-Upbk0b3yC9yVzoFjP9AFzS99csfefe6CvhEKazAZsutfch_yAqZrc0-ZIJrvpxNtZN4rVUkEL-wgokNZLuwU-vHG85eTVlok4YW3sDPMygBqHglqqu7kKRQWNHQvUlLwmEQE Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a8a903a0c87a40909869991f15a970cf Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1165960865 Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8a903a0c87a40909869991f15a970cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8a903a0c87a40909869991f15a970cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8a903a0c87a40909869991f15a970cf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8a903a0c87a40909869991f15a970cf"}]}] Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1165960865 Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a8a903a0c87a40909869991f15a970cf Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1165960865 Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1165960865-project Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 61b8e06611b84c7e9efb09bd5804c7cb Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1165960865-project Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "7d5aa6cf-6d71-476b-8eab-a84d73556c54_new"}} Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7d5aa6cf-6d71-476b-8eab-a84d73556c54', 'body': {'server': {'name': '7d5aa6cf-6d71-476b-8eab-a84d73556c54_new'}}} Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 19:53:14.143860 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:14.147424 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.157742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] Returning 404 to user: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:14.163889 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7fc6333-05bf-4dc5-a02e-1c4402ae5e9a tempest-ServersNegativeTestMultiTenantJSON-1165960865 tempest-ServersNegativeTestMultiTenantJSON-1165960865-project] 10.222.0.58 "PUT /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 404 len: 111 microversion: 2.1 time: 0.117198 Jul 26 19:53:14.168378 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1214/2410] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 19:53:14 2022] PUT /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:14.176020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60c612f6-0336-45cc-81a2-b2552f76e7d8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:14.185237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60c612f6-0336-45cc-81a2-b2552f76e7d8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.193185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60c612f6-0336-45cc-81a2-b2552f76e7d8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.195648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60c612f6-0336-45cc-81a2-b2552f76e7d8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.197463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60c612f6-0336-45cc-81a2-b2552f76e7d8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.198150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60c612f6-0336-45cc-81a2-b2552f76e7d8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.400028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60c612f6-0336-45cc-81a2-b2552f76e7d8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:14.410136 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60c612f6-0336-45cc-81a2-b2552f76e7d8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1502 microversion: 2.1 time: 0.240141 Jul 26 19:53:14.410667 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1215/2411] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:14 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:14.417671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8919179-702a-428b-9736-aa10152537f1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:14.418721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8919179-702a-428b-9736-aa10152537f1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.424238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0b941d9d-68c2-4e21-87c4-e001c8666976 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:14.426721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8919179-702a-428b-9736-aa10152537f1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.427402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8919179-702a-428b-9736-aa10152537f1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.428412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8919179-702a-428b-9736-aa10152537f1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.429152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8919179-702a-428b-9736-aa10152537f1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.435374 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0b941d9d-68c2-4e21-87c4-e001c8666976 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1524 microversion: 2.1 time: 0.398137 Jul 26 19:53:14.436602 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1197/2412] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:14 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1524 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:14.447141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-178a5da9-0fe1-446a-8c2e-2b33544f2541 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:14.448374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-178a5da9-0fe1-446a-8c2e-2b33544f2541 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.458391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-178a5da9-0fe1-446a-8c2e-2b33544f2541 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.482628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-178a5da9-0fe1-446a-8c2e-2b33544f2541 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.485438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-178a5da9-0fe1-446a-8c2e-2b33544f2541 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.486955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-178a5da9-0fe1-446a-8c2e-2b33544f2541 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.530773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-178a5da9-0fe1-446a-8c2e-2b33544f2541 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:53:14.751025 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-178a5da9-0fe1-446a-8c2e-2b33544f2541 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 204 len: 0 microversion: 2.1 time: 0.311421 Jul 26 19:53:14.752955 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1198/2413] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:53:14 2022] DELETE /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:14.756275 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8919179-702a-428b-9736-aa10152537f1 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1858 microversion: 2.1 time: 0.340907 Jul 26 19:53:14.756275 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1216/2414] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:14 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1858 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:14.762307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08dd59b4-b974-4a61-91ec-551f909b50bf"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:14.762806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:14.763578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] [instance: 9f63e6b1-f0f3-4728-9d81-55e213d76670] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.765060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.775366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.776279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.777639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.778402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.799162 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] HTTP exception thrown: Instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 could not be found. Jul 26 19:53:14.799989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.800446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Request method failure captured: Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 HTTP/1.1 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EXBEr2ZxhG7uf_uREebmXkiAWF0xEvO2af8mHHlA_n5ygj9HbQ1BtO7k83dWtR7J-xFxlZpdI4jm7pL-x_fDZbwIPnDS4GGguxXAIfb71GaptWILvbxpdcSo9nYYM63fhjE_avRnxzM6nwz-V_FeWzWHNq9_JMGqfH8NnNxUvwx5MU Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e9f1debe663740729a7c1b0bda1f3be8 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e9f1debe663740729a7c1b0bda1f3be8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f1debe663740729a7c1b0bda1f3be8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e9f1debe663740729a7c1b0bda1f3be8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e9f1debe663740729a7c1b0bda1f3be8"}]}] Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e9f1debe663740729a7c1b0bda1f3be8 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-439926085 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsAssociationTestJSON-439926085-project Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: d9a36048b1dd4b55a83ab53268489736 Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-439926085-project Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 could not be found. Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '9f63e6b1-f0f3-4728-9d81-55e213d76670'} Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 could not be found. Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 could not be found. Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.801697 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:14.805547 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.805547 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.805547 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:14.805547 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:14.805547 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:14.805547 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:14.805547 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 could not be found. Jul 26 19:53:14.805547 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.808074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] Returning 404 to user: Instance 9f63e6b1-f0f3-4728-9d81-55e213d76670 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:14.809260 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21567116-a62d-40a8-b3e7-4f6d269c1e5e tempest-FloatingIPsAssociationTestJSON-439926085 tempest-FloatingIPsAssociationTestJSON-439926085-project] 10.222.0.58 "GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670" status: 404 len: 111 microversion: 2.1 time: 0.054417 Jul 26 19:53:14.810057 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1199/2415] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:14 2022] GET /compute/v2.1/servers/9f63e6b1-f0f3-4728-9d81-55e213d76670 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:14.813698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.813698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.815737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:14.816371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: cc24d0ee-65ce-4620-a3b2-263af9715a2e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.825285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.825745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.826534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.826976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.845396 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] HTTP exception thrown: Instance cc24d0ee-65ce-4620-a3b2-263af9715a2e could not be found. Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Request method failure captured: Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e HTTP/1.1 Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EV1SU_52cVZYxMUwiSbd_F4Fbz_76le9MzCyWc4ev6S77l8srLX4jPASVzU51GFD5zf8sqbA-5qFtkZNklT2T-oCVNI2WgsYG1m2r5MNQni-bIva0AozksibKxd3YpKL3599eI9swDfHjefJhU07T8nXwhdrop1zCDIqsfJ8q6dyr0 Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f793318e056d4e04be4c0424fe43ef3f Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ListImageFiltersTestJSON-1552829222 Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f793318e056d4e04be4c0424fe43ef3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f793318e056d4e04be4c0424fe43ef3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f793318e056d4e04be4c0424fe43ef3f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f793318e056d4e04be4c0424fe43ef3f"}]}] Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ListImageFiltersTestJSON-1552829222 Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f793318e056d4e04be4c0424fe43ef3f Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1552829222 Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ListImageFiltersTestJSON-1552829222-project Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 908bdad3c14b4f0a9043fd8f41b4c5eb Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ListImageFiltersTestJSON-1552829222-project Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance cc24d0ee-65ce-4620-a3b2-263af9715a2e could not be found. Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'cc24d0ee-65ce-4620-a3b2-263af9715a2e'} Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc24d0ee-65ce-4620-a3b2-263af9715a2e could not be found. Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc24d0ee-65ce-4620-a3b2-263af9715a2e could not be found. Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:14.847433 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.852842 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.852842 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:14.852842 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:14.852842 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:14.852842 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:14.852842 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc24d0ee-65ce-4620-a3b2-263af9715a2e could not be found. Jul 26 19:53:14.852842 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.854250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Returning 404 to user: Instance cc24d0ee-65ce-4620-a3b2-263af9715a2e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:14.855281 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a318a09-0fcb-4ea5-9200-1edcc5f70565 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e" status: 404 len: 111 microversion: 2.1 time: 0.044327 Jul 26 19:53:14.856356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1200/2416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:14 2022] GET /compute/v2.1/servers/cc24d0ee-65ce-4620-a3b2-263af9715a2e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:14.861730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db4cd8e4-c0c4-4069-9b06-5689a7b9f902 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:14.862589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-db4cd8e4-c0c4-4069-9b06-5689a7b9f902 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.870259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db4cd8e4-c0c4-4069-9b06-5689a7b9f902 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.870996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db4cd8e4-c0c4-4069-9b06-5689a7b9f902 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.872074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db4cd8e4-c0c4-4069-9b06-5689a7b9f902 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.872673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db4cd8e4-c0c4-4069-9b06-5689a7b9f902 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.928431 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Cannot 'attach_volume' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state rescued Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/os-volume_attachments HTTP/1.1 Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 74 Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: {"volumeAttachment": {"volumeId": "08dd59b4-b974-4a61-91ec-551f909b50bf"}} Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: exception: Cannot 'attach_volume' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state rescued Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '4a15e74a-9354-4cf2-908d-2c9191b2ef96', 'body': {'volumeAttachment': {'volumeId': '08dd59b4-b974-4a61-91ec-551f909b50bf'}}} Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 19:53:14.931098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state rescued Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state rescued Jul 26 19:53:14.935712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:53:14.940349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 409 to user: Cannot 'attach_volume' instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 while it is in vm_state rescued {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:14.943652 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ad4f5ee9-4b51-482e-bb15-687baccb4686 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.184817 Jul 26 19:53:14.949477 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1217/2417] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 19:53:14 2022] POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/os-volume_attachments => generated 152 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:53:14.962203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5acc9fe0-7151-4c89-9f3d-2847bae810bd tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:14.963498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5acc9fe0-7151-4c89-9f3d-2847bae810bd tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:14.974231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5acc9fe0-7151-4c89-9f3d-2847bae810bd tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.981834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5acc9fe0-7151-4c89-9f3d-2847bae810bd tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:14.982822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5acc9fe0-7151-4c89-9f3d-2847bae810bd tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:14.984885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5acc9fe0-7151-4c89-9f3d-2847bae810bd tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.056153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5acc9fe0-7151-4c89-9f3d-2847bae810bd tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:53:15.247186 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5acc9fe0-7151-4c89-9f3d-2847bae810bd tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "DELETE /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 204 len: 0 microversion: 2.1 time: 0.296150 Jul 26 19:53:15.249419 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1218/2418] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:53:14 2022] DELETE /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:15.257947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dfc8e30-fabd-45c2-ad79-8afd1ffe54ea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:15.261616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1dfc8e30-fabd-45c2-ad79-8afd1ffe54ea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:15.286542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dfc8e30-fabd-45c2-ad79-8afd1ffe54ea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.287156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dfc8e30-fabd-45c2-ad79-8afd1ffe54ea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.289019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dfc8e30-fabd-45c2-ad79-8afd1ffe54ea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.290435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dfc8e30-fabd-45c2-ad79-8afd1ffe54ea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.308838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:15.364901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-db4cd8e4-c0c4-4069-9b06-5689a7b9f902 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:15.372946 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db4cd8e4-c0c4-4069-9b06-5689a7b9f902 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1533 microversion: 2.1 time: 0.515388 Jul 26 19:53:15.414492 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1201/2419] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:14 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1533 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:15.424232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f8956d3-86f7-4e8a-9e14-6b015e315dd5 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:15.430217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f8956d3-86f7-4e8a-9e14-6b015e315dd5 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:15.444003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f8956d3-86f7-4e8a-9e14-6b015e315dd5 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.448370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f8956d3-86f7-4e8a-9e14-6b015e315dd5 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.449882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f8956d3-86f7-4e8a-9e14-6b015e315dd5 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.450838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f8956d3-86f7-4e8a-9e14-6b015e315dd5 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.507123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-1dfc8e30-fabd-45c2-ad79-8afd1ffe54ea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lazy-loading 'services' on Instance uuid a96e47b7-d312-4d66-bd84-8cee85866b25 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:53:15.562830 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f8956d3-86f7-4e8a-9e14-6b015e315dd5 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action" status: 202 len: 0 microversion: 2.1 time: 0.146756 Jul 26 19:53:15.563484 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1202/2420] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:53:15 2022] POST /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:15.573612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9176d930-2296-420f-936e-4dec67627452 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:15.582812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9176d930-2296-420f-936e-4dec67627452 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:15.594766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9176d930-2296-420f-936e-4dec67627452 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.595223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9176d930-2296-420f-936e-4dec67627452 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.596699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9176d930-2296-420f-936e-4dec67627452 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.607765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9176d930-2296-420f-936e-4dec67627452 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.627552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1dfc8e30-fabd-45c2-ad79-8afd1ffe54ea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments/58a249e2-eee3-4375-b223-2d14404f577f" status: 202 len: 0 microversion: 2.1 time: 0.374105 Jul 26 19:53:15.628662 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1219/2421] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 19:53:15 2022] DELETE /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments/58a249e2-eee3-4375-b223-2d14404f577f => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:15.634315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df8691b7-e37d-4172-bf11-760da46e6e7c tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:15.635330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-df8691b7-e37d-4172-bf11-760da46e6e7c tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:15.642399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df8691b7-e37d-4172-bf11-760da46e6e7c tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.643201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df8691b7-e37d-4172-bf11-760da46e6e7c tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.644227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df8691b7-e37d-4172-bf11-760da46e6e7c tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.645074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df8691b7-e37d-4172-bf11-760da46e6e7c tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.890712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-df8691b7-e37d-4172-bf11-760da46e6e7c tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:15.896466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9176d930-2296-420f-936e-4dec67627452 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:15.924193 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df8691b7-e37d-4172-bf11-760da46e6e7c tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1504 microversion: 2.1 time: 0.293916 Jul 26 19:53:15.924927 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1220/2422] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:15 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:15.930905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1260627-39cb-4f16-9b0a-e64211e6ea0b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:15.931167 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9176d930-2296-420f-936e-4dec67627452 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 200 len: 1473 microversion: 2.1 time: 0.365346 Jul 26 19:53:15.943391 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1203/2423] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:15 2022] GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 1473 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:15.954333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0fd93de0-2267-40a6-88d1-c16957559ae7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:15.958041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0fd93de0-2267-40a6-88d1-c16957559ae7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:15.967348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fd93de0-2267-40a6-88d1-c16957559ae7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.967903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fd93de0-2267-40a6-88d1-c16957559ae7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.968728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fd93de0-2267-40a6-88d1-c16957559ae7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.969174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fd93de0-2267-40a6-88d1-c16957559ae7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.974888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1260627-39cb-4f16-9b0a-e64211e6ea0b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:15.987582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1260627-39cb-4f16-9b0a-e64211e6ea0b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.988100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1260627-39cb-4f16-9b0a-e64211e6ea0b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:15.989008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1260627-39cb-4f16-9b0a-e64211e6ea0b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:15.990157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1260627-39cb-4f16-9b0a-e64211e6ea0b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:16.011962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:16.043354 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0fd93de0-2267-40a6-88d1-c16957559ae7 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110444 Jul 26 19:53:16.048859 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1204/2424] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:53:15 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:16.054762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5af8da77-1468-410a-9afb-e8ab2b3f554b tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Action: 'create', calling method: .version_select at 0x7f87570e5820>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1378640511", "description": "tempest-description-1874082883"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:16.223761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1260627-39cb-4f16-9b0a-e64211e6ea0b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:16.234669 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1260627-39cb-4f16-9b0a-e64211e6ea0b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1510 microversion: 2.1 time: 0.308453 Jul 26 19:53:16.235925 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1221/2425] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:15 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:16.394253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-138c0d2f-f09e-49e8-9b71-f529843538d6 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:16.394818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-138c0d2f-f09e-49e8-9b71-f529843538d6 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:16.414838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-138c0d2f-f09e-49e8-9b71-f529843538d6 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:16.415692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-138c0d2f-f09e-49e8-9b71-f529843538d6 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:16.416702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-138c0d2f-f09e-49e8-9b71-f529843538d6 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:16.417341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-138c0d2f-f09e-49e8-9b71-f529843538d6 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:16.619437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-138c0d2f-f09e-49e8-9b71-f529843538d6 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:16.631151 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-138c0d2f-f09e-49e8-9b71-f529843538d6 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1533 microversion: 2.1 time: 0.240390 Jul 26 19:53:16.633755 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1222/2426] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:16 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1533 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:16.760322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5af8da77-1468-410a-9afb-e8ab2b3f554b tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.710030 Jul 26 19:53:16.760919 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1205/2427] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:53:16 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:16.775255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6e7eda64-2161-444e-8c22-6b2492e525a0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1378640511"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:16.775833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6e7eda64-2161-444e-8c22-6b2492e525a0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:16.788058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e7eda64-2161-444e-8c22-6b2492e525a0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:16.788568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e7eda64-2161-444e-8c22-6b2492e525a0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:16.789502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e7eda64-2161-444e-8c22-6b2492e525a0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:16.789941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e7eda64-2161-444e-8c22-6b2492e525a0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:16.957200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-948a3073-b2dd-4254-93d7-f768bb3edd43 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:16.958533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-948a3073-b2dd-4254-93d7-f768bb3edd43 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:16.971923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-948a3073-b2dd-4254-93d7-f768bb3edd43 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:16.972386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-948a3073-b2dd-4254-93d7-f768bb3edd43 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:16.976870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-948a3073-b2dd-4254-93d7-f768bb3edd43 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:16.977403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-948a3073-b2dd-4254-93d7-f768bb3edd43 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:17.111909 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.security_group_api [None req-6e7eda64-2161-444e-8c22-6b2492e525a0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Adding security group c1def503-9927-4db8-b8e8-4a470621366a to port d62a1a3c-ef55-4efa-9ba6-5bdd693c678c Jul 26 19:53:18.092979 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6e7eda64-2161-444e-8c22-6b2492e525a0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action" status: 202 len: 0 microversion: 2.1 time: 1.322199 Jul 26 19:53:18.097466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1223/2428] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:53:16 2022] POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action => generated 0 bytes in 1327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:18.116191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ed3c4cea-f0ae-4c53-bb28-47d17355f57c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:18.119779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ed3c4cea-f0ae-4c53-bb28-47d17355f57c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:18.145795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed3c4cea-f0ae-4c53-bb28-47d17355f57c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:18.147569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed3c4cea-f0ae-4c53-bb28-47d17355f57c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:18.148556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed3c4cea-f0ae-4c53-bb28-47d17355f57c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:18.149008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed3c4cea-f0ae-4c53-bb28-47d17355f57c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:18.217955 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ed3c4cea-f0ae-4c53-bb28-47d17355f57c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112537 Jul 26 19:53:18.218547 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1224/2429] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:53:18 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:18.226757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c430c22-698e-480f-b17b-bd440eb2157a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:18.227773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3c430c22-698e-480f-b17b-bd440eb2157a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:18.234676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c430c22-698e-480f-b17b-bd440eb2157a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:18.235246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-948a3073-b2dd-4254-93d7-f768bb3edd43 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:18.236059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c430c22-698e-480f-b17b-bd440eb2157a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:18.237050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c430c22-698e-480f-b17b-bd440eb2157a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:18.237728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c430c22-698e-480f-b17b-bd440eb2157a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:18.246035 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-948a3073-b2dd-4254-93d7-f768bb3edd43 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 200 len: 1473 microversion: 2.1 time: 1.292878 Jul 26 19:53:18.254034 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1206/2430] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:16 2022] GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 1473 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:18.281662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d6d361fc-56a0-4e79-a9e8-4520db1f9f26 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:18.287495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d6d361fc-56a0-4e79-a9e8-4520db1f9f26 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:18.298845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6d361fc-56a0-4e79-a9e8-4520db1f9f26 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:18.309849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6d361fc-56a0-4e79-a9e8-4520db1f9f26 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:18.311377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6d361fc-56a0-4e79-a9e8-4520db1f9f26 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:18.313900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6d361fc-56a0-4e79-a9e8-4520db1f9f26 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:18.970358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c430c22-698e-480f-b17b-bd440eb2157a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:18.986297 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c430c22-698e-480f-b17b-bd440eb2157a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1510 microversion: 2.1 time: 0.763767 Jul 26 19:53:18.987473 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1225/2431] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:18 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:18.998702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb7c4ad0-2ba5-431d-a231-8f374193e3d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1378640511"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:18.999598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb7c4ad0-2ba5-431d-a231-8f374193e3d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:19.016544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb7c4ad0-2ba5-431d-a231-8f374193e3d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:19.017272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb7c4ad0-2ba5-431d-a231-8f374193e3d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:19.018290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb7c4ad0-2ba5-431d-a231-8f374193e3d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:19.022205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb7c4ad0-2ba5-431d-a231-8f374193e3d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:19.040231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d6d361fc-56a0-4e79-a9e8-4520db1f9f26 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:19.048905 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d6d361fc-56a0-4e79-a9e8-4520db1f9f26 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1533 microversion: 2.1 time: 0.789398 Jul 26 19:53:19.050058 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1207/2432] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:18 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1533 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:19.054863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-75cf513a-fd73-4d82-9187-a0a1450d90a2 req-87447a72-281d-4a62-8ea3-431bd0239426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d76780-8750-4ef5-9699-2baef38358c3", "tag": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:19.084468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-75cf513a-fd73-4d82-9187-a0a1450d90a2 req-87447a72-281d-4a62-8ea3-431bd0239426 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:19.086004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-75cf513a-fd73-4d82-9187-a0a1450d90a2 req-87447a72-281d-4a62-8ea3-431bd0239426 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:19.118821 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-75cf513a-fd73-4d82-9187-a0a1450d90a2 req-87447a72-281d-4a62-8ea3-431bd0239426 service nova] Creating event network-changed:d62a1a3c-ef55-4efa-9ba6-5bdd693c678c for instance 16d76780-8750-4ef5-9699-2baef38358c3 on n-h2-708768-8 Jul 26 19:53:19.131489 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-75cf513a-fd73-4d82-9187-a0a1450d90a2 req-87447a72-281d-4a62-8ea3-431bd0239426 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078741 Jul 26 19:53:19.133773 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1208/2433] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:19.232761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ebd45bcd-6a69-4658-9458-814b278bccc2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:19.238394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ebd45bcd-6a69-4658-9458-814b278bccc2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:19.258344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ebd45bcd-6a69-4658-9458-814b278bccc2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:19.259373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ebd45bcd-6a69-4658-9458-814b278bccc2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:19.264474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ebd45bcd-6a69-4658-9458-814b278bccc2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:19.265266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ebd45bcd-6a69-4658-9458-814b278bccc2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:19.351295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ebd45bcd-6a69-4658-9458-814b278bccc2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123583 Jul 26 19:53:19.359584 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1209/2434] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:53:19 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:19.376389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a3cc8a1-4d13-4dc9-895f-025eee99debb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:19.378123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a3cc8a1-4d13-4dc9-895f-025eee99debb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:19.397129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a3cc8a1-4d13-4dc9-895f-025eee99debb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:19.398955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a3cc8a1-4d13-4dc9-895f-025eee99debb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:19.400082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a3cc8a1-4d13-4dc9-895f-025eee99debb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:19.400739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a3cc8a1-4d13-4dc9-895f-025eee99debb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:20.000339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9a3cc8a1-4d13-4dc9-895f-025eee99debb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:20.009125 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a3cc8a1-4d13-4dc9-895f-025eee99debb tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 200 len: 1473 microversion: 2.1 time: 0.647882 Jul 26 19:53:20.010022 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1210/2435] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:19 2022] GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 1473 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:20.015015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0706db58-2b0c-4c44-8911-b04761840de6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:20.015674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0706db58-2b0c-4c44-8911-b04761840de6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:20.032570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0706db58-2b0c-4c44-8911-b04761840de6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:20.032882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0706db58-2b0c-4c44-8911-b04761840de6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:20.040942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0706db58-2b0c-4c44-8911-b04761840de6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:20.041794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0706db58-2b0c-4c44-8911-b04761840de6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:20.307036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0706db58-2b0c-4c44-8911-b04761840de6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:20.316026 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0706db58-2b0c-4c44-8911-b04761840de6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1510 microversion: 2.1 time: 0.304909 Jul 26 19:53:20.317338 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1211/2436] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:20 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:20.333492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-681d6649-89c4-4d86-b461-53d491c5a449 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:20.334458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-681d6649-89c4-4d86-b461-53d491c5a449 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:20.359238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-681d6649-89c4-4d86-b461-53d491c5a449 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:20.360039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-681d6649-89c4-4d86-b461-53d491c5a449 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:20.361616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-681d6649-89c4-4d86-b461-53d491c5a449 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:20.362326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-681d6649-89c4-4d86-b461-53d491c5a449 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:20.389494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.security_group_api [None req-eb7c4ad0-2ba5-431d-a231-8f374193e3d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Removing security group c1def503-9927-4db8-b8e8-4a470621366a from port d62a1a3c-ef55-4efa-9ba6-5bdd693c678c Jul 26 19:53:20.654652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-681d6649-89c4-4d86-b461-53d491c5a449 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7ad3300c714b0789cb202c0c1f3a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89a1ef46964bff9f18f143fd404644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:20.662825 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-681d6649-89c4-4d86-b461-53d491c5a449 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 200 len: 1491 microversion: 2.1 time: 0.344229 Jul 26 19:53:20.666275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1212/2437] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:20 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 1491 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:21.053405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-486766040", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:21.152185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:53:21.659500 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb7c4ad0-2ba5-431d-a231-8f374193e3d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action" status: 202 len: 0 microversion: 2.1 time: 2.670362 Jul 26 19:53:21.660761 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1226/2438] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:53:18 2022] POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action => generated 0 bytes in 2672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:21.672490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-625145da-e3f1-4bb4-9cf0-2df9a37c6129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:21.675568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-625145da-e3f1-4bb4-9cf0-2df9a37c6129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:21.687455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-625145da-e3f1-4bb4-9cf0-2df9a37c6129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:21.688202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-625145da-e3f1-4bb4-9cf0-2df9a37c6129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:21.690026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-625145da-e3f1-4bb4-9cf0-2df9a37c6129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:21.690690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-625145da-e3f1-4bb4-9cf0-2df9a37c6129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:21.776564 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-625145da-e3f1-4bb4-9cf0-2df9a37c6129 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114571 Jul 26 19:53:21.777988 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1227/2439] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:53:21 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:21.783869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:21.785455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:21.793875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:21.794665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:21.795862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:21.796627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:21.839997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:21.840726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:21.841463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lazy-loading 'fault' on Instance uuid 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:53:21.907727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:53:21.908834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:53:21.909555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:53:21.910149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:53:21.910567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:53:21.914427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908bdad3c14b4f0a9043fd8f41b4c5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f793318e056d4e04be4c0424fe43ef3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:21.928185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:21.928672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:21.930492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:21.930948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:21.932694 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a9fddef4-b30e-49cc-a9ee-c3bd02cfc14d tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 200 len: 1307 microversion: 2.1 time: 0.153236 Jul 26 19:53:21.933316 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1228/2440] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:21 2022] GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:21.983542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:22.001662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for user 146ecbca3664463ead84028d4add8b50 and project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:22.017390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:53:22.020502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:53:22.061674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-371df047-8749-4a69-adaa-6317c60e4e04 req-52ac6695-06bd-471f-9945-964f38890ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5aa6cf-6d71-476b-8eab-a84d73556c54", "name": "network-vif-deleted", "tag": "e46fdec1-bb14-40ce-943b-7f7f98cd144c"}, {"server_uuid": "78f8c415-4c1d-4e8c-b3a6-2b1f20db3207", "name": "network-vif-deleted", "tag": "6a23c3cf-1752-438a-abe4-d9745485a1b1"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:22.083715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-371df047-8749-4a69-adaa-6317c60e4e04 req-52ac6695-06bd-471f-9945-964f38890ed0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:22.085353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-371df047-8749-4a69-adaa-6317c60e4e04 req-52ac6695-06bd-471f-9945-964f38890ed0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:22.122100 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de07593a-171c-40ba-adf8-5318d90d38e4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454409 Jul 26 19:53:22.123014 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1213/2441] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:53:22.128634 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-371df047-8749-4a69-adaa-6317c60e4e04 req-52ac6695-06bd-471f-9945-964f38890ed0 service nova] Creating event network-vif-deleted:e46fdec1-bb14-40ce-943b-7f7f98cd144c for instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 on n-h1-708768-8 Jul 26 19:53:22.129148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-371df047-8749-4a69-adaa-6317c60e4e04 req-52ac6695-06bd-471f-9945-964f38890ed0 service nova] Creating event network-vif-deleted:6a23c3cf-1752-438a-abe4-d9745485a1b1 for instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 on n-h1-708768-8 Jul 26 19:53:22.145809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-90c56ede-729d-40ab-9e7a-b8f354bf48dc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:22.152216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-90c56ede-729d-40ab-9e7a-b8f354bf48dc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:22.163680 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-371df047-8749-4a69-adaa-6317c60e4e04 req-52ac6695-06bd-471f-9945-964f38890ed0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.224872 Jul 26 19:53:22.165798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90c56ede-729d-40ab-9e7a-b8f354bf48dc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:22.167180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90c56ede-729d-40ab-9e7a-b8f354bf48dc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:22.170909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90c56ede-729d-40ab-9e7a-b8f354bf48dc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:22.171788 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1229/2442] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:22.172332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90c56ede-729d-40ab-9e7a-b8f354bf48dc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:22.181249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7d3a7b7c-d44c-492b-abc3-5f04d7deefc1 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Action: 'create', calling method: .version_select at 0x7f875f0d25e0>, body: {"pool": null} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:22.926864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-90c56ede-729d-40ab-9e7a-b8f354bf48dc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:22.939779 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-90c56ede-729d-40ab-9e7a-b8f354bf48dc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1510 microversion: 2.1 time: 0.815441 Jul 26 19:53:22.940381 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1214/2443] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:22 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1510 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:22.952030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:22.953078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] [instance: 7d5aa6cf-6d71-476b-8eab-a84d73556c54] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:22.963656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:22.971897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:22.972920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:22.973545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:22.993484 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] HTTP exception thrown: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Request method failure captured: Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 HTTP/1.1 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EX6u0xspeQQindKDMR-W2Nd6Qk19a5CVC6dqVFII3bYrthJRzvbEUIvr3K3KKKgDgKDBKW5vwJZZP7EcHAQnsuaySQ1ItQZ9MFbuql_8o-H-RAqcQgPZp8c3v5vH7QiKwa8EWOQ272PC0anu8saTo5vZwb0LO-szQ1tKXLeHBOjdV8 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 9e89a1ef46964bff9f18f143fd404644 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1441099144 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e89a1ef46964bff9f18f143fd404644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e89a1ef46964bff9f18f143fd404644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e89a1ef46964bff9f18f143fd404644", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e89a1ef46964bff9f18f143fd404644"}]}] Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1441099144 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 9e89a1ef46964bff9f18f143fd404644 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1441099144 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1441099144-project Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8d7ad3300c714b0789cb202c0c1f3a94 Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1441099144-project Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7d5aa6cf-6d71-476b-8eab-a84d73556c54'} Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:22.995295 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. Jul 26 19:53:23.000797 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:23.008095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] Returning 404 to user: Instance 7d5aa6cf-6d71-476b-8eab-a84d73556c54 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:23.009109 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-288ce963-1d42-4ebc-98de-b174710138b2 tempest-ServersNegativeTestMultiTenantJSON-1441099144 tempest-ServersNegativeTestMultiTenantJSON-1441099144-project] 10.222.0.58 "GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54" status: 404 len: 111 microversion: 2.1 time: 0.067578 Jul 26 19:53:23.011724 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1215/2444] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:22 2022] GET /compute/v2.1/servers/7d5aa6cf-6d71-476b-8eab-a84d73556c54 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:23.019876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b67d0d97-c09e-4fe1-86c6-3921d84a4a4f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:23.041306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b67d0d97-c09e-4fe1-86c6-3921d84a4a4f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:23.217455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b67d0d97-c09e-4fe1-86c6-3921d84a4a4f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:23.227158 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b67d0d97-c09e-4fe1-86c6-3921d84a4a4f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1212 microversion: 2.1 time: 0.213925 Jul 26 19:53:23.232670 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1216/2445] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:23 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1212 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:23.244619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1798b77d-3ced-4f66-b678-d5439188d179 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:23.246924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1798b77d-3ced-4f66-b678-d5439188d179 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:23.277964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1798b77d-3ced-4f66-b678-d5439188d179 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:23.278426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1798b77d-3ced-4f66-b678-d5439188d179 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:23.279485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1798b77d-3ced-4f66-b678-d5439188d179 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:23.279947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1798b77d-3ced-4f66-b678-d5439188d179 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:23.357919 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1798b77d-3ced-4f66-b678-d5439188d179 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124095 Jul 26 19:53:23.362968 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1217/2446] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:53:23 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:23.376614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:23.377254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] [instance: 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:23.392423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:23.393088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:23.394207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:23.394815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:23.422956 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] HTTP exception thrown: Instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 could not be found. Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Request method failure captured: Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 HTTP/1.1 Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EV1SU_52cVZYxMUwiSbd_F4Fbz_76le9MzCyWc4ev6S77l8srLX4jPASVzU51GFD5zf8sqbA-5qFtkZNklT2T-oCVNI2WgsYG1m2r5MNQni-bIva0AozksibKxd3YpKL3599eI9swDfHjefJhU07T8nXwhdrop1zCDIqsfJ8q6dyr0 Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f793318e056d4e04be4c0424fe43ef3f Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ListImageFiltersTestJSON-1552829222 Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f793318e056d4e04be4c0424fe43ef3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f793318e056d4e04be4c0424fe43ef3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f793318e056d4e04be4c0424fe43ef3f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f793318e056d4e04be4c0424fe43ef3f"}]}] Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ListImageFiltersTestJSON-1552829222 Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f793318e056d4e04be4c0424fe43ef3f Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1552829222 Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ListImageFiltersTestJSON-1552829222-project Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 908bdad3c14b4f0a9043fd8f41b4c5eb Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ListImageFiltersTestJSON-1552829222-project Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 could not be found. Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '78f8c415-4c1d-4e8c-b3a6-2b1f20db3207'} Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 could not be found. Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 could not be found. Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:23.424598 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 could not be found. Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Returning 404 to user: Instance 78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-736b68fc-9b21-472d-b28e-7e3cb7171977 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207" status: 404 len: 111 microversion: 2.1 time: 0.062034 Jul 26 19:53:23.428342 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1218/2447] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:23 2022] GET /compute/v2.1/servers/78f8c415-4c1d-4e8c-b3a6-2b1f20db3207 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:23.443351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f9449f81-1e43-471a-b485-f95f40a81997 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f876830eb80>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:24.702783 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f9449f81-1e43-471a-b485-f95f40a81997 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "DELETE /compute/v2.1/images/e4158bc9-0b85-40bb-8007-cb2f0e29e1a2" status: 204 len: 0 microversion: 2.1 time: 1.269395 Jul 26 19:53:24.704148 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1219/2448] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:23 2022] DELETE /compute/v2.1/images/e4158bc9-0b85-40bb-8007-cb2f0e29e1a2 => generated 0 bytes in 1273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:24.711294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-746b72d7-f77e-4eb3-8a4c-9c01e61d75a9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:24.712182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-746b72d7-f77e-4eb3-8a4c-9c01e61d75a9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:24.724304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746b72d7-f77e-4eb3-8a4c-9c01e61d75a9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:24.725023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746b72d7-f77e-4eb3-8a4c-9c01e61d75a9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:24.726560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746b72d7-f77e-4eb3-8a4c-9c01e61d75a9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:24.727014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746b72d7-f77e-4eb3-8a4c-9c01e61d75a9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:24.931778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-746b72d7-f77e-4eb3-8a4c-9c01e61d75a9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:24.940953 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-746b72d7-f77e-4eb3-8a4c-9c01e61d75a9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1516 microversion: 2.1 time: 0.235513 Jul 26 19:53:24.941531 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1220/2449] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:24 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:24.948512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-dd36623f-dae7-4872-b650-64b4a7e4ce9e req-82a1f5bf-3042-4d64-a255-9d3b203afe7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d76780-8750-4ef5-9699-2baef38358c3", "tag": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:25.004443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-dd36623f-dae7-4872-b650-64b4a7e4ce9e req-82a1f5bf-3042-4d64-a255-9d3b203afe7f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:25.004895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-dd36623f-dae7-4872-b650-64b4a7e4ce9e req-82a1f5bf-3042-4d64-a255-9d3b203afe7f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:25.043418 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-dd36623f-dae7-4872-b650-64b4a7e4ce9e req-82a1f5bf-3042-4d64-a255-9d3b203afe7f service nova] Creating event network-changed:d62a1a3c-ef55-4efa-9ba6-5bdd693c678c for instance 16d76780-8750-4ef5-9699-2baef38358c3 on n-h2-708768-8 Jul 26 19:53:25.055503 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-dd36623f-dae7-4872-b650-64b4a7e4ce9e req-82a1f5bf-3042-4d64-a255-9d3b203afe7f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109186 Jul 26 19:53:25.064163 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1221/2450] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:25.078246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-31687b9b-16a8-4236-9b07-e9aff15fcf29 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:25.079781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-31687b9b-16a8-4236-9b07-e9aff15fcf29 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:25.094203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31687b9b-16a8-4236-9b07-e9aff15fcf29 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:25.094912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31687b9b-16a8-4236-9b07-e9aff15fcf29 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:25.095977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31687b9b-16a8-4236-9b07-e9aff15fcf29 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:25.096568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31687b9b-16a8-4236-9b07-e9aff15fcf29 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:25.196108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-31687b9b-16a8-4236-9b07-e9aff15fcf29 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:25.215956 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-31687b9b-16a8-4236-9b07-e9aff15fcf29 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1270 microversion: 2.1 time: 0.145254 Jul 26 19:53:25.219929 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1222/2451] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:25 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:25.234217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a405d3f-740a-4c87-bf4e-136114574511 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:25.237011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a405d3f-740a-4c87-bf4e-136114574511 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:25.246785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a405d3f-740a-4c87-bf4e-136114574511 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:25.247472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a405d3f-740a-4c87-bf4e-136114574511 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:25.248369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a405d3f-740a-4c87-bf4e-136114574511 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:25.249501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a405d3f-740a-4c87-bf4e-136114574511 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:25.326166 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a405d3f-740a-4c87-bf4e-136114574511 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103270 Jul 26 19:53:25.330108 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1223/2452] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:53:25 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:53:25.356170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dde8dd1b-9c9c-42d2-ba65-3335230a1420 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87573d4940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:25.958968 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dde8dd1b-9c9c-42d2-ba65-3335230a1420 tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "DELETE /compute/v2.1/images/c1172f1c-55fc-4d0a-b406-c8109c328ed6" status: 204 len: 0 microversion: 2.1 time: 0.627810 Jul 26 19:53:25.959596 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1224/2453] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:25 2022] DELETE /compute/v2.1/images/c1172f1c-55fc-4d0a-b406-c8109c328ed6 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:25.971077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-981c2495-5a79-4d6b-a7a4-acb90a972c7c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] Calling method '.version_select at 0x7f87683e5040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:26.368686 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-981c2495-5a79-4d6b-a7a4-acb90a972c7c tempest-ListImageFiltersTestJSON-1552829222 tempest-ListImageFiltersTestJSON-1552829222-project] 10.222.0.58 "DELETE /compute/v2.1/images/57a1bc3c-71b4-4e32-902c-408d3e45dbfc" status: 204 len: 0 microversion: 2.1 time: 0.404061 Jul 26 19:53:26.373082 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1225/2454] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:25 2022] DELETE /compute/v2.1/images/57a1bc3c-71b4-4e32-902c-408d3e45dbfc => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:53:26.379139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6dde925b-0d79-4c99-9df0-4a33b125db5e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:26.384168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6dde925b-0d79-4c99-9df0-4a33b125db5e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:26.407938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6dde925b-0d79-4c99-9df0-4a33b125db5e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:26.408596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6dde925b-0d79-4c99-9df0-4a33b125db5e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:26.409838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6dde925b-0d79-4c99-9df0-4a33b125db5e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:26.414506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6dde925b-0d79-4c99-9df0-4a33b125db5e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:26.808827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6dde925b-0d79-4c99-9df0-4a33b125db5e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:26.822131 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6dde925b-0d79-4c99-9df0-4a33b125db5e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1270 microversion: 2.1 time: 0.446571 Jul 26 19:53:26.832505 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1226/2455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:26 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1270 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:27.455440 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7d3a7b7c-d44c-492b-abc3-5f04d7deefc1 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.282289 Jul 26 19:53:27.457168 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1230/2456] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:53:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:27.470094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.95"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:27.473572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:27.480569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:27.488671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:27.489777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:27.495508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:27.548384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Acquired lock "refresh_cache-16d76780-8750-4ef5-9699-2baef38358c3" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:53:27.741894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5891fe77-025e-4c3f-ad29-0bffc4c6651b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'create', calling method: .version_select at 0x7f875f249790>, body: {"keypair": {"name": "tempest-keypair-651981386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+MEI2iB1yKzkDq+FTO36lemEFfwPye6H76WAPbjBaTyLyXQR6ZkXgDLmmD4i9dyQzdCyxEce7RyEBr4v3r5b30IbOFSP3ZO9rAF0LWweZy1hWYAh0dKhwEznRTLov14Q=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:27.774534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-5891fe77-025e-4c3f-ad29-0bffc4c6651b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Getting quotas for project 8ab624e048d647aeaed6b3d871e4adac. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:27.793980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-5891fe77-025e-4c3f-ad29-0bffc4c6651b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Getting quotas for user 72e321f4321e4ef38621b3d4cddb490b and project 8ab624e048d647aeaed6b3d871e4adac. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:27.856090 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5891fe77-025e-4c3f-ad29-0bffc4c6651b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120005 Jul 26 19:53:27.860424 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1231/2457] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:53:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:27.874228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-58f24038-6ed0-4dea-abfd-e9a94ee5a8c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:27.880104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-58f24038-6ed0-4dea-abfd-e9a94ee5a8c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:27.897473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58f24038-6ed0-4dea-abfd-e9a94ee5a8c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:27.898281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58f24038-6ed0-4dea-abfd-e9a94ee5a8c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:27.900183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58f24038-6ed0-4dea-abfd-e9a94ee5a8c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:27.901112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58f24038-6ed0-4dea-abfd-e9a94ee5a8c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:28.203493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-58f24038-6ed0-4dea-abfd-e9a94ee5a8c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:28.227407 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-58f24038-6ed0-4dea-abfd-e9a94ee5a8c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1270 microversion: 2.1 time: 0.362934 Jul 26 19:53:28.228075 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1232/2458] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:27 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1270 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:29.263501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bac540a-5101-44eb-a8be-405dc2d32ce2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:29.266691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bac540a-5101-44eb-a8be-405dc2d32ce2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:29.294900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bac540a-5101-44eb-a8be-405dc2d32ce2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:29.297695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bac540a-5101-44eb-a8be-405dc2d32ce2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:29.300263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bac540a-5101-44eb-a8be-405dc2d32ce2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:29.301289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bac540a-5101-44eb-a8be-405dc2d32ce2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:29.814662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bac540a-5101-44eb-a8be-405dc2d32ce2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:29.828144 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bac540a-5101-44eb-a8be-405dc2d32ce2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.583136 Jul 26 19:53:29.833163 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1233/2459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:29 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:30.129508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae56ba7f-1dbe-417e-a1e6-ffab6ab57704 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Action: 'create', calling method: .version_select at 0x7f875f249f70>, body: {"keypair": {"name": "tempest-keypair-1375558261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDscZo5dfJp04dzYGKVILziEW09azsXzZkglXNQcEKTWoErUd8eUVs2wiEsfxHuIxWkjwj4ulkBCno1lSzgEyu8Z/ObeePyDOYX+6cHt9odBuP6ZkVJR1A9qitYPejheZg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:30.170537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ae56ba7f-1dbe-417e-a1e6-ffab6ab57704 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:30.176262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ae56ba7f-1dbe-417e-a1e6-ffab6ab57704 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for user 9cf0b57d40144f92a8915af5eabc11c3 and project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:30.215278 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ae56ba7f-1dbe-417e-a1e6-ffab6ab57704 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.380931 Jul 26 19:53:30.223892 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1234/2460] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:53:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:30.230125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ebef3421-efb7-4f78-ab35-f72a9b089552 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Calling method '.version_select at 0x7f875f13d8b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:30.253433 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ebef3421-efb7-4f78-ab35-f72a9b089552 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1375558261" status: 200 len: 498 microversion: 2.1 time: 0.028106 Jul 26 19:53:30.254738 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1235/2461] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:53:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1375558261 => generated 498 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:30.268716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3cc4f378-aedc-4a0a-bf18-282c8c430ba0 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Calling method '.version_select at 0x7f875f06bc10>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:30.306347 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3cc4f378-aedc-4a0a-bf18-282c8c430ba0 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375558261" status: 202 len: 0 microversion: 2.1 time: 0.043411 Jul 26 19:53:30.309457 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1236/2462] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 19:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375558261 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:53:30.331327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-729ce21d-c0d4-4c41-98ff-989f4415a54c tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Action: 'create', calling method: .version_select at 0x7f875eff4b80>, body: {"keypair": {"name": "tempest-keypair-93676921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcOXLP1a7TwFz4D3kpgDeJGxyoIZoEcZdM1SR/YjxceLkbDO2GXiDDn7jv9G38PocpLOsP+Aqqyr2lUptFb7Z4mgUL6NTDPqkvq1P96MF3iFGoY7NVAuNGVWNb0XHC3cg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:30.379408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-729ce21d-c0d4-4c41-98ff-989f4415a54c tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:30.396011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-729ce21d-c0d4-4c41-98ff-989f4415a54c tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for user 9cf0b57d40144f92a8915af5eabc11c3 and project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:30.433792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:30.457755 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-729ce21d-c0d4-4c41-98ff-989f4415a54c tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.139453 Jul 26 19:53:30.461402 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1237/2463] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:53:30 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:30.476933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-046eae7a-61b9-41ab-a30a-2b5dd20bc38b tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Calling method '.version_select at 0x7f875f13dca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:30.538671 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-046eae7a-61b9-41ab-a30a-2b5dd20bc38b tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93676921" status: 202 len: 0 microversion: 2.1 time: 0.070835 Jul 26 19:53:30.539647 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1238/2464] 10.222.0.58 () {58 vars in 1215 bytes} [Tue Jul 26 19:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93676921 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:30.573101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1f579d4-ab97-4c69-81b3-2c3a4e8d5b75 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Action: 'create', calling method: .version_select at 0x7f875ec70310>, body: {"keypair": {"name": "tempest-keypair-1646392107", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:30.635150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f1f579d4-ab97-4c69-81b3-2c3a4e8d5b75 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:30.656240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f1f579d4-ab97-4c69-81b3-2c3a4e8d5b75 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for user 9cf0b57d40144f92a8915af5eabc11c3 and project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:30.734287 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1f579d4-ab97-4c69-81b3-2c3a4e8d5b75 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.176610 Jul 26 19:53:30.739176 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1239/2465] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:53:30 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:30.751726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5575175-1974-456b-adee-d3935cade292 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Calling method '.version_select at 0x7f875f3fbaf0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:30.803891 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5575175-1974-456b-adee-d3935cade292 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646392107" status: 202 len: 0 microversion: 2.1 time: 0.055800 Jul 26 19:53:30.805096 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1240/2466] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 19:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646392107 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:30.816679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-961e8ba3-cf3d-4341-af9d-ca08267fb5d8 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Action: 'create', calling method: .version_select at 0x7f875f06b1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-855957512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVNSidbSefynyLSWvOra5Jkseup3eFTSM649ZGi2Bu3vUkPmSdn50On8c9lwGHiIQYuC3ZtaUo1Ud+ALDd+As/Ugu2he6rTmqLlgOLlg1SQ+9gxlvC2lsMYG53rAhur7g=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:30.853911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-961e8ba3-cf3d-4341-af9d-ca08267fb5d8 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:30.865660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-961e8ba3-cf3d-4341-af9d-ca08267fb5d8 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for user 9cf0b57d40144f92a8915af5eabc11c3 and project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:30.923222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-961e8ba3-cf3d-4341-af9d-ca08267fb5d8 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.110471 Jul 26 19:53:30.924713 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1241/2467] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:53:30 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:53:30.933800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bf833839-f3ec-452e-987e-bc2e0a94833b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:30.939371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bf833839-f3ec-452e-987e-bc2e0a94833b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:30.947740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf833839-f3ec-452e-987e-bc2e0a94833b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:30.948246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf833839-f3ec-452e-987e-bc2e0a94833b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:30.949049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf833839-f3ec-452e-987e-bc2e0a94833b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:30.949529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf833839-f3ec-452e-987e-bc2e0a94833b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:31.251224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bf833839-f3ec-452e-987e-bc2e0a94833b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:31.264818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bf833839-f3ec-452e-987e-bc2e0a94833b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.339334 Jul 26 19:53:31.283683 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1242/2468] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:30 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:31.293780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-efb3d44d-028e-4dcf-94bd-f2baae160f0f tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Action: 'create', calling method: .version_select at 0x7f875f3fbe50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-220390609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg8a3Z0q5NlDsMSBNcwMI/faw7ZdCO/s8OPSghNxsvxGVsQwQxazlUjyUV74/ewT3oWvDyeoukXm7KscglXnSil4Zm3CI8WGbjr6Sc+kA2ua6sgZF5gZARR9O4Crc72wA=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:31.322487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-efb3d44d-028e-4dcf-94bd-f2baae160f0f tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:31.329969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-efb3d44d-028e-4dcf-94bd-f2baae160f0f tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for user 9cf0b57d40144f92a8915af5eabc11c3 and project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:31.385838 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-efb3d44d-028e-4dcf-94bd-f2baae160f0f tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.098153 Jul 26 19:53:31.387334 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1243/2469] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:53:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:31.402963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c73dd7f5-4507-42a6-8838-7e808632b65c req-c1625ebe-59a8-43b0-882c-eda3cc66e1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc3bf14-61a5-413c-ad32-4c9ad235303c", "tag": "dbf289a8-a47c-4167-811b-3b049fa5db7f"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:31.447396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c73dd7f5-4507-42a6-8838-7e808632b65c req-c1625ebe-59a8-43b0-882c-eda3cc66e1e9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:31.447881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c73dd7f5-4507-42a6-8838-7e808632b65c req-c1625ebe-59a8-43b0-882c-eda3cc66e1e9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:31.469650 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c73dd7f5-4507-42a6-8838-7e808632b65c req-c1625ebe-59a8-43b0-882c-eda3cc66e1e9 service nova] Creating event network-changed:dbf289a8-a47c-4167-811b-3b049fa5db7f for instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c on n-h1-708768-8 Jul 26 19:53:31.486067 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c73dd7f5-4507-42a6-8838-7e808632b65c req-c1625ebe-59a8-43b0-882c-eda3cc66e1e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093321 Jul 26 19:53:31.487109 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1244/2470] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:31.493791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a82c6e5-cd8d-4b70-80a4-d977827b9e94 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Action: 'create', calling method: .version_select at 0x7f875f0f6430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2014385095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxy2WrrcGOHUsE+jhWkQDekzdrRPiJwY3XpRvZii2elrsyKSrNXgoNBrBinFgDA0fzZzWvVyHQM5I6yknHQNOQ/Q+GaEBXXC09OyAIVtdpuhaVo481i+0xkcy7lLaGZkA=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:31.515639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7a82c6e5-cd8d-4b70-80a4-d977827b9e94 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:31.521359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7a82c6e5-cd8d-4b70-80a4-d977827b9e94 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Getting quotas for user 9cf0b57d40144f92a8915af5eabc11c3 and project 858d6b213c5548e0bafc878fc2db7ba7. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:31.583365 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a82c6e5-cd8d-4b70-80a4-d977827b9e94 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.094527 Jul 26 19:53:31.585319 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1245/2471] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:53:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:31.603756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ef2ba8ee-fc32-44a2-afe9-4c2bcac947cc tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Calling method '.version_select at 0x7f875efbd9d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:31.623495 n-d-708768-8 devstack@n-api.service[125963]: WARNING oslo_db.sqlalchemy.utils [None req-ef2ba8ee-fc32-44a2-afe9-4c2bcac947cc tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 19:53:31.640560 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ef2ba8ee-fc32-44a2-afe9-4c2bcac947cc tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.045464 Jul 26 19:53:31.642222 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1246/2472] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:53:31 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:31.653814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8a19b058-a5d7-466c-9988-fd97efc48354 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Calling method '.version_select at 0x7f875f13de50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:31.715899 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8a19b058-a5d7-466c-9988-fd97efc48354 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2014385095" status: 202 len: 0 microversion: 2.1 time: 0.065689 Jul 26 19:53:31.716566 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1247/2473] 10.222.0.58 () {58 vars in 1278 bytes} [Tue Jul 26 19:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2014385095 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:53:31.738043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2dd1de72-f257-4f34-8d4b-c7f856bde4c2 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Calling method '.version_select at 0x7f875f117a60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:31.835404 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2dd1de72-f257-4f34-8d4b-c7f856bde4c2 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-220390609" status: 202 len: 0 microversion: 2.1 time: 0.112441 Jul 26 19:53:31.836360 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1248/2474] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-220390609 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:31.845783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8cdaf534-a8bc-4269-837b-08eddc220e43 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] Calling method '.version_select at 0x7f875f3fb4c0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:31.880536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8cdaf534-a8bc-4269-837b-08eddc220e43 tempest-KeyPairsV2TestJSON-717026955 tempest-KeyPairsV2TestJSON-717026955-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-855957512" status: 202 len: 0 microversion: 2.1 time: 0.038633 Jul 26 19:53:31.882589 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1249/2475] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-855957512 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:31.960041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:31.984401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Building network info cache for instance {{(pid=125964) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:53:32.015134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-495ac040-25da-44fe-9bd4-6bea23ab0cda req-680138ea-2acd-4d45-853d-33d9a141e090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d76780-8750-4ef5-9699-2baef38358c3", "tag": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:32.039631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-495ac040-25da-44fe-9bd4-6bea23ab0cda req-680138ea-2acd-4d45-853d-33d9a141e090 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:32.041522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-495ac040-25da-44fe-9bd4-6bea23ab0cda req-680138ea-2acd-4d45-853d-33d9a141e090 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:32.054810 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-495ac040-25da-44fe-9bd4-6bea23ab0cda req-680138ea-2acd-4d45-853d-33d9a141e090 service nova] Creating event network-changed:d62a1a3c-ef55-4efa-9ba6-5bdd693c678c for instance 16d76780-8750-4ef5-9699-2baef38358c3 on n-h2-708768-8 Jul 26 19:53:32.061094 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-495ac040-25da-44fe-9bd4-6bea23ab0cda req-680138ea-2acd-4d45-853d-33d9a141e090 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049701 Jul 26 19:53:32.062232 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1250/2476] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:32.290658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6a26092a-a49a-4373-a2e8-b53bc94819a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:32.292789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6a26092a-a49a-4373-a2e8-b53bc94819a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:32.313038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a26092a-a49a-4373-a2e8-b53bc94819a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:32.316383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a26092a-a49a-4373-a2e8-b53bc94819a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:32.317821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a26092a-a49a-4373-a2e8-b53bc94819a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:32.321344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a26092a-a49a-4373-a2e8-b53bc94819a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:33.190390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6a26092a-a49a-4373-a2e8-b53bc94819a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:33.198620 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6a26092a-a49a-4373-a2e8-b53bc94819a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.913485 Jul 26 19:53:33.202215 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1251/2477] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:32 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:33.226566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:34.225018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cfb29e0b-64d3-424c-a31d-fbd30b30b8f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:34.227032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cfb29e0b-64d3-424c-a31d-fbd30b30b8f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:34.237083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfb29e0b-64d3-424c-a31d-fbd30b30b8f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:34.238057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfb29e0b-64d3-424c-a31d-fbd30b30b8f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:34.239011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfb29e0b-64d3-424c-a31d-fbd30b30b8f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:34.239774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfb29e0b-64d3-424c-a31d-fbd30b30b8f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:34.660631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Updating instance_info_cache with network_info: [{"id": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c", "address": "fa:16:3e:44:7e:75", "network": {"id": "787ab92c-cec3-424a-8023-2c91a1c73011", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1786959584-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0c99967c0194f28b724c14859ca05ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd62a1a3c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125964) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:53:34.680211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Releasing lock "refresh_cache-16d76780-8750-4ef5-9699-2baef38358c3" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:53:34.681690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea2913c6-bee1-42eb-948f-5f39fbc719d0 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action" status: 202 len: 0 microversion: 2.1 time: 7.216461 Jul 26 19:53:34.686367 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1227/2478] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:53:27 2022] POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action => generated 0 bytes in 7222 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 19:53:34.692150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.95"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:34.699022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cfb29e0b-64d3-424c-a31d-fbd30b30b8f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:34.707217 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cfb29e0b-64d3-424c-a31d-fbd30b30b8f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.485919 Jul 26 19:53:34.720045 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1252/2479] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:34 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:35.338263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:35.347506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:35.348047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:35.348847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:35.349284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:35.735891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-492dcb44-4fb8-42a7-be6c-35ac4e4688bb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:35.736517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-492dcb44-4fb8-42a7-be6c-35ac4e4688bb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:35.744623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-492dcb44-4fb8-42a7-be6c-35ac4e4688bb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:35.752883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-492dcb44-4fb8-42a7-be6c-35ac4e4688bb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:35.753837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-492dcb44-4fb8-42a7-be6c-35ac4e4688bb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:35.759478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-492dcb44-4fb8-42a7-be6c-35ac4e4688bb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:35.820591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:36.353678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Acquired lock "refresh_cache-16d76780-8750-4ef5-9699-2baef38358c3" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 19:53:36.495533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-492dcb44-4fb8-42a7-be6c-35ac4e4688bb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:36.507053 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-492dcb44-4fb8-42a7-be6c-35ac4e4688bb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.777714 Jul 26 19:53:36.525539 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1253/2480] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:35 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:36.534520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-146798257", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "345475dc-76e4-4954-a940-170585f94095"}], "security_groups": [{"name": "tempest-securitygroup--1468263943"}], "key_name": "tempest-keypair-651981386", "user_data": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:36.800791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] validate_networks() for [('345475dc-76e4-4954-a940-170585f94095', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:53:37.832024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:53:37.832660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:53:37.832924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:53:37.833339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:53:37.833764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:53:37.853892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:37.854634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:37.860319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:37.861041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:37.907188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Getting quotas for project 8ab624e048d647aeaed6b3d871e4adac. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:53:37.914349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Getting quotas for user 72e321f4321e4ef38621b3d4cddb490b and project 8ab624e048d647aeaed6b3d871e4adac. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:53:37.932210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:53:37.934814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:53:37.961262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=88,nova_api:DELETE=5 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:38.000305 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-82d51056-e5fa-4b36-9695-a677436fe8ed tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.473199 Jul 26 19:53:38.001651 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1254/2481] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:53:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:53:38.011035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42f0dee9-4b67-4ba9-ba78-8e7b4a94ed12 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:38.012074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-42f0dee9-4b67-4ba9-ba78-8e7b4a94ed12 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:38.037781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42f0dee9-4b67-4ba9-ba78-8e7b4a94ed12 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:38.038234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42f0dee9-4b67-4ba9-ba78-8e7b4a94ed12 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:38.039023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42f0dee9-4b67-4ba9-ba78-8e7b4a94ed12 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:38.039455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42f0dee9-4b67-4ba9-ba78-8e7b4a94ed12 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:38.311488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-42f0dee9-4b67-4ba9-ba78-8e7b4a94ed12 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:38.325028 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-42f0dee9-4b67-4ba9-ba78-8e7b4a94ed12 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.321840 Jul 26 19:53:38.326352 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1255/2482] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:38 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:38.331161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2aef3322-7073-4a2e-8794-a2f4d74d274d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:38.331976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2aef3322-7073-4a2e-8794-a2f4d74d274d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:38.442582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2aef3322-7073-4a2e-8794-a2f4d74d274d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:38.451825 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2aef3322-7073-4a2e-8794-a2f4d74d274d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1244 microversion: 2.1 time: 0.124171 Jul 26 19:53:38.453623 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1256/2483] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:38 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1244 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:39.351371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8b1ee036-5029-4b1e-86d7-2f9e9d856782 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:39.352915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8b1ee036-5029-4b1e-86d7-2f9e9d856782 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:39.363859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b1ee036-5029-4b1e-86d7-2f9e9d856782 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:39.380317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b1ee036-5029-4b1e-86d7-2f9e9d856782 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:39.406509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b1ee036-5029-4b1e-86d7-2f9e9d856782 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:39.411670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b1ee036-5029-4b1e-86d7-2f9e9d856782 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:40.017584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8b1ee036-5029-4b1e-86d7-2f9e9d856782 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:40.027210 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8b1ee036-5029-4b1e-86d7-2f9e9d856782 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.681762 Jul 26 19:53:40.034184 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1257/2484] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:39 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:40.061825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2760dcd2-da9a-400d-b4dd-c3b04b1d58ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:40.064487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2760dcd2-da9a-400d-b4dd-c3b04b1d58ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:40.091941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2760dcd2-da9a-400d-b4dd-c3b04b1d58ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:40.092413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2760dcd2-da9a-400d-b4dd-c3b04b1d58ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:40.093227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2760dcd2-da9a-400d-b4dd-c3b04b1d58ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:40.093676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2760dcd2-da9a-400d-b4dd-c3b04b1d58ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:40.250709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2760dcd2-da9a-400d-b4dd-c3b04b1d58ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:40.260429 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2760dcd2-da9a-400d-b4dd-c3b04b1d58ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1296 microversion: 2.1 time: 0.225134 Jul 26 19:53:40.265346 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1258/2485] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:40 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1296 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:40.271036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Building network info cache for instance {{(pid=125964) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 19:53:40.277766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:40.615232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-06e77d8f-c72e-4d91-88bb-3317d35f6e25 req-b5a559fe-b57b-491e-926a-da50238c3810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d76780-8750-4ef5-9699-2baef38358c3", "tag": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:40.670417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-06e77d8f-c72e-4d91-88bb-3317d35f6e25 req-b5a559fe-b57b-491e-926a-da50238c3810 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:40.673162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-06e77d8f-c72e-4d91-88bb-3317d35f6e25 req-b5a559fe-b57b-491e-926a-da50238c3810 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:40.723141 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-06e77d8f-c72e-4d91-88bb-3317d35f6e25 req-b5a559fe-b57b-491e-926a-da50238c3810 service nova] Creating event network-changed:d62a1a3c-ef55-4efa-9ba6-5bdd693c678c for instance 16d76780-8750-4ef5-9699-2baef38358c3 on n-h2-708768-8 Jul 26 19:53:40.739099 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-06e77d8f-c72e-4d91-88bb-3317d35f6e25 req-b5a559fe-b57b-491e-926a-da50238c3810 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.453748 Jul 26 19:53:40.742742 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1259/2486] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:41.064897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e5d38d55-2a42-41e5-896e-37d7f5d510a4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:41.065892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e5d38d55-2a42-41e5-896e-37d7f5d510a4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:41.106325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5d38d55-2a42-41e5-896e-37d7f5d510a4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:41.107558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5d38d55-2a42-41e5-896e-37d7f5d510a4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:41.108724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5d38d55-2a42-41e5-896e-37d7f5d510a4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:41.109169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5d38d55-2a42-41e5-896e-37d7f5d510a4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:42.522923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e5d38d55-2a42-41e5-896e-37d7f5d510a4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:42.534456 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e5d38d55-2a42-41e5-896e-37d7f5d510a4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 1.477158 Jul 26 19:53:42.538684 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1260/2487] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:41 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:42.548222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae1740c0-a438-4cc7-9dc7-a7d2804d85df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:42.552350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ae1740c0-a438-4cc7-9dc7-a7d2804d85df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:42.574233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae1740c0-a438-4cc7-9dc7-a7d2804d85df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:42.574678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae1740c0-a438-4cc7-9dc7-a7d2804d85df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:42.576053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae1740c0-a438-4cc7-9dc7-a7d2804d85df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:42.578048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae1740c0-a438-4cc7-9dc7-a7d2804d85df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:42.758907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ae1740c0-a438-4cc7-9dc7-a7d2804d85df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:42.773301 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ae1740c0-a438-4cc7-9dc7-a7d2804d85df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1302 microversion: 2.1 time: 0.229090 Jul 26 19:53:42.774492 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1261/2488] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:42 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1302 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:42.946967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-03b2c61a-8d50-4cfe-942e-b5f1f8986d2e req-e2a556ce-c9c1-403e-a28a-2d010ad79339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc3bf14-61a5-413c-ad32-4c9ad235303c", "name": "network-vif-plugged", "status": "completed", "tag": "dbf289a8-a47c-4167-811b-3b049fa5db7f"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:43.011873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-03b2c61a-8d50-4cfe-942e-b5f1f8986d2e req-e2a556ce-c9c1-403e-a28a-2d010ad79339 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:43.014891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-03b2c61a-8d50-4cfe-942e-b5f1f8986d2e req-e2a556ce-c9c1-403e-a28a-2d010ad79339 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:43.062798 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-03b2c61a-8d50-4cfe-942e-b5f1f8986d2e req-e2a556ce-c9c1-403e-a28a-2d010ad79339 service nova] Creating event network-vif-plugged:dbf289a8-a47c-4167-811b-3b049fa5db7f for instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c on n-h1-708768-8 Jul 26 19:53:43.078997 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-03b2c61a-8d50-4cfe-942e-b5f1f8986d2e req-e2a556ce-c9c1-403e-a28a-2d010ad79339 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299112 Jul 26 19:53:43.082506 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1262/2489] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:53:43.481190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Updating instance_info_cache with network_info: [{"id": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c", "address": "fa:16:3e:44:7e:75", "network": {"id": "787ab92c-cec3-424a-8023-2c91a1c73011", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1786959584-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e0c99967c0194f28b724c14859ca05ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd62a1a3c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125964) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 19:53:43.497892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Releasing lock "refresh_cache-16d76780-8750-4ef5-9699-2baef38358c3" {{(pid=125964) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 19:53:43.501769 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c86a3bc0-b5a4-4965-9223-a76342d07728 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action" status: 202 len: 0 microversion: 2.1 time: 8.811363 Jul 26 19:53:43.508174 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1228/2490] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:53:34 2022] POST /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3/action => generated 0 bytes in 8821 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 19:53:43.518726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1c8e52a5-4c38-4c93-aede-13bf3a8dbb36 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '.version_select at 0x7f875ec70f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:43.566518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad5b84a3-0269-43ef-9fe3-46b7987cb2a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:43.567318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad5b84a3-0269-43ef-9fe3-46b7987cb2a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:43.576716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:43.614921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5b84a3-0269-43ef-9fe3-46b7987cb2a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:43.619183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5b84a3-0269-43ef-9fe3-46b7987cb2a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:43.621779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5b84a3-0269-43ef-9fe3-46b7987cb2a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:43.626107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5b84a3-0269-43ef-9fe3-46b7987cb2a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:43.861394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad5b84a3-0269-43ef-9fe3-46b7987cb2a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:43.870736 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad5b84a3-0269-43ef-9fe3-46b7987cb2a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.318259 Jul 26 19:53:43.872482 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1229/2491] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:43 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:43.945709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-00168046-2694-4c2e-aab4-4d9910c49d8d tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] Calling method '.version_select at 0x7f87572f4dc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:44.054023 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-00168046-2694-4c2e-aab4-4d9910c49d8d tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.179976 Jul 26 19:53:44.055331 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1230/2492] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Jul 26 19:53:43 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:53:44.063514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57185683-f893-4b0e-8bf5-6a5ad78abcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:44.064374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-57185683-f893-4b0e-8bf5-6a5ad78abcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:44.078551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57185683-f893-4b0e-8bf5-6a5ad78abcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:44.079408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57185683-f893-4b0e-8bf5-6a5ad78abcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:44.080513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57185683-f893-4b0e-8bf5-6a5ad78abcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:44.081030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57185683-f893-4b0e-8bf5-6a5ad78abcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:44.183567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-57185683-f893-4b0e-8bf5-6a5ad78abcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:44.202353 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-57185683-f893-4b0e-8bf5-6a5ad78abcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1302 microversion: 2.1 time: 0.145455 Jul 26 19:53:44.202944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1231/2493] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:44 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1302 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:44.213702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-581d9a7d-baab-4dd2-8be6-2750ada46be6 tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] Action: 'create', calling method: .version_select at 0x7f8756e045e0>, body: {"pool": "non_exist_pool"} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:44.269281 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-581d9a7d-baab-4dd2-8be6-2750ada46be6 tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] HTTP exception thrown: Floating IP pool not found. Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-581d9a7d-baab-4dd2-8be6-2750ada46be6 tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] Request method failure captured: Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 26 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EZHF9tyripYIHR1pnVoQ3h6v5wrgS7GGtid1yoq3Xwu1I3T3XjQsQsrt2PgjS4w0dhbSbCUqsMSmRU8hcwJb9RrmU_SxGIb11yL4vRWd10cMb35tzzcHRDwPy9UoigY_BG-LEcNqQcjXEgQvJvKqiUw0Xcw8rty4S153OkNsAGka5A Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 9d2723e687a8429d8930c33d202d34f0 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2027370395 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d2723e687a8429d8930c33d202d34f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d2723e687a8429d8930c33d202d34f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d2723e687a8429d8930c33d202d34f0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d2723e687a8429d8930c33d202d34f0"}]}] Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2027370395 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 9d2723e687a8429d8930c33d202d34f0 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2027370395 Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsNegativeTestJSON-2027370395-project Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 59c7d3c870714b38b82fb82de3792b5a Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2027370395-project Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: {"pool": "non_exist_pool"} Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: exception: Floating IP pool not found. Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:44.272726 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:44.277639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 26 19:53:44.277639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.290112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-581d9a7d-baab-4dd2-8be6-2750ada46be6 tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] Returning 404 to user: Floating IP pool not found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:44.291437 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-581d9a7d-baab-4dd2-8be6-2750ada46be6 tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.086946 Jul 26 19:53:44.292567 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1232/2494] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:53:44 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:53:44.311291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-35bf1ba0-378d-4fc0-beb8-fd460055cf4d tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] Calling method '.version_select at 0x7f875761a3a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:44.395553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-35bf1ba0-378d-4fc0-beb8-fd460055cf4d tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7b125a5e-70c0-4b0a-be2f-d8e010af344e could not be found", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:53:44.396286 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-35bf1ba0-378d-4fc0-beb8-fd460055cf4d tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] HTTP exception thrown: Floating IP not found for ID 7b125a5e-70c0-4b0a-be2f-d8e010af344e Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-35bf1ba0-378d-4fc0-beb8-fd460055cf4d tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] Request method failure captured: Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-floating-ips/7b125a5e-70c0-4b0a-be2f-d8e010af344e HTTP/1.1 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EZHF9tyripYIHR1pnVoQ3h6v5wrgS7GGtid1yoq3Xwu1I3T3XjQsQsrt2PgjS4w0dhbSbCUqsMSmRU8hcwJb9RrmU_SxGIb11yL4vRWd10cMb35tzzcHRDwPy9UoigY_BG-LEcNqQcjXEgQvJvKqiUw0Xcw8rty4S153OkNsAGka5A Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 9d2723e687a8429d8930c33d202d34f0 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2027370395 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9d2723e687a8429d8930c33d202d34f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d2723e687a8429d8930c33d202d34f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9d2723e687a8429d8930c33d202d34f0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9d2723e687a8429d8930c33d202d34f0"}]}] Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2027370395 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 9d2723e687a8429d8930c33d202d34f0 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2027370395 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsNegativeTestJSON-2027370395-project Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 59c7d3c870714b38b82fb82de3792b5a Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2027370395-project Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: exception: Floating IP not found for ID 7b125a5e-70c0-4b0a-be2f-d8e010af344e Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7b125a5e-70c0-4b0a-be2f-d8e010af344e'} Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7b125a5e-70c0-4b0a-be2f-d8e010af344e could not be found Jul 26 19:53:44.400288 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67b2e35e-7bb5-4a70-b75c-c6812df37857'] Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7b125a5e-70c0-4b0a-be2f-d8e010af344e. Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7b125a5e-70c0-4b0a-be2f-d8e010af344e Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7b125a5e-70c0-4b0a-be2f-d8e010af344e Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-35bf1ba0-378d-4fc0-beb8-fd460055cf4d tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] Returning 404 to user: Floating IP not found for ID 7b125a5e-70c0-4b0a-be2f-d8e010af344e {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:44.404281 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-35bf1ba0-378d-4fc0-beb8-fd460055cf4d tempest-FloatingIPsNegativeTestJSON-2027370395 tempest-FloatingIPsNegativeTestJSON-2027370395-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/7b125a5e-70c0-4b0a-be2f-d8e010af344e" status: 404 len: 111 microversion: 2.1 time: 0.100738 Jul 26 19:53:44.407867 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1233/2495] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:53:44 2022] DELETE /compute/v2.1/os-floating-ips/7b125a5e-70c0-4b0a-be2f-d8e010af344e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:44.894874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f57f2f5-10d6-4f36-8e84-e2fc4e80931a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:44.895592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f57f2f5-10d6-4f36-8e84-e2fc4e80931a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:44.914306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f57f2f5-10d6-4f36-8e84-e2fc4e80931a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:44.914767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f57f2f5-10d6-4f36-8e84-e2fc4e80931a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:44.915583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f57f2f5-10d6-4f36-8e84-e2fc4e80931a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:44.916058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f57f2f5-10d6-4f36-8e84-e2fc4e80931a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:45.824688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1f57f2f5-10d6-4f36-8e84-e2fc4e80931a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:45.835111 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f57f2f5-10d6-4f36-8e84-e2fc4e80931a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1312 microversion: 2.1 time: 0.945938 Jul 26 19:53:45.849265 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1234/2496] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:44 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1312 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:45.867220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db1c7f57-43e0-47ab-93c1-b0e84fdb0361 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:45.867897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-db1c7f57-43e0-47ab-93c1-b0e84fdb0361 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:45.878447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db1c7f57-43e0-47ab-93c1-b0e84fdb0361 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:45.882920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db1c7f57-43e0-47ab-93c1-b0e84fdb0361 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:45.884712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db1c7f57-43e0-47ab-93c1-b0e84fdb0361 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:45.889708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db1c7f57-43e0-47ab-93c1-b0e84fdb0361 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:46.108999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-db1c7f57-43e0-47ab-93c1-b0e84fdb0361 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:46.123204 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db1c7f57-43e0-47ab-93c1-b0e84fdb0361 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1302 microversion: 2.1 time: 0.270868 Jul 26 19:53:46.126333 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1235/2497] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:45 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1302 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:46.860661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6977e1a5-b433-4ed8-9029-370e709d5ca1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:46.861413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6977e1a5-b433-4ed8-9029-370e709d5ca1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:46.871530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6977e1a5-b433-4ed8-9029-370e709d5ca1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:46.876625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6977e1a5-b433-4ed8-9029-370e709d5ca1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:46.877636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6977e1a5-b433-4ed8-9029-370e709d5ca1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:46.878183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6977e1a5-b433-4ed8-9029-370e709d5ca1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:47.442728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6977e1a5-b433-4ed8-9029-370e709d5ca1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:47.458439 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6977e1a5-b433-4ed8-9029-370e709d5ca1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1461 microversion: 2.1 time: 0.599339 Jul 26 19:53:47.460155 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1236/2498] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:46 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1461 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:47.465714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-646e8aeb-214e-4c0e-87c5-1574e418ea09 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:47.467053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-646e8aeb-214e-4c0e-87c5-1574e418ea09 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:47.503702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-646e8aeb-214e-4c0e-87c5-1574e418ea09 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:47.504666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-646e8aeb-214e-4c0e-87c5-1574e418ea09 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:47.507316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-646e8aeb-214e-4c0e-87c5-1574e418ea09 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:47.509367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-646e8aeb-214e-4c0e-87c5-1574e418ea09 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:47.760009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-646e8aeb-214e-4c0e-87c5-1574e418ea09 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:47.770965 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-646e8aeb-214e-4c0e-87c5-1574e418ea09 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.309522 Jul 26 19:53:47.772210 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1237/2499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:47 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:47.878756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:47.995188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa6efcd0-201e-4a6b-8cfa-1f6e8ba15999 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:47.996060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa6efcd0-201e-4a6b-8cfa-1f6e8ba15999 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:48.007116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa6efcd0-201e-4a6b-8cfa-1f6e8ba15999 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:48.017737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa6efcd0-201e-4a6b-8cfa-1f6e8ba15999 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:48.018590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa6efcd0-201e-4a6b-8cfa-1f6e8ba15999 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:48.019034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa6efcd0-201e-4a6b-8cfa-1f6e8ba15999 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:48.448431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=36 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:49.008907 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa6efcd0-201e-4a6b-8cfa-1f6e8ba15999 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1612 microversion: 2.1 time: 1.235264 Jul 26 19:53:49.010361 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1238/2500] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:47 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1612 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:49.015490 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1c8e52a5-4c38-4c93-aede-13bf3a8dbb36 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/b9be5aff-c91c-4110-9af4-e7d916e8bca6" status: 202 len: 0 microversion: 2.1 time: 5.503026 Jul 26 19:53:49.017799 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1263/2501] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:53:43 2022] DELETE /compute/v2.1/os-floating-ips/b9be5aff-c91c-4110-9af4-e7d916e8bca6 => generated 0 bytes in 5506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:49.024430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c049015-19e2-4ed0-8794-30aa38bbdc4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:49.025485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0c049015-19e2-4ed0-8794-30aa38bbdc4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:49.040050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c049015-19e2-4ed0-8794-30aa38bbdc4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:49.043594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c049015-19e2-4ed0-8794-30aa38bbdc4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:49.044070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-277dc529-460b-4ab2-9906-bfbced9f520f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '.version_select at 0x7f875f1231f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:49.045036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c049015-19e2-4ed0-8794-30aa38bbdc4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:49.045970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c049015-19e2-4ed0-8794-30aa38bbdc4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:50.346136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0c049015-19e2-4ed0-8794-30aa38bbdc4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:50.360242 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0c049015-19e2-4ed0-8794-30aa38bbdc4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 1.348204 Jul 26 19:53:50.361353 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1239/2502] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:49 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:50.375982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:50.377066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:50.391359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:50.392406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:50.393842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:50.394892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:50.485988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a05edf4da4ef4019928b6e7ba4f4bc09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81cb7a0501b44a8b54b68bf244100e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:50.487326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] flavor_id is None. Assuming migration. {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 19:53:50.487997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 19:53:50.946907 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-277dc529-460b-4ab2-9906-bfbced9f520f tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/c1def503-9927-4db8-b8e8-4a470621366a" status: 202 len: 0 microversion: 2.1 time: 1.906835 Jul 26 19:53:50.948166 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1264/2503] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:53:49 2022] DELETE /compute/v2.1/os-security-groups/c1def503-9927-4db8-b8e8-4a470621366a => generated 0 bytes in 1909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:50.957171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14d13813-657c-4ec4-8de6-2e3f5940e237 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:50.958048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14d13813-657c-4ec4-8de6-2e3f5940e237 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:50.968996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14d13813-657c-4ec4-8de6-2e3f5940e237 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:50.969897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14d13813-657c-4ec4-8de6-2e3f5940e237 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:50.971095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14d13813-657c-4ec4-8de6-2e3f5940e237 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:50.971718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14d13813-657c-4ec4-8de6-2e3f5940e237 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:51.034366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14d13813-657c-4ec4-8de6-2e3f5940e237 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:53:51.210886 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14d13813-657c-4ec4-8de6-2e3f5940e237 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "DELETE /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 204 len: 0 microversion: 2.1 time: 0.257689 Jul 26 19:53:51.211720 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1265/2504] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:53:50 2022] DELETE /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:53:51.220799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-745f03d5-a7b1-42d3-849f-8688f606f94d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:51.221522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-745f03d5-a7b1-42d3-849f-8688f606f94d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:51.234378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-745f03d5-a7b1-42d3-849f-8688f606f94d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:51.235216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-745f03d5-a7b1-42d3-849f-8688f606f94d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:51.236284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-745f03d5-a7b1-42d3-849f-8688f606f94d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:51.236699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-745f03d5-a7b1-42d3-849f-8688f606f94d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:51.244070 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b90911cd-b902-4e01-be87-11901622390a tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c/action" status: 202 len: 0 microversion: 2.1 time: 0.879095 Jul 26 19:53:51.245275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1240/2505] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:53:50 2022] POST /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c/action => generated 0 bytes in 881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:53:51.260586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e6f8d209-76a1-4e8d-bbac-33fb75f51d13 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:51.265032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e6f8d209-76a1-4e8d-bbac-33fb75f51d13 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:51.295761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e6f8d209-76a1-4e8d-bbac-33fb75f51d13 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:51.296445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e6f8d209-76a1-4e8d-bbac-33fb75f51d13 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:51.298096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e6f8d209-76a1-4e8d-bbac-33fb75f51d13 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:51.301237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e6f8d209-76a1-4e8d-bbac-33fb75f51d13 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:52.037529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-745f03d5-a7b1-42d3-849f-8688f606f94d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:52.049656 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-745f03d5-a7b1-42d3-849f-8688f606f94d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1510 microversion: 2.1 time: 0.833543 Jul 26 19:53:52.050239 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1266/2506] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:51 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1510 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:52.072819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bb5eecc1-016a-4796-afc5-421df62013f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:52.076638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb5eecc1-016a-4796-afc5-421df62013f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:52.085588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb5eecc1-016a-4796-afc5-421df62013f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:52.086531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb5eecc1-016a-4796-afc5-421df62013f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:52.088037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb5eecc1-016a-4796-afc5-421df62013f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:52.089010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb5eecc1-016a-4796-afc5-421df62013f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:52.408144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e6f8d209-76a1-4e8d-bbac-33fb75f51d13 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:52.420497 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e6f8d209-76a1-4e8d-bbac-33fb75f51d13 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1470 microversion: 2.1 time: 1.169974 Jul 26 19:53:52.426078 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1241/2507] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:51 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1470 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:52.924031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7d04e1d9-2468-4209-afba-9001417e5a82 req-8ee40993-d43c-41a1-8cc6-c9c99f28cb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a506c0f-7d8b-4671-9667-185ede749851", "tag": "f57edbd3-22f4-4ba5-a486-93b6bb48d154"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:52.958631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7d04e1d9-2468-4209-afba-9001417e5a82 req-8ee40993-d43c-41a1-8cc6-c9c99f28cb0c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:52.959929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7d04e1d9-2468-4209-afba-9001417e5a82 req-8ee40993-d43c-41a1-8cc6-c9c99f28cb0c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:53.005011 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7d04e1d9-2468-4209-afba-9001417e5a82 req-8ee40993-d43c-41a1-8cc6-c9c99f28cb0c service nova] Creating event network-changed:f57edbd3-22f4-4ba5-a486-93b6bb48d154 for instance 1a506c0f-7d8b-4671-9667-185ede749851 on n-h2-708768-8 Jul 26 19:53:53.015138 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7d04e1d9-2468-4209-afba-9001417e5a82 req-8ee40993-d43c-41a1-8cc6-c9c99f28cb0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094302 Jul 26 19:53:53.032087 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1242/2508] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:53:53.071843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5a9d7ea9-ff95-4707-890f-45319080e64d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:53.073022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a9d7ea9-ff95-4707-890f-45319080e64d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:53.086700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a9d7ea9-ff95-4707-890f-45319080e64d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:53.090742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a9d7ea9-ff95-4707-890f-45319080e64d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:53.093691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a9d7ea9-ff95-4707-890f-45319080e64d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:53.094363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a9d7ea9-ff95-4707-890f-45319080e64d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:53.343094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bb5eecc1-016a-4796-afc5-421df62013f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:53.357318 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bb5eecc1-016a-4796-afc5-421df62013f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 1.306037 Jul 26 19:53:53.361271 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1267/2509] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:52 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:53.446483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-738d540b-9389-49a1-b2a8-6a16b16b1561 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:53.447360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-738d540b-9389-49a1-b2a8-6a16b16b1561 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:53.470065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-738d540b-9389-49a1-b2a8-6a16b16b1561 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:53.470601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-738d540b-9389-49a1-b2a8-6a16b16b1561 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:53.471758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-738d540b-9389-49a1-b2a8-6a16b16b1561 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:53.472211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-738d540b-9389-49a1-b2a8-6a16b16b1561 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:53.812281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5a9d7ea9-ff95-4707-890f-45319080e64d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:53.822172 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5a9d7ea9-ff95-4707-890f-45319080e64d tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1510 microversion: 2.1 time: 0.755491 Jul 26 19:53:53.826215 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1243/2510] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:53 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1510 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:54.383128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2714fc66-6291-455a-9257-644f09a6aefb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:54.384248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2714fc66-6291-455a-9257-644f09a6aefb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:54.398095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2714fc66-6291-455a-9257-644f09a6aefb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:54.408572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2714fc66-6291-455a-9257-644f09a6aefb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:54.409678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2714fc66-6291-455a-9257-644f09a6aefb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:54.410825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2714fc66-6291-455a-9257-644f09a6aefb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:54.664692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-738d540b-9389-49a1-b2a8-6a16b16b1561 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:54.685309 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-738d540b-9389-49a1-b2a8-6a16b16b1561 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1470 microversion: 2.1 time: 1.242378 Jul 26 19:53:54.686077 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1268/2511] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:53 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1470 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:54.850678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fd9a8910-8c7e-4eab-bba2-838fac847452 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:54.851551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd9a8910-8c7e-4eab-bba2-838fac847452 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:54.866810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd9a8910-8c7e-4eab-bba2-838fac847452 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:54.867862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd9a8910-8c7e-4eab-bba2-838fac847452 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:54.868958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd9a8910-8c7e-4eab-bba2-838fac847452 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:54.871502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd9a8910-8c7e-4eab-bba2-838fac847452 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:55.042842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2714fc66-6291-455a-9257-644f09a6aefb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:55.051466 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2714fc66-6291-455a-9257-644f09a6aefb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.672896 Jul 26 19:53:55.058690 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1244/2512] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:54 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:55.421652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fe761ccf-06a3-42c3-ad0a-2ac1700029c8 req-16b96293-ae39-46ee-a158-e066199849a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d76780-8750-4ef5-9699-2baef38358c3", "name": "network-vif-deleted", "tag": "d62a1a3c-ef55-4efa-9ba6-5bdd693c678c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:53:55.496158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fe761ccf-06a3-42c3-ad0a-2ac1700029c8 req-16b96293-ae39-46ee-a158-e066199849a9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:55.500779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fe761ccf-06a3-42c3-ad0a-2ac1700029c8 req-16b96293-ae39-46ee-a158-e066199849a9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:55.534659 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fe761ccf-06a3-42c3-ad0a-2ac1700029c8 req-16b96293-ae39-46ee-a158-e066199849a9 service nova] Creating event network-vif-deleted:d62a1a3c-ef55-4efa-9ba6-5bdd693c678c for instance 16d76780-8750-4ef5-9699-2baef38358c3 on n-h2-708768-8 Jul 26 19:53:55.548410 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fe761ccf-06a3-42c3-ad0a-2ac1700029c8 req-16b96293-ae39-46ee-a158-e066199849a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139210 Jul 26 19:53:55.550681 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1245/2513] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:53:55.715559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3390bc43-0102-41a7-8e3b-3ab3111bcadb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:55.716303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3390bc43-0102-41a7-8e3b-3ab3111bcadb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:55.734041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3390bc43-0102-41a7-8e3b-3ab3111bcadb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:55.734586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3390bc43-0102-41a7-8e3b-3ab3111bcadb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:55.736857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3390bc43-0102-41a7-8e3b-3ab3111bcadb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:55.738311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3390bc43-0102-41a7-8e3b-3ab3111bcadb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:55.883505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fd9a8910-8c7e-4eab-bba2-838fac847452 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f38af412694fbcaa276d2f166b21c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c99967c0194f28b724c14859ca05ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:55.898505 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fd9a8910-8c7e-4eab-bba2-838fac847452 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 200 len: 1510 microversion: 2.1 time: 1.054429 Jul 26 19:53:55.899992 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1269/2514] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:54 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 1510 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:56.082714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88bb5440-d321-4d7e-b9ad-b1e94fcbea4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:56.083599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-88bb5440-d321-4d7e-b9ad-b1e94fcbea4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:56.097146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88bb5440-d321-4d7e-b9ad-b1e94fcbea4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:56.098057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88bb5440-d321-4d7e-b9ad-b1e94fcbea4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:56.099006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88bb5440-d321-4d7e-b9ad-b1e94fcbea4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:56.104391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88bb5440-d321-4d7e-b9ad-b1e94fcbea4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:56.597114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3390bc43-0102-41a7-8e3b-3ab3111bcadb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:56.611789 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3390bc43-0102-41a7-8e3b-3ab3111bcadb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1470 microversion: 2.1 time: 0.903298 Jul 26 19:53:56.614455 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1246/2515] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:55 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1470 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:56.922408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-88bb5440-d321-4d7e-b9ad-b1e94fcbea4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:56.922857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:56.923044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] [instance: 16d76780-8750-4ef5-9699-2baef38358c3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:56.936922 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-88bb5440-d321-4d7e-b9ad-b1e94fcbea4b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.858326 Jul 26 19:53:56.940428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:56.946136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:56.953531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:56.954288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:56.954668 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1270/2516] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:56 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:53:57.019430 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] HTTP exception thrown: Instance 16d76780-8750-4ef5-9699-2baef38358c3 could not be found. Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Request method failure captured: Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 HTTP/1.1 Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EXs1NnwB94pCvsWQZWj2PHe3cCjXbEAMH8eFg3V_OQGCWZZdnbkzD5CUE-HwL-e6cfwOebNZYyUp7UFjnui2byDLS7A-A4PBaHjBrxoRjNSvIUH8SYLDKSgx5_x3-rh6-NYb8rQWqz5AvvvWpF90QtlfMnBSMAY4vwVdkIVXWgoP4I Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e0c99967c0194f28b724c14859ca05ab Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-179576509 Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e0c99967c0194f28b724c14859ca05ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0c99967c0194f28b724c14859ca05ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e0c99967c0194f28b724c14859ca05ab", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e0c99967c0194f28b724c14859ca05ab"}]}] Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-179576509 Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e0c99967c0194f28b724c14859ca05ab Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-179576509 Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerRescueTestJSONUnderV235-179576509-project Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: e7f38af412694fbcaa276d2f166b21c1 Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-179576509-project Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 16d76780-8750-4ef5-9699-2baef38358c3 could not be found. Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '16d76780-8750-4ef5-9699-2baef38358c3'} Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d76780-8750-4ef5-9699-2baef38358c3 could not be found. Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d76780-8750-4ef5-9699-2baef38358c3 could not be found. Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:57.021757 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:53:57.026374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:57.026374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:53:57.026374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:53:57.026374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:53:57.026374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:53:57.026374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:53:57.026374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d76780-8750-4ef5-9699-2baef38358c3 could not be found. Jul 26 19:53:57.026374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:53:57.032894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] Returning 404 to user: Instance 16d76780-8750-4ef5-9699-2baef38358c3 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:53:57.036296 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-43aa0cbb-ed70-4df4-b6b8-1f31c296da12 tempest-ServerRescueTestJSONUnderV235-179576509 tempest-ServerRescueTestJSONUnderV235-179576509-project] 10.222.0.58 "GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3" status: 404 len: 111 microversion: 2.1 time: 0.117978 Jul 26 19:53:57.047034 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1247/2517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:56 2022] GET /compute/v2.1/servers/16d76780-8750-4ef5-9699-2baef38358c3 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:53:57.637811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cfb34eca-7dae-465e-9bd5-3d46904c8b9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:57.638743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cfb34eca-7dae-465e-9bd5-3d46904c8b9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:57.659312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfb34eca-7dae-465e-9bd5-3d46904c8b9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:57.660177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfb34eca-7dae-465e-9bd5-3d46904c8b9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:57.663889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfb34eca-7dae-465e-9bd5-3d46904c8b9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:57.667812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfb34eca-7dae-465e-9bd5-3d46904c8b9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:57.966804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16e618c8-2e65-49a0-a0d7-6c9f038f8111 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:57.968081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-16e618c8-2e65-49a0-a0d7-6c9f038f8111 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:57.981813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16e618c8-2e65-49a0-a0d7-6c9f038f8111 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:57.982700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16e618c8-2e65-49a0-a0d7-6c9f038f8111 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:57.983802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16e618c8-2e65-49a0-a0d7-6c9f038f8111 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:53:57.987240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16e618c8-2e65-49a0-a0d7-6c9f038f8111 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:53:58.009322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:53:58.940497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-16e618c8-2e65-49a0-a0d7-6c9f038f8111 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:58.952322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16e618c8-2e65-49a0-a0d7-6c9f038f8111 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.990114 Jul 26 19:53:58.952926 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1248/2518] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:57 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:59.622935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cfb34eca-7dae-465e-9bd5-3d46904c8b9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:53:59.645293 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cfb34eca-7dae-465e-9bd5-3d46904c8b9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1475 microversion: 2.1 time: 2.011924 Jul 26 19:53:59.649270 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1271/2519] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:57 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1475 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:53:59.978299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:53:59.980993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:53:59.999286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:00.000083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:00.001087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:00.001708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:00.676656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5c12cd0-d581-4643-8302-92acff1df78c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:00.677485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5c12cd0-d581-4643-8302-92acff1df78c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:00.702609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5c12cd0-d581-4643-8302-92acff1df78c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:00.703260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5c12cd0-d581-4643-8302-92acff1df78c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:00.704450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5c12cd0-d581-4643-8302-92acff1df78c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:00.704897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5c12cd0-d581-4643-8302-92acff1df78c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:00.716415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:00.732334 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.758559 Jul 26 19:54:00.735478 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1249/2520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:53:59 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:01.290603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:01.293903 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3effa1f4-e33f-4daa-ae5b-ce67c76bfa7f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003654 Jul 26 19:54:01.306637 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1250/2521] 10.222.0.58 () {56 vars in 886 bytes} [Tue Jul 26 19:54:01 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 19:54:01.763336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d0f9f8e-fd53-4dd2-9ea8-66cf089b1336 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:01.765016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d0f9f8e-fd53-4dd2-9ea8-66cf089b1336 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:01.783833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d0f9f8e-fd53-4dd2-9ea8-66cf089b1336 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:01.791812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d0f9f8e-fd53-4dd2-9ea8-66cf089b1336 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:01.794846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d0f9f8e-fd53-4dd2-9ea8-66cf089b1336 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:01.795559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d0f9f8e-fd53-4dd2-9ea8-66cf089b1336 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:01.905285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f5c12cd0-d581-4643-8302-92acff1df78c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:01.941535 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5c12cd0-d581-4643-8302-92acff1df78c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1475 microversion: 2.1 time: 1.269006 Jul 26 19:54:01.942167 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1272/2522] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:00 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1475 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:02.393672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6d0f9f8e-fd53-4dd2-9ea8-66cf089b1336 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:02.416181 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d0f9f8e-fd53-4dd2-9ea8-66cf089b1336 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.656150 Jul 26 19:54:02.423794 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1251/2523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:01 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:02.966183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-20410e83-d177-478f-b98d-4ec3e0501aef tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:02.967323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-20410e83-d177-478f-b98d-4ec3e0501aef tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:02.979332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20410e83-d177-478f-b98d-4ec3e0501aef tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:02.980054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20410e83-d177-478f-b98d-4ec3e0501aef tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:02.981397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20410e83-d177-478f-b98d-4ec3e0501aef tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:02.983639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20410e83-d177-478f-b98d-4ec3e0501aef tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:03.068887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:03.148502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1468066139", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0f695fb7-3303-409c-b910-73ee1e80f46d"}], "block_device_mapping_v2": [{"uuid": "aa5ad101-2573-4f24-aba6-5f216f497d21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:03.294638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] validate_networks() for [('0f695fb7-3303-409c-b910-73ee1e80f46d', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:54:03.502140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-20410e83-d177-478f-b98d-4ec3e0501aef tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:03.520269 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-20410e83-d177-478f-b98d-4ec3e0501aef tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1475 microversion: 2.1 time: 0.556403 Jul 26 19:54:03.538920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1273/2524] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:02 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1475 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:03.549556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d91ec127-b134-4c60-8ead-7a7bde6fba52 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Action: 'create', calling method: .version_select at 0x7f875efddd30>, body: {"keypair": {"name": "tempest-keypair-84472231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwqvTR8co5c4A2+mAuk+jCX5T9ZSV/Z/QNmEigfXGqlJhrg3EdrQP2to4GzTT/FN/+NLPhl0SlbUuNGLNx7bH3WSNpKSKpGofCGHOwNFg4qr7fXGT87wGHOlks0QSCH3A=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:03.595688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-d91ec127-b134-4c60-8ead-7a7bde6fba52 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Getting quotas for project 215594acf68a48d081d99c2f58d35925. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:54:03.614646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-d91ec127-b134-4c60-8ead-7a7bde6fba52 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Getting quotas for user 9cb05da7a0eb48a182c4910331827161 and project 215594acf68a48d081d99c2f58d35925. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:54:03.683413 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d91ec127-b134-4c60-8ead-7a7bde6fba52 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.148895 Jul 26 19:54:03.684156 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1274/2525] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 19:54:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 19:54:03.694269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2f0c29f-75b9-42fa-a561-cdaef85f4805 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:03.696772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e2f0c29f-75b9-42fa-a561-cdaef85f4805 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:03.714004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2f0c29f-75b9-42fa-a561-cdaef85f4805 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:03.717086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2f0c29f-75b9-42fa-a561-cdaef85f4805 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:03.718719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2f0c29f-75b9-42fa-a561-cdaef85f4805 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:03.720453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2f0c29f-75b9-42fa-a561-cdaef85f4805 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:04.410734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e2f0c29f-75b9-42fa-a561-cdaef85f4805 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:04.428831 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e2f0c29f-75b9-42fa-a561-cdaef85f4805 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.743149 Jul 26 19:54:04.429904 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1275/2526] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:03 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:04.550902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b873a10c-cab9-4247-8ce5-ef3a129939a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:04.551748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b873a10c-cab9-4247-8ce5-ef3a129939a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:04.566698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b873a10c-cab9-4247-8ce5-ef3a129939a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:04.572432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b873a10c-cab9-4247-8ce5-ef3a129939a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:04.575158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b873a10c-cab9-4247-8ce5-ef3a129939a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:04.578341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b873a10c-cab9-4247-8ce5-ef3a129939a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:05.405533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:54:05.406709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:54:05.407201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:54:05.407638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:54:05.408124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:54:05.422913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:05.425298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:05.426380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:05.430268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:05.470021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:54:05.476719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Getting quotas for user 678a9d8bb54a4fdb8997fcf480a3a355 and project 13f4775142b54978b4e0e2c4c5f70147. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:54:05.534902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b873a10c-cab9-4247-8ce5-ef3a129939a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:05.545817 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b873a10c-cab9-4247-8ce5-ef3a129939a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1475 microversion: 2.1 time: 0.997607 Jul 26 19:54:05.547957 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1276/2527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:04 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1475 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:05.561423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c0e9f0a-f024-454d-9d95-d6f0fba4e37f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:05.562069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c0e9f0a-f024-454d-9d95-d6f0fba4e37f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:05.582561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c0e9f0a-f024-454d-9d95-d6f0fba4e37f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:05.583072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c0e9f0a-f024-454d-9d95-d6f0fba4e37f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:05.584106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c0e9f0a-f024-454d-9d95-d6f0fba4e37f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:05.589044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c0e9f0a-f024-454d-9d95-d6f0fba4e37f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:05.608015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:54:05.610682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa5ad101-2573-4f24-aba6-5f216f497d21',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:54:05.863936 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df6b8a79-84e9-49de-92bf-12d2e4d15e33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.719643 Jul 26 19:54:05.866452 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1252/2528] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:54:05.873782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5e0bb5b1-3266-4722-8bdf-ec0198aa8eaf req-34988d22-5852-4725-81c1-d641dea24fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a506c0f-7d8b-4671-9667-185ede749851", "name": "network-vif-plugged", "status": "completed", "tag": "f57edbd3-22f4-4ba5-a486-93b6bb48d154"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:05.929498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5e0bb5b1-3266-4722-8bdf-ec0198aa8eaf req-34988d22-5852-4725-81c1-d641dea24fa7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:05.930578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5e0bb5b1-3266-4722-8bdf-ec0198aa8eaf req-34988d22-5852-4725-81c1-d641dea24fa7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:05.949037 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5e0bb5b1-3266-4722-8bdf-ec0198aa8eaf req-34988d22-5852-4725-81c1-d641dea24fa7 service nova] Creating event network-vif-plugged:f57edbd3-22f4-4ba5-a486-93b6bb48d154 for instance 1a506c0f-7d8b-4671-9667-185ede749851 on n-h2-708768-8 Jul 26 19:54:05.957047 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5e0bb5b1-3266-4722-8bdf-ec0198aa8eaf req-34988d22-5852-4725-81c1-d641dea24fa7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088308 Jul 26 19:54:05.958269 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1253/2529] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:05.965736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3f8793a-9df6-4ee2-98b0-7029a3433f59 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:05.967317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3f8793a-9df6-4ee2-98b0-7029a3433f59 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:06.092820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3f8793a-9df6-4ee2-98b0-7029a3433f59 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:06.103515 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3f8793a-9df6-4ee2-98b0-7029a3433f59 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1053 microversion: 2.1 time: 0.142392 Jul 26 19:54:06.104779 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1254/2530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:05 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1053 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:06.145416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c0e9f0a-f024-454d-9d95-d6f0fba4e37f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:06.183243 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c0e9f0a-f024-454d-9d95-d6f0fba4e37f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.633885 Jul 26 19:54:06.199344 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1277/2531] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:05 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:06.570262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a09c4c30-f476-4b8a-9ffd-d1d7e7bd9379 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:06.571075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a09c4c30-f476-4b8a-9ffd-d1d7e7bd9379 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:06.594630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a09c4c30-f476-4b8a-9ffd-d1d7e7bd9379 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:06.595356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a09c4c30-f476-4b8a-9ffd-d1d7e7bd9379 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:06.596365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a09c4c30-f476-4b8a-9ffd-d1d7e7bd9379 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:06.599125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a09c4c30-f476-4b8a-9ffd-d1d7e7bd9379 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:07.125964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aaf83687-95c3-4c14-8692-db2cea33e097 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:07.129049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aaf83687-95c3-4c14-8692-db2cea33e097 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:07.144914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf83687-95c3-4c14-8692-db2cea33e097 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:07.146192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf83687-95c3-4c14-8692-db2cea33e097 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:07.158984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf83687-95c3-4c14-8692-db2cea33e097 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:07.165034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf83687-95c3-4c14-8692-db2cea33e097 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:07.336921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a09c4c30-f476-4b8a-9ffd-d1d7e7bd9379 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:07.353794 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a09c4c30-f476-4b8a-9ffd-d1d7e7bd9379 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1475 microversion: 2.1 time: 0.790017 Jul 26 19:54:07.357385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aaf83687-95c3-4c14-8692-db2cea33e097 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:07.363977 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1255/2532] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:06 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1475 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:07.369548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-630fcd47-cec4-49f5-be8e-31b6fa12eb1e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:07.370164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-630fcd47-cec4-49f5-be8e-31b6fa12eb1e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:07.386406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630fcd47-cec4-49f5-be8e-31b6fa12eb1e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:07.386889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630fcd47-cec4-49f5-be8e-31b6fa12eb1e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:07.387636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630fcd47-cec4-49f5-be8e-31b6fa12eb1e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:07.388088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630fcd47-cec4-49f5-be8e-31b6fa12eb1e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:07.402250 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aaf83687-95c3-4c14-8692-db2cea33e097 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1095 microversion: 2.1 time: 0.281024 Jul 26 19:54:07.403298 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1278/2533] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:07 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1095 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:08.073553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-630fcd47-cec4-49f5-be8e-31b6fa12eb1e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:08.084191 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-630fcd47-cec4-49f5-be8e-31b6fa12eb1e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1370 microversion: 2.1 time: 0.717819 Jul 26 19:54:08.089188 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1256/2534] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:07 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1370 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:08.162673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-089bb735-1009-4551-b534-46309f9a9aef tempest-ComputeTenantNetworksTest-1068197795 tempest-ComputeTenantNetworksTest-1068197795-project] Calling method '.version_select at 0x7f875eef1310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:08.307047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-17210717", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "bedf1868-40c7-4f1b-a74c-e29f668ec4db"}, {"uuid": "684c9583-5a0a-4775-a806-84ff364b4d65"}, {"uuid": "bedf1868-40c7-4f1b-a74c-e29f668ec4db"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:08.399897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] validate_networks() for [('bedf1868-40c7-4f1b-a74c-e29f668ec4db', None, None, None, None, None), ('684c9583-5a0a-4775-a806-84ff364b4d65', None, None, None, None, None), ('bedf1868-40c7-4f1b-a74c-e29f668ec4db', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:54:08.794214 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-089bb735-1009-4551-b534-46309f9a9aef tempest-ComputeTenantNetworksTest-1068197795 tempest-ComputeTenantNetworksTest-1068197795-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.856265 Jul 26 19:54:08.800353 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1279/2535] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:54:07 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:08.806907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-92ff69b0-4962-4328-8f9d-694190d43f3c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:08.807531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-92ff69b0-4962-4328-8f9d-694190d43f3c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:08.809556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:08.825720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92ff69b0-4962-4328-8f9d-694190d43f3c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:08.826177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92ff69b0-4962-4328-8f9d-694190d43f3c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:08.826958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92ff69b0-4962-4328-8f9d-694190d43f3c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:08.827395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92ff69b0-4962-4328-8f9d-694190d43f3c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:09.187315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-92ff69b0-4962-4328-8f9d-694190d43f3c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:09.202634 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-92ff69b0-4962-4328-8f9d-694190d43f3c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1475 microversion: 2.1 time: 0.401084 Jul 26 19:54:09.216356 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1280/2536] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:08 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1475 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:09.230701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d4a88ed-f5c6-417d-9bb4-a71cb073c078 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:09.231649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d4a88ed-f5c6-417d-9bb4-a71cb073c078 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:09.257541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d4a88ed-f5c6-417d-9bb4-a71cb073c078 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:09.257994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d4a88ed-f5c6-417d-9bb4-a71cb073c078 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:09.259239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d4a88ed-f5c6-417d-9bb4-a71cb073c078 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:09.259924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d4a88ed-f5c6-417d-9bb4-a71cb073c078 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:09.393861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4d4a88ed-f5c6-417d-9bb4-a71cb073c078 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:09.407402 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d4a88ed-f5c6-417d-9bb4-a71cb073c078 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1169 microversion: 2.1 time: 0.189797 Jul 26 19:54:09.408019 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1281/2537] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:09 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:09.416234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28d578f5-32cb-4412-ba4d-59e6b0495c58 tempest-ComputeTenantNetworksTest-1068197795 tempest-ComputeTenantNetworksTest-1068197795-project] Calling method '.version_select at 0x7f875efdde50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:09.669541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-28d578f5-32cb-4412-ba4d-59e6b0495c58 tempest-ComputeTenantNetworksTest-1068197795 tempest-ComputeTenantNetworksTest-1068197795-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks/278112f8-7e67-4b97-a96e-60da854612a3" status: 200 len: 139 microversion: 2.1 time: 0.257936 Jul 26 19:54:09.670209 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1282/2538] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:54:09 2022] GET /compute/v2.1/os-tenant-networks/278112f8-7e67-4b97-a96e-60da854612a3 => generated 139 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:09.681225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d01ace4b-f6c0-49f3-b370-bd9dc09fa7e2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:09.682013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d01ace4b-f6c0-49f3-b370-bd9dc09fa7e2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:09.704479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d01ace4b-f6c0-49f3-b370-bd9dc09fa7e2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:09.705150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d01ace4b-f6c0-49f3-b370-bd9dc09fa7e2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:09.706691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d01ace4b-f6c0-49f3-b370-bd9dc09fa7e2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:09.709464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d01ace4b-f6c0-49f3-b370-bd9dc09fa7e2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:10.168002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d01ace4b-f6c0-49f3-b370-bd9dc09fa7e2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:10.178602 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d01ace4b-f6c0-49f3-b370-bd9dc09fa7e2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1564 microversion: 2.1 time: 0.507179 Jul 26 19:54:10.184832 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1283/2539] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:09 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1564 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:10.189735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-648127440", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b726bfea-2817-45f8-8eb6-94f92bd1ebaa"}, {"port": "541cb467-b301-4e6d-a429-b68924052481", "tag": "port-1"}, {"port": "ae28e6f8-74d4-4ed4-a654-8129d2f6984a", "tag": "port-2"}, {"uuid": "e41f897c-5a86-4c62-b8f8-eacd57fe40b6", "tag": "net-1"}, {"uuid": "e41f897c-5a86-4c62-b8f8-eacd57fe40b6"}, {"uuid": "f4e711c7-f76e-4835-8b51-ecf24b1b7280", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f4e711c7-f76e-4835-8b51-ecf24b1b7280", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e4c55558-1197-4e5b-b933-fa796fe41426", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2f7fc6ce-7b24-4985-b9be-7db9acb7192d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6853906b-7a78-41d3-a67d-a171a9dadda5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2008628214"}], "key_name": "tempest-keypair-84472231", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:10.493786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] validate_networks() for [('b726bfea-2817-45f8-8eb6-94f92bd1ebaa', None, None, None, None, None), (None, None, '541cb467-b301-4e6d-a429-b68924052481', None, None, None), (None, None, 'ae28e6f8-74d4-4ed4-a654-8129d2f6984a', None, None, None), ('e41f897c-5a86-4c62-b8f8-eacd57fe40b6', None, None, None, None, None), ('e41f897c-5a86-4c62-b8f8-eacd57fe40b6', None, None, None, None, None), ('f4e711c7-f76e-4835-8b51-ecf24b1b7280', '10.2.2.100', None, None, None, None), ('f4e711c7-f76e-4835-8b51-ecf24b1b7280', '10.2.2.200', None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:54:13.640392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:14.542668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:54:14.544075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:54:14.544856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:54:14.545599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:54:14.546388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:54:14.552277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:14.583354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:14.584179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:14.585816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:14.586633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:14.621437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Getting quotas for project 114f0f8e78814e9089f720705dc2319c. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:54:14.637013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Getting quotas for user ff33e693dc4141e7b4667bee9c2cebfc and project 114f0f8e78814e9089f720705dc2319c. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:54:14.678130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:54:14.681506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:54:14.789284 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a82c5ae2-4e16-4128-8525-cb0852e33332 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.487025 Jul 26 19:54:14.790638 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1257/2540] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 6489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:54:14.802228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fb043055-3db5-429e-8910-de63ebe45bf7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:14.804531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fb043055-3db5-429e-8910-de63ebe45bf7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:14.814899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fb043055-3db5-429e-8910-de63ebe45bf7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:14.815920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fb043055-3db5-429e-8910-de63ebe45bf7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:14.817072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fb043055-3db5-429e-8910-de63ebe45bf7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:14.818603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fb043055-3db5-429e-8910-de63ebe45bf7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:15.211202 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fb043055-3db5-429e-8910-de63ebe45bf7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.419062 Jul 26 19:54:15.212278 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1258/2541] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:54:14 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-interface => generated 284 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:15.217798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4d332502-6bc3-49a9-adfa-81ae7657d798 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:15.218630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4d332502-6bc3-49a9-adfa-81ae7657d798 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:15.240495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d332502-6bc3-49a9-adfa-81ae7657d798 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:15.242205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d332502-6bc3-49a9-adfa-81ae7657d798 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:15.244435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d332502-6bc3-49a9-adfa-81ae7657d798 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:15.246485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d332502-6bc3-49a9-adfa-81ae7657d798 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:16.816356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4d332502-6bc3-49a9-adfa-81ae7657d798 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:16.847444 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4d332502-6bc3-49a9-adfa-81ae7657d798 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1474 microversion: 2.1 time: 1.632965 Jul 26 19:54:16.849721 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1259/2542] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:15 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1474 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:17.120265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:54:17.122987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:54:17.123807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:54:17.124738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:54:17.125483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:54:17.144647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:17.148977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:17.151455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:17.152814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:17.223741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Getting quotas for project 215594acf68a48d081d99c2f58d35925. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:54:17.234585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Getting quotas for user 9cb05da7a0eb48a182c4910331827161 and project 215594acf68a48d081d99c2f58d35925. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:54:17.236932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d42d490d-82c0-46ef-b0fa-44b4af321bea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:17.237548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d42d490d-82c0-46ef-b0fa-44b4af321bea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:17.245741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d42d490d-82c0-46ef-b0fa-44b4af321bea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:17.246192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d42d490d-82c0-46ef-b0fa-44b4af321bea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:17.246967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d42d490d-82c0-46ef-b0fa-44b4af321bea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:17.247402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d42d490d-82c0-46ef-b0fa-44b4af321bea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:17.513758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:54:17.516726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e4c55558-1197-4e5b-b933-fa796fe41426',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2f7fc6ce-7b24-4985-b9be-7db9acb7192d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6853906b-7a78-41d3-a67d-a171a9dadda5',volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:54:18.163604 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-253a1fda-51f0-4a8f-bc40-847b4f2b3600 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.977625 Jul 26 19:54:18.164319 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1284/2543] 10.222.0.58 () {62 vars in 1189 bytes} [Tue Jul 26 19:54:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 7979 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 19:54:18.406640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a6da342f-6d81-44ff-ae38-8c2cf407d254 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Action: 'create', calling method: .version_select at 0x7f875f249700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2095749359", "metadata": {"Type": "work"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:18.744928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d42d490d-82c0-46ef-b0fa-44b4af321bea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:18.762542 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d42d490d-82c0-46ef-b0fa-44b4af321bea tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1211 microversion: 2.1 time: 1.911311 Jul 26 19:54:18.763135 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1260/2544] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:16 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1211 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:18.773634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-338b73cf-e95f-4cd4-b8ba-32c5833453e1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:18.776147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-338b73cf-e95f-4cd4-b8ba-32c5833453e1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:18.796246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-338b73cf-e95f-4cd4-b8ba-32c5833453e1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:18.796917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-338b73cf-e95f-4cd4-b8ba-32c5833453e1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:18.797870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-338b73cf-e95f-4cd4-b8ba-32c5833453e1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:18.798461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-338b73cf-e95f-4cd4-b8ba-32c5833453e1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:18.986862 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a6da342f-6d81-44ff-ae38-8c2cf407d254 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.821279 Jul 26 19:54:18.987843 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1285/2545] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Jul 26 19:54:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 823 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 19:54:18.995454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1d5cf424-6dc2-4ad3-87c7-7b6176cdc12a req-5d4a3779-44b7-414c-be65-ce4b3da05e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc3bf14-61a5-413c-ad32-4c9ad235303c", "name": "network-vif-unplugged", "status": "completed", "tag": "dbf289a8-a47c-4167-811b-3b049fa5db7f"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:19.026690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1d5cf424-6dc2-4ad3-87c7-7b6176cdc12a req-5d4a3779-44b7-414c-be65-ce4b3da05e1d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:19.026994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1d5cf424-6dc2-4ad3-87c7-7b6176cdc12a req-5d4a3779-44b7-414c-be65-ce4b3da05e1d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:19.072068 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1d5cf424-6dc2-4ad3-87c7-7b6176cdc12a req-5d4a3779-44b7-414c-be65-ce4b3da05e1d service nova] Creating event network-vif-unplugged:dbf289a8-a47c-4167-811b-3b049fa5db7f for instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c on n-h2-708768-8 Jul 26 19:54:19.091796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-1d5cf424-6dc2-4ad3-87c7-7b6176cdc12a req-5d4a3779-44b7-414c-be65-ce4b3da05e1d service nova] Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:54:19.142067 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1d5cf424-6dc2-4ad3-87c7-7b6176cdc12a req-5d4a3779-44b7-414c-be65-ce4b3da05e1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150592 Jul 26 19:54:19.142721 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1286/2546] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:19.160162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ec59710-5eb8-4148-bd81-8247b537ba1c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:19.162004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8ec59710-5eb8-4148-bd81-8247b537ba1c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:19.181376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ec59710-5eb8-4148-bd81-8247b537ba1c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:19.182599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ec59710-5eb8-4148-bd81-8247b537ba1c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:19.183920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ec59710-5eb8-4148-bd81-8247b537ba1c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:19.187389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ec59710-5eb8-4148-bd81-8247b537ba1c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:19.368909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-338b73cf-e95f-4cd4-b8ba-32c5833453e1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:19.378514 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-338b73cf-e95f-4cd4-b8ba-32c5833453e1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1311 microversion: 2.1 time: 0.613997 Jul 26 19:54:19.380459 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1261/2547] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:18 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1311 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:19.392309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c13e0662-a6d7-4f6c-a746-dbabffeffeeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:19.394561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c13e0662-a6d7-4f6c-a746-dbabffeffeeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:19.530745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8ec59710-5eb8-4148-bd81-8247b537ba1c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:19.544118 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8ec59710-5eb8-4148-bd81-8247b537ba1c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1472 microversion: 2.1 time: 0.399555 Jul 26 19:54:19.548047 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1287/2548] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:19 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:19.566423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6e094ceb-492e-4824-9f2b-633f2a1d0855 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Calling method '.version_select at 0x7f875eef1dc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:19.599026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c13e0662-a6d7-4f6c-a746-dbabffeffeeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:19.618458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c13e0662-a6d7-4f6c-a746-dbabffeffeeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:19.623114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c13e0662-a6d7-4f6c-a746-dbabffeffeeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:19.626797 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c13e0662-a6d7-4f6c-a746-dbabffeffeeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1283 microversion: 2.42 time: 0.242930 Jul 26 19:54:19.631418 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1262/2549] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:19 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1283 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:19.640044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0d640ae4-84ef-4736-9c08-216c79b078fd req-2603659c-d975-4bca-8cc9-f39ea9448952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a506c0f-7d8b-4671-9667-185ede749851", "tag": "f57edbd3-22f4-4ba5-a486-93b6bb48d154"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:19.668492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0d640ae4-84ef-4736-9c08-216c79b078fd req-2603659c-d975-4bca-8cc9-f39ea9448952 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:19.668492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0d640ae4-84ef-4736-9c08-216c79b078fd req-2603659c-d975-4bca-8cc9-f39ea9448952 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:19.698693 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0d640ae4-84ef-4736-9c08-216c79b078fd req-2603659c-d975-4bca-8cc9-f39ea9448952 service nova] Creating event network-changed:f57edbd3-22f4-4ba5-a486-93b6bb48d154 for instance 1a506c0f-7d8b-4671-9667-185ede749851 on n-h2-708768-8 Jul 26 19:54:19.712030 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0d640ae4-84ef-4736-9c08-216c79b078fd req-2603659c-d975-4bca-8cc9-f39ea9448952 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077607 Jul 26 19:54:19.714307 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1263/2550] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:19.741714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6e094ceb-492e-4824-9f2b-633f2a1d0855 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156" status: 200 len: 353 microversion: 2.1 time: 0.179427 Jul 26 19:54:19.742387 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1288/2551] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:54:19 2022] GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156 => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:19.790315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66217494-f67a-4ee3-93dd-e9fd7a2b91d1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:19.791001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66217494-f67a-4ee3-93dd-e9fd7a2b91d1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:19.812358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66217494-f67a-4ee3-93dd-e9fd7a2b91d1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:19.819799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66217494-f67a-4ee3-93dd-e9fd7a2b91d1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:19.820862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66217494-f67a-4ee3-93dd-e9fd7a2b91d1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:19.831588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66217494-f67a-4ee3-93dd-e9fd7a2b91d1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:20.400341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f06dfdb7-4f6f-4d88-b74e-2559ccbf77a2 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:20.400956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f06dfdb7-4f6f-4d88-b74e-2559ccbf77a2 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:20.416057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f06dfdb7-4f6f-4d88-b74e-2559ccbf77a2 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:20.416499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f06dfdb7-4f6f-4d88-b74e-2559ccbf77a2 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:20.417278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f06dfdb7-4f6f-4d88-b74e-2559ccbf77a2 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:20.417713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f06dfdb7-4f6f-4d88-b74e-2559ccbf77a2 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:20.775421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-66217494-f67a-4ee3-93dd-e9fd7a2b91d1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:20.809733 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66217494-f67a-4ee3-93dd-e9fd7a2b91d1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1199 microversion: 2.1 time: 1.023484 Jul 26 19:54:20.819071 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1264/2552] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:19 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1199 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:54:20.842569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ae7f2977-166b-4361-954e-f3c8595b6188 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:20.844382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ae7f2977-166b-4361-954e-f3c8595b6188 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:20.882495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae7f2977-166b-4361-954e-f3c8595b6188 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:20.882955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae7f2977-166b-4361-954e-f3c8595b6188 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:20.884024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae7f2977-166b-4361-954e-f3c8595b6188 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:20.884992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae7f2977-166b-4361-954e-f3c8595b6188 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:21.189163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f06dfdb7-4f6f-4d88-b74e-2559ccbf77a2 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:21.204413 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f06dfdb7-4f6f-4d88-b74e-2559ccbf77a2 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1332 microversion: 2.1 time: 0.807962 Jul 26 19:54:21.222249 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1289/2553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:20 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1332 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:21.229525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:21.230234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:21.241448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:21.243681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:21.252461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:21.253063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:21.374376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae7f2977-166b-4361-954e-f3c8595b6188 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:21.388105 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ae7f2977-166b-4361-954e-f3c8595b6188 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1469 microversion: 2.1 time: 0.567046 Jul 26 19:54:21.409799 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1265/2554] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:20 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1469 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:21.436000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99d1d74b-bc79-4208-b7d7-a879f9bbab12 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Calling method '.version_select at 0x7f87683acca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:21.540763 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-99d1d74b-bc79-4208-b7d7-a879f9bbab12 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156" status: 200 len: 354 microversion: 2.1 time: 0.127992 Jul 26 19:54:21.541672 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1266/2555] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:54:21 2022] GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156 => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:21.547289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e704ae96-46b8-4f67-9b23-c7b9870a484c req-a2982526-10d4-454d-91f0-5074974685f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc3bf14-61a5-413c-ad32-4c9ad235303c", "tag": "dbf289a8-a47c-4167-811b-3b049fa5db7f"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:21.584579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e704ae96-46b8-4f67-9b23-c7b9870a484c req-a2982526-10d4-454d-91f0-5074974685f4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:21.584792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e704ae96-46b8-4f67-9b23-c7b9870a484c req-a2982526-10d4-454d-91f0-5074974685f4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:21.619974 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e704ae96-46b8-4f67-9b23-c7b9870a484c req-a2982526-10d4-454d-91f0-5074974685f4 service nova] Creating event network-changed:dbf289a8-a47c-4167-811b-3b049fa5db7f for instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c on n-h2-708768-8 Jul 26 19:54:21.646697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-e704ae96-46b8-4f67-9b23-c7b9870a484c req-a2982526-10d4-454d-91f0-5074974685f4 service nova] Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:54:21.673657 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e704ae96-46b8-4f67-9b23-c7b9870a484c req-a2982526-10d4-454d-91f0-5074974685f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130336 Jul 26 19:54:21.688853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1267/2556] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:21.707321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-459b83a0-da4d-48d1-9783-e5ee0d8a10e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:21.708397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-459b83a0-da4d-48d1-9783-e5ee0d8a10e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:21.732103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-459b83a0-da4d-48d1-9783-e5ee0d8a10e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:21.735855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-459b83a0-da4d-48d1-9783-e5ee0d8a10e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:21.737119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-459b83a0-da4d-48d1-9783-e5ee0d8a10e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:21.737699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-459b83a0-da4d-48d1-9783-e5ee0d8a10e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:21.904441 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-459b83a0-da4d-48d1-9783-e5ee0d8a10e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c/action" status: 204 len: 0 microversion: 2.1 time: 0.213275 Jul 26 19:54:21.917397 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1268/2557] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:54:21 2022] POST /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c/action => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:54:21.940206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34141ddc-1237-409e-8b55-54b938b4abb2 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Calling method '.version_select at 0x7f8756fe8040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:22.057742 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34141ddc-1237-409e-8b55-54b938b4abb2 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156" status: 200 len: 354 microversion: 2.1 time: 0.138744 Jul 26 19:54:22.058700 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1269/2558] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:54:21 2022] GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156 => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:22.151139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:22.169698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:22.171698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:22.173797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d6324071-519b-4ec5-8500-cd36af0b6082 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1591 microversion: 2.42 time: 0.962560 Jul 26 19:54:22.175768 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1290/2559] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:21 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1591 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:22.198630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a085928f-6321-4d28-845b-7a6af0018ecb req-e6710ada-cb5a-4353-973e-e30cd2e25577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f809b93-6a29-4300-8ed5-d02bd3b8f158", "tag": "ae4ca5b7-137d-47f2-a766-8a77b84b61ef"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:22.219286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a085928f-6321-4d28-845b-7a6af0018ecb req-e6710ada-cb5a-4353-973e-e30cd2e25577 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:22.221886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a085928f-6321-4d28-845b-7a6af0018ecb req-e6710ada-cb5a-4353-973e-e30cd2e25577 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:22.258074 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a085928f-6321-4d28-845b-7a6af0018ecb req-e6710ada-cb5a-4353-973e-e30cd2e25577 service nova] Creating event network-changed:ae4ca5b7-137d-47f2-a766-8a77b84b61ef for instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 on n-h2-708768-8 Jul 26 19:54:22.265643 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a085928f-6321-4d28-845b-7a6af0018ecb req-e6710ada-cb5a-4353-973e-e30cd2e25577 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087286 Jul 26 19:54:22.267146 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1291/2560] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:22.274510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a58dc735-992d-4e71-9137-e5277cafb531 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:22.275504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a58dc735-992d-4e71-9137-e5277cafb531 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:22.283814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a58dc735-992d-4e71-9137-e5277cafb531 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:22.284610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a58dc735-992d-4e71-9137-e5277cafb531 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:22.285656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a58dc735-992d-4e71-9137-e5277cafb531 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:22.286467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a58dc735-992d-4e71-9137-e5277cafb531 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:22.325006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f7e4b2d-57d5-4331-bd7e-66730167adc9 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Action: 'create', calling method: .version_select at 0x7f8756fa78b0>, body: {"pool": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:24.221684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a58dc735-992d-4e71-9137-e5277cafb531 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:24.235520 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a58dc735-992d-4e71-9137-e5277cafb531 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1199 microversion: 2.1 time: 1.966855 Jul 26 19:54:24.239652 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1292/2561] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:22 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1199 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:24.252687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8bd5d9d8-8929-4dc8-a3ba-4b1823670727 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:24.253590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8bd5d9d8-8929-4dc8-a3ba-4b1823670727 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:24.275430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bd5d9d8-8929-4dc8-a3ba-4b1823670727 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:24.276707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bd5d9d8-8929-4dc8-a3ba-4b1823670727 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:24.280970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bd5d9d8-8929-4dc8-a3ba-4b1823670727 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:24.282279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bd5d9d8-8929-4dc8-a3ba-4b1823670727 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:24.571492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8bd5d9d8-8929-4dc8-a3ba-4b1823670727 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:24.591133 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8bd5d9d8-8929-4dc8-a3ba-4b1823670727 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1469 microversion: 2.1 time: 0.349077 Jul 26 19:54:24.595188 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1293/2562] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:24 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:24.601538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:24.616404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7679f56-6281-4292-a2ec-1d3f3193b938 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Calling method '.version_select at 0x7f875eef1310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:24.739843 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c7679f56-6281-4292-a2ec-1d3f3193b938 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156" status: 202 len: 0 microversion: 2.1 time: 0.143417 Jul 26 19:54:24.740429 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1294/2563] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 19:54:24 2022] DELETE /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:54:24.753288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e9dab4a8-b3c0-4715-81ac-f329679e0a06 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:24.755332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e9dab4a8-b3c0-4715-81ac-f329679e0a06 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:24.788433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9dab4a8-b3c0-4715-81ac-f329679e0a06 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:24.789584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9dab4a8-b3c0-4715-81ac-f329679e0a06 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:24.797580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9dab4a8-b3c0-4715-81ac-f329679e0a06 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:24.798415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9dab4a8-b3c0-4715-81ac-f329679e0a06 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:25.664961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e9dab4a8-b3c0-4715-81ac-f329679e0a06 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:25.683955 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e9dab4a8-b3c0-4715-81ac-f329679e0a06 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.938689 Jul 26 19:54:25.687689 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1295/2564] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:24 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:25.705521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:25.746057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:25.773559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:25.776466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:25.779427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:25.782619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:26.108021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:26.119392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:26.132509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:26.133740 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3569bb02-79a5-4c25-87ba-5fbac5875bbf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1591 microversion: 2.42 time: 0.443217 Jul 26 19:54:26.134317 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1296/2565] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:25 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1591 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:26.173461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2f48a13d-7356-4dd6-9cab-a46d2b85f3a3 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Calling method '.version_select at 0x7f875eef1940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:26.281560 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2f48a13d-7356-4dd6-9cab-a46d2b85f3a3 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156" status: 200 len: 353 microversion: 2.1 time: 0.133574 Jul 26 19:54:26.283759 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1297/2566] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:54:26 2022] GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:26.290850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5b4d7158-b75f-4d2d-9df3-52dfe53109b4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:26.297593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5b4d7158-b75f-4d2d-9df3-52dfe53109b4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:26.308657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4d7158-b75f-4d2d-9df3-52dfe53109b4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:26.309104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4d7158-b75f-4d2d-9df3-52dfe53109b4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:26.309898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4d7158-b75f-4d2d-9df3-52dfe53109b4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:26.310344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4d7158-b75f-4d2d-9df3-52dfe53109b4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:26.791970 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f7e4b2d-57d5-4331-bd7e-66730167adc9 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.732017 Jul 26 19:54:26.793950 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1270/2567] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:54:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:26.799965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0e505a12-3801-48dc-b99c-543242e1786d req-0d09be3e-8830-4476-8d9a-b543498d59d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc3bf14-61a5-413c-ad32-4c9ad235303c", "name": "network-vif-plugged", "status": "completed", "tag": "dbf289a8-a47c-4167-811b-3b049fa5db7f"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:26.845714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0e505a12-3801-48dc-b99c-543242e1786d req-0d09be3e-8830-4476-8d9a-b543498d59d6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:26.854954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0e505a12-3801-48dc-b99c-543242e1786d req-0d09be3e-8830-4476-8d9a-b543498d59d6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:26.909131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5b4d7158-b75f-4d2d-9df3-52dfe53109b4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:26.914436 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0e505a12-3801-48dc-b99c-543242e1786d req-0d09be3e-8830-4476-8d9a-b543498d59d6 service nova] Creating event network-vif-plugged:dbf289a8-a47c-4167-811b-3b049fa5db7f for instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c on n-h2-708768-8 Jul 26 19:54:26.916423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:26.919679 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5b4d7158-b75f-4d2d-9df3-52dfe53109b4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1199 microversion: 2.1 time: 0.634716 Jul 26 19:54:26.926845 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1298/2568] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:26 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1199 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:26.931810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa5e0ffb-67ed-4709-b6bf-6111e9616b7b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:26.944562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fa5e0ffb-67ed-4709-b6bf-6111e9616b7b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:26.949686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-0e505a12-3801-48dc-b99c-543242e1786d req-0d09be3e-8830-4476-8d9a-b543498d59d6 service nova] Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:54:26.969551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa5e0ffb-67ed-4709-b6bf-6111e9616b7b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:26.970003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa5e0ffb-67ed-4709-b6bf-6111e9616b7b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:26.970801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa5e0ffb-67ed-4709-b6bf-6111e9616b7b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:26.971242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa5e0ffb-67ed-4709-b6bf-6111e9616b7b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:26.983507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0e505a12-3801-48dc-b99c-543242e1786d req-0d09be3e-8830-4476-8d9a-b543498d59d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188098 Jul 26 19:54:26.993298 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1271/2569] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:27.004860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-660ac761-aa71-458f-bf5f-04403f950f58 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:27.008720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-660ac761-aa71-458f-bf5f-04403f950f58 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:27.026758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-660ac761-aa71-458f-bf5f-04403f950f58 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:27.027458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-660ac761-aa71-458f-bf5f-04403f950f58 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:27.029459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-660ac761-aa71-458f-bf5f-04403f950f58 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:27.030592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-660ac761-aa71-458f-bf5f-04403f950f58 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:27.201666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:27.255105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:27.388784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-660ac761-aa71-458f-bf5f-04403f950f58 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:27.400459 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-660ac761-aa71-458f-bf5f-04403f950f58 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.405570 Jul 26 19:54:27.401316 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1272/2570] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:26 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:27.425177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b1810ae0-5174-4364-8f0e-e98774ff9621 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Action: 'create', calling method: .version_select at 0x7f87570aaee0>, body: {"pool": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:27.900276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fa5e0ffb-67ed-4709-b6bf-6111e9616b7b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:27.920402 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa5e0ffb-67ed-4709-b6bf-6111e9616b7b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1469 microversion: 2.1 time: 0.992436 Jul 26 19:54:27.927673 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1299/2571] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:26 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1469 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:27.932799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:27.944732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:27.966367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:27.969288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:27.971748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:27.973903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:28.784623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:28.798010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:28.799848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:28.801945 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bf0bcda7-ff33-4774-8c42-599065543bd0 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1659 microversion: 2.42 time: 0.873035 Jul 26 19:54:28.803020 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1300/2572] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:27 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1659 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:28.808701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26108528-bba2-485e-bf49-1e044d185a36 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Calling method '.version_select at 0x7f876471ea60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:28.855287 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-26108528-bba2-485e-bf49-1e044d185a36 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] HTTP exception thrown: Volume 64d76089-f78e-4cef-b6e8-f058062f7156 could not be found. Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26108528-bba2-485e-bf49-1e044d185a36 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Request method failure captured: Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156 HTTP/1.1 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EZkIhizZWBAgHXaY2i8uYziAgSikQVu-dE09IV9gpHZMxwR2CB6LkXuoJBlC9FbVHgflJJClgCDiZjBjwuFjkcfGE61ZDQjE3sQEJjIicRFs07kOJgPRgqnmmFQiHTJlVRqUdf5fMKlUYSPQba5eE5XrVczaE1s8figWx1wW9VtJWA Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: dade3d978ba54114a8ef461cc69b00d6 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesGetTestJSON-1753848391 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dade3d978ba54114a8ef461cc69b00d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dade3d978ba54114a8ef461cc69b00d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dade3d978ba54114a8ef461cc69b00d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dade3d978ba54114a8ef461cc69b00d6"}]}] Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesGetTestJSON-1753848391 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: dade3d978ba54114a8ef461cc69b00d6 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesGetTestJSON-1753848391 Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesGetTestJSON-1753848391-project Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9d01901659224fec9b2a79acc638c4ec Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesGetTestJSON-1753848391-project Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: exception: Volume 64d76089-f78e-4cef-b6e8-f058062f7156 could not be found. Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '64d76089-f78e-4cef-b6e8-f058062f7156'} Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64d76089-f78e-4cef-b6e8-f058062f7156 could not be found. (HTTP 404) (Request-ID: req-b1c2b01d-1b01-4d58-8404-da052953a3a2) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:54:28.857508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64d76089-f78e-4cef-b6e8-f058062f7156 could not be found. Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64d76089-f78e-4cef-b6e8-f058062f7156 could not be found. Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64d76089-f78e-4cef-b6e8-f058062f7156 could not be found. Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:54:28.861820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26108528-bba2-485e-bf49-1e044d185a36 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] Returning 404 to user: Volume 64d76089-f78e-4cef-b6e8-f058062f7156 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:54:28.866746 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26108528-bba2-485e-bf49-1e044d185a36 tempest-VolumesGetTestJSON-1753848391 tempest-VolumesGetTestJSON-1753848391-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156" status: 404 len: 109 microversion: 2.1 time: 0.054409 Jul 26 19:54:28.866746 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1301/2573] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:54:28 2022] GET /compute/v2.1/os-volumes/64d76089-f78e-4cef-b6e8-f058062f7156 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:54:28.880885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8742e7e0-9864-4063-b117-1ddbaddb3f66 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:28.884427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8742e7e0-9864-4063-b117-1ddbaddb3f66 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:28.903208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8742e7e0-9864-4063-b117-1ddbaddb3f66 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:28.903208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8742e7e0-9864-4063-b117-1ddbaddb3f66 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:28.904102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8742e7e0-9864-4063-b117-1ddbaddb3f66 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:28.904724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8742e7e0-9864-4063-b117-1ddbaddb3f66 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:29.607202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=16 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:29.803751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8742e7e0-9864-4063-b117-1ddbaddb3f66 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:29.817256 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8742e7e0-9864-4063-b117-1ddbaddb3f66 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1199 microversion: 2.1 time: 0.945358 Jul 26 19:54:29.818180 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1302/2574] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:28 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1199 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:29.825207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d5ccceb-9eca-49c5-9ca0-d04468c6cb22 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:29.829839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d5ccceb-9eca-49c5-9ca0-d04468c6cb22 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:29.842028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d5ccceb-9eca-49c5-9ca0-d04468c6cb22 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:29.843883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d5ccceb-9eca-49c5-9ca0-d04468c6cb22 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:29.844862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d5ccceb-9eca-49c5-9ca0-d04468c6cb22 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:29.848711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d5ccceb-9eca-49c5-9ca0-d04468c6cb22 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:30.333792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4d5ccceb-9eca-49c5-9ca0-d04468c6cb22 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:30.349072 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d5ccceb-9eca-49c5-9ca0-d04468c6cb22 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.529621 Jul 26 19:54:30.352516 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1303/2575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:29 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:30.370433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c9d29bc-faa4-41fc-881e-2be6b293c280 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:30.371518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8c9d29bc-faa4-41fc-881e-2be6b293c280 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:30.385499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d29bc-faa4-41fc-881e-2be6b293c280 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:30.388468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d29bc-faa4-41fc-881e-2be6b293c280 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:30.395824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d29bc-faa4-41fc-881e-2be6b293c280 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:30.396378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d29bc-faa4-41fc-881e-2be6b293c280 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:31.536979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8c9d29bc-faa4-41fc-881e-2be6b293c280 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:31.544933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c9d29bc-faa4-41fc-881e-2be6b293c280 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1461 microversion: 2.1 time: 1.190859 Jul 26 19:54:31.551696 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1304/2576] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:30 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1461 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:31.565134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-56f66279-d947-4735-9737-3b17c07de771 req-4709a66a-8e1f-4981-a3dd-d016339d447f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "tag": "c320e0cd-424d-463e-97f7-0b0006512f2a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:31.622867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-56f66279-d947-4735-9737-3b17c07de771 req-4709a66a-8e1f-4981-a3dd-d016339d447f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:31.623367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-56f66279-d947-4735-9737-3b17c07de771 req-4709a66a-8e1f-4981-a3dd-d016339d447f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:31.667085 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-56f66279-d947-4735-9737-3b17c07de771 req-4709a66a-8e1f-4981-a3dd-d016339d447f service nova] Creating event network-changed:c320e0cd-424d-463e-97f7-0b0006512f2a for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:54:31.677744 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-56f66279-d947-4735-9737-3b17c07de771 req-4709a66a-8e1f-4981-a3dd-d016339d447f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123808 Jul 26 19:54:31.678863 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1305/2577] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:31.694611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:31.701954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:31.711224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:31.711999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:31.712978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:31.713562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:32.054724 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b1810ae0-5174-4364-8f0e-e98774ff9621 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.635741 Jul 26 19:54:32.062785 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1273/2578] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:54:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:32.069085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-891be315-0f7d-4fc7-88c9-7d434b84105e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:32.070201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-891be315-0f7d-4fc7-88c9-7d434b84105e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:32.090635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-891be315-0f7d-4fc7-88c9-7d434b84105e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:32.091358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-891be315-0f7d-4fc7-88c9-7d434b84105e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:32.092474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-891be315-0f7d-4fc7-88c9-7d434b84105e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:32.093215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-891be315-0f7d-4fc7-88c9-7d434b84105e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:32.096111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:32.344560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-891be315-0f7d-4fc7-88c9-7d434b84105e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:32.354787 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-891be315-0f7d-4fc7-88c9-7d434b84105e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1199 microversion: 2.1 time: 0.290378 Jul 26 19:54:32.355713 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1274/2579] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:32 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1199 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:32.369269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68a7594f-d8be-4ed7-9f42-94c54f270a63 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:32.370128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68a7594f-d8be-4ed7-9f42-94c54f270a63 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:32.385530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68a7594f-d8be-4ed7-9f42-94c54f270a63 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:32.387137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68a7594f-d8be-4ed7-9f42-94c54f270a63 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:32.388323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68a7594f-d8be-4ed7-9f42-94c54f270a63 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:32.388927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68a7594f-d8be-4ed7-9f42-94c54f270a63 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:32.550957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:32.565899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:32.577028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:32.579596 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-43fdaa09-a24c-4750-8bf3-c0f27356e96c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1706 microversion: 2.42 time: 0.896246 Jul 26 19:54:32.581556 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1306/2580] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:31 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1706 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:32.587078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3e06d95-b68e-45c9-a1cf-9836f9a2f0d3 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:32.592958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b3e06d95-b68e-45c9-a1cf-9836f9a2f0d3 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:32.605676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3e06d95-b68e-45c9-a1cf-9836f9a2f0d3 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:32.612368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3e06d95-b68e-45c9-a1cf-9836f9a2f0d3 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:32.613347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3e06d95-b68e-45c9-a1cf-9836f9a2f0d3 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:32.613989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b3e06d95-b68e-45c9-a1cf-9836f9a2f0d3 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:32.767337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68a7594f-d8be-4ed7-9f42-94c54f270a63 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:32.781279 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68a7594f-d8be-4ed7-9f42-94c54f270a63 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.424150 Jul 26 19:54:32.784547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1275/2581] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:32 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:32.805649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c36a2951-aed5-4b16-8a20-a39f80b251f8 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Action: 'create', calling method: .version_select at 0x7f8756fbf0d0>, body: {"pool": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:33.334386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3e06d95-b68e-45c9-a1cf-9836f9a2f0d3 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1612 microversion: 2.1 time: 0.748150 Jul 26 19:54:33.335139 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1307/2582] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:32 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1612 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:33.349571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-10c61ed2-9dbc-4df3-9c4e-b286cc9a6d6a req-b688dddd-46aa-419c-8fb3-0d04a59a08b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f809b93-6a29-4300-8ed5-d02bd3b8f158", "name": "network-vif-plugged", "status": "completed", "tag": "ae4ca5b7-137d-47f2-a766-8a77b84b61ef"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:33.374445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-10c61ed2-9dbc-4df3-9c4e-b286cc9a6d6a req-b688dddd-46aa-419c-8fb3-0d04a59a08b2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:33.375047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-10c61ed2-9dbc-4df3-9c4e-b286cc9a6d6a req-b688dddd-46aa-419c-8fb3-0d04a59a08b2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:33.401919 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-10c61ed2-9dbc-4df3-9c4e-b286cc9a6d6a req-b688dddd-46aa-419c-8fb3-0d04a59a08b2 service nova] Creating event network-vif-plugged:ae4ca5b7-137d-47f2-a766-8a77b84b61ef for instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 on n-h2-708768-8 Jul 26 19:54:33.423879 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-10c61ed2-9dbc-4df3-9c4e-b286cc9a6d6a req-b688dddd-46aa-419c-8fb3-0d04a59a08b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085761 Jul 26 19:54:33.427294 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1308/2583] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:33.432757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-190ac091-2f05-4dbd-8e3e-20779d70165d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '.version_select at 0x7f875f2b9f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:33.449723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-190ac091-2f05-4dbd-8e3e-20779d70165d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:33.456517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-190ac091-2f05-4dbd-8e3e-20779d70165d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:33.491931 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-190ac091-2f05-4dbd-8e3e-20779d70165d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1561 microversion: 2.1 time: 0.063003 Jul 26 19:54:33.492932 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1309/2584] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:54:33 2022] GET /compute/v2.1/os-migrations => generated 1561 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:33.497759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e51a33a0-79e8-4fb4-9aab-e75ef5eef57a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:33.514825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e51a33a0-79e8-4fb4-9aab-e75ef5eef57a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:33.536822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e51a33a0-79e8-4fb4-9aab-e75ef5eef57a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:33.537680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e51a33a0-79e8-4fb4-9aab-e75ef5eef57a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:33.538705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e51a33a0-79e8-4fb4-9aab-e75ef5eef57a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:33.539362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e51a33a0-79e8-4fb4-9aab-e75ef5eef57a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:34.211181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e51a33a0-79e8-4fb4-9aab-e75ef5eef57a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:34.224277 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e51a33a0-79e8-4fb4-9aab-e75ef5eef57a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1199 microversion: 2.1 time: 0.730063 Jul 26 19:54:34.232006 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1310/2585] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:33 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1199 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:34.243262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:34.249516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:34.281145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:34.281610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:34.282439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:34.282889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:34.972055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:34.985621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:34.987157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:34.993289 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ebd576e-624f-415d-92b4-c2576e598815 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1706 microversion: 2.42 time: 0.753760 Jul 26 19:54:34.995921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1311/2586] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:34 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1706 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:35.000746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-278905175", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:35.127560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:54:35.916208 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c36a2951-aed5-4b16-8a20-a39f80b251f8 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.129138 Jul 26 19:54:35.917345 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1276/2587] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:54:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:35.922001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c0f02c0-33f8-48d8-96db-caa919dea0fa tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:35.922812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0c0f02c0-33f8-48d8-96db-caa919dea0fa tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:35.947325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c0f02c0-33f8-48d8-96db-caa919dea0fa tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:35.949597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c0f02c0-33f8-48d8-96db-caa919dea0fa tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:35.959920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c0f02c0-33f8-48d8-96db-caa919dea0fa tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:35.960677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c0f02c0-33f8-48d8-96db-caa919dea0fa tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:36.267855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0c0f02c0-33f8-48d8-96db-caa919dea0fa tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:36.276102 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0c0f02c0-33f8-48d8-96db-caa919dea0fa tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.357374 Jul 26 19:54:36.276912 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1277/2588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:35 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:36.281926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c920284c-6ee2-4dda-8e66-23a6522941c2 req-d5cee461-64be-4aed-a32d-13e9cb9c9c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "tag": "468b1583-8160-48b1-8a6f-27bf0aad771d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:36.307886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c920284c-6ee2-4dda-8e66-23a6522941c2 req-d5cee461-64be-4aed-a32d-13e9cb9c9c37 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:36.308545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c920284c-6ee2-4dda-8e66-23a6522941c2 req-d5cee461-64be-4aed-a32d-13e9cb9c9c37 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:36.324519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:54:36.325492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:54:36.326164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:54:36.326734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:54:36.327305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:54:36.352807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:36.353945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:36.356098 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c920284c-6ee2-4dda-8e66-23a6522941c2 req-d5cee461-64be-4aed-a32d-13e9cb9c9c37 service nova] Creating event network-changed:468b1583-8160-48b1-8a6f-27bf0aad771d for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:54:36.357176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:36.357786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:36.369099 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c920284c-6ee2-4dda-8e66-23a6522941c2 req-d5cee461-64be-4aed-a32d-13e9cb9c9c37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090763 Jul 26 19:54:36.372833 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1278/2589] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:36.413099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:54:36.419058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for user 146ecbca3664463ead84028d4add8b50 and project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:54:36.442911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:54:36.445340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:54:36.496894 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-421d9efb-d40c-4e0c-9639-6962e9fde5a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499440 Jul 26 19:54:36.498645 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1312/2590] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:54:36.512734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9363fa86-7026-4d95-be09-13e459a5de3f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:36.513439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9363fa86-7026-4d95-be09-13e459a5de3f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:36.531224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9363fa86-7026-4d95-be09-13e459a5de3f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:36.531742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9363fa86-7026-4d95-be09-13e459a5de3f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:36.533985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9363fa86-7026-4d95-be09-13e459a5de3f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:36.534507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9363fa86-7026-4d95-be09-13e459a5de3f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:36.760842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1258141535", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "3b063245-5ef6-406c-860d-aa6b9e8e85fe"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:36.852614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] validate_networks() for [('3b063245-5ef6-406c-860d-aa6b9e8e85fe', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:54:37.330832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9363fa86-7026-4d95-be09-13e459a5de3f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:37.348982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9363fa86-7026-4d95-be09-13e459a5de3f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1382 microversion: 2.1 time: 0.848967 Jul 26 19:54:37.351177 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1313/2591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:36 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1382 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:37.373603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f41a903e-ea2a-4188-96f3-b23d9261e5ea tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Action: 'create', calling method: .version_select at 0x7f875f12b3a0>, body: {"pool": null} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:37.872373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:54:37.878207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:54:37.879954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:54:37.881230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:54:37.881917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:54:37.909784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:37.910258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:37.913073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:37.914001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:37.947227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Getting quotas for project 139071656fc9488d9584fcd46fd02106. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:54:37.953350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Getting quotas for user 836a118c6207498895d022c853d99ac1 and project 139071656fc9488d9584fcd46fd02106. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:54:37.970829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:54:37.974135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:54:38.042541 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61348c7a-e674-4362-a112-e7a36572468a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.662591 Jul 26 19:54:38.043881 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1279/2592] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 19:54:38.050006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:38.051760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:38.062459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:38.063277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:38.064304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:38.064941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:38.391099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:38.406887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:38.409151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:38.417159 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bfb47663-a800-4567-be2c-2d7c6caba1a9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1753 microversion: 2.42 time: 0.365479 Jul 26 19:54:38.418005 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1280/2593] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:38 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1753 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:38.424965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-731c336d-3d2a-4aea-87aa-710dfe50fce7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:38.426593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-731c336d-3d2a-4aea-87aa-710dfe50fce7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:38.444489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-731c336d-3d2a-4aea-87aa-710dfe50fce7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:38.447634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-731c336d-3d2a-4aea-87aa-710dfe50fce7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:38.448800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-731c336d-3d2a-4aea-87aa-710dfe50fce7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:38.449626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-731c336d-3d2a-4aea-87aa-710dfe50fce7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:38.604311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-731c336d-3d2a-4aea-87aa-710dfe50fce7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:38.622585 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-731c336d-3d2a-4aea-87aa-710dfe50fce7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1282 microversion: 2.1 time: 0.203264 Jul 26 19:54:38.623202 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1281/2594] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:38 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:38.639700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6c1a8ca6-4476-4e28-8a0f-1b93cdddba80 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:38.644635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6c1a8ca6-4476-4e28-8a0f-1b93cdddba80 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:38.667323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c1a8ca6-4476-4e28-8a0f-1b93cdddba80 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:38.668193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c1a8ca6-4476-4e28-8a0f-1b93cdddba80 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:38.670639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c1a8ca6-4476-4e28-8a0f-1b93cdddba80 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:38.671302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c1a8ca6-4476-4e28-8a0f-1b93cdddba80 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:38.938432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c1a8ca6-4476-4e28-8a0f-1b93cdddba80 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:38.977424 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6c1a8ca6-4476-4e28-8a0f-1b93cdddba80 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.352283 Jul 26 19:54:38.980480 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1282/2595] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:38 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:38.991995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-18e41d51-a26c-4604-afb5-7f9842d08e12 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f8756e3f550>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:39.092454 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-18e41d51-a26c-4604-afb5-7f9842d08e12 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/0548c1b0-a6c7-48b2-8ec5-13279eeb0b30" status: 200 len: 350 microversion: 2.1 time: 0.110034 Jul 26 19:54:39.093048 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1283/2596] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:54:38 2022] GET /compute/v2.1/os-volumes/0548c1b0-a6c7-48b2-8ec5-13279eeb0b30 => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:39.348569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2d7a7760-3223-4438-9df6-06d284682332 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:39.349543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2d7a7760-3223-4438-9df6-06d284682332 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:39.367184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d7a7760-3223-4438-9df6-06d284682332 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:39.368255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d7a7760-3223-4438-9df6-06d284682332 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:39.369238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d7a7760-3223-4438-9df6-06d284682332 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:39.369861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d7a7760-3223-4438-9df6-06d284682332 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:39.672380 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2d7a7760-3223-4438-9df6-06d284682332 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1533 microversion: 2.1 time: 0.575428 Jul 26 19:54:39.677911 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1284/2597] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:39 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1533 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:39.691188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:39.704256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:39.721605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:39.722059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:39.723668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:39.732290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:39.877561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:39.890632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:39.911834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:39.913136 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-84b2ec85-4bfc-4a51-881f-930d60f7bbaa tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1322 microversion: 2.26 time: 0.225931 Jul 26 19:54:39.917985 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1285/2598] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:39 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:39.926976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6c414c63-dc30-4a3d-a45e-a2a6d7905505 req-d0216a6d-b7d2-4b85-9569-70fa7ff07cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "tag": "9b98fe98-507d-4281-a657-b217a61f93e8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:39.952182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6c414c63-dc30-4a3d-a45e-a2a6d7905505 req-d0216a6d-b7d2-4b85-9569-70fa7ff07cf1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:39.952824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6c414c63-dc30-4a3d-a45e-a2a6d7905505 req-d0216a6d-b7d2-4b85-9569-70fa7ff07cf1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:39.978544 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6c414c63-dc30-4a3d-a45e-a2a6d7905505 req-d0216a6d-b7d2-4b85-9569-70fa7ff07cf1 service nova] Creating event network-changed:9b98fe98-507d-4281-a657-b217a61f93e8 for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:54:39.984512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6c414c63-dc30-4a3d-a45e-a2a6d7905505 req-d0216a6d-b7d2-4b85-9569-70fa7ff07cf1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069107 Jul 26 19:54:39.985805 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1286/2599] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:39.992499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:39.993603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:40.002369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.003165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.004505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.005302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.203211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:40.215821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:40.217505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:40.218813 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dbac6700-2cd0-4955-8582-c2bc57cafa66 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1800 microversion: 2.42 time: 0.231670 Jul 26 19:54:40.219515 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1287/2600] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:39 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1800 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:40.225572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e1e58982-942d-48e7-9730-6991edd5fe04 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:40.226439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e1e58982-942d-48e7-9730-6991edd5fe04 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:40.241577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1e58982-942d-48e7-9730-6991edd5fe04 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.242395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1e58982-942d-48e7-9730-6991edd5fe04 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.243418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1e58982-942d-48e7-9730-6991edd5fe04 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.244083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1e58982-942d-48e7-9730-6991edd5fe04 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.318112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1e58982-942d-48e7-9730-6991edd5fe04 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:40.326995 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e1e58982-942d-48e7-9730-6991edd5fe04 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1270 microversion: 2.1 time: 0.105932 Jul 26 19:54:40.328205 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1288/2601] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:40 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:40.334266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9fdede7-de20-4409-bead-5c8bfb254e31 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:40.335320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9fdede7-de20-4409-bead-5c8bfb254e31 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:40.345329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9fdede7-de20-4409-bead-5c8bfb254e31 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.346034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9fdede7-de20-4409-bead-5c8bfb254e31 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.347009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9fdede7-de20-4409-bead-5c8bfb254e31 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.348294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9fdede7-de20-4409-bead-5c8bfb254e31 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.510343 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9fdede7-de20-4409-bead-5c8bfb254e31 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1533 microversion: 2.1 time: 0.180533 Jul 26 19:54:40.511156 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1289/2602] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:40 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1533 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:40.533515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5a86ab67-869d-419b-9676-4ff81ac540df tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:40.533800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a86ab67-869d-419b-9676-4ff81ac540df tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:40.540302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a86ab67-869d-419b-9676-4ff81ac540df tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.540919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a86ab67-869d-419b-9676-4ff81ac540df tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.541913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a86ab67-869d-419b-9676-4ff81ac540df tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.542320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a86ab67-869d-419b-9676-4ff81ac540df tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.794471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5a86ab67-869d-419b-9676-4ff81ac540df tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:40.802899 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5a86ab67-869d-419b-9676-4ff81ac540df tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.277540 Jul 26 19:54:40.803773 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1290/2603] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:40 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:40.819410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47c13ba5-6405-4279-a5e3-1e6ac98582b0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:40.823681 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:54:40.823681 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:54:40.830180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47c13ba5-6405-4279-a5e3-1e6ac98582b0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.831019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47c13ba5-6405-4279-a5e3-1e6ac98582b0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.832342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47c13ba5-6405-4279-a5e3-1e6ac98582b0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.833142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47c13ba5-6405-4279-a5e3-1e6ac98582b0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.867642 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47c13ba5-6405-4279-a5e3-1e6ac98582b0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062505 Jul 26 19:54:40.871656 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1291/2604] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 19:54:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:40.881191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-708768-8", "block_migration": false, "disk_over_commit": false}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:40.884385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:40.891000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.891376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.892180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:40.892609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:40.943510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lazy-loading 'flavor' on Instance uuid 6f809b93-6a29-4300-8ed5-d02bd3b8f158 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:54:40.960121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Going to try to live migrate instance to n-h1-708768-8 {{(pid=125964) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 19:54:43.571583 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f41a903e-ea2a-4188-96f3-b23d9261e5ea tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.213630 Jul 26 19:54:43.580189 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1314/2605] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:54:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:43.585312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:43.586011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:43.588156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:43.615684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:43.616439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:43.617453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:43.617869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:43.852259 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-25b9a498-fce5-45a5-8c3e-c4f8498b01a0 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158/action" status: 202 len: 0 microversion: 2.1 time: 2.975710 Jul 26 19:54:43.852912 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1292/2606] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:54:40 2022] POST /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158/action => generated 0 bytes in 2977 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:54:43.858609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:43.860185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:43.870152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:43.871341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:43.873784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:43.874374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:43.899259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:44.350031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:44.366551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:44.369195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:44.371807 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d28b9dc4-098c-49d2-9d36-356cf5c3bd56 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1362 microversion: 2.26 time: 0.790363 Jul 26 19:54:44.374115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1315/2607] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:43 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1362 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:44.381818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aaf684ca-2c5b-455d-9cd9-785eb4fd5b05 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:44.382904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aaf684ca-2c5b-455d-9cd9-785eb4fd5b05 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:44.391431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf684ca-2c5b-455d-9cd9-785eb4fd5b05 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:44.392276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf684ca-2c5b-455d-9cd9-785eb4fd5b05 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:44.393462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf684ca-2c5b-455d-9cd9-785eb4fd5b05 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:44.394681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf684ca-2c5b-455d-9cd9-785eb4fd5b05 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:44.514859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:44.529147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:44.530957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:44.532465 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e0bf0708-0668-4e8d-8619-1cd8aa74ac41 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1847 microversion: 2.42 time: 0.678098 Jul 26 19:54:44.533194 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1293/2608] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:43 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1847 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:44.553535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5c1cc243-fc6e-4962-813a-78e3116c11fe tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:44.555299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5c1cc243-fc6e-4962-813a-78e3116c11fe tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:44.562234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c1cc243-fc6e-4962-813a-78e3116c11fe tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:44.562911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c1cc243-fc6e-4962-813a-78e3116c11fe tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:44.566655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c1cc243-fc6e-4962-813a-78e3116c11fe tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:44.566655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c1cc243-fc6e-4962-813a-78e3116c11fe tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:44.695701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aaf684ca-2c5b-455d-9cd9-785eb4fd5b05 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:44.705356 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aaf684ca-2c5b-455d-9cd9-785eb4fd5b05 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1312 microversion: 2.1 time: 0.328707 Jul 26 19:54:44.711411 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1316/2609] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:44 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1312 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:44.726729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f2b468b4-017f-49c0-9247-0977146b04a2 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f875f12bf70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:44.758802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c1cc243-fc6e-4962-813a-78e3116c11fe tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:44.768494 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5c1cc243-fc6e-4962-813a-78e3116c11fe tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.219826 Jul 26 19:54:44.770214 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1294/2610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:44 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:44.775912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36d8ba0a-4add-441f-9e25-feb9a0c75b6c tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Calling method '.version_select at 0x7f8756f51310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:44.814013 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f2b468b4-017f-49c0-9247-0977146b04a2 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b979590a-347a-4195-b51c-f10a8a8bbe43" status: 200 len: 350 microversion: 2.1 time: 0.100255 Jul 26 19:54:44.815823 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1317/2611] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:54:44 2022] GET /compute/v2.1/os-volumes/b979590a-347a-4195-b51c-f10a8a8bbe43 => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:44.826456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc9b4f21-d549-43cb-a152-9a7aab337fe1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:44.827151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc9b4f21-d549-43cb-a152-9a7aab337fe1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:44.836943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc9b4f21-d549-43cb-a152-9a7aab337fe1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:44.837510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc9b4f21-d549-43cb-a152-9a7aab337fe1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:44.838353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc9b4f21-d549-43cb-a152-9a7aab337fe1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:44.838848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc9b4f21-d549-43cb-a152-9a7aab337fe1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:45.121470 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36d8ba0a-4add-441f-9e25-feb9a0c75b6c tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/a078775c-fcc4-4ac0-a8b5-bdf45edbbac0" status: 200 len: 142 microversion: 2.1 time: 0.348664 Jul 26 19:54:45.122949 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1295/2612] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 19:54:44 2022] GET /compute/v2.1/os-floating-ips/a078775c-fcc4-4ac0-a8b5-bdf45edbbac0 => generated 142 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:45.128913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-32938046-0b28-4585-b15e-607726c3f0cb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59da52b8-0fdf-42b0-adb4-d6a947969567"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:45.137066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-32938046-0b28-4585-b15e-607726c3f0cb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:45.146341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:45.148848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32938046-0b28-4585-b15e-607726c3f0cb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:45.149546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32938046-0b28-4585-b15e-607726c3f0cb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:45.150887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32938046-0b28-4585-b15e-607726c3f0cb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:45.151841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32938046-0b28-4585-b15e-607726c3f0cb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:45.440697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bc9b4f21-d549-43cb-a152-9a7aab337fe1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:45.449364 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc9b4f21-d549-43cb-a152-9a7aab337fe1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.632308 Jul 26 19:54:45.454988 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1318/2613] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:44 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:45.465227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7eb9b666-459d-4962-97fd-1bb6ef2075fc tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Calling method '.version_select at 0x7f87683e1820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:45.636900 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-32938046-0b28-4585-b15e-607726c3f0cb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.512281 Jul 26 19:54:45.640608 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1296/2614] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 19:54:45 2022] POST /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:45.677003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:45.679139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:45.696148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:45.699225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:45.700097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:45.700540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:46.387234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:46.396270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:46.413561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:46.418893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:46.422898 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2867f25d-012d-4740-a5d2-1f73db006a99 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1362 microversion: 2.26 time: 0.776589 Jul 26 19:54:46.426016 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1297/2615] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:45 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1362 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:46.433350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:46.437633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:46.437778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:46.454760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:46.455214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:46.456021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:46.456692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:46.746802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:46.763439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:46.765771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:46.767241 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a7c2d00b-0304-430f-89b8-3bb442082e47 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1847 microversion: 2.42 time: 0.339651 Jul 26 19:54:46.768523 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1298/2616] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:46 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1847 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:46.774779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a20d98a-43aa-4d8f-9d1c-147aa5b7ee5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:46.775588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1a20d98a-43aa-4d8f-9d1c-147aa5b7ee5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:46.785286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a20d98a-43aa-4d8f-9d1c-147aa5b7ee5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:46.786104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a20d98a-43aa-4d8f-9d1c-147aa5b7ee5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:46.787946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a20d98a-43aa-4d8f-9d1c-147aa5b7ee5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:46.788607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a20d98a-43aa-4d8f-9d1c-147aa5b7ee5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:46.977267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a20d98a-43aa-4d8f-9d1c-147aa5b7ee5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:46.987177 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a20d98a-43aa-4d8f-9d1c-147aa5b7ee5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1312 microversion: 2.1 time: 0.216390 Jul 26 19:54:46.988319 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1299/2617] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:46 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:47.006782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d8b55fc1-6eb4-447a-aa0c-1eeb70eb9019 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:47.007978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d8b55fc1-6eb4-447a-aa0c-1eeb70eb9019 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:47.019307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8b55fc1-6eb4-447a-aa0c-1eeb70eb9019 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:47.021102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8b55fc1-6eb4-447a-aa0c-1eeb70eb9019 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:47.022240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8b55fc1-6eb4-447a-aa0c-1eeb70eb9019 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:47.022878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8b55fc1-6eb4-447a-aa0c-1eeb70eb9019 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:47.293768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d8b55fc1-6eb4-447a-aa0c-1eeb70eb9019 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:47.308570 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d8b55fc1-6eb4-447a-aa0c-1eeb70eb9019 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.319065 Jul 26 19:54:47.310085 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1300/2618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:46 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:47.317588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-72c04bbe-504c-4852-b464-d7d5cfd5cb87 req-4fae614a-028d-42ea-94cc-902192433f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce31da0-9557-46b9-aa38-daa4aa549a5f", "tag": "452ba588-281e-4c62-ae46-9c77b1ae1774"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:47.333310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-72c04bbe-504c-4852-b464-d7d5cfd5cb87 req-4fae614a-028d-42ea-94cc-902192433f67 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:47.334271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-72c04bbe-504c-4852-b464-d7d5cfd5cb87 req-4fae614a-028d-42ea-94cc-902192433f67 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:47.351120 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-72c04bbe-504c-4852-b464-d7d5cfd5cb87 req-4fae614a-028d-42ea-94cc-902192433f67 service nova] Creating event network-changed:452ba588-281e-4c62-ae46-9c77b1ae1774 for instance dce31da0-9557-46b9-aa38-daa4aa549a5f on n-h1-708768-8 Jul 26 19:54:47.359089 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-72c04bbe-504c-4852-b464-d7d5cfd5cb87 req-4fae614a-028d-42ea-94cc-902192433f67 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047144 Jul 26 19:54:47.360186 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1301/2619] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:47.368306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-75b00092-1c19-4af9-9efb-ff3f1940a52b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:47.369336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-75b00092-1c19-4af9-9efb-ff3f1940a52b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:47.380042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75b00092-1c19-4af9-9efb-ff3f1940a52b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:47.381026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75b00092-1c19-4af9-9efb-ff3f1940a52b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:47.382561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75b00092-1c19-4af9-9efb-ff3f1940a52b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:47.383276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75b00092-1c19-4af9-9efb-ff3f1940a52b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:47.678974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-75b00092-1c19-4af9-9efb-ff3f1940a52b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:47.690423 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-75b00092-1c19-4af9-9efb-ff3f1940a52b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.328488 Jul 26 19:54:47.693128 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1302/2620] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:47 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:47.700376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-69a1228a-dc66-4b22-8f77-57eb26766a6b tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f8756e32550>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:47.963279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:48.197304 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7eb9b666-459d-4962-97fd-1bb6ef2075fc tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/a078775c-fcc4-4ac0-a8b5-bdf45edbbac0" status: 202 len: 0 microversion: 2.1 time: 2.741124 Jul 26 19:54:48.198458 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1319/2621] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:54:45 2022] DELETE /compute/v2.1/os-floating-ips/a078775c-fcc4-4ac0-a8b5-bdf45edbbac0 => generated 0 bytes in 2743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:54:48.205019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:48.205956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:48.214732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:48.215431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:48.216422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:48.217010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:48.858965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:48.872721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:48.874745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:48.876535 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-031bacf5-5da7-4b11-8fb2-8fc75766c108 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1362 microversion: 2.26 time: 0.676854 Jul 26 19:54:48.910325 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1320/2622] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:48 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1362 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:48.920614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:48.921719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:48.928750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:48.929463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:48.930651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:48.937356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:49.308549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:49.324851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:49.327042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:49.328479 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-704ce07b-b5a2-4b1d-a70a-ce8a994d5eeb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1835 microversion: 2.42 time: 0.411894 Jul 26 19:54:49.335203 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1321/2623] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:48 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1835 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:49.340161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-326303e7-cbed-4774-914f-35bb1405c7a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:49.347909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-326303e7-cbed-4774-914f-35bb1405c7a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:49.355283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-326303e7-cbed-4774-914f-35bb1405c7a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:49.356013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-326303e7-cbed-4774-914f-35bb1405c7a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:49.356980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-326303e7-cbed-4774-914f-35bb1405c7a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:49.357574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-326303e7-cbed-4774-914f-35bb1405c7a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:49.363393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:49.790702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-326303e7-cbed-4774-914f-35bb1405c7a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:49.802002 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-326303e7-cbed-4774-914f-35bb1405c7a5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1312 microversion: 2.1 time: 0.465371 Jul 26 19:54:49.805786 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1322/2624] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:49 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1312 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:49.819558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8a6cb10-09e5-49b2-936b-83617d1e4f21 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Calling method '.version_select at 0x7f875f249310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:50.191275 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8a6cb10-09e5-49b2-936b-83617d1e4f21 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.382379 Jul 26 19:54:50.199656 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1323/2625] 10.222.0.58 () {58 vars in 1164 bytes} [Tue Jul 26 19:54:49 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:54:50.199656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb8054a5-3aea-4856-8949-83940f40a950 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:50.199656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fb8054a5-3aea-4856-8949-83940f40a950 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:50.206347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb8054a5-3aea-4856-8949-83940f40a950 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:50.206810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb8054a5-3aea-4856-8949-83940f40a950 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:50.207588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb8054a5-3aea-4856-8949-83940f40a950 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:50.208047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb8054a5-3aea-4856-8949-83940f40a950 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:50.693043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fb8054a5-3aea-4856-8949-83940f40a950 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:50.700946 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fb8054a5-3aea-4856-8949-83940f40a950 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.507600 Jul 26 19:54:50.701611 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1324/2626] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:50 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:50.707034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc8ef0e2-ceb6-403d-b17c-fc86e8cb4af9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:50.707867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc8ef0e2-ceb6-403d-b17c-fc86e8cb4af9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:50.714156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc8ef0e2-ceb6-403d-b17c-fc86e8cb4af9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:50.714750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc8ef0e2-ceb6-403d-b17c-fc86e8cb4af9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:50.715788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc8ef0e2-ceb6-403d-b17c-fc86e8cb4af9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:50.716391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc8ef0e2-ceb6-403d-b17c-fc86e8cb4af9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:50.845101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:51.546491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc8ef0e2-ceb6-403d-b17c-fc86e8cb4af9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:51.554976 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc8ef0e2-ceb6-403d-b17c-fc86e8cb4af9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.852197 Jul 26 19:54:51.571206 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1325/2627] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:50 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:51.576360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-722c8297-736d-4c2b-b6a5-14d6a346b09c req-fc28d386-7147-44d4-ac55-f5ce6059923a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "tag": "0ad81dfc-1d62-45e5-844d-8e3f948affe9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:51.587011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-722c8297-736d-4c2b-b6a5-14d6a346b09c req-fc28d386-7147-44d4-ac55-f5ce6059923a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:51.587791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-722c8297-736d-4c2b-b6a5-14d6a346b09c req-fc28d386-7147-44d4-ac55-f5ce6059923a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:51.601089 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-722c8297-736d-4c2b-b6a5-14d6a346b09c req-fc28d386-7147-44d4-ac55-f5ce6059923a service nova] Creating event network-changed:0ad81dfc-1d62-45e5-844d-8e3f948affe9 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:54:51.623238 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-722c8297-736d-4c2b-b6a5-14d6a346b09c req-fc28d386-7147-44d4-ac55-f5ce6059923a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050331 Jul 26 19:54:51.624520 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1326/2628] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:51.630108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:51.632556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:51.639373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:51.640162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:51.641157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:51.641809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:52.011457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:52.030634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:52.032385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:52.033563 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c9086af-ffa7-4739-b8dc-c36d72ff305d tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1362 microversion: 2.26 time: 0.407752 Jul 26 19:54:52.036015 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1327/2629] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:51 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:52.044771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4c3d4fc0-e8ed-49f6-be8d-ccef092581f0 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Calling method '.version_select at 0x7f875eef1160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:52.501289 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4c3d4fc0-e8ed-49f6-be8d-ccef092581f0 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.463841 Jul 26 19:54:52.502017 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1328/2630] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Jul 26 19:54:52 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:52.506910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:52.507532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:52.516034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:52.516496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:52.517276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:52.517726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:52.909933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:52.921613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:52.924452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:52.926776 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-34b6e901-ddc9-4925-b312-e0ad5dbf5d4a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.423946 Jul 26 19:54:52.939750 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1329/2631] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:52 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:52.939750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a4e61f5-7c88-4cc0-b574-420ab66b9faf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:52.939750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3a4e61f5-7c88-4cc0-b574-420ab66b9faf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:52.947724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a4e61f5-7c88-4cc0-b574-420ab66b9faf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:52.948572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a4e61f5-7c88-4cc0-b574-420ab66b9faf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:52.949647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a4e61f5-7c88-4cc0-b574-420ab66b9faf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:52.950343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a4e61f5-7c88-4cc0-b574-420ab66b9faf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:53.246670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3a4e61f5-7c88-4cc0-b574-420ab66b9faf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:53.255056 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a4e61f5-7c88-4cc0-b574-420ab66b9faf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1312 microversion: 2.1 time: 0.326174 Jul 26 19:54:53.255651 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1330/2632] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:52 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:53.260456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-124ea373-4ca1-43e0-831f-6f305b43b410 req-b793bcde-3fdb-4924-a618-e1c471e43869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "name": "network-vif-plugged", "status": "completed", "tag": "468b1583-8160-48b1-8a6f-27bf0aad771d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:53.270825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-124ea373-4ca1-43e0-831f-6f305b43b410 req-b793bcde-3fdb-4924-a618-e1c471e43869 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:53.271265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-124ea373-4ca1-43e0-831f-6f305b43b410 req-b793bcde-3fdb-4924-a618-e1c471e43869 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:53.283055 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-124ea373-4ca1-43e0-831f-6f305b43b410 req-b793bcde-3fdb-4924-a618-e1c471e43869 service nova] Creating event network-vif-plugged:468b1583-8160-48b1-8a6f-27bf0aad771d for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:54:53.290057 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-124ea373-4ca1-43e0-831f-6f305b43b410 req-b793bcde-3fdb-4924-a618-e1c471e43869 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032860 Jul 26 19:54:53.290658 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1331/2633] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:53.297435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5e0658a-f187-46a6-885a-80822486007e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:53.298325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a5e0658a-f187-46a6-885a-80822486007e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:53.305866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5e0658a-f187-46a6-885a-80822486007e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:53.306310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5e0658a-f187-46a6-885a-80822486007e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:53.307074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5e0658a-f187-46a6-885a-80822486007e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:53.307504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5e0658a-f187-46a6-885a-80822486007e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:53.586864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a5e0658a-f187-46a6-885a-80822486007e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:53.594630 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5e0658a-f187-46a6-885a-80822486007e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.302537 Jul 26 19:54:53.595806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1332/2634] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:53 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:53.601123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31201b05-9664-43dc-8d7c-664cad471269 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Calling method '.version_select at 0x7f876838eee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:54.996423 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-69a1228a-dc66-4b22-8f77-57eb26766a6b tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/f9d2a91a-8a95-4761-acf2-625a64940253" status: 200 len: 351 microversion: 2.1 time: 7.301845 Jul 26 19:54:54.998030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1303/2635] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:54:47 2022] GET /compute/v2.1/os-volumes/f9d2a91a-8a95-4761-acf2-625a64940253 => generated 351 bytes in 7303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:55.004907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b7a0893-fb77-4f95-a2b9-b4f8e0e83db1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:55.006435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0b7a0893-fb77-4f95-a2b9-b4f8e0e83db1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:55.029056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b7a0893-fb77-4f95-a2b9-b4f8e0e83db1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.034489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b7a0893-fb77-4f95-a2b9-b4f8e0e83db1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.036436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b7a0893-fb77-4f95-a2b9-b4f8e0e83db1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.037171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b7a0893-fb77-4f95-a2b9-b4f8e0e83db1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.219049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0b7a0893-fb77-4f95-a2b9-b4f8e0e83db1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:55.230366 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0b7a0893-fb77-4f95-a2b9-b4f8e0e83db1 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.232094 Jul 26 19:54:55.231996 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1304/2636] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:54 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:55.242180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:55.243431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:55.251687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.252346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.254053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.254817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.345259 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31201b05-9664-43dc-8d7c-664cad471269 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/768fbe5e-4182-4055-bd9d-23813b57f497" status: 202 len: 0 microversion: 2.1 time: 1.748135 Jul 26 19:54:55.348185 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1333/2637] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:54:53 2022] DELETE /compute/v2.1/os-floating-ips/768fbe5e-4182-4055-bd9d-23813b57f497 => generated 0 bytes in 1751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:54:55.353960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-2a8a2b75-11d9-4f09-897e-75ad06062a12 req-6b12343f-66d0-45f2-a94c-7055a88bf6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed130697-86c2-4c78-9e02-f124b2663d3c", "tag": "759e6886-8ec2-4919-acc0-06161f6a9e94"}, {"name": "network-changed", "server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "tag": "541cb467-b301-4e6d-a429-b68924052481"}, {"name": "network-changed", "server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "tag": "ae28e6f8-74d4-4ed4-a654-8129d2f6984a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:55.374468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2a8a2b75-11d9-4f09-897e-75ad06062a12 req-6b12343f-66d0-45f2-a94c-7055a88bf6b6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.376342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2a8a2b75-11d9-4f09-897e-75ad06062a12 req-6b12343f-66d0-45f2-a94c-7055a88bf6b6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.406341 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2a8a2b75-11d9-4f09-897e-75ad06062a12 req-6b12343f-66d0-45f2-a94c-7055a88bf6b6 service nova] Creating event network-changed:759e6886-8ec2-4919-acc0-06161f6a9e94 for instance ed130697-86c2-4c78-9e02-f124b2663d3c on n-h1-708768-8 Jul 26 19:54:55.416855 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2a8a2b75-11d9-4f09-897e-75ad06062a12 req-6b12343f-66d0-45f2-a94c-7055a88bf6b6 service nova] Creating event network-changed:541cb467-b301-4e6d-a429-b68924052481 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:54:55.417542 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2a8a2b75-11d9-4f09-897e-75ad06062a12 req-6b12343f-66d0-45f2-a94c-7055a88bf6b6 service nova] Creating event network-changed:ae28e6f8-74d4-4ed4-a654-8129d2f6984a for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:54:55.444546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:55.444993 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-2a8a2b75-11d9-4f09-897e-75ad06062a12 req-6b12343f-66d0-45f2-a94c-7055a88bf6b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.092029 Jul 26 19:54:55.446263 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1334/2638] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:55.454289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:55.456603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:55.456916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:55.458106 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d0af6e98-8fa1-4e23-aa10-79a5ae7112df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1362 microversion: 2.26 time: 0.224807 Jul 26 19:54:55.458680 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1305/2639] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:55 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:55.463448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c2c980a-e3a3-448c-b299-f7493a9af555 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:55.464413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c2c980a-e3a3-448c-b299-f7493a9af555 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:55.470323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:55.470918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c2c980a-e3a3-448c-b299-f7493a9af555 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.472177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c2c980a-e3a3-448c-b299-f7493a9af555 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.473186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c2c980a-e3a3-448c-b299-f7493a9af555 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.473861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c2c980a-e3a3-448c-b299-f7493a9af555 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.486686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.488483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.489305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.489748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.633837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c2c980a-e3a3-448c-b299-f7493a9af555 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:55.643926 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c2c980a-e3a3-448c-b299-f7493a9af555 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1312 microversion: 2.1 time: 0.183347 Jul 26 19:54:55.644805 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1306/2640] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:55 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:55.650402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5ceac3d-02af-4fb0-b36e-663415b406a5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:55.651682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b5ceac3d-02af-4fb0-b36e-663415b406a5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:55.663486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5ceac3d-02af-4fb0-b36e-663415b406a5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.666494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5ceac3d-02af-4fb0-b36e-663415b406a5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.668667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5ceac3d-02af-4fb0-b36e-663415b406a5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:55.668667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5ceac3d-02af-4fb0-b36e-663415b406a5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:55.864474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b5ceac3d-02af-4fb0-b36e-663415b406a5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:55.873469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b5ceac3d-02af-4fb0-b36e-663415b406a5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.227123 Jul 26 19:54:55.874163 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1307/2641] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:55 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:55.880022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f050f56f-f345-4dbb-a1e1-ab365781a469 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f8756ec4160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:56.020414 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f050f56f-f345-4dbb-a1e1-ab365781a469 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.144072 Jul 26 19:54:56.023005 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1308/2642] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Jul 26 19:54:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:56.030006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2dc527c3-36db-463b-9460-8d4a1eb85cdd req-dc082c83-dd78-417d-9fa3-358cbe36b1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "name": "network-vif-plugged", "status": "completed", "tag": "9b98fe98-507d-4281-a657-b217a61f93e8"}, {"server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "name": "network-vif-plugged", "status": "completed", "tag": "c320e0cd-424d-463e-97f7-0b0006512f2a"}, {"server_uuid": "dce31da0-9557-46b9-aa38-daa4aa549a5f", "name": "network-vif-plugged", "status": "completed", "tag": "452ba588-281e-4c62-ae46-9c77b1ae1774"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:56.055763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2dc527c3-36db-463b-9460-8d4a1eb85cdd req-dc082c83-dd78-417d-9fa3-358cbe36b1d7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:56.056303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2dc527c3-36db-463b-9460-8d4a1eb85cdd req-dc082c83-dd78-417d-9fa3-358cbe36b1d7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:56.071009 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2dc527c3-36db-463b-9460-8d4a1eb85cdd req-dc082c83-dd78-417d-9fa3-358cbe36b1d7 service nova] Creating event network-vif-plugged:9b98fe98-507d-4281-a657-b217a61f93e8 for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:54:56.071705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2dc527c3-36db-463b-9460-8d4a1eb85cdd req-dc082c83-dd78-417d-9fa3-358cbe36b1d7 service nova] Creating event network-vif-plugged:c320e0cd-424d-463e-97f7-0b0006512f2a for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:54:56.072410 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2dc527c3-36db-463b-9460-8d4a1eb85cdd req-dc082c83-dd78-417d-9fa3-358cbe36b1d7 service nova] Creating event network-vif-plugged:452ba588-281e-4c62-ae46-9c77b1ae1774 for instance dce31da0-9557-46b9-aa38-daa4aa549a5f on n-h1-708768-8 Jul 26 19:54:56.083677 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2dc527c3-36db-463b-9460-8d4a1eb85cdd req-dc082c83-dd78-417d-9fa3-358cbe36b1d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.058139 Jul 26 19:54:56.084626 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1309/2643] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:56.091210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8840d423-ff8e-4bce-a0cb-9c8bf0b1de55 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Calling method '.version_select at 0x7f8756f385e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:56.091587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:56.113043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:56.115228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:56.117276 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1de4ebcf-ebe0-42b7-b447-148f66c0d0eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.669591 Jul 26 19:54:56.118349 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1335/2644] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:55 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:56.131292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03ce54a6-a0ab-4ecb-97b6-7c1a198d6e3f tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f875edc8ca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:56.414515 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03ce54a6-a0ab-4ecb-97b6-7c1a198d6e3f tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.294773 Jul 26 19:54:56.425772 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1336/2645] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Jul 26 19:54:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:56.431202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87bfd554-94ad-4fe4-8cd3-c93a33cb6320 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:56.432101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87bfd554-94ad-4fe4-8cd3-c93a33cb6320 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:56.439534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87bfd554-94ad-4fe4-8cd3-c93a33cb6320 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:56.440912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87bfd554-94ad-4fe4-8cd3-c93a33cb6320 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:56.441911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87bfd554-94ad-4fe4-8cd3-c93a33cb6320 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:56.442556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87bfd554-94ad-4fe4-8cd3-c93a33cb6320 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:57.113808 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8840d423-ff8e-4bce-a0cb-9c8bf0b1de55 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/42fff9b5-b2b2-4b99-ad37-f91df5d92098" status: 202 len: 0 microversion: 2.1 time: 1.027881 Jul 26 19:54:57.114407 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1310/2646] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:54:56 2022] DELETE /compute/v2.1/os-floating-ips/42fff9b5-b2b2-4b99-ad37-f91df5d92098 => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:54:57.119141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-905df065-5abc-4b99-9585-3de28f19fc80 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f8756f38c10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:57.207900 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-905df065-5abc-4b99-9585-3de28f19fc80 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092406 Jul 26 19:54:57.214601 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1311/2647] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Jul 26 19:54:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:57.214601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:57.214601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:57.221936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:57.222387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:57.223161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:57.223598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:57.339517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-87bfd554-94ad-4fe4-8cd3-c93a33cb6320 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:57.363424 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87bfd554-94ad-4fe4-8cd3-c93a33cb6320 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.935232 Jul 26 19:54:57.364835 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1337/2648] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:56 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:57.371359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-35985487-69dd-46cd-8dbc-affa3d06993b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:57.372305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-35985487-69dd-46cd-8dbc-affa3d06993b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:57.380740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35985487-69dd-46cd-8dbc-affa3d06993b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:57.381436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35985487-69dd-46cd-8dbc-affa3d06993b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:57.382726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35985487-69dd-46cd-8dbc-affa3d06993b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:57.383688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35985487-69dd-46cd-8dbc-affa3d06993b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:57.437086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:57.453601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:57.456589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:57.458780 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f2f8c33-cb4b-4e39-9de5-aab2c1410d00 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1362 microversion: 2.26 time: 0.249190 Jul 26 19:54:57.460057 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1312/2649] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:57 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:57.467392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-edb9082d-cd5b-4605-a508-e19358a9143d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:57.468351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-edb9082d-cd5b-4605-a508-e19358a9143d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:57.475815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edb9082d-cd5b-4605-a508-e19358a9143d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:57.476895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edb9082d-cd5b-4605-a508-e19358a9143d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:57.477894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edb9082d-cd5b-4605-a508-e19358a9143d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:57.478525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edb9082d-cd5b-4605-a508-e19358a9143d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:57.660836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edb9082d-cd5b-4605-a508-e19358a9143d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:57.670465 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-edb9082d-cd5b-4605-a508-e19358a9143d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1353 microversion: 2.1 time: 0.209045 Jul 26 19:54:57.671094 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1313/2650] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:57 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:57.676630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a5e4853-d313-4b58-b3fe-af29d5a71166 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] Calling method '.version_select at 0x7f8756e97b80>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:57.903872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-35985487-69dd-46cd-8dbc-affa3d06993b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:57.916947 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-35985487-69dd-46cd-8dbc-affa3d06993b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1312 microversion: 2.1 time: 0.550190 Jul 26 19:54:57.917560 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1338/2651] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:57 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1312 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:57.923198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:57.923835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:57.930454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:57.931278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:57.932323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:57.932974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:58.366559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:58.382876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:58.386995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:58.389252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ed451d13-05e3-4d39-aeab-5c260bca9fe9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.470429 Jul 26 19:54:58.391887 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1339/2652] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:57 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:58.398574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f4aee62-36fd-4b63-98eb-897ab5bed38c tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f875ec61ca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:58.544506 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a5e4853-d313-4b58-b3fe-af29d5a71166 tempest-FloatingIPDetailsTestJSON-911178724 tempest-FloatingIPDetailsTestJSON-911178724-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/d2d6be04-2416-4079-8176-290f866fc4bd" status: 202 len: 0 microversion: 2.1 time: 0.872075 Jul 26 19:54:58.549226 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1314/2653] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:54:57 2022] DELETE /compute/v2.1/os-floating-ips/d2d6be04-2416-4079-8176-290f866fc4bd => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:54:58.553961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-df06e48d-ed05-4df7-a3e4-d28ece8fd5a4 req-051e7e3e-061d-46ae-8a7b-1b3f556b669a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "tag": "fe6b2cb8-1d37-4fcb-8207-e8f166570861"}, {"name": "network-changed", "server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "tag": "1836dc79-1df6-4f9f-ad40-28b880acc6bb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:58.575531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-df06e48d-ed05-4df7-a3e4-d28ece8fd5a4 req-051e7e3e-061d-46ae-8a7b-1b3f556b669a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:58.579192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-df06e48d-ed05-4df7-a3e4-d28ece8fd5a4 req-051e7e3e-061d-46ae-8a7b-1b3f556b669a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:58.596120 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f4aee62-36fd-4b63-98eb-897ab5bed38c tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.202358 Jul 26 19:54:58.599824 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1340/2654] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Jul 26 19:54:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:58.611296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-81c10d70-c7af-4077-af9b-d46e927d45d8 req-91e51058-93db-4cd1-93cb-6f55aa5e39ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed130697-86c2-4c78-9e02-f124b2663d3c", "name": "network-vif-plugged", "status": "completed", "tag": "759e6886-8ec2-4919-acc0-06161f6a9e94"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:58.631426 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-df06e48d-ed05-4df7-a3e4-d28ece8fd5a4 req-051e7e3e-061d-46ae-8a7b-1b3f556b669a service nova] Creating event network-changed:fe6b2cb8-1d37-4fcb-8207-e8f166570861 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:54:58.634806 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-df06e48d-ed05-4df7-a3e4-d28ece8fd5a4 req-051e7e3e-061d-46ae-8a7b-1b3f556b669a service nova] Creating event network-changed:1836dc79-1df6-4f9f-ad40-28b880acc6bb for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:54:58.644184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-81c10d70-c7af-4077-af9b-d46e927d45d8 req-91e51058-93db-4cd1-93cb-6f55aa5e39ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:58.646329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-81c10d70-c7af-4077-af9b-d46e927d45d8 req-91e51058-93db-4cd1-93cb-6f55aa5e39ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:58.648266 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-df06e48d-ed05-4df7-a3e4-d28ece8fd5a4 req-051e7e3e-061d-46ae-8a7b-1b3f556b669a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096857 Jul 26 19:54:58.650732 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1315/2655] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:58.660076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-30a7cb87-5d65-4e47-8e40-49b4b21eae0e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:58.662212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-30a7cb87-5d65-4e47-8e40-49b4b21eae0e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:58.674346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30a7cb87-5d65-4e47-8e40-49b4b21eae0e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:58.676672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30a7cb87-5d65-4e47-8e40-49b4b21eae0e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:58.677714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30a7cb87-5d65-4e47-8e40-49b4b21eae0e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:58.678410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30a7cb87-5d65-4e47-8e40-49b4b21eae0e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:58.681088 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-81c10d70-c7af-4077-af9b-d46e927d45d8 req-91e51058-93db-4cd1-93cb-6f55aa5e39ca service nova] Creating event network-vif-plugged:759e6886-8ec2-4919-acc0-06161f6a9e94 for instance ed130697-86c2-4c78-9e02-f124b2663d3c on n-h1-708768-8 Jul 26 19:54:58.692834 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-81c10d70-c7af-4077-af9b-d46e927d45d8 req-91e51058-93db-4cd1-93cb-6f55aa5e39ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090792 Jul 26 19:54:58.698483 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1341/2656] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:58.716856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:58.718173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:58.727686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:58.728621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:58.729653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:58.730257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.008523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-30a7cb87-5d65-4e47-8e40-49b4b21eae0e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:59.010837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:54:59.048636 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-30a7cb87-5d65-4e47-8e40-49b4b21eae0e tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.395920 Jul 26 19:54:59.049953 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1316/2657] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:58 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:59.073119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5581ac7-92a9-44bc-95a3-a77370f3220a tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f8756e3f670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:59.114085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:59.134147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:59.136378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:59.137897 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02695231-249a-4b4f-bbf6-38258a98e399 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1362 microversion: 2.26 time: 0.438059 Jul 26 19:54:59.138628 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1342/2658] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:58 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:54:59.149564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11a59cc5-9757-4c56-b879-683e54fc6852 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:59.150434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11a59cc5-9757-4c56-b879-683e54fc6852 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:59.162757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a59cc5-9757-4c56-b879-683e54fc6852 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.166242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a59cc5-9757-4c56-b879-683e54fc6852 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.167407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a59cc5-9757-4c56-b879-683e54fc6852 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.168195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a59cc5-9757-4c56-b879-683e54fc6852 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.247855 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5581ac7-92a9-44bc-95a3-a77370f3220a tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.179108 Jul 26 19:54:59.248956 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1317/2659] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Jul 26 19:54:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:59.254195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5cefd7d5-7c9e-4e71-a9e4-af5b16168c3f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:59.254985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5cefd7d5-7c9e-4e71-a9e4-af5b16168c3f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:59.262866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cefd7d5-7c9e-4e71-a9e4-af5b16168c3f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.263320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cefd7d5-7c9e-4e71-a9e4-af5b16168c3f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.264324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cefd7d5-7c9e-4e71-a9e4-af5b16168c3f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.264905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cefd7d5-7c9e-4e71-a9e4-af5b16168c3f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.687259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-11a59cc5-9757-4c56-b879-683e54fc6852 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:59.695857 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11a59cc5-9757-4c56-b879-683e54fc6852 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1802 microversion: 2.1 time: 0.555970 Jul 26 19:54:59.696590 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1343/2660] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:59 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1802 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:59.701784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c41d37c1-2c97-4495-baca-15d5a1ea5479 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f87682d9c10>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:59.790951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5cefd7d5-7c9e-4e71-a9e4-af5b16168c3f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:59.799111 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5cefd7d5-7c9e-4e71-a9e4-af5b16168c3f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1462 microversion: 2.1 time: 0.548747 Jul 26 19:54:59.811902 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c41d37c1-2c97-4495-baca-15d5a1ea5479 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.113857 Jul 26 19:54:59.812508 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1318/2662] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:54:59 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1462 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:59.812624 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1344/2662] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:54:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:54:59.819547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:59.819547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:59.822510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b450fe02-d0d7-4943-abf6-16e87c5578ce tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:54:59.823263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b450fe02-d0d7-4943-abf6-16e87c5578ce tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:59.830239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b450fe02-d0d7-4943-abf6-16e87c5578ce tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.831699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b450fe02-d0d7-4943-abf6-16e87c5578ce tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.832753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b450fe02-d0d7-4943-abf6-16e87c5578ce tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.833313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b450fe02-d0d7-4943-abf6-16e87c5578ce tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.833714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.834603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.835950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.836337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.859130 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b450fe02-d0d7-4943-abf6-16e87c5578ce tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16/ips" status: 200 len: 217 microversion: 2.1 time: 0.045155 Jul 26 19:54:59.860271 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1319/2663] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 19:54:59 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16/ips => generated 217 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:54:59.865113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:54:59.867648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:54:59.874230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.874883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.875839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:54:59.876407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:54:59.973698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:54:59.981027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Old instance type m1.heat2, new instance type m1.heat {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 19:54:59.988498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:54:59.989074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:54:59.989655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:54:59.990202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:54:59.990709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:55:00.117746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7453bccf-191d-4cee-935a-758da1fb257c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.256079 Jul 26 19:55:00.118907 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1320/2664] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:54:59 2022] POST /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:55:00.124389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8594b82f-46cc-4050-9ae5-13c15e449916 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f8757137820>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:00.239844 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8594b82f-46cc-4050-9ae5-13c15e449916 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.119473 Jul 26 19:55:00.241237 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1321/2665] 10.222.0.58 () {58 vars in 1188 bytes} [Tue Jul 26 19:55:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:00.248922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-abd8ce00-24e8-48d9-b611-8e75871b3c88 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:00.249762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-abd8ce00-24e8-48d9-b611-8e75871b3c88 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:00.262445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abd8ce00-24e8-48d9-b611-8e75871b3c88 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:00.263207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abd8ce00-24e8-48d9-b611-8e75871b3c88 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:00.264287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abd8ce00-24e8-48d9-b611-8e75871b3c88 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:00.264888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abd8ce00-24e8-48d9-b611-8e75871b3c88 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:00.296754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-abd8ce00-24e8-48d9-b611-8e75871b3c88 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:55:00.419053 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-abd8ce00-24e8-48d9-b611-8e75871b3c88 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 204 len: 0 microversion: 2.1 time: 0.175774 Jul 26 19:55:00.420348 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1322/2666] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:55:00 2022] DELETE /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:00.428459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be4799e3-2849-480b-9848-1bd9190a039f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:00.429644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-be4799e3-2849-480b-9848-1bd9190a039f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:00.454810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be4799e3-2849-480b-9848-1bd9190a039f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:00.457732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be4799e3-2849-480b-9848-1bd9190a039f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:00.460161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be4799e3-2849-480b-9848-1bd9190a039f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:00.466030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be4799e3-2849-480b-9848-1bd9190a039f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:00.662709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:00.679667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:00.681224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:00.687054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e541671-7047-4007-aa9a-2c03bdde6dc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.873194 Jul 26 19:55:00.688444 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1345/2667] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:54:59 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:00.696457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5dc44f50-a01c-4ac4-9ffd-41df4c89367b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:00.701603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5dc44f50-a01c-4ac4-9ffd-41df4c89367b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:00.715964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dc44f50-a01c-4ac4-9ffd-41df4c89367b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:00.718079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dc44f50-a01c-4ac4-9ffd-41df4c89367b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:00.720120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dc44f50-a01c-4ac4-9ffd-41df4c89367b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:00.724138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dc44f50-a01c-4ac4-9ffd-41df4c89367b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:00.874007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-be4799e3-2849-480b-9848-1bd9190a039f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:00.885329 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-be4799e3-2849-480b-9848-1bd9190a039f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.463705 Jul 26 19:55:00.886438 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1323/2668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:00 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:00.891352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:00.892309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:00.900968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:00.901642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:00.903845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:00.904580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.136427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:01.146850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:01.148491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:01.150320 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e82461b1-c53d-4431-82d7-fe061b029958 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1546 microversion: 2.26 time: 0.262624 Jul 26 19:55:01.151394 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1324/2669] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:00 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:01.165447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23ffaba1-4ff3-4c78-8741-fec1aae4c3a4 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] Calling method '.version_select at 0x7f8756e973a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:01.178351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5dc44f50-a01c-4ac4-9ffd-41df4c89367b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:01.196967 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5dc44f50-a01c-4ac4-9ffd-41df4c89367b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1471 microversion: 2.1 time: 0.507323 Jul 26 19:55:01.206456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1346/2670] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:00 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1471 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:01.213959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c2727d8b-6d18-48b3-9f15-e7b06f318839 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:01.214806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c2727d8b-6d18-48b3-9f15-e7b06f318839 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:01.226477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2727d8b-6d18-48b3-9f15-e7b06f318839 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.228006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2727d8b-6d18-48b3-9f15-e7b06f318839 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.229129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2727d8b-6d18-48b3-9f15-e7b06f318839 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.229842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2727d8b-6d18-48b3-9f15-e7b06f318839 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.257121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:01.340657 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23ffaba1-4ff3-4c78-8741-fec1aae4c3a4 tempest-VolumesTestJSON-815024281 tempest-VolumesTestJSON-815024281-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.183876 Jul 26 19:55:01.341492 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1325/2671] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 19:55:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:01.348128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-3148eebe-b1ad-4821-af08-a8bc21ec3ad7 req-01e5eac4-51d9-4979-8c73-a303d4a61c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "tag": "284685bc-eeaf-4bd9-82d4-f42d9b330786"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:01.376544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3148eebe-b1ad-4821-af08-a8bc21ec3ad7 req-01e5eac4-51d9-4979-8c73-a303d4a61c03 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.383243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3148eebe-b1ad-4821-af08-a8bc21ec3ad7 req-01e5eac4-51d9-4979-8c73-a303d4a61c03 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.405079 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3148eebe-b1ad-4821-af08-a8bc21ec3ad7 req-01e5eac4-51d9-4979-8c73-a303d4a61c03 service nova] Creating event network-changed:284685bc-eeaf-4bd9-82d4-f42d9b330786 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:01.426653 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-3148eebe-b1ad-4821-af08-a8bc21ec3ad7 req-01e5eac4-51d9-4979-8c73-a303d4a61c03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082697 Jul 26 19:55:01.435981 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1326/2672] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:01.467842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cf55aafe-a823-435d-98d7-b8667e728d54 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:01.476017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cf55aafe-a823-435d-98d7-b8667e728d54 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:01.500027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf55aafe-a823-435d-98d7-b8667e728d54 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.502170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf55aafe-a823-435d-98d7-b8667e728d54 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.508072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf55aafe-a823-435d-98d7-b8667e728d54 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.509796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf55aafe-a823-435d-98d7-b8667e728d54 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.593580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-cf55aafe-a823-435d-98d7-b8667e728d54 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lazy-loading 'flavor' on Instance uuid 1a506c0f-7d8b-4671-9667-185ede749851 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:01.922127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c2727d8b-6d18-48b3-9f15-e7b06f318839 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:01.933113 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c2727d8b-6d18-48b3-9f15-e7b06f318839 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1808 microversion: 2.1 time: 0.725304 Jul 26 19:55:01.937222 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cf55aafe-a823-435d-98d7-b8667e728d54 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/action" status: 200 len: 32 microversion: 2.1 time: 0.499599 Jul 26 19:55:01.938162 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1327/2673] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:55:01 2022] POST /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/action => generated 32 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:55:01.956593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756ea5310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:01.956860 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1347/2674] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:01 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1808 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:01.970831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:01.972611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.973267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.974008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:01.975042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:01.986257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.987077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.989256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.990456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.998251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:01.998768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:01.999566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:02.002854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:02.064829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:02.066092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:02.099557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:02.100078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:02.160540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:02.200015 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89cd0177-0689-451b-83ca-d380847ccc24 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-860720838" status: 201 len: 0 microversion: 2.26 time: 0.260337 Jul 26 19:55:02.203881 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1328/2675] 10.222.0.58 () {62 vars in 1377 bytes} [Tue Jul 26 19:55:01 2022] PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-860720838 => generated 0 bytes in 265 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 19:55:02.215679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ceb43739-488f-4d54-9e26-f1ba79261f6b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:02.216407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ceb43739-488f-4d54-9e26-f1ba79261f6b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:02.228420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ceb43739-488f-4d54-9e26-f1ba79261f6b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:02.234336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ceb43739-488f-4d54-9e26-f1ba79261f6b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:02.236688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ceb43739-488f-4d54-9e26-f1ba79261f6b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:02.239123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ceb43739-488f-4d54-9e26-f1ba79261f6b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:02.601989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ceb43739-488f-4d54-9e26-f1ba79261f6b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:02.611436 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ceb43739-488f-4d54-9e26-f1ba79261f6b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.406060 Jul 26 19:55:02.624086 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1329/2676] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:02 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:02.630772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ac6c746-8369-41d2-90b2-413be7984dca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:02.631798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ac6c746-8369-41d2-90b2-413be7984dca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:02.646651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ac6c746-8369-41d2-90b2-413be7984dca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:02.647225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ac6c746-8369-41d2-90b2-413be7984dca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:02.659730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ac6c746-8369-41d2-90b2-413be7984dca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:02.659730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ac6c746-8369-41d2-90b2-413be7984dca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:02.697589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:02.890323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:02.941438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:02.943961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:02.945388 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22847092-e733-481d-8cb8-58fa95149cc7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.987135 Jul 26 19:55:02.946527 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1348/2677] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:01 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:02.952664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3c9c3e2-2c83-440d-a2f5-b3789535266a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f875ed6fd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:02.962331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3c9c3e2-2c83-440d-a2f5-b3789535266a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:02.963056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3c9c3e2-2c83-440d-a2f5-b3789535266a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:02.994764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ac6c746-8369-41d2-90b2-413be7984dca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:02.996233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e3c9c3e2-2c83-440d-a2f5-b3789535266a tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-860720838" status: 204 len: 0 microversion: 2.26 time: 0.048341 Jul 26 19:55:02.997678 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1349/2678] 10.222.0.58 () {60 vars in 1358 bytes} [Tue Jul 26 19:55:02 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-860720838 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:55:03.007387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-983b8d3a-409f-4179-a0b7-2503fe2f0521 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:03.008183 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ac6c746-8369-41d2-90b2-413be7984dca tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.393774 Jul 26 19:55:03.009055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-983b8d3a-409f-4179-a0b7-2503fe2f0521 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:03.017548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-983b8d3a-409f-4179-a0b7-2503fe2f0521 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.018309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-983b8d3a-409f-4179-a0b7-2503fe2f0521 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.019366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-983b8d3a-409f-4179-a0b7-2503fe2f0521 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.023167 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1330/2679] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:02 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:03.028753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-829227f9-6418-4f08-9b9d-fd103a8ac9e0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:03.034231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-829227f9-6418-4f08-9b9d-fd103a8ac9e0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:03.040636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-983b8d3a-409f-4179-a0b7-2503fe2f0521 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.052554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-829227f9-6418-4f08-9b9d-fd103a8ac9e0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.053105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-829227f9-6418-4f08-9b9d-fd103a8ac9e0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.054085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-829227f9-6418-4f08-9b9d-fd103a8ac9e0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.056175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-829227f9-6418-4f08-9b9d-fd103a8ac9e0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.251541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-829227f9-6418-4f08-9b9d-fd103a8ac9e0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:03.261702 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-829227f9-6418-4f08-9b9d-fd103a8ac9e0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1808 microversion: 2.1 time: 0.237103 Jul 26 19:55:03.262301 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1331/2680] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:03 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:03.267767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756f891f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:03.277036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.280222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.280765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:03.288296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.288741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.289521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.289956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.321216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.321731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.338246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:03.356276 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ab10eec2-d8db-460b-89ea-6e83be4c25df tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 204 len: 0 microversion: 2.26 time: 0.092742 Jul 26 19:55:03.357166 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1332/2681] 10.222.0.58 () {60 vars in 1295 bytes} [Tue Jul 26 19:55:03 2022] DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:55:03.367595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-53e4eab0-6ae6-4d3d-953c-e3d67c8138bf tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756fbf5e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:03.376870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53e4eab0-6ae6-4d3d-953c-e3d67c8138bf tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.377470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53e4eab0-6ae6-4d3d-953c-e3d67c8138bf tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.388975 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-53e4eab0-6ae6-4d3d-953c-e3d67c8138bf tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 200 len: 12 microversion: 2.26 time: 0.025851 Jul 26 19:55:03.389953 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1333/2682] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Jul 26 19:55:03 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:03.401038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756f51940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:03.417703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.418273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.418831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:03.425753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.426643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.427718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.428311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.463720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.464178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.476698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.477226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.506530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:03.524595 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e46a4561-5f10-4d76-bdd0-d5763560df47 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-1105834286" status: 201 len: 0 microversion: 2.26 time: 0.127714 Jul 26 19:55:03.525329 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1334/2683] 10.222.0.58 () {62 vars in 1380 bytes} [Tue Jul 26 19:55:03 2022] PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-1105834286 => generated 0 bytes in 129 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 26 19:55:03.537443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-da160b1d-ec0a-459e-8393-f68c76eef111 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756ea5ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:03.546106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da160b1d-ec0a-459e-8393-f68c76eef111 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.546582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da160b1d-ec0a-459e-8393-f68c76eef111 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.557063 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-da160b1d-ec0a-459e-8393-f68c76eef111 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 200 len: 36 microversion: 2.26 time: 0.025118 Jul 26 19:55:03.563216 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1335/2684] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Jul 26 19:55:03 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 36 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:03.569140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756ed6ca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:03.577160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.577606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.578084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:03.585634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.586084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.586926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.587357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.615583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.616064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.643973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:03.665606 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-730523fa-dbc0-4555-bba6-1a9bf440d5f0 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-1105834286" status: 204 len: 0 microversion: 2.26 time: 0.101086 Jul 26 19:55:03.669679 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1336/2685] 10.222.0.58 () {60 vars in 1364 bytes} [Tue Jul 26 19:55:03 2022] DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-1105834286 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:55:03.679589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fd6eefcb-50ac-4edf-ad68-2b1af4dec55a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:03.680392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fd6eefcb-50ac-4edf-ad68-2b1af4dec55a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:03.702946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fd6eefcb-50ac-4edf-ad68-2b1af4dec55a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.703519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fd6eefcb-50ac-4edf-ad68-2b1af4dec55a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.704742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fd6eefcb-50ac-4edf-ad68-2b1af4dec55a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:03.705174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fd6eefcb-50ac-4edf-ad68-2b1af4dec55a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:03.972551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fd6eefcb-50ac-4edf-ad68-2b1af4dec55a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:03.982888 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fd6eefcb-50ac-4edf-ad68-2b1af4dec55a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.312034 Jul 26 19:55:03.987790 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1337/2686] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:03 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:03.992569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-169f3c50-4bf4-48a6-a15a-f214b57b21a8 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f87578098b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:04.002115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-169f3c50-4bf4-48a6-a15a-f214b57b21a8 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.003965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-169f3c50-4bf4-48a6-a15a-f214b57b21a8 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.014838 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-169f3c50-4bf4-48a6-a15a-f214b57b21a8 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 200 len: 12 microversion: 2.26 time: 0.029745 Jul 26 19:55:04.032987 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1338/2687] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Jul 26 19:55:03 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 12 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:04.052837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-05dd3f7f-85ca-4fab-b668-74bd27cdd24f req-573225d1-4151-4176-bc40-a169c1172d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "tag": "ec179517-adcc-4787-947f-12e245e9aa0b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:04.077659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-05dd3f7f-85ca-4fab-b668-74bd27cdd24f req-573225d1-4151-4176-bc40-a169c1172d14 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.078589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-05dd3f7f-85ca-4fab-b668-74bd27cdd24f req-573225d1-4151-4176-bc40-a169c1172d14 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.093462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-05dd3f7f-85ca-4fab-b668-74bd27cdd24f req-573225d1-4151-4176-bc40-a169c1172d14 service nova] Creating event network-changed:ec179517-adcc-4787-947f-12e245e9aa0b for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:04.101763 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-05dd3f7f-85ca-4fab-b668-74bd27cdd24f req-573225d1-4151-4176-bc40-a169c1172d14 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067035 Jul 26 19:55:04.108511 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1339/2688] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:04.121828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:04.123331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:04.143344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.151280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.152297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.152758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.206080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-983b8d3a-409f-4179-a0b7-2503fe2f0521 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:04.231516 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-983b8d3a-409f-4179-a0b7-2503fe2f0521 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1471 microversion: 2.1 time: 1.220111 Jul 26 19:55:04.232642 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1350/2689] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:02 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1471 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:04.253323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f875f3fb4c0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:04.268669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.269066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.269744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:04.277448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.279205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.280360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.281053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.314198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.314583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.329311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:04.351461 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ce4c703c-b0ee-40c8-92ed-ab04900b8bef tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 204 len: 0 microversion: 2.26 time: 0.117426 Jul 26 19:55:04.352785 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1351/2690] 10.222.0.58 () {60 vars in 1295 bytes} [Tue Jul 26 19:55:04 2022] DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:55:04.358207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64aa0f46-5a32-4d23-a8b7-36335c7c801f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:04.359473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64aa0f46-5a32-4d23-a8b7-36335c7c801f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:04.368806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64aa0f46-5a32-4d23-a8b7-36335c7c801f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.369668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64aa0f46-5a32-4d23-a8b7-36335c7c801f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.370722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64aa0f46-5a32-4d23-a8b7-36335c7c801f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.371418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64aa0f46-5a32-4d23-a8b7-36335c7c801f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.627236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:04.645557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:04.649881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:04.651600 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f04a9ff2-36fc-4340-81ce-3e24c0b3f510 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.541435 Jul 26 19:55:04.652370 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1340/2691] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:04 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:04.658907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4191f05b-654c-4a30-800c-c783188df89d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:04.660221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4191f05b-654c-4a30-800c-c783188df89d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:04.669102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4191f05b-654c-4a30-800c-c783188df89d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.670428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4191f05b-654c-4a30-800c-c783188df89d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:04.671378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4191f05b-654c-4a30-800c-c783188df89d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:04.672007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4191f05b-654c-4a30-800c-c783188df89d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.122274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4191f05b-654c-4a30-800c-c783188df89d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:05.131570 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4191f05b-654c-4a30-800c-c783188df89d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1787 microversion: 2.1 time: 0.477886 Jul 26 19:55:05.144685 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1341/2692] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:04 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1787 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:05.157967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8757227310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:05.179166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.181984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.182736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:05.189124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.190460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.191463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.192132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.244860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.245733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.257631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.258472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.292407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:05.334758 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5c3d9caf-107d-4de0-857b-a1f8b409b9b7 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-877634804" status: 201 len: 0 microversion: 2.26 time: 0.186315 Jul 26 19:55:05.338004 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1342/2693] 10.222.0.58 () {62 vars in 1377 bytes} [Tue Jul 26 19:55:05 2022] PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-877634804 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 19:55:05.346843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d489f36d-7e11-44b7-9353-b488f4d49deb req-e5162d50-69a8-4a3e-bd4b-9978c58467f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f809b93-6a29-4300-8ed5-d02bd3b8f158", "name": "network-vif-unplugged", "status": "completed", "tag": "ae4ca5b7-137d-47f2-a766-8a77b84b61ef"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:05.378222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d489f36d-7e11-44b7-9353-b488f4d49deb req-e5162d50-69a8-4a3e-bd4b-9978c58467f2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.378551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d489f36d-7e11-44b7-9353-b488f4d49deb req-e5162d50-69a8-4a3e-bd4b-9978c58467f2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.411432 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d489f36d-7e11-44b7-9353-b488f4d49deb req-e5162d50-69a8-4a3e-bd4b-9978c58467f2 service nova] Creating event network-vif-unplugged:ae4ca5b7-137d-47f2-a766-8a77b84b61ef for instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 on n-h2-708768-8 Jul 26 19:55:05.422682 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d489f36d-7e11-44b7-9353-b488f4d49deb req-e5162d50-69a8-4a3e-bd4b-9978c58467f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082639 Jul 26 19:55:05.423902 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1343/2694] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:05.432442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c6b85ced-3f01-423e-a4db-241291ec9bde tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:05.433471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c6b85ced-3f01-423e-a4db-241291ec9bde tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:05.443231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:05.446368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6b85ced-3f01-423e-a4db-241291ec9bde tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.450451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6b85ced-3f01-423e-a4db-241291ec9bde tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.451557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6b85ced-3f01-423e-a4db-241291ec9bde tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.452259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6b85ced-3f01-423e-a4db-241291ec9bde tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.462919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64aa0f46-5a32-4d23-a8b7-36335c7c801f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:05.477199 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64aa0f46-5a32-4d23-a8b7-36335c7c801f tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 1.123013 Jul 26 19:55:05.477803 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1352/2695] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:04 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:05.498039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fd61636a-2323-4be1-a3b3-83477ebb4583 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:05.503786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd61636a-2323-4be1-a3b3-83477ebb4583 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:05.520372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd61636a-2323-4be1-a3b3-83477ebb4583 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.524211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd61636a-2323-4be1-a3b3-83477ebb4583 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.528961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd61636a-2323-4be1-a3b3-83477ebb4583 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.531191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd61636a-2323-4be1-a3b3-83477ebb4583 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.734436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c6b85ced-3f01-423e-a4db-241291ec9bde tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:05.739448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:05.746603 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c6b85ced-3f01-423e-a4db-241291ec9bde tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.320630 Jul 26 19:55:05.761658 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1344/2696] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:05 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:05.782738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756f45790>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:05.802626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.803524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.804305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:05.811818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.812903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.824535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.825182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.882104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.884049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.911177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:05.911837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:05.962339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:05.998970 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2860a88f-4984-44f5-b1ac-82cd30a32d52 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-1245898931" status: 201 len: 0 microversion: 2.26 time: 0.221942 Jul 26 19:55:06.000010 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1345/2697] 10.222.0.58 () {62 vars in 1380 bytes} [Tue Jul 26 19:55:05 2022] PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-1245898931 => generated 0 bytes in 238 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 26 19:55:06.010251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:06.013728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:06.042783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.043675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.044863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.045532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.367332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:06.381213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:06.384167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:06.385801 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-895f8989-fa37-4dcb-ba99-fb533748a85e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.379716 Jul 26 19:55:06.386784 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1346/2698] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:06 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:06.394840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756e3d1f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:06.409337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.410236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.410978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:06.419162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.420114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.421902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.422757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.466798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.467647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.490706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:06.513003 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03d63886-0b39-4adf-b943-5385732cca02 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 204 len: 0 microversion: 2.26 time: 0.124020 Jul 26 19:55:06.518618 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1347/2699] 10.222.0.58 () {60 vars in 1295 bytes} [Tue Jul 26 19:55:06 2022] DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:55:06.525614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c6cac3c0-2667-4699-8110-ba08a591469c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:06.526597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c6cac3c0-2667-4699-8110-ba08a591469c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:06.535922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6cac3c0-2667-4699-8110-ba08a591469c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.536820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6cac3c0-2667-4699-8110-ba08a591469c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.537857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6cac3c0-2667-4699-8110-ba08a591469c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.539343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c6cac3c0-2667-4699-8110-ba08a591469c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.753900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c6cac3c0-2667-4699-8110-ba08a591469c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:06.768303 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c6cac3c0-2667-4699-8110-ba08a591469c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1787 microversion: 2.1 time: 0.246363 Jul 26 19:55:06.770220 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1348/2700] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:06 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1787 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:06.777843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a0f66fb4-a403-491a-9c09-7e6d62f502ce req-42532d61-01be-481f-8b01-f6fafa26323a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "name": "network-vif-deleted", "tag": "9b98fe98-507d-4281-a657-b217a61f93e8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:06.824774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a0f66fb4-a403-491a-9c09-7e6d62f502ce req-42532d61-01be-481f-8b01-f6fafa26323a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.825323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a0f66fb4-a403-491a-9c09-7e6d62f502ce req-42532d61-01be-481f-8b01-f6fafa26323a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.839425 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a0f66fb4-a403-491a-9c09-7e6d62f502ce req-42532d61-01be-481f-8b01-f6fafa26323a service nova] Creating event network-vif-deleted:9b98fe98-507d-4281-a657-b217a61f93e8 for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:55:06.845284 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a0f66fb4-a403-491a-9c09-7e6d62f502ce req-42532d61-01be-481f-8b01-f6fafa26323a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073225 Jul 26 19:55:06.845937 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1349/2701] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:06.854918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49f2c95e-3f48-48b7-985b-b33b2b2e4517 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:06.855785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-49f2c95e-3f48-48b7-985b-b33b2b2e4517 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:06.863404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49f2c95e-3f48-48b7-985b-b33b2b2e4517 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.863935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49f2c95e-3f48-48b7-985b-b33b2b2e4517 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:06.864825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49f2c95e-3f48-48b7-985b-b33b2b2e4517 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:06.865319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49f2c95e-3f48-48b7-985b-b33b2b2e4517 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.068638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-49f2c95e-3f48-48b7-985b-b33b2b2e4517 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:07.099248 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-49f2c95e-3f48-48b7-985b-b33b2b2e4517 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.249482 Jul 26 19:55:07.102183 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1350/2702] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:06 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:07.116900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d98fb03d-5029-4bd3-afba-897831e13807 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756f388b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:07.151501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d98fb03d-5029-4bd3-afba-897831e13807 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.152261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d98fb03d-5029-4bd3-afba-897831e13807 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.167000 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d98fb03d-5029-4bd3-afba-897831e13807 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 200 len: 12 microversion: 2.26 time: 0.062803 Jul 26 19:55:07.168073 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1351/2703] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Jul 26 19:55:07 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 12 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:07.178624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a91d2f37-7163-4a26-9697-e91f9aade40d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:07.179397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a91d2f37-7163-4a26-9697-e91f9aade40d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:07.187534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a91d2f37-7163-4a26-9697-e91f9aade40d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.188033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a91d2f37-7163-4a26-9697-e91f9aade40d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.189012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a91d2f37-7163-4a26-9697-e91f9aade40d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.189441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a91d2f37-7163-4a26-9697-e91f9aade40d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.390031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a91d2f37-7163-4a26-9697-e91f9aade40d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:07.401445 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a91d2f37-7163-4a26-9697-e91f9aade40d tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.231940 Jul 26 19:55:07.402944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1352/2704] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:07 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:07.409483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756d84550>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:07.417997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.418517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.419144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:07.426508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.427461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.428107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.428657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.461901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.462549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.478866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:07.502179 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6a2246d5-7550-4f5e-878f-8473056111a4 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 204 len: 0 microversion: 2.26 time: 0.098228 Jul 26 19:55:07.503158 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1353/2705] 10.222.0.58 () {60 vars in 1295 bytes} [Tue Jul 26 19:55:07 2022] DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:55:07.512336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ba0fed39-057a-40db-9120-a96bf30bd8e5 req-e93dbe83-4b6e-448b-8d91-8a4dbc18c36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "name": "network-vif-unplugged", "status": "completed", "tag": "468b1583-8160-48b1-8a6f-27bf0aad771d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:07.524393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ba0fed39-057a-40db-9120-a96bf30bd8e5 req-e93dbe83-4b6e-448b-8d91-8a4dbc18c36d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.524939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ba0fed39-057a-40db-9120-a96bf30bd8e5 req-e93dbe83-4b6e-448b-8d91-8a4dbc18c36d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.544240 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ba0fed39-057a-40db-9120-a96bf30bd8e5 req-e93dbe83-4b6e-448b-8d91-8a4dbc18c36d service nova] Creating event network-vif-unplugged:468b1583-8160-48b1-8a6f-27bf0aad771d for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:55:07.550426 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ba0fed39-057a-40db-9120-a96bf30bd8e5 req-e93dbe83-4b6e-448b-8d91-8a4dbc18c36d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045425 Jul 26 19:55:07.551803 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1354/2706] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:07.557980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:07.559645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:07.567741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.568192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.569254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.569700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.606728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fd61636a-2323-4be1-a3b3-83477ebb4583 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:07.624608 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fd61636a-2323-4be1-a3b3-83477ebb4583 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1471 microversion: 2.1 time: 2.139392 Jul 26 19:55:07.641589 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1353/2707] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:05 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1471 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:07.659299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-61b79628-08bb-4672-9048-de4db44c9d3d req-c6c807c3-124d-42c1-8039-eaddf12c9718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f809b93-6a29-4300-8ed5-d02bd3b8f158", "tag": "ae4ca5b7-137d-47f2-a766-8a77b84b61ef"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:07.703709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-61b79628-08bb-4672-9048-de4db44c9d3d req-c6c807c3-124d-42c1-8039-eaddf12c9718 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.707826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-61b79628-08bb-4672-9048-de4db44c9d3d req-c6c807c3-124d-42c1-8039-eaddf12c9718 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.755195 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-61b79628-08bb-4672-9048-de4db44c9d3d req-c6c807c3-124d-42c1-8039-eaddf12c9718 service nova] Creating event network-changed:ae4ca5b7-137d-47f2-a766-8a77b84b61ef for instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 on n-h2-708768-8 Jul 26 19:55:07.766017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-61b79628-08bb-4672-9048-de4db44c9d3d req-c6c807c3-124d-42c1-8039-eaddf12c9718 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122602 Jul 26 19:55:07.770762 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1354/2708] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:07.777520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f87682e98b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:07.795569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.796382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.815706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:07.829988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.833932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.834985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.835581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.895686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.896658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.918426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:07.919453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:07.980066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:07.986249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:08.000642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:08.003049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:08.004351 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9972b447-2c97-46c4-8f44-166bffd834ef tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.451380 Jul 26 19:55:08.019655 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1355/2709] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:07 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:08.019655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c6812eb-27c8-49c0-aa94-23d1b31b726a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.019655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c6812eb-27c8-49c0-aa94-23d1b31b726a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.019655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c6812eb-27c8-49c0-aa94-23d1b31b726a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.021068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c6812eb-27c8-49c0-aa94-23d1b31b726a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.021068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c6812eb-27c8-49c0-aa94-23d1b31b726a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.021352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c6812eb-27c8-49c0-aa94-23d1b31b726a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.052351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02bd2ac0-577b-4017-966f-84e7dcf0eb22 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-95415295" status: 201 len: 0 microversion: 2.26 time: 0.279729 Jul 26 19:55:08.055039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1355/2710] 10.222.0.58 () {62 vars in 1374 bytes} [Tue Jul 26 19:55:07 2022] PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-95415295 => generated 0 bytes in 283 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Jul 26 19:55:08.070562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f87682f5790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.080429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.080993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.081513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.091149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.091954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.093449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.094039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.129561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.130188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.141772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.142456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.170404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:08.189028 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-319213f6-3637-4dc3-bd48-e5ec481e1f0b tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-849877802" status: 201 len: 0 microversion: 2.26 time: 0.122180 Jul 26 19:55:08.190294 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1356/2711] 10.222.0.58 () {62 vars in 1377 bytes} [Tue Jul 26 19:55:08 2022] PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags/tempest-tag-849877802 => generated 0 bytes in 125 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 19:55:08.195979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-859afdee-a7c2-45be-a72c-2db633ef1839 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.196900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-859afdee-a7c2-45be-a72c-2db633ef1839 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.205010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-859afdee-a7c2-45be-a72c-2db633ef1839 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.205992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-859afdee-a7c2-45be-a72c-2db633ef1839 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.207067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-859afdee-a7c2-45be-a72c-2db633ef1839 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.207748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-859afdee-a7c2-45be-a72c-2db633ef1839 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.212420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c6812eb-27c8-49c0-aa94-23d1b31b726a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:08.229239 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c6812eb-27c8-49c0-aa94-23d1b31b726a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1673 microversion: 2.1 time: 0.221898 Jul 26 19:55:08.229669 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1356/2712] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:08 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:08.236340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Action: 'update_all', calling method: .version_select at 0x7f8756ed63a0>, body: {"tags": ["tempest-tag-989986355", "tempest-tag-1397341855"]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:08.245548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.245998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.246483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.254532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.256350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.257283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.258000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.285054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.285506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.318152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:08.336572 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a92d99f8-e13f-4562-bf9e-f57bc9fd1263 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 200 len: 61 microversion: 2.26 time: 0.105725 Jul 26 19:55:08.339074 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1357/2713] 10.222.0.58 () {62 vars in 1312 bytes} [Tue Jul 26 19:55:08 2022] PUT /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 61 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:08.349309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-30b67315-b2ae-473c-9ab3-9b3b3747ac44 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f8756fa7e50>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.358241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30b67315-b2ae-473c-9ab3-9b3b3747ac44 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.358701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30b67315-b2ae-473c-9ab3-9b3b3747ac44 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.370638 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-30b67315-b2ae-473c-9ab3-9b3b3747ac44 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 200 len: 61 microversion: 2.26 time: 0.026740 Jul 26 19:55:08.371528 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1358/2714] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Jul 26 19:55:08 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 61 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:08.384822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '.version_select at 0x7f87682ee5e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.402349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.403233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.403892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.413753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.414331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.415504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.416605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.448008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.448641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.459118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:08.468085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lazy-loading 'flavor' on Instance uuid ed130697-86c2-4c78-9e02-f124b2663d3c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:55:08.489047 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a22de758-7f8d-4c78-b027-db9e45f19708 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags" status: 204 len: 0 microversion: 2.26 time: 0.109889 Jul 26 19:55:08.489834 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1359/2715] 10.222.0.58 () {60 vars in 1295 bytes} [Tue Jul 26 19:55:08 2022] DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c/tags => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:55:08.494265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d431b38b-e27b-4797-a46e-985d8caba051 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.494876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d431b38b-e27b-4797-a46e-985d8caba051 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.501901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d431b38b-e27b-4797-a46e-985d8caba051 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.502367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d431b38b-e27b-4797-a46e-985d8caba051 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.503160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d431b38b-e27b-4797-a46e-985d8caba051 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.503643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d431b38b-e27b-4797-a46e-985d8caba051 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.688839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d431b38b-e27b-4797-a46e-985d8caba051 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:08.698292 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d431b38b-e27b-4797-a46e-985d8caba051 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.207575 Jul 26 19:55:08.712228 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1360/2716] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:08 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:08.721900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88ae92d1-1b24-4d0a-9358-57c440c99f41 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.723683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-88ae92d1-1b24-4d0a-9358-57c440c99f41 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.730663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88ae92d1-1b24-4d0a-9358-57c440c99f41 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.731117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88ae92d1-1b24-4d0a-9358-57c440c99f41 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.732058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88ae92d1-1b24-4d0a-9358-57c440c99f41 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.732897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88ae92d1-1b24-4d0a-9358-57c440c99f41 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.763896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-859afdee-a7c2-45be-a72c-2db633ef1839 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:08.764841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-88ae92d1-1b24-4d0a-9358-57c440c99f41 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:55:08.781506 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-859afdee-a7c2-45be-a72c-2db633ef1839 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.589958 Jul 26 19:55:08.785838 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1357/2717] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:08 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:08.793785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-81b31c72-ee8a-40c9-8cfd-85e941591f0f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.794711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-81b31c72-ee8a-40c9-8cfd-85e941591f0f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.804986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81b31c72-ee8a-40c9-8cfd-85e941591f0f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.805882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81b31c72-ee8a-40c9-8cfd-85e941591f0f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.807111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81b31c72-ee8a-40c9-8cfd-85e941591f0f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.809523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81b31c72-ee8a-40c9-8cfd-85e941591f0f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.875137 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88ae92d1-1b24-4d0a-9358-57c440c99f41 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 204 len: 0 microversion: 2.26 time: 0.159619 Jul 26 19:55:08.876423 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1361/2718] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:55:08 2022] DELETE /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:55:08.886437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:08.887379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:08.895865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.896740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:08.897994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:08.898658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.086396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:09.097879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:09.099770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:09.101150 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06ae5ba5-e730-43fa-adc1-90bd538c5320 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1552 microversion: 2.26 time: 0.219474 Jul 26 19:55:09.102156 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1362/2719] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:08 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1552 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:09.107335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:09.107973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:09.115122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.115747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.116524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.116961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.394309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:09.409022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:09.412007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:09.414332 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e91c4e24-ae62-4a43-8e4e-414d0af7ce2e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.310859 Jul 26 19:55:09.415749 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1363/2720] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:09 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:09.430952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3fbb6f5-bf64-4638-98e0-5bf85389a87e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:09.432042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3fbb6f5-bf64-4638-98e0-5bf85389a87e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:09.453267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3fbb6f5-bf64-4638-98e0-5bf85389a87e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.454414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3fbb6f5-bf64-4638-98e0-5bf85389a87e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.456501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3fbb6f5-bf64-4638-98e0-5bf85389a87e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.457051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3fbb6f5-bf64-4638-98e0-5bf85389a87e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.574782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-81b31c72-ee8a-40c9-8cfd-85e941591f0f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:09.602749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-81b31c72-ee8a-40c9-8cfd-85e941591f0f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.812914 Jul 26 19:55:09.626667 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1358/2721] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:08 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:09.632671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-91f62f62-ac8d-49ea-9e2d-70cfb04b06fc req-25eecab9-2e88-45c0-b0df-8ed174d709d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "name": "network-vif-deleted", "tag": "468b1583-8160-48b1-8a6f-27bf0aad771d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:09.675987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-91f62f62-ac8d-49ea-9e2d-70cfb04b06fc req-25eecab9-2e88-45c0-b0df-8ed174d709d5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.676436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-91f62f62-ac8d-49ea-9e2d-70cfb04b06fc req-25eecab9-2e88-45c0-b0df-8ed174d709d5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.712801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3fbb6f5-bf64-4638-98e0-5bf85389a87e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:09.721343 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3fbb6f5-bf64-4638-98e0-5bf85389a87e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1652 microversion: 2.1 time: 0.303710 Jul 26 19:55:09.732127 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1364/2722] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:09 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1652 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:09.735660 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-91f62f62-ac8d-49ea-9e2d-70cfb04b06fc req-25eecab9-2e88-45c0-b0df-8ed174d709d5 service nova] Creating event network-vif-deleted:468b1583-8160-48b1-8a6f-27bf0aad771d for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:55:09.745027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5ae252a5-3806-4c61-9436-cca62cf377bd req-84afc8b5-b305-41fe-9631-98362551c296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "name": "network-vif-unplugged", "status": "completed", "tag": "c320e0cd-424d-463e-97f7-0b0006512f2a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:09.754465 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-91f62f62-ac8d-49ea-9e2d-70cfb04b06fc req-25eecab9-2e88-45c0-b0df-8ed174d709d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126174 Jul 26 19:55:09.763153 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1359/2723] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:09.771020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ebcb9d80-85e6-4e8a-a787-f6f19fed351c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:09.771789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ebcb9d80-85e6-4e8a-a787-f6f19fed351c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:09.774944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5ae252a5-3806-4c61-9436-cca62cf377bd req-84afc8b5-b305-41fe-9631-98362551c296 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.775594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5ae252a5-3806-4c61-9436-cca62cf377bd req-84afc8b5-b305-41fe-9631-98362551c296 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.790681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebcb9d80-85e6-4e8a-a787-f6f19fed351c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.791144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebcb9d80-85e6-4e8a-a787-f6f19fed351c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.791970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebcb9d80-85e6-4e8a-a787-f6f19fed351c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.792407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebcb9d80-85e6-4e8a-a787-f6f19fed351c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.810215 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5ae252a5-3806-4c61-9436-cca62cf377bd req-84afc8b5-b305-41fe-9631-98362551c296 service nova] Creating event network-vif-unplugged:c320e0cd-424d-463e-97f7-0b0006512f2a for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:55:09.824471 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5ae252a5-3806-4c61-9436-cca62cf377bd req-84afc8b5-b305-41fe-9631-98362551c296 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081918 Jul 26 19:55:09.827527 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1365/2724] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:09.843074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f3ad921-e91e-4bd6-bb30-85ffcd3cb275 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:09.843867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f3ad921-e91e-4bd6-bb30-85ffcd3cb275 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:09.863673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f3ad921-e91e-4bd6-bb30-85ffcd3cb275 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.864066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f3ad921-e91e-4bd6-bb30-85ffcd3cb275 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:09.867968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f3ad921-e91e-4bd6-bb30-85ffcd3cb275 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:09.868438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f3ad921-e91e-4bd6-bb30-85ffcd3cb275 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:10.156474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f3ad921-e91e-4bd6-bb30-85ffcd3cb275 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:10.169924 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f3ad921-e91e-4bd6-bb30-85ffcd3cb275 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.341108 Jul 26 19:55:10.187386 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1366/2725] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:09 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:10.196964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:10.202482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:10.226401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:10.228400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:10.229360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:10.230110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:10.535583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:10.544554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:10.550512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:10.552785 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21035237-e927-43b9-b501-ee29f1e8362c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1552 microversion: 2.26 time: 0.363269 Jul 26 19:55:10.554356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1367/2726] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:10 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1552 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:10.559398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:10.560448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:10.567869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:10.568511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:10.569307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:10.569751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:10.662886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ebcb9d80-85e6-4e8a-a787-f6f19fed351c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:10.678488 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ebcb9d80-85e6-4e8a-a787-f6f19fed351c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.910750 Jul 26 19:55:10.679521 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1360/2727] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:09 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:10.691577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd326ef9-bae0-48b2-9e56-59b1996b5896 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:10.692740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bd326ef9-bae0-48b2-9e56-59b1996b5896 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:10.712022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd326ef9-bae0-48b2-9e56-59b1996b5896 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:10.712920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd326ef9-bae0-48b2-9e56-59b1996b5896 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:10.716274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd326ef9-bae0-48b2-9e56-59b1996b5896 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:10.717695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd326ef9-bae0-48b2-9e56-59b1996b5896 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:10.988739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:11.008908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:11.012134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:11.015198 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b2bc5101-c4e0-4628-a1f5-19a81a570a57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.459793 Jul 26 19:55:11.017872 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1368/2728] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:10 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:11.047098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02454a9a-32f7-4325-b50f-6079fb6813c0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:11.049764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02454a9a-32f7-4325-b50f-6079fb6813c0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:11.066998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02454a9a-32f7-4325-b50f-6079fb6813c0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:11.071543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02454a9a-32f7-4325-b50f-6079fb6813c0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:11.073276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02454a9a-32f7-4325-b50f-6079fb6813c0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:11.075892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02454a9a-32f7-4325-b50f-6079fb6813c0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:11.466519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02454a9a-32f7-4325-b50f-6079fb6813c0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:11.479780 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02454a9a-32f7-4325-b50f-6079fb6813c0 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1494 microversion: 2.1 time: 0.459968 Jul 26 19:55:11.480879 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1369/2729] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:11 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1494 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:11.485806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-825800f8-df1f-4049-9456-d7349e27bdaa tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:11.487035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-825800f8-df1f-4049-9456-d7349e27bdaa tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:11.516410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-825800f8-df1f-4049-9456-d7349e27bdaa tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:11.517116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-825800f8-df1f-4049-9456-d7349e27bdaa tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:11.519802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-825800f8-df1f-4049-9456-d7349e27bdaa tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:11.520399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-825800f8-df1f-4049-9456-d7349e27bdaa tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:11.796368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-825800f8-df1f-4049-9456-d7349e27bdaa tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:11.810963 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-825800f8-df1f-4049-9456-d7349e27bdaa tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.325934 Jul 26 19:55:11.831652 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1370/2730] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:11 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:11.831652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:11.831652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:11.840974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:11.841566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:11.842449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:11.842981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:11.943164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:11.957703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:11.959529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '836a118c6207498895d022c853d99ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139071656fc9488d9584fcd46fd02106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:11.960987 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eecd320b-90eb-4e0f-8461-5c202cd4a724 tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 200 len: 1510 microversion: 2.26 time: 0.139269 Jul 26 19:55:11.962521 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1371/2731] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:11 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 1510 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:11.996292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8020c003-d7c4-4b3e-9d32-c8a1ea453d08 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:12.004481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8020c003-d7c4-4b3e-9d32-c8a1ea453d08 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:12.025420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8020c003-d7c4-4b3e-9d32-c8a1ea453d08 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.026676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8020c003-d7c4-4b3e-9d32-c8a1ea453d08 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.038009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8020c003-d7c4-4b3e-9d32-c8a1ea453d08 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.047996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8020c003-d7c4-4b3e-9d32-c8a1ea453d08 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.057419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd326ef9-bae0-48b2-9e56-59b1996b5896 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:12.061531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:12.069646 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bd326ef9-bae0-48b2-9e56-59b1996b5896 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 1.388705 Jul 26 19:55:12.080850 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1361/2732] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:10 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:12.094478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:12.096370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:12.110278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.111393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.113138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.113746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.349107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8020c003-d7c4-4b3e-9d32-c8a1ea453d08 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:12.359386 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8020c003-d7c4-4b3e-9d32-c8a1ea453d08 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.395697 Jul 26 19:55:12.360030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1372/2733] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:11 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:12.387875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-41ee1e62-8b0a-4152-b80e-fe45dc0dc0c1 req-28f9804d-a855-484b-ad91-2e25775f01fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed130697-86c2-4c78-9e02-f124b2663d3c", "name": "network-vif-deleted", "tag": "759e6886-8ec2-4919-acc0-06161f6a9e94"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:12.406847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-41ee1e62-8b0a-4152-b80e-fe45dc0dc0c1 req-28f9804d-a855-484b-ad91-2e25775f01fc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.407354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-41ee1e62-8b0a-4152-b80e-fe45dc0dc0c1 req-28f9804d-a855-484b-ad91-2e25775f01fc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.430861 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-41ee1e62-8b0a-4152-b80e-fe45dc0dc0c1 req-28f9804d-a855-484b-ad91-2e25775f01fc service nova] Creating event network-vif-deleted:759e6886-8ec2-4919-acc0-06161f6a9e94 for instance ed130697-86c2-4c78-9e02-f124b2663d3c on n-h1-708768-8 Jul 26 19:55:12.439641 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-41ee1e62-8b0a-4152-b80e-fe45dc0dc0c1 req-28f9804d-a855-484b-ad91-2e25775f01fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060384 Jul 26 19:55:12.442798 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1373/2734] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:12.506362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ac279b1-55f7-4768-9c35-d68406d21db1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:12.508450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ac279b1-55f7-4768-9c35-d68406d21db1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:12.519497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ac279b1-55f7-4768-9c35-d68406d21db1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.520669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ac279b1-55f7-4768-9c35-d68406d21db1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.521807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ac279b1-55f7-4768-9c35-d68406d21db1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.522677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ac279b1-55f7-4768-9c35-d68406d21db1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.609804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ac279b1-55f7-4768-9c35-d68406d21db1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:12.620767 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ac279b1-55f7-4768-9c35-d68406d21db1 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 200 len: 1296 microversion: 2.1 time: 0.120102 Jul 26 19:55:12.622146 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1374/2735] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:12 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:12.753229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:12.765538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:12.768827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:12.770288 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b546e510-04dc-4e10-902d-c9306ca941b5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.688049 Jul 26 19:55:12.771328 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1362/2736] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:12 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:12.846779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5532b0e5-b877-430e-b509-448d557a5267 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:12.848660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5532b0e5-b877-430e-b509-448d557a5267 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:12.876670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5532b0e5-b877-430e-b509-448d557a5267 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.880010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5532b0e5-b877-430e-b509-448d557a5267 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.883274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5532b0e5-b877-430e-b509-448d557a5267 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.884699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5532b0e5-b877-430e-b509-448d557a5267 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.913776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-75faca80-8566-4189-afc5-ab8c3a5cf9ab req-9c1c42a2-be3d-4b86-9233-e80242a0dca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f809b93-6a29-4300-8ed5-d02bd3b8f158", "name": "network-vif-unplugged", "status": "completed", "tag": "ae4ca5b7-137d-47f2-a766-8a77b84b61ef"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:12.927405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-75faca80-8566-4189-afc5-ab8c3a5cf9ab req-9c1c42a2-be3d-4b86-9233-e80242a0dca3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:12.927868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-75faca80-8566-4189-afc5-ab8c3a5cf9ab req-9c1c42a2-be3d-4b86-9233-e80242a0dca3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:12.943816 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-75faca80-8566-4189-afc5-ab8c3a5cf9ab req-9c1c42a2-be3d-4b86-9233-e80242a0dca3 service nova] Creating event network-vif-unplugged:ae4ca5b7-137d-47f2-a766-8a77b84b61ef for instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 on n-h2-708768-8 Jul 26 19:55:12.949955 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-75faca80-8566-4189-afc5-ab8c3a5cf9ab req-9c1c42a2-be3d-4b86-9233-e80242a0dca3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044730 Jul 26 19:55:12.951415 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1363/2737] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:13.149033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f8dd0c62-e912-4438-84c7-22c2d048cc29 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Action: 'create', calling method: .version_select at 0x7f87682e9700>, body: {"keypair": {"name": "tempest-keypair-1289688256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHxcwD4iUsC4bDaNsmwa+2PgRd4bA2aeZQthrJ+R9I27h4IYgOULjI+nHMf2rJF3oiUnQYv/1HmC9FXXXmzWElm9EGaPVnLt5ME2SWHl04c5eMGb4STIxLToEto8qSbzQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:13.197954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5532b0e5-b877-430e-b509-448d557a5267 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:13.202689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:13.210223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f8dd0c62-e912-4438-84c7-22c2d048cc29 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:13.212672 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5532b0e5-b877-430e-b509-448d557a5267 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.370761 Jul 26 19:55:13.213736 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1375/2738] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:12 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:13.221025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f8dd0c62-e912-4438-84c7-22c2d048cc29 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:13.231165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:13.232065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] [instance: ed130697-86c2-4c78-9e02-f124b2663d3c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:13.248234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:13.251222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:13.252463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:13.253514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:13.274831 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f8dd0c62-e912-4438-84c7-22c2d048cc29 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.320157 Jul 26 19:55:13.276344 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1364/2739] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jul 26 19:55:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 324 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:55:13.280834 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] HTTP exception thrown: Instance ed130697-86c2-4c78-9e02-f124b2663d3c could not be found. Jul 26 19:55:13.282896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c6eb1a63-07d2-424d-b6d9-b6ec980f1ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:13.283898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c6eb1a63-07d2-424d-b6d9-b6ec980f1ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Request method failure captured: Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c HTTP/1.1 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EZ61bQ4SFILyPSV3i273iMKrVqRQmIjWzjHIZhelMQN8l-ShrBSB8hyB_Yy2vot9lnLjRM-jH3IeZxeVRAqtxTbXLA3FIqlrH3v5gTRYJjA58svPPzzCwIGaRoTNirls9fqjpa5toHPARSt6uoziovyz8FNGNUVftg9egTa0Bjs2zc Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.26 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 139071656fc9488d9584fcd46fd02106 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerTagsTestJSON-887179546 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/139071656fc9488d9584fcd46fd02106"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/139071656fc9488d9584fcd46fd02106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_139071656fc9488d9584fcd46fd02106", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/139071656fc9488d9584fcd46fd02106"}]}] Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerTagsTestJSON-887179546 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 139071656fc9488d9584fcd46fd02106 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerTagsTestJSON-887179546 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerTagsTestJSON-887179546-project Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 836a118c6207498895d022c853d99ac1 Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerTagsTestJSON-887179546-project Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance ed130697-86c2-4c78-9e02-f124b2663d3c could not be found. Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ed130697-86c2-4c78-9e02-f124b2663d3c'} Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed130697-86c2-4c78-9e02-f124b2663d3c could not be found. Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed130697-86c2-4c78-9e02-f124b2663d3c could not be found. Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:13.284102 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:13.289220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:13.289220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:13.289220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:13.289220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:13.289220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:13.289220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed130697-86c2-4c78-9e02-f124b2663d3c could not be found. Jul 26 19:55:13.289220 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:13.290631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] Returning 404 to user: Instance ed130697-86c2-4c78-9e02-f124b2663d3c could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:13.292111 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5e848c56-0f20-4132-84bd-0d748766218c tempest-ServerTagsTestJSON-887179546 tempest-ServerTagsTestJSON-887179546-project] 10.222.0.58 "GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c" status: 404 len: 111 microversion: 2.26 time: 0.074123 Jul 26 19:55:13.292638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:13.294391 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1376/2740] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:13 2022] GET /compute/v2.1/servers/ed130697-86c2-4c78-9e02-f124b2663d3c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:55:13.300804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6eb1a63-07d2-424d-b6d9-b6ec980f1ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:13.301391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6eb1a63-07d2-424d-b6d9-b6ec980f1ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:13.302074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb02084f-e392-4689-8588-20c455169646 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f8756e3dc10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:13.302212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6eb1a63-07d2-424d-b6d9-b6ec980f1ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:13.302959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6eb1a63-07d2-424d-b6d9-b6ec980f1ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:13.317677 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb02084f-e392-4689-8588-20c455169646 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1289688256" status: 200 len: 513 microversion: 2.2 time: 0.021699 Jul 26 19:55:13.319063 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1377/2741] 10.222.0.58 () {60 vars in 1258 bytes} [Tue Jul 26 19:55:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1289688256 => generated 513 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:13.335271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a2000b2f-dd79-4dca-9771-741f8f88a8a9 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f875679a8b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:13.375821 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a2000b2f-dd79-4dca-9771-741f8f88a8a9 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289688256" status: 204 len: 0 microversion: 2.2 time: 0.049037 Jul 26 19:55:13.376534 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1378/2742] 10.222.0.58 () {60 vars in 1261 bytes} [Tue Jul 26 19:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289688256 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:13.382101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0473c6c0-d4e7-4d66-bfd5-235b1427dfed tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:13.382720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0473c6c0-d4e7-4d66-bfd5-235b1427dfed tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:13.397308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0473c6c0-d4e7-4d66-bfd5-235b1427dfed tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:13.397759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0473c6c0-d4e7-4d66-bfd5-235b1427dfed tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:13.398916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0473c6c0-d4e7-4d66-bfd5-235b1427dfed tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:13.399408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0473c6c0-d4e7-4d66-bfd5-235b1427dfed tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:13.777922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c6eb1a63-07d2-424d-b6d9-b6ec980f1ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:13.788123 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c6eb1a63-07d2-424d-b6d9-b6ec980f1ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.510392 Jul 26 19:55:13.795637 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1365/2743] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:13 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:13.806719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ecf3d94e-7151-4657-935c-3d8ecb973842 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Action: 'create', calling method: .version_select at 0x7f875f06b160>, body: {"keypair": {"name": "tempest-keypair-1868424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKj8vANtartHCF2mqNqadPiTT5xevbe478t00CpFExreTrazp9axWxDHWwj3LE9nLiEmL16FRZJiOAf+LonzugNn+P6qqOD4ISGWg/MyD+Zl3qPKm6zMcNeDelqNrEaAw=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:13.836190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ecf3d94e-7151-4657-935c-3d8ecb973842 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:13.842811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ecf3d94e-7151-4657-935c-3d8ecb973842 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:13.926299 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ecf3d94e-7151-4657-935c-3d8ecb973842 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.2 time: 0.127239 Jul 26 19:55:13.930120 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1366/2744] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jul 26 19:55:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:55:13.947358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:13.952891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:13.953508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0473c6c0-d4e7-4d66-bfd5-235b1427dfed tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:13.962162 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0473c6c0-d4e7-4d66-bfd5-235b1427dfed tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.583943 Jul 26 19:55:13.963123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:13.963936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:13.965106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:13.966142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:13.973979 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1379/2745] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:13 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:13.984660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:13.987571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:14.002528 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] HTTP exception thrown: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:55:14.005717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:14.006913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:14.008359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Request method failure captured: Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 HTTP/1.1 Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EZafazIjUOkFm8PFVNsXd0nKzTY6O1lqqjB031ROTFh_Au_wBo8NwSSpoT2wv4il_ebz5BHqDbnYwmqADYoZl8osTBiBJppEKKXIE-vdOdYlnbD8sMi2iq8Y__J5ZL_rvB7DHnW5Gmogr25ifojllta2BgDNHM4r8CiDtfmc92XhrU Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_114f0f8e78814e9089f720705dc2319c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}] Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestMultiNic-640219212 Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestMultiNic-640219212-project Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ff33e693dc4141e7b4667bee9c2cebfc Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestMultiNic-640219212-project Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7bec5c6d-2e2f-4d44-8e81-a36a3332cd16'} Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:14.009101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:14.013180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:14.013180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:14.013180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:14.013180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:14.013180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:14.013180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:55:14.013180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:14.018820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Returning 404 to user: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:14.020077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:14.022118 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4653d56d-f126-4cfa-8ad9-43d61655550f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 404 len: 111 microversion: 2.1 time: 0.087124 Jul 26 19:55:14.027793 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1367/2746] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:13 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:55:14.044234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-867a3765-037b-4fb0-899a-22fcfd681fe9 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f875ed6f4c0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:14.088774 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-867a3765-037b-4fb0-899a-22fcfd681fe9 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1868424" status: 204 len: 0 microversion: 2.2 time: 0.059262 Jul 26 19:55:14.089950 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1368/2747] 10.222.0.58 () {60 vars in 1252 bytes} [Tue Jul 26 19:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1868424 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:14.102564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-db99c883-f01a-410e-8522-f5fc40580953 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Action: 'create', calling method: .version_select at 0x7f875eef1dc0>, body: {"keypair": {"name": "tempest-keypair-692406948", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:14.120398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-db99c883-f01a-410e-8522-f5fc40580953 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:14.125869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-db99c883-f01a-410e-8522-f5fc40580953 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:14.156721 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-db99c883-f01a-410e-8522-f5fc40580953 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.058886 Jul 26 19:55:14.158735 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1369/2748] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jul 26 19:55:14 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 26 19:55:14.169605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33eb445c-d7b8-4f95-b914-5bf3dcb0a04d tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f875e9cd9d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:14.207260 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-33eb445c-d7b8-4f95-b914-5bf3dcb0a04d tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-692406948" status: 204 len: 0 microversion: 2.2 time: 0.041339 Jul 26 19:55:14.207639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1370/2749] 10.222.0.58 () {60 vars in 1258 bytes} [Tue Jul 26 19:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-692406948 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:55:14.220918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c99de33b-2649-4cc3-9cd8-afd4732293a2 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Action: 'create', calling method: .version_select at 0x7f875ed6fc10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1391209659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzacLs/hgbvYjq692Cnt2k3r69sjUQUdBEbTC4QJtUb5Q9LRZ9pcXj/lB4+gJZRCwYHiSgeVB0En/Xo6FdPTfbBNudf347Zga5lp/f94coUssa13Fku1b54aI297cUBWQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:14.260960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-c99de33b-2649-4cc3-9cd8-afd4732293a2 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:14.286856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-c99de33b-2649-4cc3-9cd8-afd4732293a2 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:14.337898 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c99de33b-2649-4cc3-9cd8-afd4732293a2 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.121526 Jul 26 19:55:14.339105 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1371/2750] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jul 26 19:55:14 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:55:14.350019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ce8aa0f-6ffa-4f48-b313-a7b7aeda350b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:14.351195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ce8aa0f-6ffa-4f48-b313-a7b7aeda350b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:14.365764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ce8aa0f-6ffa-4f48-b313-a7b7aeda350b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:14.367843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ce8aa0f-6ffa-4f48-b313-a7b7aeda350b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:14.369384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ce8aa0f-6ffa-4f48-b313-a7b7aeda350b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:14.371866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ce8aa0f-6ffa-4f48-b313-a7b7aeda350b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:14.633176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:14.648385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:14.657430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:14.659896 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7cbce4ae-e474-4c50-b49a-3906335990df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.684471 Jul 26 19:55:14.673446 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1380/2751] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:13 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:14.682587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f6c422c-7e4c-4d96-9b39-60098803277e tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Action: 'create', calling method: .version_select at 0x7f875753dd30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1211593468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMkx/utPOX+rLtrSldPauR6iX0fLH1P4hO3fsvaVu1UkZ8JpH/GxUT7hFc0K98CZNIs36WMQzBGo6RZRkmkWd6dg7WjI+VH3h0sAVVeg6JC43LugFa4MRs9PDEt3uTgRw=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:14.695440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ce8aa0f-6ffa-4f48-b313-a7b7aeda350b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:14.700831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-2f6c422c-7e4c-4d96-9b39-60098803277e tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:14.707477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-2f6c422c-7e4c-4d96-9b39-60098803277e tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:14.710496 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ce8aa0f-6ffa-4f48-b313-a7b7aeda350b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.368590 Jul 26 19:55:14.714097 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1372/2752] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:14 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:14.718025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:14.728469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c4530b57-59f0-47ee-85b3-b012c318e601 req-e910977f-31d1-44e3-916b-dc7579178dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec5c6d-2e2f-4d44-8e81-a36a3332cd16", "name": "network-vif-deleted", "tag": "c320e0cd-424d-463e-97f7-0b0006512f2a"}, {"server_uuid": "6f809b93-6a29-4300-8ed5-d02bd3b8f158", "name": "network-vif-unplugged", "status": "completed", "tag": "ae4ca5b7-137d-47f2-a766-8a77b84b61ef"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:14.745329 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f6c422c-7e4c-4d96-9b39-60098803277e tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.070160 Jul 26 19:55:14.746605 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1381/2753] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jul 26 19:55:14 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:55:14.757421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c4530b57-59f0-47ee-85b3-b012c318e601 req-e910977f-31d1-44e3-916b-dc7579178dd8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:14.758345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c4530b57-59f0-47ee-85b3-b012c318e601 req-e910977f-31d1-44e3-916b-dc7579178dd8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:14.762867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17a1fff6-3371-4976-820d-9477d2bd48c8 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Action: 'create', calling method: .version_select at 0x7f8756ddc820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1090162053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3UQ2O70WP4F5LzfFTcoLavDZuq7CtwhqvOrgv6FZuloz3IH2F4niu+Pd3n+7F536T2QWxRD35VJTTFpumSmtGaVGgibQv9rVuWNZ1k5O99seg+n60nUh/wkV7H80AfhQ=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:14.781746 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c4530b57-59f0-47ee-85b3-b012c318e601 req-e910977f-31d1-44e3-916b-dc7579178dd8 service nova] Creating event network-vif-deleted:c320e0cd-424d-463e-97f7-0b0006512f2a for instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 on n-h1-708768-8 Jul 26 19:55:14.784709 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c4530b57-59f0-47ee-85b3-b012c318e601 req-e910977f-31d1-44e3-916b-dc7579178dd8 service nova] Creating event network-vif-unplugged:ae4ca5b7-137d-47f2-a766-8a77b84b61ef for instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 on n-h2-708768-8 Jul 26 19:55:14.798445 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c4530b57-59f0-47ee-85b3-b012c318e601 req-e910977f-31d1-44e3-916b-dc7579178dd8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.083058 Jul 26 19:55:14.800698 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1373/2754] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:14.806515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-17a1fff6-3371-4976-820d-9477d2bd48c8 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:14.815387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-17a1fff6-3371-4976-820d-9477d2bd48c8 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:14.824190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4a4ee54b-fe10-4e35-80e5-440760ac56b0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:14.825030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4a4ee54b-fe10-4e35-80e5-440760ac56b0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:14.835222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a4ee54b-fe10-4e35-80e5-440760ac56b0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:14.835832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a4ee54b-fe10-4e35-80e5-440760ac56b0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:14.836697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a4ee54b-fe10-4e35-80e5-440760ac56b0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:14.837516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a4ee54b-fe10-4e35-80e5-440760ac56b0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:14.849135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-17a1fff6-3371-4976-820d-9477d2bd48c8 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.092570 Jul 26 19:55:14.856223 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1382/2755] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jul 26 19:55:14 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:55:14.864162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16de0fed-c31f-416a-9678-eb6bec7f3ad0 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f875679aca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:14.872288 n-d-708768-8 devstack@n-api.service[125964]: WARNING oslo_db.sqlalchemy.utils [None req-16de0fed-c31f-416a-9678-eb6bec7f3ad0 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 19:55:14.880980 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16de0fed-c31f-416a-9678-eb6bec7f3ad0 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.023268 Jul 26 19:55:14.882181 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1383/2756] 10.222.0.58 () {60 vars in 1177 bytes} [Tue Jul 26 19:55:14 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:14.894188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6e58fed3-15d6-455a-ab25-85ca20f50c91 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f8756ed6ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:14.923237 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6e58fed3-15d6-455a-ab25-85ca20f50c91 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1090162053" status: 204 len: 0 microversion: 2.2 time: 0.033317 Jul 26 19:55:14.924648 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1384/2757] 10.222.0.58 () {60 vars in 1321 bytes} [Tue Jul 26 19:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1090162053 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:55:14.934355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-733e9e9a-3585-4fba-87c6-55c275b14a17 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f8757227310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:14.962850 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-733e9e9a-3585-4fba-87c6-55c275b14a17 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1211593468" status: 204 len: 0 microversion: 2.2 time: 0.033280 Jul 26 19:55:14.963761 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1385/2758] 10.222.0.58 () {60 vars in 1321 bytes} [Tue Jul 26 19:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1211593468 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:55:14.973121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e832e262-a200-4231-aa62-3d72cddfe111 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f8756ddc940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:14.997044 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e832e262-a200-4231-aa62-3d72cddfe111 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1391209659" status: 204 len: 0 microversion: 2.2 time: 0.029024 Jul 26 19:55:14.998213 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1386/2759] 10.222.0.58 () {60 vars in 1321 bytes} [Tue Jul 26 19:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1391209659 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:55:15.006576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a931472-3513-4e35-9816-c30dbc99457f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:15.007234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1a931472-3513-4e35-9816-c30dbc99457f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:15.016904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a931472-3513-4e35-9816-c30dbc99457f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:15.017552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a931472-3513-4e35-9816-c30dbc99457f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:15.019265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a931472-3513-4e35-9816-c30dbc99457f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:15.019917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a931472-3513-4e35-9816-c30dbc99457f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:15.335091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a931472-3513-4e35-9816-c30dbc99457f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:15.345413 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a931472-3513-4e35-9816-c30dbc99457f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.345728 Jul 26 19:55:15.361639 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1387/2760] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:14 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:15.368435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e7b6f7a5-26ac-43bf-9c80-1ff6f74611ef tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Action: 'create', calling method: .version_select at 0x7f875679a310>, body: {"keypair": {"name": "tempest-keypair-917313475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMB70M9UMNabEOGx3UJp3z3ITmQ6jo8YbKJYIGX/R1rOf/WwzK2JCEgMBT92qnO2K/s+9pRPKVJLVddGLOi3ployCS4WAKG31ezJ6H+huvFCC9fMATkIsDZwHNlxquDIUA=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:15.391104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-e7b6f7a5-26ac-43bf-9c80-1ff6f74611ef tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:15.399940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-e7b6f7a5-26ac-43bf-9c80-1ff6f74611ef tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:15.434811 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e7b6f7a5-26ac-43bf-9c80-1ff6f74611ef tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.071622 Jul 26 19:55:15.436159 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1388/2761] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Jul 26 19:55:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 19:55:15.449376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d13463d5-2775-4efe-9ab7-d62ccba65501 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f87567a9af0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:15.462392 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d13463d5-2775-4efe-9ab7-d62ccba65501 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-917313475" status: 200 len: 512 microversion: 2.2 time: 0.018698 Jul 26 19:55:15.463532 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1389/2762] 10.222.0.58 () {60 vars in 1255 bytes} [Tue Jul 26 19:55:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-917313475 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:15.479753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd0e44a2-2e53-4759-bb6f-d76db0f947e7 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f87567aa670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:15.487594 n-d-708768-8 devstack@n-api.service[125964]: WARNING oslo_db.sqlalchemy.utils [None req-dd0e44a2-2e53-4759-bb6f-d76db0f947e7 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 19:55:15.496258 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd0e44a2-2e53-4759-bb6f-d76db0f947e7 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.024048 Jul 26 19:55:15.497327 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1390/2763] 10.222.0.58 () {60 vars in 1177 bytes} [Tue Jul 26 19:55:15 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:15.514565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3fac5bfd-b41d-4a1a-8dcc-51240a69a034 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f875761a3a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:15.542851 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3fac5bfd-b41d-4a1a-8dcc-51240a69a034 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-917313475" status: 204 len: 0 microversion: 2.2 time: 0.037724 Jul 26 19:55:15.548265 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1391/2764] 10.222.0.58 () {60 vars in 1258 bytes} [Tue Jul 26 19:55:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-917313475 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:15.554730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Action: 'create', calling method: .version_select at 0x7f8756ddcb80>, body: {"keypair": {"name": "tempest-keypair-1776022438", "type": "x509"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:15.572218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4a4ee54b-fe10-4e35-80e5-440760ac56b0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:15.581662 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4a4ee54b-fe10-4e35-80e5-440760ac56b0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.764943 Jul 26 19:55:15.584220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:15.585121 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1374/2765] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:14 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:15.608508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:15.631633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.processutils [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp5tx6eoun/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp5tx6eoun/temp.key -subj /CN=32ec69b2ddc64d1ea728bccfdfeda115 -extensions v3_req_client {{(pid=125964) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 26 19:55:15.691054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:15.691724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:15.709248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:15.711909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:15.712804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:15.716754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:15.875658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.processutils [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp5tx6eoun/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp5tx6eoun/temp.key -subj /CN=32ec69b2ddc64d1ea728bccfdfeda115 -extensions v3_req_client" returned: 0 in 0.244s {{(pid=125964) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 26 19:55:15.877679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.processutils [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp5tx6eoun/temp.key -password pass: {{(pid=125964) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 26 19:55:15.953999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.processutils [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp5tx6eoun/temp.key -password pass:" returned: 0 in 0.076s {{(pid=125964) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 26 19:55:16.030513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:16.042496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Getting quotas for user 32ec69b2ddc64d1ea728bccfdfeda115 and project 17866b10bc8447c8ad44466670c0ee0b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:16.063469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f45f9ac1-341a-4bcb-9c16-ee11bf8e1d48 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.513008 Jul 26 19:55:16.065190 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1392/2766] 10.222.0.58 () {62 vars in 1198 bytes} [Tue Jul 26 19:55:15 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 516 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:16.071668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5132e1b-a6dc-44e1-82a9-73e090854e52 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:16.072525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5132e1b-a6dc-44e1-82a9-73e090854e52 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:16.079509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5132e1b-a6dc-44e1-82a9-73e090854e52 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:16.080537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5132e1b-a6dc-44e1-82a9-73e090854e52 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:16.081450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5132e1b-a6dc-44e1-82a9-73e090854e52 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:16.082277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5132e1b-a6dc-44e1-82a9-73e090854e52 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:16.311012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5132e1b-a6dc-44e1-82a9-73e090854e52 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:16.324967 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5132e1b-a6dc-44e1-82a9-73e090854e52 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.258399 Jul 26 19:55:16.325760 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1393/2767] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:16 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:16.330830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-667d84cc-e243-4cf8-81b1-7bc5c242d76d tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f8756ed6a60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:16.344486 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-667d84cc-e243-4cf8-81b1-7bc5c242d76d tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1776022438" status: 200 len: 1534 microversion: 2.2 time: 0.017776 Jul 26 19:55:16.345365 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1394/2768] 10.222.0.58 () {60 vars in 1258 bytes} [Tue Jul 26 19:55:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1776022438 => generated 1534 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:16.357578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ed3bad6-7344-41d1-a83c-dd51b5287d6a tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f87567aa940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:16.362423 n-d-708768-8 devstack@n-api.service[125964]: WARNING oslo_db.sqlalchemy.utils [None req-3ed3bad6-7344-41d1-a83c-dd51b5287d6a tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 19:55:16.367379 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ed3bad6-7344-41d1-a83c-dd51b5287d6a tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.013432 Jul 26 19:55:16.377899 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1395/2769] 10.222.0.58 () {60 vars in 1177 bytes} [Tue Jul 26 19:55:16 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:16.384872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2a7db18d-e177-42da-8e4d-2ba42120464a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:16.385411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2a7db18d-e177-42da-8e4d-2ba42120464a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:16.394316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a7db18d-e177-42da-8e4d-2ba42120464a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:16.394768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a7db18d-e177-42da-8e4d-2ba42120464a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:16.395538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a7db18d-e177-42da-8e4d-2ba42120464a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:16.396016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a7db18d-e177-42da-8e4d-2ba42120464a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:16.556683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:16.570400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:16.573095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:16.576119 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7ada65d3-9b03-4b31-b92b-2da3ba785c4c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.890074 Jul 26 19:55:16.578113 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1375/2770] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:15 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:16.584622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0c561db-b1f5-4121-8fd5-e6a61295a849 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] Calling method '.version_select at 0x7f875f12bb80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:16.610743 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0c561db-b1f5-4121-8fd5-e6a61295a849 tempest-KeyPairsV22TestJSON-361865791 tempest-KeyPairsV22TestJSON-361865791-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776022438" status: 204 len: 0 microversion: 2.2 time: 0.031265 Jul 26 19:55:16.612025 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1376/2771] 10.222.0.58 () {60 vars in 1261 bytes} [Tue Jul 26 19:55:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776022438 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:16.618770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b436394a-9c98-48e1-b87e-13b8e4ddbb76 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:16.619635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b436394a-9c98-48e1-b87e-13b8e4ddbb76 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:16.628765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b436394a-9c98-48e1-b87e-13b8e4ddbb76 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:16.629555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b436394a-9c98-48e1-b87e-13b8e4ddbb76 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:16.630795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b436394a-9c98-48e1-b87e-13b8e4ddbb76 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:16.631449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b436394a-9c98-48e1-b87e-13b8e4ddbb76 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:16.690573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2a7db18d-e177-42da-8e4d-2ba42120464a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:16.698688 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2a7db18d-e177-42da-8e4d-2ba42120464a tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1392 microversion: 2.1 time: 0.319195 Jul 26 19:55:16.699923 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1396/2772] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:16 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1392 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:17.048269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b436394a-9c98-48e1-b87e-13b8e4ddbb76 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:17.059182 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b436394a-9c98-48e1-b87e-13b8e4ddbb76 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.445846 Jul 26 19:55:17.060204 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1377/2773] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:16 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:17.349742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f69edd8-ef00-40c5-ac2f-8a0a217431bb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:17.351117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f69edd8-ef00-40c5-ac2f-8a0a217431bb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:17.366888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f69edd8-ef00-40c5-ac2f-8a0a217431bb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:17.367210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f69edd8-ef00-40c5-ac2f-8a0a217431bb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:17.375574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f69edd8-ef00-40c5-ac2f-8a0a217431bb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:17.376075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f69edd8-ef00-40c5-ac2f-8a0a217431bb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:17.613709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:17.615533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:17.625834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:17.626462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:17.627726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:17.628427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:17.786160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f69edd8-ef00-40c5-ac2f-8a0a217431bb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:17.800969 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f69edd8-ef00-40c5-ac2f-8a0a217431bb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.457174 Jul 26 19:55:17.801590 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1397/2774] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:17 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:17.806117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1acf0c4e-aa7d-43ec-b8cf-1f18fa9a749c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:17.806742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1acf0c4e-aa7d-43ec-b8cf-1f18fa9a749c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:17.825204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1acf0c4e-aa7d-43ec-b8cf-1f18fa9a749c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:17.825650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1acf0c4e-aa7d-43ec-b8cf-1f18fa9a749c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:17.826437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1acf0c4e-aa7d-43ec-b8cf-1f18fa9a749c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:17.826885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1acf0c4e-aa7d-43ec-b8cf-1f18fa9a749c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:18.035088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:18.050571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:18.055543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:18.057792 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-580d25d7-e0ea-4f5d-9291-9943047eeadd tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.455091 Jul 26 19:55:18.059724 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1378/2775] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:17 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:18.085054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e49b220-4d5c-44ff-bd95-eb5b03ee4430 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:18.086126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2e49b220-4d5c-44ff-bd95-eb5b03ee4430 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:18.102490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e49b220-4d5c-44ff-bd95-eb5b03ee4430 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:18.103414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e49b220-4d5c-44ff-bd95-eb5b03ee4430 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:18.104694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e49b220-4d5c-44ff-bd95-eb5b03ee4430 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:18.105492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e49b220-4d5c-44ff-bd95-eb5b03ee4430 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:18.470206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e49b220-4d5c-44ff-bd95-eb5b03ee4430 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:18.484681 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e49b220-4d5c-44ff-bd95-eb5b03ee4430 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.406507 Jul 26 19:55:18.488562 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1379/2776] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:18 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:18.858679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1acf0c4e-aa7d-43ec-b8cf-1f18fa9a749c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:18.874135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1acf0c4e-aa7d-43ec-b8cf-1f18fa9a749c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1382 microversion: 2.1 time: 1.070077 Jul 26 19:55:18.886253 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1398/2777] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:17 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1382 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:18.902423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02a713dd-916c-4de2-a208-4d704e67b165 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:18.903058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02a713dd-916c-4de2-a208-4d704e67b165 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:18.922130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a713dd-916c-4de2-a208-4d704e67b165 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:18.923164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a713dd-916c-4de2-a208-4d704e67b165 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:18.925424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a713dd-916c-4de2-a208-4d704e67b165 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:18.927051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a713dd-916c-4de2-a208-4d704e67b165 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:18.941221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a58b929c-bc5b-48ed-841b-a1b86d4f7871 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Action: 'create', calling method: .version_select at 0x7f875eef19d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-8298668", "metadata": {"Type": "work"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a58b929c-bc5b-48ed-841b-a1b86d4f7871 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Request method failure captured: Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 119 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EamyYRTW3Zp_argWS4TEFZCyNjLZF7gWtlvgaP8SGkPEVKUja5aX9TjoZN4sLydqBLxOt5LdShOribqwzQ3AWW626P-8q57Df2-waSgzmRb9-V-7Q5qgYdesY_VEFnC58EkA4IYLEzUeqis8g1cmdGNxD_syOC2FRfwir7Jl1ESCpU Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c01c709cb8941abb4cad7adf6e2d493", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}] Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 667f813a2ea1434094819176aa25ca61 Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-8298668", "metadata": {"Type": "work"}}} Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-8298668', 'metadata': {'Type': 'work'}}}} Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:55:18.946319 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a58b929c-bc5b-48ed-841b-a1b86d4f7871 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:18.950482 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a58b929c-bc5b-48ed-841b-a1b86d4f7871 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.457994 Jul 26 19:55:18.951941 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1380/2778] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Jul 26 19:55:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 462 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:55:18.959214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d238b66-fd0e-4712-b9fc-41a0f0ff9789 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '.version_select at 0x7f875f06dca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:18.972732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d238b66-fd0e-4712-b9fc-41a0f0ff9789 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:18.976961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d238b66-fd0e-4712-b9fc-41a0f0ff9789 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:18.992603 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d238b66-fd0e-4712-b9fc-41a0f0ff9789 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2337 microversion: 2.1 time: 0.039007 Jul 26 19:55:19.011815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1381/2779] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:55:18 2022] GET /compute/v2.1/os-migrations => generated 2337 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:19.035923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ce17440-9cdf-4a76-b5f0-dee57d8dadea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Action: 'create', calling method: .version_select at 0x7f875f021e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-592131231", "metadata": {"Type": "work"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ce17440-9cdf-4a76-b5f0-dee57d8dadea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Request method failure captured: Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 119 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EamyYRTW3Zp_argWS4TEFZCyNjLZF7gWtlvgaP8SGkPEVKUja5aX9TjoZN4sLydqBLxOt5LdShOribqwzQ3AWW626P-8q57Df2-waSgzmRb9-V-7Q5qgYdesY_VEFnC58EkA4IYLEzUeqis8g1cmdGNxD_syOC2FRfwir7Jl1ESCpU Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c01c709cb8941abb4cad7adf6e2d493", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}] Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 667f813a2ea1434094819176aa25ca61 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-592131231", "metadata": {"Type": "work"}}} Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-592131231', 'metadata': {'Type': 'work'}}}} Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi '0' Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:55:19.040102 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 19:55:19.044215 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.046379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ce17440-9cdf-4a76-b5f0-dee57d8dadea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:19.047408 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6ce17440-9cdf-4a76-b5f0-dee57d8dadea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034277 Jul 26 19:55:19.049076 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1382/2780] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Jul 26 19:55:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:55:19.056831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a997180d-16c4-41f2-960a-5ddecf49d5d5 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:19.057659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a997180d-16c4-41f2-960a-5ddecf49d5d5 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:19.077883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a997180d-16c4-41f2-960a-5ddecf49d5d5 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.078629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a997180d-16c4-41f2-960a-5ddecf49d5d5 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.079580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a997180d-16c4-41f2-960a-5ddecf49d5d5 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.080238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a997180d-16c4-41f2-960a-5ddecf49d5d5 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.277391 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a997180d-16c4-41f2-960a-5ddecf49d5d5 tempest-LiveMigrationTest-1945098071 tempest-LiveMigrationTest-1945098071-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1533 microversion: 2.1 time: 0.227039 Jul 26 19:55:19.278167 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1383/2781] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:19 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1533 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:19.284852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd5c1e2b-883f-46e1-9a6f-d9511c6554fb tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Action: 'create', calling method: .version_select at 0x7f87682d9790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1640989152", "metadata": {"Type": "work"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd5c1e2b-883f-46e1-9a6f-d9511c6554fb tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Request method failure captured: Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 119 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EamyYRTW3Zp_argWS4TEFZCyNjLZF7gWtlvgaP8SGkPEVKUja5aX9TjoZN4sLydqBLxOt5LdShOribqwzQ3AWW626P-8q57Df2-waSgzmRb9-V-7Q5qgYdesY_VEFnC58EkA4IYLEzUeqis8g1cmdGNxD_syOC2FRfwir7Jl1ESCpU Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c01c709cb8941abb4cad7adf6e2d493", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}] Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 667f813a2ea1434094819176aa25ca61 Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1640989152", "metadata": {"Type": "work"}}} Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1640989152', 'metadata': {'Type': 'work'}}}} Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi '' Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:55:19.289205 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 19:55:19.293126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.295822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd5c1e2b-883f-46e1-9a6f-d9511c6554fb tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:19.296860 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bd5c1e2b-883f-46e1-9a6f-d9511c6554fb tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017203 Jul 26 19:55:19.297603 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1384/2782] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Jul 26 19:55:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:55:19.308204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:19.309289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:19.318992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.319475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.321211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.321915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.359510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02a713dd-916c-4de2-a208-4d704e67b165 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:19.382916 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02a713dd-916c-4de2-a208-4d704e67b165 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1735 microversion: 2.1 time: 0.495482 Jul 26 19:55:19.383532 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1399/2783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:18 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1735 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:19.397771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a8c9453e-b91b-4c9d-a876-e87fd01beaa1 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Calling method '.version_select at 0x7f87567aa8b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:19.454112 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-a8c9453e-b91b-4c9d-a876-e87fd01beaa1 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] HTTP exception thrown: Volume tempest-invalid-1595278269 could not be found. Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a8c9453e-b91b-4c9d-a876-e87fd01beaa1 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Request method failure captured: Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1595278269 HTTP/1.1 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EamyYRTW3Zp_argWS4TEFZCyNjLZF7gWtlvgaP8SGkPEVKUja5aX9TjoZN4sLydqBLxOt5LdShOribqwzQ3AWW626P-8q57Df2-waSgzmRb9-V-7Q5qgYdesY_VEFnC58EkA4IYLEzUeqis8g1cmdGNxD_syOC2FRfwir7Jl1ESCpU Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c01c709cb8941abb4cad7adf6e2d493", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}] Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 667f813a2ea1434094819176aa25ca61 Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: exception: Volume tempest-invalid-1595278269 could not be found. Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'tempest-invalid-1595278269'} Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1595278269 could not be found. (HTTP 404) (Request-ID: req-c01fe06b-5744-4d75-9fe4-37268e1344f3) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:55:19.458002 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1595278269 could not be found. Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1595278269 could not be found. Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1595278269 could not be found. Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a8c9453e-b91b-4c9d-a876-e87fd01beaa1 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Returning 404 to user: Volume tempest-invalid-1595278269 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:19.462206 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a8c9453e-b91b-4c9d-a876-e87fd01beaa1 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1595278269" status: 404 len: 99 microversion: 2.1 time: 0.074941 Jul 26 19:55:19.465452 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1400/2784] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:55:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1595278269 => generated 99 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:55:19.474643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b2fce512-fc2e-41c4-8f43-65a95c95def9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:19.475174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b2fce512-fc2e-41c4-8f43-65a95c95def9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:19.494616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2fce512-fc2e-41c4-8f43-65a95c95def9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.495080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2fce512-fc2e-41c4-8f43-65a95c95def9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.497751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2fce512-fc2e-41c4-8f43-65a95c95def9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.498233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2fce512-fc2e-41c4-8f43-65a95c95def9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.535361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b2fce512-fc2e-41c4-8f43-65a95c95def9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:55:19.709496 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b2fce512-fc2e-41c4-8f43-65a95c95def9 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 204 len: 0 microversion: 2.1 time: 0.242488 Jul 26 19:55:19.710126 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1401/2785] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:55:19 2022] DELETE /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:19.727802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c309eb6c-84b4-4618-9084-da907d3fecd5 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009538 Jul 26 19:55:19.728343 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1402/2786] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Jul 26 19:55:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 19:55:19.748176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03461b62-203e-4ab3-9f71-6098d64ee29f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:19.748884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03461b62-203e-4ab3-9f71-6098d64ee29f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:19.760520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03461b62-203e-4ab3-9f71-6098d64ee29f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.761767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03461b62-203e-4ab3-9f71-6098d64ee29f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.762735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03461b62-203e-4ab3-9f71-6098d64ee29f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.763329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03461b62-203e-4ab3-9f71-6098d64ee29f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.808605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:19.821765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:19.824036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:19.825498 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c18b8a3-71f0-43ef-9988-d014d9fb4f2d tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.522037 Jul 26 19:55:19.839735 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1385/2787] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:19 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:19.850408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f46cf54e-84eb-4aff-90d6-6f3f334dd3d0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:19.851048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f46cf54e-84eb-4aff-90d6-6f3f334dd3d0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:19.858116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f46cf54e-84eb-4aff-90d6-6f3f334dd3d0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.858573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f46cf54e-84eb-4aff-90d6-6f3f334dd3d0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:19.859361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f46cf54e-84eb-4aff-90d6-6f3f334dd3d0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:19.859830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f46cf54e-84eb-4aff-90d6-6f3f334dd3d0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:20.148511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f46cf54e-84eb-4aff-90d6-6f3f334dd3d0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:20.157495 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f46cf54e-84eb-4aff-90d6-6f3f334dd3d0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1388 microversion: 2.1 time: 0.324093 Jul 26 19:55:20.166144 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1386/2788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:19 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1388 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:20.170912 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a535dc1b-40d1-486b-ab44-cefe61bd33e6 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003669 Jul 26 19:55:20.171418 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1387/2789] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:55:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 19:55:20.262751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03461b62-203e-4ab3-9f71-6098d64ee29f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:20.281864 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03461b62-203e-4ab3-9f71-6098d64ee29f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.552383 Jul 26 19:55:20.299296 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1403/2790] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:19 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:20.307642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d329202-e43d-471a-ba3d-be1918d2f853 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Calling method '.version_select at 0x7f87567639d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:20.317498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-671a1b40-7c32-4bf2-a4ff-6fb4a14f5fba tempest-AbsoluteLimitsTestJSON-497430486 tempest-AbsoluteLimitsTestJSON-497430486-project] Calling method '.version_select at 0x7f87682a5e50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:20.335240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-671a1b40-7c32-4bf2-a4ff-6fb4a14f5fba tempest-AbsoluteLimitsTestJSON-497430486 tempest-AbsoluteLimitsTestJSON-497430486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:20.335722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-671a1b40-7c32-4bf2-a4ff-6fb4a14f5fba tempest-AbsoluteLimitsTestJSON-497430486 tempest-AbsoluteLimitsTestJSON-497430486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:20.337196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-671a1b40-7c32-4bf2-a4ff-6fb4a14f5fba tempest-AbsoluteLimitsTestJSON-497430486 tempest-AbsoluteLimitsTestJSON-497430486-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:20.338271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-671a1b40-7c32-4bf2-a4ff-6fb4a14f5fba tempest-AbsoluteLimitsTestJSON-497430486 tempest-AbsoluteLimitsTestJSON-497430486-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:20.358310 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-9d329202-e43d-471a-ba3d-be1918d2f853 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] HTTP exception thrown: Volume ebcc5782-e684-4970-bd09-93c7366bce24 could not be found. Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d329202-e43d-471a-ba3d-be1918d2f853 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Request method failure captured: Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-volumes/ebcc5782-e684-4970-bd09-93c7366bce24 HTTP/1.1 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EamyYRTW3Zp_argWS4TEFZCyNjLZF7gWtlvgaP8SGkPEVKUja5aX9TjoZN4sLydqBLxOt5LdShOribqwzQ3AWW626P-8q57Df2-waSgzmRb9-V-7Q5qgYdesY_VEFnC58EkA4IYLEzUeqis8g1cmdGNxD_syOC2FRfwir7Jl1ESCpU Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c01c709cb8941abb4cad7adf6e2d493", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}] Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 667f813a2ea1434094819176aa25ca61 Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: exception: Volume ebcc5782-e684-4970-bd09-93c7366bce24 could not be found. Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ebcc5782-e684-4970-bd09-93c7366bce24'} Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebcc5782-e684-4970-bd09-93c7366bce24 could not be found. (HTTP 404) (Request-ID: req-3fc237b5-9ab5-4e5f-870b-421598db7f4c) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:55:20.360504 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebcc5782-e684-4970-bd09-93c7366bce24 could not be found. Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebcc5782-e684-4970-bd09-93c7366bce24 could not be found. Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebcc5782-e684-4970-bd09-93c7366bce24 could not be found. Jul 26 19:55:20.365719 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.370298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d329202-e43d-471a-ba3d-be1918d2f853 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Returning 404 to user: Volume ebcc5782-e684-4970-bd09-93c7366bce24 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:20.372446 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9d329202-e43d-471a-ba3d-be1918d2f853 tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/ebcc5782-e684-4970-bd09-93c7366bce24" status: 404 len: 109 microversion: 2.1 time: 0.069543 Jul 26 19:55:20.373129 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1404/2791] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 19:55:20 2022] DELETE /compute/v2.1/os-volumes/ebcc5782-e684-4970-bd09-93c7366bce24 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:55:20.382819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16dd21ba-c30d-436a-8ed1-f690aa4526ea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Calling method '.version_select at 0x7f87567aae50>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:20.402948 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-671a1b40-7c32-4bf2-a4ff-6fb4a14f5fba tempest-AbsoluteLimitsTestJSON-497430486 tempest-AbsoluteLimitsTestJSON-497430486-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.230384 Jul 26 19:55:20.414102 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1388/2792] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Jul 26 19:55:20 2022] GET /compute/v2.1/limits => generated 511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:20.415521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15bb11c7-9b2b-40ec-a013-d8c6fc844440 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:20.416612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-15bb11c7-9b2b-40ec-a013-d8c6fc844440 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:20.426764 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-16dd21ba-c30d-436a-8ed1-f690aa4526ea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] HTTP exception thrown: Volume d229aa30-54d5-46e2-876e-f12dccd6ae38 could not be found. Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16dd21ba-c30d-436a-8ed1-f690aa4526ea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Request method failure captured: Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-volumes/d229aa30-54d5-46e2-876e-f12dccd6ae38 HTTP/1.1 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EamyYRTW3Zp_argWS4TEFZCyNjLZF7gWtlvgaP8SGkPEVKUja5aX9TjoZN4sLydqBLxOt5LdShOribqwzQ3AWW626P-8q57Df2-waSgzmRb9-V-7Q5qgYdesY_VEFnC58EkA4IYLEzUeqis8g1cmdGNxD_syOC2FRfwir7Jl1ESCpU Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c01c709cb8941abb4cad7adf6e2d493", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c01c709cb8941abb4cad7adf6e2d493"}]}] Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6c01c709cb8941abb4cad7adf6e2d493 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-VolumesNegativeTest-991558581 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 667f813a2ea1434094819176aa25ca61 Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-VolumesNegativeTest-991558581-project Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: exception: Volume d229aa30-54d5-46e2-876e-f12dccd6ae38 could not be found. Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd229aa30-54d5-46e2-876e-f12dccd6ae38'} Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d229aa30-54d5-46e2-876e-f12dccd6ae38 could not be found. (HTTP 404) (Request-ID: req-a6f65218-1d02-4bf9-b185-c23c6c607505) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:55:20.428856 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d229aa30-54d5-46e2-876e-f12dccd6ae38 could not be found. Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d229aa30-54d5-46e2-876e-f12dccd6ae38 could not be found. Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d229aa30-54d5-46e2-876e-f12dccd6ae38 could not be found. Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16dd21ba-c30d-436a-8ed1-f690aa4526ea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] Returning 404 to user: Volume d229aa30-54d5-46e2-876e-f12dccd6ae38 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16dd21ba-c30d-436a-8ed1-f690aa4526ea tempest-VolumesNegativeTest-991558581 tempest-VolumesNegativeTest-991558581-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d229aa30-54d5-46e2-876e-f12dccd6ae38" status: 404 len: 109 microversion: 2.1 time: 0.051480 Jul 26 19:55:20.433342 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1405/2793] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:55:20 2022] GET /compute/v2.1/os-volumes/d229aa30-54d5-46e2-876e-f12dccd6ae38 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:55:20.436456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15bb11c7-9b2b-40ec-a013-d8c6fc844440 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:20.436456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15bb11c7-9b2b-40ec-a013-d8c6fc844440 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:20.436456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15bb11c7-9b2b-40ec-a013-d8c6fc844440 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:20.436456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15bb11c7-9b2b-40ec-a013-d8c6fc844440 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:20.855240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:20.855970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:20.864486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:20.865404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:20.866334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:20.866909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.099970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15bb11c7-9b2b-40ec-a013-d8c6fc844440 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:21.117501 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15bb11c7-9b2b-40ec-a013-d8c6fc844440 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1715 microversion: 2.1 time: 0.706336 Jul 26 19:55:21.118097 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1389/2794] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:20 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1715 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:21.178870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-583b9aa0-4224-4285-8a27-958a413e3e42 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:21.180130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-583b9aa0-4224-4285-8a27-958a413e3e42 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:21.189012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-583b9aa0-4224-4285-8a27-958a413e3e42 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.194712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-583b9aa0-4224-4285-8a27-958a413e3e42 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.195559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-583b9aa0-4224-4285-8a27-958a413e3e42 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.196041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-583b9aa0-4224-4285-8a27-958a413e3e42 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.232500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:21.242649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:21.244562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:21.245954 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c79a03b-e63d-46fb-8fff-5725d1716496 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.395536 Jul 26 19:55:21.246985 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1406/2795] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:20 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:21.271507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:21.272724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:21.274958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:21.282265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.282628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.284016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.284475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.388886 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Cannot 'detach_volume' instance 1a506c0f-7d8b-4671-9667-185ede749851 while it is in vm_state rescued Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments/59da52b8-0fdf-42b0-adb4-d6a947969567 HTTP/1.1 Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'detach_volume' instance 1a506c0f-7d8b-4671-9667-185ede749851 while it is in vm_state rescued Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'server_id': '1a506c0f-7d8b-4671-9667-185ede749851', 'id': '59da52b8-0fdf-42b0-adb4-d6a947969567'} Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a506c0f-7d8b-4671-9667-185ede749851 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1a506c0f-7d8b-4671-9667-185ede749851 while it is in vm_state rescued Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:21.392218 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:21.398046 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:21.398046 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:21.398046 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:21.398046 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:21.398046 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1a506c0f-7d8b-4671-9667-185ede749851 while it is in vm_state rescued Jul 26 19:55:21.398046 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:21.399948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 409 to user: Cannot 'detach_volume' instance 1a506c0f-7d8b-4671-9667-185ede749851 while it is in vm_state rescued {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:21.401247 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63ee7653-e870-4503-a396-2d645f8e7cdb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments/59da52b8-0fdf-42b0-adb4-d6a947969567" status: 409 len: 152 microversion: 2.1 time: 0.134358 Jul 26 19:55:21.406585 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1407/2796] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 19:55:21 2022] DELETE /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments/59da52b8-0fdf-42b0-adb4-d6a947969567 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:55:21.414429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-602c1227-0575-4f66-b4da-aa9389da8154 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:21.415078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-602c1227-0575-4f66-b4da-aa9389da8154 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:21.423270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-602c1227-0575-4f66-b4da-aa9389da8154 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.423801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-602c1227-0575-4f66-b4da-aa9389da8154 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.424928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-602c1227-0575-4f66-b4da-aa9389da8154 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.425512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-602c1227-0575-4f66-b4da-aa9389da8154 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.630622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-583b9aa0-4224-4285-8a27-958a413e3e42 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:21.643978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-583b9aa0-4224-4285-8a27-958a413e3e42 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1388 microversion: 2.1 time: 0.469353 Jul 26 19:55:21.648175 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1390/2797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:21 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1388 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:21.664768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5383ce07-be66-4b92-8009-00a4ff903d10 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:21.665310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5383ce07-be66-4b92-8009-00a4ff903d10 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:21.673162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5383ce07-be66-4b92-8009-00a4ff903d10 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.673648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5383ce07-be66-4b92-8009-00a4ff903d10 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.674848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5383ce07-be66-4b92-8009-00a4ff903d10 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.675444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5383ce07-be66-4b92-8009-00a4ff903d10 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.774730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-602c1227-0575-4f66-b4da-aa9389da8154 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:21.787998 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-602c1227-0575-4f66-b4da-aa9389da8154 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.380131 Jul 26 19:55:21.791388 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1408/2798] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:21 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:21.808071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:21.823354 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5383ce07-be66-4b92-8009-00a4ff903d10 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/action" status: 202 len: 0 microversion: 2.1 time: 0.170511 Jul 26 19:55:21.829148 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1391/2799] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:55:21 2022] POST /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:55:21.835944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e1de6e5b-ab5d-451c-b697-e9e7b1a9bd16 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:21.837123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e1de6e5b-ab5d-451c-b697-e9e7b1a9bd16 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:21.856485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1de6e5b-ab5d-451c-b697-e9e7b1a9bd16 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.858216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1de6e5b-ab5d-451c-b697-e9e7b1a9bd16 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:21.862423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1de6e5b-ab5d-451c-b697-e9e7b1a9bd16 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:21.863164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1de6e5b-ab5d-451c-b697-e9e7b1a9bd16 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:22.109031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1de6e5b-ab5d-451c-b697-e9e7b1a9bd16 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:22.127475 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e1de6e5b-ab5d-451c-b697-e9e7b1a9bd16 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1723 microversion: 2.1 time: 0.287298 Jul 26 19:55:22.128207 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1409/2800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:21 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:22.275692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:22.276484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:22.287112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:22.287565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:22.291210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:22.295907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:22.579323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-cdc4e11a-95ca-43a1-8d13-8f1eff9f2ece req-5dd2b75b-4f8c-4cd3-bd3c-5a9fafe34bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f809b93-6a29-4300-8ed5-d02bd3b8f158", "name": "network-vif-deleted", "tag": "ae4ca5b7-137d-47f2-a766-8a77b84b61ef"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:22.600081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cdc4e11a-95ca-43a1-8d13-8f1eff9f2ece req-5dd2b75b-4f8c-4cd3-bd3c-5a9fafe34bd6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:22.600505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cdc4e11a-95ca-43a1-8d13-8f1eff9f2ece req-5dd2b75b-4f8c-4cd3-bd3c-5a9fafe34bd6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:22.629537 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-cdc4e11a-95ca-43a1-8d13-8f1eff9f2ece req-5dd2b75b-4f8c-4cd3-bd3c-5a9fafe34bd6 service nova] Creating event network-vif-deleted:ae4ca5b7-137d-47f2-a766-8a77b84b61ef for instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 on n-h1-708768-8 Jul 26 19:55:22.637645 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-cdc4e11a-95ca-43a1-8d13-8f1eff9f2ece req-5dd2b75b-4f8c-4cd3-bd3c-5a9fafe34bd6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061917 Jul 26 19:55:22.638805 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1410/2801] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:55:22.695752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d021fd9a-f741-48fa-88b5-9d968e24d91c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:22.696819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d021fd9a-f741-48fa-88b5-9d968e24d91c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:22.725215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d021fd9a-f741-48fa-88b5-9d968e24d91c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:22.730608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d021fd9a-f741-48fa-88b5-9d968e24d91c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:22.731786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d021fd9a-f741-48fa-88b5-9d968e24d91c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:22.734901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d021fd9a-f741-48fa-88b5-9d968e24d91c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:22.746290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:22.749460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:22.761404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:22.762941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:22.764162 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-86423220-3513-47bf-b95a-3ee56a09c690 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.495433 Jul 26 19:55:22.764746 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1392/2802] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:22 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:22.814457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:22.814994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:22.821954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:22.822406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:22.823190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:22.836913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:22.891189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d021fd9a-f741-48fa-88b5-9d968e24d91c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:22.907356 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d021fd9a-f741-48fa-88b5-9d968e24d91c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1184 microversion: 2.1 time: 0.241281 Jul 26 19:55:22.908328 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1411/2803] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:22 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1184 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:23.154170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0683fbf3-577e-4fa0-b294-b8acf7e7df29 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:23.156544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0683fbf3-577e-4fa0-b294-b8acf7e7df29 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:23.171700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0683fbf3-577e-4fa0-b294-b8acf7e7df29 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:23.180618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0683fbf3-577e-4fa0-b294-b8acf7e7df29 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:23.186347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0683fbf3-577e-4fa0-b294-b8acf7e7df29 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:23.188386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0683fbf3-577e-4fa0-b294-b8acf7e7df29 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:23.275159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:23.283475 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.472907 Jul 26 19:55:23.287909 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1393/2804] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:22 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:23.364844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:23.366121 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001647 Jul 26 19:55:23.366675 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1394/2805] 10.222.0.58 () {56 vars in 886 bytes} [Tue Jul 26 19:55:23 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 26 19:55:23.374545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:23.375990 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001838 Jul 26 19:55:23.376604 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1395/2806] 10.222.0.58 () {54 vars in 1035 bytes} [Tue Jul 26 19:55:23 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 26 19:55:23.383589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:23.385587 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002360 Jul 26 19:55:23.395407 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1396/2807] 10.222.0.58 () {54 vars in 1041 bytes} [Tue Jul 26 19:55:23 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:23.397071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:23.398200 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-862ae0d1-96e0-4776-a29a-91a6f26e7dc1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001613 Jul 26 19:55:23.408618 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1397/2808] 10.222.0.58 () {56 vars in 886 bytes} [Tue Jul 26 19:55:23 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 19:55:23.794240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:23.795063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:23.810491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:23.812463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:23.814966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:23.818731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:23.931045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0683fbf3-577e-4fa0-b294-b8acf7e7df29 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:23.957660 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0683fbf3-577e-4fa0-b294-b8acf7e7df29 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1723 microversion: 2.1 time: 0.799485 Jul 26 19:55:23.958763 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1412/2809] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:23 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1723 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:23.988968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68958087-9322-4ff7-8551-461dc323b062 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:23.992215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68958087-9322-4ff7-8551-461dc323b062 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:24.015440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68958087-9322-4ff7-8551-461dc323b062 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:24.015923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68958087-9322-4ff7-8551-461dc323b062 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:24.019437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68958087-9322-4ff7-8551-461dc323b062 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:24.024300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68958087-9322-4ff7-8551-461dc323b062 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:24.226521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68958087-9322-4ff7-8551-461dc323b062 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:24.253637 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68958087-9322-4ff7-8551-461dc323b062 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1184 microversion: 2.1 time: 0.278600 Jul 26 19:55:24.254250 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1413/2810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:23 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1184 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:24.312131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bb0fc6d2-0f8c-447d-a67e-3ef0849ad9bf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:24.315793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bb0fc6d2-0f8c-447d-a67e-3ef0849ad9bf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:24.330649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb0fc6d2-0f8c-447d-a67e-3ef0849ad9bf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:24.336340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb0fc6d2-0f8c-447d-a67e-3ef0849ad9bf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:24.338204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb0fc6d2-0f8c-447d-a67e-3ef0849ad9bf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:24.341226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb0fc6d2-0f8c-447d-a67e-3ef0849ad9bf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:24.619578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:24.645591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:24.650342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:24.668986 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-644c9f05-b9ea-44c0-8fb1-7948dc2f50e3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.865814 Jul 26 19:55:24.672459 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1398/2811] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:23 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:24.915500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bb0fc6d2-0f8c-447d-a67e-3ef0849ad9bf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:24.926342 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bb0fc6d2-0f8c-447d-a67e-3ef0849ad9bf tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.620303 Jul 26 19:55:24.932722 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1414/2812] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:24 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:24.986759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-892704b9-8c7b-421b-b63d-74352aae044e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:24.987678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-892704b9-8c7b-421b-b63d-74352aae044e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:25.003242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-892704b9-8c7b-421b-b63d-74352aae044e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:25.005463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-892704b9-8c7b-421b-b63d-74352aae044e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:25.009493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-892704b9-8c7b-421b-b63d-74352aae044e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:25.011152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-892704b9-8c7b-421b-b63d-74352aae044e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:25.274941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f192f398-2f51-4401-9b04-e4fa92f75acb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:25.275665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f192f398-2f51-4401-9b04-e4fa92f75acb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:25.296825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f192f398-2f51-4401-9b04-e4fa92f75acb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:25.299322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f192f398-2f51-4401-9b04-e4fa92f75acb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:25.301918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f192f398-2f51-4401-9b04-e4fa92f75acb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:25.303331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f192f398-2f51-4401-9b04-e4fa92f75acb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:25.442443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f192f398-2f51-4401-9b04-e4fa92f75acb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:25.457691 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f192f398-2f51-4401-9b04-e4fa92f75acb tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1184 microversion: 2.1 time: 0.186947 Jul 26 19:55:25.459827 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1415/2813] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:25 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1184 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:25.480912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-165842985", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "4d8e34b1-c63f-47c7-a240-0f5ab19b407f"}, {"uuid": "dcf8ba35-46f9-4ba8-9c59-07d8c812ec69"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:25.608218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] validate_networks() for [('4d8e34b1-c63f-47c7-a240-0f5ab19b407f', None, None, None, None, None), ('dcf8ba35-46f9-4ba8-9c59-07d8c812ec69', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:55:26.053045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=20 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:26.104795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-892704b9-8c7b-421b-b63d-74352aae044e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:26.128414 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-892704b9-8c7b-421b-b63d-74352aae044e tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1723 microversion: 2.1 time: 1.141516 Jul 26 19:55:26.132879 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1399/2814] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:24 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1723 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:26.153273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:26.157196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:26.181685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:26.183978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:26.187673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:26.189416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:26.770319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:26.781951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:26.793657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:26.795808 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-48c7cbe3-6cb5-4879-91d5-7c707bc978a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.661842 Jul 26 19:55:26.796422 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1400/2815] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:26 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:26.815708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3ad6b28-202e-4be6-99b2-7dbcf5730874 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:26.816337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a3ad6b28-202e-4be6-99b2-7dbcf5730874 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:26.843438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3ad6b28-202e-4be6-99b2-7dbcf5730874 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:26.843916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3ad6b28-202e-4be6-99b2-7dbcf5730874 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:26.844708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3ad6b28-202e-4be6-99b2-7dbcf5730874 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:26.845211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3ad6b28-202e-4be6-99b2-7dbcf5730874 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.020851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:55:27.021282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:55:27.021762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:55:27.022854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:55:27.023291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:55:27.047515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:27.048007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.049440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:27.049886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.102804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Getting quotas for project 114f0f8e78814e9089f720705dc2319c. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:27.119439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Getting quotas for user ff33e693dc4141e7b4667bee9c2cebfc and project 114f0f8e78814e9089f720705dc2319c. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:27.156781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:55:27.165900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:55:27.235471 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f50647d8-cc1f-4215-9cc6-db2f609b9e30 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774180 Jul 26 19:55:27.239021 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1416/2816] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:55:27.251226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef96dee8-74d0-474c-b8d5-0ec73f62fa16 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:27.252712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef96dee8-74d0-474c-b8d5-0ec73f62fa16 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:27.268932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef96dee8-74d0-474c-b8d5-0ec73f62fa16 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:27.271633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef96dee8-74d0-474c-b8d5-0ec73f62fa16 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.272670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef96dee8-74d0-474c-b8d5-0ec73f62fa16 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:27.274800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef96dee8-74d0-474c-b8d5-0ec73f62fa16 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.507537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ef96dee8-74d0-474c-b8d5-0ec73f62fa16 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:27.516298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef96dee8-74d0-474c-b8d5-0ec73f62fa16 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1184 microversion: 2.1 time: 0.275248 Jul 26 19:55:27.519779 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1417/2817] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:27 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1184 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:27.536453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afae1a38-41df-45d2-9bb0-efa35ea6293b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:27.537093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-afae1a38-41df-45d2-9bb0-efa35ea6293b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:27.554542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afae1a38-41df-45d2-9bb0-efa35ea6293b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:27.557178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afae1a38-41df-45d2-9bb0-efa35ea6293b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.558139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afae1a38-41df-45d2-9bb0-efa35ea6293b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:27.559800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afae1a38-41df-45d2-9bb0-efa35ea6293b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.667134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3ad6b28-202e-4be6-99b2-7dbcf5730874 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:27.693486 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3ad6b28-202e-4be6-99b2-7dbcf5730874 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 0.895770 Jul 26 19:55:27.702362 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1401/2818] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:26 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:27.718220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d32ca954-7f94-4e87-ac33-8c27f66ca90d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:27.720847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d32ca954-7f94-4e87-ac33-8c27f66ca90d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:27.851971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afae1a38-41df-45d2-9bb0-efa35ea6293b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:27.866705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afae1a38-41df-45d2-9bb0-efa35ea6293b tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1729 microversion: 2.1 time: 0.345445 Jul 26 19:55:27.884456 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1418/2819] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:27 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1729 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:27.890965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:27.891585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:27.916102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:27.916735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.917721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:27.918423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:27.989776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d32ca954-7f94-4e87-ac33-8c27f66ca90d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:28.006725 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d32ca954-7f94-4e87-ac33-8c27f66ca90d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1212 microversion: 2.1 time: 0.303058 Jul 26 19:55:28.009479 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1402/2820] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:27 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1212 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:28.025396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-248a56d9-9520-4ad5-b3f3-af6519f15aa9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:28.031490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-248a56d9-9520-4ad5-b3f3-af6519f15aa9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:28.042895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:28.045064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-248a56d9-9520-4ad5-b3f3-af6519f15aa9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:28.046288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-248a56d9-9520-4ad5-b3f3-af6519f15aa9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:28.047298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-248a56d9-9520-4ad5-b3f3-af6519f15aa9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:28.048002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-248a56d9-9520-4ad5-b3f3-af6519f15aa9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:28.370598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:28.388919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:28.396468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:28.401610 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7b59df1-0098-4415-addb-4eab0f938cc6 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.512436 Jul 26 19:55:28.402888 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1419/2821] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:27 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:28.416455 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-248a56d9-9520-4ad5-b3f3-af6519f15aa9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.402964 Jul 26 19:55:28.416455 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1403/2822] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:55:28 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-interface => generated 284 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:28.540757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cff3d04c-88f2-4a2e-b210-3276cae868ab tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:28.541406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cff3d04c-88f2-4a2e-b210-3276cae868ab tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:28.554836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cff3d04c-88f2-4a2e-b210-3276cae868ab tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:28.561446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cff3d04c-88f2-4a2e-b210-3276cae868ab tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:28.573895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cff3d04c-88f2-4a2e-b210-3276cae868ab tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:28.575854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cff3d04c-88f2-4a2e-b210-3276cae868ab tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:28.738093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af4ed5ce-3d71-41ea-a504-dcb8c8d71dbb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:28.739712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af4ed5ce-3d71-41ea-a504-dcb8c8d71dbb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:28.754707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af4ed5ce-3d71-41ea-a504-dcb8c8d71dbb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:28.756010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af4ed5ce-3d71-41ea-a504-dcb8c8d71dbb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:28.759494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cff3d04c-88f2-4a2e-b210-3276cae868ab tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:28.760384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af4ed5ce-3d71-41ea-a504-dcb8c8d71dbb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:28.761933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af4ed5ce-3d71-41ea-a504-dcb8c8d71dbb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:28.771557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cff3d04c-88f2-4a2e-b210-3276cae868ab tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1184 microversion: 2.1 time: 0.236108 Jul 26 19:55:28.772424 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1420/2823] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:28 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1184 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:29.030542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-58d52f4f-5aca-4988-a117-f3cc7413a3af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:29.031500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-58d52f4f-5aca-4988-a117-f3cc7413a3af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:29.051801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58d52f4f-5aca-4988-a117-f3cc7413a3af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:29.052302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58d52f4f-5aca-4988-a117-f3cc7413a3af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:29.053145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58d52f4f-5aca-4988-a117-f3cc7413a3af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:29.059043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58d52f4f-5aca-4988-a117-f3cc7413a3af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:29.249363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-58d52f4f-5aca-4988-a117-f3cc7413a3af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:29.262115 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-58d52f4f-5aca-4988-a117-f3cc7413a3af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1208 microversion: 2.1 time: 0.234895 Jul 26 19:55:29.276954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1421/2824] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:29 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1208 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:29.432098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:29.433010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:29.460005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:29.460594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:29.461439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:29.461885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:30.217515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-af4ed5ce-3d71-41ea-a504-dcb8c8d71dbb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:30.231832 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af4ed5ce-3d71-41ea-a504-dcb8c8d71dbb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1476 microversion: 2.1 time: 1.504901 Jul 26 19:55:30.233726 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1404/2825] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:28 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1476 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:30.246297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fefa72d9-09f1-4857-82bc-b3f16693ef07 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:30.247141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fefa72d9-09f1-4857-82bc-b3f16693ef07 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:30.263727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fefa72d9-09f1-4857-82bc-b3f16693ef07 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:30.264474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fefa72d9-09f1-4857-82bc-b3f16693ef07 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:30.265525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fefa72d9-09f1-4857-82bc-b3f16693ef07 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:30.266083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fefa72d9-09f1-4857-82bc-b3f16693ef07 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:30.351407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:30.489690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fefa72d9-09f1-4857-82bc-b3f16693ef07 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:30.500620 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fefa72d9-09f1-4857-82bc-b3f16693ef07 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1184 microversion: 2.1 time: 0.265661 Jul 26 19:55:30.501432 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1405/2826] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:30 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1184 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:30.515385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-287996b3-25ff-44a0-96a3-8a691590f820 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:30.516238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-287996b3-25ff-44a0-96a3-8a691590f820 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:30.524915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-287996b3-25ff-44a0-96a3-8a691590f820 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:30.525365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-287996b3-25ff-44a0-96a3-8a691590f820 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:30.526137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-287996b3-25ff-44a0-96a3-8a691590f820 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:30.526560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-287996b3-25ff-44a0-96a3-8a691590f820 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:30.637995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:30.648509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:30.650021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:30.651201 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1edd0d7-d475-4580-b891-b54365a3e9eb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 1.224641 Jul 26 19:55:30.651801 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1422/2827] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:29 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:55:31.259571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-057679fc-0626-47e4-86e8-af2d6f52e86b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:31.260625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-057679fc-0626-47e4-86e8-af2d6f52e86b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:31.279904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-057679fc-0626-47e4-86e8-af2d6f52e86b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:31.280371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-057679fc-0626-47e4-86e8-af2d6f52e86b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:31.281339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-057679fc-0626-47e4-86e8-af2d6f52e86b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:31.281810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-057679fc-0626-47e4-86e8-af2d6f52e86b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:31.451594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-287996b3-25ff-44a0-96a3-8a691590f820 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:31.463504 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-287996b3-25ff-44a0-96a3-8a691590f820 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1270 microversion: 2.1 time: 0.960723 Jul 26 19:55:31.473752 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1406/2828] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:30 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1270 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:31.479552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a0e13e93-e0ed-40b7-9f32-d24a8001521a req-52c903de-b72d-4461-99f5-e3bcef8cfd43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a506c0f-7d8b-4671-9667-185ede749851", "tag": "f57edbd3-22f4-4ba5-a486-93b6bb48d154"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:31.508732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a0e13e93-e0ed-40b7-9f32-d24a8001521a req-52c903de-b72d-4461-99f5-e3bcef8cfd43 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:31.509185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a0e13e93-e0ed-40b7-9f32-d24a8001521a req-52c903de-b72d-4461-99f5-e3bcef8cfd43 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:31.526054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a0e13e93-e0ed-40b7-9f32-d24a8001521a req-52c903de-b72d-4461-99f5-e3bcef8cfd43 service nova] Creating event network-changed:f57edbd3-22f4-4ba5-a486-93b6bb48d154 for instance 1a506c0f-7d8b-4671-9667-185ede749851 on n-h2-708768-8 Jul 26 19:55:31.533005 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a0e13e93-e0ed-40b7-9f32-d24a8001521a req-52c903de-b72d-4461-99f5-e3bcef8cfd43 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056837 Jul 26 19:55:31.534375 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1407/2829] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:31.541022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c9428f50-3246-420f-95ed-7a77fdc207d2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:31.542027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c9428f50-3246-420f-95ed-7a77fdc207d2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:31.549746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c9428f50-3246-420f-95ed-7a77fdc207d2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:31.550948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c9428f50-3246-420f-95ed-7a77fdc207d2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:31.552049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c9428f50-3246-420f-95ed-7a77fdc207d2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:31.552643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c9428f50-3246-420f-95ed-7a77fdc207d2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:31.645868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-057679fc-0626-47e4-86e8-af2d6f52e86b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:31.657152 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-057679fc-0626-47e4-86e8-af2d6f52e86b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1475 microversion: 2.1 time: 0.401633 Jul 26 19:55:31.658566 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1423/2830] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:31 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1475 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:31.679015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:31.679994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:31.691140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:31.693011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:31.694750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:31.695470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:32.107373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:32.121567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:32.123289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:32.125419 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5302450-c5d1-481e-9013-d29d532c212a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.450413 Jul 26 19:55:32.141913 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1424/2831] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:31 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:55:32.232937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c9428f50-3246-420f-95ed-7a77fdc207d2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:32.248959 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c9428f50-3246-420f-95ed-7a77fdc207d2 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 200 len: 1138 microversion: 2.1 time: 0.713097 Jul 26 19:55:32.250068 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1408/2832] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:31 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 1138 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:32.499679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f80363f-29ad-47e6-aa2c-c03f51c0b12c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:32.500499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f80363f-29ad-47e6-aa2c-c03f51c0b12c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:32.522579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f80363f-29ad-47e6-aa2c-c03f51c0b12c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:32.534099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f80363f-29ad-47e6-aa2c-c03f51c0b12c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:32.537238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f80363f-29ad-47e6-aa2c-c03f51c0b12c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:32.539262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f80363f-29ad-47e6-aa2c-c03f51c0b12c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:32.668273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f80363f-29ad-47e6-aa2c-c03f51c0b12c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:32.679880 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f80363f-29ad-47e6-aa2c-c03f51c0b12c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1270 microversion: 2.1 time: 0.186893 Jul 26 19:55:32.684678 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1425/2833] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:32 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:32.700055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7f936eb3-6b08-4f56-b9a6-fd38f5671dfc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:32.700710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7f936eb3-6b08-4f56-b9a6-fd38f5671dfc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:32.713695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f936eb3-6b08-4f56-b9a6-fd38f5671dfc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:32.714415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f936eb3-6b08-4f56-b9a6-fd38f5671dfc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:32.716682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f936eb3-6b08-4f56-b9a6-fd38f5671dfc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:32.717692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f936eb3-6b08-4f56-b9a6-fd38f5671dfc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:33.151697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:33.152355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:33.164974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:33.165424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:33.166210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:33.166644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:33.208583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7f936eb3-6b08-4f56-b9a6-fd38f5671dfc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:33.216882 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7f936eb3-6b08-4f56-b9a6-fd38f5671dfc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1475 microversion: 2.1 time: 0.542194 Jul 26 19:55:33.223119 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1409/2834] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:32 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1475 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:33.269989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:33.270806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 6f809b93-6a29-4300-8ed5-d02bd3b8f158] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:33.277301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:33.278621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:33.279599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:33.280434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:33.303728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] HTTP exception thrown: Instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 could not be found. Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Request method failure captured: Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 HTTP/1.1 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EUbs3BkQJFk1gXTrdu-TDC925Ds8TNlE9iUEblNh_WV4uijGxqD0Dmbq36f1dD9zNf85ALPNwJPf4xPv9vEi9n0fW5J465yLynl1hcMpmD_zVz1JHUnQ9cesDk8hL1YCja3rOyvLJWrxaCMLPIwO2syi7rdV1D6OUw0S6RjehGZULE Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 13f4775142b54978b4e0e2c4c5f70147 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13f4775142b54978b4e0e2c4c5f70147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13f4775142b54978b4e0e2c4c5f70147"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13f4775142b54978b4e0e2c4c5f70147", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13f4775142b54978b4e0e2c4c5f70147"}]}] Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 13f4775142b54978b4e0e2c4c5f70147 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-LiveMigrationTest-1829733505-project Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 678a9d8bb54a4fdb8997fcf480a3a355 Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-LiveMigrationTest-1829733505-project Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 could not be found. Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6f809b93-6a29-4300-8ed5-d02bd3b8f158'} Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 could not be found. Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 could not be found. Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:33.305883 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:33.310862 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:33.310862 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:33.310862 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:33.310862 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:33.310862 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:33.310862 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 could not be found. Jul 26 19:55:33.310862 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:55:33.313055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Returning 404 to user: Instance 6f809b93-6a29-4300-8ed5-d02bd3b8f158 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:33.314739 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0d560f7-6fdd-446f-9266-66132cddb97c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158" status: 404 len: 111 microversion: 2.1 time: 0.048789 Jul 26 19:55:33.318847 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1410/2835] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:33 2022] GET /compute/v2.1/servers/6f809b93-6a29-4300-8ed5-d02bd3b8f158 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:55:33.707154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a18c89aa-c6a0-46e2-90fb-01837f073d4b req-094f58b7-5937-49fb-b1ae-fada534bd27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a506c0f-7d8b-4671-9667-185ede749851", "tag": "f57edbd3-22f4-4ba5-a486-93b6bb48d154"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:33.726906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a18c89aa-c6a0-46e2-90fb-01837f073d4b req-094f58b7-5937-49fb-b1ae-fada534bd27f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:33.732794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a18c89aa-c6a0-46e2-90fb-01837f073d4b req-094f58b7-5937-49fb-b1ae-fada534bd27f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:33.758066 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a18c89aa-c6a0-46e2-90fb-01837f073d4b req-094f58b7-5937-49fb-b1ae-fada534bd27f service nova] Creating event network-changed:f57edbd3-22f4-4ba5-a486-93b6bb48d154 for instance 1a506c0f-7d8b-4671-9667-185ede749851 on n-h2-708768-8 Jul 26 19:55:33.773703 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a18c89aa-c6a0-46e2-90fb-01837f073d4b req-094f58b7-5937-49fb-b1ae-fada534bd27f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071095 Jul 26 19:55:33.774867 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1411/2836] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:55:33.795919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f875ba54-6ca1-4529-a29d-0614eaa0573d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:33.796826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f875ba54-6ca1-4529-a29d-0614eaa0573d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:33.813245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f875ba54-6ca1-4529-a29d-0614eaa0573d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:33.814882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f875ba54-6ca1-4529-a29d-0614eaa0573d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:33.816640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f875ba54-6ca1-4529-a29d-0614eaa0573d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:33.820828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f875ba54-6ca1-4529-a29d-0614eaa0573d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:34.014021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:34.035949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:34.038189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:34.039692 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0bbfdb10-2a95-4f7b-81dc-de72734bbd11 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.893838 Jul 26 19:55:34.040522 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1426/2837] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:33 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:34.052018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2311eafb-fcdf-420a-a792-ca232a5d386e req-657d563a-d38e-4323-978a-cce88af36592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce31da0-9557-46b9-aa38-daa4aa549a5f", "name": "network-vif-unplugged", "status": "completed", "tag": "452ba588-281e-4c62-ae46-9c77b1ae1774"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:34.081970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2311eafb-fcdf-420a-a792-ca232a5d386e req-657d563a-d38e-4323-978a-cce88af36592 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:34.082424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2311eafb-fcdf-420a-a792-ca232a5d386e req-657d563a-d38e-4323-978a-cce88af36592 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:34.128536 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2311eafb-fcdf-420a-a792-ca232a5d386e req-657d563a-d38e-4323-978a-cce88af36592 service nova] Creating event network-vif-unplugged:452ba588-281e-4c62-ae46-9c77b1ae1774 for instance dce31da0-9557-46b9-aa38-daa4aa549a5f on n-h2-708768-8 Jul 26 19:55:34.145569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-2311eafb-fcdf-420a-a792-ca232a5d386e req-657d563a-d38e-4323-978a-cce88af36592 service nova] Instance dce31da0-9557-46b9-aa38-daa4aa549a5f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:55:34.181608 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2311eafb-fcdf-420a-a792-ca232a5d386e req-657d563a-d38e-4323-978a-cce88af36592 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138723 Jul 26 19:55:34.182488 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1427/2838] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:34.245911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f4ec84d5-e1a3-4ef3-a204-e28835e1cf24 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:34.247098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f4ec84d5-e1a3-4ef3-a204-e28835e1cf24 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:34.260802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4ec84d5-e1a3-4ef3-a204-e28835e1cf24 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:34.262681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4ec84d5-e1a3-4ef3-a204-e28835e1cf24 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:34.264174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4ec84d5-e1a3-4ef3-a204-e28835e1cf24 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:34.266230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4ec84d5-e1a3-4ef3-a204-e28835e1cf24 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:34.682485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f875ba54-6ca1-4529-a29d-0614eaa0573d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:34.702341 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f875ba54-6ca1-4529-a29d-0614eaa0573d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1270 microversion: 2.1 time: 0.925407 Jul 26 19:55:34.710358 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1412/2839] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:33 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1270 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:35.068765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:35.069379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:35.087196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:35.087750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:35.091418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:35.091931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:35.463028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f4ec84d5-e1a3-4ef3-a204-e28835e1cf24 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:35.467559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:35.495909 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f4ec84d5-e1a3-4ef3-a204-e28835e1cf24 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1475 microversion: 2.1 time: 1.255351 Jul 26 19:55:35.512306 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1428/2840] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:34 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1475 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:35.732072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66559975-170c-46d1-9a90-fa87b6e2a761 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:35.737725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66559975-170c-46d1-9a90-fa87b6e2a761 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:35.754992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66559975-170c-46d1-9a90-fa87b6e2a761 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:35.757946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66559975-170c-46d1-9a90-fa87b6e2a761 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:35.767465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66559975-170c-46d1-9a90-fa87b6e2a761 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:35.768341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66559975-170c-46d1-9a90-fa87b6e2a761 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:35.983821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:36.003181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:36.005268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:36.006841 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e16b2328-fdeb-468c-9276-3ce7d18ac339 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.942477 Jul 26 19:55:36.012427 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1413/2841] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:35 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:55:36.066325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-66559975-170c-46d1-9a90-fa87b6e2a761 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:36.079887 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66559975-170c-46d1-9a90-fa87b6e2a761 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1270 microversion: 2.1 time: 0.352614 Jul 26 19:55:36.093991 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1429/2842] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:35 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1270 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:36.524805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82557c41-3a75-47e4-8734-0e239976a9f2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:36.525411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-82557c41-3a75-47e4-8734-0e239976a9f2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:36.554081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82557c41-3a75-47e4-8734-0e239976a9f2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:36.554530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82557c41-3a75-47e4-8734-0e239976a9f2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:36.555657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82557c41-3a75-47e4-8734-0e239976a9f2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:36.556088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82557c41-3a75-47e4-8734-0e239976a9f2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:37.040221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:37.041020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:37.058677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:37.059478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:37.062346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:37.065643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:37.154770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:37.156607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:37.380993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-82557c41-3a75-47e4-8734-0e239976a9f2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:37.389039 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-82557c41-3a75-47e4-8734-0e239976a9f2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1475 microversion: 2.1 time: 0.867895 Jul 26 19:55:37.390962 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1414/2843] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:36 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1475 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:37.397362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd8fd296-e3c7-48b0-a302-89c9d6c160e6 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:37.406886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd8fd296-e3c7-48b0-a302-89c9d6c160e6 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:37.420469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd8fd296-e3c7-48b0-a302-89c9d6c160e6 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:37.425047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd8fd296-e3c7-48b0-a302-89c9d6c160e6 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:37.426817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd8fd296-e3c7-48b0-a302-89c9d6c160e6 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:37.427440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd8fd296-e3c7-48b0-a302-89c9d6c160e6 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:38.002279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=20 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:38.069311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd8fd296-e3c7-48b0-a302-89c9d6c160e6 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:38.076554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:38.085717 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd8fd296-e3c7-48b0-a302-89c9d6c160e6 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1312 microversion: 2.1 time: 0.689950 Jul 26 19:55:38.086666 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1415/2844] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:37 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1312 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:38.112743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-51d7fa69-5e0e-415d-8605-778058a4a649 req-6f7695d3-02a9-4615-8fe6-6665fc270d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce31da0-9557-46b9-aa38-daa4aa549a5f", "tag": "452ba588-281e-4c62-ae46-9c77b1ae1774"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:38.159943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-51d7fa69-5e0e-415d-8605-778058a4a649 req-6f7695d3-02a9-4615-8fe6-6665fc270d20 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:38.163150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-51d7fa69-5e0e-415d-8605-778058a4a649 req-6f7695d3-02a9-4615-8fe6-6665fc270d20 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:38.209853 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-51d7fa69-5e0e-415d-8605-778058a4a649 req-6f7695d3-02a9-4615-8fe6-6665fc270d20 service nova] Creating event network-changed:452ba588-281e-4c62-ae46-9c77b1ae1774 for instance dce31da0-9557-46b9-aa38-daa4aa549a5f on n-h2-708768-8 Jul 26 19:55:38.229175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-51d7fa69-5e0e-415d-8605-778058a4a649 req-6f7695d3-02a9-4615-8fe6-6665fc270d20 service nova] Instance dce31da0-9557-46b9-aa38-daa4aa549a5f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:55:38.263878 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-51d7fa69-5e0e-415d-8605-778058a4a649 req-6f7695d3-02a9-4615-8fe6-6665fc270d20 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172955 Jul 26 19:55:38.264507 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1416/2845] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:38.292908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:38.312531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:38.318205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:38.325508 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b0ad6ce3-b53a-49b7-9990-5e483f87f8a3 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 1.287230 Jul 26 19:55:38.326816 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1430/2846] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:37 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:38.411846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8a0d627-21ac-4799-a96d-f50992300c98 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:38.413131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8a0d627-21ac-4799-a96d-f50992300c98 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:38.426839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8a0d627-21ac-4799-a96d-f50992300c98 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:38.430293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8a0d627-21ac-4799-a96d-f50992300c98 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:38.431280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8a0d627-21ac-4799-a96d-f50992300c98 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:38.431894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8a0d627-21ac-4799-a96d-f50992300c98 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:39.112116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4872a76f-e90b-4c0d-b8e3-dc1019fd3b98 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:39.113106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4872a76f-e90b-4c0d-b8e3-dc1019fd3b98 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:39.127918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4872a76f-e90b-4c0d-b8e3-dc1019fd3b98 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:39.138368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4872a76f-e90b-4c0d-b8e3-dc1019fd3b98 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:39.144472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4872a76f-e90b-4c0d-b8e3-dc1019fd3b98 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:39.145022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4872a76f-e90b-4c0d-b8e3-dc1019fd3b98 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:39.859117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c8a0d627-21ac-4799-a96d-f50992300c98 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:39.877214 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8a0d627-21ac-4799-a96d-f50992300c98 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1475 microversion: 2.1 time: 1.470369 Jul 26 19:55:39.887191 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1417/2847] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:38 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1475 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:39.896637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:39.899470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:39.926685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:39.927133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:39.927978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:39.928412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:40.074882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4872a76f-e90b-4c0d-b8e3-dc1019fd3b98 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:40.085784 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4872a76f-e90b-4c0d-b8e3-dc1019fd3b98 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1312 microversion: 2.1 time: 0.977983 Jul 26 19:55:40.089751 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1431/2848] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:39 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1312 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:40.144263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8119fd6c-7054-4f31-8fd6-8a1e9c08d095 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:40.144770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8119fd6c-7054-4f31-8fd6-8a1e9c08d095 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:40.160164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8119fd6c-7054-4f31-8fd6-8a1e9c08d095 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:40.161250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8119fd6c-7054-4f31-8fd6-8a1e9c08d095 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:40.164237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8119fd6c-7054-4f31-8fd6-8a1e9c08d095 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:40.166065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8119fd6c-7054-4f31-8fd6-8a1e9c08d095 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:40.243594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8119fd6c-7054-4f31-8fd6-8a1e9c08d095 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:55:40.422245 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8119fd6c-7054-4f31-8fd6-8a1e9c08d095 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 204 len: 0 microversion: 2.1 time: 0.283528 Jul 26 19:55:40.423291 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1432/2849] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:55:40 2022] DELETE /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:55:40.433706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ccf22cb-120c-4884-947a-addbbc9733f4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:40.436535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ccf22cb-120c-4884-947a-addbbc9733f4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:40.456922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ccf22cb-120c-4884-947a-addbbc9733f4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:40.457794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ccf22cb-120c-4884-947a-addbbc9733f4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:40.460263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ccf22cb-120c-4884-947a-addbbc9733f4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:40.460908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ccf22cb-120c-4884-947a-addbbc9733f4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:40.763984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:40.782573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:40.793469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:40.805930 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c512195-e912-4b0a-a76a-46c03f87c312 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.903664 Jul 26 19:55:40.808033 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1418/2850] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:39 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:40.913962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ab4244d-22b4-461d-a526-c3c9fa9947e0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:40.916874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6ab4244d-22b4-461d-a526-c3c9fa9947e0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:40.935900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ab4244d-22b4-461d-a526-c3c9fa9947e0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:40.939075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ab4244d-22b4-461d-a526-c3c9fa9947e0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:40.940771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ab4244d-22b4-461d-a526-c3c9fa9947e0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:40.941368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ab4244d-22b4-461d-a526-c3c9fa9947e0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:41.276873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ccf22cb-120c-4884-947a-addbbc9733f4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:41.289356 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ccf22cb-120c-4884-947a-addbbc9733f4 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1667 microversion: 2.1 time: 0.861728 Jul 26 19:55:41.293538 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1433/2851] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:40 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1667 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:41.306734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aa0b6f78-2c31-4985-9aa5-c4bcbaa282c5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:41.308502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aa0b6f78-2c31-4985-9aa5-c4bcbaa282c5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:41.322595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa0b6f78-2c31-4985-9aa5-c4bcbaa282c5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:41.326506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa0b6f78-2c31-4985-9aa5-c4bcbaa282c5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:41.327543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa0b6f78-2c31-4985-9aa5-c4bcbaa282c5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:41.328190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa0b6f78-2c31-4985-9aa5-c4bcbaa282c5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:42.246590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6ab4244d-22b4-461d-a526-c3c9fa9947e0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:42.263040 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6ab4244d-22b4-461d-a526-c3c9fa9947e0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1473 microversion: 2.1 time: 1.354143 Jul 26 19:55:42.269006 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1419/2852] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:40 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1473 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:42.285156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:42.286013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:42.299782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:42.310661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-aa0b6f78-2c31-4985-9aa5-c4bcbaa282c5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:42.312598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:42.315395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:42.317357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:42.321258 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aa0b6f78-2c31-4985-9aa5-c4bcbaa282c5 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 1.026376 Jul 26 19:55:42.325078 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1434/2853] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:41 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:42.336750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d00889f5-60f7-4514-8d33-15e1136e5640 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:42.339495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d00889f5-60f7-4514-8d33-15e1136e5640 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:42.354884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d00889f5-60f7-4514-8d33-15e1136e5640 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:42.355851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d00889f5-60f7-4514-8d33-15e1136e5640 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:42.358642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d00889f5-60f7-4514-8d33-15e1136e5640 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:42.360215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d00889f5-60f7-4514-8d33-15e1136e5640 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:43.122279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d00889f5-60f7-4514-8d33-15e1136e5640 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:43.146381 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d00889f5-60f7-4514-8d33-15e1136e5640 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1667 microversion: 2.1 time: 0.811933 Jul 26 19:55:43.147061 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1435/2854] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:42 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1667 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:43.310652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bde64f9c-622b-4fe5-a207-e6aee1099251 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:43.311541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bde64f9c-622b-4fe5-a207-e6aee1099251 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:43.321046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde64f9c-622b-4fe5-a207-e6aee1099251 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:43.321804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde64f9c-622b-4fe5-a207-e6aee1099251 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:43.322781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde64f9c-622b-4fe5-a207-e6aee1099251 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:43.323387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bde64f9c-622b-4fe5-a207-e6aee1099251 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:43.661573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:43.675902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:43.691143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:43.694460 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8225349e-f150-430b-9979-2d8af58b7e51 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 1.422214 Jul 26 19:55:43.702990 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1420/2855] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:42 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:43.711459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-56cf5b14-7045-40e5-9959-77e150bf89af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:43.712108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-56cf5b14-7045-40e5-9959-77e150bf89af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:43.730246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56cf5b14-7045-40e5-9959-77e150bf89af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:43.730945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56cf5b14-7045-40e5-9959-77e150bf89af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:43.735787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56cf5b14-7045-40e5-9959-77e150bf89af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:43.736911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56cf5b14-7045-40e5-9959-77e150bf89af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:44.348552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bde64f9c-622b-4fe5-a207-e6aee1099251 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:44.378248 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bde64f9c-622b-4fe5-a207-e6aee1099251 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1470 microversion: 2.1 time: 1.081985 Jul 26 19:55:44.383853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1436/2856] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:43 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1470 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:44.413265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96598fe6-e618-4dcd-90e0-a869d18b8a79 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:44.415241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-96598fe6-e618-4dcd-90e0-a869d18b8a79 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:44.453770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96598fe6-e618-4dcd-90e0-a869d18b8a79 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:44.454341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96598fe6-e618-4dcd-90e0-a869d18b8a79 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:44.455150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96598fe6-e618-4dcd-90e0-a869d18b8a79 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:44.455820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96598fe6-e618-4dcd-90e0-a869d18b8a79 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:44.982327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-96598fe6-e618-4dcd-90e0-a869d18b8a79 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:44.983817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-56cf5b14-7045-40e5-9959-77e150bf89af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:44.992657 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96598fe6-e618-4dcd-90e0-a869d18b8a79 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1667 microversion: 2.1 time: 0.606360 Jul 26 19:55:44.995966 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1437/2857] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:44 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1667 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:45.002426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2368948-672d-4b96-be53-4b08de1621ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:45.003241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d2368948-672d-4b96-be53-4b08de1621ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:45.024164 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-56cf5b14-7045-40e5-9959-77e150bf89af tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 1.319911 Jul 26 19:55:45.030363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2368948-672d-4b96-be53-4b08de1621ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:45.034997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2368948-672d-4b96-be53-4b08de1621ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:45.036510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2368948-672d-4b96-be53-4b08de1621ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:45.037984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2368948-672d-4b96-be53-4b08de1621ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:45.058873 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1421/2858] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:43 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:45.086808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:45.088215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:45.110862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:45.115373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:45.116641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:45.117916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:45.257718 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d2368948-672d-4b96-be53-4b08de1621ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f/action" status: 204 len: 0 microversion: 2.1 time: 0.260080 Jul 26 19:55:45.263067 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1438/2859] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:55:44 2022] POST /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f/action => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:45.965324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df389fb7-15a1-40f8-80fb-922933577e36 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Action: 'create', calling method: .version_select at 0x7f8756721ca0>, body: {"keypair": {"name": "tempest-keypair-2047488868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoH6/rYCe5Y1mo4K0OGYTaPmd3Gmdj5jQc8QDabCkVqY1adbcr2n8nxqf9b6rSsuIWBXuM3Ntxv/bZflR6IQVbtnJntIQkiNc30RWfH+fm+NkGf9S+vykU6TGDDHMkAKw=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:45.968283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:45.994079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:46.004275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:46.009658 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0d77464f-def2-4b57-b262-1674d991730a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.949000 Jul 26 19:55:46.010725 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1422/2860] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:45 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:46.011712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-df389fb7-15a1-40f8-80fb-922933577e36 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Getting quotas for project 447b5dd287aa49e8915187d2c75da345. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:46.026362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-df389fb7-15a1-40f8-80fb-922933577e36 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Getting quotas for user 9a6a30957f45486fa6880e63c44f9107 and project 447b5dd287aa49e8915187d2c75da345. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:46.046983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-17e3febc-8611-45e1-8dff-f1b0d98e00aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:46.058052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-17e3febc-8611-45e1-8dff-f1b0d98e00aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:46.068969 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df389fb7-15a1-40f8-80fb-922933577e36 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.801304 Jul 26 19:55:46.070824 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1439/2861] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:55:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:46.080053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17e3febc-8611-45e1-8dff-f1b0d98e00aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:46.080556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17e3febc-8611-45e1-8dff-f1b0d98e00aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:46.081289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17e3febc-8611-45e1-8dff-f1b0d98e00aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:46.082003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17e3febc-8611-45e1-8dff-f1b0d98e00aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:46.082118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-86967821-6f13-4c83-8e70-7e8e330b7ca0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:46.082682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-86967821-6f13-4c83-8e70-7e8e330b7ca0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:46.102652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86967821-6f13-4c83-8e70-7e8e330b7ca0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:46.103103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86967821-6f13-4c83-8e70-7e8e330b7ca0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:46.105640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86967821-6f13-4c83-8e70-7e8e330b7ca0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:46.106086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86967821-6f13-4c83-8e70-7e8e330b7ca0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:46.325075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-86967821-6f13-4c83-8e70-7e8e330b7ca0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:46.347215 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-86967821-6f13-4c83-8e70-7e8e330b7ca0 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1599 microversion: 2.1 time: 0.271385 Jul 26 19:55:46.350188 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1440/2862] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:46 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1599 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:46.356345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c9e8f52-56eb-42e3-80cc-10d16e3c9a4d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:46.360243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3c9e8f52-56eb-42e3-80cc-10d16e3c9a4d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:46.381230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c9e8f52-56eb-42e3-80cc-10d16e3c9a4d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:46.382045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c9e8f52-56eb-42e3-80cc-10d16e3c9a4d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:46.383044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c9e8f52-56eb-42e3-80cc-10d16e3c9a4d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:46.397540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c9e8f52-56eb-42e3-80cc-10d16e3c9a4d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:46.850861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c9e8f52-56eb-42e3-80cc-10d16e3c9a4d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:46.864260 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c9e8f52-56eb-42e3-80cc-10d16e3c9a4d tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.509774 Jul 26 19:55:46.865540 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1441/2863] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:46 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:47.381459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea3f9031-6de3-4e3d-8397-6ab86816960e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: .version_select at 0x7f875670a790>, body: {"keypair": {"name": "tempest-keypair-1862015649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoChVPRu/vEdQe4kC1qYIEAN3dUDQnzFsFkSpaBXU/9qSfwhhHUjQZEUT6ZNqpo0miPnRHHEBrSh0YEPnmUscwR7Tk2OJPgWd/+91b+/2ySbfYmaL/42AhyhD/ZkIeSlw=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:47.398008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:47.411259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-17e3febc-8611-45e1-8dff-f1b0d98e00aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:47.427772 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-17e3febc-8611-45e1-8dff-f1b0d98e00aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1470 microversion: 2.1 time: 1.388353 Jul 26 19:55:47.430119 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1423/2864] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:46 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1470 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:47.451649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:47.452527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:47.461043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:47.461755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:47.462743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:47.464100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:47.472009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ea3f9031-6de3-4e3d-8397-6ab86816960e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for project 2a16253a71a24312a17022e4f01ed652. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:47.489720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ea3f9031-6de3-4e3d-8397-6ab86816960e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for user 889459c783694048b93438ce16b75d0f and project 2a16253a71a24312a17022e4f01ed652. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:47.561761 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea3f9031-6de3-4e3d-8397-6ab86816960e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.691108 Jul 26 19:55:47.562391 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1442/2865] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:55:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:47.582738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-69a0bcef-8fda-498a-9b56-f822f592740c req-e4fa64b7-50d2-45b8-9889-2177841436e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-plugged", "status": "completed", "tag": "fe6b2cb8-1d37-4fcb-8207-e8f166570861"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:47.614783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-69a0bcef-8fda-498a-9b56-f822f592740c req-e4fa64b7-50d2-45b8-9889-2177841436e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:47.616065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-69a0bcef-8fda-498a-9b56-f822f592740c req-e4fa64b7-50d2-45b8-9889-2177841436e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:47.632926 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-69a0bcef-8fda-498a-9b56-f822f592740c req-e4fa64b7-50d2-45b8-9889-2177841436e2 service nova] Creating event network-vif-plugged:fe6b2cb8-1d37-4fcb-8207-e8f166570861 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:47.645541 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-69a0bcef-8fda-498a-9b56-f822f592740c req-e4fa64b7-50d2-45b8-9889-2177841436e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080824 Jul 26 19:55:47.646553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1443/2866] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:47.653072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a67898a-7cff-4e4a-b791-23d48959095c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:47.654904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1a67898a-7cff-4e4a-b791-23d48959095c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:47.666655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a67898a-7cff-4e4a-b791-23d48959095c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:47.667467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a67898a-7cff-4e4a-b791-23d48959095c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:47.668785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a67898a-7cff-4e4a-b791-23d48959095c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:47.669596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a67898a-7cff-4e4a-b791-23d48959095c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:47.776215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a67898a-7cff-4e4a-b791-23d48959095c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:47.791113 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a67898a-7cff-4e4a-b791-23d48959095c tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 200 len: 1599 microversion: 2.1 time: 0.143086 Jul 26 19:55:47.791746 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1444/2867] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:47 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 1599 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:47.801906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-405f771a-b7a4-4e9c-afd8-a20d4c638a24 req-01843091-24db-43ba-a3f9-baecbe703740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7616d5d-d9c0-4142-a5a6-f5b67c561504", "tag": "f062a38e-da73-4d2a-861d-ccae8ec69107"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:47.832172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-405f771a-b7a4-4e9c-afd8-a20d4c638a24 req-01843091-24db-43ba-a3f9-baecbe703740 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:47.832585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-405f771a-b7a4-4e9c-afd8-a20d4c638a24 req-01843091-24db-43ba-a3f9-baecbe703740 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:47.881578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-405f771a-b7a4-4e9c-afd8-a20d4c638a24 req-01843091-24db-43ba-a3f9-baecbe703740 service nova] Creating event network-changed:f062a38e-da73-4d2a-861d-ccae8ec69107 for instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 on n-h1-708768-8 Jul 26 19:55:47.900631 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-405f771a-b7a4-4e9c-afd8-a20d4c638a24 req-01843091-24db-43ba-a3f9-baecbe703740 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105027 Jul 26 19:55:47.904847 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1445/2868] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:47.920644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-94b42fdc-1dad-45c3-9d82-db03e8ecefda tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:47.921535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-94b42fdc-1dad-45c3-9d82-db03e8ecefda tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:47.940284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94b42fdc-1dad-45c3-9d82-db03e8ecefda tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:47.940805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94b42fdc-1dad-45c3-9d82-db03e8ecefda tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:47.942252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94b42fdc-1dad-45c3-9d82-db03e8ecefda tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:47.943630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94b42fdc-1dad-45c3-9d82-db03e8ecefda tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:47.982842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:48.292561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:48.302105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:48.303642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:48.336657 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0b60ca4e-3264-4fee-b560-eed2dd71aa2a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.886640 Jul 26 19:55:48.337322 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1424/2869] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:47 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:48.450791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-853908c3-a2f2-448a-956b-640e2add1e72 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:48.452104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-853908c3-a2f2-448a-956b-640e2add1e72 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:48.462119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-853908c3-a2f2-448a-956b-640e2add1e72 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:48.463681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-853908c3-a2f2-448a-956b-640e2add1e72 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:48.465135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-853908c3-a2f2-448a-956b-640e2add1e72 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:48.465579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-853908c3-a2f2-448a-956b-640e2add1e72 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:48.579856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-94b42fdc-1dad-45c3-9d82-db03e8ecefda tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:48.588975 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-94b42fdc-1dad-45c3-9d82-db03e8ecefda tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.680982 Jul 26 19:55:48.599204 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1446/2870] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:47 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:48.815673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:48.817609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: a96e47b7-d312-4d66-bd84-8cee85866b25] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:48.832337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:48.834408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:48.838054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:48.838759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:48.904289 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] HTTP exception thrown: Instance a96e47b7-d312-4d66-bd84-8cee85866b25 could not be found. Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Request method failure captured: Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 HTTP/1.1 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUbs3BkQJFk1gXTrdu-TDC925Ds8TNlE9iUEblNh_WV4uijGxqD0Dmbq36f1dD9zNf85ALPNwJPf4xPv9vEi9n0fW5J465yLynl1hcMpmD_zVz1JHUnQ9cesDk8hL1YCja3rOyvLJWrxaCMLPIwO2syi7rdV1D6OUw0S6RjehGZULE Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 13f4775142b54978b4e0e2c4c5f70147 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13f4775142b54978b4e0e2c4c5f70147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13f4775142b54978b4e0e2c4c5f70147"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13f4775142b54978b4e0e2c4c5f70147", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13f4775142b54978b4e0e2c4c5f70147"}]}] Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 13f4775142b54978b4e0e2c4c5f70147 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-LiveMigrationTest-1829733505-project Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 678a9d8bb54a4fdb8997fcf480a3a355 Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-LiveMigrationTest-1829733505-project Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance a96e47b7-d312-4d66-bd84-8cee85866b25 could not be found. Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a96e47b7-d312-4d66-bd84-8cee85866b25'} Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96e47b7-d312-4d66-bd84-8cee85866b25 could not be found. Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96e47b7-d312-4d66-bd84-8cee85866b25 could not be found. Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:48.908374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:48.913147 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:48.913147 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:48.913147 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:48.913147 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:48.913147 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:48.913147 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96e47b7-d312-4d66-bd84-8cee85866b25 could not be found. Jul 26 19:55:48.913147 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:48.913147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Returning 404 to user: Instance a96e47b7-d312-4d66-bd84-8cee85866b25 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:48.913742 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4eda1657-4797-43e0-8255-ee96c2dc481f tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25" status: 404 len: 111 microversion: 2.1 time: 0.101882 Jul 26 19:55:48.915747 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1447/2871] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:48 2022] GET /compute/v2.1/servers/a96e47b7-d312-4d66-bd84-8cee85866b25 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:55:48.931867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-690d7a6f-f5f2-451b-9183-94ac39d28d0b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '.version_select at 0x7f875672b1f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:48.963460 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-690d7a6f-f5f2-451b-9183-94ac39d28d0b tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29173777" status: 202 len: 0 microversion: 2.1 time: 0.042419 Jul 26 19:55:48.963460 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1448/2872] 10.222.0.58 () {58 vars in 1215 bytes} [Tue Jul 26 19:55:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29173777 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:55:48.980791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-853908c3-a2f2-448a-956b-640e2add1e72 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:48.995795 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-853908c3-a2f2-448a-956b-640e2add1e72 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1470 microversion: 2.1 time: 0.549194 Jul 26 19:55:48.997839 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1425/2873] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:48 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1470 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:49.373266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:49.375329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:49.389889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:49.395193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:49.398640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:49.399106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:49.625262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c436d3f2-f219-4546-b0bb-dc71ef953c6f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:49.627490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c436d3f2-f219-4546-b0bb-dc71ef953c6f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:49.647532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c436d3f2-f219-4546-b0bb-dc71ef953c6f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:49.650291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c436d3f2-f219-4546-b0bb-dc71ef953c6f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:49.651188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c436d3f2-f219-4546-b0bb-dc71ef953c6f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:49.658939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c436d3f2-f219-4546-b0bb-dc71ef953c6f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:50.240268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:50.256827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:50.258357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:50.259549 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd925375-b717-442d-84b6-181cda68df92 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.895908 Jul 26 19:55:50.287347 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1449/2874] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:49 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:50.292411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-39a405c2-12c8-4560-9c8d-aaf19a503fea req-224ffbfb-726b-4617-b780-cb31e8bdfc3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce31da0-9557-46b9-aa38-daa4aa549a5f", "name": "network-vif-plugged", "status": "completed", "tag": "452ba588-281e-4c62-ae46-9c77b1ae1774"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:50.310694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-39a405c2-12c8-4560-9c8d-aaf19a503fea req-224ffbfb-726b-4617-b780-cb31e8bdfc3b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:50.311512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-39a405c2-12c8-4560-9c8d-aaf19a503fea req-224ffbfb-726b-4617-b780-cb31e8bdfc3b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:50.336018 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-39a405c2-12c8-4560-9c8d-aaf19a503fea req-224ffbfb-726b-4617-b780-cb31e8bdfc3b service nova] Creating event network-vif-plugged:452ba588-281e-4c62-ae46-9c77b1ae1774 for instance dce31da0-9557-46b9-aa38-daa4aa549a5f on n-h2-708768-8 Jul 26 19:55:50.362367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-39a405c2-12c8-4560-9c8d-aaf19a503fea req-224ffbfb-726b-4617-b780-cb31e8bdfc3b service nova] Instance dce31da0-9557-46b9-aa38-daa4aa549a5f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:55:50.418628 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-39a405c2-12c8-4560-9c8d-aaf19a503fea req-224ffbfb-726b-4617-b780-cb31e8bdfc3b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127522 Jul 26 19:55:50.421423 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1450/2875] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:50.436073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6db6e44-66e8-4283-b37f-2a67201cd1f6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:50.436971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b6db6e44-66e8-4283-b37f-2a67201cd1f6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:50.457381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6db6e44-66e8-4283-b37f-2a67201cd1f6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:50.457835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6db6e44-66e8-4283-b37f-2a67201cd1f6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:50.460440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6db6e44-66e8-4283-b37f-2a67201cd1f6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:50.463024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6db6e44-66e8-4283-b37f-2a67201cd1f6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:51.167440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c436d3f2-f219-4546-b0bb-dc71ef953c6f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:51.177000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c436d3f2-f219-4546-b0bb-dc71ef953c6f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 1.556870 Jul 26 19:55:51.181910 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1426/2876] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:49 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:51.188595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b6db6e44-66e8-4283-b37f-2a67201cd1f6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:51.193492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-aebda7f0-a0ba-4ead-bf21-0149bd5ceb5a req-fa0bd6ed-0822-4449-b749-30d4feab11ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96e47b7-d312-4d66-bd84-8cee85866b25", "name": "network-vif-deleted", "tag": "4c2b7e2a-35c8-4f6c-87db-eb905b409fbb"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:51.207382 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b6db6e44-66e8-4283-b37f-2a67201cd1f6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1470 microversion: 2.1 time: 0.772323 Jul 26 19:55:51.209891 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1451/2877] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:50 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1470 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:51.217276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aebda7f0-a0ba-4ead-bf21-0149bd5ceb5a req-fa0bd6ed-0822-4449-b749-30d4feab11ad service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:51.217727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aebda7f0-a0ba-4ead-bf21-0149bd5ceb5a req-fa0bd6ed-0822-4449-b749-30d4feab11ad service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:51.249414 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aebda7f0-a0ba-4ead-bf21-0149bd5ceb5a req-fa0bd6ed-0822-4449-b749-30d4feab11ad service nova] Creating event network-vif-deleted:4c2b7e2a-35c8-4f6c-87db-eb905b409fbb for instance a96e47b7-d312-4d66-bd84-8cee85866b25 on n-h2-708768-8 Jul 26 19:55:51.261347 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-aebda7f0-a0ba-4ead-bf21-0149bd5ceb5a req-fa0bd6ed-0822-4449-b749-30d4feab11ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077878 Jul 26 19:55:51.261957 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1427/2878] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:51.294699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:51.295322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:51.314091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:51.314643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:51.315445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:51.317850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.210607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0f65f83e-69ca-474f-938b-abc6cb3a4b2e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:52.212712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0f65f83e-69ca-474f-938b-abc6cb3a4b2e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:52.238678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f65f83e-69ca-474f-938b-abc6cb3a4b2e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:52.242210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f65f83e-69ca-474f-938b-abc6cb3a4b2e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.243298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f65f83e-69ca-474f-938b-abc6cb3a4b2e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:52.248949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f65f83e-69ca-474f-938b-abc6cb3a4b2e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.338338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:52.368351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:52.372699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:52.377035 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-339b7573-813d-4d0d-823e-4900cf816a9a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 1.084816 Jul 26 19:55:52.393285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1452/2879] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:51 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:52.401409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c4c1eddd-7959-499c-831d-e217a5046713 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:52.402225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c4c1eddd-7959-499c-831d-e217a5046713 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:52.417722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4c1eddd-7959-499c-831d-e217a5046713 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:52.419028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4c1eddd-7959-499c-831d-e217a5046713 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.420960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4c1eddd-7959-499c-831d-e217a5046713 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:52.426494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4c1eddd-7959-499c-831d-e217a5046713 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.760306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c4c1eddd-7959-499c-831d-e217a5046713 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:52.763814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0f65f83e-69ca-474f-938b-abc6cb3a4b2e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:52.775845 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0f65f83e-69ca-474f-938b-abc6cb3a4b2e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.576335 Jul 26 19:55:52.779136 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1428/2880] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:52 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:52.796914 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c4c1eddd-7959-499c-831d-e217a5046713 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1462 microversion: 2.1 time: 0.400663 Jul 26 19:55:52.798091 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1453/2881] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:52 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1462 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:52.815602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2fb96671-14a5-4826-8a46-350fd66de349 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:52.816238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2fb96671-14a5-4826-8a46-350fd66de349 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:52.826488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fb96671-14a5-4826-8a46-350fd66de349 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:52.826788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7b64fe76-10a1-4ea0-94f6-3e8b4ab642ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:52.827378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fb96671-14a5-4826-8a46-350fd66de349 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.827696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7b64fe76-10a1-4ea0-94f6-3e8b4ab642ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:52.829121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fb96671-14a5-4826-8a46-350fd66de349 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:52.829919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fb96671-14a5-4826-8a46-350fd66de349 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.842522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b64fe76-10a1-4ea0-94f6-3e8b4ab642ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:52.845640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b64fe76-10a1-4ea0-94f6-3e8b4ab642ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.847471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b64fe76-10a1-4ea0-94f6-3e8b4ab642ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:52.848942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b64fe76-10a1-4ea0-94f6-3e8b4ab642ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:52.895941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2fb96671-14a5-4826-8a46-350fd66de349 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:55:53.120823 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2fb96671-14a5-4826-8a46-350fd66de349 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 204 len: 0 microversion: 2.1 time: 0.338812 Jul 26 19:55:53.123483 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1429/2882] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:55:52 2022] DELETE /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:53.146434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ccbe0290-c60f-4e16-bbc5-7d70d63894db req-c6d50064-cdc8-4759-9c7a-d9903c9f4596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-plugged", "status": "completed", "tag": "541cb467-b301-4e6d-a429-b68924052481"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:53.196934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ccbe0290-c60f-4e16-bbc5-7d70d63894db req-c6d50064-cdc8-4759-9c7a-d9903c9f4596 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:53.197384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ccbe0290-c60f-4e16-bbc5-7d70d63894db req-c6d50064-cdc8-4759-9c7a-d9903c9f4596 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:53.224031 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ccbe0290-c60f-4e16-bbc5-7d70d63894db req-c6d50064-cdc8-4759-9c7a-d9903c9f4596 service nova] Creating event network-vif-plugged:541cb467-b301-4e6d-a429-b68924052481 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:53.231494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ccbe0290-c60f-4e16-bbc5-7d70d63894db req-c6d50064-cdc8-4759-9c7a-d9903c9f4596 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097884 Jul 26 19:55:53.234042 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1430/2883] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:53.253794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-924fda52-4f26-44c0-8b3b-8865613275ad tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:53.254544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-924fda52-4f26-44c0-8b3b-8865613275ad tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:53.273198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-924fda52-4f26-44c0-8b3b-8865613275ad tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:53.277713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-924fda52-4f26-44c0-8b3b-8865613275ad tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:53.281520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-924fda52-4f26-44c0-8b3b-8865613275ad tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:53.282298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7b64fe76-10a1-4ea0-94f6-3e8b4ab642ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:53.286889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-924fda52-4f26-44c0-8b3b-8865613275ad tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:53.296487 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7b64fe76-10a1-4ea0-94f6-3e8b4ab642ae tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1462 microversion: 2.1 time: 0.477966 Jul 26 19:55:53.301147 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1454/2884] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:52 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1462 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:53.321592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b953e7ed-ab74-41d4-b830-f3de9f4770ed tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'create', calling method: .version_select at 0x7f8756ddc310>, body: {"keypair": {"name": "tempest-keypair-44193320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKF5E8K6lO2buVKCVRqLde5kNqXv8sNYGPeWBSijH/Ykt6EYiJY2BJs5bd2a0arv5YloET3LLDPQnNZQvhZCNzApOFkQu3wA4PG3lv63rgBKcV/W8yogjYeXv2ErMW22g=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:53.368606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-b953e7ed-ab74-41d4-b830-f3de9f4770ed tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:53.384606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-b953e7ed-ab74-41d4-b830-f3de9f4770ed tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for user 146ecbca3664463ead84028d4add8b50 and project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:53.445764 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b953e7ed-ab74-41d4-b830-f3de9f4770ed tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.127939 Jul 26 19:55:53.455205 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1455/2885] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:55:53 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:55:53.462794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:53.468011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:53.488494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:53.489806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:53.491982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:53.492428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:53.914370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:53.948157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:53.954996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:53.962461 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d973ee66-5dd5-4529-85dc-340574628853 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.499958 Jul 26 19:55:53.964341 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1456/2886] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:53 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:53.975860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e5ecd2b7-81ea-4a8e-9e9f-b0333ab6dee5 req-ec3afd5c-b550-4bff-a0bf-9a83d9bf35ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7616d5d-d9c0-4142-a5a6-f5b67c561504", "tag": "58b567bd-8272-4b4f-b6a0-6b4e09924408"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:53.996273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e5ecd2b7-81ea-4a8e-9e9f-b0333ab6dee5 req-ec3afd5c-b550-4bff-a0bf-9a83d9bf35ef service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:53.997278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e5ecd2b7-81ea-4a8e-9e9f-b0333ab6dee5 req-ec3afd5c-b550-4bff-a0bf-9a83d9bf35ef service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:54.022939 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e5ecd2b7-81ea-4a8e-9e9f-b0333ab6dee5 req-ec3afd5c-b550-4bff-a0bf-9a83d9bf35ef service nova] Creating event network-changed:58b567bd-8272-4b4f-b6a0-6b4e09924408 for instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 on n-h1-708768-8 Jul 26 19:55:54.030471 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e5ecd2b7-81ea-4a8e-9e9f-b0333ab6dee5 req-ec3afd5c-b550-4bff-a0bf-9a83d9bf35ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064623 Jul 26 19:55:54.032391 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1457/2887] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:54.046337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1f35455-6fa3-41c5-8139-54c717e09caf tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:54.048193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c1f35455-6fa3-41c5-8139-54c717e09caf tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:54.055662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1f35455-6fa3-41c5-8139-54c717e09caf tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:54.056760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1f35455-6fa3-41c5-8139-54c717e09caf tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:54.057745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1f35455-6fa3-41c5-8139-54c717e09caf tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:54.058548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1f35455-6fa3-41c5-8139-54c717e09caf tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:54.202646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-924fda52-4f26-44c0-8b3b-8865613275ad tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:54.218084 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-924fda52-4f26-44c0-8b3b-8865613275ad tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1484 microversion: 2.1 time: 0.980981 Jul 26 19:55:54.220198 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1431/2888] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:53 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1484 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:54.513036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c1f35455-6fa3-41c5-8139-54c717e09caf tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:54.533422 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1f35455-6fa3-41c5-8139-54c717e09caf tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.499556 Jul 26 19:55:54.542551 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1458/2889] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:54 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:54.989499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:54.990184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:55.014843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:55.015293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:55.023918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:55.025756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:55.095873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:55.243026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ad35169-4388-44fe-a5fb-38512792b528 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:55.244013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ad35169-4388-44fe-a5fb-38512792b528 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:55.259707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ad35169-4388-44fe-a5fb-38512792b528 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:55.260278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ad35169-4388-44fe-a5fb-38512792b528 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:55.260969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ad35169-4388-44fe-a5fb-38512792b528 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:55.264754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ad35169-4388-44fe-a5fb-38512792b528 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:55.702783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ad35169-4388-44fe-a5fb-38512792b528 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:55.722733 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ad35169-4388-44fe-a5fb-38512792b528 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1484 microversion: 2.1 time: 0.480629 Jul 26 19:55:55.724259 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1459/2890] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:55 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1484 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:55.742376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e6d3d92e-6e10-4700-8139-0be2283d8f14 req-2c00cc71-4938-421a-a520-a7cc59a17278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-plugged", "status": "completed", "tag": "284685bc-eeaf-4bd9-82d4-f42d9b330786"}, {"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-plugged", "status": "completed", "tag": "1836dc79-1df6-4f9f-ad40-28b880acc6bb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:55.778207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e6d3d92e-6e10-4700-8139-0be2283d8f14 req-2c00cc71-4938-421a-a520-a7cc59a17278 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:55.780090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e6d3d92e-6e10-4700-8139-0be2283d8f14 req-2c00cc71-4938-421a-a520-a7cc59a17278 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:55.853214 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e6d3d92e-6e10-4700-8139-0be2283d8f14 req-2c00cc71-4938-421a-a520-a7cc59a17278 service nova] Creating event network-vif-plugged:284685bc-eeaf-4bd9-82d4-f42d9b330786 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:55.854573 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e6d3d92e-6e10-4700-8139-0be2283d8f14 req-2c00cc71-4938-421a-a520-a7cc59a17278 service nova] Creating event network-vif-plugged:1836dc79-1df6-4f9f-ad40-28b880acc6bb for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:55.875056 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e6d3d92e-6e10-4700-8139-0be2283d8f14 req-2c00cc71-4938-421a-a520-a7cc59a17278 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.146396 Jul 26 19:55:55.877865 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1460/2891] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:55.933189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4989d73b-c3e1-4062-90cd-8a2becb0a7f4 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:55.937286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4989d73b-c3e1-4062-90cd-8a2becb0a7f4 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:55.964362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4989d73b-c3e1-4062-90cd-8a2becb0a7f4 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:55.964961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4989d73b-c3e1-4062-90cd-8a2becb0a7f4 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:55.966933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4989d73b-c3e1-4062-90cd-8a2becb0a7f4 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:55.971010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4989d73b-c3e1-4062-90cd-8a2becb0a7f4 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:56.310772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4989d73b-c3e1-4062-90cd-8a2becb0a7f4 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:56.319628 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4989d73b-c3e1-4062-90cd-8a2becb0a7f4 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.440168 Jul 26 19:55:56.323052 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1461/2892] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:55 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:56.429462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-63912401", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa81df3d-9f96-49e8-813d-dbedef5ea966"}], "security_groups": [{"name": "tempest-securitygroup--1319369329"}], "key_name": "tempest-keypair-1862015649", "user_data": "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:56.538588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:56.554703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:56.558823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:56.561917 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e48f25b-7999-4593-bf50-2011f68879a4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 1.579401 Jul 26 19:55:56.564639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1432/2893] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:54 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:56.704059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] validate_networks() for [('aa81df3d-9f96-49e8-813d-dbedef5ea966', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:55:56.757332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8502ce8f-4690-4e85-ad83-820f36c5e791 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:56.758052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8502ce8f-4690-4e85-ad83-820f36c5e791 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:56.779468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8502ce8f-4690-4e85-ad83-820f36c5e791 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:56.780086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8502ce8f-4690-4e85-ad83-820f36c5e791 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:56.780838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8502ce8f-4690-4e85-ad83-820f36c5e791 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:56.781256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8502ce8f-4690-4e85-ad83-820f36c5e791 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:56.962995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8502ce8f-4690-4e85-ad83-820f36c5e791 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:56.978851 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8502ce8f-4690-4e85-ad83-820f36c5e791 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 200 len: 1442 microversion: 2.1 time: 0.233446 Jul 26 19:55:56.979763 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1433/2894] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:56 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 1442 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:55:56.985048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-39aeb113-a75c-4300-8146-539b8f5c34a7 req-f5d56220-ad71-4bcd-a532-2a47605df0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13baaecc-fbee-455e-b19a-01055ffe15aa", "name": "network-vif-deleted", "tag": "29c14f48-9d91-41cf-93b8-933d95135cb9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:57.015336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-39aeb113-a75c-4300-8146-539b8f5c34a7 req-f5d56220-ad71-4bcd-a532-2a47605df0bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:57.015834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-39aeb113-a75c-4300-8146-539b8f5c34a7 req-f5d56220-ad71-4bcd-a532-2a47605df0bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:57.055067 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-39aeb113-a75c-4300-8146-539b8f5c34a7 req-f5d56220-ad71-4bcd-a532-2a47605df0bb service nova] Creating event network-vif-deleted:29c14f48-9d91-41cf-93b8-933d95135cb9 for instance 13baaecc-fbee-455e-b19a-01055ffe15aa on n-h1-708768-8 Jul 26 19:55:57.060386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-39aeb113-a75c-4300-8146-539b8f5c34a7 req-f5d56220-ad71-4bcd-a532-2a47605df0bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078987 Jul 26 19:55:57.061218 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1434/2895] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:57.066936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e111874a-9060-4d59-990a-9fd1ea995941 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '.version_select at 0x7f87682d9040>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:57.072418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e111874a-9060-4d59-990a-9fd1ea995941 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:57.072986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e111874a-9060-4d59-990a-9fd1ea995941 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:57.083158 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e111874a-9060-4d59-990a-9fd1ea995941 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1571 microversion: 2.1 time: 0.020778 Jul 26 19:55:57.084093 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1435/2896] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 19:55:57 2022] GET /compute/v2.1/os-migrations => generated 1571 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:57.127912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2cf73800-d74c-4241-b9e4-3ac8e20bda78 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:57.156021 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2cf73800-d74c-4241-b9e4-3ac8e20bda78 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044618 Jul 26 19:55:57.166342 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1436/2897] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:55:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:57.179132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6564174b-13ea-4b2e-9278-d068ea9b6501 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-225231899", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:57.195240 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:55:57.195240 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:55:57.242881 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6564174b-13ea-4b2e-9278-d068ea9b6501 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.073903 Jul 26 19:55:57.244215 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1437/2898] 10.222.0.58 () {60 vars in 1146 bytes} [Tue Jul 26 19:55:57 2022] POST /compute/v2.1/flavors => generated 498 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:57.256999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d571ad38-a8f5-4d11-b7ec-fd378015b4a7 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:57.277761 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d571ad38-a8f5-4d11-b7ec-fd378015b4a7 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025265 Jul 26 19:55:57.279007 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1438/2899] 10.222.0.58 () {58 vars in 1182 bytes} [Tue Jul 26 19:55:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:55:57.349714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc126fb5-d433-42d0-a3d2-7de91ec8c011 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:57.351983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc126fb5-d433-42d0-a3d2-7de91ec8c011 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:57.365607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc126fb5-d433-42d0-a3d2-7de91ec8c011 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:57.366852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc126fb5-d433-42d0-a3d2-7de91ec8c011 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:57.367956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc126fb5-d433-42d0-a3d2-7de91ec8c011 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:57.368788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc126fb5-d433-42d0-a3d2-7de91ec8c011 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:57.555898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:55:57.556326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:55:57.556800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:55:57.557213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:55:57.557629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:55:57.568804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:57.569256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:57.570504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:57.571133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:57.595567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for project 2a16253a71a24312a17022e4f01ed652. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:57.602881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for user 889459c783694048b93438ce16b75d0f and project 2a16253a71a24312a17022e4f01ed652. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:57.621605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:55:57.625003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:55:57.675280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc126fb5-d433-42d0-a3d2-7de91ec8c011 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:57.686525 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc126fb5-d433-42d0-a3d2-7de91ec8c011 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.339827 Jul 26 19:55:57.688745 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1439/2900] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:57 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:57.693441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1636121021", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "b546e8a6-73db-4197-9039-bca8d3f21ca2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:57.706710 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0e120cbc-545a-4e32-aa77-1d1b27a12d47 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.283528 Jul 26 19:55:57.708355 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1462/2901] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:55:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:55:57.720004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:57.721277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:57.732632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:57.733900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:57.736058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:57.736777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:57.812309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:55:58.027221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:58.039006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:58.041108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:58.042546 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11a0b4ad-499f-402f-be9b-9b8f7ac30a17 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.333037 Jul 26 19:55:58.043541 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1463/2902] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:57 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:55:58.048417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5c20a3a-56d4-42d7-87ab-4e37c7e4e978 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:58.050082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5c20a3a-56d4-42d7-87ab-4e37c7e4e978 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:58.143308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5c20a3a-56d4-42d7-87ab-4e37c7e4e978 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:58.154009 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5c20a3a-56d4-42d7-87ab-4e37c7e4e978 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1240 microversion: 2.1 time: 0.108779 Jul 26 19:55:58.154606 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1464/2903] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:58 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1240 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:58.161060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:58.163067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 13baaecc-fbee-455e-b19a-01055ffe15aa] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:58.170691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.171479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.172678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.173248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.193066 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] HTTP exception thrown: Instance 13baaecc-fbee-455e-b19a-01055ffe15aa could not be found. Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Request method failure captured: Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa HTTP/1.1 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EUbs3BkQJFk1gXTrdu-TDC925Ds8TNlE9iUEblNh_WV4uijGxqD0Dmbq36f1dD9zNf85ALPNwJPf4xPv9vEi9n0fW5J465yLynl1hcMpmD_zVz1JHUnQ9cesDk8hL1YCja3rOyvLJWrxaCMLPIwO2syi7rdV1D6OUw0S6RjehGZULE Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 13f4775142b54978b4e0e2c4c5f70147 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13f4775142b54978b4e0e2c4c5f70147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13f4775142b54978b4e0e2c4c5f70147"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13f4775142b54978b4e0e2c4c5f70147", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13f4775142b54978b4e0e2c4c5f70147"}]}] Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 13f4775142b54978b4e0e2c4c5f70147 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-LiveMigrationTest-1829733505 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-LiveMigrationTest-1829733505-project Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 678a9d8bb54a4fdb8997fcf480a3a355 Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-LiveMigrationTest-1829733505-project Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 13baaecc-fbee-455e-b19a-01055ffe15aa could not be found. Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '13baaecc-fbee-455e-b19a-01055ffe15aa'} Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13baaecc-fbee-455e-b19a-01055ffe15aa could not be found. Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13baaecc-fbee-455e-b19a-01055ffe15aa could not be found. Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:55:58.195496 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:58.199943 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:55:58.199943 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:55:58.199943 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:55:58.199943 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:55:58.199943 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:55:58.199943 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13baaecc-fbee-455e-b19a-01055ffe15aa could not be found. Jul 26 19:55:58.199943 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:55:58.221639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Returning 404 to user: Instance 13baaecc-fbee-455e-b19a-01055ffe15aa could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:55:58.222363 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-424775f1-4ee4-485d-86a2-b94eddd80913 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa" status: 404 len: 111 microversion: 2.1 time: 0.066571 Jul 26 19:55:58.223426 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1465/2904] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:58 2022] GET /compute/v2.1/servers/13baaecc-fbee-455e-b19a-01055ffe15aa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:55:58.235291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-79c44d2c-de5a-4423-92df-f157e95deb33 req-661b7756-dbbd-4de3-b4a1-9e6fcc55430f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-plugged", "status": "completed", "tag": "ec179517-adcc-4787-947f-12e245e9aa0b"}, {"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-plugged", "status": "completed", "tag": "ae28e6f8-74d4-4ed4-a654-8129d2f6984a"}, {"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-plugged", "status": "completed", "tag": "0ad81dfc-1d62-45e5-844d-8e3f948affe9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:55:58.260800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-79c44d2c-de5a-4423-92df-f157e95deb33 req-661b7756-dbbd-4de3-b4a1-9e6fcc55430f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.262394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-79c44d2c-de5a-4423-92df-f157e95deb33 req-661b7756-dbbd-4de3-b4a1-9e6fcc55430f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.298540 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-79c44d2c-de5a-4423-92df-f157e95deb33 req-661b7756-dbbd-4de3-b4a1-9e6fcc55430f service nova] Creating event network-vif-plugged:ec179517-adcc-4787-947f-12e245e9aa0b for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:58.300026 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-79c44d2c-de5a-4423-92df-f157e95deb33 req-661b7756-dbbd-4de3-b4a1-9e6fcc55430f service nova] Creating event network-vif-plugged:ae28e6f8-74d4-4ed4-a654-8129d2f6984a for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:58.302466 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-79c44d2c-de5a-4423-92df-f157e95deb33 req-661b7756-dbbd-4de3-b4a1-9e6fcc55430f service nova] Creating event network-vif-plugged:0ad81dfc-1d62-45e5-844d-8e3f948affe9 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:55:58.319398 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-79c44d2c-de5a-4423-92df-f157e95deb33 req-661b7756-dbbd-4de3-b4a1-9e6fcc55430f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.094838 Jul 26 19:55:58.323449 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1466/2905] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:55:58.334048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c2ba539-39d5-46b3-bc8b-a5ef77e5cc83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:58.337621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c2ba539-39d5-46b3-bc8b-a5ef77e5cc83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:58.354940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c2ba539-39d5-46b3-bc8b-a5ef77e5cc83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.356019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c2ba539-39d5-46b3-bc8b-a5ef77e5cc83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.365045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c2ba539-39d5-46b3-bc8b-a5ef77e5cc83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.365386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c2ba539-39d5-46b3-bc8b-a5ef77e5cc83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.394386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:55:58.395415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:55:58.396473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:55:58.397095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:55:58.397746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:55:58.400331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:58.426192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.428046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.431073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.431761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.432077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c2ba539-39d5-46b3-bc8b-a5ef77e5cc83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:55:58.493051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:55:58.507597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for user 146ecbca3664463ead84028d4add8b50 and project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:55:58.561411 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c2ba539-39d5-46b3-bc8b-a5ef77e5cc83 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "DELETE /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 204 len: 0 microversion: 2.1 time: 0.235671 Jul 26 19:55:58.568682 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1467/2906] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:55:58 2022] DELETE /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:55:58.572678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:55:58.575712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d6590154-3da7-412d-89ca-c0441de11c33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:58.576431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d6590154-3da7-412d-89ca-c0441de11c33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:58.586017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:55:58.594442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6590154-3da7-412d-89ca-c0441de11c33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.594869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6590154-3da7-412d-89ca-c0441de11c33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.595715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6590154-3da7-412d-89ca-c0441de11c33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:58.596159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6590154-3da7-412d-89ca-c0441de11c33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:58.681600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:58.685997 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3966a795-00af-4173-a397-684e5cfad871 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994718 Jul 26 19:55:58.696410 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1440/2907] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:55:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:55:58.704865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-95efb2fb-09d9-4310-b89a-1f6d3cdf0c9c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:58.707908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-95efb2fb-09d9-4310-b89a-1f6d3cdf0c9c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:58.947861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-95efb2fb-09d9-4310-b89a-1f6d3cdf0c9c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:58.956296 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-95efb2fb-09d9-4310-b89a-1f6d3cdf0c9c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1279 microversion: 2.1 time: 0.258652 Jul 26 19:55:58.956911 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1441/2908] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:58 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:58.968159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d6590154-3da7-412d-89ca-c0441de11c33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:58.977559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c42052d5-96e4-4335-b564-6f683195ad89 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:58.979842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d6590154-3da7-412d-89ca-c0441de11c33 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1499 microversion: 2.1 time: 0.409013 Jul 26 19:55:58.981544 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1468/2909] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:58 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1499 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:58.985382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c42052d5-96e4-4335-b564-6f683195ad89 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:59.047838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c42052d5-96e4-4335-b564-6f683195ad89 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:59.048320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c42052d5-96e4-4335-b564-6f683195ad89 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:59.056590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c42052d5-96e4-4335-b564-6f683195ad89 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:59.058525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c42052d5-96e4-4335-b564-6f683195ad89 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:59.067761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:59.068732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:59.070750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:55:59.085637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:59.088097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:59.091994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:59.093558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:59.607432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:59.630044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:59.634077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:59.639174 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15484501-8e50-4f6e-802d-0bb7944081f9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1877 microversion: 2.42 time: 0.576000 Jul 26 19:55:59.643148 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1469/2910] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:55:59 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1877 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:55:59.651464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e831d410-a412-4fb3-8bd1-8fbf6d4788eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:59.655930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e831d410-a412-4fb3-8bd1-8fbf6d4788eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:55:59.667100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e831d410-a412-4fb3-8bd1-8fbf6d4788eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:59.668114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e831d410-a412-4fb3-8bd1-8fbf6d4788eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:59.669163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e831d410-a412-4fb3-8bd1-8fbf6d4788eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:55:59.669938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e831d410-a412-4fb3-8bd1-8fbf6d4788eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:55:59.806835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e831d410-a412-4fb3-8bd1-8fbf6d4788eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:59.833800 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e831d410-a412-4fb3-8bd1-8fbf6d4788eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1310 microversion: 2.1 time: 0.189205 Jul 26 19:55:59.839146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c42052d5-96e4-4335-b564-6f683195ad89 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:55:59.840447 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1470/2911] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:59 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1310 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:59.861026 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c42052d5-96e4-4335-b564-6f683195ad89 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.897929 Jul 26 19:55:59.868392 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1442/2912] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:58 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:55:59.988966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89c7ca8d-6a31-46a1-88ca-3bbb0b49fead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:55:59.990717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89c7ca8d-6a31-46a1-88ca-3bbb0b49fead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:00.005467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e9f6f3bc-cada-4c1d-9dd3-a54909cf5028 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:00.006502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e9f6f3bc-cada-4c1d-9dd3-a54909cf5028 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:00.008220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c7ca8d-6a31-46a1-88ca-3bbb0b49fead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.009788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c7ca8d-6a31-46a1-88ca-3bbb0b49fead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:00.010802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c7ca8d-6a31-46a1-88ca-3bbb0b49fead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.011463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c7ca8d-6a31-46a1-88ca-3bbb0b49fead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:00.036117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9f6f3bc-cada-4c1d-9dd3-a54909cf5028 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.036582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9f6f3bc-cada-4c1d-9dd3-a54909cf5028 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:00.041547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9f6f3bc-cada-4c1d-9dd3-a54909cf5028 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.042007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e9f6f3bc-cada-4c1d-9dd3-a54909cf5028 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:00.176765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-89c7ca8d-6a31-46a1-88ca-3bbb0b49fead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:00.191161 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89c7ca8d-6a31-46a1-88ca-3bbb0b49fead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1331 microversion: 2.1 time: 0.215227 Jul 26 19:56:00.191796 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1471/2913] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:59 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:00.572427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e9f6f3bc-cada-4c1d-9dd3-a54909cf5028 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678a9d8bb54a4fdb8997fcf480a3a355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f4775142b54978b4e0e2c4c5f70147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:00.580444 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e9f6f3bc-cada-4c1d-9dd3-a54909cf5028 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 200 len: 1499 microversion: 2.1 time: 0.581785 Jul 26 19:56:00.588005 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1443/2914] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:55:59 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 1499 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:00.666230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:00.667327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:00.692489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.695170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:00.698509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.699845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:00.821255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b1f95022-3845-423c-97f5-df36bb78efdc req-9f249468-1e95-4299-afc6-4935f1bc49a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935ae66a-87b3-42a0-99ec-679dedd8f3df", "name": "network-vif-deleted", "tag": "c36f3c36-3ad6-4297-b38d-d13e0fc6869d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:00.845024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b1f95022-3845-423c-97f5-df36bb78efdc req-9f249468-1e95-4299-afc6-4935f1bc49a2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.845753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b1f95022-3845-423c-97f5-df36bb78efdc req-9f249468-1e95-4299-afc6-4935f1bc49a2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:00.879473 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b1f95022-3845-423c-97f5-df36bb78efdc req-9f249468-1e95-4299-afc6-4935f1bc49a2 service nova] Creating event network-vif-deleted:c36f3c36-3ad6-4297-b38d-d13e0fc6869d for instance 935ae66a-87b3-42a0-99ec-679dedd8f3df on n-h1-708768-8 Jul 26 19:56:00.887803 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b1f95022-3845-423c-97f5-df36bb78efdc req-9f249468-1e95-4299-afc6-4935f1bc49a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070903 Jul 26 19:56:00.893039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1444/2915] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:56:00.901827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-691838de-cae8-44d7-88bc-613e29bb2b83 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:00.904008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-691838de-cae8-44d7-88bc-613e29bb2b83 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:00.923108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-691838de-cae8-44d7-88bc-613e29bb2b83 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.923761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-691838de-cae8-44d7-88bc-613e29bb2b83 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:00.924671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-691838de-cae8-44d7-88bc-613e29bb2b83 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:00.925107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-691838de-cae8-44d7-88bc-613e29bb2b83 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.066140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-691838de-cae8-44d7-88bc-613e29bb2b83 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:01.080056 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-691838de-cae8-44d7-88bc-613e29bb2b83 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1298 microversion: 2.1 time: 0.185323 Jul 26 19:56:01.091251 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1445/2916] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:00 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1298 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:01.121465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c37253c9-a522-4fd2-aac8-5e9100f79f4e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:01.124052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c37253c9-a522-4fd2-aac8-5e9100f79f4e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:01.139295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:01.145521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c37253c9-a522-4fd2-aac8-5e9100f79f4e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:01.150506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c37253c9-a522-4fd2-aac8-5e9100f79f4e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.153618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c37253c9-a522-4fd2-aac8-5e9100f79f4e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:01.155644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c37253c9-a522-4fd2-aac8-5e9100f79f4e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.157432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:01.162997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:01.169106 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-17333411-2faa-4b89-89ae-8d14d6486509 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2835 microversion: 2.42 time: 0.506809 Jul 26 19:56:01.175006 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1472/2917] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:00 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2835 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:01.203119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-72ae83f8-d2e0-49fc-b44a-7990bbb3b30b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:01.203808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-72ae83f8-d2e0-49fc-b44a-7990bbb3b30b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:01.222167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72ae83f8-d2e0-49fc-b44a-7990bbb3b30b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:01.224017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72ae83f8-d2e0-49fc-b44a-7990bbb3b30b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.228753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72ae83f8-d2e0-49fc-b44a-7990bbb3b30b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:01.231806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-72ae83f8-d2e0-49fc-b44a-7990bbb3b30b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.434088 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-72ae83f8-d2e0-49fc-b44a-7990bbb3b30b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.234618 Jul 26 19:56:01.435369 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1473/2918] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Jul 26 19:56:01 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647/os-interface => generated 1831 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:01.449249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38f26d1e-e38d-4936-b232-77b9d4c7ea9b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:01.449870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38f26d1e-e38d-4936-b232-77b9d4c7ea9b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:01.466874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f26d1e-e38d-4936-b232-77b9d4c7ea9b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:01.473259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f26d1e-e38d-4936-b232-77b9d4c7ea9b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.475302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f26d1e-e38d-4936-b232-77b9d4c7ea9b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:01.477898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f26d1e-e38d-4936-b232-77b9d4c7ea9b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.626495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c37253c9-a522-4fd2-aac8-5e9100f79f4e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:01.634899 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c37253c9-a522-4fd2-aac8-5e9100f79f4e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.538223 Jul 26 19:56:01.636150 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1446/2919] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:01 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:01.642147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:01.643122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] [instance: 935ae66a-87b3-42a0-99ec-679dedd8f3df] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:01.649996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:01.650658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.651829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:01.652512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:01.676688 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] HTTP exception thrown: Instance 935ae66a-87b3-42a0-99ec-679dedd8f3df could not be found. Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Request method failure captured: Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df HTTP/1.1 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EUbs3BkQJFk1gXTrdu-TDC925Ds8TNlE9iUEblNh_WV4uijGxqD0Dmbq36f1dD9zNf85ALPNwJPf4xPv9vEi9n0fW5J465yLynl1hcMpmD_zVz1JHUnQ9cesDk8hL1YCja3rOyvLJWrxaCMLPIwO2syi7rdV1D6OUw0S6RjehGZULE Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 13f4775142b54978b4e0e2c4c5f70147 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-LiveMigrationTest-1829733505 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13f4775142b54978b4e0e2c4c5f70147"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13f4775142b54978b4e0e2c4c5f70147"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13f4775142b54978b4e0e2c4c5f70147", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13f4775142b54978b4e0e2c4c5f70147"}]}] Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-LiveMigrationTest-1829733505 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 13f4775142b54978b4e0e2c4c5f70147 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-LiveMigrationTest-1829733505 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-LiveMigrationTest-1829733505-project Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 678a9d8bb54a4fdb8997fcf480a3a355 Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-LiveMigrationTest-1829733505-project Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 935ae66a-87b3-42a0-99ec-679dedd8f3df could not be found. Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '935ae66a-87b3-42a0-99ec-679dedd8f3df'} Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935ae66a-87b3-42a0-99ec-679dedd8f3df could not be found. Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935ae66a-87b3-42a0-99ec-679dedd8f3df could not be found. Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:01.681488 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935ae66a-87b3-42a0-99ec-679dedd8f3df could not be found. Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] Returning 404 to user: Instance 935ae66a-87b3-42a0-99ec-679dedd8f3df could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-325c602a-3c00-412f-bbda-550fbb59c091 tempest-LiveMigrationTest-1829733505 tempest-LiveMigrationTest-1829733505-project] 10.222.0.58 "GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df" status: 404 len: 111 microversion: 2.1 time: 0.045561 Jul 26 19:56:01.685491 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1447/2920] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:01 2022] GET /compute/v2.1/servers/935ae66a-87b3-42a0-99ec-679dedd8f3df => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:56:01.689846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38f26d1e-e38d-4936-b232-77b9d4c7ea9b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:01.698871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38f26d1e-e38d-4936-b232-77b9d4c7ea9b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1337 microversion: 2.1 time: 0.262312 Jul 26 19:56:01.702541 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1474/2921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:01 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1337 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:02.121402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8bc77b14-d8cb-41a0-a394-1903a73c6135 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:02.122285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8bc77b14-d8cb-41a0-a394-1903a73c6135 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:02.141528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bc77b14-d8cb-41a0-a394-1903a73c6135 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:02.146158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bc77b14-d8cb-41a0-a394-1903a73c6135 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:02.152523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bc77b14-d8cb-41a0-a394-1903a73c6135 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:02.152989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bc77b14-d8cb-41a0-a394-1903a73c6135 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:02.658733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ffcf0a3-d1be-4b1f-8126-2a53c4bb81ac tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:02.662447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ffcf0a3-d1be-4b1f-8126-2a53c4bb81ac tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:02.673370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ffcf0a3-d1be-4b1f-8126-2a53c4bb81ac tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:02.690059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ffcf0a3-d1be-4b1f-8126-2a53c4bb81ac tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:02.692060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ffcf0a3-d1be-4b1f-8126-2a53c4bb81ac tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:02.694654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ffcf0a3-d1be-4b1f-8126-2a53c4bb81ac tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:02.972017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8bc77b14-d8cb-41a0-a394-1903a73c6135 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:02.982807 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8bc77b14-d8cb-41a0-a394-1903a73c6135 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1366 microversion: 2.1 time: 0.873150 Jul 26 19:56:02.983406 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1448/2922] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:02 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1366 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:03.001916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f415b570-c8db-4228-9d5e-b52cdae5adad tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:03.002581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f415b570-c8db-4228-9d5e-b52cdae5adad tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:03.019379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f415b570-c8db-4228-9d5e-b52cdae5adad tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:03.021679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f415b570-c8db-4228-9d5e-b52cdae5adad tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:03.024640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f415b570-c8db-4228-9d5e-b52cdae5adad tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:03.026953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f415b570-c8db-4228-9d5e-b52cdae5adad tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:03.748953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f415b570-c8db-4228-9d5e-b52cdae5adad tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:03.766598 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f415b570-c8db-4228-9d5e-b52cdae5adad tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1379 microversion: 2.1 time: 0.777305 Jul 26 19:56:03.769513 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1449/2923] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:02 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1379 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:03.791361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-35db8140-5a97-4b99-8bb4-6138364f9cc3 req-f0250cb0-1fb2-4752-95f2-dff3c7569eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7616d5d-d9c0-4142-a5a6-f5b67c561504", "name": "network-vif-plugged", "status": "completed", "tag": "58b567bd-8272-4b4f-b6a0-6b4e09924408"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:03.823923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-35db8140-5a97-4b99-8bb4-6138364f9cc3 req-f0250cb0-1fb2-4752-95f2-dff3c7569eff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:03.830439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-35db8140-5a97-4b99-8bb4-6138364f9cc3 req-f0250cb0-1fb2-4752-95f2-dff3c7569eff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:03.849943 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-35db8140-5a97-4b99-8bb4-6138364f9cc3 req-f0250cb0-1fb2-4752-95f2-dff3c7569eff service nova] Creating event network-vif-plugged:58b567bd-8272-4b4f-b6a0-6b4e09924408 for instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 on n-h1-708768-8 Jul 26 19:56:03.860943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ffcf0a3-d1be-4b1f-8126-2a53c4bb81ac tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:03.875900 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ffcf0a3-d1be-4b1f-8126-2a53c4bb81ac tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 1.221019 Jul 26 19:56:03.876765 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1475/2924] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:02 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:03.889468 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-35db8140-5a97-4b99-8bb4-6138364f9cc3 req-f0250cb0-1fb2-4752-95f2-dff3c7569eff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109156 Jul 26 19:56:03.900233 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1450/2925] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:04.008682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b2970255-8ee0-478a-85c9-a726969f628b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:04.009351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b2970255-8ee0-478a-85c9-a726969f628b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:04.038732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2970255-8ee0-478a-85c9-a726969f628b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.039168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2970255-8ee0-478a-85c9-a726969f628b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.046329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2970255-8ee0-478a-85c9-a726969f628b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.046869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2970255-8ee0-478a-85c9-a726969f628b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.052647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57cac993-d1a3-4c70-ab38-05b569593487 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:04.056147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-57cac993-d1a3-4c70-ab38-05b569593487 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:04.090631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57cac993-d1a3-4c70-ab38-05b569593487 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.091102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57cac993-d1a3-4c70-ab38-05b569593487 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.092004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57cac993-d1a3-4c70-ab38-05b569593487 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.092468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57cac993-d1a3-4c70-ab38-05b569593487 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.302355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-57cac993-d1a3-4c70-ab38-05b569593487 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lazy-loading 'services' on Instance uuid 1a506c0f-7d8b-4671-9667-185ede749851 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:56:04.452105 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-57cac993-d1a3-4c70-ab38-05b569593487 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments/59da52b8-0fdf-42b0-adb4-d6a947969567" status: 202 len: 0 microversion: 2.1 time: 0.413300 Jul 26 19:56:04.453921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1451/2926] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 19:56:04 2022] DELETE /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments/59da52b8-0fdf-42b0-adb4-d6a947969567 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:56:04.473752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ba60384c-43c3-43cf-b35c-65c032b860ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:04.481653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ba60384c-43c3-43cf-b35c-65c032b860ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:04.512560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba60384c-43c3-43cf-b35c-65c032b860ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.515652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba60384c-43c3-43cf-b35c-65c032b860ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.517105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba60384c-43c3-43cf-b35c-65c032b860ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.517830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba60384c-43c3-43cf-b35c-65c032b860ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.619258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ba60384c-43c3-43cf-b35c-65c032b860ad tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157327 Jul 26 19:56:04.620921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1452/2927] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:04 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:04.734033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-2e37bcea-ff35-4225-833a-ca6c94aa2baf req-f036faa1-f515-4b42-8c02-39961c3c3f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8827133-9f6e-48f6-9ae4-d4be69370eef", "tag": "e1519dc4-c176-49b9-b5ac-043b57b24aa4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:04.780923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2e37bcea-ff35-4225-833a-ca6c94aa2baf req-f036faa1-f515-4b42-8c02-39961c3c3f7c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.783181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2e37bcea-ff35-4225-833a-ca6c94aa2baf req-f036faa1-f515-4b42-8c02-39961c3c3f7c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.833800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b2970255-8ee0-478a-85c9-a726969f628b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:04.838385 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2e37bcea-ff35-4225-833a-ca6c94aa2baf req-f036faa1-f515-4b42-8c02-39961c3c3f7c service nova] Creating event network-changed:e1519dc4-c176-49b9-b5ac-043b57b24aa4 for instance c8827133-9f6e-48f6-9ae4-d4be69370eef on n-h1-708768-8 Jul 26 19:56:04.850357 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b2970255-8ee0-478a-85c9-a726969f628b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1366 microversion: 2.1 time: 0.845864 Jul 26 19:56:04.854874 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1476/2928] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:04 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1366 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:04.871054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-2e37bcea-ff35-4225-833a-ca6c94aa2baf req-f036faa1-f515-4b42-8c02-39961c3c3f7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143255 Jul 26 19:56:04.872796 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1453/2929] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:04.884277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e96cb727-0038-49fd-99f3-87b36a131477 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:04.886963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e96cb727-0038-49fd-99f3-87b36a131477 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:04.905231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e96cb727-0038-49fd-99f3-87b36a131477 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.907864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e96cb727-0038-49fd-99f3-87b36a131477 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.913475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e96cb727-0038-49fd-99f3-87b36a131477 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.915482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e96cb727-0038-49fd-99f3-87b36a131477 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.915636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-62b2d84c-eb4d-403a-88e4-9100861a6e25 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:04.916664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-62b2d84c-eb4d-403a-88e4-9100861a6e25 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:04.940066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62b2d84c-eb4d-403a-88e4-9100861a6e25 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.940524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62b2d84c-eb4d-403a-88e4-9100861a6e25 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:04.951421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62b2d84c-eb4d-403a-88e4-9100861a6e25 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:04.951421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62b2d84c-eb4d-403a-88e4-9100861a6e25 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:05.357663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e96cb727-0038-49fd-99f3-87b36a131477 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:05.370939 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e96cb727-0038-49fd-99f3-87b36a131477 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1379 microversion: 2.1 time: 0.514481 Jul 26 19:56:05.387020 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1477/2930] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:04 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1379 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:05.392450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-3cb473ef-78ad-4d3b-9aa8-52c7af290c58 req-7898a7c3-6f63-441b-9f37-6441843ad477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "tag": "0ad81dfc-1d62-45e5-844d-8e3f948affe9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:05.425198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3cb473ef-78ad-4d3b-9aa8-52c7af290c58 req-7898a7c3-6f63-441b-9f37-6441843ad477 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:05.429061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3cb473ef-78ad-4d3b-9aa8-52c7af290c58 req-7898a7c3-6f63-441b-9f37-6441843ad477 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:05.453972 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3cb473ef-78ad-4d3b-9aa8-52c7af290c58 req-7898a7c3-6f63-441b-9f37-6441843ad477 service nova] Creating event network-changed:0ad81dfc-1d62-45e5-844d-8e3f948affe9 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:56:05.470197 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-3cb473ef-78ad-4d3b-9aa8-52c7af290c58 req-7898a7c3-6f63-441b-9f37-6441843ad477 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081652 Jul 26 19:56:05.475884 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1478/2931] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:05.633871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-92598f35-a54c-4010-bd3d-0900b093f7a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:05.636571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92598f35-a54c-4010-bd3d-0900b093f7a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:05.658535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92598f35-a54c-4010-bd3d-0900b093f7a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:05.660838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92598f35-a54c-4010-bd3d-0900b093f7a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:05.662718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92598f35-a54c-4010-bd3d-0900b093f7a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:05.664915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92598f35-a54c-4010-bd3d-0900b093f7a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:05.743883 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-92598f35-a54c-4010-bd3d-0900b093f7a8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115038 Jul 26 19:56:05.747231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-62b2d84c-eb4d-403a-88e4-9100861a6e25 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:05.748723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1479/2932] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:05 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:05.780860 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-62b2d84c-eb4d-403a-88e4-9100861a6e25 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.869931 Jul 26 19:56:05.794607 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1454/2933] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:04 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:05.872157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10829247-e1eb-4b92-a2c4-1fcddaec2a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:05.872860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-10829247-e1eb-4b92-a2c4-1fcddaec2a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:05.890113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10829247-e1eb-4b92-a2c4-1fcddaec2a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:05.892085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10829247-e1eb-4b92-a2c4-1fcddaec2a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:05.894759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10829247-e1eb-4b92-a2c4-1fcddaec2a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:05.896088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10829247-e1eb-4b92-a2c4-1fcddaec2a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:06.099577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a77c6d69-88ba-4dc0-b995-47c28d2a3da4 req-56d6a73d-d345-4a55-85f1-3c3305c88115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7616d5d-d9c0-4142-a5a6-f5b67c561504", "name": "network-vif-plugged", "status": "completed", "tag": "f062a38e-da73-4d2a-861d-ccae8ec69107"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:06.119703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a77c6d69-88ba-4dc0-b995-47c28d2a3da4 req-56d6a73d-d345-4a55-85f1-3c3305c88115 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:06.120141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a77c6d69-88ba-4dc0-b995-47c28d2a3da4 req-56d6a73d-d345-4a55-85f1-3c3305c88115 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:06.149099 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a77c6d69-88ba-4dc0-b995-47c28d2a3da4 req-56d6a73d-d345-4a55-85f1-3c3305c88115 service nova] Creating event network-vif-plugged:f062a38e-da73-4d2a-861d-ccae8ec69107 for instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 on n-h1-708768-8 Jul 26 19:56:06.172211 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a77c6d69-88ba-4dc0-b995-47c28d2a3da4 req-56d6a73d-d345-4a55-85f1-3c3305c88115 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068685 Jul 26 19:56:06.174203 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1455/2934] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:06.288604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10829247-e1eb-4b92-a2c4-1fcddaec2a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:06.314362 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-10829247-e1eb-4b92-a2c4-1fcddaec2a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1366 microversion: 2.1 time: 0.444818 Jul 26 19:56:06.315547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1480/2935] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:05 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:06.395416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bc100a0-64b8-46cc-af29-d51d6e286910 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:06.396551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bc100a0-64b8-46cc-af29-d51d6e286910 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:06.409507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bc100a0-64b8-46cc-af29-d51d6e286910 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:06.409971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bc100a0-64b8-46cc-af29-d51d6e286910 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:06.410750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bc100a0-64b8-46cc-af29-d51d6e286910 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:06.411182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bc100a0-64b8-46cc-af29-d51d6e286910 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:06.760426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5cfe6c35-9f0f-4733-b73e-4a6a4e5201ce tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:06.763638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5cfe6c35-9f0f-4733-b73e-4a6a4e5201ce tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:06.778993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cfe6c35-9f0f-4733-b73e-4a6a4e5201ce tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:06.779450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cfe6c35-9f0f-4733-b73e-4a6a4e5201ce tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:06.792854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cfe6c35-9f0f-4733-b73e-4a6a4e5201ce tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:06.793342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cfe6c35-9f0f-4733-b73e-4a6a4e5201ce tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:06.874356 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5cfe6c35-9f0f-4733-b73e-4a6a4e5201ce tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117735 Jul 26 19:56:06.889374 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1481/2936] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:06 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:56:06.897507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-474ebfd6-d478-4ad9-b658-09564bb36a1c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:06.898993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-474ebfd6-d478-4ad9-b658-09564bb36a1c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:06.906514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-474ebfd6-d478-4ad9-b658-09564bb36a1c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:06.907283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-474ebfd6-d478-4ad9-b658-09564bb36a1c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:06.908268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-474ebfd6-d478-4ad9-b658-09564bb36a1c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:06.908892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-474ebfd6-d478-4ad9-b658-09564bb36a1c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:07.297288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bc100a0-64b8-46cc-af29-d51d6e286910 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:07.314009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bc100a0-64b8-46cc-af29-d51d6e286910 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1379 microversion: 2.1 time: 0.923661 Jul 26 19:56:07.334077 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1456/2937] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:06 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1379 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:07.339448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8f5ce89b-b3b0-4592-b83c-1ec77d0977ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:07.341700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8f5ce89b-b3b0-4592-b83c-1ec77d0977ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:07.349949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f5ce89b-b3b0-4592-b83c-1ec77d0977ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:07.350608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f5ce89b-b3b0-4592-b83c-1ec77d0977ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:07.351905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f5ce89b-b3b0-4592-b83c-1ec77d0977ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:07.352974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f5ce89b-b3b0-4592-b83c-1ec77d0977ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:07.427708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-474ebfd6-d478-4ad9-b658-09564bb36a1c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:07.439705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-474ebfd6-d478-4ad9-b658-09564bb36a1c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.548563 Jul 26 19:56:07.441717 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1482/2938] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:06 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:07.505724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7186878e-e458-4a8a-bdc8-2a50682316c5 req-6d8351d6-9862-43e8-861c-a4859282edc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:07.531823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7186878e-e458-4a8a-bdc8-2a50682316c5 req-6d8351d6-9862-43e8-861c-a4859282edc5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:07.532772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7186878e-e458-4a8a-bdc8-2a50682316c5 req-6d8351d6-9862-43e8-861c-a4859282edc5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:07.564554 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7186878e-e458-4a8a-bdc8-2a50682316c5 req-6d8351d6-9862-43e8-861c-a4859282edc5 service nova] Creating event network-changed:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h1-708768-8 Jul 26 19:56:07.578046 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7186878e-e458-4a8a-bdc8-2a50682316c5 req-6d8351d6-9862-43e8-861c-a4859282edc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077156 Jul 26 19:56:07.584216 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1483/2939] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:56:07.902559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4003f9d1-de3b-4535-930d-a8bdb452a1a1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:07.909199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4003f9d1-de3b-4535-930d-a8bdb452a1a1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:07.927209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:07.932307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4003f9d1-de3b-4535-930d-a8bdb452a1a1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:07.933602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4003f9d1-de3b-4535-930d-a8bdb452a1a1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:07.939091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4003f9d1-de3b-4535-930d-a8bdb452a1a1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:07.940673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4003f9d1-de3b-4535-930d-a8bdb452a1a1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:08.005481 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4003f9d1-de3b-4535-930d-a8bdb452a1a1 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110494 Jul 26 19:56:08.009026 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1484/2940] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:07 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:08.336334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-495a93ab-3f8e-4eec-965f-0d7155dde2df tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:08.337182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-495a93ab-3f8e-4eec-965f-0d7155dde2df tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:08.344482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=20 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:08.347630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-495a93ab-3f8e-4eec-965f-0d7155dde2df tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:08.348259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-495a93ab-3f8e-4eec-965f-0d7155dde2df tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:08.349208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-495a93ab-3f8e-4eec-965f-0d7155dde2df tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:08.349801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-495a93ab-3f8e-4eec-965f-0d7155dde2df tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:08.400579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8f5ce89b-b3b0-4592-b83c-1ec77d0977ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:08.414182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:08.421448 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8f5ce89b-b3b0-4592-b83c-1ec77d0977ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1366 microversion: 2.1 time: 1.085508 Jul 26 19:56:08.438184 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1457/2941] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:07 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1366 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:08.462999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-99f8e36e-44fd-4a16-b01a-424bd1ba6a6b tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:08.464157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-99f8e36e-44fd-4a16-b01a-424bd1ba6a6b tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:08.474691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:08.489974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99f8e36e-44fd-4a16-b01a-424bd1ba6a6b tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:08.490697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99f8e36e-44fd-4a16-b01a-424bd1ba6a6b tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:08.491682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99f8e36e-44fd-4a16-b01a-424bd1ba6a6b tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:08.494435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99f8e36e-44fd-4a16-b01a-424bd1ba6a6b tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:08.695325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-495a93ab-3f8e-4eec-965f-0d7155dde2df tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:08.704324 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-495a93ab-3f8e-4eec-965f-0d7155dde2df tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1379 microversion: 2.1 time: 0.373386 Jul 26 19:56:08.724254 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1485/2942] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:08 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1379 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:08.952582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:09.021351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1da35e71-16ec-4edb-b6cd-2e84f46656b4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:09.025682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1da35e71-16ec-4edb-b6cd-2e84f46656b4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:09.050068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1da35e71-16ec-4edb-b6cd-2e84f46656b4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:09.050522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1da35e71-16ec-4edb-b6cd-2e84f46656b4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:09.051305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1da35e71-16ec-4edb-b6cd-2e84f46656b4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:09.051774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1da35e71-16ec-4edb-b6cd-2e84f46656b4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:09.126217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:09.136671 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1da35e71-16ec-4edb-b6cd-2e84f46656b4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122060 Jul 26 19:56:09.140738 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1486/2943] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:09 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:56:09.192591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-99f8e36e-44fd-4a16-b01a-424bd1ba6a6b tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:09.217282 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-99f8e36e-44fd-4a16-b01a-424bd1ba6a6b tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1333 microversion: 2.1 time: 0.758628 Jul 26 19:56:09.219246 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1458/2944] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:08 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1333 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:09.443564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-393b9a98-a488-4ba6-8f88-83793fedf359 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:09.444221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-393b9a98-a488-4ba6-8f88-83793fedf359 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:09.456629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-393b9a98-a488-4ba6-8f88-83793fedf359 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:09.458742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-393b9a98-a488-4ba6-8f88-83793fedf359 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:09.460082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-393b9a98-a488-4ba6-8f88-83793fedf359 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:09.460727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-393b9a98-a488-4ba6-8f88-83793fedf359 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:09.732429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73f4109a-a75c-45c2-a7f7-164b22150691 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:09.733857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73f4109a-a75c-45c2-a7f7-164b22150691 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:09.758553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73f4109a-a75c-45c2-a7f7-164b22150691 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:09.760476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73f4109a-a75c-45c2-a7f7-164b22150691 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:09.763585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73f4109a-a75c-45c2-a7f7-164b22150691 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:09.766025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73f4109a-a75c-45c2-a7f7-164b22150691 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:09.774634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-393b9a98-a488-4ba6-8f88-83793fedf359 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:09.787736 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-393b9a98-a488-4ba6-8f88-83793fedf359 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1366 microversion: 2.1 time: 0.347898 Jul 26 19:56:09.804738 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1487/2945] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:09 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:10.152201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e74f0785-9c4f-4929-8438-ef1700af79a7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:10.154721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e74f0785-9c4f-4929-8438-ef1700af79a7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:10.182652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e74f0785-9c4f-4929-8438-ef1700af79a7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:10.185795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e74f0785-9c4f-4929-8438-ef1700af79a7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:10.188322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e74f0785-9c4f-4929-8438-ef1700af79a7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:10.191796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e74f0785-9c4f-4929-8438-ef1700af79a7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:10.294789 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e74f0785-9c4f-4929-8438-ef1700af79a7 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147443 Jul 26 19:56:10.297088 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1488/2946] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:10 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:10.306069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e67728e-9b05-4b9e-8ef7-a88bc814e116 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:10.309121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e67728e-9b05-4b9e-8ef7-a88bc814e116 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:10.326379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e67728e-9b05-4b9e-8ef7-a88bc814e116 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:10.327712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e67728e-9b05-4b9e-8ef7-a88bc814e116 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:10.328810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e67728e-9b05-4b9e-8ef7-a88bc814e116 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:10.329527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e67728e-9b05-4b9e-8ef7-a88bc814e116 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:10.671901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-73f4109a-a75c-45c2-a7f7-164b22150691 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:10.681443 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73f4109a-a75c-45c2-a7f7-164b22150691 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1379 microversion: 2.1 time: 0.954764 Jul 26 19:56:10.682043 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1459/2947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:09 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1379 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:10.809835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-878c54fd-edf5-46f9-8f73-53026d7388b6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:10.810851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-878c54fd-edf5-46f9-8f73-53026d7388b6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:10.825513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-878c54fd-edf5-46f9-8f73-53026d7388b6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:10.828316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-878c54fd-edf5-46f9-8f73-53026d7388b6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:10.829380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-878c54fd-edf5-46f9-8f73-53026d7388b6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:10.832736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-878c54fd-edf5-46f9-8f73-53026d7388b6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.287914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-878c54fd-edf5-46f9-8f73-53026d7388b6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:11.297437 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-878c54fd-edf5-46f9-8f73-53026d7388b6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1366 microversion: 2.1 time: 0.490948 Jul 26 19:56:11.298034 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1460/2948] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:10 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:11.342060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e6478dda-3201-4fbc-bd68-72c50ee1f4c9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:11.345165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e6478dda-3201-4fbc-bd68-72c50ee1f4c9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:11.348451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e67728e-9b05-4b9e-8ef7-a88bc814e116 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:11.362747 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e67728e-9b05-4b9e-8ef7-a88bc814e116 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1668 microversion: 2.1 time: 1.064368 Jul 26 19:56:11.368537 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1489/2949] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:10 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1668 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:11.384999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6478dda-3201-4fbc-bd68-72c50ee1f4c9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.386172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-30ba91be-7c44-44dd-8c05-47c6234f0986 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:11.386683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-30ba91be-7c44-44dd-8c05-47c6234f0986 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:11.387315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6478dda-3201-4fbc-bd68-72c50ee1f4c9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.390763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6478dda-3201-4fbc-bd68-72c50ee1f4c9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.391707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6478dda-3201-4fbc-bd68-72c50ee1f4c9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.409538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30ba91be-7c44-44dd-8c05-47c6234f0986 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.409995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30ba91be-7c44-44dd-8c05-47c6234f0986 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.410788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30ba91be-7c44-44dd-8c05-47c6234f0986 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.411228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30ba91be-7c44-44dd-8c05-47c6234f0986 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.460293 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e6478dda-3201-4fbc-bd68-72c50ee1f4c9 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152753 Jul 26 19:56:11.463900 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1461/2950] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:11 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:11.524285 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-30ba91be-7c44-44dd-8c05-47c6234f0986 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504/ips" status: 200 len: 179 microversion: 2.1 time: 0.130790 Jul 26 19:56:11.527048 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1490/2951] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 19:56:11 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504/ips => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:11.539343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c00f0815-8a5f-4215-a290-a861ec38692a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:11.540069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c00f0815-8a5f-4215-a290-a861ec38692a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:11.558713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c00f0815-8a5f-4215-a290-a861ec38692a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.559529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c00f0815-8a5f-4215-a290-a861ec38692a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.564368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c00f0815-8a5f-4215-a290-a861ec38692a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.570993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c00f0815-8a5f-4215-a290-a861ec38692a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.676753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c00f0815-8a5f-4215-a290-a861ec38692a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:56:11.707874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-640236e7-51aa-4af6-8f41-10d6ec88ba46 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:11.708760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-640236e7-51aa-4af6-8f41-10d6ec88ba46 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:11.724138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-640236e7-51aa-4af6-8f41-10d6ec88ba46 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.726570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-640236e7-51aa-4af6-8f41-10d6ec88ba46 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.727357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-640236e7-51aa-4af6-8f41-10d6ec88ba46 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.727853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-640236e7-51aa-4af6-8f41-10d6ec88ba46 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.927111 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c00f0815-8a5f-4215-a290-a861ec38692a tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 204 len: 0 microversion: 2.1 time: 0.391293 Jul 26 19:56:11.931782 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1462/2952] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:56:11 2022] DELETE /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:56:11.946186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6eb4752b-9fd1-45d2-bef0-6e59d35ae32b req-cd08b474-804e-42e3-8487-829cb5ca7f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8827133-9f6e-48f6-9ae4-d4be69370eef", "name": "network-vif-plugged", "status": "completed", "tag": "e1519dc4-c176-49b9-b5ac-043b57b24aa4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:11.967032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6eb4752b-9fd1-45d2-bef0-6e59d35ae32b req-cd08b474-804e-42e3-8487-829cb5ca7f48 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:11.970909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6eb4752b-9fd1-45d2-bef0-6e59d35ae32b req-cd08b474-804e-42e3-8487-829cb5ca7f48 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:11.988372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-640236e7-51aa-4af6-8f41-10d6ec88ba46 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:11.998434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-640236e7-51aa-4af6-8f41-10d6ec88ba46 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1379 microversion: 2.1 time: 0.296642 Jul 26 19:56:12.002912 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6eb4752b-9fd1-45d2-bef0-6e59d35ae32b req-cd08b474-804e-42e3-8487-829cb5ca7f48 service nova] Creating event network-vif-plugged:e1519dc4-c176-49b9-b5ac-043b57b24aa4 for instance c8827133-9f6e-48f6-9ae4-d4be69370eef on n-h1-708768-8 Jul 26 19:56:12.014834 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6eb4752b-9fd1-45d2-bef0-6e59d35ae32b req-cd08b474-804e-42e3-8487-829cb5ca7f48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081367 Jul 26 19:56:12.016525 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1463/2953] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:12.027150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a273fe00-6ae0-4b96-8acd-fbcd13d6ff91 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:12.028618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a273fe00-6ae0-4b96-8acd-fbcd13d6ff91 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:12.047585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a273fe00-6ae0-4b96-8acd-fbcd13d6ff91 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:12.049571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a273fe00-6ae0-4b96-8acd-fbcd13d6ff91 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:12.050614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a273fe00-6ae0-4b96-8acd-fbcd13d6ff91 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:12.051639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a273fe00-6ae0-4b96-8acd-fbcd13d6ff91 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:12.064454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1491/2954] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:11 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1379 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:12.323514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ccf5d311-9254-4a50-b369-26504bffd412 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:12.324260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ccf5d311-9254-4a50-b369-26504bffd412 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:12.344276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ccf5d311-9254-4a50-b369-26504bffd412 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:12.345293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ccf5d311-9254-4a50-b369-26504bffd412 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:12.348285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ccf5d311-9254-4a50-b369-26504bffd412 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:12.352063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ccf5d311-9254-4a50-b369-26504bffd412 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:12.506644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a273fe00-6ae0-4b96-8acd-fbcd13d6ff91 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:12.519990 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a273fe00-6ae0-4b96-8acd-fbcd13d6ff91 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1674 microversion: 2.1 time: 0.500936 Jul 26 19:56:12.533038 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1464/2955] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:12 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1674 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:12.561637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-35c34999-df2d-4ea8-91ba-3445dacf374a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:12.570066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-35c34999-df2d-4ea8-91ba-3445dacf374a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:12.586302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35c34999-df2d-4ea8-91ba-3445dacf374a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:12.586681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35c34999-df2d-4ea8-91ba-3445dacf374a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:12.587476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35c34999-df2d-4ea8-91ba-3445dacf374a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:12.587943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35c34999-df2d-4ea8-91ba-3445dacf374a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:12.688932 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-35c34999-df2d-4ea8-91ba-3445dacf374a tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146600 Jul 26 19:56:12.689591 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1465/2956] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:12 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:12.829485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ccf5d311-9254-4a50-b369-26504bffd412 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:12.862691 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ccf5d311-9254-4a50-b369-26504bffd412 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1366 microversion: 2.1 time: 0.540630 Jul 26 19:56:12.865273 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1492/2957] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:12 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:13.033279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f7bee84d-4b79-4bc8-a0b3-04feff31f603 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:13.037620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f7bee84d-4b79-4bc8-a0b3-04feff31f603 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:13.053236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7bee84d-4b79-4bc8-a0b3-04feff31f603 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.054578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7bee84d-4b79-4bc8-a0b3-04feff31f603 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.064030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7bee84d-4b79-4bc8-a0b3-04feff31f603 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.064579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7bee84d-4b79-4bc8-a0b3-04feff31f603 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.364363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f7bee84d-4b79-4bc8-a0b3-04feff31f603 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:13.372947 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f7bee84d-4b79-4bc8-a0b3-04feff31f603 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1379 microversion: 2.1 time: 0.353639 Jul 26 19:56:13.373429 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1466/2958] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:13 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1379 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:13.568679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7dac0430-9921-4b9a-ac27-dfb1e12c1727 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:13.569449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7dac0430-9921-4b9a-ac27-dfb1e12c1727 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:13.586316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dac0430-9921-4b9a-ac27-dfb1e12c1727 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.587087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dac0430-9921-4b9a-ac27-dfb1e12c1727 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.588124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dac0430-9921-4b9a-ac27-dfb1e12c1727 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.588598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dac0430-9921-4b9a-ac27-dfb1e12c1727 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.702338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1c3a9663-0d8b-4d44-a4b4-75eea588dcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:13.705352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1c3a9663-0d8b-4d44-a4b4-75eea588dcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:13.714760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c3a9663-0d8b-4d44-a4b4-75eea588dcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.715401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c3a9663-0d8b-4d44-a4b4-75eea588dcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.716684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c3a9663-0d8b-4d44-a4b4-75eea588dcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.717566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c3a9663-0d8b-4d44-a4b4-75eea588dcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.760742 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1c3a9663-0d8b-4d44-a4b4-75eea588dcc2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063091 Jul 26 19:56:13.761583 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1467/2959] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:56:13 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:56:13.858941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:13.861451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:13.868058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.868513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.869568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.870020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.914753 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Cannot 'reboot' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2/action HTTP/1.1 Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 28 Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: {"reboot": {"type": "HARD"}} Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: exception: Cannot 'reboot' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '2e85cae1-2beb-4a4f-9ff6-b6f594b088b2', 'body': {'reboot': {'type': 'HARD'}}} Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 19:56:13.916850 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued Jul 26 19:56:13.922367 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:13.924504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 409 to user: Cannot 'reboot' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:13.927503 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9479d43d-061f-4263-9cc7-62fd6cf12126 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2/action" status: 409 len: 145 microversion: 2.1 time: 0.073643 Jul 26 19:56:13.928345 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1468/2960] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:56:13 2022] POST /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2/action => generated 145 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 19:56:13.934322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4cf6ff3-deae-42e0-84fc-3ac784760528 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:13.935283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b4cf6ff3-deae-42e0-84fc-3ac784760528 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:13.944047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4cf6ff3-deae-42e0-84fc-3ac784760528 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.944757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4cf6ff3-deae-42e0-84fc-3ac784760528 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.945747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4cf6ff3-deae-42e0-84fc-3ac784760528 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:13.946353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4cf6ff3-deae-42e0-84fc-3ac784760528 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:13.983817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7dac0430-9921-4b9a-ac27-dfb1e12c1727 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:13.994276 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7dac0430-9921-4b9a-ac27-dfb1e12c1727 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1674 microversion: 2.1 time: 0.445947 Jul 26 19:56:14.005341 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1493/2961] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:13 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1674 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:14.019270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:14.022245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:14.029168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.029590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:14.030393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.030891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:14.074095 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Cannot 'rebuild' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2/action HTTP/1.1 Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 65 Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'rebuild' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '2e85cae1-2beb-4a4f-9ff6-b6f594b088b2', 'body': {'rebuild': {'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa'}}} Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:56:14.077236 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 409 to user: Cannot 'rebuild' instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 while it is in vm_state rescued {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:14.081857 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f34be452-5e1f-424c-81ff-eb0abe937fd0 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "POST /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2/action" status: 409 len: 146 microversion: 2.1 time: 0.074748 Jul 26 19:56:14.088316 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1494/2962] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:56:14 2022] POST /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2/action => generated 146 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:56:14.095149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-15fd0b29-afca-4f40-a514-ba7ea8432fb2 req-eec72bb7-b67c-4899-9e96-12575ce3072d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "name": "network-vif-plugged", "status": "completed", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:14.106766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-15fd0b29-afca-4f40-a514-ba7ea8432fb2 req-eec72bb7-b67c-4899-9e96-12575ce3072d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.107495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-15fd0b29-afca-4f40-a514-ba7ea8432fb2 req-eec72bb7-b67c-4899-9e96-12575ce3072d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:14.121138 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-15fd0b29-afca-4f40-a514-ba7ea8432fb2 req-eec72bb7-b67c-4899-9e96-12575ce3072d service nova] Creating event network-vif-plugged:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h1-708768-8 Jul 26 19:56:14.127462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-15fd0b29-afca-4f40-a514-ba7ea8432fb2 req-eec72bb7-b67c-4899-9e96-12575ce3072d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036933 Jul 26 19:56:14.128970 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1495/2963] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:14.136679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74de18c2-2ea3-41e3-9ebc-0f1270f8f4df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:14.137910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74de18c2-2ea3-41e3-9ebc-0f1270f8f4df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:14.148312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74de18c2-2ea3-41e3-9ebc-0f1270f8f4df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.149324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74de18c2-2ea3-41e3-9ebc-0f1270f8f4df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:14.150379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74de18c2-2ea3-41e3-9ebc-0f1270f8f4df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.151061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74de18c2-2ea3-41e3-9ebc-0f1270f8f4df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:14.183698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74de18c2-2ea3-41e3-9ebc-0f1270f8f4df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:56:14.341121 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74de18c2-2ea3-41e3-9ebc-0f1270f8f4df tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 204 len: 0 microversion: 2.1 time: 0.210249 Jul 26 19:56:14.344308 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1496/2964] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:56:14 2022] DELETE /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:56:14.360444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5a156b9c-1915-490d-9cb5-7ed9d97b81af tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:14.361478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a156b9c-1915-490d-9cb5-7ed9d97b81af tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:14.373433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a156b9c-1915-490d-9cb5-7ed9d97b81af tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.374028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a156b9c-1915-490d-9cb5-7ed9d97b81af tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:14.376567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a156b9c-1915-490d-9cb5-7ed9d97b81af tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.377439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a156b9c-1915-490d-9cb5-7ed9d97b81af tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:14.472479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4cf6ff3-deae-42e0-84fc-3ac784760528 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:14.489924 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4cf6ff3-deae-42e0-84fc-3ac784760528 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1366 microversion: 2.1 time: 0.559233 Jul 26 19:56:14.492979 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1469/2965] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:13 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:14.519240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c1b5f24-9e25-474e-ae81-e126e653543a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:14.522307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c1b5f24-9e25-474e-ae81-e126e653543a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:14.551502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c1b5f24-9e25-474e-ae81-e126e653543a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.555816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c1b5f24-9e25-474e-ae81-e126e653543a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:14.560284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c1b5f24-9e25-474e-ae81-e126e653543a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:14.561308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c1b5f24-9e25-474e-ae81-e126e653543a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:15.185721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5a156b9c-1915-490d-9cb5-7ed9d97b81af tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:15.194949 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5a156b9c-1915-490d-9cb5-7ed9d97b81af tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1689 microversion: 2.1 time: 0.844449 Jul 26 19:56:15.196953 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1497/2966] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:14 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1689 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:15.202085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-907687c1-cf96-4122-a46e-98752a913b16 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:15.202963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-907687c1-cf96-4122-a46e-98752a913b16 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:15.209681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-907687c1-cf96-4122-a46e-98752a913b16 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:15.210340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-907687c1-cf96-4122-a46e-98752a913b16 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:15.211275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-907687c1-cf96-4122-a46e-98752a913b16 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:15.211883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-907687c1-cf96-4122-a46e-98752a913b16 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:15.283574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c1b5f24-9e25-474e-ae81-e126e653543a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:15.293829 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c1b5f24-9e25-474e-ae81-e126e653543a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1379 microversion: 2.1 time: 0.797062 Jul 26 19:56:15.295055 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1470/2967] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:14 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1379 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:15.320984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c48993d1-56d0-4eb1-bac4-6b96d988963b req-e4e91b2d-1dce-4aaf-8925-255137236b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7616d5d-d9c0-4142-a5a6-f5b67c561504", "name": "network-vif-deleted", "tag": "58b567bd-8272-4b4f-b6a0-6b4e09924408"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:15.342841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c48993d1-56d0-4eb1-bac4-6b96d988963b req-e4e91b2d-1dce-4aaf-8925-255137236b04 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:15.344648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c48993d1-56d0-4eb1-bac4-6b96d988963b req-e4e91b2d-1dce-4aaf-8925-255137236b04 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:15.369197 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c48993d1-56d0-4eb1-bac4-6b96d988963b req-e4e91b2d-1dce-4aaf-8925-255137236b04 service nova] Creating event network-vif-deleted:58b567bd-8272-4b4f-b6a0-6b4e09924408 for instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 on n-h1-708768-8 Jul 26 19:56:15.376500 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c48993d1-56d0-4eb1-bac4-6b96d988963b req-e4e91b2d-1dce-4aaf-8925-255137236b04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079988 Jul 26 19:56:15.377625 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1471/2968] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:15.514921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d659f2ec-559d-4cf1-a846-3ce3fb90e3ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:15.517088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d659f2ec-559d-4cf1-a846-3ce3fb90e3ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:15.517315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-907687c1-cf96-4122-a46e-98752a913b16 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:15.530264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d659f2ec-559d-4cf1-a846-3ce3fb90e3ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:15.532092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d659f2ec-559d-4cf1-a846-3ce3fb90e3ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:15.534184 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-907687c1-cf96-4122-a46e-98752a913b16 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1653 microversion: 2.1 time: 0.335901 Jul 26 19:56:15.534598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d659f2ec-559d-4cf1-a846-3ce3fb90e3ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:15.535150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d659f2ec-559d-4cf1-a846-3ce3fb90e3ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:15.550350 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1498/2969] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:15 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1653 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:15.832724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d659f2ec-559d-4cf1-a846-3ce3fb90e3ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:15.849892 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d659f2ec-559d-4cf1-a846-3ce3fb90e3ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1555 microversion: 2.1 time: 0.339874 Jul 26 19:56:15.875904 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1472/2970] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:15 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1555 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:15.876285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-94c5f73a-474c-4ab8-b686-49e63beb736c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:15.876799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-94c5f73a-474c-4ab8-b686-49e63beb736c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:15.884420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94c5f73a-474c-4ab8-b686-49e63beb736c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:15.885163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94c5f73a-474c-4ab8-b686-49e63beb736c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:15.886133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94c5f73a-474c-4ab8-b686-49e63beb736c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:15.886737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94c5f73a-474c-4ab8-b686-49e63beb736c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:16.016309 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-94c5f73a-474c-4ab8-b686-49e63beb736c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142717 Jul 26 19:56:16.025107 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1499/2971] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:56:15 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:16.219856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7706319a-6e6a-4cb4-a04b-dcceee533f11 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:16.220933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7706319a-6e6a-4cb4-a04b-dcceee533f11 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:16.237043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7706319a-6e6a-4cb4-a04b-dcceee533f11 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:16.237884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7706319a-6e6a-4cb4-a04b-dcceee533f11 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:16.239436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7706319a-6e6a-4cb4-a04b-dcceee533f11 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:16.240159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7706319a-6e6a-4cb4-a04b-dcceee533f11 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:16.314295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47aedc62-5cd2-46b9-bde2-a5b1416b1928 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:16.315820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47aedc62-5cd2-46b9-bde2-a5b1416b1928 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:16.346852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47aedc62-5cd2-46b9-bde2-a5b1416b1928 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:16.349751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47aedc62-5cd2-46b9-bde2-a5b1416b1928 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:16.350622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47aedc62-5cd2-46b9-bde2-a5b1416b1928 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:16.351125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47aedc62-5cd2-46b9-bde2-a5b1416b1928 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:16.517184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7706319a-6e6a-4cb4-a04b-dcceee533f11 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:16.525059 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7706319a-6e6a-4cb4-a04b-dcceee533f11 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1689 microversion: 2.1 time: 0.309633 Jul 26 19:56:16.525960 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1473/2972] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:16 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1689 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:16.560212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:16.561549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:16.572423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:16.573134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:16.577407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:16.578394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:16.607091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:16.651234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:16.651727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:16.653238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lazy-loading 'fault' on Instance uuid c7616d5d-d9c0-4142-a5a6-f5b67c561504 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:56:16.706507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff33e693dc4141e7b4667bee9c2cebfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114f0f8e78814e9089f720705dc2319c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:16.716735 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c9d616a-fe4b-4459-abe6-8997aa22050e tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 200 len: 1302 microversion: 2.1 time: 0.160273 Jul 26 19:56:16.718095 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1474/2973] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:16 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 1302 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:16.981208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47aedc62-5cd2-46b9-bde2-a5b1416b1928 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:16.990887 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47aedc62-5cd2-46b9-bde2-a5b1416b1928 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1529 microversion: 2.1 time: 0.680421 Jul 26 19:56:16.991477 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1500/2974] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:16 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1529 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:17.014681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab499ca1-48e4-485e-9f51-7d7bc3a5100f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:17.015522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab499ca1-48e4-485e-9f51-7d7bc3a5100f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:17.025602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab499ca1-48e4-485e-9f51-7d7bc3a5100f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.026340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab499ca1-48e4-485e-9f51-7d7bc3a5100f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.027294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab499ca1-48e4-485e-9f51-7d7bc3a5100f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.027926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab499ca1-48e4-485e-9f51-7d7bc3a5100f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.219451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab499ca1-48e4-485e-9f51-7d7bc3a5100f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:17.234077 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab499ca1-48e4-485e-9f51-7d7bc3a5100f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1529 microversion: 2.1 time: 0.222732 Jul 26 19:56:17.240483 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1475/2975] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:17 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1529 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:17.255580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-795caa8f-9017-4e15-b130-fe05d7fd52fc tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:17.256842 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:56:17.256842 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:56:17.277756 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-795caa8f-9017-4e15-b130-fe05d7fd52fc tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/b546e8a6-73db-4197-9039-bca8d3f21ca2" status: 202 len: 0 microversion: 2.1 time: 0.026415 Jul 26 19:56:17.279192 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1501/2976] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:56:17 2022] DELETE /compute/v2.1/flavors/b546e8a6-73db-4197-9039-bca8d3f21ca2 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:56:17.288249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de879d68-0f77-4a00-bbbb-c4422c0c8be8 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:17.314232 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de879d68-0f77-4a00-bbbb-c4422c0c8be8 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030451 Jul 26 19:56:17.315689 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1476/2977] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:56:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:17.335239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:17.338337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:17.347460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.348484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.350777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.351391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.392214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-351f4e72-0c0e-471a-87ed-01550ba0812b req-b8dac067-3e0c-442c-b3df-2a27bf1328b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7616d5d-d9c0-4142-a5a6-f5b67c561504", "name": "network-vif-deleted", "tag": "f062a38e-da73-4d2a-861d-ccae8ec69107"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:17.410870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:17.411562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-351f4e72-0c0e-471a-87ed-01550ba0812b req-b8dac067-3e0c-442c-b3df-2a27bf1328b1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.412033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-351f4e72-0c0e-471a-87ed-01550ba0812b req-b8dac067-3e0c-442c-b3df-2a27bf1328b1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.421552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Old instance type tempest-test_resize_flavor_-225231899, new instance type m1.heat {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 19:56:17.436241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:56:17.436662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:56:17.437709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:56:17.438189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:56:17.438361 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-351f4e72-0c0e-471a-87ed-01550ba0812b req-b8dac067-3e0c-442c-b3df-2a27bf1328b1 service nova] Creating event network-vif-deleted:f062a38e-da73-4d2a-861d-ccae8ec69107 for instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 on n-h1-708768-8 Jul 26 19:56:17.438604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:56:17.444377 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-351f4e72-0c0e-471a-87ed-01550ba0812b req-b8dac067-3e0c-442c-b3df-2a27bf1328b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055711 Jul 26 19:56:17.445254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1477/2978] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:56:17.523788 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6a9b290f-0a05-488e-819f-60d867e91bce tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad/action" status: 202 len: 0 microversion: 2.1 time: 0.193324 Jul 26 19:56:17.533909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-16ec7e0a-bece-4844-854e-2be18cbbd80e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:17.534619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-16ec7e0a-bece-4844-854e-2be18cbbd80e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:17.538435 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1502/2979] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:56:17 2022] POST /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:56:17.549569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9aec0236-ab20-4663-9387-da80e5844a93 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:17.550941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9aec0236-ab20-4663-9387-da80e5844a93 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:17.551628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16ec7e0a-bece-4844-854e-2be18cbbd80e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.553589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16ec7e0a-bece-4844-854e-2be18cbbd80e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.554509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16ec7e0a-bece-4844-854e-2be18cbbd80e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.558692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16ec7e0a-bece-4844-854e-2be18cbbd80e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.559840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aec0236-ab20-4663-9387-da80e5844a93 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.560737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aec0236-ab20-4663-9387-da80e5844a93 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.563094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aec0236-ab20-4663-9387-da80e5844a93 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.563860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aec0236-ab20-4663-9387-da80e5844a93 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.568933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:17.758849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-16ec7e0a-bece-4844-854e-2be18cbbd80e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:17.767953 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-16ec7e0a-bece-4844-854e-2be18cbbd80e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1538 microversion: 2.1 time: 0.238311 Jul 26 19:56:17.768991 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1478/2980] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:17 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1538 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:17.774246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:17.774856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:17.776979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:17.782664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.783117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.783922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:17.784457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:17.809049 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] HTTP exception thrown: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Request method failure captured: Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 HTTP/1.1 Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EZafazIjUOkFm8PFVNsXd0nKzTY6O1lqqjB031ROTFh_Au_wBo8NwSSpoT2wv4il_ebz5BHqDbnYwmqADYoZl8osTBiBJppEKKXIE-vdOdYlnbD8sMi2iq8Y__J5ZL_rvB7DHnW5Gmogr25ifojllta2BgDNHM4r8CiDtfmc92XhrU Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_114f0f8e78814e9089f720705dc2319c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}] Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ff33e693dc4141e7b4667bee9c2cebfc Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c7616d5d-d9c0-4142-a5a6-f5b67c561504'} Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:17.819737 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Returning 404 to user: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:17.825867 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9d196092-a75c-4fde-9644-ab4dc0fd55c7 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 404 len: 111 microversion: 2.1 time: 0.052380 Jul 26 19:56:17.840549 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1479/2981] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:17 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:56:17.959776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9aec0236-ab20-4663-9387-da80e5844a93 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:17.970417 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9aec0236-ab20-4663-9387-da80e5844a93 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1689 microversion: 2.1 time: 0.424283 Jul 26 19:56:17.973079 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1503/2982] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:17 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1689 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:18.794737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ce333e6-94f4-4cf2-99e1-104040f6a3f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:18.795974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ce333e6-94f4-4cf2-99e1-104040f6a3f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:18.816110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ce333e6-94f4-4cf2-99e1-104040f6a3f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:18.816754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ce333e6-94f4-4cf2-99e1-104040f6a3f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:18.817907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ce333e6-94f4-4cf2-99e1-104040f6a3f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:18.818505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ce333e6-94f4-4cf2-99e1-104040f6a3f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:18.995478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d4d315f-dbac-45a3-bbd5-873eebf9fbff tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:19.003318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0d4d315f-dbac-45a3-bbd5-873eebf9fbff tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:19.032866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d4d315f-dbac-45a3-bbd5-873eebf9fbff tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:19.033422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d4d315f-dbac-45a3-bbd5-873eebf9fbff tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:19.036605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d4d315f-dbac-45a3-bbd5-873eebf9fbff tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:19.040313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d4d315f-dbac-45a3-bbd5-873eebf9fbff tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:19.503066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0d4d315f-dbac-45a3-bbd5-873eebf9fbff tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:19.513201 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d4d315f-dbac-45a3-bbd5-873eebf9fbff tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1689 microversion: 2.1 time: 0.521870 Jul 26 19:56:19.514515 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1504/2983] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:18 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1689 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:19.536899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4c6dff5b-ea0b-456c-bec3-88c34e04cc86 req-84155404-3cc7-4802-9e70-5e879e58c551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8827133-9f6e-48f6-9ae4-d4be69370eef", "tag": "e1519dc4-c176-49b9-b5ac-043b57b24aa4"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:19.583382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4c6dff5b-ea0b-456c-bec3-88c34e04cc86 req-84155404-3cc7-4802-9e70-5e879e58c551 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:19.590274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4c6dff5b-ea0b-456c-bec3-88c34e04cc86 req-84155404-3cc7-4802-9e70-5e879e58c551 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:19.632795 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4c6dff5b-ea0b-456c-bec3-88c34e04cc86 req-84155404-3cc7-4802-9e70-5e879e58c551 service nova] Creating event network-changed:e1519dc4-c176-49b9-b5ac-043b57b24aa4 for instance c8827133-9f6e-48f6-9ae4-d4be69370eef on n-h1-708768-8 Jul 26 19:56:19.656943 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4c6dff5b-ea0b-456c-bec3-88c34e04cc86 req-84155404-3cc7-4802-9e70-5e879e58c551 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139838 Jul 26 19:56:19.658579 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1505/2984] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:20.314822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ce333e6-94f4-4cf2-99e1-104040f6a3f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:20.327830 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ce333e6-94f4-4cf2-99e1-104040f6a3f7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1538 microversion: 2.1 time: 1.537069 Jul 26 19:56:20.328819 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1480/2985] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:18 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1538 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:20.537603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46968f5c-9ed8-4987-83ce-c57b1077e8f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:20.541286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-46968f5c-9ed8-4987-83ce-c57b1077e8f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:20.564025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46968f5c-9ed8-4987-83ce-c57b1077e8f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:20.564481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46968f5c-9ed8-4987-83ce-c57b1077e8f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:20.565269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46968f5c-9ed8-4987-83ce-c57b1077e8f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:20.569875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46968f5c-9ed8-4987-83ce-c57b1077e8f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:20.918042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-46968f5c-9ed8-4987-83ce-c57b1077e8f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:20.934107 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-46968f5c-9ed8-4987-83ce-c57b1077e8f3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1689 microversion: 2.1 time: 0.400719 Jul 26 19:56:20.950531 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1506/2986] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:20 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1689 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:21.358644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac4d9c74-aa93-4c21-8677-ba33ef1de0fd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:21.359571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ac4d9c74-aa93-4c21-8677-ba33ef1de0fd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:21.392031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac4d9c74-aa93-4c21-8677-ba33ef1de0fd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:21.393949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac4d9c74-aa93-4c21-8677-ba33ef1de0fd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:21.402886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac4d9c74-aa93-4c21-8677-ba33ef1de0fd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:21.404564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac4d9c74-aa93-4c21-8677-ba33ef1de0fd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:21.962884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02c68bcc-6046-4b2e-8c42-67346a32c63d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:21.963596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02c68bcc-6046-4b2e-8c42-67346a32c63d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:21.971600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02c68bcc-6046-4b2e-8c42-67346a32c63d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:21.997971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02c68bcc-6046-4b2e-8c42-67346a32c63d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:21.998953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02c68bcc-6046-4b2e-8c42-67346a32c63d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:21.999531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02c68bcc-6046-4b2e-8c42-67346a32c63d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:22.152864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02c68bcc-6046-4b2e-8c42-67346a32c63d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:22.165064 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02c68bcc-6046-4b2e-8c42-67346a32c63d tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1621 microversion: 2.1 time: 0.206968 Jul 26 19:56:22.165866 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1507/2987] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:21 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1621 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:23.107818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ac4d9c74-aa93-4c21-8677-ba33ef1de0fd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:23.128055 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ac4d9c74-aa93-4c21-8677-ba33ef1de0fd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1538 microversion: 2.1 time: 1.776326 Jul 26 19:56:23.137203 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1481/2988] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:21 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1538 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:23.193322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-00d5aa8a-30e1-497d-bb30-ef8cf20974eb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:23.194861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-00d5aa8a-30e1-497d-bb30-ef8cf20974eb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:23.210291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00d5aa8a-30e1-497d-bb30-ef8cf20974eb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:23.212004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00d5aa8a-30e1-497d-bb30-ef8cf20974eb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:23.213112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00d5aa8a-30e1-497d-bb30-ef8cf20974eb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:23.214128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00d5aa8a-30e1-497d-bb30-ef8cf20974eb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:23.392110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-00d5aa8a-30e1-497d-bb30-ef8cf20974eb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:23.404184 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-00d5aa8a-30e1-497d-bb30-ef8cf20974eb tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 200 len: 1621 microversion: 2.1 time: 0.218571 Jul 26 19:56:23.406150 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1508/2989] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:23 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 1621 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:23.586132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-fc02d0f9-16e6-4542-952c-edceed47eb7f req-0abd65a3-e353-49c1-8a09-65c6b95a5321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a506c0f-7d8b-4671-9667-185ede749851", "name": "network-vif-deleted", "tag": "f57edbd3-22f4-4ba5-a486-93b6bb48d154"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:23.637388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fc02d0f9-16e6-4542-952c-edceed47eb7f req-0abd65a3-e353-49c1-8a09-65c6b95a5321 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:23.638088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fc02d0f9-16e6-4542-952c-edceed47eb7f req-0abd65a3-e353-49c1-8a09-65c6b95a5321 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:23.641838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1105128596", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dfc3d8b4-63d5-4c06-8550-4535bd0807ee"}], "security_groups": [{"name": "tempest-securitygroup--1999661902"}], "key_name": "tempest-keypair-2047488868", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7c845bdc-b453-4ec5-a9da-ea4caa8ac30a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:23.689996 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-fc02d0f9-16e6-4542-952c-edceed47eb7f req-0abd65a3-e353-49c1-8a09-65c6b95a5321 service nova] Creating event network-vif-deleted:f57edbd3-22f4-4ba5-a486-93b6bb48d154 for instance 1a506c0f-7d8b-4671-9667-185ede749851 on n-h2-708768-8 Jul 26 19:56:23.727933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-fc02d0f9-16e6-4542-952c-edceed47eb7f req-0abd65a3-e353-49c1-8a09-65c6b95a5321 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146798 Jul 26 19:56:23.741013 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1482/2990] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:24.020285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] validate_networks() for [('dfc3d8b4-63d5-4c06-8550-4535bd0807ee', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:56:24.156017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-21a1593a-96c1-4fe0-b3c0-e55457c79ee0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:24.157504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-21a1593a-96c1-4fe0-b3c0-e55457c79ee0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:24.228857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-21a1593a-96c1-4fe0-b3c0-e55457c79ee0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:24.230538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-21a1593a-96c1-4fe0-b3c0-e55457c79ee0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:24.231921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-21a1593a-96c1-4fe0-b3c0-e55457c79ee0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:24.232730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-21a1593a-96c1-4fe0-b3c0-e55457c79ee0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:24.528104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-21a1593a-96c1-4fe0-b3c0-e55457c79ee0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:24.537662 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-21a1593a-96c1-4fe0-b3c0-e55457c79ee0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.389285 Jul 26 19:56:24.543908 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1483/2991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:24 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:24.552594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:24.559078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 1a506c0f-7d8b-4671-9667-185ede749851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:24.570504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:24.572211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:24.575428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:24.576009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:24.598864 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Instance 1a506c0f-7d8b-4671-9667-185ede749851 could not be found. Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 HTTP/1.1 Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 1a506c0f-7d8b-4671-9667-185ede749851 could not be found. Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '1a506c0f-7d8b-4671-9667-185ede749851'} Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a506c0f-7d8b-4671-9667-185ede749851 could not be found. Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a506c0f-7d8b-4671-9667-185ede749851 could not be found. Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:24.600859 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:24.604930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:24.604930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:24.604930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:24.604930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:24.604930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:24.604930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:24.604930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a506c0f-7d8b-4671-9667-185ede749851 could not be found. Jul 26 19:56:24.604930 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:24.606798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 404 to user: Instance 1a506c0f-7d8b-4671-9667-185ede749851 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:24.607929 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9bfb19d5-f5b4-45f8-8507-9acdad84e589 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851" status: 404 len: 111 microversion: 2.1 time: 0.059168 Jul 26 19:56:24.612597 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1484/2992] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:24 2022] GET /compute/v2.1/servers/1a506c0f-7d8b-4671-9667-185ede749851 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:56:24.617807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-67f5eb97-2177-4d98-8f48-82975afb72cd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '.version_select at 0x7f87683e1ee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:24.659409 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-67f5eb97-2177-4d98-8f48-82975afb72cd tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651981386" status: 202 len: 0 microversion: 2.1 time: 0.045143 Jul 26 19:56:24.660512 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1485/2993] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651981386 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:56:24.924346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:24.934859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Getting quotas for project 447b5dd287aa49e8915187d2c75da345. Resources: dict_keys(['metadata_items']) {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:56:24.951441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Getting quotas for user 9a6a30957f45486fa6880e63c44f9107 and project 447b5dd287aa49e8915187d2c75da345. Resources: dict_keys(['metadata_items']) {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:56:24.979537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:56:24.979987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:56:24.980460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:56:24.980870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:56:24.981282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:56:25.002285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.003905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.006097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.006741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.065281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Getting quotas for project 447b5dd287aa49e8915187d2c75da345. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:56:25.072833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Getting quotas for user 9a6a30957f45486fa6880e63c44f9107 and project 447b5dd287aa49e8915187d2c75da345. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:56:25.101869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:25.102640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:25.125062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.125507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.126929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.127440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.167394 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] HTTP exception thrown: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Request method failure captured: Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 HTTP/1.1 Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EZafazIjUOkFm8PFVNsXd0nKzTY6O1lqqjB031ROTFh_Au_wBo8NwSSpoT2wv4il_ebz5BHqDbnYwmqADYoZl8osTBiBJppEKKXIE-vdOdYlnbD8sMi2iq8Y__J5ZL_rvB7DHnW5Gmogr25ifojllta2BgDNHM4r8CiDtfmc92XhrU Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_114f0f8e78814e9089f720705dc2319c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}] Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ff33e693dc4141e7b4667bee9c2cebfc Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c7616d5d-d9c0-4142-a5a6-f5b67c561504'} Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:25.171867 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.176106 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.177968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Returning 404 to user: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:25.181480 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-337fb5a7-4599-4d42-b502-94b76ac8fa47 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 404 len: 111 microversion: 2.1 time: 0.084195 Jul 26 19:56:25.186225 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1486/2994] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:56:25 2022] DELETE /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:56:25.197325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:25.198840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: c7616d5d-d9c0-4142-a5a6-f5b67c561504] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:25.200535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:56:25.203428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c845bdc-b453-4ec5-a9da-ea4caa8ac30a',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:56:25.207308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.208019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.208950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.209394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.228734 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] HTTP exception thrown: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Request method failure captured: Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 HTTP/1.1 Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EZafazIjUOkFm8PFVNsXd0nKzTY6O1lqqjB031ROTFh_Au_wBo8NwSSpoT2wv4il_ebz5BHqDbnYwmqADYoZl8osTBiBJppEKKXIE-vdOdYlnbD8sMi2iq8Y__J5ZL_rvB7DHnW5Gmogr25ifojllta2BgDNHM4r8CiDtfmc92XhrU Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_114f0f8e78814e9089f720705dc2319c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}] Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ff33e693dc4141e7b4667bee9c2cebfc Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c7616d5d-d9c0-4142-a5a6-f5b67c561504'} Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:25.230465 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.234492 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.234492 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:25.234492 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:25.234492 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:25.234492 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:25.234492 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. Jul 26 19:56:25.234492 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.234492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Returning 404 to user: Instance c7616d5d-d9c0-4142-a5a6-f5b67c561504 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:25.246335 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f2a76d01-21da-4efb-9589-e280c9c355f3 tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504" status: 404 len: 111 microversion: 2.1 time: 0.055943 Jul 26 19:56:25.248877 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1487/2995] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:25 2022] GET /compute/v2.1/servers/c7616d5d-d9c0-4142-a5a6-f5b67c561504 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:56:25.263825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:25.266381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:25.283526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.284479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.286673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.287296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.326189 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] HTTP exception thrown: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Request method failure captured: Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 HTTP/1.1 Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EZafazIjUOkFm8PFVNsXd0nKzTY6O1lqqjB031ROTFh_Au_wBo8NwSSpoT2wv4il_ebz5BHqDbnYwmqADYoZl8osTBiBJppEKKXIE-vdOdYlnbD8sMi2iq8Y__J5ZL_rvB7DHnW5Gmogr25ifojllta2BgDNHM4r8CiDtfmc92XhrU Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_114f0f8e78814e9089f720705dc2319c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}] Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ff33e693dc4141e7b4667bee9c2cebfc Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7bec5c6d-2e2f-4d44-8e81-a36a3332cd16'} Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:25.329225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Returning 404 to user: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:25.333211 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9528d60c-a3f2-4e58-abd7-400915c1dc2f tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 404 len: 111 microversion: 2.1 time: 0.078853 Jul 26 19:56:25.334428 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1488/2996] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:56:25 2022] DELETE /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:56:25.339724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:25.340927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] [instance: 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:25.349881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.350614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.351635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.352240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.371494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] HTTP exception thrown: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Request method failure captured: Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 HTTP/1.1 Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EZafazIjUOkFm8PFVNsXd0nKzTY6O1lqqjB031ROTFh_Au_wBo8NwSSpoT2wv4il_ebz5BHqDbnYwmqADYoZl8osTBiBJppEKKXIE-vdOdYlnbD8sMi2iq8Y__J5ZL_rvB7DHnW5Gmogr25ifojllta2BgDNHM4r8CiDtfmc92XhrU Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_114f0f8e78814e9089f720705dc2319c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/114f0f8e78814e9089f720705dc2319c"}]}] Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 114f0f8e78814e9089f720705dc2319c Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestMultiNic-640219212 Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ff33e693dc4141e7b4667bee9c2cebfc Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestMultiNic-640219212-project Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7bec5c6d-2e2f-4d44-8e81-a36a3332cd16'} Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:25.373994 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] Returning 404 to user: Instance 7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:25.379346 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2af0be61-0c81-48c7-8487-6fe77441021c tempest-ServersTestMultiNic-640219212 tempest-ServersTestMultiNic-640219212-project] 10.222.0.58 "GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16" status: 404 len: 111 microversion: 2.1 time: 0.040626 Jul 26 19:56:25.380369 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1489/2997] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:25 2022] GET /compute/v2.1/servers/7bec5c6d-2e2f-4d44-8e81-a36a3332cd16 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:56:25.471182 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-83600d0d-95c2-4c4a-8f4c-02f7a6a17a85 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.836073 Jul 26 19:56:25.472458 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1509/2998] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:56:23 2022] POST /compute/v2.1/servers => generated 407 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:56:25.484340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7fced9d6-adda-4e53-b8f1-cca8029c8950 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:25.484961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7fced9d6-adda-4e53-b8f1-cca8029c8950 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:25.568779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-926ca882-0c6c-4d33-b9f0-8c5fb26e9886 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:25.569514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-926ca882-0c6c-4d33-b9f0-8c5fb26e9886 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:25.580545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-926ca882-0c6c-4d33-b9f0-8c5fb26e9886 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.580887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-926ca882-0c6c-4d33-b9f0-8c5fb26e9886 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.581681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-926ca882-0c6c-4d33-b9f0-8c5fb26e9886 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:25.582133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-926ca882-0c6c-4d33-b9f0-8c5fb26e9886 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:25.633902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7fced9d6-adda-4e53-b8f1-cca8029c8950 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:25.661043 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7fced9d6-adda-4e53-b8f1-cca8029c8950 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1122 microversion: 2.1 time: 0.181533 Jul 26 19:56:25.672328 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1490/2999] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:25 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1122 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:25.910593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-926ca882-0c6c-4d33-b9f0-8c5fb26e9886 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:25.924608 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-926ca882-0c6c-4d33-b9f0-8c5fb26e9886 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.361032 Jul 26 19:56:25.927539 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1510/3000] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:25 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:26.685017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85528ff0-475f-4b15-9024-0b3bfbf31dd9 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:26.685612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-85528ff0-475f-4b15-9024-0b3bfbf31dd9 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:26.696594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85528ff0-475f-4b15-9024-0b3bfbf31dd9 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:26.697046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85528ff0-475f-4b15-9024-0b3bfbf31dd9 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:26.697832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85528ff0-475f-4b15-9024-0b3bfbf31dd9 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:26.698272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85528ff0-475f-4b15-9024-0b3bfbf31dd9 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:26.820549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-85528ff0-475f-4b15-9024-0b3bfbf31dd9 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:26.830734 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85528ff0-475f-4b15-9024-0b3bfbf31dd9 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1220 microversion: 2.1 time: 0.151553 Jul 26 19:56:26.839640 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1491/3001] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:26 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:26.950547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-343f9c0d-fb21-46f6-a4df-bf5b5657331f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:26.951918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-343f9c0d-fb21-46f6-a4df-bf5b5657331f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:26.967808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-343f9c0d-fb21-46f6-a4df-bf5b5657331f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:26.969913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-343f9c0d-fb21-46f6-a4df-bf5b5657331f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:26.974478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-343f9c0d-fb21-46f6-a4df-bf5b5657331f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:26.975184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-343f9c0d-fb21-46f6-a4df-bf5b5657331f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:27.571401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-343f9c0d-fb21-46f6-a4df-bf5b5657331f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:27.586733 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-343f9c0d-fb21-46f6-a4df-bf5b5657331f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.638677 Jul 26 19:56:27.589120 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1511/3002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:26 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:27.856041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-42929181-f589-46a0-8cf5-aa648d05ba57 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:27.857400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-42929181-f589-46a0-8cf5-aa648d05ba57 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:27.867700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42929181-f589-46a0-8cf5-aa648d05ba57 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:27.870872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42929181-f589-46a0-8cf5-aa648d05ba57 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:27.874821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42929181-f589-46a0-8cf5-aa648d05ba57 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:27.877525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42929181-f589-46a0-8cf5-aa648d05ba57 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:27.925203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e14099d8-25a9-425f-9776-fd6464303ffc tempest-QuotaClassesAdmin257Test-2079485210 tempest-QuotaClassesAdmin257Test-2079485210-project-admin] Calling method '.version_select at 0x7f87682b69d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:27.926880 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:56:27.926880 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:56:27.951737 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e14099d8-25a9-425f-9776-fd6464303ffc tempest-QuotaClassesAdmin257Test-2079485210 tempest-QuotaClassesAdmin257Test-2079485210-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.298347 Jul 26 19:56:27.954130 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1492/3003] 10.222.0.58 () {60 vars in 1226 bytes} [Tue Jul 26 19:56:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:56:27.965922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5654907-7cfb-4f7e-b50a-3a0c02793e42 tempest-QuotaClassesAdmin257Test-2079485210 tempest-QuotaClassesAdmin257Test-2079485210-project-admin] Action: 'update', calling method: .version_select at 0x7f87682b6e50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:27.970049 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:56:27.970049 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:56:28.167400 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c5654907-7cfb-4f7e-b50a-3a0c02793e42 tempest-QuotaClassesAdmin257Test-2079485210 tempest-QuotaClassesAdmin257Test-2079485210-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.206670 Jul 26 19:56:28.170466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1493/3004] 10.222.0.58 () {62 vars in 1247 bytes} [Tue Jul 26 19:56:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:56:28.183194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-da45385d-fe16-427f-b321-5485acac3c4c tempest-QuotaClassesAdmin257Test-2079485210 tempest-QuotaClassesAdmin257Test-2079485210-project-admin] Calling method '.version_select at 0x7f876825f3a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:28.222854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-da45385d-fe16-427f-b321-5485acac3c4c tempest-QuotaClassesAdmin257Test-2079485210 tempest-QuotaClassesAdmin257Test-2079485210-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.043787 Jul 26 19:56:28.223707 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1494/3005] 10.222.0.58 () {60 vars in 1226 bytes} [Tue Jul 26 19:56:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:56:28.235201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e5f5ef6e-79a8-4df5-a630-76daa68cbc52 tempest-QuotaClassesAdmin257Test-2079485210 tempest-QuotaClassesAdmin257Test-2079485210-project-admin] Action: 'update', calling method: .version_select at 0x7f8768231dc0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:28.351999 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e5f5ef6e-79a8-4df5-a630-76daa68cbc52 tempest-QuotaClassesAdmin257Test-2079485210 tempest-QuotaClassesAdmin257Test-2079485210-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.121044 Jul 26 19:56:28.357374 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1495/3006] 10.222.0.58 () {62 vars in 1247 bytes} [Tue Jul 26 19:56:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 19:56:28.610924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fbd17c42-b196-4b1b-bac4-251404290227 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:28.611998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fbd17c42-b196-4b1b-bac4-251404290227 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:28.621921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbd17c42-b196-4b1b-bac4-251404290227 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:28.626038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbd17c42-b196-4b1b-bac4-251404290227 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:28.627138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbd17c42-b196-4b1b-bac4-251404290227 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:28.629695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbd17c42-b196-4b1b-bac4-251404290227 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:28.698927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-42929181-f589-46a0-8cf5-aa648d05ba57 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:28.709957 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-42929181-f589-46a0-8cf5-aa648d05ba57 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1306 microversion: 2.1 time: 0.858580 Jul 26 19:56:28.736099 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1512/3007] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:27 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1306 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:29.019908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fbd17c42-b196-4b1b-bac4-251404290227 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:29.029329 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fbd17c42-b196-4b1b-bac4-251404290227 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.422767 Jul 26 19:56:29.037903 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1496/3008] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:28 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:29.743389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dcc3a5b4-a83b-48b8-ac80-23aa98a3d535 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:29.744791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dcc3a5b4-a83b-48b8-ac80-23aa98a3d535 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:29.762127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dcc3a5b4-a83b-48b8-ac80-23aa98a3d535 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:29.762990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dcc3a5b4-a83b-48b8-ac80-23aa98a3d535 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:29.764060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dcc3a5b4-a83b-48b8-ac80-23aa98a3d535 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:29.764784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dcc3a5b4-a83b-48b8-ac80-23aa98a3d535 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:30.030973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dcc3a5b4-a83b-48b8-ac80-23aa98a3d535 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:30.040713 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dcc3a5b4-a83b-48b8-ac80-23aa98a3d535 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1306 microversion: 2.1 time: 0.301125 Jul 26 19:56:30.065816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f8ef5b0-8bcf-4e88-8b80-38cea8673ee2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:30.075461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1f8ef5b0-8bcf-4e88-8b80-38cea8673ee2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:30.085293 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1513/3009] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:29 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1306 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:30.095974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f8ef5b0-8bcf-4e88-8b80-38cea8673ee2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:30.098787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f8ef5b0-8bcf-4e88-8b80-38cea8673ee2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:30.099859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f8ef5b0-8bcf-4e88-8b80-38cea8673ee2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:30.105634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f8ef5b0-8bcf-4e88-8b80-38cea8673ee2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:30.446281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-218a48f6-3c50-4196-8869-0e1d0ef21fb1 req-17b23682-9e4f-42fb-aacf-72af0c85bd02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653ce92f-4a72-47da-a702-73aa770b76bc", "tag": "d724e79a-8161-4d71-a463-ac224e25a24a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:30.482015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-218a48f6-3c50-4196-8869-0e1d0ef21fb1 req-17b23682-9e4f-42fb-aacf-72af0c85bd02 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:30.485761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-218a48f6-3c50-4196-8869-0e1d0ef21fb1 req-17b23682-9e4f-42fb-aacf-72af0c85bd02 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:30.510141 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-218a48f6-3c50-4196-8869-0e1d0ef21fb1 req-17b23682-9e4f-42fb-aacf-72af0c85bd02 service nova] Creating event network-changed:d724e79a-8161-4d71-a463-ac224e25a24a for instance 653ce92f-4a72-47da-a702-73aa770b76bc on n-h2-708768-8 Jul 26 19:56:30.526802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-218a48f6-3c50-4196-8869-0e1d0ef21fb1 req-17b23682-9e4f-42fb-aacf-72af0c85bd02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083939 Jul 26 19:56:30.527677 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1514/3010] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:56:30.694714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1f8ef5b0-8bcf-4e88-8b80-38cea8673ee2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:30.706860 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1f8ef5b0-8bcf-4e88-8b80-38cea8673ee2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.643684 Jul 26 19:56:30.714603 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1497/3011] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:30 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:31.065863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b72d17cb-9806-4d9f-ad6c-d00381cf1ffb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:31.066582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b72d17cb-9806-4d9f-ad6c-d00381cf1ffb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:31.095817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b72d17cb-9806-4d9f-ad6c-d00381cf1ffb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:31.096624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b72d17cb-9806-4d9f-ad6c-d00381cf1ffb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:31.098683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b72d17cb-9806-4d9f-ad6c-d00381cf1ffb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:31.102279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b72d17cb-9806-4d9f-ad6c-d00381cf1ffb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:31.739632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bafba8bf-0d7a-4606-9a4b-bfb6b461b30f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:31.744773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bafba8bf-0d7a-4606-9a4b-bfb6b461b30f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:31.764358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bafba8bf-0d7a-4606-9a4b-bfb6b461b30f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:31.765837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bafba8bf-0d7a-4606-9a4b-bfb6b461b30f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:31.767571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bafba8bf-0d7a-4606-9a4b-bfb6b461b30f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:31.768045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bafba8bf-0d7a-4606-9a4b-bfb6b461b30f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:31.867883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b72d17cb-9806-4d9f-ad6c-d00381cf1ffb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:31.878295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b72d17cb-9806-4d9f-ad6c-d00381cf1ffb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1306 microversion: 2.1 time: 0.817772 Jul 26 19:56:31.879456 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1515/3012] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:31 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1306 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:32.898549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4297123c-e4bc-465f-bbfa-5274fd86ba42 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:32.899270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4297123c-e4bc-465f-bbfa-5274fd86ba42 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:32.914104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4297123c-e4bc-465f-bbfa-5274fd86ba42 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:32.914560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4297123c-e4bc-465f-bbfa-5274fd86ba42 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:32.915354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4297123c-e4bc-465f-bbfa-5274fd86ba42 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:32.915820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4297123c-e4bc-465f-bbfa-5274fd86ba42 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:33.101705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bafba8bf-0d7a-4606-9a4b-bfb6b461b30f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:33.116931 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bafba8bf-0d7a-4606-9a4b-bfb6b461b30f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 1.381554 Jul 26 19:56:33.122133 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1498/3013] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:31 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:33.278918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4297123c-e4bc-465f-bbfa-5274fd86ba42 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:33.291367 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4297123c-e4bc-465f-bbfa-5274fd86ba42 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1306 microversion: 2.1 time: 0.396791 Jul 26 19:56:33.291994 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1516/3014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:32 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1306 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:34.150367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a631bf6a-aa87-4a9d-be25-edfbbbf426d4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:34.150911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a631bf6a-aa87-4a9d-be25-edfbbbf426d4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:34.178175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a631bf6a-aa87-4a9d-be25-edfbbbf426d4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:34.178859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a631bf6a-aa87-4a9d-be25-edfbbbf426d4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:34.182787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a631bf6a-aa87-4a9d-be25-edfbbbf426d4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:34.183414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a631bf6a-aa87-4a9d-be25-edfbbbf426d4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:34.322972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5ee4fc60-b1e0-4085-b734-9c675ca7b921 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:34.323736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5ee4fc60-b1e0-4085-b734-9c675ca7b921 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:34.334158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ee4fc60-b1e0-4085-b734-9c675ca7b921 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:34.348241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ee4fc60-b1e0-4085-b734-9c675ca7b921 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:34.349304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ee4fc60-b1e0-4085-b734-9c675ca7b921 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:34.349850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ee4fc60-b1e0-4085-b734-9c675ca7b921 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:34.502403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a631bf6a-aa87-4a9d-be25-edfbbbf426d4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:34.512414 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a631bf6a-aa87-4a9d-be25-edfbbbf426d4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.366397 Jul 26 19:56:34.513681 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1499/3015] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:34 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:34.781134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5ee4fc60-b1e0-4085-b734-9c675ca7b921 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:34.797664 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5ee4fc60-b1e0-4085-b734-9c675ca7b921 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1306 microversion: 2.1 time: 0.475569 Jul 26 19:56:34.797664 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1517/3016] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:34 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1306 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:35.540150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4514ca08-55c3-441b-abbc-6640ee29555d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:35.541473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4514ca08-55c3-441b-abbc-6640ee29555d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:35.555568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4514ca08-55c3-441b-abbc-6640ee29555d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:35.559736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4514ca08-55c3-441b-abbc-6640ee29555d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:35.563586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4514ca08-55c3-441b-abbc-6640ee29555d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:35.569583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4514ca08-55c3-441b-abbc-6640ee29555d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:35.627760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:35.630763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:35.834319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4514ca08-55c3-441b-abbc-6640ee29555d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:35.843775 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4514ca08-55c3-441b-abbc-6640ee29555d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.308816 Jul 26 19:56:35.847991 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1500/3017] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:35 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:35.861322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0f26c73-a446-40bd-8058-ffa415499903 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:35.862326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0f26c73-a446-40bd-8058-ffa415499903 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:35.870825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0f26c73-a446-40bd-8058-ffa415499903 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:35.871280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0f26c73-a446-40bd-8058-ffa415499903 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:35.872084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0f26c73-a446-40bd-8058-ffa415499903 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:35.872518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0f26c73-a446-40bd-8058-ffa415499903 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:36.107549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e0f26c73-a446-40bd-8058-ffa415499903 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:36.108980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1912795133", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": "none"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:36.122716 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0f26c73-a446-40bd-8058-ffa415499903 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1306 microversion: 2.1 time: 0.267530 Jul 26 19:56:36.122716 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1501/3018] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:35 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1306 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:36.197824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:56:36.198791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:56:36.199429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:56:36.200336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:56:36.201359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:56:36.212428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a7c895b-cb4f-404c-9f03-962ae593c0e8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:36.213192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a7c895b-cb4f-404c-9f03-962ae593c0e8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:36.222481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:36.222939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:36.223790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:36.224147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a7c895b-cb4f-404c-9f03-962ae593c0e8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:36.224284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:36.226230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a7c895b-cb4f-404c-9f03-962ae593c0e8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:36.227206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a7c895b-cb4f-404c-9f03-962ae593c0e8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:36.229553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a7c895b-cb4f-404c-9f03-962ae593c0e8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:36.252809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Getting quotas for project 58f3bafa5736448da7b9baedbc2d5111. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:56:36.263452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Getting quotas for user d7b24d3cdbdc4bba8cc46107bade7f4a and project 58f3bafa5736448da7b9baedbc2d5111. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:56:36.285921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:56:36.287557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a7c895b-cb4f-404c-9f03-962ae593c0e8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:56:36.289152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:56:36.341688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:36.377440 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-73f120b6-1dae-49e0-85c7-f797287303cf tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.757416 Jul 26 19:56:36.379137 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1518/3019] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 19:56:36.432286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a76a6c0f-430a-4c24-b9a0-a7bcde9a80c1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:36.434648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a76a6c0f-430a-4c24-b9a0-a7bcde9a80c1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:36.486023 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a7c895b-cb4f-404c-9f03-962ae593c0e8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 204 len: 0 microversion: 2.1 time: 0.277149 Jul 26 19:56:36.491550 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1502/3020] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:56:36 2022] DELETE /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:56:36.497897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8a3c840e-1146-48b9-886a-53f4c04e8b87 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:36.499700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8a3c840e-1146-48b9-886a-53f4c04e8b87 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:36.513676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a3c840e-1146-48b9-886a-53f4c04e8b87 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:36.514125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a3c840e-1146-48b9-886a-53f4c04e8b87 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:36.515485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a3c840e-1146-48b9-886a-53f4c04e8b87 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:36.515974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a3c840e-1146-48b9-886a-53f4c04e8b87 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:36.616540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a76a6c0f-430a-4c24-b9a0-a7bcde9a80c1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:36.628278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a76a6c0f-430a-4c24-b9a0-a7bcde9a80c1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:36.629783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a76a6c0f-430a-4c24-b9a0-a7bcde9a80c1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:36.642883 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a76a6c0f-430a-4c24-b9a0-a7bcde9a80c1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "PUT /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1359 microversion: 2.75 time: 0.252717 Jul 26 19:56:36.660605 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1519/3021] 10.222.0.58 () {62 vars in 1297 bytes} [Tue Jul 26 19:56:36 2022] PUT /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:36.668081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47bb0768-ecd4-441f-83be-41ff6deafd5b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:36.668923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47bb0768-ecd4-441f-83be-41ff6deafd5b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:36.755746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47bb0768-ecd4-441f-83be-41ff6deafd5b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:36.766254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47bb0768-ecd4-441f-83be-41ff6deafd5b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:36.768335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47bb0768-ecd4-441f-83be-41ff6deafd5b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:36.775947 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47bb0768-ecd4-441f-83be-41ff6deafd5b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1359 microversion: 2.75 time: 0.111398 Jul 26 19:56:36.777276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a3c840e-1146-48b9-886a-53f4c04e8b87 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:36.788329 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1520/3022] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:36 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1359 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:56:36.790632 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8a3c840e-1146-48b9-886a-53f4c04e8b87 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1509 microversion: 2.1 time: 0.297326 Jul 26 19:56:36.796521 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1503/3023] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:36 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:36.871779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-486561f6-3178-4d9e-899a-32089a54d24f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:36.872485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-486561f6-3178-4d9e-899a-32089a54d24f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:36.883721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-486561f6-3178-4d9e-899a-32089a54d24f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:36.884202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-486561f6-3178-4d9e-899a-32089a54d24f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:36.885330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-486561f6-3178-4d9e-899a-32089a54d24f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:36.885952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-486561f6-3178-4d9e-899a-32089a54d24f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:37.138570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5085e71-d2a5-47f1-92f2-cd01978a9cc3 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:37.139290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5085e71-d2a5-47f1-92f2-cd01978a9cc3 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:37.155198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5085e71-d2a5-47f1-92f2-cd01978a9cc3 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:37.163734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5085e71-d2a5-47f1-92f2-cd01978a9cc3 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:37.164680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5085e71-d2a5-47f1-92f2-cd01978a9cc3 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:37.165126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5085e71-d2a5-47f1-92f2-cd01978a9cc3 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:37.185336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-486561f6-3178-4d9e-899a-32089a54d24f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:37.201577 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-486561f6-3178-4d9e-899a-32089a54d24f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.333174 Jul 26 19:56:37.203466 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1521/3024] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:36 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:37.452966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f5085e71-d2a5-47f1-92f2-cd01978a9cc3 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:37.463124 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5085e71-d2a5-47f1-92f2-cd01978a9cc3 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1306 microversion: 2.1 time: 0.329214 Jul 26 19:56:37.479092 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1504/3025] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:37 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1306 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:37.801661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:37.802372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:37.813172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca8ef596-02f1-4a3e-82a1-b804e427c320 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:37.814371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca8ef596-02f1-4a3e-82a1-b804e427c320 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:37.822970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ef596-02f1-4a3e-82a1-b804e427c320 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:37.823410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ef596-02f1-4a3e-82a1-b804e427c320 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:37.824596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:37.825202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:37.826158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:37.826746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:37.828589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ef596-02f1-4a3e-82a1-b804e427c320 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:37.832418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ef596-02f1-4a3e-82a1-b804e427c320 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:37.980182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:37.993591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:37.995554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:38.002025 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ed40518-8e07-42e7-87a8-f7de3c1f845d tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1419 microversion: 2.75 time: 0.204215 Jul 26 19:56:38.003333 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1522/3026] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:37 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1419 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:38.050321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ca8ef596-02f1-4a3e-82a1-b804e427c320 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:38.058368 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ca8ef596-02f1-4a3e-82a1-b804e427c320 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1509 microversion: 2.1 time: 0.249505 Jul 26 19:56:38.059564 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1505/3027] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:37 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:38.227942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a14854e3-a3bf-4f29-8132-a4759f126b01 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:38.228799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a14854e3-a3bf-4f29-8132-a4759f126b01 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:38.236318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a14854e3-a3bf-4f29-8132-a4759f126b01 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:38.237373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a14854e3-a3bf-4f29-8132-a4759f126b01 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:38.238504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a14854e3-a3bf-4f29-8132-a4759f126b01 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:38.239092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a14854e3-a3bf-4f29-8132-a4759f126b01 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:38.424513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a14854e3-a3bf-4f29-8132-a4759f126b01 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:38.438189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a14854e3-a3bf-4f29-8132-a4759f126b01 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.214172 Jul 26 19:56:38.439396 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1523/3028] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:38 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:38.487886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de7b8126-46e5-44cb-a1b7-d5b313a3a6a8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:38.488942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de7b8126-46e5-44cb-a1b7-d5b313a3a6a8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:38.493327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:38.500165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de7b8126-46e5-44cb-a1b7-d5b313a3a6a8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:38.500831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de7b8126-46e5-44cb-a1b7-d5b313a3a6a8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:38.501692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de7b8126-46e5-44cb-a1b7-d5b313a3a6a8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:38.502120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de7b8126-46e5-44cb-a1b7-d5b313a3a6a8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:38.792254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-de7b8126-46e5-44cb-a1b7-d5b313a3a6a8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:38.801230 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de7b8126-46e5-44cb-a1b7-d5b313a3a6a8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.318817 Jul 26 19:56:38.803691 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1506/3029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:38 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:39.036865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:39.037543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:39.045976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:39.050244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:39.051048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:39.051481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:39.073382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:39.087929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d64b2553-f5ac-45b5-ae4d-eb91e5b88412 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:39.090764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d64b2553-f5ac-45b5-ae4d-eb91e5b88412 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:39.101268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=15,nova_api:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:39.103509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d64b2553-f5ac-45b5-ae4d-eb91e5b88412 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:39.104292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d64b2553-f5ac-45b5-ae4d-eb91e5b88412 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:39.105298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d64b2553-f5ac-45b5-ae4d-eb91e5b88412 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:39.106020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d64b2553-f5ac-45b5-ae4d-eb91e5b88412 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:39.165236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:39.175057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:39.177511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:39.183325 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-57eec682-783f-4d1e-8997-daa2e6c39030 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1417 microversion: 2.75 time: 0.153662 Jul 26 19:56:39.184456 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1524/3030] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:39 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1417 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:39.461126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21ea8e3a-60f6-4e5f-9e78-85b409e67d14 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:39.461901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21ea8e3a-60f6-4e5f-9e78-85b409e67d14 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:39.473346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21ea8e3a-60f6-4e5f-9e78-85b409e67d14 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:39.473892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21ea8e3a-60f6-4e5f-9e78-85b409e67d14 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:39.474930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d64b2553-f5ac-45b5-ae4d-eb91e5b88412 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:39.475867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21ea8e3a-60f6-4e5f-9e78-85b409e67d14 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:39.476988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21ea8e3a-60f6-4e5f-9e78-85b409e67d14 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:39.482858 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d64b2553-f5ac-45b5-ae4d-eb91e5b88412 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1509 microversion: 2.1 time: 0.403551 Jul 26 19:56:39.484225 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1507/3031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:39 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:39.664969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21ea8e3a-60f6-4e5f-9e78-85b409e67d14 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:39.674065 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21ea8e3a-60f6-4e5f-9e78-85b409e67d14 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.216745 Jul 26 19:56:39.684298 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1525/3032] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:39 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:39.825845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2cccaa72-e0ed-4ac4-91ad-1c34d1a7b5e4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:39.826604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2cccaa72-e0ed-4ac4-91ad-1c34d1a7b5e4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:39.836003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cccaa72-e0ed-4ac4-91ad-1c34d1a7b5e4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:39.836754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cccaa72-e0ed-4ac4-91ad-1c34d1a7b5e4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:39.837852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cccaa72-e0ed-4ac4-91ad-1c34d1a7b5e4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:39.838428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cccaa72-e0ed-4ac4-91ad-1c34d1a7b5e4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:40.210398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:40.211127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:40.224748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:40.227146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:40.228098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:40.229400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:40.349840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2cccaa72-e0ed-4ac4-91ad-1c34d1a7b5e4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:40.359374 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2cccaa72-e0ed-4ac4-91ad-1c34d1a7b5e4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.537225 Jul 26 19:56:40.361602 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1508/3033] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:39 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:40.404770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:40.423148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:40.425719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:40.433511 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2689787c-3887-4c08-afb7-3da606942df7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1417 microversion: 2.75 time: 0.226854 Jul 26 19:56:40.434688 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1526/3034] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:40 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1417 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:40.463292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-9e708c9c-3692-41f9-b629-5e3d8cb2367d req-e44887fd-ef28-477e-a6fd-eaac28a2f126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e85cae1-2beb-4a4f-9ff6-b6f594b088b2", "name": "network-vif-deleted", "tag": "df3b4566-8e9d-48e1-ab1e-4fdc624c5211"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:40.485510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9e708c9c-3692-41f9-b629-5e3d8cb2367d req-e44887fd-ef28-477e-a6fd-eaac28a2f126 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:40.488101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9e708c9c-3692-41f9-b629-5e3d8cb2367d req-e44887fd-ef28-477e-a6fd-eaac28a2f126 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:40.554818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-9e708c9c-3692-41f9-b629-5e3d8cb2367d req-e44887fd-ef28-477e-a6fd-eaac28a2f126 service nova] Creating event network-vif-deleted:df3b4566-8e9d-48e1-ab1e-4fdc624c5211 for instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 on n-h2-708768-8 Jul 26 19:56:40.569271 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-9e708c9c-3692-41f9-b629-5e3d8cb2367d req-e44887fd-ef28-477e-a6fd-eaac28a2f126 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111339 Jul 26 19:56:40.573185 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1509/3035] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:56:40.699849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f93b45a6-839f-46df-bb63-071487131409 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:40.700976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f93b45a6-839f-46df-bb63-071487131409 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:40.720995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f93b45a6-839f-46df-bb63-071487131409 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:40.721757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f93b45a6-839f-46df-bb63-071487131409 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:40.725314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f93b45a6-839f-46df-bb63-071487131409 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:40.730847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f93b45a6-839f-46df-bb63-071487131409 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:40.965983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:40.966823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:40.994603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:40.996176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.004715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.006447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.069435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.070519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.071626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lazy-loading 'fault' on Instance uuid 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:56:41.208071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:41.215596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f93b45a6-839f-46df-bb63-071487131409 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:41.234797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f93b45a6-839f-46df-bb63-071487131409 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.540941 Jul 26 19:56:41.237506 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1510/3036] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:40 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:41.262167 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b20ac928-b070-4cb1-9ffe-cc32b8c4c1f6 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 200 len: 1312 microversion: 2.1 time: 0.749267 Jul 26 19:56:41.262828 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1527/3037] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:40 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 1312 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:41.381402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68fe2393-796a-41f8-8088-5bcd0151ebda tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:41.382015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68fe2393-796a-41f8-8088-5bcd0151ebda tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:41.388620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68fe2393-796a-41f8-8088-5bcd0151ebda tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.389115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68fe2393-796a-41f8-8088-5bcd0151ebda tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.390616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68fe2393-796a-41f8-8088-5bcd0151ebda tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.391049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68fe2393-796a-41f8-8088-5bcd0151ebda tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.465222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:41.466236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:41.474044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.474799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.475795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.476561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.566594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:41.578968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:41.581579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:41.588335 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e3f6806-c32a-438d-9a4d-7c6aa8dcbefe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1438 microversion: 2.75 time: 0.126969 Jul 26 19:56:41.589196 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1528/3038] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:41 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1438 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:56:41.619932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:41.624495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:41.632199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.632649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.633709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.634330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.755520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:56:41.756467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:56:41.756721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:56:41.756900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:56:41.757498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:56:41.808785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68fe2393-796a-41f8-8088-5bcd0151ebda tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:41.823279 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68fe2393-796a-41f8-8088-5bcd0151ebda tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.445718 Jul 26 19:56:41.824046 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1511/3039] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:41 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:41.862050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:41.869596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:41.880503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.881458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:41.882997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:41.883698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.273304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0fce69e-a197-414d-a70b-ccdd3ccd6fdb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:42.274475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a0fce69e-a197-414d-a70b-ccdd3ccd6fdb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:42.293113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0fce69e-a197-414d-a70b-ccdd3ccd6fdb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.293593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0fce69e-a197-414d-a70b-ccdd3ccd6fdb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.294421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0fce69e-a197-414d-a70b-ccdd3ccd6fdb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.295145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0fce69e-a197-414d-a70b-ccdd3ccd6fdb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.483870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:42.492283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:42.493807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:42.509145 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79caf8d2-4a6b-49f1-bc74-291df5ec9213 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "POST /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5/action" status: 202 len: 1495 microversion: 2.75 time: 0.894281 Jul 26 19:56:42.509864 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1529/3040] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 19:56:41 2022] POST /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5/action => generated 1495 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 19:56:42.519262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:42.520048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:42.526520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.527314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.528364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.529291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.544199 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 could not be found. Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 HTTP/1.1 Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 could not be found. Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '2e85cae1-2beb-4a4f-9ff6-b6f594b088b2'} Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 could not be found. Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 could not be found. Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:42.546572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 could not be found. Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 404 to user: Instance 2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b5e07559-0dac-496e-8da4-d9eacdc82abc tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2" status: 404 len: 111 microversion: 2.1 time: 0.037498 Jul 26 19:56:42.553026 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1530/3041] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:42 2022] GET /compute/v2.1/servers/2e85cae1-2beb-4a4f-9ff6-b6f594b088b2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:56:42.556617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:42.557366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:42.563762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.564561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.565578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.566236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.575509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a0fce69e-a197-414d-a70b-ccdd3ccd6fdb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:42.583370 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0fce69e-a197-414d-a70b-ccdd3ccd6fdb tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.326236 Jul 26 19:56:42.584033 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1512/3042] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:42 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:42.588489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-861c0241-175f-4074-bc1f-3988c17ae384 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:42.588992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-861c0241-175f-4074-bc1f-3988c17ae384 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:42.606495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-861c0241-175f-4074-bc1f-3988c17ae384 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.612044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-861c0241-175f-4074-bc1f-3988c17ae384 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.613149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-861c0241-175f-4074-bc1f-3988c17ae384 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.613784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-861c0241-175f-4074-bc1f-3988c17ae384 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.651869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-861c0241-175f-4074-bc1f-3988c17ae384 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:56:42.741169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:42.759982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:42.764794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:42.778913 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d1cfb1ed-8532-4a82-88bb-d9d5601ede6b tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.227165 Jul 26 19:56:42.779834 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-861c0241-175f-4074-bc1f-3988c17ae384 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 204 len: 0 microversion: 2.1 time: 0.191988 Jul 26 19:56:42.780754 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1531/3043] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:42 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:42.785146 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1513/3044] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:56:42 2022] DELETE /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:56:42.802156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-434dbc41-3997-4cd0-9a4e-a87b568398b2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:42.802156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-434dbc41-3997-4cd0-9a4e-a87b568398b2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:42.811432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-434dbc41-3997-4cd0-9a4e-a87b568398b2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.811432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-434dbc41-3997-4cd0-9a4e-a87b568398b2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.811432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-434dbc41-3997-4cd0-9a4e-a87b568398b2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.811432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-434dbc41-3997-4cd0-9a4e-a87b568398b2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.848902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c36f429d-2b85-4771-9bb0-9a9755cc0b63 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:42.850163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c36f429d-2b85-4771-9bb0-9a9755cc0b63 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:42.858021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c36f429d-2b85-4771-9bb0-9a9755cc0b63 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.858507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c36f429d-2b85-4771-9bb0-9a9755cc0b63 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:42.859489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c36f429d-2b85-4771-9bb0-9a9755cc0b63 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:42.859970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c36f429d-2b85-4771-9bb0-9a9755cc0b63 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:43.037628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c36f429d-2b85-4771-9bb0-9a9755cc0b63 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:43.052043 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c36f429d-2b85-4771-9bb0-9a9755cc0b63 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.209951 Jul 26 19:56:43.053739 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1514/3045] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:42 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:43.104160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-434dbc41-3997-4cd0-9a4e-a87b568398b2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:43.119358 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-434dbc41-3997-4cd0-9a4e-a87b568398b2 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.330002 Jul 26 19:56:43.120894 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1532/3046] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:42 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:43.608706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c4a5b2ca-8775-45ce-8dc3-e8aeb7a81b1a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:43.609412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c4a5b2ca-8775-45ce-8dc3-e8aeb7a81b1a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:43.629781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c4a5b2ca-8775-45ce-8dc3-e8aeb7a81b1a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:43.635079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c4a5b2ca-8775-45ce-8dc3-e8aeb7a81b1a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:43.636702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c4a5b2ca-8775-45ce-8dc3-e8aeb7a81b1a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:43.639634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c4a5b2ca-8775-45ce-8dc3-e8aeb7a81b1a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:43.812828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:43.814530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:43.833638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:43.834305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:43.835279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:43.835919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:43.900194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c4a5b2ca-8775-45ce-8dc3-e8aeb7a81b1a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:43.916624 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c4a5b2ca-8775-45ce-8dc3-e8aeb7a81b1a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.312317 Jul 26 19:56:43.918254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1515/3047] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:43 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:43.966338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:43.976302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:43.989374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:43.998248 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f7d8c640-f04b-4098-b71a-b4d61d50b5fe tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.192520 Jul 26 19:56:44.002744 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1533/3048] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:43 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:44.077120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e550028e-b8ae-462b-8424-b7d4a09ef103 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:44.077120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e550028e-b8ae-462b-8424-b7d4a09ef103 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:44.085765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e550028e-b8ae-462b-8424-b7d4a09ef103 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:44.085765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e550028e-b8ae-462b-8424-b7d4a09ef103 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:44.086083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e550028e-b8ae-462b-8424-b7d4a09ef103 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:44.086594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e550028e-b8ae-462b-8424-b7d4a09ef103 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:44.147684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ac01296a-58aa-4efc-b400-570290ac6550 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:44.148317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ac01296a-58aa-4efc-b400-570290ac6550 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:44.156128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac01296a-58aa-4efc-b400-570290ac6550 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:44.156128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac01296a-58aa-4efc-b400-570290ac6550 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:44.157389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac01296a-58aa-4efc-b400-570290ac6550 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:44.157957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac01296a-58aa-4efc-b400-570290ac6550 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:44.432109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e550028e-b8ae-462b-8424-b7d4a09ef103 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:44.446980 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e550028e-b8ae-462b-8424-b7d4a09ef103 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.373459 Jul 26 19:56:44.447998 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1516/3049] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:44 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:44.736529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ac01296a-58aa-4efc-b400-570290ac6550 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:44.745459 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ac01296a-58aa-4efc-b400-570290ac6550 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.603254 Jul 26 19:56:44.752461 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1534/3050] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:44 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:44.942825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c3eeb47-4a8c-465b-ae22-13fbe6cfb5e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:44.943516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3c3eeb47-4a8c-465b-ae22-13fbe6cfb5e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:44.952497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c3eeb47-4a8c-465b-ae22-13fbe6cfb5e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:44.953222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c3eeb47-4a8c-465b-ae22-13fbe6cfb5e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:44.954137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c3eeb47-4a8c-465b-ae22-13fbe6cfb5e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:44.954785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c3eeb47-4a8c-465b-ae22-13fbe6cfb5e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:44.960951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:45.038116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:45.038724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:45.054796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:45.055252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:45.061760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:45.062642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:45.140971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:45.155902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:45.157427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:45.163467 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd0cac3e-d8ac-4a78-9dd5-9c05b73659f8 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.129189 Jul 26 19:56:45.164586 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1535/3051] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:45 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:45.215378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c3eeb47-4a8c-465b-ae22-13fbe6cfb5e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:45.224739 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c3eeb47-4a8c-465b-ae22-13fbe6cfb5e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.286119 Jul 26 19:56:45.238764 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1517/3052] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:44 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:45.472777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-58bfe708-973e-4ef3-b773-bab3b6da7dbf tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:45.473405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-58bfe708-973e-4ef3-b773-bab3b6da7dbf tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:45.480020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58bfe708-973e-4ef3-b773-bab3b6da7dbf tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:45.480806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58bfe708-973e-4ef3-b773-bab3b6da7dbf tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:45.482024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58bfe708-973e-4ef3-b773-bab3b6da7dbf tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:45.482626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58bfe708-973e-4ef3-b773-bab3b6da7dbf tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:45.684909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-58bfe708-973e-4ef3-b773-bab3b6da7dbf tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:45.697571 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-58bfe708-973e-4ef3-b773-bab3b6da7dbf tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.227672 Jul 26 19:56:45.698609 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1536/3053] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:45 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:45.769329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5d9c5827-1e3c-4d88-9413-8c01dddd07d4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:45.769895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5d9c5827-1e3c-4d88-9413-8c01dddd07d4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:45.782492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d9c5827-1e3c-4d88-9413-8c01dddd07d4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:45.783368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d9c5827-1e3c-4d88-9413-8c01dddd07d4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:45.786887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d9c5827-1e3c-4d88-9413-8c01dddd07d4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:45.789105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d9c5827-1e3c-4d88-9413-8c01dddd07d4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:46.097271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5d9c5827-1e3c-4d88-9413-8c01dddd07d4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:46.109135 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5d9c5827-1e3c-4d88-9413-8c01dddd07d4 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.342018 Jul 26 19:56:46.111568 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1518/3054] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:45 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:46.192781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:46.194032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:46.205826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:46.206475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:46.207787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:46.208495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:46.247539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1785ba00-1c76-4bdc-90d2-a2ecf118291e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:46.248350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1785ba00-1c76-4bdc-90d2-a2ecf118291e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:46.259222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1785ba00-1c76-4bdc-90d2-a2ecf118291e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:46.259667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:46.263556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1785ba00-1c76-4bdc-90d2-a2ecf118291e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:46.265532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1785ba00-1c76-4bdc-90d2-a2ecf118291e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:46.268040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1785ba00-1c76-4bdc-90d2-a2ecf118291e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:46.366648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:46.383425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:46.385011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:46.394696 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dcf69a9e-b194-4469-ac73-2a78d106eaa1 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.209379 Jul 26 19:56:46.395641 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1537/3055] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:46 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:56:46.470760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1785ba00-1c76-4bdc-90d2-a2ecf118291e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:46.496902 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1785ba00-1c76-4bdc-90d2-a2ecf118291e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.253600 Jul 26 19:56:46.500380 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1519/3056] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:46 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:46.725618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54b6c0c3-09fe-4858-baa9-44049555fc0a tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:46.726353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-54b6c0c3-09fe-4858-baa9-44049555fc0a tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:46.733404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54b6c0c3-09fe-4858-baa9-44049555fc0a tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:46.734161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54b6c0c3-09fe-4858-baa9-44049555fc0a tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:46.736124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54b6c0c3-09fe-4858-baa9-44049555fc0a tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:46.736124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54b6c0c3-09fe-4858-baa9-44049555fc0a tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:46.759925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:47.013061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-54b6c0c3-09fe-4858-baa9-44049555fc0a tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:47.031690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-54b6c0c3-09fe-4858-baa9-44049555fc0a tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.312294 Jul 26 19:56:47.040639 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1538/3057] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:46 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:47.134333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-47ebb626-2fe3-4a74-ab93-af5c435ce6c8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:47.135719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-47ebb626-2fe3-4a74-ab93-af5c435ce6c8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:47.148282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47ebb626-2fe3-4a74-ab93-af5c435ce6c8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:47.149230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47ebb626-2fe3-4a74-ab93-af5c435ce6c8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:47.150351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47ebb626-2fe3-4a74-ab93-af5c435ce6c8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:47.151008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47ebb626-2fe3-4a74-ab93-af5c435ce6c8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:47.424735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:47.425359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:47.434712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:47.435563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:47.436628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:47.437313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:47.467869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:47.503670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-47ebb626-2fe3-4a74-ab93-af5c435ce6c8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:47.518554 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-47ebb626-2fe3-4a74-ab93-af5c435ce6c8 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.390509 Jul 26 19:56:47.520040 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1520/3058] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:47 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:47.537005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ddff6ac3-a3a7-4a27-8b09-55a8db011ead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:47.538097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ddff6ac3-a3a7-4a27-8b09-55a8db011ead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:47.540116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:47.548123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddff6ac3-a3a7-4a27-8b09-55a8db011ead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:47.548875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddff6ac3-a3a7-4a27-8b09-55a8db011ead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:47.551559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddff6ac3-a3a7-4a27-8b09-55a8db011ead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:47.552236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:47.552539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddff6ac3-a3a7-4a27-8b09-55a8db011ead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:47.553748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:47.566891 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f052c4d-4bd9-4722-a9c3-0abbb5c21af9 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.146561 Jul 26 19:56:47.573043 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1539/3059] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:47 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:56:48.059623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db552ecc-2bd8-4c8a-92f4-e3c4634a5dbb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:48.060919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-db552ecc-2bd8-4c8a-92f4-e3c4634a5dbb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:48.069361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db552ecc-2bd8-4c8a-92f4-e3c4634a5dbb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:48.070006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db552ecc-2bd8-4c8a-92f4-e3c4634a5dbb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:48.071265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db552ecc-2bd8-4c8a-92f4-e3c4634a5dbb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:48.072114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db552ecc-2bd8-4c8a-92f4-e3c4634a5dbb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:48.294913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ddff6ac3-a3a7-4a27-8b09-55a8db011ead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:48.305180 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ddff6ac3-a3a7-4a27-8b09-55a8db011ead tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1543 microversion: 2.1 time: 0.783301 Jul 26 19:56:48.319499 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1521/3060] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:47 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1543 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:48.358619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-db552ecc-2bd8-4c8a-92f4-e3c4634a5dbb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:48.370110 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db552ecc-2bd8-4c8a-92f4-e3c4634a5dbb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.319707 Jul 26 19:56:48.370693 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1540/3061] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:48 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:48.542213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bbd07b26-b499-4049-a50d-5f74fbd6f715 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:48.542833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bbd07b26-b499-4049-a50d-5f74fbd6f715 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:48.550660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbd07b26-b499-4049-a50d-5f74fbd6f715 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:48.551095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbd07b26-b499-4049-a50d-5f74fbd6f715 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:48.557752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbd07b26-b499-4049-a50d-5f74fbd6f715 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:48.564094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbd07b26-b499-4049-a50d-5f74fbd6f715 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:48.603955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:48.605755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:48.621457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:48.622451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:48.623585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:48.624334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:48.726778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:48.744787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:48.747412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:48.756116 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29cf712f-3a02-40e0-955f-bb0b900c09a6 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.161063 Jul 26 19:56:48.757866 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1541/3062] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:48 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:49.123872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bbd07b26-b499-4049-a50d-5f74fbd6f715 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:49.132621 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bbd07b26-b499-4049-a50d-5f74fbd6f715 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1522 microversion: 2.1 time: 0.594841 Jul 26 19:56:49.133205 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1522/3063] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:48 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:49.328004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38438e7c-cf1e-45fb-99b1-cb8e0f75edd9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:49.329077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38438e7c-cf1e-45fb-99b1-cb8e0f75edd9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:49.338857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38438e7c-cf1e-45fb-99b1-cb8e0f75edd9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:49.339526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38438e7c-cf1e-45fb-99b1-cb8e0f75edd9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:49.340620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38438e7c-cf1e-45fb-99b1-cb8e0f75edd9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:49.341289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38438e7c-cf1e-45fb-99b1-cb8e0f75edd9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:49.392576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f761766a-1b5d-4894-9244-6b803caab10e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:49.393863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f761766a-1b5d-4894-9244-6b803caab10e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:49.410363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f761766a-1b5d-4894-9244-6b803caab10e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:49.411173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f761766a-1b5d-4894-9244-6b803caab10e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:49.412391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f761766a-1b5d-4894-9244-6b803caab10e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:49.413243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f761766a-1b5d-4894-9244-6b803caab10e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:49.650737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38438e7c-cf1e-45fb-99b1-cb8e0f75edd9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:49.662482 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38438e7c-cf1e-45fb-99b1-cb8e0f75edd9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1542 microversion: 2.1 time: 0.339050 Jul 26 19:56:49.662898 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1542/3064] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:49 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1542 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:49.671900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:49.671900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:49.677816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:49.678978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:49.680020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:49.680643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.075827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:50.089125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:50.091182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:50.093406 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38478501-4cdb-4819-8903-10a55d25cab5 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2954 microversion: 2.42 time: 0.428426 Jul 26 19:56:50.095043 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1543/3065] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:49 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2954 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:50.101834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f761766a-1b5d-4894-9244-6b803caab10e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:50.118143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:50.118541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f761766a-1b5d-4894-9244-6b803caab10e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.727645 Jul 26 19:56:50.131660 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1523/3066] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:49 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:50.132026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:50.132159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-aabda8a0-e233-4b8d-84a6-b91c04102636 req-0fef735b-7a18-44ad-aa07-f6a915c4f004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a15e74a-9354-4cf2-908d-2c9191b2ef96", "name": "network-vif-deleted", "tag": "c56a0e33-dd68-4bcf-b1d1-6aa56969b87d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:50.136510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.136987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.137798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.138243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.168556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aabda8a0-e233-4b8d-84a6-b91c04102636 req-0fef735b-7a18-44ad-aa07-f6a915c4f004 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.168791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aabda8a0-e233-4b8d-84a6-b91c04102636 req-0fef735b-7a18-44ad-aa07-f6a915c4f004 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.192655 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aabda8a0-e233-4b8d-84a6-b91c04102636 req-0fef735b-7a18-44ad-aa07-f6a915c4f004 service nova] Creating event network-vif-deleted:c56a0e33-dd68-4bcf-b1d1-6aa56969b87d for instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 on n-h1-708768-8 Jul 26 19:56:50.213196 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-aabda8a0-e233-4b8d-84a6-b91c04102636 req-0fef735b-7a18-44ad-aa07-f6a915c4f004 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089552 Jul 26 19:56:50.215744 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1524/3067] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:50.228329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08581c2b-9a69-470f-bdd7-6659938d1b0e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:50.229732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08581c2b-9a69-470f-bdd7-6659938d1b0e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:50.240400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08581c2b-9a69-470f-bdd7-6659938d1b0e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.241060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08581c2b-9a69-470f-bdd7-6659938d1b0e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.242411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08581c2b-9a69-470f-bdd7-6659938d1b0e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.243031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08581c2b-9a69-470f-bdd7-6659938d1b0e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.285135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:50.303169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:50.305540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:50.321575 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c1df8d3-29d7-4dbc-a5d7-1c3f3cd88ae4 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.224789 Jul 26 19:56:50.322399 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1544/3068] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:50 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:50.328862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:50.329681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:50.336879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.337552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.339080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.339771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.391830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.392438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.393350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lazy-loading 'fault' on Instance uuid 4a15e74a-9354-4cf2-908d-2c9191b2ef96 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:56:50.521083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e321f4321e4ef38621b3d4cddb490b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab624e048d647aeaed6b3d871e4adac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:50.533367 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad86fd66-b13b-406e-9d17-6727279c48a3 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 200 len: 1312 microversion: 2.1 time: 0.209646 Jul 26 19:56:50.534989 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1545/3069] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:50 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:50.555953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-682b7b2c-7140-4007-aa1d-a5c9f65fc522 req-92aa4a03-a4d4-41e3-8eff-333284a01944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653ce92f-4a72-47da-a702-73aa770b76bc", "name": "network-vif-plugged", "status": "completed", "tag": "d724e79a-8161-4d71-a463-ac224e25a24a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:50.577098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-682b7b2c-7140-4007-aa1d-a5c9f65fc522 req-92aa4a03-a4d4-41e3-8eff-333284a01944 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.578009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-682b7b2c-7140-4007-aa1d-a5c9f65fc522 req-92aa4a03-a4d4-41e3-8eff-333284a01944 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.609667 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-682b7b2c-7140-4007-aa1d-a5c9f65fc522 req-92aa4a03-a4d4-41e3-8eff-333284a01944 service nova] Creating event network-vif-plugged:d724e79a-8161-4d71-a463-ac224e25a24a for instance 653ce92f-4a72-47da-a702-73aa770b76bc on n-h2-708768-8 Jul 26 19:56:50.623059 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-682b7b2c-7140-4007-aa1d-a5c9f65fc522 req-92aa4a03-a4d4-41e3-8eff-333284a01944 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086106 Jul 26 19:56:50.625139 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1546/3070] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:50.689900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6fc7640-a697-4960-9640-81b1e4c55ec8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:50.690808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b6fc7640-a697-4960-9640-81b1e4c55ec8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:50.702032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6fc7640-a697-4960-9640-81b1e4c55ec8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.704273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6fc7640-a697-4960-9640-81b1e4c55ec8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.707521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6fc7640-a697-4960-9640-81b1e4c55ec8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:50.708264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6fc7640-a697-4960-9640-81b1e4c55ec8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:50.713524 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08581c2b-9a69-470f-bdd7-6659938d1b0e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.494619 Jul 26 19:56:50.714132 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1525/3071] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Jul 26 19:56:50 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647/os-interface => generated 1831 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:51.027062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b6fc7640-a697-4960-9640-81b1e4c55ec8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:51.037673 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b6fc7640-a697-4960-9640-81b1e4c55ec8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1542 microversion: 2.1 time: 0.352750 Jul 26 19:56:51.052539 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1547/3072] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:50 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1542 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:51.144742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-959d9728-8b29-44a4-ab26-381766de9827 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:51.147532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-959d9728-8b29-44a4-ab26-381766de9827 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:51.158724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-959d9728-8b29-44a4-ab26-381766de9827 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:51.159717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-959d9728-8b29-44a4-ab26-381766de9827 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:51.160676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-959d9728-8b29-44a4-ab26-381766de9827 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:51.163647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-959d9728-8b29-44a4-ab26-381766de9827 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:51.350667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:51.358251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:51.369021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:51.370159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:51.371434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:51.372013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:51.496900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:51.511711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:51.515934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:51.531885 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bad7c6ee-9aab-40a8-bcfb-3cca802839d0 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.185198 Jul 26 19:56:51.534576 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1548/3073] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:51 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:51.558624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:51.559247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] [instance: 4a15e74a-9354-4cf2-908d-2c9191b2ef96] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:51.565832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:51.566291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:51.567158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:51.577337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:51.602314 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] HTTP exception thrown: Instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 could not be found. Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Request method failure captured: Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 HTTP/1.1 Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EXLxScLabAf9ys77i4WMLZ7m18K9IGYn9lxVv41B4pMYU2gzLrL8LAKp0ilQiOUXyGsudcXIS6NW_7kEXCKL59wAC8SaSrLAijTFag5su1hVq1mQWjj7MmzhD_37LIJpMe35BrusjI1123d1UIUY6nW6UW25khZDS3err8EUbu5wjE Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ab624e048d647aeaed6b3d871e4adac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ab624e048d647aeaed6b3d871e4adac"}]}] Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 8ab624e048d647aeaed6b3d871e4adac Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315331904 Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 72e321f4321e4ef38621b3d4cddb490b Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315331904-project Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 could not be found. Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '4a15e74a-9354-4cf2-908d-2c9191b2ef96'} Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 could not be found. Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 could not be found. Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:51.604440 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:56:51.610249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:51.610249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:56:51.610249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:56:51.610249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:56:51.610249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:56:51.610249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:56:51.610249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 could not be found. Jul 26 19:56:51.610249 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:56:51.611737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] Returning 404 to user: Instance 4a15e74a-9354-4cf2-908d-2c9191b2ef96 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:56:51.613316 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-99513a07-0cfe-4f6a-a581-57079513ce37 tempest-ServerRescueNegativeTestJSON-1315331904 tempest-ServerRescueNegativeTestJSON-1315331904-project] 10.222.0.58 "GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96" status: 404 len: 111 microversion: 2.1 time: 0.058412 Jul 26 19:56:51.616666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-959d9728-8b29-44a4-ab26-381766de9827 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:51.617797 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1549/3074] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:51 2022] GET /compute/v2.1/servers/4a15e74a-9354-4cf2-908d-2c9191b2ef96 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:56:51.634003 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-959d9728-8b29-44a4-ab26-381766de9827 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1294 microversion: 2.1 time: 0.493372 Jul 26 19:56:51.637965 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1526/3075] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:51 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1294 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:52.067942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a73ce7a-517a-44b2-8b7a-24b31368d706 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:52.068556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8a73ce7a-517a-44b2-8b7a-24b31368d706 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:52.080790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a73ce7a-517a-44b2-8b7a-24b31368d706 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.081252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a73ce7a-517a-44b2-8b7a-24b31368d706 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:52.082053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a73ce7a-517a-44b2-8b7a-24b31368d706 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.082496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a73ce7a-517a-44b2-8b7a-24b31368d706 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:52.254761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c19ed16c-ea1f-444e-830d-9b9d24da6910 req-c6c9728a-8deb-4bee-99ea-b5daba0e03fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "name": "network-vif-unplugged", "status": "completed", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}, {"name": "network-changed", "server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:52.276883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c19ed16c-ea1f-444e-830d-9b9d24da6910 req-c6c9728a-8deb-4bee-99ea-b5daba0e03fb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.281024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c19ed16c-ea1f-444e-830d-9b9d24da6910 req-c6c9728a-8deb-4bee-99ea-b5daba0e03fb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:52.316260 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c19ed16c-ea1f-444e-830d-9b9d24da6910 req-c6c9728a-8deb-4bee-99ea-b5daba0e03fb service nova] Creating event network-vif-unplugged:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h2-708768-8 Jul 26 19:56:52.316935 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c19ed16c-ea1f-444e-830d-9b9d24da6910 req-c6c9728a-8deb-4bee-99ea-b5daba0e03fb service nova] Creating event network-changed:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h2-708768-8 Jul 26 19:56:52.324171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-c19ed16c-ea1f-444e-830d-9b9d24da6910 req-c6c9728a-8deb-4bee-99ea-b5daba0e03fb service nova] Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:56:52.338791 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c19ed16c-ea1f-444e-830d-9b9d24da6910 req-c6c9728a-8deb-4bee-99ea-b5daba0e03fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.089128 Jul 26 19:56:52.340143 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1527/3076] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:52.391139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55502456-4d68-4c8e-9370-805b56ffc2a2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:52.392492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55502456-4d68-4c8e-9370-805b56ffc2a2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:52.412620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55502456-4d68-4c8e-9370-805b56ffc2a2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.415641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55502456-4d68-4c8e-9370-805b56ffc2a2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:52.418757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55502456-4d68-4c8e-9370-805b56ffc2a2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.421088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55502456-4d68-4c8e-9370-805b56ffc2a2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:52.487074 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55502456-4d68-4c8e-9370-805b56ffc2a2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/ips" status: 200 len: 148 microversion: 2.1 time: 0.102187 Jul 26 19:56:52.489049 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1528/3077] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 19:56:52 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/ips => generated 148 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:56:52.515553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a73ce7a-517a-44b2-8b7a-24b31368d706 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:52.523741 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a73ce7a-517a-44b2-8b7a-24b31368d706 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1542 microversion: 2.1 time: 0.459615 Jul 26 19:56:52.524333 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1550/3078] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:52 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1542 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:52.561959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:52.562689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:52.588458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.592388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:52.593273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.593730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:52.662431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-93efc0c5-12a4-4a60-ae46-7c9c4fbccc30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:52.663183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-93efc0c5-12a4-4a60-ae46-7c9c4fbccc30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:52.680553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93efc0c5-12a4-4a60-ae46-7c9c4fbccc30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.681202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93efc0c5-12a4-4a60-ae46-7c9c4fbccc30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:52.683294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93efc0c5-12a4-4a60-ae46-7c9c4fbccc30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:52.683798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93efc0c5-12a4-4a60-ae46-7c9c4fbccc30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:53.138403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:53.152972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:53.158437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:53.171401 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e6d811c-3687-4dc1-985e-eaf2419afca3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.614897 Jul 26 19:56:53.185888 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1529/3079] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:52 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:53.377785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-93efc0c5-12a4-4a60-ae46-7c9c4fbccc30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:53.388968 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-93efc0c5-12a4-4a60-ae46-7c9c4fbccc30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1486 microversion: 2.1 time: 0.731797 Jul 26 19:56:53.393194 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1551/3080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:52 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1486 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:53.418705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12353207-d117-4730-b5a5-bf91f47e16b7 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:53.419736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-12353207-d117-4730-b5a5-bf91f47e16b7 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:53.451188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12353207-d117-4730-b5a5-bf91f47e16b7 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:53.451796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12353207-d117-4730-b5a5-bf91f47e16b7 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:53.452737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12353207-d117-4730-b5a5-bf91f47e16b7 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:53.453187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12353207-d117-4730-b5a5-bf91f47e16b7 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:53.551135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2055a5c1-5d0d-4a56-bce5-48c74d2269dd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:53.551795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2055a5c1-5d0d-4a56-bce5-48c74d2269dd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:53.558183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2055a5c1-5d0d-4a56-bce5-48c74d2269dd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:53.558646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2055a5c1-5d0d-4a56-bce5-48c74d2269dd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:53.559435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2055a5c1-5d0d-4a56-bce5-48c74d2269dd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:53.559912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2055a5c1-5d0d-4a56-bce5-48c74d2269dd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:54.453161 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-12353207-d117-4730-b5a5-bf91f47e16b7 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.041145 Jul 26 19:56:54.460589 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1530/3081] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:56:53 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc/os-interface => generated 285 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:54.465264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:54.465943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:54.476567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:54.480219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:54.483529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:54.485325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:54.542211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2055a5c1-5d0d-4a56-bce5-48c74d2269dd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:54.555768 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2055a5c1-5d0d-4a56-bce5-48c74d2269dd tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1542 microversion: 2.1 time: 1.008312 Jul 26 19:56:54.556375 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1552/3082] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:53 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1542 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:56:54.865814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:54.910283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:54.916939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:54.929917 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-79025a35-b804-417d-8ebb-5a7d3cca63b7 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.474395 Jul 26 19:56:54.930885 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1531/3083] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:54 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:55.364753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39ce9e4f-d834-421d-9c84-62acc680579a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656562b0-62d7-4bc2-b7bc-12751dcaa46f"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:56:55.368410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39ce9e4f-d834-421d-9c84-62acc680579a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:55.400485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39ce9e4f-d834-421d-9c84-62acc680579a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:55.401279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39ce9e4f-d834-421d-9c84-62acc680579a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:55.403172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39ce9e4f-d834-421d-9c84-62acc680579a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:55.404161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39ce9e4f-d834-421d-9c84-62acc680579a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:55.578775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-450a5081-6aca-4f97-8fb9-bade0bc06dbe tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:55.579389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-450a5081-6aca-4f97-8fb9-bade0bc06dbe tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:55.591713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-450a5081-6aca-4f97-8fb9-bade0bc06dbe tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:55.593643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-450a5081-6aca-4f97-8fb9-bade0bc06dbe tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:55.595594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-450a5081-6aca-4f97-8fb9-bade0bc06dbe tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:55.596254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-450a5081-6aca-4f97-8fb9-bade0bc06dbe tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:56.050710 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39ce9e4f-d834-421d-9c84-62acc680579a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690137 Jul 26 19:56:56.056834 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1553/3084] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 19:56:55 2022] POST /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:56:56.093041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:56.100291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:56.136947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:56.138063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:56.141672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:56.147237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:56.613429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-450a5081-6aca-4f97-8fb9-bade0bc06dbe tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:56.622617 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-450a5081-6aca-4f97-8fb9-bade0bc06dbe tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1542 microversion: 2.1 time: 1.048207 Jul 26 19:56:56.625840 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1532/3085] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:55 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1542 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:56.682322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:56.691122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:56.704356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:56.732004 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-32c56aa1-1f5b-436d-a10e-4c64b60bff91 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.671480 Jul 26 19:56:56.735152 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1554/3086] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:56 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:57.645937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-99679c9e-4928-471e-be13-1d85b302b1aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:57.646552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-99679c9e-4928-471e-be13-1d85b302b1aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:57.660201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99679c9e-4928-471e-be13-1d85b302b1aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:57.660657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99679c9e-4928-471e-be13-1d85b302b1aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:57.661432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99679c9e-4928-471e-be13-1d85b302b1aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:57.664975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99679c9e-4928-471e-be13-1d85b302b1aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:57.760739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:57.761555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:57.781286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:57.782187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:57.783195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:57.783866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:57.832133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:56:57.957255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:57.968747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:57.975398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:57.988415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5f7a50c-2d1e-4dc3-bf66-001ed41004d3 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.231933 Jul 26 19:56:57.991150 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1555/3087] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:57 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:56:58.417332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-99679c9e-4928-471e-be13-1d85b302b1aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:58.429125 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-99679c9e-4928-471e-be13-1d85b302b1aa tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1474 microversion: 2.1 time: 0.786840 Jul 26 19:56:58.429954 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1533/3088] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:57 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1474 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:56:59.017319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:59.019412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:59.045114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:59.045927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:59.048911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:59.050306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:59.442039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:59.455912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:59.456304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-611b1043-637c-4e70-abf6-35287971dd6b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:59.457236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-611b1043-637c-4e70-abf6-35287971dd6b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:59.458931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:56:59.471170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-611b1043-637c-4e70-abf6-35287971dd6b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:59.471642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-611b1043-637c-4e70-abf6-35287971dd6b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:59.472462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-611b1043-637c-4e70-abf6-35287971dd6b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:59.472937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-611b1043-637c-4e70-abf6-35287971dd6b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:59.478107 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1ec92a34-413f-4d71-a5f2-85fa38dc3c0a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.466196 Jul 26 19:56:59.479317 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1556/3089] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:56:59 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:56:59.864506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7a851fa3-dadc-4409-9f8b-b4f6951dce9e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:56:59.865145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7a851fa3-dadc-4409-9f8b-b4f6951dce9e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:56:59.875496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a851fa3-dadc-4409-9f8b-b4f6951dce9e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:59.879012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a851fa3-dadc-4409-9f8b-b4f6951dce9e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:56:59.885042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a851fa3-dadc-4409-9f8b-b4f6951dce9e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:56:59.885477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a851fa3-dadc-4409-9f8b-b4f6951dce9e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:00.334603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a851fa3-dadc-4409-9f8b-b4f6951dce9e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:00.348846 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7a851fa3-dadc-4409-9f8b-b4f6951dce9e tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1486 microversion: 2.1 time: 0.493734 Jul 26 19:57:00.355944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1557/3090] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:59 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1486 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:00.364698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ded71c70-bb51-4d25-8361-33be792416f9 req-553a0e0e-8642-4d31-a1b7-fca836973d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653ce92f-4a72-47da-a702-73aa770b76bc", "tag": "d724e79a-8161-4d71-a463-ac224e25a24a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:00.398469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ded71c70-bb51-4d25-8361-33be792416f9 req-553a0e0e-8642-4d31-a1b7-fca836973d56 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:00.398911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ded71c70-bb51-4d25-8361-33be792416f9 req-553a0e0e-8642-4d31-a1b7-fca836973d56 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:00.428844 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ded71c70-bb51-4d25-8361-33be792416f9 req-553a0e0e-8642-4d31-a1b7-fca836973d56 service nova] Creating event network-changed:d724e79a-8161-4d71-a463-ac224e25a24a for instance 653ce92f-4a72-47da-a702-73aa770b76bc on n-h2-708768-8 Jul 26 19:57:00.442512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ded71c70-bb51-4d25-8361-33be792416f9 req-553a0e0e-8642-4d31-a1b7-fca836973d56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084740 Jul 26 19:57:00.443378 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1558/3091] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:00.510267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:00.511174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:00.524756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:00.525489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:00.526519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:00.527175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:00.720150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-611b1043-637c-4e70-abf6-35287971dd6b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:00.744975 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-611b1043-637c-4e70-abf6-35287971dd6b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1471 microversion: 2.1 time: 1.294433 Jul 26 19:57:00.759638 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1534/3092] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:56:59 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1471 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:00.771361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:00.771984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:00.782748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:00.785913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:00.789609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:00.790082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:00.886577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:00.910780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:00.911500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:00.912681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:00.913358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:00.946215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:00.948627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:57:00.955588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for user 146ecbca3664463ead84028d4add8b50 and project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:57:00.955910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:00.962059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:00.973898 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e9aabe85-abbe-41b2-b228-08fa3b19c50c tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.468307 Jul 26 19:57:00.976237 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1559/3093] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:00 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:01.172193 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1422bb3f-5f8c-4329-8253-6396e188475b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad/action" status: 202 len: 0 microversion: 2.1 time: 0.405734 Jul 26 19:57:01.192129 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1535/3094] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:57:00 2022] POST /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:57:01.199119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82bd1376-3352-48ee-b6e4-eba6b4c63012 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:01.200054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82bd1376-3352-48ee-b6e4-eba6b4c63012 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:01.239468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82bd1376-3352-48ee-b6e4-eba6b4c63012 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:01.239984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82bd1376-3352-48ee-b6e4-eba6b4c63012 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:01.240800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82bd1376-3352-48ee-b6e4-eba6b4c63012 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:01.241247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82bd1376-3352-48ee-b6e4-eba6b4c63012 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:01.931896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82bd1376-3352-48ee-b6e4-eba6b4c63012 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:01.945648 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82bd1376-3352-48ee-b6e4-eba6b4c63012 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1470 microversion: 2.1 time: 0.751220 Jul 26 19:57:01.960632 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1560/3095] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:01 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1470 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:02.007693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:02.008787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:02.047785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:02.056278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:02.059262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:02.065735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:02.782942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:02.798529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:02.799711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:02.818063 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-558a0e89-f664-4e5e-ac40-13cbb838b622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.814763 Jul 26 19:57:02.833291 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1536/3096] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:02 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:02.966997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bfcaebc4-ae90-4f28-9937-b96510a7ba35 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:02.967809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bfcaebc4-ae90-4f28-9937-b96510a7ba35 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:02.975920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfcaebc4-ae90-4f28-9937-b96510a7ba35 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:02.976676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfcaebc4-ae90-4f28-9937-b96510a7ba35 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:02.977865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfcaebc4-ae90-4f28-9937-b96510a7ba35 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:02.978930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfcaebc4-ae90-4f28-9937-b96510a7ba35 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:03.848676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:03.849372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:03.881253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:03.884879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:03.887065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:03.890329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:03.979456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bfcaebc4-ae90-4f28-9937-b96510a7ba35 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:03.988854 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bfcaebc4-ae90-4f28-9937-b96510a7ba35 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1470 microversion: 2.1 time: 1.026290 Jul 26 19:57:03.993066 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1561/3097] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:02 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1470 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:04.391339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:04.400574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:04.403242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:04.409764 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-74c091e0-a4bf-4d2c-b60c-7fe513e6ac3f tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.568055 Jul 26 19:57:04.424607 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1537/3098] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:03 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:04.551640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a0849518-4ad1-4a2f-805d-fdb24fbd0d52 req-d9542b49-d42b-403b-9a82-a9f1c09d77f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "name": "network-vif-plugged", "status": "completed", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:04.565727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a0849518-4ad1-4a2f-805d-fdb24fbd0d52 req-d9542b49-d42b-403b-9a82-a9f1c09d77f2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:04.566180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a0849518-4ad1-4a2f-805d-fdb24fbd0d52 req-d9542b49-d42b-403b-9a82-a9f1c09d77f2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:04.592001 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a0849518-4ad1-4a2f-805d-fdb24fbd0d52 req-d9542b49-d42b-403b-9a82-a9f1c09d77f2 service nova] Creating event network-vif-plugged:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h2-708768-8 Jul 26 19:57:04.610754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-a0849518-4ad1-4a2f-805d-fdb24fbd0d52 req-d9542b49-d42b-403b-9a82-a9f1c09d77f2 service nova] Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:57:04.635725 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a0849518-4ad1-4a2f-805d-fdb24fbd0d52 req-d9542b49-d42b-403b-9a82-a9f1c09d77f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087867 Jul 26 19:57:04.640175 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1562/3099] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:05.010729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fdb28baa-4ff6-4053-b242-37c23befa853 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:05.012358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fdb28baa-4ff6-4053-b242-37c23befa853 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:05.024807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdb28baa-4ff6-4053-b242-37c23befa853 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:05.025672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdb28baa-4ff6-4053-b242-37c23befa853 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:05.035567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdb28baa-4ff6-4053-b242-37c23befa853 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:05.038108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdb28baa-4ff6-4053-b242-37c23befa853 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:05.356572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fdb28baa-4ff6-4053-b242-37c23befa853 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:05.367315 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fdb28baa-4ff6-4053-b242-37c23befa853 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1470 microversion: 2.1 time: 0.361321 Jul 26 19:57:05.368240 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1538/3100] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:05 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:05.437832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:05.439327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:05.457801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:05.458926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:05.461483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:05.462108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:05.699204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:05.718483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:05.724170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:05.745173 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b40d7f71-24a6-4444-82da-3497ebf0c271 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.312453 Jul 26 19:57:05.745793 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1563/3101] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:05 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:06.391863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a547375f-f8e6-4793-ad0d-04a48b52de1d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:06.392473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a547375f-f8e6-4793-ad0d-04a48b52de1d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:06.403916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a547375f-f8e6-4793-ad0d-04a48b52de1d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:06.410684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a547375f-f8e6-4793-ad0d-04a48b52de1d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:06.411846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a547375f-f8e6-4793-ad0d-04a48b52de1d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:06.412290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a547375f-f8e6-4793-ad0d-04a48b52de1d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:06.774508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:06.775728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:06.787818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:06.796632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:06.797324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:06.798472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:06.799075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:06.879883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a547375f-f8e6-4793-ad0d-04a48b52de1d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:06.888759 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a547375f-f8e6-4793-ad0d-04a48b52de1d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1536 microversion: 2.1 time: 0.502252 Jul 26 19:57:06.903321 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1539/3102] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:06 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1536 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:06.983141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:07.015451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:07.019138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:07.036527 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-945e78e8-bf5e-47f9-9bb8-922b024d64ae tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.267742 Jul 26 19:57:07.040773 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1564/3103] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:06 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:07.415021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4a293ba6-813a-4c1f-926e-329a36837d78 req-e27d7315-8b58-40bc-a8ad-5e2810ae0406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "name": "network-vif-unplugged", "status": "completed", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:07.475092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4a293ba6-813a-4c1f-926e-329a36837d78 req-e27d7315-8b58-40bc-a8ad-5e2810ae0406 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:07.479951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4a293ba6-813a-4c1f-926e-329a36837d78 req-e27d7315-8b58-40bc-a8ad-5e2810ae0406 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:07.521714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-4a293ba6-813a-4c1f-926e-329a36837d78 req-e27d7315-8b58-40bc-a8ad-5e2810ae0406 service nova] Creating event network-vif-unplugged:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h1-708768-8 Jul 26 19:57:07.541001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-4a293ba6-813a-4c1f-926e-329a36837d78 req-e27d7315-8b58-40bc-a8ad-5e2810ae0406 service nova] Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:57:07.581913 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4a293ba6-813a-4c1f-926e-329a36837d78 req-e27d7315-8b58-40bc-a8ad-5e2810ae0406 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173105 Jul 26 19:57:07.582535 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1540/3104] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:07.912511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-097c5a42-e978-4d88-8f7e-6fd762b93461 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:07.916349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-097c5a42-e978-4d88-8f7e-6fd762b93461 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:07.937797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-097c5a42-e978-4d88-8f7e-6fd762b93461 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:07.938266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-097c5a42-e978-4d88-8f7e-6fd762b93461 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:07.939067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-097c5a42-e978-4d88-8f7e-6fd762b93461 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:07.939494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-097c5a42-e978-4d88-8f7e-6fd762b93461 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:07.989901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-299537192", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": "none"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:08.101040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:57:08.101470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:57:08.101953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:57:08.102364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:57:08.102770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:57:08.125828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:08.126228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:08.127069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:08.127515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:08.157880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Getting quotas for project f6532de3a377404baf62965d3c14e87f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:57:08.172238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Getting quotas for user 7c1347c8e0e4464ca3f8a6004857898a and project f6532de3a377404baf62965d3c14e87f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:57:08.176185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-097c5a42-e978-4d88-8f7e-6fd762b93461 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:08.185976 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-097c5a42-e978-4d88-8f7e-6fd762b93461 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1536 microversion: 2.1 time: 0.278590 Jul 26 19:57:08.191980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:57:08.192769 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1541/3105] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:07 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1536 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:08.195152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:57:08.204755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:08.205380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:08.222085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:08.223727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:08.224531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:08.226113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:08.227125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:08.274447 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-54ce6450-ad0f-476b-ab47-485328fa0750 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.496101 Jul 26 19:57:08.276219 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1565/3106] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 19:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 19:57:08.290681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e93b14cd-1ad1-4810-ad43-46944469761a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:08.291302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e93b14cd-1ad1-4810-ad43-46944469761a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:08.344279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:08.353686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:08.356079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:08.369911 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97093b2b-f2e2-4655-9ee7-cdfe77435622 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1447 microversion: 2.75 time: 0.175555 Jul 26 19:57:08.370766 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1542/3107] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:08 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:08.386708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e93b14cd-1ad1-4810-ad43-46944469761a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:08.396950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e93b14cd-1ad1-4810-ad43-46944469761a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:08.398951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e93b14cd-1ad1-4810-ad43-46944469761a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:08.400174 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e93b14cd-1ad1-4810-ad43-46944469761a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1277 microversion: 2.54 time: 0.116804 Jul 26 19:57:08.405822 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1566/3108] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:08 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:09.212522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a9891fd-dc10-48af-b083-817b6ff59a85 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:09.213989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3a9891fd-dc10-48af-b083-817b6ff59a85 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:09.221735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a9891fd-dc10-48af-b083-817b6ff59a85 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:09.222343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a9891fd-dc10-48af-b083-817b6ff59a85 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:09.223406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a9891fd-dc10-48af-b083-817b6ff59a85 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:09.223942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a9891fd-dc10-48af-b083-817b6ff59a85 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:09.379828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3a9891fd-dc10-48af-b083-817b6ff59a85 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:09.388493 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a9891fd-dc10-48af-b083-817b6ff59a85 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1536 microversion: 2.1 time: 0.180263 Jul 26 19:57:09.396640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:09.397244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:09.402326 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1543/3109] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:09 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1536 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:09.405819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:09.407489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:09.409998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:09.411481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:09.428736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:09.429860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:09.442503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:09.442979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:09.448108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:09.448680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:09.564951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:09.582327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:09.584890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:09.586857 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-440c5f92-51e1-4751-94db-67ba21321978 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1329 microversion: 2.54 time: 0.165600 Jul 26 19:57:09.588388 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1544/3110] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:09 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1329 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:09.606725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-16f4699a-799f-4255-8825-8b973618b265 req-94a56d6b-62f6-4552-88cd-6aa9f07d47f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:09.637427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-16f4699a-799f-4255-8825-8b973618b265 req-94a56d6b-62f6-4552-88cd-6aa9f07d47f9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:09.641137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-16f4699a-799f-4255-8825-8b973618b265 req-94a56d6b-62f6-4552-88cd-6aa9f07d47f9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:09.679763 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-16f4699a-799f-4255-8825-8b973618b265 req-94a56d6b-62f6-4552-88cd-6aa9f07d47f9 service nova] Creating event network-changed:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h1-708768-8 Jul 26 19:57:09.687874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-16f4699a-799f-4255-8825-8b973618b265 req-94a56d6b-62f6-4552-88cd-6aa9f07d47f9 service nova] Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:57:09.711019 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-16f4699a-799f-4255-8825-8b973618b265 req-94a56d6b-62f6-4552-88cd-6aa9f07d47f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108356 Jul 26 19:57:09.714880 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1545/3111] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:10.072371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:10.082993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:10.084798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:10.090897 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11962758-069c-4109-99a4-fd75283b1f24 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1453 microversion: 2.75 time: 0.698170 Jul 26 19:57:10.091530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1567/3112] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:09 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1453 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:10.422367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-822f94e1-11a5-4696-98f9-abc5d23d85c4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:10.423787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-822f94e1-11a5-4696-98f9-abc5d23d85c4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:10.442226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-822f94e1-11a5-4696-98f9-abc5d23d85c4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:10.442937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-822f94e1-11a5-4696-98f9-abc5d23d85c4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:10.443924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-822f94e1-11a5-4696-98f9-abc5d23d85c4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:10.444650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-822f94e1-11a5-4696-98f9-abc5d23d85c4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:10.614895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-822f94e1-11a5-4696-98f9-abc5d23d85c4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:10.617969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:10.619522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:10.625365 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-822f94e1-11a5-4696-98f9-abc5d23d85c4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1536 microversion: 2.1 time: 0.207443 Jul 26 19:57:10.635838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:10.635838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:10.636388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:10.636940 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1546/3113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:10 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1536 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:10.640666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:10.734410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:10.742488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:10.744020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:10.745405 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a14f6aa7-eef1-463c-9ec9-69c83fba9399 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1335 microversion: 2.54 time: 0.136586 Jul 26 19:57:10.745967 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1568/3114] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:10 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1335 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:11.118141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:11.119202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:11.129475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:11.136911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:11.138079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:11.140047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:11.140585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:11.227550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:11.236948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:11.238796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:11.245367 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8bc27d9-42bb-4dd5-9c18-4aded7087621 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1453 microversion: 2.75 time: 0.131997 Jul 26 19:57:11.255667 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1547/3115] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:11 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:11.651270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0cee43d2-5c77-4bc3-9fd2-51851474c9d5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:11.652798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0cee43d2-5c77-4bc3-9fd2-51851474c9d5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:11.660800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cee43d2-5c77-4bc3-9fd2-51851474c9d5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:11.661569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cee43d2-5c77-4bc3-9fd2-51851474c9d5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:11.662548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cee43d2-5c77-4bc3-9fd2-51851474c9d5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:11.663189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cee43d2-5c77-4bc3-9fd2-51851474c9d5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:11.771034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:11.772405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:11.781120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:11.781923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:11.782965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:11.783801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:11.856593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:11.865734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:11.867528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:11.868705 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ddcd020-d5cf-4b09-9ba7-95deb55919a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1335 microversion: 2.54 time: 0.102508 Jul 26 19:57:11.884838 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1548/3116] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:11 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:11.996449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0cee43d2-5c77-4bc3-9fd2-51851474c9d5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:12.007031 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0cee43d2-5c77-4bc3-9fd2-51851474c9d5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1536 microversion: 2.1 time: 0.360994 Jul 26 19:57:12.024136 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1569/3117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:11 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1536 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:12.273122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:12.273912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:12.285442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:12.288517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:12.293033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:12.293619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:12.426910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:12.435895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:12.446219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:12.453306 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9a911316-7f0b-4480-864b-9d921dbd9976 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1453 microversion: 2.75 time: 0.184805 Jul 26 19:57:12.468669 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1549/3118] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:12 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:12.733999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-725f7e58-9df5-4373-8c0c-3566bf15f773 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: .version_select at 0x7f8756ddcd30>, body: {"keypair": {"name": "tempest-keypair-408550919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBlTgwOFjAHnF+6kUARqFcO58Q5U32yExm+vEb8bZHjT1ngIMtGxRA2bhf7dp6YMP37zCQO5dl0Epz+N39s7ry4Fxj7pkigY/cZ8YuOnMxzkrMxNiFm/dK5SR3aXntLRg=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:12.755454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-725f7e58-9df5-4373-8c0c-3566bf15f773 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for project 2a16253a71a24312a17022e4f01ed652. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:57:12.764618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-725f7e58-9df5-4373-8c0c-3566bf15f773 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for user 889459c783694048b93438ce16b75d0f and project 2a16253a71a24312a17022e4f01ed652. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:57:12.796329 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-725f7e58-9df5-4373-8c0c-3566bf15f773 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070082 Jul 26 19:57:12.797932 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1570/3119] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:57:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:12.893569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:12.894275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:12.916145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:12.916985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:12.917778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:12.918269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:12.924315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:13.031600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2acec87c-6632-4e05-b732-1b8eea18f0d0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:13.032663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2acec87c-6632-4e05-b732-1b8eea18f0d0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:13.037152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:13.046562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2acec87c-6632-4e05-b732-1b8eea18f0d0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.047866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:13.048671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2acec87c-6632-4e05-b732-1b8eea18f0d0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.049455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:13.050504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2acec87c-6632-4e05-b732-1b8eea18f0d0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.050794 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6743c2e0-6fe0-4c44-8e03-a34afe4c70af tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1356 microversion: 2.54 time: 0.161146 Jul 26 19:57:13.051810 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1550/3120] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:12 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:13.052588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2acec87c-6632-4e05-b732-1b8eea18f0d0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.081175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc4b73a8-5102-410e-b9f5-8bc2612e4799 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Action: 'create', calling method: .version_select at 0x7f875e3b1d30>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-571347653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDg5+k5RJVPiIHUnHWYYNqj/JkR9sxE0tNuv7hICpjG+dLhWNrrdBDj/dmHu99j92PqLutTfE3oR3DYKC+m4ZsvU2fNGxRuSRQ4xQGKrZGH1GpQmAatOaDoj+uh16+8+A=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:13.144966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fc4b73a8-5102-410e-b9f5-8bc2612e4799 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Getting quotas for project f6532de3a377404baf62965d3c14e87f. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:57:13.164422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fc4b73a8-5102-410e-b9f5-8bc2612e4799 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Getting quotas for user 7c1347c8e0e4464ca3f8a6004857898a and project f6532de3a377404baf62965d3c14e87f. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:57:13.215809 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc4b73a8-5102-410e-b9f5-8bc2612e4799 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.141408 Jul 26 19:57:13.222483 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1551/3121] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 19:57:13 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 19:57:13.243928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-571347653", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:13.246913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:13.270908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.274224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.277810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.277985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.396103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2acec87c-6632-4e05-b732-1b8eea18f0d0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:13.422775 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2acec87c-6632-4e05-b732-1b8eea18f0d0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1529 microversion: 2.1 time: 0.394418 Jul 26 19:57:13.427035 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1571/3122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:13 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1529 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:13.451256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b74b4bf5-8604-4789-95e4-feb4877a1a2d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:13.452213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b74b4bf5-8604-4789-95e4-feb4877a1a2d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:13.460864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b74b4bf5-8604-4789-95e4-feb4877a1a2d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.461649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b74b4bf5-8604-4789-95e4-feb4877a1a2d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.462623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b74b4bf5-8604-4789-95e4-feb4877a1a2d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.463254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b74b4bf5-8604-4789-95e4-feb4877a1a2d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.492730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:57:13.493156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:57:13.493615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:57:13.494017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:57:13.494427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:57:13.603478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:13.619088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.619644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.620745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.621459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.660800 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18ef450c-c0f6-4d19-bc82-ac64d5ca3012 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "POST /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7/action" status: 202 len: 1138 microversion: 2.54 time: 0.431345 Jul 26 19:57:13.661802 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1552/3123] 10.222.0.58 () {62 vars in 1320 bytes} [Tue Jul 26 19:57:13 2022] POST /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7/action => generated 1138 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 19:57:13.668589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:13.688324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:13.701337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.701800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.703539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.704136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.836844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b74b4bf5-8604-4789-95e4-feb4877a1a2d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:13.851337 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b74b4bf5-8604-4789-95e4-feb4877a1a2d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1529 microversion: 2.1 time: 0.404438 Jul 26 19:57:13.864026 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1572/3124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:13 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1529 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:13.864449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:13.871834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:13.877433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:13.877606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:13.883263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:13.897285 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85b5d3ff-79b4-4f73-9226-37ed39b32a99 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1438 microversion: 2.75 time: 0.234179 Jul 26 19:57:13.910610 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1553/3125] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:13 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1438 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:13.910956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.910956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.911173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ab887c8-2222-4907-a12d-2e51605decc1 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:13.911173 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:57:13.911173 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 19:57:13.911404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:13.913869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:13.928673 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-3ab887c8-2222-4907-a12d-2e51605decc1 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] HTTP exception thrown: Flavor b546e8a6-73db-4197-9039-bca8d3f21ca2 could not be found. Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ab887c8-2222-4907-a12d-2e51605decc1 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Request method failure captured: Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/flavors/b546e8a6-73db-4197-9039-bca8d3f21ca2 HTTP/1.1 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EYv08HXpsEa0s3C5qUuoGwaqfzMVmJyz16pUPFPBFpxM3hWuC63Z7_yB12j9YaxCRd7pLBv4eqCUpNEMwn1L9Rdg7GJ08VQFzZ2KosiYerU4gORtl_qL6N0DxFHOh8QAGpz0FsA-SGcyvI88gaCDd7V0IuTG6vczjWtJkuU08vVhNk Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: c81cb7a0501b44a8b54b68bf244100e2 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-MigrationsAdminTest-587241728 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c81cb7a0501b44a8b54b68bf244100e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c81cb7a0501b44a8b54b68bf244100e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c81cb7a0501b44a8b54b68bf244100e2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c81cb7a0501b44a8b54b68bf244100e2"}]}] Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-MigrationsAdminTest-587241728 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: c81cb7a0501b44a8b54b68bf244100e2 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-MigrationsAdminTest-587241728 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-MigrationsAdminTest-587241728-project-admin Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a05edf4da4ef4019928b6e7ba4f4bc09 Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-MigrationsAdminTest-587241728-project-admin Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: exception: Flavor b546e8a6-73db-4197-9039-bca8d3f21ca2 could not be found. Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'b546e8a6-73db-4197-9039-bca8d3f21ca2'} Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b546e8a6-73db-4197-9039-bca8d3f21ca2 could not be found. Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor b546e8a6-73db-4197-9039-bca8d3f21ca2 could not be found. Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:13.934729 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b546e8a6-73db-4197-9039-bca8d3f21ca2 could not be found. Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ab887c8-2222-4907-a12d-2e51605decc1 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Returning 404 to user: Flavor b546e8a6-73db-4197-9039-bca8d3f21ca2 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ab887c8-2222-4907-a12d-2e51605decc1 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/b546e8a6-73db-4197-9039-bca8d3f21ca2" status: 404 len: 109 microversion: 2.1 time: 0.035407 Jul 26 19:57:13.939508 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1554/3126] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:57:13 2022] DELETE /compute/v2.1/flavors/b546e8a6-73db-4197-9039-bca8d3f21ca2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:57:14.189531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:14.210596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:14.217498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:14.219018 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cd25e28-3d3b-46f7-951a-9e11530299f5 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.363457 Jul 26 19:57:14.222954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1573/3127] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:13 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:14.249452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:14.253806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:14.267676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:14.268741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:14.269742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:14.270349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:14.273445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-365042483", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:14.397314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] validate_networks() for None {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:57:14.435374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:57:14.435736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:57:14.436321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:57:14.436735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:57:14.437146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:57:14.557411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:14.566881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:14.568015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:14.568809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:14.569309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:14.816663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:14.890709 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-db3a7426-af68-4145-8d67-362de2def573 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5/action" status: 202 len: 1942 microversion: 2.75 time: 0.951908 Jul 26 19:57:14.891681 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1555/3128] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 19:57:13 2022] POST /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5/action => generated 1942 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 19:57:14.926612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-997ce635-45d3-41a8-b622-d9b6541a8c89 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:14.927767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-997ce635-45d3-41a8-b622-d9b6541a8c89 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:14.941779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-997ce635-45d3-41a8-b622-d9b6541a8c89 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:14.943192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-997ce635-45d3-41a8-b622-d9b6541a8c89 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:14.944814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-997ce635-45d3-41a8-b622-d9b6541a8c89 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:14.946637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-997ce635-45d3-41a8-b622-d9b6541a8c89 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:15.182349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-997ce635-45d3-41a8-b622-d9b6541a8c89 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:15.231024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-997ce635-45d3-41a8-b622-d9b6541a8c89 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.309024 Jul 26 19:57:15.249833 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1556/3129] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:14 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:15.256013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:15.256633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:15.264199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:15.264663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:15.265472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:15.266729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:15.364667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:15.374756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:15.376577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:15.377954 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-13990353-7bc2-4844-976d-305ff62585b8 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.125992 Jul 26 19:57:15.394634 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1557/3130] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:15 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:15.423376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:57:15.423942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:57:15.424357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:57:15.425339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:57:15.425976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:57:15.437510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:15.438505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:15.439828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:15.440954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:15.469963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:57:15.476318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Getting quotas for user 146ecbca3664463ead84028d4add8b50 and project 5aa3fa3f76b04006a2cb1c22021083f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:57:15.523927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:57:15.526879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:57:15.612045 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cc7492a5-c0bd-402b-8e9d-96561f36067d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344274 Jul 26 19:57:15.613547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1574/3131] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:57:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:57:15.628197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a4544e1-a086-4319-98ae-795dd9848d54 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:15.629369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a4544e1-a086-4319-98ae-795dd9848d54 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:15.721360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1a4544e1-a086-4319-98ae-795dd9848d54 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:15.731012 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a4544e1-a086-4319-98ae-795dd9848d54 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1212 microversion: 2.1 time: 0.109809 Jul 26 19:57:15.731844 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1558/3132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:15 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1212 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:15.827503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-dd5a900e-8e48-482e-bf3c-011a934486ba req-e7dfb985-bbb0-4bde-8f88-80ff7dde0edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "name": "network-vif-plugged", "status": "completed", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:15.854569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-dd5a900e-8e48-482e-bf3c-011a934486ba req-e7dfb985-bbb0-4bde-8f88-80ff7dde0edc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:15.855126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-dd5a900e-8e48-482e-bf3c-011a934486ba req-e7dfb985-bbb0-4bde-8f88-80ff7dde0edc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:15.870945 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-dd5a900e-8e48-482e-bf3c-011a934486ba req-e7dfb985-bbb0-4bde-8f88-80ff7dde0edc service nova] Creating event network-vif-plugged:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h1-708768-8 Jul 26 19:57:15.877632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-dd5a900e-8e48-482e-bf3c-011a934486ba req-e7dfb985-bbb0-4bde-8f88-80ff7dde0edc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056983 Jul 26 19:57:15.881172 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1575/3133] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:57:16.257533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6d1835c9-ac1a-49ee-aefd-9f9f550756ce tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:16.258805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6d1835c9-ac1a-49ee-aefd-9f9f550756ce tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:16.276322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d1835c9-ac1a-49ee-aefd-9f9f550756ce tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:16.277366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d1835c9-ac1a-49ee-aefd-9f9f550756ce tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:16.281263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d1835c9-ac1a-49ee-aefd-9f9f550756ce tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:16.282088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d1835c9-ac1a-49ee-aefd-9f9f550756ce tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:16.421554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:16.422465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:16.439936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:16.441583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:16.443362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:16.445904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:16.481699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-6d1835c9-ac1a-49ee-aefd-9f9f550756ce tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:16.546998 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6d1835c9-ac1a-49ee-aefd-9f9f550756ce tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.293714 Jul 26 19:57:16.550339 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1559/3134] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:16 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:16.563167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:16.582105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:16.585006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:16.587221 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-33b3180e-fe21-45bd-bc22-3cc6301c18c2 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.181327 Jul 26 19:57:16.588397 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1576/3135] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:16 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:16.604447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1324187113", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa81df3d-9f96-49e8-813d-dbedef5ea966"}], "security_groups": [{"name": "tempest-securitygroup--630619959"}], "key_name": "tempest-keypair-408550919", "user_data": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:16.756120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] validate_networks() for [('aa81df3d-9f96-49e8-813d-dbedef5ea966', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:57:16.757956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66688264-7671-4e58-9d80-e8c152444e63 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:16.759551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66688264-7671-4e58-9d80-e8c152444e63 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:16.769855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66688264-7671-4e58-9d80-e8c152444e63 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:16.770480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66688264-7671-4e58-9d80-e8c152444e63 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:16.771737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66688264-7671-4e58-9d80-e8c152444e63 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:16.772246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66688264-7671-4e58-9d80-e8c152444e63 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:16.777645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:16.936981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-66688264-7671-4e58-9d80-e8c152444e63 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:16.960850 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66688264-7671-4e58-9d80-e8c152444e63 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1264 microversion: 2.1 time: 0.208436 Jul 26 19:57:16.962105 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1577/3136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:16 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:17.576641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-78ff827c-00ac-4ba3-abd3-6df72418b961 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:17.578506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-78ff827c-00ac-4ba3-abd3-6df72418b961 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:17.611293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78ff827c-00ac-4ba3-abd3-6df72418b961 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:17.611908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78ff827c-00ac-4ba3-abd3-6df72418b961 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:17.617234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78ff827c-00ac-4ba3-abd3-6df72418b961 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:17.618398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:57:17.618880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78ff827c-00ac-4ba3-abd3-6df72418b961 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:17.618980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:57:17.619329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:57:17.620057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:57:17.620663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:57:17.635708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:17.636740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:17.638214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:17.638909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:17.674628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for project 2a16253a71a24312a17022e4f01ed652. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:57:17.682926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for user 889459c783694048b93438ce16b75d0f and project 2a16253a71a24312a17022e4f01ed652. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:57:17.709821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:57:17.713406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:57:17.825950 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c30898e5-27cc-4181-95e3-c34a84459f65 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.246298 Jul 26 19:57:17.827287 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1560/3137] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:57:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:57:17.835742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:17.836628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:17.859754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:17.860196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:17.862999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:17.864855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:17.867532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-78ff827c-00ac-4ba3-abd3-6df72418b961 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:17.942634 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-78ff827c-00ac-4ba3-abd3-6df72418b961 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.371363 Jul 26 19:57:17.949189 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1578/3138] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:17 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:17.954881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a21302e7-7703-4138-b3f9-47a2727c3ba7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:17.955505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a21302e7-7703-4138-b3f9-47a2727c3ba7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:18.075979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a21302e7-7703-4138-b3f9-47a2727c3ba7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:18.083212 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a21302e7-7703-4138-b3f9-47a2727c3ba7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1241 microversion: 2.1 time: 0.132593 Jul 26 19:57:18.089089 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1579/3139] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:17 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:18.096588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-da58e7c2-0b5a-4a3d-b960-9147209e0fe2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:18.098168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-da58e7c2-0b5a-4a3d-b960-9147209e0fe2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:18.115919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da58e7c2-0b5a-4a3d-b960-9147209e0fe2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:18.116449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da58e7c2-0b5a-4a3d-b960-9147209e0fe2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:18.117421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da58e7c2-0b5a-4a3d-b960-9147209e0fe2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:18.117925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da58e7c2-0b5a-4a3d-b960-9147209e0fe2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:18.124969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:18.144024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:18.147629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:18.151180 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-95529ac5-2f39-439f-acd1-5de26004ff0d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.320889 Jul 26 19:57:18.164240 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1561/3140] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:17 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:18.253314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-da58e7c2-0b5a-4a3d-b960-9147209e0fe2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:18.276656 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-da58e7c2-0b5a-4a3d-b960-9147209e0fe2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1270 microversion: 2.1 time: 0.184190 Jul 26 19:57:18.295722 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1580/3141] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:18 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:18.977549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc66fdfa-aaa3-4729-a84e-e05b4f414640 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:18.978390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc66fdfa-aaa3-4729-a84e-e05b4f414640 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:18.994440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc66fdfa-aaa3-4729-a84e-e05b4f414640 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:18.995047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc66fdfa-aaa3-4729-a84e-e05b4f414640 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:18.996290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc66fdfa-aaa3-4729-a84e-e05b4f414640 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:18.996893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc66fdfa-aaa3-4729-a84e-e05b4f414640 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:19.114787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16ea89e2-0639-4302-9804-f3e213834042 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:19.115425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-16ea89e2-0639-4302-9804-f3e213834042 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:19.132796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16ea89e2-0639-4302-9804-f3e213834042 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:19.133249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16ea89e2-0639-4302-9804-f3e213834042 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:19.134060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16ea89e2-0639-4302-9804-f3e213834042 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:19.134486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16ea89e2-0639-4302-9804-f3e213834042 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:19.137172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-fc66fdfa-aaa3-4729-a84e-e05b4f414640 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:19.181806 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc66fdfa-aaa3-4729-a84e-e05b4f414640 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.208319 Jul 26 19:57:19.195178 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1562/3142] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:18 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:19.202522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:19.206709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:19.232623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:19.233077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:19.233876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:19.234313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:19.357715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-16ea89e2-0639-4302-9804-f3e213834042 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:19.371521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16ea89e2-0639-4302-9804-f3e213834042 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1293 microversion: 2.1 time: 0.264823 Jul 26 19:57:19.372522 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1581/3143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:19 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1293 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:19.377382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:19.384658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8461ad90-c011-46f7-b4be-aa5e5fa66056 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:19.390712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:19.399007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8461ad90-c011-46f7-b4be-aa5e5fa66056 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:19.402788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:19.405403 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a56b1983-c6c1-4956-8723-19e72cf26b09 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.208942 Jul 26 19:57:19.407916 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1563/3144] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:19 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:19.410333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8461ad90-c011-46f7-b4be-aa5e5fa66056 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:19.410793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8461ad90-c011-46f7-b4be-aa5e5fa66056 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:19.411582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8461ad90-c011-46f7-b4be-aa5e5fa66056 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:19.412052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8461ad90-c011-46f7-b4be-aa5e5fa66056 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:19.756375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8461ad90-c011-46f7-b4be-aa5e5fa66056 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:19.767517 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8461ad90-c011-46f7-b4be-aa5e5fa66056 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1312 microversion: 2.1 time: 0.390311 Jul 26 19:57:19.768188 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1582/3145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:19 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:20.226070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7980253c-1594-4fa0-9af7-8dcb40e0d00d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:20.226706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7980253c-1594-4fa0-9af7-8dcb40e0d00d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:20.253396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7980253c-1594-4fa0-9af7-8dcb40e0d00d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:20.253917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7980253c-1594-4fa0-9af7-8dcb40e0d00d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:20.254782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7980253c-1594-4fa0-9af7-8dcb40e0d00d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:20.255228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7980253c-1594-4fa0-9af7-8dcb40e0d00d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:20.362849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:20.393699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc01665f-78c3-4634-bb2c-4bcdc4b6e43e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:20.394659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fc01665f-78c3-4634-bb2c-4bcdc4b6e43e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:20.403089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc01665f-78c3-4634-bb2c-4bcdc4b6e43e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:20.403901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc01665f-78c3-4634-bb2c-4bcdc4b6e43e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:20.416526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc01665f-78c3-4634-bb2c-4bcdc4b6e43e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:20.417089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc01665f-78c3-4634-bb2c-4bcdc4b6e43e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:20.611179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fc01665f-78c3-4634-bb2c-4bcdc4b6e43e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:20.627382 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc01665f-78c3-4634-bb2c-4bcdc4b6e43e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1299 microversion: 2.1 time: 0.235978 Jul 26 19:57:20.629169 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1583/3146] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:20 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:20.652341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:20.657575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:20.670740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-7980253c-1594-4fa0-9af7-8dcb40e0d00d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:20.682273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:20.684127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:20.685701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:20.689436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:20.713955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:20.721676 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7980253c-1594-4fa0-9af7-8dcb40e0d00d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.498091 Jul 26 19:57:20.723455 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1564/3147] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:20 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:20.798147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7ace5e7e-767a-42e3-b8c0-e2e0e6c2772b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:20.798982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7ace5e7e-767a-42e3-b8c0-e2e0e6c2772b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:20.819975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ace5e7e-767a-42e3-b8c0-e2e0e6c2772b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:20.822243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ace5e7e-767a-42e3-b8c0-e2e0e6c2772b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:20.824081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ace5e7e-767a-42e3-b8c0-e2e0e6c2772b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:20.825591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ace5e7e-767a-42e3-b8c0-e2e0e6c2772b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:20.891130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:20.902926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:20.908965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:20.910236 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a9be453d-10f0-44d4-ac19-c4dff438bfbc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.278982 Jul 26 19:57:20.912318 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1584/3148] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:20 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:21.048130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-85962612-dc11-4e10-9c8f-af9fda1eb985 req-6c555356-8bc9-4cf5-841f-56f1603b21dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:21.063352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-85962612-dc11-4e10-9c8f-af9fda1eb985 req-6c555356-8bc9-4cf5-841f-56f1603b21dc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:21.064433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-85962612-dc11-4e10-9c8f-af9fda1eb985 req-6c555356-8bc9-4cf5-841f-56f1603b21dc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:21.083591 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-85962612-dc11-4e10-9c8f-af9fda1eb985 req-6c555356-8bc9-4cf5-841f-56f1603b21dc service nova] Creating event network-changed:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h1-708768-8 Jul 26 19:57:21.091551 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-85962612-dc11-4e10-9c8f-af9fda1eb985 req-6c555356-8bc9-4cf5-841f-56f1603b21dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049767 Jul 26 19:57:21.093159 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1585/3149] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:21.474602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ace5e7e-767a-42e3-b8c0-e2e0e6c2772b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:21.485051 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7ace5e7e-767a-42e3-b8c0-e2e0e6c2772b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1312 microversion: 2.1 time: 0.696112 Jul 26 19:57:21.488852 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1565/3150] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:20 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1312 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:21.666747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a27a4dc1-9aa3-46ed-a043-db4e1464153f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:21.668011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a27a4dc1-9aa3-46ed-a043-db4e1464153f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:21.689055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a27a4dc1-9aa3-46ed-a043-db4e1464153f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:21.690161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a27a4dc1-9aa3-46ed-a043-db4e1464153f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:21.692616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a27a4dc1-9aa3-46ed-a043-db4e1464153f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:21.693715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a27a4dc1-9aa3-46ed-a043-db4e1464153f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:21.750242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-81ae571d-b41e-4248-9527-ab9ad4f7b19a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:21.750863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-81ae571d-b41e-4248-9527-ab9ad4f7b19a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:21.765281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81ae571d-b41e-4248-9527-ab9ad4f7b19a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:21.765752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81ae571d-b41e-4248-9527-ab9ad4f7b19a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:21.768719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81ae571d-b41e-4248-9527-ab9ad4f7b19a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:21.769174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81ae571d-b41e-4248-9527-ab9ad4f7b19a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:21.823629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a27a4dc1-9aa3-46ed-a043-db4e1464153f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:21.833531 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a27a4dc1-9aa3-46ed-a043-db4e1464153f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1299 microversion: 2.1 time: 0.186600 Jul 26 19:57:21.834638 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1586/3151] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:21 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:21.940391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:21.941133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:21.958886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:21.959462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:21.960372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:21.960882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:22.182418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-81ae571d-b41e-4248-9527-ab9ad4f7b19a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:22.212164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:22.225970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:22.227698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:22.230600 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-81ae571d-b41e-4248-9527-ab9ad4f7b19a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.485295 Jul 26 19:57:22.232623 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1566/3152] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:21 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:22.244400 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-28e374c4-5f77-42e0-a1da-e1404ff2555b tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.294626 Jul 26 19:57:22.259503 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1587/3153] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:21 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:22.510620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c96bf601-b2ba-4d1a-b7eb-ba991472e515 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:22.516407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c96bf601-b2ba-4d1a-b7eb-ba991472e515 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:22.547098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c96bf601-b2ba-4d1a-b7eb-ba991472e515 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:22.549455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c96bf601-b2ba-4d1a-b7eb-ba991472e515 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:22.552721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c96bf601-b2ba-4d1a-b7eb-ba991472e515 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:22.553954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c96bf601-b2ba-4d1a-b7eb-ba991472e515 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:22.854853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce981029-8cb7-4d4f-b902-b8344c631028 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:22.855566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ce981029-8cb7-4d4f-b902-b8344c631028 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:22.867228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce981029-8cb7-4d4f-b902-b8344c631028 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:22.872978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce981029-8cb7-4d4f-b902-b8344c631028 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:22.874239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce981029-8cb7-4d4f-b902-b8344c631028 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:22.874768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce981029-8cb7-4d4f-b902-b8344c631028 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:22.937579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c96bf601-b2ba-4d1a-b7eb-ba991472e515 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:22.947097 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c96bf601-b2ba-4d1a-b7eb-ba991472e515 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1312 microversion: 2.1 time: 0.441573 Jul 26 19:57:22.948374 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1567/3154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:22 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1312 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:23.270433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87d89557-df75-4ad3-9038-f68faeb64bdb tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:23.271054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87d89557-df75-4ad3-9038-f68faeb64bdb tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:23.271510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ce981029-8cb7-4d4f-b902-b8344c631028 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:23.280063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d89557-df75-4ad3-9038-f68faeb64bdb tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:23.280619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d89557-df75-4ad3-9038-f68faeb64bdb tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:23.281529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d89557-df75-4ad3-9038-f68faeb64bdb tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:23.291507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce981029-8cb7-4d4f-b902-b8344c631028 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1366 microversion: 2.1 time: 0.440125 Jul 26 19:57:23.292019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d89557-df75-4ad3-9038-f68faeb64bdb tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:23.293430 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1588/3155] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:22 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:23.302967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:23.303933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:23.324175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:23.325056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:23.326695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:23.327626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:23.435782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-87d89557-df75-4ad3-9038-f68faeb64bdb tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:23.469601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:23.470906 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87d89557-df75-4ad3-9038-f68faeb64bdb tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.204839 Jul 26 19:57:23.484017 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1568/3156] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:23 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:23.495924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:23.498442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:23.499749 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-09e11f93-d5c8-449a-9c7b-b8a4eaae89a1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.204082 Jul 26 19:57:23.501985 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1589/3157] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:23 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:23.770316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c4314fdf-85df-4df4-a7f9-c6ec4bfdb60e req-76f34d2f-7b27-4643-b669-0f70fd51340b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c84435b-ff31-447e-887e-4c244035e948", "tag": "f49d3f37-a8be-492d-8050-52b308ec42bd"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:23.815678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c4314fdf-85df-4df4-a7f9-c6ec4bfdb60e req-76f34d2f-7b27-4643-b669-0f70fd51340b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:23.816253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c4314fdf-85df-4df4-a7f9-c6ec4bfdb60e req-76f34d2f-7b27-4643-b669-0f70fd51340b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:23.837916 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c4314fdf-85df-4df4-a7f9-c6ec4bfdb60e req-76f34d2f-7b27-4643-b669-0f70fd51340b service nova] Creating event network-changed:f49d3f37-a8be-492d-8050-52b308ec42bd for instance 6c84435b-ff31-447e-887e-4c244035e948 on n-h2-708768-8 Jul 26 19:57:23.852582 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c4314fdf-85df-4df4-a7f9-c6ec4bfdb60e req-76f34d2f-7b27-4643-b669-0f70fd51340b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086753 Jul 26 19:57:23.855068 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1569/3158] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:23.971734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2e6c1021-c439-423a-9681-00bc2417f51f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:23.972428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2e6c1021-c439-423a-9681-00bc2417f51f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:23.986413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:23.990715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e6c1021-c439-423a-9681-00bc2417f51f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:23.991231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e6c1021-c439-423a-9681-00bc2417f51f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:23.992411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e6c1021-c439-423a-9681-00bc2417f51f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:23.993047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e6c1021-c439-423a-9681-00bc2417f51f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:24.324674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18a204ce-02a8-4de9-b60e-1843e2a896d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:24.327669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18a204ce-02a8-4de9-b60e-1843e2a896d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:24.336808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18a204ce-02a8-4de9-b60e-1843e2a896d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:24.339844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18a204ce-02a8-4de9-b60e-1843e2a896d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:24.341234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18a204ce-02a8-4de9-b60e-1843e2a896d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:24.342645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18a204ce-02a8-4de9-b60e-1843e2a896d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:24.436544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2e6c1021-c439-423a-9681-00bc2417f51f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:24.445078 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2e6c1021-c439-423a-9681-00bc2417f51f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1312 microversion: 2.1 time: 0.478657 Jul 26 19:57:24.460117 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1590/3159] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:23 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1312 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:24.514027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ff13d55-190a-4c16-a54f-329566f5cf16 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:24.514671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ff13d55-190a-4c16-a54f-329566f5cf16 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:24.522325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ff13d55-190a-4c16-a54f-329566f5cf16 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:24.522965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ff13d55-190a-4c16-a54f-329566f5cf16 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:24.523866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ff13d55-190a-4c16-a54f-329566f5cf16 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:24.524310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ff13d55-190a-4c16-a54f-329566f5cf16 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:24.688578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-2ff13d55-190a-4c16-a54f-329566f5cf16 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:24.688824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18a204ce-02a8-4de9-b60e-1843e2a896d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:24.699108 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18a204ce-02a8-4de9-b60e-1843e2a896d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1366 microversion: 2.1 time: 0.386689 Jul 26 19:57:24.711653 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1570/3160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:24 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:24.713771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:24.715502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:24.727918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:24.728517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:24.729553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:24.730100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:24.738896 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ff13d55-190a-4c16-a54f-329566f5cf16 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.241412 Jul 26 19:57:24.739852 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1591/3161] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:24 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:24.825637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:24.835438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:24.838050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:24.839306 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1db924c9-4b2a-49bf-a337-92c2ec15bfe6 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.136254 Jul 26 19:57:24.840124 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1571/3162] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:24 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:25.467035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-038eeb2e-6a74-4eba-87ba-6fe6eea4ff57 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:25.468077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-038eeb2e-6a74-4eba-87ba-6fe6eea4ff57 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:25.471755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:25.482729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-038eeb2e-6a74-4eba-87ba-6fe6eea4ff57 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:25.483517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-038eeb2e-6a74-4eba-87ba-6fe6eea4ff57 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:25.484855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-038eeb2e-6a74-4eba-87ba-6fe6eea4ff57 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:25.485623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-038eeb2e-6a74-4eba-87ba-6fe6eea4ff57 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:25.664292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-038eeb2e-6a74-4eba-87ba-6fe6eea4ff57 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:25.677600 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-038eeb2e-6a74-4eba-87ba-6fe6eea4ff57 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1312 microversion: 2.1 time: 0.213633 Jul 26 19:57:25.679171 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1592/3163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:25 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:25.720984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1765b7de-3c83-4a9d-8039-31c4f44a6401 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:25.721755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1765b7de-3c83-4a9d-8039-31c4f44a6401 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:25.728303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1765b7de-3c83-4a9d-8039-31c4f44a6401 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:25.729412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1765b7de-3c83-4a9d-8039-31c4f44a6401 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:25.730274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1765b7de-3c83-4a9d-8039-31c4f44a6401 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:25.730794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1765b7de-3c83-4a9d-8039-31c4f44a6401 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:25.767331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f51c210f-2747-4e66-b29a-8964f9cd29b3 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:25.768275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f51c210f-2747-4e66-b29a-8964f9cd29b3 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:25.783474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f51c210f-2747-4e66-b29a-8964f9cd29b3 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:25.784233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f51c210f-2747-4e66-b29a-8964f9cd29b3 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:25.785047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f51c210f-2747-4e66-b29a-8964f9cd29b3 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:25.785655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f51c210f-2747-4e66-b29a-8964f9cd29b3 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:25.878812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-f51c210f-2747-4e66-b29a-8964f9cd29b3 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:25.902027 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f51c210f-2747-4e66-b29a-8964f9cd29b3 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.139358 Jul 26 19:57:25.902940 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1593/3164] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:25 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:25.909337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:25.909970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:25.917133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:25.917727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:25.918689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:25.920123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:25.949466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:26.016824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:26.030350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:26.032698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:26.033937 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61571273-f0a3-4110-8e8c-408dff95935e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.128999 Jul 26 19:57:26.034503 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1594/3165] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:25 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:26.142802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1765b7de-3c83-4a9d-8039-31c4f44a6401 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:26.165681 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1765b7de-3c83-4a9d-8039-31c4f44a6401 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1366 microversion: 2.1 time: 0.445274 Jul 26 19:57:26.167083 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1572/3166] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:25 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:26.701340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-52f25073-66a4-4bfe-b209-8f2aa0a8b914 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:26.701981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-52f25073-66a4-4bfe-b209-8f2aa0a8b914 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:26.714026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52f25073-66a4-4bfe-b209-8f2aa0a8b914 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:26.714492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52f25073-66a4-4bfe-b209-8f2aa0a8b914 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:26.720054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52f25073-66a4-4bfe-b209-8f2aa0a8b914 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:26.720514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52f25073-66a4-4bfe-b209-8f2aa0a8b914 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:26.934746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c2b1b3e8-e40e-437b-ba69-6f49d2007c85 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:26.936225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c2b1b3e8-e40e-437b-ba69-6f49d2007c85 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:26.947997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2b1b3e8-e40e-437b-ba69-6f49d2007c85 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:26.948452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2b1b3e8-e40e-437b-ba69-6f49d2007c85 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:26.949237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2b1b3e8-e40e-437b-ba69-6f49d2007c85 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:26.949678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2b1b3e8-e40e-437b-ba69-6f49d2007c85 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:27.073303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-c2b1b3e8-e40e-437b-ba69-6f49d2007c85 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:27.115697 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c2b1b3e8-e40e-437b-ba69-6f49d2007c85 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.184939 Jul 26 19:57:27.118218 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1573/3167] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:26 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:27.129739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:27.130692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:27.141388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:27.143713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:27.145346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:27.146350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:27.165373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-52f25073-66a4-4bfe-b209-8f2aa0a8b914 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:27.174443 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-52f25073-66a4-4bfe-b209-8f2aa0a8b914 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1312 microversion: 2.1 time: 0.477453 Jul 26 19:57:27.177366 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1595/3168] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:26 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:27.187675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e9e6f7c-5edd-40ee-b2b2-d951cb8ce2f8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:27.189819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e9e6f7c-5edd-40ee-b2b2-d951cb8ce2f8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:27.203846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f7c-5edd-40ee-b2b2-d951cb8ce2f8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:27.207722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f7c-5edd-40ee-b2b2-d951cb8ce2f8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:27.210651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f7c-5edd-40ee-b2b2-d951cb8ce2f8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:27.211175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e9e6f7c-5edd-40ee-b2b2-d951cb8ce2f8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:27.271741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:27.294637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:27.297369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:27.299114 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cbebf853-33ae-4dab-801c-7ad632f4673e tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.179615 Jul 26 19:57:27.301039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1574/3169] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:27 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:27.444750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e9e6f7c-5edd-40ee-b2b2-d951cb8ce2f8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:27.458169 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e9e6f7c-5edd-40ee-b2b2-d951cb8ce2f8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1366 microversion: 2.1 time: 0.274633 Jul 26 19:57:27.461566 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1596/3170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:27 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:28.113033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-10b8f1e6-06a9-4378-aa8f-cb77b3977c71 req-9cb72e5e-f81f-4287-8c19-0097b1071260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "name": "network-vif-plugged", "status": "completed", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:28.142864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:28.144250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:28.146773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec68d8e6-5db1-42a9-9c0d-78b32ee79022 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:28.147984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ec68d8e6-5db1-42a9-9c0d-78b32ee79022 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:28.151284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-10b8f1e6-06a9-4378-aa8f-cb77b3977c71 req-9cb72e5e-f81f-4287-8c19-0097b1071260 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.156386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=20 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:28.156573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-10b8f1e6-06a9-4378-aa8f-cb77b3977c71 req-9cb72e5e-f81f-4287-8c19-0097b1071260 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.158805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec68d8e6-5db1-42a9-9c0d-78b32ee79022 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.159439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec68d8e6-5db1-42a9-9c0d-78b32ee79022 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.160494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec68d8e6-5db1-42a9-9c0d-78b32ee79022 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.161153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec68d8e6-5db1-42a9-9c0d-78b32ee79022 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.179682 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-10b8f1e6-06a9-4378-aa8f-cb77b3977c71 req-9cb72e5e-f81f-4287-8c19-0097b1071260 service nova] Creating event network-vif-plugged:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h1-708768-8 Jul 26 19:57:28.187673 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-10b8f1e6-06a9-4378-aa8f-cb77b3977c71 req-9cb72e5e-f81f-4287-8c19-0097b1071260 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085659 Jul 26 19:57:28.190254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1575/3171] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:28.216223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-19b5735d-ff50-40e3-a5ac-237fe6434d9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:28.219502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-19b5735d-ff50-40e3-a5ac-237fe6434d9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:28.235257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19b5735d-ff50-40e3-a5ac-237fe6434d9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.235740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19b5735d-ff50-40e3-a5ac-237fe6434d9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.236528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19b5735d-ff50-40e3-a5ac-237fe6434d9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.236967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19b5735d-ff50-40e3-a5ac-237fe6434d9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.329340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-ec68d8e6-5db1-42a9-9c0d-78b32ee79022 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:28.354566 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ec68d8e6-5db1-42a9-9c0d-78b32ee79022 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.213202 Jul 26 19:57:28.355904 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1597/3172] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:28 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:28.362089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:28.362958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:28.369930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.370600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.371543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.372204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.444609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:28.456787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:28.458619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:28.460192 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a7db7ac-1046-4167-b6dc-0adedd59de59 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.102258 Jul 26 19:57:28.460931 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1598/3173] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:28 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:28.482481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-132ff496-d0f5-49ee-8ac8-85bf888b2990 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:28.483344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-132ff496-d0f5-49ee-8ac8-85bf888b2990 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:28.490400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-132ff496-d0f5-49ee-8ac8-85bf888b2990 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.491091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-132ff496-d0f5-49ee-8ac8-85bf888b2990 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.492266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-132ff496-d0f5-49ee-8ac8-85bf888b2990 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:28.493003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-132ff496-d0f5-49ee-8ac8-85bf888b2990 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:28.653537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-132ff496-d0f5-49ee-8ac8-85bf888b2990 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:28.663990 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-132ff496-d0f5-49ee-8ac8-85bf888b2990 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1366 microversion: 2.1 time: 0.185280 Jul 26 19:57:28.664779 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1599/3174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:28 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:28.761382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-19b5735d-ff50-40e3-a5ac-237fe6434d9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:28.772667 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-19b5735d-ff50-40e3-a5ac-237fe6434d9d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1312 microversion: 2.1 time: 0.577741 Jul 26 19:57:28.795565 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1576/3175] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:28 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1312 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:29.391795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e561d69b-7d6e-4e24-ab7d-1f3a6d913040 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:29.392489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e561d69b-7d6e-4e24-ab7d-1f3a6d913040 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:29.399636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e561d69b-7d6e-4e24-ab7d-1f3a6d913040 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:29.400084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e561d69b-7d6e-4e24-ab7d-1f3a6d913040 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:29.400867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e561d69b-7d6e-4e24-ab7d-1f3a6d913040 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:29.401311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e561d69b-7d6e-4e24-ab7d-1f3a6d913040 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:29.486749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:29.487560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:29.494678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-e561d69b-7d6e-4e24-ab7d-1f3a6d913040 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:29.503054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:29.504103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:29.505145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:29.507636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:29.521058 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e561d69b-7d6e-4e24-ab7d-1f3a6d913040 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.137018 Jul 26 19:57:29.521668 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1600/3176] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:29 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:29.603586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:29.614236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:29.616207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:29.617748 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e514f1a6-b0cf-4791-b30e-586e9d465852 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.136729 Jul 26 19:57:29.618866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1577/3177] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:29 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:29.695161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a413a159-863d-43f7-95a3-035bae7fb2e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:29.695161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a413a159-863d-43f7-95a3-035bae7fb2e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:29.699987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a413a159-863d-43f7-95a3-035bae7fb2e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:29.701096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a413a159-863d-43f7-95a3-035bae7fb2e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:29.702329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a413a159-863d-43f7-95a3-035bae7fb2e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:29.703006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a413a159-863d-43f7-95a3-035bae7fb2e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:29.799587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-efecd35b-c44e-4d0b-b343-4bc8d1806af2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:29.800555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-efecd35b-c44e-4d0b-b343-4bc8d1806af2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:29.814351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-efecd35b-c44e-4d0b-b343-4bc8d1806af2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:29.816514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-efecd35b-c44e-4d0b-b343-4bc8d1806af2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:29.817434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-efecd35b-c44e-4d0b-b343-4bc8d1806af2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:29.818665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-efecd35b-c44e-4d0b-b343-4bc8d1806af2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:30.067685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a413a159-863d-43f7-95a3-035bae7fb2e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:30.081035 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a413a159-863d-43f7-95a3-035bae7fb2e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1366 microversion: 2.1 time: 0.398463 Jul 26 19:57:30.082018 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1601/3178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:29 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:30.131394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-efecd35b-c44e-4d0b-b343-4bc8d1806af2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:30.142620 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-efecd35b-c44e-4d0b-b343-4bc8d1806af2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1312 microversion: 2.1 time: 0.346863 Jul 26 19:57:30.143733 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1578/3179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:29 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1312 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:30.234719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-251e6a9d-7d6b-4fa6-ac11-b4a6c06f8d05 req-ba961f08-b0a4-43e4-9ee4-40b480cbce9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c84435b-ff31-447e-887e-4c244035e948", "name": "network-vif-plugged", "status": "completed", "tag": "f49d3f37-a8be-492d-8050-52b308ec42bd"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:30.252017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-251e6a9d-7d6b-4fa6-ac11-b4a6c06f8d05 req-ba961f08-b0a4-43e4-9ee4-40b480cbce9f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:30.253052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-251e6a9d-7d6b-4fa6-ac11-b4a6c06f8d05 req-ba961f08-b0a4-43e4-9ee4-40b480cbce9f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:30.264527 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-251e6a9d-7d6b-4fa6-ac11-b4a6c06f8d05 req-ba961f08-b0a4-43e4-9ee4-40b480cbce9f service nova] Creating event network-vif-plugged:f49d3f37-a8be-492d-8050-52b308ec42bd for instance 6c84435b-ff31-447e-887e-4c244035e948 on n-h2-708768-8 Jul 26 19:57:30.270628 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-251e6a9d-7d6b-4fa6-ac11-b4a6c06f8d05 req-ba961f08-b0a4-43e4-9ee4-40b480cbce9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041088 Jul 26 19:57:30.271558 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1602/3180] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:57:30.550615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37ab6b62-c8b3-4f55-9307-dd21fab27a39 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:30.551892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37ab6b62-c8b3-4f55-9307-dd21fab27a39 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:30.564843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37ab6b62-c8b3-4f55-9307-dd21fab27a39 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:30.565314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37ab6b62-c8b3-4f55-9307-dd21fab27a39 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:30.568287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37ab6b62-c8b3-4f55-9307-dd21fab27a39 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:30.568816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37ab6b62-c8b3-4f55-9307-dd21fab27a39 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:30.645745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:30.647006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:30.666349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:30.669888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:30.673637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:30.674169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:30.681899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-37ab6b62-c8b3-4f55-9307-dd21fab27a39 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:30.732098 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37ab6b62-c8b3-4f55-9307-dd21fab27a39 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.185158 Jul 26 19:57:30.734762 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1579/3181] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:30 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:31.102535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1fb73a95-2bbd-4c9c-bb32-ce5faea31b4c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:31.103161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1fb73a95-2bbd-4c9c-bb32-ce5faea31b4c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:31.110744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1fb73a95-2bbd-4c9c-bb32-ce5faea31b4c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.111209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1fb73a95-2bbd-4c9c-bb32-ce5faea31b4c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.112031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1fb73a95-2bbd-4c9c-bb32-ce5faea31b4c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.112472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1fb73a95-2bbd-4c9c-bb32-ce5faea31b4c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.138845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:31.149765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:31.151692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:31.153347 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3f177938-4774-4249-a085-8a5d2c2ef0bd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.513965 Jul 26 19:57:31.172906 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1603/3182] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:30 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:31.180818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee531437-decb-4188-a187-c642718fd813 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:31.181707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ee531437-decb-4188-a187-c642718fd813 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:31.191735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee531437-decb-4188-a187-c642718fd813 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.192410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee531437-decb-4188-a187-c642718fd813 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.193989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee531437-decb-4188-a187-c642718fd813 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.194611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee531437-decb-4188-a187-c642718fd813 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.280876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1fb73a95-2bbd-4c9c-bb32-ce5faea31b4c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:31.284946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:31.293226 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1fb73a95-2bbd-4c9c-bb32-ce5faea31b4c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1366 microversion: 2.1 time: 0.194584 Jul 26 19:57:31.294635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1580/3183] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:31 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:31.414686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ee531437-decb-4188-a187-c642718fd813 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:31.424686 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ee531437-decb-4188-a187-c642718fd813 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1462 microversion: 2.1 time: 0.249558 Jul 26 19:57:31.425371 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1604/3184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:31 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1462 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:31.447305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d925d85-278f-4da9-87f2-725eb37e7535 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:31.448079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1d925d85-278f-4da9-87f2-725eb37e7535 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:31.454672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d925d85-278f-4da9-87f2-725eb37e7535 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.455225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d925d85-278f-4da9-87f2-725eb37e7535 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.456224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d925d85-278f-4da9-87f2-725eb37e7535 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.456669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d925d85-278f-4da9-87f2-725eb37e7535 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.594408 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1d925d85-278f-4da9-87f2-725eb37e7535 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1613 microversion: 2.1 time: 0.151452 Jul 26 19:57:31.595994 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1581/3185] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:31 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:31.619779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:31.620766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:31.629949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.630675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.631467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.632065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.665341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a05edf4da4ef4019928b6e7ba4f4bc09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81cb7a0501b44a8b54b68bf244100e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:31.665980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] flavor_id is None. Assuming migration. {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 19:57:31.666355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 19:57:31.765010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15afead6-356e-4d17-beca-019262ab458e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:31.766363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-15afead6-356e-4d17-beca-019262ab458e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:31.774821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15afead6-356e-4d17-beca-019262ab458e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.775548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15afead6-356e-4d17-beca-019262ab458e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.777010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15afead6-356e-4d17-beca-019262ab458e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.777653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15afead6-356e-4d17-beca-019262ab458e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.798994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06cf0762-1e38-4cb1-877a-74c30076195d tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9/action" status: 202 len: 0 microversion: 2.1 time: 0.185161 Jul 26 19:57:31.799908 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1605/3186] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:57:31 2022] POST /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:57:31.808958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6336902d-c0cd-4d5c-9515-4791b68c9407 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:31.810042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6336902d-c0cd-4d5c-9515-4791b68c9407 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:31.818622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6336902d-c0cd-4d5c-9515-4791b68c9407 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.819281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6336902d-c0cd-4d5c-9515-4791b68c9407 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.820355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6336902d-c0cd-4d5c-9515-4791b68c9407 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:31.821081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6336902d-c0cd-4d5c-9515-4791b68c9407 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:31.887896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-15afead6-356e-4d17-beca-019262ab458e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:31.930109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15afead6-356e-4d17-beca-019262ab458e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.171757 Jul 26 19:57:31.943658 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1582/3187] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:31 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:32.085394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6336902d-c0cd-4d5c-9515-4791b68c9407 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:32.094990 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6336902d-c0cd-4d5c-9515-4791b68c9407 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1471 microversion: 2.1 time: 0.290122 Jul 26 19:57:32.096486 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1606/3188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:31 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:32.179842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:32.180580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:32.191236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:32.191488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:32.192311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:32.192743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:32.304742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:32.314272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:32.321831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b252ef0-e86a-45c6-940a-a1c512915c33 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:32.322561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1b252ef0-e86a-45c6-940a-a1c512915c33 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:32.331295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b252ef0-e86a-45c6-940a-a1c512915c33 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:32.331738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:32.332437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b252ef0-e86a-45c6-940a-a1c512915c33 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:32.333579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b252ef0-e86a-45c6-940a-a1c512915c33 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:32.334969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e774c85-1fb3-4b13-b6a0-c00ae5cd9327 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.158995 Jul 26 19:57:32.335561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b252ef0-e86a-45c6-940a-a1c512915c33 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:32.354137 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1583/3189] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:32 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:32.524240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1b252ef0-e86a-45c6-940a-a1c512915c33 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:32.537401 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b252ef0-e86a-45c6-940a-a1c512915c33 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1555 microversion: 2.1 time: 0.226046 Jul 26 19:57:32.552561 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1607/3190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:32 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:32.560778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-78b01f61-f177-4319-a06e-2f17d9f78dc8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:32.561284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-78b01f61-f177-4319-a06e-2f17d9f78dc8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:32.569717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78b01f61-f177-4319-a06e-2f17d9f78dc8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:32.570178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78b01f61-f177-4319-a06e-2f17d9f78dc8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:32.570965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78b01f61-f177-4319-a06e-2f17d9f78dc8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:32.571443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78b01f61-f177-4319-a06e-2f17d9f78dc8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:32.672739 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-78b01f61-f177-4319-a06e-2f17d9f78dc8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116367 Jul 26 19:57:32.679665 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1584/3191] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:57:32 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:32.957888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c4d695a-cee2-4406-ade1-85c609c5b661 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:32.959148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c4d695a-cee2-4406-ade1-85c609c5b661 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:32.985215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c4d695a-cee2-4406-ade1-85c609c5b661 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:32.986019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c4d695a-cee2-4406-ade1-85c609c5b661 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:32.987285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c4d695a-cee2-4406-ade1-85c609c5b661 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:32.987971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c4d695a-cee2-4406-ade1-85c609c5b661 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:33.120349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-101875b7-d7a0-4917-853d-ac9a5cf7f6be tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:33.121235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-101875b7-d7a0-4917-853d-ac9a5cf7f6be tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:33.139423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-101875b7-d7a0-4917-853d-ac9a5cf7f6be tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:33.140742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-101875b7-d7a0-4917-853d-ac9a5cf7f6be tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:33.158033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-101875b7-d7a0-4917-853d-ac9a5cf7f6be tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:33.160262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-101875b7-d7a0-4917-853d-ac9a5cf7f6be tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:33.183598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-8c4d695a-cee2-4406-ade1-85c609c5b661 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:33.248209 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c4d695a-cee2-4406-ade1-85c609c5b661 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.294260 Jul 26 19:57:33.268930 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1608/3192] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:32 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:33.366116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:33.366861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:33.377642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:33.378193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:33.379024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:33.379473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:33.382757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:33.715045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:33.731195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:33.740016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:33.743355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e91ce943-8914-400a-a271-368ecff3b3d9 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.381521 Jul 26 19:57:33.745427 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1609/3193] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:33 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:34.015059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-101875b7-d7a0-4917-853d-ac9a5cf7f6be tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:34.038979 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-101875b7-d7a0-4917-853d-ac9a5cf7f6be tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1471 microversion: 2.1 time: 0.924757 Jul 26 19:57:34.053669 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1585/3194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:33 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1471 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:34.283888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-41b2ab3d-0b50-4b2e-8a63-35f4ace0c553 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:34.284498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41b2ab3d-0b50-4b2e-8a63-35f4ace0c553 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:34.291588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41b2ab3d-0b50-4b2e-8a63-35f4ace0c553 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:34.292073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41b2ab3d-0b50-4b2e-8a63-35f4ace0c553 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:34.292845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41b2ab3d-0b50-4b2e-8a63-35f4ace0c553 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:34.293290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41b2ab3d-0b50-4b2e-8a63-35f4ace0c553 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:34.367355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-41b2ab3d-0b50-4b2e-8a63-35f4ace0c553 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:34.385845 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-41b2ab3d-0b50-4b2e-8a63-35f4ace0c553 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.107549 Jul 26 19:57:34.386434 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1610/3195] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:34 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:34.772700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:34.773980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:34.784033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:34.785033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:34.786082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:34.786734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:34.813703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:34.818619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:34.819427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Searching by: {'deleted': False, 'project_id': '447b5dd287aa49e8915187d2c75da345'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:57:34.838942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:34.839388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:34.840219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:34.841318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:34.866952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:57:34.899690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ca5f635-b36e-4bdc-a2f7-466530ae123c tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.090462 Jul 26 19:57:34.900627 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1611/3196] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 19:57:34 2022] GET /compute/v2.1/servers => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:34.915540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:34.921246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:34.922012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Searching by: {'deleted': False, 'project_id': '447b5dd287aa49e8915187d2c75da345'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:57:34.928152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:34.928804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:34.929607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:34.930051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:34.958771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:57:34.993459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:35.010481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:35.012490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:35.014870 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c65b137-17b7-4a6d-9f80-ae4be5b617bc tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.247965 Jul 26 19:57:35.026622 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1586/3197] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:34 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:35.062607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6cc32404-1474-4932-b712-cd35521be2f4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:35.063493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6cc32404-1474-4932-b712-cd35521be2f4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:35.071400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cc32404-1474-4932-b712-cd35521be2f4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.071952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:35.072407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cc32404-1474-4932-b712-cd35521be2f4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:35.073548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cc32404-1474-4932-b712-cd35521be2f4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.074176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cc32404-1474-4932-b712-cd35521be2f4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:35.080619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.081159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:35.308041 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-996d6687-2ac1-4687-9873-bb6b413969ea tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1608 microversion: 2.1 time: 0.395963 Jul 26 19:57:35.310656 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1612/3198] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:57:34 2022] GET /compute/v2.1/servers/detail => generated 1608 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:35.335758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-adb393a6-00a3-44b7-9004-861db5d1fd84 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:35.346117 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-adb393a6-00a3-44b7-9004-861db5d1fd84 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015574 Jul 26 19:57:35.354957 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1613/3199] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:57:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:57:35.412484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-698b462f-250b-4cba-997a-58607bc09aa4 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:35.413271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-698b462f-250b-4cba-997a-58607bc09aa4 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:35.420671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-698b462f-250b-4cba-997a-58607bc09aa4 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.421216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-698b462f-250b-4cba-997a-58607bc09aa4 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:35.422060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-698b462f-250b-4cba-997a-58607bc09aa4 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.422596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-698b462f-250b-4cba-997a-58607bc09aa4 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:35.515051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-698b462f-250b-4cba-997a-58607bc09aa4 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:35.539004 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-698b462f-250b-4cba-997a-58607bc09aa4 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.130360 Jul 26 19:57:35.547750 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1614/3200] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:35 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:35.716977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b5ee48ec-5008-45a3-92a1-62afe290f16b tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:35.717982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b5ee48ec-5008-45a3-92a1-62afe290f16b tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:35.725183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5ee48ec-5008-45a3-92a1-62afe290f16b tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.726013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5ee48ec-5008-45a3-92a1-62afe290f16b tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:35.727130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5ee48ec-5008-45a3-92a1-62afe290f16b tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.727965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b5ee48ec-5008-45a3-92a1-62afe290f16b tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:35.757083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b5ee48ec-5008-45a3-92a1-62afe290f16b tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:57:35.828535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6cc32404-1474-4932-b712-cd35521be2f4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:35.836916 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6cc32404-1474-4932-b712-cd35521be2f4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1471 microversion: 2.1 time: 0.779472 Jul 26 19:57:35.837521 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1587/3201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:35 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1471 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:35.883169 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b5ee48ec-5008-45a3-92a1-62afe290f16b tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "DELETE /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 204 len: 0 microversion: 2.1 time: 0.170316 Jul 26 19:57:35.884332 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1615/3202] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:57:35 2022] DELETE /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:57:35.893412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-379df68b-c852-49fb-be72-2eba7c3a67c8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:35.894036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-379df68b-c852-49fb-be72-2eba7c3a67c8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:35.902299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-379df68b-c852-49fb-be72-2eba7c3a67c8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.903922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-379df68b-c852-49fb-be72-2eba7c3a67c8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:35.905313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-379df68b-c852-49fb-be72-2eba7c3a67c8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:35.908017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-379df68b-c852-49fb-be72-2eba7c3a67c8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:36.042992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:36.044047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:36.050343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:36.051031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:36.052015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:36.052793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:36.170084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:36.189008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:36.193302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:36.194856 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bfd97e20-c638-44f8-993e-688cc434c9a3 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.156267 Jul 26 19:57:36.212659 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1616/3203] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:36 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:36.222273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-24c907f5-8d62-4ba0-b085-b20e5b5055c3 req-4ba09750-2399-462c-b2b8-cd8dd8d9e30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c84435b-ff31-447e-887e-4c244035e948", "tag": "f49d3f37-a8be-492d-8050-52b308ec42bd"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:36.235852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-24c907f5-8d62-4ba0-b085-b20e5b5055c3 req-4ba09750-2399-462c-b2b8-cd8dd8d9e30c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:36.236410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-24c907f5-8d62-4ba0-b085-b20e5b5055c3 req-4ba09750-2399-462c-b2b8-cd8dd8d9e30c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:36.255105 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-24c907f5-8d62-4ba0-b085-b20e5b5055c3 req-4ba09750-2399-462c-b2b8-cd8dd8d9e30c service nova] Creating event network-changed:f49d3f37-a8be-492d-8050-52b308ec42bd for instance 6c84435b-ff31-447e-887e-4c244035e948 on n-h2-708768-8 Jul 26 19:57:36.256271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-379df68b-c852-49fb-be72-2eba7c3a67c8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:36.274370 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-379df68b-c852-49fb-be72-2eba7c3a67c8 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1611 microversion: 2.1 time: 0.384911 Jul 26 19:57:36.276925 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1588/3204] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:35 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1611 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:36.285149 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-24c907f5-8d62-4ba0-b085-b20e5b5055c3 req-4ba09750-2399-462c-b2b8-cd8dd8d9e30c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070825 Jul 26 19:57:36.286040 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1617/3205] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:36.570820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4e2a495-20bc-435a-9fc5-cf7324b3338d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:36.572461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4e2a495-20bc-435a-9fc5-cf7324b3338d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:36.583433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4e2a495-20bc-435a-9fc5-cf7324b3338d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:36.584923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4e2a495-20bc-435a-9fc5-cf7324b3338d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:36.586766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4e2a495-20bc-435a-9fc5-cf7324b3338d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:36.587870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4e2a495-20bc-435a-9fc5-cf7324b3338d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:36.751026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-a4e2a495-20bc-435a-9fc5-cf7324b3338d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:36.784862 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4e2a495-20bc-435a-9fc5-cf7324b3338d tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.219239 Jul 26 19:57:36.785887 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1589/3206] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:36 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:36.861938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9296676d-346f-404d-87d9-723e67adedc4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:36.863959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9296676d-346f-404d-87d9-723e67adedc4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:36.880686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9296676d-346f-404d-87d9-723e67adedc4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:36.881296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9296676d-346f-404d-87d9-723e67adedc4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:36.882186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9296676d-346f-404d-87d9-723e67adedc4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:36.882750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9296676d-346f-404d-87d9-723e67adedc4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:37.170777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9296676d-346f-404d-87d9-723e67adedc4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:37.186658 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9296676d-346f-404d-87d9-723e67adedc4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.327289 Jul 26 19:57:37.205504 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1618/3207] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:36 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:37.221124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:37.221914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:37.235775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:37.236760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:37.237754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:37.238405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:37.299949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2b85d258-05e9-460a-8207-fb5042fbf3e2 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:37.300909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2b85d258-05e9-460a-8207-fb5042fbf3e2 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:37.309016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b85d258-05e9-460a-8207-fb5042fbf3e2 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:37.310379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b85d258-05e9-460a-8207-fb5042fbf3e2 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:37.311554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b85d258-05e9-460a-8207-fb5042fbf3e2 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:37.312264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b85d258-05e9-460a-8207-fb5042fbf3e2 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:37.430712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:37.444025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:37.445781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:37.447143 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cb6d1d2d-7023-4ba9-b0ba-c42736d82d17 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.231676 Jul 26 19:57:37.450711 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1590/3208] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:37 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:37.717840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b85d258-05e9-460a-8207-fb5042fbf3e2 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:37.728546 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2b85d258-05e9-460a-8207-fb5042fbf3e2 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1611 microversion: 2.1 time: 0.432666 Jul 26 19:57:37.729717 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1619/3209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:37 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1611 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:37.816056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1434aef8-5d31-4764-b6aa-35cc8a10df46 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:37.817068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1434aef8-5d31-4764-b6aa-35cc8a10df46 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:37.827443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1434aef8-5d31-4764-b6aa-35cc8a10df46 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:37.828974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1434aef8-5d31-4764-b6aa-35cc8a10df46 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:37.830144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1434aef8-5d31-4764-b6aa-35cc8a10df46 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:37.830745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1434aef8-5d31-4764-b6aa-35cc8a10df46 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:37.985539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-1434aef8-5d31-4764-b6aa-35cc8a10df46 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:38.026132 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1434aef8-5d31-4764-b6aa-35cc8a10df46 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.217669 Jul 26 19:57:38.027217 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1591/3210] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:37 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:38.208317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b04aed73-a34e-4596-8934-65f3a8a9fd7f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:38.210334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b04aed73-a34e-4596-8934-65f3a8a9fd7f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:38.222431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b04aed73-a34e-4596-8934-65f3a8a9fd7f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:38.223140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b04aed73-a34e-4596-8934-65f3a8a9fd7f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:38.225195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b04aed73-a34e-4596-8934-65f3a8a9fd7f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:38.225644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b04aed73-a34e-4596-8934-65f3a8a9fd7f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:38.478595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:38.480001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:38.505132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:38.506260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:38.508479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:38.509851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:38.693917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:38.704909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:38.707752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:38.714629 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-49c617fa-c216-4f4a-929c-1aa65fd903fb tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.244174 Jul 26 19:57:38.718220 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1592/3211] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:38 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:38.750628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22e2c3ff-640c-4943-a45b-3c45bd3ebecb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:38.751671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-22e2c3ff-640c-4943-a45b-3c45bd3ebecb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:38.761051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e2c3ff-640c-4943-a45b-3c45bd3ebecb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:38.766761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e2c3ff-640c-4943-a45b-3c45bd3ebecb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:38.767840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e2c3ff-640c-4943-a45b-3c45bd3ebecb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:38.768389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e2c3ff-640c-4943-a45b-3c45bd3ebecb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:39.102799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22e2c3ff-640c-4943-a45b-3c45bd3ebecb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:39.125109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22e2c3ff-640c-4943-a45b-3c45bd3ebecb tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1611 microversion: 2.1 time: 0.371040 Jul 26 19:57:39.127294 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1593/3212] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:38 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1611 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:39.151444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-205682ec-030f-4340-9676-3fdccb8a7dd5 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:39.153982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-205682ec-030f-4340-9676-3fdccb8a7dd5 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:39.162085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b04aed73-a34e-4596-8934-65f3a8a9fd7f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:39.166739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-205682ec-030f-4340-9676-3fdccb8a7dd5 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:39.167205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-205682ec-030f-4340-9676-3fdccb8a7dd5 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:39.168226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-205682ec-030f-4340-9676-3fdccb8a7dd5 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:39.168726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-205682ec-030f-4340-9676-3fdccb8a7dd5 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:39.173950 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b04aed73-a34e-4596-8934-65f3a8a9fd7f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.969299 Jul 26 19:57:39.175275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1620/3213] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:38 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:39.307371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-205682ec-030f-4340-9676-3fdccb8a7dd5 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:39.350802 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-205682ec-030f-4340-9676-3fdccb8a7dd5 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.203871 Jul 26 19:57:39.351760 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1594/3214] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:39 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:39.741713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:39.742922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:39.758758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:39.760802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:39.761846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:39.763781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:39.980371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:40.002889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:40.006961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:40.016014 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85680920-3ed4-4612-bfd0-cde683753355 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.277850 Jul 26 19:57:40.016726 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1621/3215] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:39 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:40.160081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-225aec59-bf69-4b57-a06c-515807323fb4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:40.161059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-225aec59-bf69-4b57-a06c-515807323fb4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:40.203779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-605dde26-08d0-4549-b863-e384d17d1994 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:40.204411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-605dde26-08d0-4549-b863-e384d17d1994 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:40.211280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-225aec59-bf69-4b57-a06c-515807323fb4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:40.219262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-605dde26-08d0-4549-b863-e384d17d1994 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:40.219858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-225aec59-bf69-4b57-a06c-515807323fb4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:40.220978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-225aec59-bf69-4b57-a06c-515807323fb4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:40.224255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-605dde26-08d0-4549-b863-e384d17d1994 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:40.224600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-225aec59-bf69-4b57-a06c-515807323fb4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:40.227732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-605dde26-08d0-4549-b863-e384d17d1994 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:40.232286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-605dde26-08d0-4549-b863-e384d17d1994 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:40.413073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-225aec59-bf69-4b57-a06c-515807323fb4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:40.424547 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-225aec59-bf69-4b57-a06c-515807323fb4 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1543 microversion: 2.1 time: 0.275912 Jul 26 19:57:40.425341 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1595/3216] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:40 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1543 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:40.439653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-27886ba8-ee91-4d99-96ff-96a6de7c2277 req-1bc1debc-d237-4d23-9ec0-06a1a290cd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653ce92f-4a72-47da-a702-73aa770b76bc", "name": "network-vif-deleted", "tag": "d724e79a-8161-4d71-a463-ac224e25a24a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:40.466970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-27886ba8-ee91-4d99-96ff-96a6de7c2277 req-1bc1debc-d237-4d23-9ec0-06a1a290cd19 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:40.473136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-27886ba8-ee91-4d99-96ff-96a6de7c2277 req-1bc1debc-d237-4d23-9ec0-06a1a290cd19 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:40.527489 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-27886ba8-ee91-4d99-96ff-96a6de7c2277 req-1bc1debc-d237-4d23-9ec0-06a1a290cd19 service nova] Creating event network-vif-deleted:d724e79a-8161-4d71-a463-ac224e25a24a for instance 653ce92f-4a72-47da-a702-73aa770b76bc on n-h2-708768-8 Jul 26 19:57:40.541981 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-27886ba8-ee91-4d99-96ff-96a6de7c2277 req-1bc1debc-d237-4d23-9ec0-06a1a290cd19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115185 Jul 26 19:57:40.542665 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1596/3217] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:57:40.557899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fafec104-cc46-49d6-b38b-ae1d6077f94a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Action: 'create', calling method: .version_select at 0x7f87682d9d30>, body: {"keypair": {"name": "tempest-keypair-934864880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp+Ge08U0zLKdJ6X/cP8OOKkdUxipnz7RftwfzIDbRuPJhU+JUGJKOilfDTC6GCAYg48D3uTwXBPtYymmvLyixSLzsU/OYOH8aXTbhKsPjM+4vSq3RSSIqgItt1Owmezg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:40.596140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fafec104-cc46-49d6-b38b-ae1d6077f94a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Getting quotas for project de6c4fcbbcad43f08177ab50a5bd6066. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:57:40.617428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fafec104-cc46-49d6-b38b-ae1d6077f94a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Getting quotas for user da0d6a89b6cd44f1b82bdf1b738b741a and project de6c4fcbbcad43f08177ab50a5bd6066. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:57:40.665867 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fafec104-cc46-49d6-b38b-ae1d6077f94a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.116549 Jul 26 19:57:40.666871 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1597/3218] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 19:57:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 19:57:40.671967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15f3d526-e6e7-4042-b4f7-d5ea639075df tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:40.672706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-15f3d526-e6e7-4042-b4f7-d5ea639075df tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:40.685031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15f3d526-e6e7-4042-b4f7-d5ea639075df tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:40.690433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15f3d526-e6e7-4042-b4f7-d5ea639075df tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:40.691627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15f3d526-e6e7-4042-b4f7-d5ea639075df tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:40.698772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15f3d526-e6e7-4042-b4f7-d5ea639075df tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:40.704692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:40.755235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-605dde26-08d0-4549-b863-e384d17d1994 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:40.769708 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-605dde26-08d0-4549-b863-e384d17d1994 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.572747 Jul 26 19:57:40.771076 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1622/3219] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:40 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:40.888659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-15f3d526-e6e7-4042-b4f7-d5ea639075df tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:40.930800 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15f3d526-e6e7-4042-b4f7-d5ea639075df tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.262705 Jul 26 19:57:40.940190 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1598/3220] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:40 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:41.042530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:41.044203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:41.056780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:41.057605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:41.060161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:41.062743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:41.217177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:41.230103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:41.232745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:41.233980 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a54aaf6d-2ebc-4997-ad80-973e17eed74d tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.195537 Jul 26 19:57:41.234553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1623/3221] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:41 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:41.446800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-518e28e9-8b29-452b-bf86-1360322a9d47 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:41.448083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-518e28e9-8b29-452b-bf86-1360322a9d47 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:41.465508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-518e28e9-8b29-452b-bf86-1360322a9d47 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:41.466859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-518e28e9-8b29-452b-bf86-1360322a9d47 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:41.468426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-518e28e9-8b29-452b-bf86-1360322a9d47 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:41.469123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-518e28e9-8b29-452b-bf86-1360322a9d47 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:41.599099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-518e28e9-8b29-452b-bf86-1360322a9d47 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:41.612402 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-518e28e9-8b29-452b-bf86-1360322a9d47 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1253 microversion: 2.1 time: 0.169486 Jul 26 19:57:41.614550 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1599/3222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:41 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1253 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:41.797097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ccab0a6-43d3-4e12-b000-51212e415b70 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:41.799854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ccab0a6-43d3-4e12-b000-51212e415b70 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:41.810714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ccab0a6-43d3-4e12-b000-51212e415b70 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:41.811567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ccab0a6-43d3-4e12-b000-51212e415b70 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:41.813172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ccab0a6-43d3-4e12-b000-51212e415b70 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:41.813902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ccab0a6-43d3-4e12-b000-51212e415b70 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:41.823368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:41.968432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e508b3f4-50a9-4adc-b66c-4da8f1bd2b92 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:41.969051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e508b3f4-50a9-4adc-b66c-4da8f1bd2b92 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:41.972728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:41.975948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e508b3f4-50a9-4adc-b66c-4da8f1bd2b92 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:41.976681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e508b3f4-50a9-4adc-b66c-4da8f1bd2b92 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:41.977684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e508b3f4-50a9-4adc-b66c-4da8f1bd2b92 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:41.978387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e508b3f4-50a9-4adc-b66c-4da8f1bd2b92 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:42.102374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-e508b3f4-50a9-4adc-b66c-4da8f1bd2b92 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:42.122746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ccab0a6-43d3-4e12-b000-51212e415b70 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:42.151438 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e508b3f4-50a9-4adc-b66c-4da8f1bd2b92 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.186870 Jul 26 19:57:42.158440 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ccab0a6-43d3-4e12-b000-51212e415b70 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.368201 Jul 26 19:57:42.172220 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1624/3223] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:41 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:42.173689 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1600/3224] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:41 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:42.258839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:42.259458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:42.268079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:42.268766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:42.269702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:42.270295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:42.405903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:42.418274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:42.421634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:42.427843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6c89e870-950f-4f06-816d-9abdb1a88e93 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.173192 Jul 26 19:57:42.429030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1625/3225] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:42 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:42.635765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6593169c-d290-420a-ba23-a68ef2b84764 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:42.636676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6593169c-d290-420a-ba23-a68ef2b84764 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:42.650021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6593169c-d290-420a-ba23-a68ef2b84764 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:42.651087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6593169c-d290-420a-ba23-a68ef2b84764 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:42.652242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6593169c-d290-420a-ba23-a68ef2b84764 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:42.661460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6593169c-d290-420a-ba23-a68ef2b84764 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:42.774835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6593169c-d290-420a-ba23-a68ef2b84764 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:42.787224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6593169c-d290-420a-ba23-a68ef2b84764 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1253 microversion: 2.1 time: 0.155870 Jul 26 19:57:42.795575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1166913624", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "024d2383-ebe3-486c-850d-27305bbb09e6"}, {"port": "60776fda-42ee-4ff6-9939-bd5eb8e38a33", "tag": "port-1"}, {"port": "4a2560ce-2348-4752-8688-b4bcf611e22a", "tag": "port-2"}, {"uuid": "86f831bd-9ce5-4887-8e1d-d77497d93f94", "tag": "net-1"}, {"uuid": "86f831bd-9ce5-4887-8e1d-d77497d93f94"}, {"uuid": "cef811c0-feca-47fb-b991-2eb554080cac", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cef811c0-feca-47fb-b991-2eb554080cac", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bc6ffbe0-de32-4be3-a0d2-0df49d185f04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "190026d9-8d0a-4c8e-8757-faa5e00cde51", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5600517f-8c73-4051-bcc4-49ea4b89c7cc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--704831154"}], "key_name": "tempest-keypair-934864880", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:57:42.799914 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1601/3226] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:42 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1253 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:42.919966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] validate_networks() for [('024d2383-ebe3-486c-850d-27305bbb09e6', None, None, None, None, None), (None, None, '60776fda-42ee-4ff6-9939-bd5eb8e38a33', None, None, None), (None, None, '4a2560ce-2348-4752-8688-b4bcf611e22a', None, None, None), ('86f831bd-9ce5-4887-8e1d-d77497d93f94', None, None, None, None, None), ('86f831bd-9ce5-4887-8e1d-d77497d93f94', None, None, None, None, None), ('cef811c0-feca-47fb-b991-2eb554080cac', '10.2.2.100', None, None, None, None), ('cef811c0-feca-47fb-b991-2eb554080cac', '10.2.2.200', None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:57:43.182631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0fce992-17ce-48b7-85c1-dece2a7784ec tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:43.183245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a0fce992-17ce-48b7-85c1-dece2a7784ec tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:43.195007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0fce992-17ce-48b7-85c1-dece2a7784ec tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:43.195460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0fce992-17ce-48b7-85c1-dece2a7784ec tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:43.201371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0fce992-17ce-48b7-85c1-dece2a7784ec tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:43.201822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0fce992-17ce-48b7-85c1-dece2a7784ec tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:43.518169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a0fce992-17ce-48b7-85c1-dece2a7784ec tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:43.527244 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0fce992-17ce-48b7-85c1-dece2a7784ec tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.349693 Jul 26 19:57:43.530011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1602/3227] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:43 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:43.539259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bca4960a-91d6-44ad-8c53-8785de00322e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:43.542208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bca4960a-91d6-44ad-8c53-8785de00322e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:43.560574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bca4960a-91d6-44ad-8c53-8785de00322e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:43.561889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bca4960a-91d6-44ad-8c53-8785de00322e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:43.562883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bca4960a-91d6-44ad-8c53-8785de00322e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:43.563765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bca4960a-91d6-44ad-8c53-8785de00322e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:43.742460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-bca4960a-91d6-44ad-8c53-8785de00322e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:43.791469 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bca4960a-91d6-44ad-8c53-8785de00322e tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.260217 Jul 26 19:57:43.792115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1603/3228] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:43 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:43.808438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:43.809128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:43.823920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:43.824378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:43.825470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:43.826016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:43.966272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:43.976135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:43.980394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:43.981792 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a611a235-1dec-42bc-83fd-9c6cd57b2870 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.188706 Jul 26 19:57:43.982377 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1604/3229] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:43 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:43.988623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bac37efb-eee7-4992-9b6a-9cf647f7ad30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:43.989973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bac37efb-eee7-4992-9b6a-9cf647f7ad30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:43.998961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bac37efb-eee7-4992-9b6a-9cf647f7ad30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:43.999949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bac37efb-eee7-4992-9b6a-9cf647f7ad30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:44.001050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bac37efb-eee7-4992-9b6a-9cf647f7ad30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:44.001629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bac37efb-eee7-4992-9b6a-9cf647f7ad30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:44.151797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bac37efb-eee7-4992-9b6a-9cf647f7ad30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:44.173605 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bac37efb-eee7-4992-9b6a-9cf647f7ad30 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1253 microversion: 2.1 time: 0.190080 Jul 26 19:57:44.174456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1605/3230] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:43 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1253 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:44.564599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-844a0a3d-c245-466a-8bb4-6412ea43f536 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:44.565617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-844a0a3d-c245-466a-8bb4-6412ea43f536 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:44.579806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-844a0a3d-c245-466a-8bb4-6412ea43f536 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:44.580514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-844a0a3d-c245-466a-8bb4-6412ea43f536 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:44.581556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-844a0a3d-c245-466a-8bb4-6412ea43f536 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:44.582277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-844a0a3d-c245-466a-8bb4-6412ea43f536 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:44.917414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-844a0a3d-c245-466a-8bb4-6412ea43f536 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:44.927976 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-844a0a3d-c245-466a-8bb4-6412ea43f536 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.379640 Jul 26 19:57:44.928963 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1606/3231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:44 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:44.933694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d862770f-1177-445a-97b9-11222924406b tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:44.936299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d862770f-1177-445a-97b9-11222924406b tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:44.942774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:44.950881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d862770f-1177-445a-97b9-11222924406b tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:44.951591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d862770f-1177-445a-97b9-11222924406b tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:44.952480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d862770f-1177-445a-97b9-11222924406b tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:44.953228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d862770f-1177-445a-97b9-11222924406b tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:45.065311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-d862770f-1177-445a-97b9-11222924406b tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:45.070701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:45.099147 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d862770f-1177-445a-97b9-11222924406b tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.168808 Jul 26 19:57:45.099935 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1607/3232] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:44 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:45.106329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:45.106952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:45.126988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:45.127729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:45.128685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:45.129294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:45.251892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:45.266188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:45.268057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:45.269301 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b5003a21-822e-4f49-b106-3d76fa498ae1 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1407 microversion: 2.54 time: 0.168410 Jul 26 19:57:45.270222 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1608/3233] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:45 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:45.275513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e4340e22-c7e4-4c0e-8f9b-5c7d2140d873 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:45.276295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e4340e22-c7e4-4c0e-8f9b-5c7d2140d873 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:45.291880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4340e22-c7e4-4c0e-8f9b-5c7d2140d873 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:45.292338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4340e22-c7e4-4c0e-8f9b-5c7d2140d873 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:45.293134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4340e22-c7e4-4c0e-8f9b-5c7d2140d873 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:45.293621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4340e22-c7e4-4c0e-8f9b-5c7d2140d873 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:45.472910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e4340e22-c7e4-4c0e-8f9b-5c7d2140d873 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:45.482112 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e4340e22-c7e4-4c0e-8f9b-5c7d2140d873 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1253 microversion: 2.1 time: 0.210171 Jul 26 19:57:45.486655 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1609/3234] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:45 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1253 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:45.584918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:57:45.585338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:57:45.586155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:57:45.586768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:57:45.587181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:57:45.591568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:45.600016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:45.600731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:45.601690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:45.602294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:45.635187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Getting quotas for project de6c4fcbbcad43f08177ab50a5bd6066. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:57:45.642910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Getting quotas for user da0d6a89b6cd44f1b82bdf1b738b741a and project de6c4fcbbcad43f08177ab50a5bd6066. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:57:45.940421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:57:45.950529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2774622-5c7b-4e46-b5c1-0c440a21a736 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:45.951036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bc6ffbe0-de32-4be3-a0d2-0df49d185f04',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='190026d9-8d0a-4c8e-8757-faa5e00cde51',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5600517f-8c73-4051-bcc4-49ea4b89c7cc',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:57:45.952152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d2774622-5c7b-4e46-b5c1-0c440a21a736 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:45.961145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2774622-5c7b-4e46-b5c1-0c440a21a736 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:45.961852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2774622-5c7b-4e46-b5c1-0c440a21a736 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:45.962807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2774622-5c7b-4e46-b5c1-0c440a21a736 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:45.963413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2774622-5c7b-4e46-b5c1-0c440a21a736 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:46.255875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2774622-5c7b-4e46-b5c1-0c440a21a736 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:46.268765 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2774622-5c7b-4e46-b5c1-0c440a21a736 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.322439 Jul 26 19:57:46.270010 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1610/3235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:45 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:46.275056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73255c5e-2d1d-44b4-be7d-4993674cd904 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:46.275977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73255c5e-2d1d-44b4-be7d-4993674cd904 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:46.283888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73255c5e-2d1d-44b4-be7d-4993674cd904 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:46.284531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73255c5e-2d1d-44b4-be7d-4993674cd904 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:46.285311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73255c5e-2d1d-44b4-be7d-4993674cd904 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:46.285752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73255c5e-2d1d-44b4-be7d-4993674cd904 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:46.385581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-73255c5e-2d1d-44b4-be7d-4993674cd904 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:46.406854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73255c5e-2d1d-44b4-be7d-4993674cd904 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1929 microversion: 2.75 time: 0.135406 Jul 26 19:57:46.407810 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1611/3236] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:46 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1929 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:46.412515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:46.413140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:46.420080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:46.420542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:46.421331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:46.422475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:46.533483 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-00e09ef0-1f3a-49dc-ab56-e760a084338b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 3.741987 Jul 26 19:57:46.535897 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1626/3237] 10.222.0.58 () {62 vars in 1189 bytes} [Tue Jul 26 19:57:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 3744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 19:57:46.540889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2a530ad8-bb0d-4d62-b6ff-010ee4dcb045 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:46.541730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2a530ad8-bb0d-4d62-b6ff-010ee4dcb045 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:46.548973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a530ad8-bb0d-4d62-b6ff-010ee4dcb045 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:46.554372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a530ad8-bb0d-4d62-b6ff-010ee4dcb045 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:46.555560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a530ad8-bb0d-4d62-b6ff-010ee4dcb045 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:46.556222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a530ad8-bb0d-4d62-b6ff-010ee4dcb045 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:46.561979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:46.580070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:46.585181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:46.589938 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e9c7f49-0a44-4c16-aaa9-4ca4003b0193 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1413 microversion: 2.54 time: 0.179066 Jul 26 19:57:46.592601 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1612/3238] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:46 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1413 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:46.609289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-711b3f2e-c329-4e2b-9e8e-f2280ab5823d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:46.610749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-711b3f2e-c329-4e2b-9e8e-f2280ab5823d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:46.651148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2a530ad8-bb0d-4d62-b6ff-010ee4dcb045 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6a30957f45486fa6880e63c44f9107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447b5dd287aa49e8915187d2c75da345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:46.666313 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2a530ad8-bb0d-4d62-b6ff-010ee4dcb045 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 200 len: 1253 microversion: 2.1 time: 0.128384 Jul 26 19:57:46.669626 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1627/3239] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:46 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 1253 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:46.729123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-711b3f2e-c329-4e2b-9e8e-f2280ab5823d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:46.739747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-711b3f2e-c329-4e2b-9e8e-f2280ab5823d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:46.741461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-711b3f2e-c329-4e2b-9e8e-f2280ab5823d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:46.742877 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-711b3f2e-c329-4e2b-9e8e-f2280ab5823d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1285 microversion: 2.32 time: 0.149266 Jul 26 19:57:46.743668 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1613/3240] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:46 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:47.295678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0bbb42e1-1e0c-4fa4-b776-cac44df0d6d1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:47.297614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0bbb42e1-1e0c-4fa4-b776-cac44df0d6d1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:47.307736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bbb42e1-1e0c-4fa4-b776-cac44df0d6d1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:47.308407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bbb42e1-1e0c-4fa4-b776-cac44df0d6d1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:47.309403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bbb42e1-1e0c-4fa4-b776-cac44df0d6d1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:47.310007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bbb42e1-1e0c-4fa4-b776-cac44df0d6d1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:47.439092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-65256c09-1669-4c44-a340-dc6e1f9ea15a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:47.439970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-65256c09-1669-4c44-a340-dc6e1f9ea15a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:47.448880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65256c09-1669-4c44-a340-dc6e1f9ea15a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:47.450270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65256c09-1669-4c44-a340-dc6e1f9ea15a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:47.451319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65256c09-1669-4c44-a340-dc6e1f9ea15a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:47.452029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65256c09-1669-4c44-a340-dc6e1f9ea15a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:47.495524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:47.563545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-65256c09-1669-4c44-a340-dc6e1f9ea15a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:47.607562 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-65256c09-1669-4c44-a340-dc6e1f9ea15a tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1935 microversion: 2.75 time: 0.172623 Jul 26 19:57:47.608521 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1614/3241] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:47 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1935 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:47.618946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:47.622477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:47.630132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:47.631723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:47.633175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:47.634591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:47.750350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:47.760126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:47.762812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:47.764519 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-81e0ac8d-5c83-41b0-9f25-015fa85f69fd tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1413 microversion: 2.54 time: 0.151285 Jul 26 19:57:47.765570 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1615/3242] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:47 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:47.771685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:47.773275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] [instance: 653ce92f-4a72-47da-a702-73aa770b76bc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:47.784907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:47.786358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:47.787407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:47.788088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:47.808452 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] HTTP exception thrown: Instance 653ce92f-4a72-47da-a702-73aa770b76bc could not be found. Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Request method failure captured: Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc HTTP/1.1 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EbAhO0uE_PEeHfpCPBPkhaUlHug48ZqRd8EPEdSsOaxl84Oxa7KBdchqPyiWhXcx_UzTh6iYhDzKcFILHhM50r_xXkgAXbvgroc_mkJ_TF-Rl2n8zDauqVyFlVADKTgWeNj-_NOeF-DzbdcLDtMHd76FQrvdfZYpQvRMtOffhL4fSU Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 447b5dd287aa49e8915187d2c75da345 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestBootFromVolume-1266984116 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/447b5dd287aa49e8915187d2c75da345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/447b5dd287aa49e8915187d2c75da345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_447b5dd287aa49e8915187d2c75da345", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/447b5dd287aa49e8915187d2c75da345"}]}] Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestBootFromVolume-1266984116 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 447b5dd287aa49e8915187d2c75da345 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1266984116 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestBootFromVolume-1266984116-project Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9a6a30957f45486fa6880e63c44f9107 Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestBootFromVolume-1266984116-project Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 653ce92f-4a72-47da-a702-73aa770b76bc could not be found. Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '653ce92f-4a72-47da-a702-73aa770b76bc'} Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 653ce92f-4a72-47da-a702-73aa770b76bc could not be found. Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 653ce92f-4a72-47da-a702-73aa770b76bc could not be found. Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:57:47.813382 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:47.818459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:47.818459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:57:47.818459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:57:47.818459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:57:47.818459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:57:47.818459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 653ce92f-4a72-47da-a702-73aa770b76bc could not be found. Jul 26 19:57:47.818459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:47.822322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Returning 404 to user: Instance 653ce92f-4a72-47da-a702-73aa770b76bc could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:57:47.823567 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0291144b-1818-42b3-b527-8b39e7edb239 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc" status: 404 len: 111 microversion: 2.1 time: 0.056670 Jul 26 19:57:47.828726 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1616/3243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:47 2022] GET /compute/v2.1/servers/653ce92f-4a72-47da-a702-73aa770b76bc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:57:47.836159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8db49826-2713-43e9-bc73-626e1d8978cc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:47.837151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8db49826-2713-43e9-bc73-626e1d8978cc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:47.946902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8db49826-2713-43e9-bc73-626e1d8978cc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:47.957581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8db49826-2713-43e9-bc73-626e1d8978cc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:47.957956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8db49826-2713-43e9-bc73-626e1d8978cc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:47.959138 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8db49826-2713-43e9-bc73-626e1d8978cc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1285 microversion: 2.32 time: 0.128777 Jul 26 19:57:47.971924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1617/3244] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:47 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:47.971924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c9a7a85-f852-4997-9901-9b51395e3932 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] Calling method '.version_select at 0x7f875f06d1f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:48.001520 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c9a7a85-f852-4997-9901-9b51395e3932 tempest-ServersTestBootFromVolume-1266984116 tempest-ServersTestBootFromVolume-1266984116-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047488868" status: 202 len: 0 microversion: 2.1 time: 0.037768 Jul 26 19:57:48.002863 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1618/3245] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 19:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047488868 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:57:48.034311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bbb42e1-1e0c-4fa4-b776-cac44df0d6d1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:48.057351 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0bbb42e1-1e0c-4fa4-b776-cac44df0d6d1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.765824 Jul 26 19:57:48.071798 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1628/3246] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:47 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:48.642854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9faae45e-291f-4d07-9af8-3d1c2920eaf7 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:48.643537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9faae45e-291f-4d07-9af8-3d1c2920eaf7 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:48.660217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9faae45e-291f-4d07-9af8-3d1c2920eaf7 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:48.662172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9faae45e-291f-4d07-9af8-3d1c2920eaf7 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:48.663079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9faae45e-291f-4d07-9af8-3d1c2920eaf7 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:48.663537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9faae45e-291f-4d07-9af8-3d1c2920eaf7 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:48.782806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-9faae45e-291f-4d07-9af8-3d1c2920eaf7 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:48.792710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:48.794763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:48.806408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:48.806853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:48.807652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:48.815397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:48.817893 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9faae45e-291f-4d07-9af8-3d1c2920eaf7 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1935 microversion: 2.75 time: 0.179070 Jul 26 19:57:48.820260 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1619/3247] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:48 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1935 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:48.948097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:48.957726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:48.959171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:48.960375 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-26e46cbc-9d08-4f78-9a45-44277df0dc43 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1398 microversion: 2.54 time: 0.171800 Jul 26 19:57:48.978417 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1629/3248] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:48 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1398 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:48.988581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:48.989207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:48.989909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e6c451f4-b1fe-4766-87cf-7b24664b7c7c tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '.version_select at 0x7f8756ec45e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:49.011176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.011788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.012554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.012998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.036710 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e6c451f4-b1fe-4766-87cf-7b24664b7c7c tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-571347653" status: 204 len: 0 microversion: 2.54 time: 0.049900 Jul 26 19:57:49.040913 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1630/3249] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Jul 26 19:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-571347653 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 19:57:49.057145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-183f3d10-518c-43ad-a16d-b0fba5ef7479 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:49.057855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-183f3d10-518c-43ad-a16d-b0fba5ef7479 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:49.074157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-183f3d10-518c-43ad-a16d-b0fba5ef7479 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.076684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-183f3d10-518c-43ad-a16d-b0fba5ef7479 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.077991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-183f3d10-518c-43ad-a16d-b0fba5ef7479 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.079734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-183f3d10-518c-43ad-a16d-b0fba5ef7479 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.128322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-183f3d10-518c-43ad-a16d-b0fba5ef7479 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:57:49.182570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:49.192923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:49.201063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:49.204517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97e6cdfb-8d3d-48dd-8dad-20d33b1c2c15 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1575 microversion: 2.32 time: 0.223954 Jul 26 19:57:49.205236 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1620/3250] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:48 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:49.214462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-500a0190-8a83-4774-8497-5250443937e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:49.218850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-500a0190-8a83-4774-8497-5250443937e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:49.231959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-500a0190-8a83-4774-8497-5250443937e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.235446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-500a0190-8a83-4774-8497-5250443937e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.236454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-500a0190-8a83-4774-8497-5250443937e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.236906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-500a0190-8a83-4774-8497-5250443937e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.301854 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-183f3d10-518c-43ad-a16d-b0fba5ef7479 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 204 len: 0 microversion: 2.54 time: 0.248570 Jul 26 19:57:49.303054 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1631/3251] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:57:49 2022] DELETE /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:57:49.315446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:49.316193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:49.334178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.334850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.338756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.339290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.461705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:49.481239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:49.487533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:49.488825 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4bba7a62-eebe-4f63-9c2c-00e3093d7b3a tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1404 microversion: 2.54 time: 0.181436 Jul 26 19:57:49.490684 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1632/3252] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:49 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1404 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:49.846360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3fe19312-c51c-4185-aff0-084cf6569984 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:49.847286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3fe19312-c51c-4185-aff0-084cf6569984 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:49.863160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3fe19312-c51c-4185-aff0-084cf6569984 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.863782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3fe19312-c51c-4185-aff0-084cf6569984 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.864674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3fe19312-c51c-4185-aff0-084cf6569984 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:49.867527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3fe19312-c51c-4185-aff0-084cf6569984 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:49.907202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-500a0190-8a83-4774-8497-5250443937e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:49.915785 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-500a0190-8a83-4774-8497-5250443937e2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.707340 Jul 26 19:57:49.930852 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1621/3253] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:49 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:50.038443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-3fe19312-c51c-4185-aff0-084cf6569984 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] Lazy-loading 'services' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:50.077825 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3fe19312-c51c-4185-aff0-084cf6569984 tempest-ServersAdmin275Test-1370095133 tempest-ServersAdmin275Test-1370095133-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1920 microversion: 2.75 time: 0.234931 Jul 26 19:57:50.081369 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1633/3254] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:49 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1920 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:50.130210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-13824ed9-38dd-444a-9755-2f0e2c6239ac tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:50.130979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-13824ed9-38dd-444a-9755-2f0e2c6239ac tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:50.138901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13824ed9-38dd-444a-9755-2f0e2c6239ac tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.139755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13824ed9-38dd-444a-9755-2f0e2c6239ac tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.141000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13824ed9-38dd-444a-9755-2f0e2c6239ac tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.141595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13824ed9-38dd-444a-9755-2f0e2c6239ac tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.194991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-13824ed9-38dd-444a-9755-2f0e2c6239ac tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:57:50.235331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:50.236538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:50.244643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.245557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.246841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.247738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.357459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.368846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.371459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.374183 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d3edb4e3-dc46-4147-a38e-62f6ed503a12 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1593 microversion: 2.32 time: 0.143308 Jul 26 19:57:50.375356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1634/3255] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:50 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1593 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:50.385099 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-13824ed9-38dd-444a-9755-2f0e2c6239ac tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 204 len: 0 microversion: 2.75 time: 0.259098 Jul 26 19:57:50.387925 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1622/3256] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:57:50 2022] DELETE /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:57:50.396249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:50.396882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:50.404861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.405942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.406768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.407219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.482361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.498225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.502191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.509950 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-114117e2-2647-4591-8d3b-bb0246aaf5ed tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1444 microversion: 2.75 time: 0.117555 Jul 26 19:57:50.519117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:50.520445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:50.525116 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1635/3257] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:50 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1444 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:50.530176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.530884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.531920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.532627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.740794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.763059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.765242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:50.767015 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2fd092e-ad8b-44f2-a827-ee956a667876 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1404 microversion: 2.54 time: 0.253442 Jul 26 19:57:50.768387 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1623/3258] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:50 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:50.937857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4bdbbe53-ef79-4dcc-a201-ae6753691717 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:50.939071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4bdbbe53-ef79-4dcc-a201-ae6753691717 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:50.946346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe53-ef79-4dcc-a201-ae6753691717 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.947049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe53-ef79-4dcc-a201-ae6753691717 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:50.948052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe53-ef79-4dcc-a201-ae6753691717 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:50.948657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bdbbe53-ef79-4dcc-a201-ae6753691717 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:51.108602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4bdbbe53-ef79-4dcc-a201-ae6753691717 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:51.117776 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4bdbbe53-ef79-4dcc-a201-ae6753691717 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.184076 Jul 26 19:57:51.118551 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1636/3259] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:50 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:51.398615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:51.399461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:51.412054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:51.412678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:51.413610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:51.415097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:51.540007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:51.540637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:51.551910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:51.552368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:51.553163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:51.553606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:51.557360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:51.583064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:51.584967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:51.595599 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3b296373-858d-4f64-8de6-c51b48c77fdc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1593 microversion: 2.32 time: 0.191746 Jul 26 19:57:51.596525 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1624/3260] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:51 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1593 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:51.738516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:51.772227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:51.780239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:51.797250 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f4c023b-ef36-4e58-9fd9-9fdb27f0c0de tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1444 microversion: 2.75 time: 0.261327 Jul 26 19:57:51.797432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:51.798633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:51.803796 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1637/3261] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:51 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1444 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:51.815503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:51.816405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:51.819558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:51.828828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:51.947449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:51.947751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:51.948392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lazy-loading 'fault' on Instance uuid b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:52.145255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b0feb490-f0b1-4698-9425-81af6b95c507 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:52.146643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b0feb490-f0b1-4698-9425-81af6b95c507 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:52.172030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0feb490-f0b1-4698-9425-81af6b95c507 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:52.180227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0feb490-f0b1-4698-9425-81af6b95c507 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:52.182718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0feb490-f0b1-4698-9425-81af6b95c507 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:52.183293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0feb490-f0b1-4698-9425-81af6b95c507 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:52.264936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:52.273671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:52.284348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c1347c8e0e4464ca3f8a6004857898a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6532de3a377404baf62965d3c14e87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:52.285915 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e3aba4f-8545-4065-8556-fb63f2cc14d4 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 200 len: 1409 microversion: 2.54 time: 0.497986 Jul 26 19:57:52.286692 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1625/3262] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:51 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 1409 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:52.620073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:52.620736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:52.631019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:52.636278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:52.642333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:52.645648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:52.750310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0feb490-f0b1-4698-9425-81af6b95c507 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:52.765508 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b0feb490-f0b1-4698-9425-81af6b95c507 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.627585 Jul 26 19:57:52.769570 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1638/3263] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:52 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:57:52.829291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:52.829987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:52.839216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:52.840940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:52.843671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:52.844238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:52.896923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:52.897662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:52.898320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lazy-loading 'fault' on Instance uuid 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:57:52.959173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:52.977782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:52.982253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7b24d3cdbdc4bba8cc46107bade7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f3bafa5736448da7b9baedbc2d5111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:52.993855 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68e4b37f-3b5f-438a-8678-f468bf93ba7a tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 200 len: 1449 microversion: 2.75 time: 0.168748 Jul 26 19:57:53.008448 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1639/3264] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:52 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 1449 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:53.314983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:53.315710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] [instance: b3ef0bb5-fad3-4ae5-87b2-df830c3798a7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:53.322485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:53.323299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:53.324983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:53.325740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:53.329029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:53.344255 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] HTTP exception thrown: Instance b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 could not be found. Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Request method failure captured: Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 HTTP/1.1 Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EcTQQCqKU-m5fc1yH4nv28wOSTWuw6IIk6hPbrM4ezOlgXj4f2Y-8P9Vjw1d19O708IbRFTNqZSSWxW7F0f9rGg-O7pUVkMl36LGKY64MiCDDcHLr8FgAJRoC_Fclu5a-wff7JL20zq9An1d_7p8nNpScFqoeZaD58kKZDDgzQ6pws Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.54 Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f6532de3a377404baf62965d3c14e87f Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerShowV254Test-1953887004 Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f6532de3a377404baf62965d3c14e87f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6532de3a377404baf62965d3c14e87f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f6532de3a377404baf62965d3c14e87f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f6532de3a377404baf62965d3c14e87f"}]}] Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerShowV254Test-1953887004 Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f6532de3a377404baf62965d3c14e87f Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerShowV254Test-1953887004 Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerShowV254Test-1953887004-project Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 7c1347c8e0e4464ca3f8a6004857898a Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerShowV254Test-1953887004-project Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 could not be found. Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'b3ef0bb5-fad3-4ae5-87b2-df830c3798a7'} Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 could not be found. Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 could not be found. Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:57:53.346612 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:57:53.351121 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:53.351121 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:57:53.351121 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:57:53.351121 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:57:53.351121 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:57:53.351121 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 could not be found. Jul 26 19:57:53.351121 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:57:53.353162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] Returning 404 to user: Instance b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:57:53.354272 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-837bd47b-651b-4c8a-b40c-de95ea2ae260 tempest-ServerShowV254Test-1953887004 tempest-ServerShowV254Test-1953887004-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7" status: 404 len: 111 microversion: 2.54 time: 0.043608 Jul 26 19:57:53.358637 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1640/3265] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:53 2022] GET /compute/v2.1/servers/b3ef0bb5-fad3-4ae5-87b2-df830c3798a7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 19:57:53.546223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:53.560785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:53.562322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:53.563514 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1575c536-50e2-49e3-9c05-080c60323e89 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1660 microversion: 2.32 time: 0.948101 Jul 26 19:57:53.570616 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1626/3266] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:52 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1660 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:57:53.792972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce3188f7-8269-4855-81ed-0f3dbe38760a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:53.793954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ce3188f7-8269-4855-81ed-0f3dbe38760a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:53.806224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce3188f7-8269-4855-81ed-0f3dbe38760a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:53.806684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce3188f7-8269-4855-81ed-0f3dbe38760a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:53.807524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce3188f7-8269-4855-81ed-0f3dbe38760a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:53.814562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce3188f7-8269-4855-81ed-0f3dbe38760a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:54.020285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ce3188f7-8269-4855-81ed-0f3dbe38760a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:54.021861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:54.023002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] [instance: 7b071ee0-02ab-46c8-b3a2-eb409ec041f5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:54.036354 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce3188f7-8269-4855-81ed-0f3dbe38760a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.247623 Jul 26 19:57:54.037582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1641/3267] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:53 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:54.039514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:54.040081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:54.040971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:54.050300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:54.076794 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] HTTP exception thrown: Instance 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 could not be found. Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Request method failure captured: Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 HTTP/1.1 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EbyXcKWkY9tnn4iWFb-lbeXlpZ1vw1M5tt2xHmeIfWZyE5hxOC9ZmhZKmGz92O_aHOVmr9fO7PbIYW7YObhRSVHb1wzWrUioF2B7xDSZYUQEGnljx9GsPLQ0Xy8o3hHsI6sRRUfQy0yz39cyKjxFA0h5GBYDXp_2-_IigHYZe2K1ik Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.75 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 58f3bafa5736448da7b9baedbc2d5111 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersAdmin275Test-1872805036 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58f3bafa5736448da7b9baedbc2d5111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58f3bafa5736448da7b9baedbc2d5111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58f3bafa5736448da7b9baedbc2d5111", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58f3bafa5736448da7b9baedbc2d5111"}]}] Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersAdmin275Test-1872805036 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 58f3bafa5736448da7b9baedbc2d5111 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersAdmin275Test-1872805036 Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersAdmin275Test-1872805036-project Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: d7b24d3cdbdc4bba8cc46107bade7f4a Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersAdmin275Test-1872805036-project Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 could not be found. Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7b071ee0-02ab-46c8-b3a2-eb409ec041f5'} Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 could not be found. Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 could not be found. Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:57:54.080466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:54.084802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:57:54.084802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:57:54.084802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:57:54.084802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:57:54.084802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:57:54.084802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 could not be found. Jul 26 19:57:54.084802 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:57:54.086649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] Returning 404 to user: Instance 7b071ee0-02ab-46c8-b3a2-eb409ec041f5 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:57:54.092317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22030442-7f5b-4106-8652-5c13e50ba632 tempest-ServersAdmin275Test-1872805036 tempest-ServersAdmin275Test-1872805036-project] 10.222.0.58 "GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5" status: 404 len: 111 microversion: 2.75 time: 0.070230 Jul 26 19:57:54.093386 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1627/3268] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:54 2022] GET /compute/v2.1/servers/7b071ee0-02ab-46c8-b3a2-eb409ec041f5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 19:57:54.594438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:54.595405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:54.612402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:54.613140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:54.614396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:54.614991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:55.075110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ce0acbd3-8ddf-480f-9b79-f2052486650a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:55.076006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ce0acbd3-8ddf-480f-9b79-f2052486650a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:55.112889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce0acbd3-8ddf-480f-9b79-f2052486650a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:55.116571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce0acbd3-8ddf-480f-9b79-f2052486650a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:55.135825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce0acbd3-8ddf-480f-9b79-f2052486650a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:55.138932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce0acbd3-8ddf-480f-9b79-f2052486650a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:55.404693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:55.421395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:55.427106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:55.428388 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1130fd8-3ae9-4911-9002-a6443d2e85e5 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1660 microversion: 2.32 time: 0.838990 Jul 26 19:57:55.428956 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1642/3269] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:54 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1660 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:55.546922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ce0acbd3-8ddf-480f-9b79-f2052486650a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:55.566843 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ce0acbd3-8ddf-480f-9b79-f2052486650a tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.508278 Jul 26 19:57:55.567818 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1628/3270] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:55 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:56.454870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:56.455486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:56.482637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:56.486797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:56.489106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:56.489556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:56.490339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:56.490773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:56.607800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7ebce8b7-5869-47f2-a6e5-a69398251122 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:56.612132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7ebce8b7-5869-47f2-a6e5-a69398251122 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:56.637173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ebce8b7-5869-47f2-a6e5-a69398251122 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:56.640575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ebce8b7-5869-47f2-a6e5-a69398251122 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:56.641795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ebce8b7-5869-47f2-a6e5-a69398251122 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:56.642441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ebce8b7-5869-47f2-a6e5-a69398251122 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:57.158061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ebce8b7-5869-47f2-a6e5-a69398251122 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:57.175122 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7ebce8b7-5869-47f2-a6e5-a69398251122 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.584576 Jul 26 19:57:57.177144 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1629/3271] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:56 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:57:57.265065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:57.275093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:57.276840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:57.279123 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9629e06-c2a5-4d49-8cf3-19f1fe36f073 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1752 microversion: 2.32 time: 0.828123 Jul 26 19:57:57.294075 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1643/3272] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:56 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1752 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:57:58.200285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc2d7ec2-f962-40ba-965e-7dad361a7dd2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:58.201247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc2d7ec2-f962-40ba-965e-7dad361a7dd2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:58.210840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:57:58.241828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc2d7ec2-f962-40ba-965e-7dad361a7dd2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:58.244222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc2d7ec2-f962-40ba-965e-7dad361a7dd2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:58.248182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc2d7ec2-f962-40ba-965e-7dad361a7dd2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:58.254829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc2d7ec2-f962-40ba-965e-7dad361a7dd2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:58.312686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:57:58.318469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:57:58.368769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:58.372260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:58.378716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:57:58.381280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:57:59.549167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:59.569604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:59.585722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:57:59.587040 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-744d2b9d-e9c2-47f8-b5af-85ee71a26824 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1798 microversion: 2.32 time: 1.279935 Jul 26 19:57:59.587694 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1644/3273] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:57:58 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1798 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:00.005931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fc2d7ec2-f962-40ba-965e-7dad361a7dd2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:00.015037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc2d7ec2-f962-40ba-965e-7dad361a7dd2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 1.820304 Jul 26 19:58:00.034396 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1630/3274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:57:58 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:00.617951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:00.618588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:00.647778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:00.649651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:00.651573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:00.653538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:01.042933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55e43d82-2746-4942-a106-6bb0b0e433de tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:01.043914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55e43d82-2746-4942-a106-6bb0b0e433de tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:01.060971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55e43d82-2746-4942-a106-6bb0b0e433de tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:01.061952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55e43d82-2746-4942-a106-6bb0b0e433de tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:01.068744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55e43d82-2746-4942-a106-6bb0b0e433de tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:01.071333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55e43d82-2746-4942-a106-6bb0b0e433de tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:01.139499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:01.453398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:01.476739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:01.484961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:01.487380 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-97d04682-2b99-4342-9f01-124a0c488c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1798 microversion: 2.32 time: 0.875701 Jul 26 19:58:01.488439 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1645/3275] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:00 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1798 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:02.376218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55e43d82-2746-4942-a106-6bb0b0e433de tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:02.385492 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55e43d82-2746-4942-a106-6bb0b0e433de tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 1.347869 Jul 26 19:58:02.390851 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1631/3276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:01 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:02.517697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:02.519158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:02.541437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:02.542203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:02.543258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:02.543888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:03.125581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:03.144273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:03.149397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:03.150891 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5bba929-dd42-4331-906b-d253997b17bb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1844 microversion: 2.32 time: 0.638785 Jul 26 19:58:03.155133 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1646/3277] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:02 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1844 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:03.417819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f239c836-a0ce-45d7-ae9f-4167213f5361 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:03.418560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f239c836-a0ce-45d7-ae9f-4167213f5361 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:03.430693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f239c836-a0ce-45d7-ae9f-4167213f5361 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:03.441425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f239c836-a0ce-45d7-ae9f-4167213f5361 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:03.443908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f239c836-a0ce-45d7-ae9f-4167213f5361 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:03.444784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f239c836-a0ce-45d7-ae9f-4167213f5361 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:04.091706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f239c836-a0ce-45d7-ae9f-4167213f5361 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:04.103253 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f239c836-a0ce-45d7-ae9f-4167213f5361 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 0.689384 Jul 26 19:58:04.120775 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1632/3278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:03 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:04.177756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:04.179203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:04.192005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:04.196603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:04.197585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:04.199873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:05.132736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3eeaca0d-af81-4eb4-b626-958b7d17d6b4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:05.133526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3eeaca0d-af81-4eb4-b626-958b7d17d6b4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:05.163084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3eeaca0d-af81-4eb4-b626-958b7d17d6b4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:05.164026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3eeaca0d-af81-4eb4-b626-958b7d17d6b4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:05.169548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3eeaca0d-af81-4eb4-b626-958b7d17d6b4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:05.170364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3eeaca0d-af81-4eb4-b626-958b7d17d6b4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:06.341312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:06.360312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3eeaca0d-af81-4eb4-b626-958b7d17d6b4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:06.385123 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3eeaca0d-af81-4eb4-b626-958b7d17d6b4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 1.257382 Jul 26 19:58:06.393993 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1633/3279] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:05 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:06.421296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:06.425770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:06.427420 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4dec50e-168b-476b-af8f-3f691960be27 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1844 microversion: 2.32 time: 2.253792 Jul 26 19:58:06.428530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1647/3280] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:04 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1844 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:06.468797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a108fe71-d209-4f96-906d-223a6d8ed131 req-eae91d62-836d-4ea4-a0a8-0d7c02f830fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "tag": "bf0697cb-e330-45a1-909c-22998a643533"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:06.500995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a108fe71-d209-4f96-906d-223a6d8ed131 req-eae91d62-836d-4ea4-a0a8-0d7c02f830fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:06.519106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a108fe71-d209-4f96-906d-223a6d8ed131 req-eae91d62-836d-4ea4-a0a8-0d7c02f830fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:06.569427 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a108fe71-d209-4f96-906d-223a6d8ed131 req-eae91d62-836d-4ea4-a0a8-0d7c02f830fe service nova] Creating event network-changed:bf0697cb-e330-45a1-909c-22998a643533 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:58:06.587952 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a108fe71-d209-4f96-906d-223a6d8ed131 req-eae91d62-836d-4ea4-a0a8-0d7c02f830fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160913 Jul 26 19:58:06.593849 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1634/3281] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:07.423760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c9896d1-b5b4-4af2-8971-5c2d8c9c6d2c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:07.424949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c9896d1-b5b4-4af2-8971-5c2d8c9c6d2c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:07.436647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c9896d1-b5b4-4af2-8971-5c2d8c9c6d2c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:07.438705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c9896d1-b5b4-4af2-8971-5c2d8c9c6d2c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:07.440445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c9896d1-b5b4-4af2-8971-5c2d8c9c6d2c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:07.440889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c9896d1-b5b4-4af2-8971-5c2d8c9c6d2c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:07.457934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:07.458649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:07.468348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:07.469506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:07.470318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:07.470937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:07.987171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:07.997581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:08.005633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:08.010345 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1e5773ce-7e88-4bf6-81f2-15e48470983e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1844 microversion: 2.32 time: 0.557163 Jul 26 19:58:08.013286 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1635/3282] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:07 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1844 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:08.507841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9c9896d1-b5b4-4af2-8971-5c2d8c9c6d2c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:08.521731 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c9896d1-b5b4-4af2-8971-5c2d8c9c6d2c tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1476 microversion: 2.1 time: 1.102206 Jul 26 19:58:08.539747 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1648/3283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:07 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1476 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:09.041369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:09.043096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:09.057847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:09.058580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:09.059687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:09.060388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:09.545781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36d599cd-e896-4681-ae9e-c71dcb68e680 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:09.546339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-36d599cd-e896-4681-ae9e-c71dcb68e680 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:09.557087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36d599cd-e896-4681-ae9e-c71dcb68e680 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:09.557898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36d599cd-e896-4681-ae9e-c71dcb68e680 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:09.564380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36d599cd-e896-4681-ae9e-c71dcb68e680 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:09.564938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36d599cd-e896-4681-ae9e-c71dcb68e680 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:10.404178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:10.436770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:10.446817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:10.457337 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5701f945-f16c-406a-941e-05a261f7c6e2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1865 microversion: 2.32 time: 1.420123 Jul 26 19:58:10.475645 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1636/3284] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:09 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1865 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:10.598012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-9b4f96a3-75f0-4265-aa25-2c3ea1b2c983 req-2d3fc08e-1056-4677-8703-f2cb3bcd8a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "tag": "60776fda-42ee-4ff6-9939-bd5eb8e38a33"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:10.611825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:10.644464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9b4f96a3-75f0-4265-aa25-2c3ea1b2c983 req-2d3fc08e-1056-4677-8703-f2cb3bcd8a85 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:10.661472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9b4f96a3-75f0-4265-aa25-2c3ea1b2c983 req-2d3fc08e-1056-4677-8703-f2cb3bcd8a85 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:10.712668 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-9b4f96a3-75f0-4265-aa25-2c3ea1b2c983 req-2d3fc08e-1056-4677-8703-f2cb3bcd8a85 service nova] Creating event network-changed:60776fda-42ee-4ff6-9939-bd5eb8e38a33 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:58:10.731446 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-9b4f96a3-75f0-4265-aa25-2c3ea1b2c983 req-2d3fc08e-1056-4677-8703-f2cb3bcd8a85 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141158 Jul 26 19:58:10.752247 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1637/3285] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:10.816242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-36d599cd-e896-4681-ae9e-c71dcb68e680 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:10.830909 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36d599cd-e896-4681-ae9e-c71dcb68e680 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1475 microversion: 2.1 time: 1.289456 Jul 26 19:58:10.833843 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1649/3286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:09 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1475 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:58:11.500180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:11.502165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:11.518773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d27a9226-21c7-463e-981e-7cde21e538c6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:11.519586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d27a9226-21c7-463e-981e-7cde21e538c6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:11.526696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:11.528447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:11.529703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:11.530308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:11.531106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d27a9226-21c7-463e-981e-7cde21e538c6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:11.531562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d27a9226-21c7-463e-981e-7cde21e538c6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:11.532367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d27a9226-21c7-463e-981e-7cde21e538c6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:11.532805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d27a9226-21c7-463e-981e-7cde21e538c6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:11.585934 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d27a9226-21c7-463e-981e-7cde21e538c6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948/ips" status: 200 len: 149 microversion: 2.1 time: 0.070985 Jul 26 19:58:11.586865 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1650/3287] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 19:58:11 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948/ips => generated 149 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:11.673897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656562b0-62d7-4bc2-b7bc-12751dcaa46f"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:11.681315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:11.699852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:11.700441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:11.703579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:11.704342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:11.920091 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Invalid volume: volume 656562b0-62d7-4bc2-b7bc-12751dcaa46f is already attached to instances: c8827133-9f6e-48f6-9ae4-d4be69370eef Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948/os-volume_attachments HTTP/1.1 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 74 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: {"volumeAttachment": {"volumeId": "656562b0-62d7-4bc2-b7bc-12751dcaa46f"}} Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid volume: volume 656562b0-62d7-4bc2-b7bc-12751dcaa46f is already attached to instances: c8827133-9f6e-48f6-9ae4-d4be69370eef Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'server_id': '6c84435b-ff31-447e-887e-4c244035e948', 'body': {'volumeAttachment': {'volumeId': '656562b0-62d7-4bc2-b7bc-12751dcaa46f'}}} Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 656562b0-62d7-4bc2-b7bc-12751dcaa46f is already attached to instances: c8827133-9f6e-48f6-9ae4-d4be69370eef Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:58:11.922543 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 656562b0-62d7-4bc2-b7bc-12751dcaa46f is already attached to instances: c8827133-9f6e-48f6-9ae4-d4be69370eef Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 656562b0-62d7-4bc2-b7bc-12751dcaa46f is already attached to instances: c8827133-9f6e-48f6-9ae4-d4be69370eef Jul 26 19:58:11.927922 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:11.936028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 400 to user: Invalid volume: volume 656562b0-62d7-4bc2-b7bc-12751dcaa46f is already attached to instances: c8827133-9f6e-48f6-9ae4-d4be69370eef {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:11.940753 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44a4d3e3-3987-4e82-b4e0-85dc3f836c3d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.267248 Jul 26 19:58:11.941700 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1651/3288] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 19:58:11 2022] POST /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948/os-volume_attachments => generated 174 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:58:11.946632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38222c57-c588-4720-9e82-4d31187e4ab8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:11.952518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38222c57-c588-4720-9e82-4d31187e4ab8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:11.970203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38222c57-c588-4720-9e82-4d31187e4ab8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:11.970655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38222c57-c588-4720-9e82-4d31187e4ab8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:11.976598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38222c57-c588-4720-9e82-4d31187e4ab8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:11.977074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38222c57-c588-4720-9e82-4d31187e4ab8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:12.806789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38222c57-c588-4720-9e82-4d31187e4ab8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:12.822706 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38222c57-c588-4720-9e82-4d31187e4ab8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1475 microversion: 2.1 time: 0.879709 Jul 26 19:58:12.835648 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1652/3289] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:11 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1475 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:12.835648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea6b1da6-6cc5-4724-a9b3-a031f90964bc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:12.835648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ea6b1da6-6cc5-4724-a9b3-a031f90964bc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:12.850645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea6b1da6-6cc5-4724-a9b3-a031f90964bc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:12.850945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea6b1da6-6cc5-4724-a9b3-a031f90964bc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:12.851779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea6b1da6-6cc5-4724-a9b3-a031f90964bc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:12.852218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea6b1da6-6cc5-4724-a9b3-a031f90964bc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:12.903458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ea6b1da6-6cc5-4724-a9b3-a031f90964bc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:58:13.068224 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea6b1da6-6cc5-4724-a9b3-a031f90964bc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 204 len: 0 microversion: 2.1 time: 0.242904 Jul 26 19:58:13.068853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1653/3290] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:58:12 2022] DELETE /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:58:13.085144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c30e31f-d747-4890-b1e7-23edfdbdd414 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:13.086120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0c30e31f-d747-4890-b1e7-23edfdbdd414 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:13.097853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c30e31f-d747-4890-b1e7-23edfdbdd414 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:13.099930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c30e31f-d747-4890-b1e7-23edfdbdd414 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:13.102827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c30e31f-d747-4890-b1e7-23edfdbdd414 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:13.103460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c30e31f-d747-4890-b1e7-23edfdbdd414 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:13.978261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0c30e31f-d747-4890-b1e7-23edfdbdd414 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:13.990097 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0c30e31f-d747-4890-b1e7-23edfdbdd414 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1680 microversion: 2.1 time: 0.916260 Jul 26 19:58:13.994517 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1654/3291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:13 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1680 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:14.007283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-be67f393-2277-49fd-95e9-9798f2937fc2 req-99971a7d-b129-4600-9dd2-1c78c116b647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "name": "network-vif-unplugged", "status": "completed", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:14.047986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-be67f393-2277-49fd-95e9-9798f2937fc2 req-99971a7d-b129-4600-9dd2-1c78c116b647 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:14.048428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-be67f393-2277-49fd-95e9-9798f2937fc2 req-99971a7d-b129-4600-9dd2-1c78c116b647 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:14.088884 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-be67f393-2277-49fd-95e9-9798f2937fc2 req-99971a7d-b129-4600-9dd2-1c78c116b647 service nova] Creating event network-vif-unplugged:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h2-708768-8 Jul 26 19:58:14.127175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-be67f393-2277-49fd-95e9-9798f2937fc2 req-99971a7d-b129-4600-9dd2-1c78c116b647 service nova] Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:58:14.168663 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-be67f393-2277-49fd-95e9-9798f2937fc2 req-99971a7d-b129-4600-9dd2-1c78c116b647 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172117 Jul 26 19:58:14.180976 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1655/3292] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:14.195272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f119fc5-ee4f-4744-9610-e21695bb4ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:14.196030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4f119fc5-ee4f-4744-9610-e21695bb4ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:14.207488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f119fc5-ee4f-4744-9610-e21695bb4ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:14.215743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:14.226150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f119fc5-ee4f-4744-9610-e21695bb4ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:14.227066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f119fc5-ee4f-4744-9610-e21695bb4ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:14.227514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f119fc5-ee4f-4744-9610-e21695bb4ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:14.242011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:14.243517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:14.266344 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-40e9b680-1acd-4098-9260-5a2b3aa755d6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1865 microversion: 2.32 time: 2.772192 Jul 26 19:58:14.288559 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1638/3293] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:11 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1865 bytes in 2794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:14.322601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:15.016712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-58ea7328-c6eb-481b-b80f-415a9ffd0a77 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:15.017164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-58ea7328-c6eb-481b-b80f-415a9ffd0a77 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:15.040952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58ea7328-c6eb-481b-b80f-415a9ffd0a77 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:15.049211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58ea7328-c6eb-481b-b80f-415a9ffd0a77 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:15.051902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58ea7328-c6eb-481b-b80f-415a9ffd0a77 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:15.058390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58ea7328-c6eb-481b-b80f-415a9ffd0a77 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:15.514746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4f119fc5-ee4f-4744-9610-e21695bb4ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:15.530020 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f119fc5-ee4f-4744-9610-e21695bb4ac0 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1475 microversion: 2.1 time: 1.341558 Jul 26 19:58:15.530708 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1656/3294] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:14 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1475 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:15.536155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:15.539392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:15.569237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:15.569680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:15.570468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:15.570907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:16.504315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:16.518405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:16.528541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:16.533375 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1cac959c-0560-4f02-a4b9-a071a4ce602d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1886 microversion: 2.32 time: 1.001415 Jul 26 19:58:16.538365 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1657/3295] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:15 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1886 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:16.563321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-52c82fca-b639-4456-97af-93d4e0444197 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:16.584073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-52c82fca-b639-4456-97af-93d4e0444197 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:16.599764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:16.602879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52c82fca-b639-4456-97af-93d4e0444197 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:16.603739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52c82fca-b639-4456-97af-93d4e0444197 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:16.604827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52c82fca-b639-4456-97af-93d4e0444197 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:16.605772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52c82fca-b639-4456-97af-93d4e0444197 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:17.897809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-58ea7328-c6eb-481b-b80f-415a9ffd0a77 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:17.916190 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-58ea7328-c6eb-481b-b80f-415a9ffd0a77 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1680 microversion: 2.1 time: 2.899878 Jul 26 19:58:17.919997 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1639/3296] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:15 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1680 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:58:17.931542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-efc1bfab-13e5-409b-9409-a4a82749acce req-f6838dc2-1606-409a-865a-fa75418d3aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:17.960330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-efc1bfab-13e5-409b-9409-a4a82749acce req-f6838dc2-1606-409a-865a-fa75418d3aab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:17.960771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-efc1bfab-13e5-409b-9409-a4a82749acce req-f6838dc2-1606-409a-865a-fa75418d3aab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:17.997334 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-efc1bfab-13e5-409b-9409-a4a82749acce req-f6838dc2-1606-409a-865a-fa75418d3aab service nova] Creating event network-changed:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h2-708768-8 Jul 26 19:58:18.013635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-efc1bfab-13e5-409b-9409-a4a82749acce req-f6838dc2-1606-409a-865a-fa75418d3aab service nova] Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:58:18.048213 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-efc1bfab-13e5-409b-9409-a4a82749acce req-f6838dc2-1606-409a-865a-fa75418d3aab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126653 Jul 26 19:58:18.049066 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1640/3297] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:18.075768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:18.076995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:18.092826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:18.095304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:18.098857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:18.099429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:18.143324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-52c82fca-b639-4456-97af-93d4e0444197 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:18.151474 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-52c82fca-b639-4456-97af-93d4e0444197 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1475 microversion: 2.1 time: 1.599752 Jul 26 19:58:18.181405 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1658/3298] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:16 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1475 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:18.184928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-abdc6286-d94e-49a8-aa53-1ab14b37e09b req-d8914c66-82be-44cb-9210-36462e7052d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c84435b-ff31-447e-887e-4c244035e948", "name": "network-vif-unplugged", "status": "completed", "tag": "f49d3f37-a8be-492d-8050-52b308ec42bd"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:18.212147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-abdc6286-d94e-49a8-aa53-1ab14b37e09b req-d8914c66-82be-44cb-9210-36462e7052d0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:18.212836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-abdc6286-d94e-49a8-aa53-1ab14b37e09b req-d8914c66-82be-44cb-9210-36462e7052d0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:18.237238 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-abdc6286-d94e-49a8-aa53-1ab14b37e09b req-d8914c66-82be-44cb-9210-36462e7052d0 service nova] Creating event network-vif-unplugged:f49d3f37-a8be-492d-8050-52b308ec42bd for instance 6c84435b-ff31-447e-887e-4c244035e948 on n-h2-708768-8 Jul 26 19:58:18.243152 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-abdc6286-d94e-49a8-aa53-1ab14b37e09b req-d8914c66-82be-44cb-9210-36462e7052d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072395 Jul 26 19:58:18.246888 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1659/3299] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:18.941073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5080ca66-d6b8-4aa9-9e76-2f0d8d2b5aeb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:18.941777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5080ca66-d6b8-4aa9-9e76-2f0d8d2b5aeb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:18.957962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5080ca66-d6b8-4aa9-9e76-2f0d8d2b5aeb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:18.963844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5080ca66-d6b8-4aa9-9e76-2f0d8d2b5aeb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:18.966420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5080ca66-d6b8-4aa9-9e76-2f0d8d2b5aeb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:18.967040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5080ca66-d6b8-4aa9-9e76-2f0d8d2b5aeb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:19.458784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5080ca66-d6b8-4aa9-9e76-2f0d8d2b5aeb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:19.470012 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5080ca66-d6b8-4aa9-9e76-2f0d8d2b5aeb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1680 microversion: 2.1 time: 0.533030 Jul 26 19:58:19.478853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1660/3300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:18 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1680 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:19.921539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c6a59889-a7a2-45a6-b413-ed647a540617 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f8756fbf430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2055884595", "description": "tempest-description-2108858827"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:20.181216 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c6a59889-a7a2-45a6-b413-ed647a540617 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.700776 Jul 26 19:58:20.182570 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1661/3301] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:58:19 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:20.187868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d65e8c11-35f2-4098-b378-87b68836546f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:20.188824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d65e8c11-35f2-4098-b378-87b68836546f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:20.231708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d65e8c11-35f2-4098-b378-87b68836546f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:20.243102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d65e8c11-35f2-4098-b378-87b68836546f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:20.245636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d65e8c11-35f2-4098-b378-87b68836546f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:20.249580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d65e8c11-35f2-4098-b378-87b68836546f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:20.862672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:20.883280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:20.898075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:20.899548 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4431bad-e47e-4f59-a90e-caeb6c9e4386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1886 microversion: 2.32 time: 2.847188 Jul 26 19:58:20.904852 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1641/3302] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:18 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1886 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:20.916975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0c4f5a5-113a-4c25-b30e-7b818f15531c tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f875edc8550>, body: {"security_group_rule": {"parent_group_id": "c251b7b3-431b-4267-af1e-d18150d36d50", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:21.590805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d65e8c11-35f2-4098-b378-87b68836546f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:21.600702 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d65e8c11-35f2-4098-b378-87b68836546f tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1475 microversion: 2.1 time: 1.416561 Jul 26 19:58:21.601292 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1662/3303] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:20 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1475 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:21.901275 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0c4f5a5-113a-4c25-b30e-7b818f15531c tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.995291 Jul 26 19:58:21.909974 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1642/3304] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:58:20 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:21.917768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bce71143-639a-4460-a591-2d2d14c4ec15 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:21.918749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bce71143-639a-4460-a591-2d2d14c4ec15 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:21.938719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bce71143-639a-4460-a591-2d2d14c4ec15 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:21.939440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bce71143-639a-4460-a591-2d2d14c4ec15 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:21.940678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bce71143-639a-4460-a591-2d2d14c4ec15 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:21.945503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bce71143-639a-4460-a591-2d2d14c4ec15 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:22.006457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5d77f156-ebaf-433e-b89a-c66a50368acb req-51ae7c38-8a5f-43e5-8f90-17e7cba8ffd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "tag": "4a2560ce-2348-4752-8688-b4bcf611e22a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:22.041504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5d77f156-ebaf-433e-b89a-c66a50368acb req-51ae7c38-8a5f-43e5-8f90-17e7cba8ffd0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:22.044455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5d77f156-ebaf-433e-b89a-c66a50368acb req-51ae7c38-8a5f-43e5-8f90-17e7cba8ffd0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:22.070611 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5d77f156-ebaf-433e-b89a-c66a50368acb req-51ae7c38-8a5f-43e5-8f90-17e7cba8ffd0 service nova] Creating event network-changed:4a2560ce-2348-4752-8688-b4bcf611e22a for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:58:22.083217 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5d77f156-ebaf-433e-b89a-c66a50368acb req-51ae7c38-8a5f-43e5-8f90-17e7cba8ffd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.476911 Jul 26 19:58:22.084035 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1663/3305] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:22.094982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a05fbc13-14f2-4652-aae4-1069b0387492 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f8757338790>, body: {"security_group_rule": {"parent_group_id": "c251b7b3-431b-4267-af1e-d18150d36d50", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:22.400812 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-a05fbc13-14f2-4652-aae4-1069b0387492 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] HTTP exception thrown: This rule already exists in group c251b7b3-431b-4267-af1e-d18150d36d50 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a05fbc13-14f2-4652-aae4-1069b0387492 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Request method failure captured: Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 138 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EdanAut8I3viPINNdWtmMs_B2nG5syMnEFC-ETvMkwWQ0bBtN1ZcQ1nPiJC9XqHzZPpB7RuQ_bHvuy2Dbabob3OpdKDVP8QQk4iu4V7cjlhc_phG7y9WF9n9FzB4-MYZeOP7NKq4vqsUXaQMvEu-qWyG-qykCFyYkJjT22tqGfv-mk Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca11a6dd77024429b3fadc4cfd7b1bd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}] Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ac05b1a1e1d249849d824bcd15f36772 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: {"security_group_rule": {"parent_group_id": "c251b7b3-431b-4267-af1e-d18150d36d50", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: exception: This rule already exists in group c251b7b3-431b-4267-af1e-d18150d36d50 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c251b7b3-431b-4267-af1e-d18150d36d50', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c251b7b3-431b-4267-af1e-d18150d36d50 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c251b7b3-431b-4267-af1e-d18150d36d50 Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:22.404798 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:22.412711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:22.412711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:22.412711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c251b7b3-431b-4267-af1e-d18150d36d50 Jul 26 19:58:22.412711 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:22.427218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a05fbc13-14f2-4652-aae4-1069b0387492 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Returning 400 to user: This rule already exists in group c251b7b3-431b-4267-af1e-d18150d36d50 {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:22.430651 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a05fbc13-14f2-4652-aae4-1069b0387492 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.345014 Jul 26 19:58:22.435172 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1664/3306] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:58:22 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:58:22.458628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:22.460712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:22.483916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:22.485580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:22.486976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:22.490291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:22.519177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bce71143-639a-4460-a591-2d2d14c4ec15 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:22.531402 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bce71143-639a-4460-a591-2d2d14c4ec15 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1613 microversion: 2.1 time: 0.620273 Jul 26 19:58:22.535686 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1643/3307] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:21 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1613 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:22.546030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-abaef9b3-5383-4446-90fc-ef173c0aad03 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Calling method '.version_select at 0x7f875e9cd160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:23.209366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:23.243534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:23.252044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:23.258479 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a6b0aa45-9726-49b9-a363-66296007f9da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.814645 Jul 26 19:58:23.268356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1665/3308] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:22 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:23.291487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-634a3614-7e93-41f7-9899-ff6d994129e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:23.295905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-634a3614-7e93-41f7-9899-ff6d994129e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:23.319905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-634a3614-7e93-41f7-9899-ff6d994129e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:23.322462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-634a3614-7e93-41f7-9899-ff6d994129e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:23.323324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-634a3614-7e93-41f7-9899-ff6d994129e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:23.324013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-634a3614-7e93-41f7-9899-ff6d994129e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:23.760758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-634a3614-7e93-41f7-9899-ff6d994129e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:23.773097 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-634a3614-7e93-41f7-9899-ff6d994129e8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1470 microversion: 2.1 time: 0.503320 Jul 26 19:58:23.773784 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1666/3309] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:23 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1470 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:23.780269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc4dcc76-e4dd-4799-8919-b177bee7b2bb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:23.781158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fc4dcc76-e4dd-4799-8919-b177bee7b2bb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:23.788040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc4dcc76-e4dd-4799-8919-b177bee7b2bb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:23.789026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc4dcc76-e4dd-4799-8919-b177bee7b2bb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:23.790075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc4dcc76-e4dd-4799-8919-b177bee7b2bb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:23.790591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc4dcc76-e4dd-4799-8919-b177bee7b2bb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:23.914183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fc4dcc76-e4dd-4799-8919-b177bee7b2bb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:23.928521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc4dcc76-e4dd-4799-8919-b177bee7b2bb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1613 microversion: 2.1 time: 0.152641 Jul 26 19:58:23.931041 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1667/3310] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:23 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1613 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:23.939289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5881543b-de06-4a18-815d-324f5b3d3ea4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:23.940152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5881543b-de06-4a18-815d-324f5b3d3ea4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:23.949422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5881543b-de06-4a18-815d-324f5b3d3ea4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:23.950162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5881543b-de06-4a18-815d-324f5b3d3ea4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:23.951297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5881543b-de06-4a18-815d-324f5b3d3ea4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:23.952151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5881543b-de06-4a18-815d-324f5b3d3ea4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:24.175325 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5881543b-de06-4a18-815d-324f5b3d3ea4 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "POST /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9/action" status: 202 len: 0 microversion: 2.1 time: 0.237060 Jul 26 19:58:24.176385 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1668/3311] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:58:23 2022] POST /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:24.192463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e4162ff3-554b-48ed-97d3-ac0e949ef0ad req-604d34aa-4903-4a0c-aecd-02c4fd0a9969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "tag": "e395b810-ac28-4698-a37b-dcec92a493f6"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:24.227661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e4162ff3-554b-48ed-97d3-ac0e949ef0ad req-604d34aa-4903-4a0c-aecd-02c4fd0a9969 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:24.233461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e4162ff3-554b-48ed-97d3-ac0e949ef0ad req-604d34aa-4903-4a0c-aecd-02c4fd0a9969 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:24.263697 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e4162ff3-554b-48ed-97d3-ac0e949ef0ad req-604d34aa-4903-4a0c-aecd-02c4fd0a9969 service nova] Creating event network-changed:e395b810-ac28-4698-a37b-dcec92a493f6 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:58:24.277959 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e4162ff3-554b-48ed-97d3-ac0e949ef0ad req-604d34aa-4903-4a0c-aecd-02c4fd0a9969 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092394 Jul 26 19:58:24.278853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1669/3312] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:58:24.293575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-60d5bd7a-edee-4d14-ac7c-0dc6d480b6a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:24.296588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-60d5bd7a-edee-4d14-ac7c-0dc6d480b6a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:24.311333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60d5bd7a-edee-4d14-ac7c-0dc6d480b6a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:24.316466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60d5bd7a-edee-4d14-ac7c-0dc6d480b6a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:24.319753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60d5bd7a-edee-4d14-ac7c-0dc6d480b6a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:24.322962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60d5bd7a-edee-4d14-ac7c-0dc6d480b6a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:24.582230 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-abaef9b3-5383-4446-90fc-ef173c0aad03 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/1fbca6a6-2b5a-498c-a21f-80b093b3f793" status: 202 len: 0 microversion: 2.1 time: 2.045186 Jul 26 19:58:24.583463 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1644/3313] 10.222.0.58 () {58 vars in 1287 bytes} [Tue Jul 26 19:58:22 2022] DELETE /compute/v2.1/os-security-group-rules/1fbca6a6-2b5a-498c-a21f-80b093b3f793 => generated 0 bytes in 2047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:24.591198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:24.591916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:24.611238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:24.618687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:24.620032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:24.620623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:24.736296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-60d5bd7a-edee-4d14-ac7c-0dc6d480b6a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:24.746004 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-60d5bd7a-edee-4d14-ac7c-0dc6d480b6a1 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.464627 Jul 26 19:58:24.746594 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1670/3314] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:24 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:24.756697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f56ac6a4-4da8-4c0b-8fb1-5d0152b1df6d tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f87573d4940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1656781018", "description": "tempest-description-1978390407"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:25.099135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f56ac6a4-4da8-4c0b-8fb1-5d0152b1df6d tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.346432 Jul 26 19:58:25.100119 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1671/3315] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:58:24 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:25.317745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb88c132-568f-4ea7-8eee-5195f3c50fa4 tempest-PortsAdminExtendedAttrsTestJSON-1716201459 tempest-PortsAdminExtendedAttrsTestJSON-1716201459-project-admin] Calling method '.version_select at 0x7f875713e5e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:25.318751 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 19:58:25.318751 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 19:58:25.320200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb88c132-568f-4ea7-8eee-5195f3c50fa4 tempest-PortsAdminExtendedAttrsTestJSON-1716201459 tempest-PortsAdminExtendedAttrsTestJSON-1716201459-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:25.320920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb88c132-568f-4ea7-8eee-5195f3c50fa4 tempest-PortsAdminExtendedAttrsTestJSON-1716201459 tempest-PortsAdminExtendedAttrsTestJSON-1716201459-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:25.350794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb88c132-568f-4ea7-8eee-5195f3c50fa4 tempest-PortsAdminExtendedAttrsTestJSON-1716201459 tempest-PortsAdminExtendedAttrsTestJSON-1716201459-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:25.351258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb88c132-568f-4ea7-8eee-5195f3c50fa4 tempest-PortsAdminExtendedAttrsTestJSON-1716201459 tempest-PortsAdminExtendedAttrsTestJSON-1716201459-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:25.365935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb88c132-568f-4ea7-8eee-5195f3c50fa4 tempest-PortsAdminExtendedAttrsTestJSON-1716201459 tempest-PortsAdminExtendedAttrsTestJSON-1716201459-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:25.366633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb88c132-568f-4ea7-8eee-5195f3c50fa4 tempest-PortsAdminExtendedAttrsTestJSON-1716201459 tempest-PortsAdminExtendedAttrsTestJSON-1716201459-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:25.374847 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb88c132-568f-4ea7-8eee-5195f3c50fa4 tempest-PortsAdminExtendedAttrsTestJSON-1716201459 tempest-PortsAdminExtendedAttrsTestJSON-1716201459-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.255520 Jul 26 19:58:25.382556 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1672/3316] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:58:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:25.389710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ce4d992-9fcd-441a-923d-8936cfdb2622 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:25.390546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ce4d992-9fcd-441a-923d-8936cfdb2622 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:25.398204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ce4d992-9fcd-441a-923d-8936cfdb2622 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:25.398916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ce4d992-9fcd-441a-923d-8936cfdb2622 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:25.399905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ce4d992-9fcd-441a-923d-8936cfdb2622 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:25.400506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ce4d992-9fcd-441a-923d-8936cfdb2622 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:25.552045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ce4d992-9fcd-441a-923d-8936cfdb2622 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:25.565373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ce4d992-9fcd-441a-923d-8936cfdb2622 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1613 microversion: 2.1 time: 0.178651 Jul 26 19:58:25.567954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1673/3317] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:25 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1613 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:25.584610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d40261b-cd60-4b0c-b262-2a985e24d780 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f87574b3dc0>, body: {"security_group_rule": {"parent_group_id": "8139bcfd-6091-404f-87fe-c667a6d105c0", "ip_protocol": "tcp", "from_port": 1786421982, "to_port": 22}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:25.685119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:25.697697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:25.700799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:25.702599 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a7ad7541-246f-4b04-8990-580a8742a112 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 1.117922 Jul 26 19:58:25.705162 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1645/3318] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:24 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:25.740050 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-8d40261b-cd60-4b0c-b262-2a985e24d780 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] HTTP exception thrown: Invalid port range 1786421982:22. Former value cannot be greater than the later Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d40261b-cd60-4b0c-b262-2a985e24d780 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Request method failure captured: Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 146 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EdanAut8I3viPINNdWtmMs_B2nG5syMnEFC-ETvMkwWQ0bBtN1ZcQ1nPiJC9XqHzZPpB7RuQ_bHvuy2Dbabob3OpdKDVP8QQk4iu4V7cjlhc_phG7y9WF9n9FzB4-MYZeOP7NKq4vqsUXaQMvEu-qWyG-qykCFyYkJjT22tqGfv-mk Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca11a6dd77024429b3fadc4cfd7b1bd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}] Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ac05b1a1e1d249849d824bcd15f36772 Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: {"security_group_rule": {"parent_group_id": "8139bcfd-6091-404f-87fe-c667a6d105c0", "ip_protocol": "tcp", "from_port": 1786421982, "to_port": 22}} Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid port range 1786421982:22. Former value cannot be greater than the later Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8139bcfd-6091-404f-87fe-c667a6d105c0', 'ip_protocol': 'tcp', 'from_port': 1786421982, 'to_port': 22}}} Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1786421982:22. Former value cannot be greater than the later Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1786421982:22. Former value cannot be greater than the later Jul 26 19:58:25.742214 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1786421982:22. Former value cannot be greater than the later Jul 26 19:58:25.746551 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.749163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d40261b-cd60-4b0c-b262-2a985e24d780 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Returning 400 to user: Invalid port range 1786421982:22. Former value cannot be greater than the later {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:25.751487 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d40261b-cd60-4b0c-b262-2a985e24d780 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.182283 Jul 26 19:58:25.755297 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1674/3319] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:58:25 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:58:25.778750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdc8b4f7-d456-42b3-94d1-93e5aee10392 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f875ee59820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1132126420", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:25.783875 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cdc8b4f7-d456-42b3-94d1-93e5aee10392 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] HTTP exception thrown: Security group id should be uuid Jul 26 19:58:25.784196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca1cfbef-712f-4504-825c-6c1abb978861 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:25.786059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca1cfbef-712f-4504-825c-6c1abb978861 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdc8b4f7-d456-42b3-94d1-93e5aee10392 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Request method failure captured: Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 131 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EdanAut8I3viPINNdWtmMs_B2nG5syMnEFC-ETvMkwWQ0bBtN1ZcQ1nPiJC9XqHzZPpB7RuQ_bHvuy2Dbabob3OpdKDVP8QQk4iu4V7cjlhc_phG7y9WF9n9FzB4-MYZeOP7NKq4vqsUXaQMvEu-qWyG-qykCFyYkJjT22tqGfv-mk Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca11a6dd77024429b3fadc4cfd7b1bd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}] Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ac05b1a1e1d249849d824bcd15f36772 Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1132126420", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group id should be uuid Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1132126420', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:25.790545 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:25.795036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 26 19:58:25.795036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:25.795036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdc8b4f7-d456-42b3-94d1-93e5aee10392 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Returning 400 to user: Security group id should be uuid {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:25.795036 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cdc8b4f7-d456-42b3-94d1-93e5aee10392 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028966 Jul 26 19:58:25.795476 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1646/3320] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:58:25 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:58:25.808877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbef-712f-4504-825c-6c1abb978861 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:25.809664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbef-712f-4504-825c-6c1abb978861 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:25.810958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbef-712f-4504-825c-6c1abb978861 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:25.812195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca1cfbef-712f-4504-825c-6c1abb978861 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:25.820853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f201f4e7-fa6d-4b06-b1fe-433103b4f3ca tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f875eff4040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1041106234", "description": "tempest-description-1620283095"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:26.585109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca1cfbef-712f-4504-825c-6c1abb978861 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:26.594299 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca1cfbef-712f-4504-825c-6c1abb978861 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.823458 Jul 26 19:58:26.599349 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1675/3321] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:25 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:26.608478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5fba4e9-cab4-417c-ab78-fda93d213ddc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:26.612510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f5fba4e9-cab4-417c-ab78-fda93d213ddc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:26.624941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5fba4e9-cab4-417c-ab78-fda93d213ddc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:26.625815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5fba4e9-cab4-417c-ab78-fda93d213ddc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:26.627034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5fba4e9-cab4-417c-ab78-fda93d213ddc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:26.627659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5fba4e9-cab4-417c-ab78-fda93d213ddc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:26.760287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f5fba4e9-cab4-417c-ab78-fda93d213ddc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:26.769069 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5fba4e9-cab4-417c-ab78-fda93d213ddc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 200 len: 1613 microversion: 2.1 time: 0.168337 Jul 26 19:58:26.770029 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1676/3322] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:26 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 1613 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:26.777066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:26.778258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:26.797008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:26.797904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:26.799538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:26.800263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:26.813181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:27.167880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:27.200543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:27.206596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:27.207912 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cdc47377-bd4b-4e4a-a03d-9de8e2245156 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.436668 Jul 26 19:58:27.211742 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1677/3323] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:26 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:27.229030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-804623f3-b51b-4fa2-bcee-5136db665e0f req-8ec23395-5614-4312-b121-b2a6fe221c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c84435b-ff31-447e-887e-4c244035e948", "name": "network-vif-deleted", "tag": "f49d3f37-a8be-492d-8050-52b308ec42bd"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:27.269830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-804623f3-b51b-4fa2-bcee-5136db665e0f req-8ec23395-5614-4312-b121-b2a6fe221c9e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:27.270275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-804623f3-b51b-4fa2-bcee-5136db665e0f req-8ec23395-5614-4312-b121-b2a6fe221c9e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:27.308193 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-804623f3-b51b-4fa2-bcee-5136db665e0f req-8ec23395-5614-4312-b121-b2a6fe221c9e service nova] Creating event network-vif-deleted:f49d3f37-a8be-492d-8050-52b308ec42bd for instance 6c84435b-ff31-447e-887e-4c244035e948 on n-h2-708768-8 Jul 26 19:58:27.317428 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-804623f3-b51b-4fa2-bcee-5136db665e0f req-8ec23395-5614-4312-b121-b2a6fe221c9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104193 Jul 26 19:58:27.319048 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1678/3324] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:27.510818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f201f4e7-fa6d-4b06-b1fe-433103b4f3ca tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.699666 Jul 26 19:58:27.512365 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1647/3325] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:58:25 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:27.526055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a22cd08d-c990-4b59-a82f-5bedf4701da9 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f8756fa7670>, body: {"security_group_rule": {"parent_group_id": "eb1848c5-3efa-49f4-934e-8fe3db6f4495", "ip_protocol": "tempest-999-1055572237", "from_port": 22, "to_port": 22}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:27.622919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2b00070-fc12-49d9-8485-fd4c9ccd79f5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:27.623538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e2b00070-fc12-49d9-8485-fd4c9ccd79f5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:27.630303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2b00070-fc12-49d9-8485-fd4c9ccd79f5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:27.630746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2b00070-fc12-49d9-8485-fd4c9ccd79f5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:27.643428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2b00070-fc12-49d9-8485-fd4c9ccd79f5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:27.643951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2b00070-fc12-49d9-8485-fd4c9ccd79f5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:27.733313 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-a22cd08d-c990-4b59-a82f-5bedf4701da9 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] HTTP exception thrown: Invalid IP protocol tempest-999-1055572237. Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a22cd08d-c990-4b59-a82f-5bedf4701da9 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Request method failure captured: Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 157 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EdanAut8I3viPINNdWtmMs_B2nG5syMnEFC-ETvMkwWQ0bBtN1ZcQ1nPiJC9XqHzZPpB7RuQ_bHvuy2Dbabob3OpdKDVP8QQk4iu4V7cjlhc_phG7y9WF9n9FzB4-MYZeOP7NKq4vqsUXaQMvEu-qWyG-qykCFyYkJjT22tqGfv-mk Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca11a6dd77024429b3fadc4cfd7b1bd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}] Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ac05b1a1e1d249849d824bcd15f36772 Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: {"security_group_rule": {"parent_group_id": "eb1848c5-3efa-49f4-934e-8fe3db6f4495", "ip_protocol": "tempest-999-1055572237", "from_port": 22, "to_port": 22}} Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid IP protocol tempest-999-1055572237. Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'eb1848c5-3efa-49f4-934e-8fe3db6f4495', 'ip_protocol': 'tempest-999-1055572237', 'from_port': 22, 'to_port': 22}}} Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1055572237. Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1055572237. Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:27.735523 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1055572237. Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a22cd08d-c990-4b59-a82f-5bedf4701da9 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Returning 400 to user: Invalid IP protocol tempest-999-1055572237. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a22cd08d-c990-4b59-a82f-5bedf4701da9 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.216287 Jul 26 19:58:27.748418 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1679/3326] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:58:27 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 19:58:27.750672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-97c4b3af-3f3c-4aa0-953e-8b9ee12c445f tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f8756f51a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-862099343", "description": "tempest-description-571770603"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:28.131340 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-97c4b3af-3f3c-4aa0-953e-8b9ee12c445f tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.387846 Jul 26 19:58:28.145704 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1680/3327] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:58:27 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:28.174067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:28.181705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:28.194617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:28.196200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:28.199505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:28.200271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:28.301857 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 HTTP/1.1 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '6c84435b-ff31-447e-887e-4c244035e948'} Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:28.329845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.337000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:28.337000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:28.337000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:28.337000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:28.337000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:28.337000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 19:58:28.337000 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.346605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:28.348295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f7d3c3aa-59ad-467e-8209-89e8da0c7707 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 404 len: 111 microversion: 2.1 time: 0.200101 Jul 26 19:58:28.351673 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1681/3328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:28 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:58:28.357907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-84b08c48-e1d2-4558-a454-c7c8e4c7672c tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f875710cca0>, body: {"security_group_rule": {"parent_group_id": "28a24381-8bde-442c-99dd-7b3e18153176", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:28.421792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e2b00070-fc12-49d9-8485-fd4c9ccd79f5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:28.443258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e2b00070-fc12-49d9-8485-fd4c9ccd79f5 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.825174 Jul 26 19:58:28.447575 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1648/3329] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:27 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:28.462695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f5d79843-9e42-4aeb-9483-b196d1a1ddf0 req-0c58db06-a0f9-46f4-815a-bb89eccff648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "name": "network-vif-plugged", "status": "completed", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:28.481998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f5d79843-9e42-4aeb-9483-b196d1a1ddf0 req-0c58db06-a0f9-46f4-815a-bb89eccff648 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:28.483579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f5d79843-9e42-4aeb-9483-b196d1a1ddf0 req-0c58db06-a0f9-46f4-815a-bb89eccff648 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:28.496568 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-84b08c48-e1d2-4558-a454-c7c8e4c7672c tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-84b08c48-e1d2-4558-a454-c7c8e4c7672c tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Request method failure captured: Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 138 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EdanAut8I3viPINNdWtmMs_B2nG5syMnEFC-ETvMkwWQ0bBtN1ZcQ1nPiJC9XqHzZPpB7RuQ_bHvuy2Dbabob3OpdKDVP8QQk4iu4V7cjlhc_phG7y9WF9n9FzB4-MYZeOP7NKq4vqsUXaQMvEu-qWyG-qykCFyYkJjT22tqGfv-mk Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca11a6dd77024429b3fadc4cfd7b1bd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}] Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ac05b1a1e1d249849d824bcd15f36772 Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: {"security_group_rule": {"parent_group_id": "28a24381-8bde-442c-99dd-7b3e18153176", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'security_group_rule': {'parent_group_id': '28a24381-8bde-442c-99dd-7b3e18153176', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 19:58:28.498492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 19:58:28.502562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:28.508349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-84b08c48-e1d2-4558-a454-c7c8e4c7672c tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:28.510370 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-84b08c48-e1d2-4558-a454-c7c8e4c7672c tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.157171 Jul 26 19:58:28.513126 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f5d79843-9e42-4aeb-9483-b196d1a1ddf0 req-0c58db06-a0f9-46f4-815a-bb89eccff648 service nova] Creating event network-vif-plugged:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h2-708768-8 Jul 26 19:58:28.520465 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1682/3330] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:58:28 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:58:28.527749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:28.528741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:28.531193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-f5d79843-9e42-4aeb-9483-b196d1a1ddf0 req-0c58db06-a0f9-46f4-815a-bb89eccff648 service nova] Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:58:28.539400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:28.540084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:28.541682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:28.543230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:28.575177 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f5d79843-9e42-4aeb-9483-b196d1a1ddf0 req-0c58db06-a0f9-46f4-815a-bb89eccff648 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123378 Jul 26 19:58:28.576153 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1649/3331] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:28.590646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eedbd1c9-843d-421f-8d03-ddaefa62f616 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '.version_select at 0x7f875e9cd160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:28.629885 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eedbd1c9-843d-421f-8d03-ddaefa62f616 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408550919" status: 202 len: 0 microversion: 2.1 time: 0.052424 Jul 26 19:58:28.631327 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1650/3332] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 19:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408550919 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:28.651642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0114a1c4-7f71-447f-923a-4b5c76b8c2ee tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f875f13d160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1896350435", "description": "tempest-description-504310237"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:29.066097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:29.088898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:29.096875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:29.101077 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-812335ff-89fe-4ba6-b387-7e8d7d433965 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.579229 Jul 26 19:58:29.111430 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1683/3333] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:28 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:29.358208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bdd71dd5-fe50-4c1f-ae22-678fb08a7222 req-df8e132a-62a4-4442-82ca-d84722a637fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "tag": "6ad30944-b73a-4ace-827b-888b0b01a8ea"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:29.384133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bdd71dd5-fe50-4c1f-ae22-678fb08a7222 req-df8e132a-62a4-4442-82ca-d84722a637fd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:29.384628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bdd71dd5-fe50-4c1f-ae22-678fb08a7222 req-df8e132a-62a4-4442-82ca-d84722a637fd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:29.414093 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bdd71dd5-fe50-4c1f-ae22-678fb08a7222 req-df8e132a-62a4-4442-82ca-d84722a637fd service nova] Creating event network-changed:6ad30944-b73a-4ace-827b-888b0b01a8ea for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:58:29.421616 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bdd71dd5-fe50-4c1f-ae22-678fb08a7222 req-df8e132a-62a4-4442-82ca-d84722a637fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067853 Jul 26 19:58:29.427513 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1684/3334] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:58:29.467133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5694b1d7-ef1f-42cb-a6b6-1a78e0d0b6c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:29.467986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5694b1d7-ef1f-42cb-a6b6-1a78e0d0b6c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:29.474586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5694b1d7-ef1f-42cb-a6b6-1a78e0d0b6c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:29.475141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5694b1d7-ef1f-42cb-a6b6-1a78e0d0b6c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:29.476036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5694b1d7-ef1f-42cb-a6b6-1a78e0d0b6c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:29.476709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5694b1d7-ef1f-42cb-a6b6-1a78e0d0b6c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:29.631216 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0114a1c4-7f71-447f-923a-4b5c76b8c2ee tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.998425 Jul 26 19:58:29.639957 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1651/3335] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:58:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:29.645088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87b9b7dd-9b22-4aa8-8a2f-6158b3a28026 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f875e3b1550>, body: {"security_group_rule": {"parent_group_id": "6674d8cd-f161-4b66-8838-4aa405200348", "ip_protocol": "tcp", "from_port": 22, "to_port": 1177105949}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:30.053859 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-87b9b7dd-9b22-4aa8-8a2f-6158b3a28026 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] HTTP exception thrown: Invalid port range 22:1177105949. Valid TCP ports should be between 1-65535 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87b9b7dd-9b22-4aa8-8a2f-6158b3a28026 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Request method failure captured: Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 146 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EdanAut8I3viPINNdWtmMs_B2nG5syMnEFC-ETvMkwWQ0bBtN1ZcQ1nPiJC9XqHzZPpB7RuQ_bHvuy2Dbabob3OpdKDVP8QQk4iu4V7cjlhc_phG7y9WF9n9FzB4-MYZeOP7NKq4vqsUXaQMvEu-qWyG-qykCFyYkJjT22tqGfv-mk Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca11a6dd77024429b3fadc4cfd7b1bd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}] Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ac05b1a1e1d249849d824bcd15f36772 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: {"security_group_rule": {"parent_group_id": "6674d8cd-f161-4b66-8838-4aa405200348", "ip_protocol": "tcp", "from_port": 22, "to_port": 1177105949}} Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid port range 22:1177105949. Valid TCP ports should be between 1-65535 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6674d8cd-f161-4b66-8838-4aa405200348', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1177105949}}} Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1177105949. Valid TCP ports should be between 1-65535 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1177105949. Valid TCP ports should be between 1-65535 Jul 26 19:58:30.057199 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1177105949. Valid TCP ports should be between 1-65535 Jul 26 19:58:30.064098 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.068919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87b9b7dd-9b22-4aa8-8a2f-6158b3a28026 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Returning 400 to user: Invalid port range 22:1177105949. Valid TCP ports should be between 1-65535 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:30.069388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5694b1d7-ef1f-42cb-a6b6-1a78e0d0b6c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:30.072662 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87b9b7dd-9b22-4aa8-8a2f-6158b3a28026 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.430297 Jul 26 19:58:30.075099 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1652/3336] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:58:29 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 434 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:58:30.084457 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5694b1d7-ef1f-42cb-a6b6-1a78e0d0b6c3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.621785 Jul 26 19:58:30.085044 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1685/3337] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:29 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:30.105146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-79167f58-9287-42c8-9768-bfa7b0fb3f1a tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Action: 'create', calling method: .version_select at 0x7f875edd0040>, body: {"security_group_rule": {"parent_group_id": "ff3bd9a5-d5a3-405a-bfce-eda8a88872fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:30.127434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:30.128145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:30.136102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:30.136574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:30.137356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:30.138396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:30.205962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-79167f58-9287-42c8-9768-bfa7b0fb3f1a tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:58:30.206566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-79167f58-9287-42c8-9768-bfa7b0fb3f1a tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Neutron security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa not found {{(pid=125963) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:58:30.207473 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-79167f58-9287-42c8-9768-bfa7b0fb3f1a tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] HTTP exception thrown: Security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa does not exist Jul 26 19:58:30.207473 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-26320797-7eaf-4995-b1d2-5dc94c9dccb1'] Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-79167f58-9287-42c8-9768-bfa7b0fb3f1a tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Request method failure captured: Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 138 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EdanAut8I3viPINNdWtmMs_B2nG5syMnEFC-ETvMkwWQ0bBtN1ZcQ1nPiJC9XqHzZPpB7RuQ_bHvuy2Dbabob3OpdKDVP8QQk4iu4V7cjlhc_phG7y9WF9n9FzB4-MYZeOP7NKq4vqsUXaQMvEu-qWyG-qykCFyYkJjT22tqGfv-mk Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca11a6dd77024429b3fadc4cfd7b1bd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}] Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ac05b1a1e1d249849d824bcd15f36772 Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: {"security_group_rule": {"parent_group_id": "ff3bd9a5-d5a3-405a-bfce-eda8a88872fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa does not exist Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-26320797-7eaf-4995-b1d2-5dc94c9dccb1'] Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ff3bd9a5-d5a3-405a-bfce-eda8a88872fa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:58:30.211103 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa does not exist Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26320797-7eaf-4995-b1d2-5dc94c9dccb1'] Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa does not exist Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26320797-7eaf-4995-b1d2-5dc94c9dccb1'] Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa does not exist Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26320797-7eaf-4995-b1d2-5dc94c9dccb1'] Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa does not exist Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26320797-7eaf-4995-b1d2-5dc94c9dccb1'] Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-79167f58-9287-42c8-9768-bfa7b0fb3f1a tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Returning 404 to user: Security group ff3bd9a5-d5a3-405a-bfce-eda8a88872fa does not exist Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-26320797-7eaf-4995-b1d2-5dc94c9dccb1'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-79167f58-9287-42c8-9768-bfa7b0fb3f1a tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.131133 Jul 26 19:58:30.217542 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1653/3338] 10.222.0.58 () {60 vars in 1195 bytes} [Tue Jul 26 19:58:30 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:58:30.223849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d5adb340-ced2-473c-9d29-5ea7fd27bde6 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Calling method '.version_select at 0x7f875ee493a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:30.373906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-d5adb340-ced2-473c-9d29-5ea7fd27bde6 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:58:30.374506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-d5adb340-ced2-473c-9d29-5ea7fd27bde6 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Neutron security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 not found {{(pid=125963) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 26 19:58:30.375024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d5adb340-ced2-473c-9d29-5ea7fd27bde6 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] HTTP exception thrown: Security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 does not exist Jul 26 19:58:30.375024 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-4195993b-3591-48b7-a8c6-1f01fedda793'] Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d5adb340-ced2-473c-9d29-5ea7fd27bde6 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Request method failure captured: Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-security-group-rules/ca8139d6-caeb-47bf-a956-17a8590b1b56 HTTP/1.1 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EdanAut8I3viPINNdWtmMs_B2nG5syMnEFC-ETvMkwWQ0bBtN1ZcQ1nPiJC9XqHzZPpB7RuQ_bHvuy2Dbabob3OpdKDVP8QQk4iu4V7cjlhc_phG7y9WF9n9FzB4-MYZeOP7NKq4vqsUXaQMvEu-qWyG-qykCFyYkJjT22tqGfv-mk Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca11a6dd77024429b3fadc4cfd7b1bd6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca11a6dd77024429b3fadc4cfd7b1bd6"}]}] Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: ca11a6dd77024429b3fadc4cfd7b1bd6 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ac05b1a1e1d249849d824bcd15f36772 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-541104536-project Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 does not exist Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-4195993b-3591-48b7-a8c6-1f01fedda793'] Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ca8139d6-caeb-47bf-a956-17a8590b1b56'} Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:58:30.376916 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 does not exist Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4195993b-3591-48b7-a8c6-1f01fedda793'] Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 does not exist Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4195993b-3591-48b7-a8c6-1f01fedda793'] Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 does not exist Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4195993b-3591-48b7-a8c6-1f01fedda793'] Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 does not exist Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4195993b-3591-48b7-a8c6-1f01fedda793'] Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d5adb340-ced2-473c-9d29-5ea7fd27bde6 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Returning 404 to user: Security group rule ca8139d6-caeb-47bf-a956-17a8590b1b56 does not exist Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-4195993b-3591-48b7-a8c6-1f01fedda793'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d5adb340-ced2-473c-9d29-5ea7fd27bde6 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/ca8139d6-caeb-47bf-a956-17a8590b1b56" status: 404 len: 199 microversion: 2.1 time: 0.158341 Jul 26 19:58:30.383693 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1654/3339] 10.222.0.58 () {58 vars in 1287 bytes} [Tue Jul 26 19:58:30 2022] DELETE /compute/v2.1/os-security-group-rules/ca8139d6-caeb-47bf-a956-17a8590b1b56 => generated 199 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:58:30.389184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe6a3f4e-577f-4c62-837b-d5d31d4915ad tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Calling method '.version_select at 0x7f875edd0430>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:30.888944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:30.905787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:30.909927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:30.913206 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-185f0c87-9f9c-4817-82be-dcf51a277ca8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.789685 Jul 26 19:58:30.917584 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1686/3340] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:30 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:58:31.107638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fba6cad5-b0f5-4141-a179-354a571e5bcc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:31.108236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fba6cad5-b0f5-4141-a179-354a571e5bcc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:31.115063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fba6cad5-b0f5-4141-a179-354a571e5bcc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:31.115513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fba6cad5-b0f5-4141-a179-354a571e5bcc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:31.116360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fba6cad5-b0f5-4141-a179-354a571e5bcc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:31.131748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fba6cad5-b0f5-4141-a179-354a571e5bcc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:31.364651 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe6a3f4e-577f-4c62-837b-d5d31d4915ad tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/6674d8cd-f161-4b66-8838-4aa405200348" status: 202 len: 0 microversion: 2.1 time: 0.979460 Jul 26 19:58:31.365835 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1655/3341] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:58:30 2022] DELETE /compute/v2.1/os-security-groups/6674d8cd-f161-4b66-8838-4aa405200348 => generated 0 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:31.371704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d37d8449-e534-447d-8740-479641bb930a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:31.372580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d37d8449-e534-447d-8740-479641bb930a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:31.380988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d37d8449-e534-447d-8740-479641bb930a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:31.381656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d37d8449-e534-447d-8740-479641bb930a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:31.382624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d37d8449-e534-447d-8740-479641bb930a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:31.383226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d37d8449-e534-447d-8740-479641bb930a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:31.388739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=75 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:31.524750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-d37d8449-e534-447d-8740-479641bb930a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lazy-loading 'services' on Instance uuid c8827133-9f6e-48f6-9ae4-d4be69370eef {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:58:31.643968 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d37d8449-e534-447d-8740-479641bb930a tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments/656562b0-62d7-4bc2-b7bc-12751dcaa46f" status: 202 len: 0 microversion: 2.1 time: 0.276441 Jul 26 19:58:31.644888 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1656/3342] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 19:58:31 2022] DELETE /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments/656562b0-62d7-4bc2-b7bc-12751dcaa46f => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:31.663666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dc9e261d-624a-404f-90b4-44b9dfd9b00b tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Calling method '.version_select at 0x7f875ed34670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:32.057028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fba6cad5-b0f5-4141-a179-354a571e5bcc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:32.080442 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fba6cad5-b0f5-4141-a179-354a571e5bcc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.977366 Jul 26 19:58:32.095336 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1687/3343] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:31 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:58:32.095336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9b9edaa0-2641-4587-b05c-2b3cd35e5e18 req-d15b9b9f-8df3-4af6-9147-85372384871f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "tag": "416b5295-1a24-4ec5-b91d-06450d8eb3c8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:32.096394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9b9edaa0-2641-4587-b05c-2b3cd35e5e18 req-d15b9b9f-8df3-4af6-9147-85372384871f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:32.096845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9b9edaa0-2641-4587-b05c-2b3cd35e5e18 req-d15b9b9f-8df3-4af6-9147-85372384871f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:32.128537 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9b9edaa0-2641-4587-b05c-2b3cd35e5e18 req-d15b9b9f-8df3-4af6-9147-85372384871f service nova] Creating event network-changed:416b5295-1a24-4ec5-b91d-06450d8eb3c8 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:58:32.137549 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9b9edaa0-2641-4587-b05c-2b3cd35e5e18 req-d15b9b9f-8df3-4af6-9147-85372384871f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054615 Jul 26 19:58:32.138841 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1688/3344] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:32.144379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd6a19b3-f7a4-4be2-ae61-075e3b6ab762 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:32.156643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd6a19b3-f7a4-4be2-ae61-075e3b6ab762 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:32.165400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd6a19b3-f7a4-4be2-ae61-075e3b6ab762 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:32.166139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd6a19b3-f7a4-4be2-ae61-075e3b6ab762 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:32.172847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd6a19b3-f7a4-4be2-ae61-075e3b6ab762 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:32.173597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd6a19b3-f7a4-4be2-ae61-075e3b6ab762 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:32.282407 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd6a19b3-f7a4-4be2-ae61-075e3b6ab762 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116585 Jul 26 19:58:32.289492 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1689/3345] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:58:32 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:32.312890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:32.317513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:32.346441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:32.346910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:32.351746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:32.356654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:33.487252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dc9e261d-624a-404f-90b4-44b9dfd9b00b tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/28a24381-8bde-442c-99dd-7b3e18153176" status: 202 len: 0 microversion: 2.1 time: 1.840391 Jul 26 19:58:33.490810 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1657/3346] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:58:31 2022] DELETE /compute/v2.1/os-security-groups/28a24381-8bde-442c-99dd-7b3e18153176 => generated 0 bytes in 1842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:33.493319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-50cc9b28-938f-4c61-ab45-28d934e37c5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:33.494121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-50cc9b28-938f-4c61-ab45-28d934e37c5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:33.525220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50cc9b28-938f-4c61-ab45-28d934e37c5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:33.525611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50cc9b28-938f-4c61-ab45-28d934e37c5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:33.527685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50cc9b28-938f-4c61-ab45-28d934e37c5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:33.527685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50cc9b28-938f-4c61-ab45-28d934e37c5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:33.822369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:33.839414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:33.846080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:33.848129 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03faaf1f-ed08-4d7f-85cd-55811ae76c65 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 1.557601 Jul 26 19:58:33.851374 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1690/3347] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:32 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:33.882546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89d5c4cf-983f-43b4-9226-1414aa9aff41 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:33.884780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89d5c4cf-983f-43b4-9226-1414aa9aff41 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:33.900831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89d5c4cf-983f-43b4-9226-1414aa9aff41 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:33.902730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89d5c4cf-983f-43b4-9226-1414aa9aff41 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:33.906714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89d5c4cf-983f-43b4-9226-1414aa9aff41 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:33.907171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89d5c4cf-983f-43b4-9226-1414aa9aff41 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:33.997731 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89d5c4cf-983f-43b4-9226-1414aa9aff41 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141190 Jul 26 19:58:33.998461 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1691/3348] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:58:33 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:34.019663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c9582e41-54b8-4ee2-a7e8-db1505eb7a57 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Calling method '.version_select at 0x7f8756e7b0d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:34.064654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-50cc9b28-938f-4c61-ab45-28d934e37c5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:34.077293 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-50cc9b28-938f-4c61-ab45-28d934e37c5b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.587729 Jul 26 19:58:34.089606 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1658/3349] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:33 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:34.785632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e26873e2-8e36-45c6-b4c6-80d1568e24ee req-98bc4f60-e0f0-4937-bc21-165582ccade2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "name": "network-vif-unplugged", "status": "completed", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:34.802775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e26873e2-8e36-45c6-b4c6-80d1568e24ee req-98bc4f60-e0f0-4937-bc21-165582ccade2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:34.804084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e26873e2-8e36-45c6-b4c6-80d1568e24ee req-98bc4f60-e0f0-4937-bc21-165582ccade2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:34.822467 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e26873e2-8e36-45c6-b4c6-80d1568e24ee req-98bc4f60-e0f0-4937-bc21-165582ccade2 service nova] Creating event network-vif-unplugged:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h1-708768-8 Jul 26 19:58:34.840907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-e26873e2-8e36-45c6-b4c6-80d1568e24ee req-98bc4f60-e0f0-4937-bc21-165582ccade2 service nova] Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:58:34.858512 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e26873e2-8e36-45c6-b4c6-80d1568e24ee req-98bc4f60-e0f0-4937-bc21-165582ccade2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077088 Jul 26 19:58:34.860094 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1659/3350] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:34.876611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:34.877803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:34.887189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:34.888034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:34.889052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:34.889885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:34.985424 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c9582e41-54b8-4ee2-a7e8-db1505eb7a57 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/eb1848c5-3efa-49f4-934e-8fe3db6f4495" status: 202 len: 0 microversion: 2.1 time: 0.985625 Jul 26 19:58:34.985958 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1692/3351] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:58:33 2022] DELETE /compute/v2.1/os-security-groups/eb1848c5-3efa-49f4-934e-8fe3db6f4495 => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:34.999125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d03e9549-256f-470f-9a59-f472d95a4b46 req-f43210a7-4661-4ee9-af91-ca871ed3d92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "tag": "2fe790d2-60b2-4792-a59a-9585e6108fb0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:35.015457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d03e9549-256f-470f-9a59-f472d95a4b46 req-f43210a7-4661-4ee9-af91-ca871ed3d92d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:35.015934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d03e9549-256f-470f-9a59-f472d95a4b46 req-f43210a7-4661-4ee9-af91-ca871ed3d92d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:35.052329 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d03e9549-256f-470f-9a59-f472d95a4b46 req-f43210a7-4661-4ee9-af91-ca871ed3d92d service nova] Creating event network-changed:2fe790d2-60b2-4792-a59a-9585e6108fb0 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:58:35.061879 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d03e9549-256f-470f-9a59-f472d95a4b46 req-f43210a7-4661-4ee9-af91-ca871ed3d92d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074372 Jul 26 19:58:35.063059 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1693/3352] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:35.071345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-422037ec-d917-4e35-9c82-28d88ed6d20b tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Calling method '.version_select at 0x7f8756ddc4c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:35.277016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:35.290021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:35.312897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:35.315530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90d5e18c-78a2-4f24-977c-ba03b4d1bea8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.444081 Jul 26 19:58:35.316461 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1660/3353] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:34 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:58:35.322073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-482f1b7f-41f4-4728-93b2-95ef6a951357 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:35.325083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-482f1b7f-41f4-4728-93b2-95ef6a951357 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:35.334754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-482f1b7f-41f4-4728-93b2-95ef6a951357 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:35.336105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-482f1b7f-41f4-4728-93b2-95ef6a951357 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:35.337161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-482f1b7f-41f4-4728-93b2-95ef6a951357 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:35.338298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-482f1b7f-41f4-4728-93b2-95ef6a951357 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:35.380473 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-482f1b7f-41f4-4728-93b2-95ef6a951357 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062699 Jul 26 19:58:35.386570 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1661/3354] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:58:35 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:35.398108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbfca4a6-90e7-4757-bafb-713940e940e9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:35.403647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cbfca4a6-90e7-4757-bafb-713940e940e9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:35.423058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbfca4a6-90e7-4757-bafb-713940e940e9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:35.423522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbfca4a6-90e7-4757-bafb-713940e940e9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:35.426593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbfca4a6-90e7-4757-bafb-713940e940e9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:35.427224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbfca4a6-90e7-4757-bafb-713940e940e9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:35.867463 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-422037ec-d917-4e35-9c82-28d88ed6d20b tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8139bcfd-6091-404f-87fe-c667a6d105c0" status: 202 len: 0 microversion: 2.1 time: 0.802559 Jul 26 19:58:35.868103 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1694/3355] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:58:35 2022] DELETE /compute/v2.1/os-security-groups/8139bcfd-6091-404f-87fe-c667a6d105c0 => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:35.882288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f130261f-6442-49e7-b172-792c3f3d9737 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] Calling method '.version_select at 0x7f8756f38f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:36.032444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cbfca4a6-90e7-4757-bafb-713940e940e9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:36.042524 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cbfca4a6-90e7-4757-bafb-713940e940e9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.649491 Jul 26 19:58:36.056690 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1662/3356] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:35 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:36.343268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:36.344036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:36.372526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:36.373341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:36.375912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:36.376648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:36.927859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:36.955757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:36.969360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:36.971426 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0cfa0081-bb09-421a-aab8-92b21fa12889 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.632361 Jul 26 19:58:36.975049 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1663/3357] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:36 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:36.981782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-94d367e4-e264-497a-b969-b1c98f13a5bf tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:36.984247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-94d367e4-e264-497a-b969-b1c98f13a5bf tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:36.998465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94d367e4-e264-497a-b969-b1c98f13a5bf tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:36.999191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94d367e4-e264-497a-b969-b1c98f13a5bf tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:37.000007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94d367e4-e264-497a-b969-b1c98f13a5bf tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:37.000446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94d367e4-e264-497a-b969-b1c98f13a5bf tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:37.077662 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-94d367e4-e264-497a-b969-b1c98f13a5bf tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101293 Jul 26 19:58:37.080536 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1664/3358] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:58:36 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:37.097233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c1d8f278-a4c2-4fbc-a8cf-ddf4f8dfc70e req-93c9eefa-3202-43dc-b8c4-1a8a19e0b882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:37.130963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c1d8f278-a4c2-4fbc-a8cf-ddf4f8dfc70e req-93c9eefa-3202-43dc-b8c4-1a8a19e0b882 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:37.131736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c1d8f278-a4c2-4fbc-a8cf-ddf4f8dfc70e req-93c9eefa-3202-43dc-b8c4-1a8a19e0b882 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:37.176878 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c1d8f278-a4c2-4fbc-a8cf-ddf4f8dfc70e req-93c9eefa-3202-43dc-b8c4-1a8a19e0b882 service nova] Creating event network-changed:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h1-708768-8 Jul 26 19:58:37.187330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-c1d8f278-a4c2-4fbc-a8cf-ddf4f8dfc70e req-93c9eefa-3202-43dc-b8c4-1a8a19e0b882 service nova] Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 19:58:37.239673 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c1d8f278-a4c2-4fbc-a8cf-ddf4f8dfc70e req-93c9eefa-3202-43dc-b8c4-1a8a19e0b882 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144296 Jul 26 19:58:37.242151 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1665/3359] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:37.254040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0e4ccb5-3a01-47e8-8745-c43eb0fbba07 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:37.255148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c0e4ccb5-3a01-47e8-8745-c43eb0fbba07 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:37.263819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0e4ccb5-3a01-47e8-8745-c43eb0fbba07 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:37.264600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0e4ccb5-3a01-47e8-8745-c43eb0fbba07 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:37.266509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0e4ccb5-3a01-47e8-8745-c43eb0fbba07 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:37.267317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0e4ccb5-3a01-47e8-8745-c43eb0fbba07 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:38.239602 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f130261f-6442-49e7-b172-792c3f3d9737 tempest-SecurityGroupRulesNegativeTestJSON-541104536 tempest-SecurityGroupRulesNegativeTestJSON-541104536-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/c251b7b3-431b-4267-af1e-d18150d36d50" status: 202 len: 0 microversion: 2.1 time: 2.363731 Jul 26 19:58:38.240589 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1695/3360] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:58:35 2022] DELETE /compute/v2.1/os-security-groups/c251b7b3-431b-4267-af1e-d18150d36d50 => generated 0 bytes in 2365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:58:38.246110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:38.251897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:38.272405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:38.273692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:38.277015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:38.278164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:38.961818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c0e4ccb5-3a01-47e8-8745-c43eb0fbba07 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:38.982581 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c0e4ccb5-3a01-47e8-8745-c43eb0fbba07 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 1.734685 Jul 26 19:58:38.983496 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1666/3361] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:37 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:38.998415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0fc76b77-ba41-4b96-9422-ea9e3c3ef92d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:39.004078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0fc76b77-ba41-4b96-9422-ea9e3c3ef92d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:39.032677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0fc76b77-ba41-4b96-9422-ea9e3c3ef92d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:39.034513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0fc76b77-ba41-4b96-9422-ea9e3c3ef92d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:39.045450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0fc76b77-ba41-4b96-9422-ea9e3c3ef92d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:39.047140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0fc76b77-ba41-4b96-9422-ea9e3c3ef92d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:39.113049 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0fc76b77-ba41-4b96-9422-ea9e3c3ef92d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127720 Jul 26 19:58:39.115806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1667/3362] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:58:38 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:39.197374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:39.213605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:39.220201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:39.226514 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-be35f3eb-eabc-41cc-8267-5b5e9d79cb0e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.984451 Jul 26 19:58:39.228679 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1696/3363] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:38 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:39.255491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e1126234-fc04-402a-8797-f36710153464 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Action: 'create', calling method: .version_select at 0x7f875ef28e50>, body: {"keypair": {"name": "tempest-keypair-1824033096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXUnrlyruDLoJKcP3GO08brGHcHCG8kocsksoEAG2as4z5yLzd6PixulJF835jPDWaWzZnD/wWXvTf5MA+nBQ4N87jg/g+Z7eEW0i8uI1E1qFkHEo0b9sbwoJlbLhHkTA=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:39.282344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-e1126234-fc04-402a-8797-f36710153464 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Getting quotas for project c75d41d830114829b39e22cb1a46730e. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:58:39.291746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-e1126234-fc04-402a-8797-f36710153464 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Getting quotas for user 94a9998874894955891cfe419a49de65 and project c75d41d830114829b39e22cb1a46730e. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:58:39.328140 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e1126234-fc04-402a-8797-f36710153464 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210669 Jul 26 19:58:39.329115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1668/3364] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:58:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:40.013564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca1fe3d5-ea44-4d7b-9144-555837e051e7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:40.015450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca1fe3d5-ea44-4d7b-9144-555837e051e7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:40.029926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca1fe3d5-ea44-4d7b-9144-555837e051e7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.031591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca1fe3d5-ea44-4d7b-9144-555837e051e7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.033200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca1fe3d5-ea44-4d7b-9144-555837e051e7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.033824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca1fe3d5-ea44-4d7b-9144-555837e051e7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.130154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5b2b3dcc-d94e-421d-af26-2b8ccd3d7849 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:40.139176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5b2b3dcc-d94e-421d-af26-2b8ccd3d7849 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:40.160328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b2b3dcc-d94e-421d-af26-2b8ccd3d7849 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.162716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b2b3dcc-d94e-421d-af26-2b8ccd3d7849 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.163652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b2b3dcc-d94e-421d-af26-2b8ccd3d7849 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.164097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b2b3dcc-d94e-421d-af26-2b8ccd3d7849 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.238943 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5b2b3dcc-d94e-421d-af26-2b8ccd3d7849 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113846 Jul 26 19:58:40.239956 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1669/3365] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 19:58:40 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 19:58:40.267069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:40.269138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:40.282265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.283347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.297676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.298553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.592448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca1fe3d5-ea44-4d7b-9144-555837e051e7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:40.606277 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca1fe3d5-ea44-4d7b-9144-555837e051e7 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.597726 Jul 26 19:58:40.607597 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1697/3366] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:40 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:40.628486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4b0b00a8-3ef5-4fff-b7b7-d5c8e1fb4ac4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:40.629185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4b0b00a8-3ef5-4fff-b7b7-d5c8e1fb4ac4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:40.657758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b0b00a8-3ef5-4fff-b7b7-d5c8e1fb4ac4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.659047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b0b00a8-3ef5-4fff-b7b7-d5c8e1fb4ac4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.660213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b0b00a8-3ef5-4fff-b7b7-d5c8e1fb4ac4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.663506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b0b00a8-3ef5-4fff-b7b7-d5c8e1fb4ac4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.696547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4b0b00a8-3ef5-4fff-b7b7-d5c8e1fb4ac4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:58:40.758237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:40.782967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:40.789615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:40.799024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d3dd7e42-f492-4999-a5ee-d5982ca05f86 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.535201 Jul 26 19:58:40.800030 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1670/3367] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:40 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:40.841286 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4b0b00a8-3ef5-4fff-b7b7-d5c8e1fb4ac4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 204 len: 0 microversion: 2.1 time: 0.227607 Jul 26 19:58:40.842063 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1698/3368] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:58:40 2022] DELETE /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:58:40.851171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7d4f335f-2fbb-4bac-b33e-74cad1188514 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:40.852252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7d4f335f-2fbb-4bac-b33e-74cad1188514 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:40.862993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7d4f335f-2fbb-4bac-b33e-74cad1188514 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.863592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7d4f335f-2fbb-4bac-b33e-74cad1188514 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:40.864691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7d4f335f-2fbb-4bac-b33e-74cad1188514 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:40.865158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7d4f335f-2fbb-4bac-b33e-74cad1188514 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:41.359442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7d4f335f-2fbb-4bac-b33e-74cad1188514 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:41.381282 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7d4f335f-2fbb-4bac-b33e-74cad1188514 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1679 microversion: 2.1 time: 0.534663 Jul 26 19:58:41.382649 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1671/3369] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:40 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1679 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:41.631537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb71e5fb-fe99-430b-98f4-7bbfeb8da385 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:41.632278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eb71e5fb-fe99-430b-98f4-7bbfeb8da385 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:41.642302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb71e5fb-fe99-430b-98f4-7bbfeb8da385 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:41.643054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb71e5fb-fe99-430b-98f4-7bbfeb8da385 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:41.644131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb71e5fb-fe99-430b-98f4-7bbfeb8da385 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:41.644738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb71e5fb-fe99-430b-98f4-7bbfeb8da385 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:41.825878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:41.826952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:41.829770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:41.836458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:41.837785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:41.842110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:41.842921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:42.336374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eb71e5fb-fe99-430b-98f4-7bbfeb8da385 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:42.345688 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb71e5fb-fe99-430b-98f4-7bbfeb8da385 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1469 microversion: 2.1 time: 0.718711 Jul 26 19:58:42.347974 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1699/3370] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:41 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1469 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:42.405472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b847732-7974-466a-b45f-1b7d871cb4a4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:42.407156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b847732-7974-466a-b45f-1b7d871cb4a4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:42.422534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b847732-7974-466a-b45f-1b7d871cb4a4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:42.423014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b847732-7974-466a-b45f-1b7d871cb4a4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:42.426426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b847732-7974-466a-b45f-1b7d871cb4a4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:42.426890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b847732-7974-466a-b45f-1b7d871cb4a4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:42.915090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b847732-7974-466a-b45f-1b7d871cb4a4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:42.948204 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b847732-7974-466a-b45f-1b7d871cb4a4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1679 microversion: 2.1 time: 0.547756 Jul 26 19:58:42.950086 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1700/3371] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:42 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1679 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:43.184398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:43.197878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:43.201610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:43.203750 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c6857d4-f574-4935-a433-2adaf7b7716a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 1.382694 Jul 26 19:58:43.205025 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1672/3372] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:41 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:43.371147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82e62c67-3d75-444f-861f-929136d23a66 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:43.372220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82e62c67-3d75-444f-861f-929136d23a66 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:43.381297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82e62c67-3d75-444f-861f-929136d23a66 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:43.382207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82e62c67-3d75-444f-861f-929136d23a66 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:43.383242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82e62c67-3d75-444f-861f-929136d23a66 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:43.383809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82e62c67-3d75-444f-861f-929136d23a66 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:43.406046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:43.658592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82e62c67-3d75-444f-861f-929136d23a66 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:43.673790 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82e62c67-3d75-444f-861f-929136d23a66 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1462 microversion: 2.1 time: 0.307284 Jul 26 19:58:43.677324 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1701/3373] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:43 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1462 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:43.697399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9a23b95d-72c3-4044-a266-b12e0f7b7684 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:43.698803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9a23b95d-72c3-4044-a266-b12e0f7b7684 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:43.706310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a23b95d-72c3-4044-a266-b12e0f7b7684 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:43.707003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a23b95d-72c3-4044-a266-b12e0f7b7684 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:43.707874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a23b95d-72c3-4044-a266-b12e0f7b7684 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:43.708309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a23b95d-72c3-4044-a266-b12e0f7b7684 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:43.970450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2fb8db76-a019-41f9-915f-e06e7783fd84 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:43.971065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2fb8db76-a019-41f9-915f-e06e7783fd84 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:43.981012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2fb8db76-a019-41f9-915f-e06e7783fd84 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:43.981462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2fb8db76-a019-41f9-915f-e06e7783fd84 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:43.982245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2fb8db76-a019-41f9-915f-e06e7783fd84 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:43.982680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2fb8db76-a019-41f9-915f-e06e7783fd84 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:44.316284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2fb8db76-a019-41f9-915f-e06e7783fd84 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:44.324652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2fb8db76-a019-41f9-915f-e06e7783fd84 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1679 microversion: 2.1 time: 0.357911 Jul 26 19:58:44.340294 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1702/3374] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:43 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1679 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:44.347106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:44.348714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:44.358039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:44.358922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:44.359996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:44.360955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:44.675248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:44.688894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:44.693234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:44.694501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f52aec0-2244-47e9-a301-174477402fa2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.352719 Jul 26 19:58:44.695089 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1703/3375] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:44 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:44.792552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9a23b95d-72c3-4044-a266-b12e0f7b7684 tempest-MigrationsAdminTest-587241728 tempest-MigrationsAdminTest-587241728-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1613 microversion: 2.1 time: 1.098921 Jul 26 19:58:44.794685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1673/3376] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:43 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1613 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:44.833555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-27f26ef0-588b-42f0-b82b-e37a85f42ae8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:44.834356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-27f26ef0-588b-42f0-b82b-e37a85f42ae8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:44.841969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27f26ef0-588b-42f0-b82b-e37a85f42ae8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:44.842600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27f26ef0-588b-42f0-b82b-e37a85f42ae8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:44.843880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27f26ef0-588b-42f0-b82b-e37a85f42ae8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:44.844504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27f26ef0-588b-42f0-b82b-e37a85f42ae8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:44.873818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-27f26ef0-588b-42f0-b82b-e37a85f42ae8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:58:44.974291 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-27f26ef0-588b-42f0-b82b-e37a85f42ae8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 204 len: 0 microversion: 2.1 time: 0.144944 Jul 26 19:58:44.979968 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1704/3377] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:58:44 2022] DELETE /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:58:44.990723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-01616c55-61f9-46a1-b5a0-c8fdddd12c88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:44.991929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-01616c55-61f9-46a1-b5a0-c8fdddd12c88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:45.008927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01616c55-61f9-46a1-b5a0-c8fdddd12c88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:45.010668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01616c55-61f9-46a1-b5a0-c8fdddd12c88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:45.013070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01616c55-61f9-46a1-b5a0-c8fdddd12c88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:45.013752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01616c55-61f9-46a1-b5a0-c8fdddd12c88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:45.347830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c5ad6c4-7012-4e0d-b3ee-258959a9906f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:45.348980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c5ad6c4-7012-4e0d-b3ee-258959a9906f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:45.359788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c5ad6c4-7012-4e0d-b3ee-258959a9906f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:45.360249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c5ad6c4-7012-4e0d-b3ee-258959a9906f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:45.361036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c5ad6c4-7012-4e0d-b3ee-258959a9906f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:45.361472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c5ad6c4-7012-4e0d-b3ee-258959a9906f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:45.723217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9c5ad6c4-7012-4e0d-b3ee-258959a9906f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:45.735393 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c5ad6c4-7012-4e0d-b3ee-258959a9906f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1679 microversion: 2.1 time: 0.391802 Jul 26 19:58:45.748308 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1705/3378] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:45 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1679 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:58:45.755667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:45.756676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:45.770631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:45.781511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-01616c55-61f9-46a1-b5a0-c8fdddd12c88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:45.791513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:45.791877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:45.794538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:45.796190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:45.802820 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-01616c55-61f9-46a1-b5a0-c8fdddd12c88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1468 microversion: 2.1 time: 0.818207 Jul 26 19:58:45.804213 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1674/3379] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:44 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1468 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:46.454844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:46.476480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:46.483670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:46.491827 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f917d2f5-abf3-4d69-9c5e-8e1a3076bd8d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.737773 Jul 26 19:58:46.507578 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1706/3380] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:45 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:46.583140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3dabc1ee-a2d7-478a-9ed5-d1a857c212a9 req-5e24a017-1198-4b54-8909-d7cec935e157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "name": "network-vif-plugged", "status": "completed", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:46.593821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3dabc1ee-a2d7-478a-9ed5-d1a857c212a9 req-5e24a017-1198-4b54-8909-d7cec935e157 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:46.594272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3dabc1ee-a2d7-478a-9ed5-d1a857c212a9 req-5e24a017-1198-4b54-8909-d7cec935e157 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:46.607258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3dabc1ee-a2d7-478a-9ed5-d1a857c212a9 req-5e24a017-1198-4b54-8909-d7cec935e157 service nova] Creating event network-vif-plugged:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h1-708768-8 Jul 26 19:58:46.614173 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3dabc1ee-a2d7-478a-9ed5-d1a857c212a9 req-5e24a017-1198-4b54-8909-d7cec935e157 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205201 Jul 26 19:58:46.614970 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1675/3381] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:46.703845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1432169033", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "59ecaada-60ea-45c5-a7f8-54b3e0f92720"}], "security_groups": [{"name": "tempest-securitygroup--1691603258"}], "key_name": "tempest-keypair-1824033096", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:46.758360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:46.761000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a071de13-77a7-4c75-a21c-ebaa216c5c5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:46.761733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a071de13-77a7-4c75-a21c-ebaa216c5c5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:46.787515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a071de13-77a7-4c75-a21c-ebaa216c5c5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:46.793966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a071de13-77a7-4c75-a21c-ebaa216c5c5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:46.798154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a071de13-77a7-4c75-a21c-ebaa216c5c5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:46.803269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a071de13-77a7-4c75-a21c-ebaa216c5c5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:46.968248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a071de13-77a7-4c75-a21c-ebaa216c5c5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:46.987074 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a071de13-77a7-4c75-a21c-ebaa216c5c5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 200 len: 1611 microversion: 2.1 time: 0.232188 Jul 26 19:58:47.002042 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1676/3382] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:46 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 1611 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:58:47.011550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d40af60-0081-4557-b7f4-4b0504c8f68e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:47.014571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8d40af60-0081-4557-b7f4-4b0504c8f68e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:47.058410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d40af60-0081-4557-b7f4-4b0504c8f68e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:47.058714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d40af60-0081-4557-b7f4-4b0504c8f68e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:47.059507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d40af60-0081-4557-b7f4-4b0504c8f68e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:47.059976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d40af60-0081-4557-b7f4-4b0504c8f68e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:47.438865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8d40af60-0081-4557-b7f4-4b0504c8f68e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:47.450714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d40af60-0081-4557-b7f4-4b0504c8f68e tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1468 microversion: 2.1 time: 0.447443 Jul 26 19:58:47.451312 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1677/3383] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:47 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1468 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:47.466480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a6e41f66-0aa9-46b2-b25f-221373dc6128 req-012762ae-d6ca-44bb-bf4d-6a6b591ec438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8827133-9f6e-48f6-9ae4-d4be69370eef", "name": "network-vif-deleted", "tag": "e1519dc4-c176-49b9-b5ac-043b57b24aa4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:47.472523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] validate_networks() for [('59ecaada-60ea-45c5-a7f8-54b3e0f92720', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:58:47.484918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a6e41f66-0aa9-46b2-b25f-221373dc6128 req-012762ae-d6ca-44bb-bf4d-6a6b591ec438 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:47.485643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a6e41f66-0aa9-46b2-b25f-221373dc6128 req-012762ae-d6ca-44bb-bf4d-6a6b591ec438 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:47.511840 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a6e41f66-0aa9-46b2-b25f-221373dc6128 req-012762ae-d6ca-44bb-bf4d-6a6b591ec438 service nova] Creating event network-vif-deleted:e1519dc4-c176-49b9-b5ac-043b57b24aa4 for instance c8827133-9f6e-48f6-9ae4-d4be69370eef on n-h1-708768-8 Jul 26 19:58:47.519924 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a6e41f66-0aa9-46b2-b25f-221373dc6128 req-012762ae-d6ca-44bb-bf4d-6a6b591ec438 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058639 Jul 26 19:58:47.524900 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1678/3384] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:47.537575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:47.539581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:47.554346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:47.557664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:47.560578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:47.562488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:48.021970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:48.034436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:48.037049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:48.038514 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ee41417b-82c7-4b1f-8a99-3c262fc33ea0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.510906 Jul 26 19:58:48.054180 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1679/3385] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:47 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:48.064117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:48.064746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:48.087568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:48.088090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:48.088954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:48.089511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:48.106966 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef HTTP/1.1 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c8827133-9f6e-48f6-9ae4-d4be69370eef'} Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:48.115829 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:48.121101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:48.121101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:48.121101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:48.121101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:48.121101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:48.121101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 19:58:48.121101 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:48.124088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:48.127806 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc96b256-3205-4b82-83aa-afb800d9d3d7 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 404 len: 111 microversion: 2.1 time: 0.072201 Jul 26 19:58:48.128705 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1680/3386] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:48 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:58:48.139091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3f142840-8321-4913-b804-c9f0ce9f983d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '.version_select at 0x7f875e3b1550>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:48.177099 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3f142840-8321-4913-b804-c9f0ce9f983d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862015649" status: 202 len: 0 microversion: 2.1 time: 0.043000 Jul 26 19:58:48.178735 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1681/3387] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 19:58:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862015649 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:58:48.475396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb1cacf4-23df-4670-848c-f9ab72e9a164 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:48.475795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb1cacf4-23df-4670-848c-f9ab72e9a164 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:48.494713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb1cacf4-23df-4670-848c-f9ab72e9a164 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:48.495116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb1cacf4-23df-4670-848c-f9ab72e9a164 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:48.496193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb1cacf4-23df-4670-848c-f9ab72e9a164 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:48.496853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb1cacf4-23df-4670-848c-f9ab72e9a164 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:49.304865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:49.379168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb1cacf4-23df-4670-848c-f9ab72e9a164 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:49.391300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Getting quotas for project c75d41d830114829b39e22cb1a46730e. Resources: dict_keys(['metadata_items']) {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:58:49.405797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb1cacf4-23df-4670-848c-f9ab72e9a164 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 200 len: 1468 microversion: 2.1 time: 0.924762 Jul 26 19:58:49.413774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Getting quotas for user 94a9998874894955891cfe419a49de65 and project c75d41d830114829b39e22cb1a46730e. Resources: dict_keys(['metadata_items']) {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:58:49.427316 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1682/3388] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:48 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 1468 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:49.445967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:58:49.446654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:58:49.447337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:58:49.450342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:58:49.450986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:58:49.469081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:49.470400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:49.472208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:49.472901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:49.518428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Getting quotas for project c75d41d830114829b39e22cb1a46730e. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:58:49.535430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Getting quotas for user 94a9998874894955891cfe419a49de65 and project c75d41d830114829b39e22cb1a46730e. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:58:49.570854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:58:49.577001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:58:49.611799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-70136362-43e7-49d0-a183-c16ce8841344 req-48069c6d-b1de-4f0a-8461-29cb52d4c5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3633ebd7-95c8-46eb-98f5-a4770ff2bdc9", "name": "network-vif-deleted", "tag": "0ddf494e-6a03-4781-b08d-c586a8307aab"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:49.657098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-70136362-43e7-49d0-a183-c16ce8841344 req-48069c6d-b1de-4f0a-8461-29cb52d4c5de service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:49.657598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-70136362-43e7-49d0-a183-c16ce8841344 req-48069c6d-b1de-4f0a-8461-29cb52d4c5de service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:49.676578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-42e932bd-0225-43e2-bf02-6444273abe68 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.979320 Jul 26 19:58:49.677709 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1707/3389] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:58:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 2981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:58:49.691563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:49.692213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:49.703367 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-70136362-43e7-49d0-a183-c16ce8841344 req-48069c6d-b1de-4f0a-8461-29cb52d4c5de service nova] Creating event network-vif-deleted:0ddf494e-6a03-4781-b08d-c586a8307aab for instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 on n-h1-708768-8 Jul 26 19:58:49.717664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:49.720939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:49.723213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:49.723910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:49.724352 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-70136362-43e7-49d0-a183-c16ce8841344 req-48069c6d-b1de-4f0a-8461-29cb52d4c5de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295593 Jul 26 19:58:49.724976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1683/3390] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:49.733198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2fd0774-ad05-4a7e-911f-06ea67b0eb36 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:49.740131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d2fd0774-ad05-4a7e-911f-06ea67b0eb36 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:49.886377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2fd0774-ad05-4a7e-911f-06ea67b0eb36 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:49.897177 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2fd0774-ad05-4a7e-911f-06ea67b0eb36 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1278 microversion: 2.1 time: 0.169960 Jul 26 19:58:49.897788 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1684/3391] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:49 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:50.372894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:50.387599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:50.389319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:50.390484 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65fb74cc-63f7-4a35-8ad3-c52f96a8ed60 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.711523 Jul 26 19:58:50.400582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1708/3392] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:49 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:50.432943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:50.434247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:50.441599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:50.442316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:50.455705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:50.456576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:50.473205 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] HTTP exception thrown: Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 could not be found. Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Request method failure captured: Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 HTTP/1.1 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EYulq82l4evePNH-EnUrB8aNchSG0obSZxSAFCGiGA30KsLejIMIeHKcYRU_NVwvYgtFdIUCizbgzOQE4dK_lImElpKgT0IVoGVUQo_PwznaCHhso3Q4Xm7GTqOG2lqkM1e-dUL46F36Hte2s5ki_wMvSADNAbBrHbwhM_DMcFOgZM Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5aa3fa3f76b04006a2cb1c22021083f5 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-MigrationsAdminTest-500580657 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5aa3fa3f76b04006a2cb1c22021083f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5aa3fa3f76b04006a2cb1c22021083f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5aa3fa3f76b04006a2cb1c22021083f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5aa3fa3f76b04006a2cb1c22021083f5"}]}] Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-MigrationsAdminTest-500580657 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5aa3fa3f76b04006a2cb1c22021083f5 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-MigrationsAdminTest-500580657 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-MigrationsAdminTest-500580657-project Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 146ecbca3664463ead84028d4add8b50 Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-MigrationsAdminTest-500580657-project Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 could not be found. Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '3633ebd7-95c8-46eb-98f5-a4770ff2bdc9'} Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 could not be found. Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 could not be found. Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:50.474932 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 could not be found. Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Returning 404 to user: Instance 3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:50.481091 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b36c855e-c0a5-4c04-8f78-0ee29cb390c6 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9" status: 404 len: 111 microversion: 2.1 time: 0.048735 Jul 26 19:58:50.481900 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1685/3393] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:50 2022] GET /compute/v2.1/servers/3633ebd7-95c8-46eb-98f5-a4770ff2bdc9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:58:50.486331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b3129080-8a99-4ea6-b31c-5a28c902993d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:50.486826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b3129080-8a99-4ea6-b31c-5a28c902993d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:50.507524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3129080-8a99-4ea6-b31c-5a28c902993d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:50.508001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3129080-8a99-4ea6-b31c-5a28c902993d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:50.508980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3129080-8a99-4ea6-b31c-5a28c902993d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:50.509581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3129080-8a99-4ea6-b31c-5a28c902993d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:50.554678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b3129080-8a99-4ea6-b31c-5a28c902993d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:58:50.651451 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b3129080-8a99-4ea6-b31c-5a28c902993d tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 204 len: 0 microversion: 2.1 time: 0.168308 Jul 26 19:58:50.653963 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1709/3394] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:58:50 2022] DELETE /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:58:50.664823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6817b829-a9e3-4c0a-88ee-53634029b4f9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:50.665461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6817b829-a9e3-4c0a-88ee-53634029b4f9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:50.676787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6817b829-a9e3-4c0a-88ee-53634029b4f9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:50.677131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6817b829-a9e3-4c0a-88ee-53634029b4f9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:50.678219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6817b829-a9e3-4c0a-88ee-53634029b4f9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:50.679166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6817b829-a9e3-4c0a-88ee-53634029b4f9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:50.889885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6817b829-a9e3-4c0a-88ee-53634029b4f9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:50.899544 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6817b829-a9e3-4c0a-88ee-53634029b4f9 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1535 microversion: 2.1 time: 0.240178 Jul 26 19:58:50.915585 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1686/3395] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:50 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1535 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:50.919832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1114c6c4-35c1-478d-aa0f-1736b98125f6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:50.920620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1114c6c4-35c1-478d-aa0f-1736b98125f6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:50.926835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1114c6c4-35c1-478d-aa0f-1736b98125f6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:50.927287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1114c6c4-35c1-478d-aa0f-1736b98125f6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:50.928148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1114c6c4-35c1-478d-aa0f-1736b98125f6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:50.928817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1114c6c4-35c1-478d-aa0f-1736b98125f6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:51.414971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:51.415586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:51.429758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:51.430625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:51.431705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:51.432961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:51.445332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1114c6c4-35c1-478d-aa0f-1736b98125f6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:51.462141 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1114c6c4-35c1-478d-aa0f-1736b98125f6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1274 microversion: 2.1 time: 0.547595 Jul 26 19:58:51.462902 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1710/3396] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:50 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1274 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:51.636897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cc14fd71-b02e-45e2-adad-1588f9ca0c63 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: .version_select at 0x7f8756e044c0>, body: {"keypair": {"name": "tempest-keypair-1519705480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfbZizdKhDPvyYQrm4Q+6etH4pridI8s9Ya0yXCFIwB8vdjqKoeIavE+L/hNeoZAVBk9lVZfR7yGHZ3ca56UwsLN7kHzC//+6Lhz9V579kiKqXCzDsSwxJlIHWUqe5yAA=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:51.669177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-cc14fd71-b02e-45e2-adad-1588f9ca0c63 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for project 2a16253a71a24312a17022e4f01ed652. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:58:51.680553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-cc14fd71-b02e-45e2-adad-1588f9ca0c63 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for user 889459c783694048b93438ce16b75d0f and project 2a16253a71a24312a17022e4f01ed652. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:58:51.737095 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cc14fd71-b02e-45e2-adad-1588f9ca0c63 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105253 Jul 26 19:58:51.743399 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1711/3397] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 19:58:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:51.924849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0bd2f0ad-2109-49a5-9797-7f60349ac289 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:51.926203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0bd2f0ad-2109-49a5-9797-7f60349ac289 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:51.947930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bd2f0ad-2109-49a5-9797-7f60349ac289 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:51.948270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bd2f0ad-2109-49a5-9797-7f60349ac289 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:51.954664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bd2f0ad-2109-49a5-9797-7f60349ac289 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:51.955055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bd2f0ad-2109-49a5-9797-7f60349ac289 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:52.105442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:52.122403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:52.128506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:52.129960 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-94fa5408-ee4f-4af4-80f8-e4dac22ebffd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.719345 Jul 26 19:58:52.135322 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1687/3398] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:51 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:58:52.307048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bd2f0ad-2109-49a5-9797-7f60349ac289 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:52.315313 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0bd2f0ad-2109-49a5-9797-7f60349ac289 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1535 microversion: 2.1 time: 0.396046 Jul 26 19:58:52.315932 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1712/3399] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:51 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1535 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:58:52.484391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f9018057-ea58-487d-9643-4c5b46599919 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:52.485253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f9018057-ea58-487d-9643-4c5b46599919 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:52.495265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9018057-ea58-487d-9643-4c5b46599919 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:52.497992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9018057-ea58-487d-9643-4c5b46599919 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:52.500580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9018057-ea58-487d-9643-4c5b46599919 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:52.503127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9018057-ea58-487d-9643-4c5b46599919 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:52.865747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f9018057-ea58-487d-9643-4c5b46599919 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:52.877148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f9018057-ea58-487d-9643-4c5b46599919 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1336 microversion: 2.1 time: 0.396274 Jul 26 19:58:52.878097 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1688/3400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:52 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1336 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:53.159032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:53.160409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:53.171261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:53.172534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:53.173921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:53.174553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:53.342804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f4bf5e55-ce22-466d-b59e-ea17f7c23b38 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:53.343993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f4bf5e55-ce22-466d-b59e-ea17f7c23b38 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:53.363369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4bf5e55-ce22-466d-b59e-ea17f7c23b38 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:53.366136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4bf5e55-ce22-466d-b59e-ea17f7c23b38 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:53.367179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4bf5e55-ce22-466d-b59e-ea17f7c23b38 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:53.367912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4bf5e55-ce22-466d-b59e-ea17f7c23b38 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:53.814610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:53.834750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:53.838612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:53.846190 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a521d9d6-bebe-4a95-891b-713cddee3e98 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.693016 Jul 26 19:58:53.860154 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1713/3401] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:53 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:53.904515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85e5503d-a7dd-463e-be66-2d1efd682e1e tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:53.905492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85e5503d-a7dd-463e-be66-2d1efd682e1e tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:53.920613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85e5503d-a7dd-463e-be66-2d1efd682e1e tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:53.922717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85e5503d-a7dd-463e-be66-2d1efd682e1e tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:53.924830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85e5503d-a7dd-463e-be66-2d1efd682e1e tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:53.926825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85e5503d-a7dd-463e-be66-2d1efd682e1e tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:53.972780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f4bf5e55-ce22-466d-b59e-ea17f7c23b38 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:53.986883 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f4bf5e55-ce22-466d-b59e-ea17f7c23b38 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 200 len: 1535 microversion: 2.1 time: 0.652789 Jul 26 19:58:53.990021 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1689/3402] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:53 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 1535 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:58:54.172235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1d1fb0cf-dbf5-41e9-b515-74a360d6e9f1 req-fb53d127-301e-413c-a5a1-0d0c236f3ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eca44fb-21e0-445c-a361-16a0f41c78ad", "name": "network-vif-deleted", "tag": "a1cca3f6-1178-434f-a483-1e63628609d4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:54.187471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1d1fb0cf-dbf5-41e9-b515-74a360d6e9f1 req-fb53d127-301e-413c-a5a1-0d0c236f3ce3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:54.187946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1d1fb0cf-dbf5-41e9-b515-74a360d6e9f1 req-fb53d127-301e-413c-a5a1-0d0c236f3ce3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:54.222909 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1d1fb0cf-dbf5-41e9-b515-74a360d6e9f1 req-fb53d127-301e-413c-a5a1-0d0c236f3ce3 service nova] Creating event network-vif-deleted:a1cca3f6-1178-434f-a483-1e63628609d4 for instance 4eca44fb-21e0-445c-a361-16a0f41c78ad on n-h1-708768-8 Jul 26 19:58:54.240946 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1d1fb0cf-dbf5-41e9-b515-74a360d6e9f1 req-fb53d127-301e-413c-a5a1-0d0c236f3ce3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074474 Jul 26 19:58:54.242321 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1690/3403] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:54.531444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-85e5503d-a7dd-463e-be66-2d1efd682e1e tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:54.540810 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85e5503d-a7dd-463e-be66-2d1efd682e1e tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1404 microversion: 2.1 time: 0.643680 Jul 26 19:58:54.542074 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1714/3404] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:53 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1404 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:54.877321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:54.878687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:54.887015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:54.889259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:54.890318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:54.892092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:55.014847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:55.016011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4eca44fb-21e0-445c-a361-16a0f41c78ad] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:55.024980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:55.026394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:55.027529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:55.031835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:55.054590 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] HTTP exception thrown: Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad could not be found. Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Request method failure captured: Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad HTTP/1.1 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EYulq82l4evePNH-EnUrB8aNchSG0obSZxSAFCGiGA30KsLejIMIeHKcYRU_NVwvYgtFdIUCizbgzOQE4dK_lImElpKgT0IVoGVUQo_PwznaCHhso3Q4Xm7GTqOG2lqkM1e-dUL46F36Hte2s5ki_wMvSADNAbBrHbwhM_DMcFOgZM Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5aa3fa3f76b04006a2cb1c22021083f5 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-MigrationsAdminTest-500580657 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5aa3fa3f76b04006a2cb1c22021083f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5aa3fa3f76b04006a2cb1c22021083f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5aa3fa3f76b04006a2cb1c22021083f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5aa3fa3f76b04006a2cb1c22021083f5"}]}] Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-MigrationsAdminTest-500580657 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5aa3fa3f76b04006a2cb1c22021083f5 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-MigrationsAdminTest-500580657 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-MigrationsAdminTest-500580657-project Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 146ecbca3664463ead84028d4add8b50 Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-MigrationsAdminTest-500580657-project Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad could not be found. Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '4eca44fb-21e0-445c-a361-16a0f41c78ad'} Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad could not be found. Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad could not be found. Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:58:55.058309 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:55.064028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:58:55.064028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:58:55.064028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:58:55.064028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:58:55.064028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:58:55.064028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad could not be found. Jul 26 19:58:55.064028 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:58:55.064639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Returning 404 to user: Instance 4eca44fb-21e0-445c-a361-16a0f41c78ad could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:58:55.065363 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7de9d3d-5678-4b3d-9ad5-7807d58922f8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad" status: 404 len: 111 microversion: 2.1 time: 0.054796 Jul 26 19:58:55.065958 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1715/3405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:55 2022] GET /compute/v2.1/servers/4eca44fb-21e0-445c-a361-16a0f41c78ad => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:58:55.080303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ae80d96-3a38-4265-9f53-9b1fc764c19b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '.version_select at 0x7f8756e041f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:55.106759 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ae80d96-3a38-4265-9f53-9b1fc764c19b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-44193320" status: 202 len: 0 microversion: 2.1 time: 0.029989 Jul 26 19:58:55.111361 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1716/3406] 10.222.0.58 () {58 vars in 1215 bytes} [Tue Jul 26 19:58:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-44193320 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:58:55.564256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f478f6f-6bc3-4e53-ae35-ca69103ecea4 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:55.564941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4f478f6f-6bc3-4e53-ae35-ca69103ecea4 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:55.573404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f478f6f-6bc3-4e53-ae35-ca69103ecea4 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:55.573855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f478f6f-6bc3-4e53-ae35-ca69103ecea4 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:55.574886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f478f6f-6bc3-4e53-ae35-ca69103ecea4 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:55.575568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f478f6f-6bc3-4e53-ae35-ca69103ecea4 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:56.028861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:56.040535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4f478f6f-6bc3-4e53-ae35-ca69103ecea4 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:56.043997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:56.046531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:56.047996 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aaa34616-8f7c-41bc-bd20-7e91a08b9266 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 1.176147 Jul 26 19:58:56.049149 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1691/3407] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:54 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:56.050894 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f478f6f-6bc3-4e53-ae35-ca69103ecea4 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1404 microversion: 2.1 time: 0.491544 Jul 26 19:58:56.051576 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1717/3408] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:55 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:58:56.323897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7d2b6c7d-21cc-40e3-8e0b-5b5242b3087b req-bc8e8107-51ec-468d-82f8-705b34c5e54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c64238-cb11-404b-8360-4c9b9838b1d2", "tag": "b66e0699-9709-4697-827f-5732deb28612"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:56.342284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7d2b6c7d-21cc-40e3-8e0b-5b5242b3087b req-bc8e8107-51ec-468d-82f8-705b34c5e54a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:56.342740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7d2b6c7d-21cc-40e3-8e0b-5b5242b3087b req-bc8e8107-51ec-468d-82f8-705b34c5e54a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:56.369138 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7d2b6c7d-21cc-40e3-8e0b-5b5242b3087b req-bc8e8107-51ec-468d-82f8-705b34c5e54a service nova] Creating event network-changed:b66e0699-9709-4697-827f-5732deb28612 for instance b3c64238-cb11-404b-8360-4c9b9838b1d2 on n-h2-708768-8 Jul 26 19:58:56.383956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7d2b6c7d-21cc-40e3-8e0b-5b5242b3087b req-bc8e8107-51ec-468d-82f8-705b34c5e54a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063923 Jul 26 19:58:56.384789 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1692/3409] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:58:56.632991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-656972722", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa81df3d-9f96-49e8-813d-dbedef5ea966"}], "security_groups": [{"name": "tempest-securitygroup--88459767"}], "key_name": "tempest-keypair-1519705480", "user_data": "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:58:57.075059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:57.075816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:57.092140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:57.092600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:57.093400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:57.094068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:57.466762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] validate_networks() for [('aa81df3d-9f96-49e8-813d-dbedef5ea966', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:58:57.499733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:57.511238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:57.513124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:57.514636 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b3b37b1-20ea-4bfe-9bcb-69b09c976692 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.445383 Jul 26 19:58:57.515766 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1693/3410] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:57 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:57.521801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45750c61-eb63-4af9-9c51-22590611e487 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:57.522550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-45750c61-eb63-4af9-9c51-22590611e487 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:57.530545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45750c61-eb63-4af9-9c51-22590611e487 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:57.531157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45750c61-eb63-4af9-9c51-22590611e487 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:57.532093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45750c61-eb63-4af9-9c51-22590611e487 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:57.532659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45750c61-eb63-4af9-9c51-22590611e487 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:57.772569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-45750c61-eb63-4af9-9c51-22590611e487 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:57.784875 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45750c61-eb63-4af9-9c51-22590611e487 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1404 microversion: 2.1 time: 0.267818 Jul 26 19:58:57.785664 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1694/3411] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:57 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1404 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:58.123721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-53d03913-b5df-45c2-b823-0991084f6acf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:58.124963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-53d03913-b5df-45c2-b823-0991084f6acf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:58.136046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53d03913-b5df-45c2-b823-0991084f6acf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:58.138578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53d03913-b5df-45c2-b823-0991084f6acf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:58.140575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53d03913-b5df-45c2-b823-0991084f6acf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:58.143348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53d03913-b5df-45c2-b823-0991084f6acf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:58.184054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-53d03913-b5df-45c2-b823-0991084f6acf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:58:58.316302 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-53d03913-b5df-45c2-b823-0991084f6acf tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 204 len: 0 microversion: 2.42 time: 0.528504 Jul 26 19:58:58.321655 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1695/3412] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:58:57 2022] DELETE /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:58:58.329163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d0ca92bb-1b8a-4afd-a21c-a449377b2b41 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:58.329990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d0ca92bb-1b8a-4afd-a21c-a449377b2b41 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:58.339526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0ca92bb-1b8a-4afd-a21c-a449377b2b41 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:58.340382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0ca92bb-1b8a-4afd-a21c-a449377b2b41 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:58.341626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0ca92bb-1b8a-4afd-a21c-a449377b2b41 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:58.342785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0ca92bb-1b8a-4afd-a21c-a449377b2b41 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:58.396168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:58.405418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d0ca92bb-1b8a-4afd-a21c-a449377b2b41 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:58:58.542517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d0ca92bb-1b8a-4afd-a21c-a449377b2b41 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 204 len: 0 microversion: 2.1 time: 0.218307 Jul 26 19:58:58.544383 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1696/3413] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:58:58 2022] DELETE /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:58:58.552494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:58.554547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:58.563037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:58.563286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:58.564111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:58.564550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:58.937903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:58.945989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:58:58.946982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:58:58.948253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:58:58.948853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:58:58.949452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:58:58.963230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:58.967099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:58.967981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:58.969305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:58.970795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:58.971967 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c26a9538-10cf-46a9-824e-af241a55ffca tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2960 microversion: 2.42 time: 0.424475 Jul 26 19:58:58.972743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:58.976371 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1697/3414] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:58 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2960 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:58.985894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:58.989449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:58.998616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:58:59.006884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:59.007417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:59.008322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:59.008675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:59.028358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for project 2a16253a71a24312a17022e4f01ed652. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:58:59.040378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for user 889459c783694048b93438ce16b75d0f and project 2a16253a71a24312a17022e4f01ed652. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:58:59.073601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:58:59.075991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:58:59.138578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9fdd568b-fa5c-49e3-8172-8dd7076372c9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.510478 Jul 26 19:58:59.145584 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1718/3415] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:58:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:58:59.157417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb5cbba3-af9e-4c87-a1e1-b84d864683a2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:59.158203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eb5cbba3-af9e-4c87-a1e1-b84d864683a2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:59.164968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb5cbba3-af9e-4c87-a1e1-b84d864683a2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:59.165570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb5cbba3-af9e-4c87-a1e1-b84d864683a2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:59.166564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb5cbba3-af9e-4c87-a1e1-b84d864683a2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:59.167295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb5cbba3-af9e-4c87-a1e1-b84d864683a2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:59.403923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:59.418783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:59.420467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:59.421548 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6682ee64-06a1-4f8c-a792-1593000f6883 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.444000 Jul 26 19:58:59.426119 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1698/3416] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:58 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:58:59.438568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5cded843-ede8-404e-aaf4-3e99f54828d3 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:59.442725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5cded843-ede8-404e-aaf4-3e99f54828d3 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:59.455077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cded843-ede8-404e-aaf4-3e99f54828d3 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:59.458634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cded843-ede8-404e-aaf4-3e99f54828d3 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:59.459538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cded843-ede8-404e-aaf4-3e99f54828d3 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:58:59.460013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cded843-ede8-404e-aaf4-3e99f54828d3 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:58:59.706809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eb5cbba3-af9e-4c87-a1e1-b84d864683a2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:59.719323 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb5cbba3-af9e-4c87-a1e1-b84d864683a2 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1468 microversion: 2.1 time: 0.572249 Jul 26 19:58:59.723531 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1719/3417] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:59 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1468 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:59.736066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-70c79bee-0520-469f-af39-0409289e41a3 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:58:59.736989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-70c79bee-0520-469f-af39-0409289e41a3 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:58:59.781246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5cded843-ede8-404e-aaf4-3e99f54828d3 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:59.792202 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5cded843-ede8-404e-aaf4-3e99f54828d3 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1404 microversion: 2.1 time: 0.366436 Jul 26 19:58:59.808671 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1699/3418] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:59 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1404 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:58:59.900539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-70c79bee-0520-469f-af39-0409289e41a3 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:58:59.907951 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-70c79bee-0520-469f-af39-0409289e41a3 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1241 microversion: 2.1 time: 0.183219 Jul 26 19:58:59.908819 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1720/3419] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:58:59 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:00.002844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:00.003504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:00.005947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:00.042158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:00.043083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:00.045096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:00.045567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:00.449739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:00.450347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:00.476951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:00.479486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:00.480898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:00.483692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:01.046014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.056544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.062355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.066128 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-25a52803-4ecc-4992-9fd8-fe32792220b4 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2960 microversion: 2.42 time: 1.067545 Jul 26 19:59:01.069646 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1700/3420] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:58:59 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2960 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:01.083983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c6f7b08b-bb46-46d8-ae08-09d572e5a9a8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:01.084837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c6f7b08b-bb46-46d8-ae08-09d572e5a9a8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:01.099160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6f7b08b-bb46-46d8-ae08-09d572e5a9a8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:01.102047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6f7b08b-bb46-46d8-ae08-09d572e5a9a8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:01.110070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6f7b08b-bb46-46d8-ae08-09d572e5a9a8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:01.110685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6f7b08b-bb46-46d8-ae08-09d572e5a9a8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:01.372237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c6f7b08b-bb46-46d8-ae08-09d572e5a9a8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.383058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c6f7b08b-bb46-46d8-ae08-09d572e5a9a8 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1468 microversion: 2.1 time: 0.311607 Jul 26 19:59:01.386079 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1701/3421] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:01 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1468 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:01.397634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5b20c06b-364e-4cbf-8b19-1c7ad80485f0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:01.399352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5b20c06b-364e-4cbf-8b19-1c7ad80485f0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:01.422567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b20c06b-364e-4cbf-8b19-1c7ad80485f0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:01.423026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b20c06b-364e-4cbf-8b19-1c7ad80485f0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:01.424138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b20c06b-364e-4cbf-8b19-1c7ad80485f0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:01.424754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b20c06b-364e-4cbf-8b19-1c7ad80485f0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:01.653050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.665216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.668241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.670187 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-741fbb1b-85aa-4c9c-acc8-beed202b6c68 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 1.224643 Jul 26 19:59:01.672501 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1721/3422] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:00 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:59:01.680968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-266796d7-16e8-4427-b8d5-1448b556c55d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:01.683059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-266796d7-16e8-4427-b8d5-1448b556c55d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:01.690738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-266796d7-16e8-4427-b8d5-1448b556c55d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:01.692481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-266796d7-16e8-4427-b8d5-1448b556c55d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:01.694785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-266796d7-16e8-4427-b8d5-1448b556c55d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:01.696189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-266796d7-16e8-4427-b8d5-1448b556c55d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:01.810481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5b20c06b-364e-4cbf-8b19-1c7ad80485f0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.835953 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5b20c06b-364e-4cbf-8b19-1c7ad80485f0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1404 microversion: 2.1 time: 0.447712 Jul 26 19:59:01.847644 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1702/3423] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:01 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:01.859834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-266796d7-16e8-4427-b8d5-1448b556c55d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:01.874024 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-266796d7-16e8-4427-b8d5-1448b556c55d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1299 microversion: 2.1 time: 0.200169 Jul 26 19:59:01.890992 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1722/3424] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:01 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1299 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:01.893851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-91541026-eea4-4a93-8753-4f69d0108a1e req-e4edb495-62dc-412c-a466-39f260e58059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c64238-cb11-404b-8360-4c9b9838b1d2", "name": "network-vif-plugged", "status": "completed", "tag": "b66e0699-9709-4697-827f-5732deb28612"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:01.912938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-91541026-eea4-4a93-8753-4f69d0108a1e req-e4edb495-62dc-412c-a466-39f260e58059 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:01.913818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-91541026-eea4-4a93-8753-4f69d0108a1e req-e4edb495-62dc-412c-a466-39f260e58059 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:01.930889 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-91541026-eea4-4a93-8753-4f69d0108a1e req-e4edb495-62dc-412c-a466-39f260e58059 service nova] Creating event network-vif-plugged:b66e0699-9709-4697-827f-5732deb28612 for instance b3c64238-cb11-404b-8360-4c9b9838b1d2 on n-h2-708768-8 Jul 26 19:59:01.938386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-91541026-eea4-4a93-8753-4f69d0108a1e req-e4edb495-62dc-412c-a466-39f260e58059 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066328 Jul 26 19:59:01.939004 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1703/3425] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:59:02.109735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:02.111555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:02.121941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:02.123820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:02.126565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:02.127873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:02.409623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ed24a00-4a10-43ed-a64f-a696bbd61f95 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:02.410316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ed24a00-4a10-43ed-a64f-a696bbd61f95 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:02.416901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ed24a00-4a10-43ed-a64f-a696bbd61f95 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:02.417706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ed24a00-4a10-43ed-a64f-a696bbd61f95 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:02.418667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ed24a00-4a10-43ed-a64f-a696bbd61f95 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:02.419265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ed24a00-4a10-43ed-a64f-a696bbd61f95 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:02.766738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:02.788151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:02.790733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:02.792306 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f6a4fec-d245-4ef5-a6df-b61bff10ccda tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2960 microversion: 2.42 time: 0.691697 Jul 26 19:59:02.794891 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1723/3426] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:02 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2960 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:02.810100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:02.812189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:02.821752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:02.823083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:02.824887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:02.825653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:02.959075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9ed24a00-4a10-43ed-a64f-a696bbd61f95 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:02.970332 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ed24a00-4a10-43ed-a64f-a696bbd61f95 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1468 microversion: 2.1 time: 0.565608 Jul 26 19:59:02.972223 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1704/3427] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:02 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1468 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:02.987346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d4c6c845-d4b0-4a90-a7ba-ae9bb7695321 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:02.988193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4c6c845-d4b0-4a90-a7ba-ae9bb7695321 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:02.997436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4c6c845-d4b0-4a90-a7ba-ae9bb7695321 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:02.998369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4c6c845-d4b0-4a90-a7ba-ae9bb7695321 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:02.999229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4c6c845-d4b0-4a90-a7ba-ae9bb7695321 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:02.999925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4c6c845-d4b0-4a90-a7ba-ae9bb7695321 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:03.364278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4c6c845-d4b0-4a90-a7ba-ae9bb7695321 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:03.372966 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d4c6c845-d4b0-4a90-a7ba-ae9bb7695321 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1404 microversion: 2.1 time: 0.399390 Jul 26 19:59:03.376682 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1705/3428] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:02 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:03.381774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e123915d-db43-4c91-8387-dab0e2293568 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:03.384243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e123915d-db43-4c91-8387-dab0e2293568 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:03.404685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e123915d-db43-4c91-8387-dab0e2293568 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:03.405515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e123915d-db43-4c91-8387-dab0e2293568 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:03.406500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e123915d-db43-4c91-8387-dab0e2293568 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:03.407107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e123915d-db43-4c91-8387-dab0e2293568 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:03.483597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:03.493821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:03.503126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:03.504598 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1e460183-b1bb-4fcb-bd1c-1de09a95cadc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.707487 Jul 26 19:59:03.519658 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1724/3429] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:02 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:03.530978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e123915d-db43-4c91-8387-dab0e2293568 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:03.559854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e123915d-db43-4c91-8387-dab0e2293568 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1299 microversion: 2.1 time: 0.181615 Jul 26 19:59:03.561466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1706/3430] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:03 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:03.821186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:03.823046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:03.850794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:03.851263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:03.853533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:03.854293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:03.902644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-69714ad8-de0f-4f2d-8f1a-0fd2ebef4706 req-50c57512-5bb9-4482-86e4-8683b0a15942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce31da0-9557-46b9-aa38-daa4aa549a5f", "name": "network-vif-deleted", "tag": "452ba588-281e-4c62-ae46-9c77b1ae1774"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:03.924578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-69714ad8-de0f-4f2d-8f1a-0fd2ebef4706 req-50c57512-5bb9-4482-86e4-8683b0a15942 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:03.925034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-69714ad8-de0f-4f2d-8f1a-0fd2ebef4706 req-50c57512-5bb9-4482-86e4-8683b0a15942 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:03.958960 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-69714ad8-de0f-4f2d-8f1a-0fd2ebef4706 req-50c57512-5bb9-4482-86e4-8683b0a15942 service nova] Creating event network-vif-deleted:452ba588-281e-4c62-ae46-9c77b1ae1774 for instance dce31da0-9557-46b9-aa38-daa4aa549a5f on n-h2-708768-8 Jul 26 19:59:03.965516 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-69714ad8-de0f-4f2d-8f1a-0fd2ebef4706 req-50c57512-5bb9-4482-86e4-8683b0a15942 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067575 Jul 26 19:59:03.966949 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1707/3431] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:59:04.005458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-23ce54dd-39bc-4d27-ba42-a6539a11e769 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:04.006532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-23ce54dd-39bc-4d27-ba42-a6539a11e769 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:04.014473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23ce54dd-39bc-4d27-ba42-a6539a11e769 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:04.015253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23ce54dd-39bc-4d27-ba42-a6539a11e769 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:04.016705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23ce54dd-39bc-4d27-ba42-a6539a11e769 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:04.017344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23ce54dd-39bc-4d27-ba42-a6539a11e769 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:04.184366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-23ce54dd-39bc-4d27-ba42-a6539a11e769 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:04.196116 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-23ce54dd-39bc-4d27-ba42-a6539a11e769 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 200 len: 1426 microversion: 2.1 time: 0.197599 Jul 26 19:59:04.197915 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1708/3432] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:03 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 1426 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:04.398640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1d043e2-f0d6-45e9-ae8d-e61b4b68ad2d tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:04.399275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1d043e2-f0d6-45e9-ae8d-e61b4b68ad2d tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:04.408926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1d043e2-f0d6-45e9-ae8d-e61b4b68ad2d tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:04.409388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1d043e2-f0d6-45e9-ae8d-e61b4b68ad2d tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:04.410180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1d043e2-f0d6-45e9-ae8d-e61b4b68ad2d tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:04.414015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1d043e2-f0d6-45e9-ae8d-e61b4b68ad2d tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:04.772880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1d043e2-f0d6-45e9-ae8d-e61b4b68ad2d tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:04.785705 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1d043e2-f0d6-45e9-ae8d-e61b4b68ad2d tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1591 microversion: 2.1 time: 0.390880 Jul 26 19:59:04.786872 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1709/3433] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:04 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1591 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:04.793878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:04.795167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:04.804200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:04.805626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:04.806865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:04.807798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.069756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:05.080145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:05.082857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:05.084347 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a5f7f37-3607-402d-8634-d907bc437b2d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.296192 Jul 26 19:59:05.099925 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1710/3434] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:04 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:05.099925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0b5a7484-561c-4e1f-9762-8c577362a388 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:05.099925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0b5a7484-561c-4e1f-9762-8c577362a388 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:05.106665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b5a7484-561c-4e1f-9762-8c577362a388 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.107267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b5a7484-561c-4e1f-9762-8c577362a388 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.110445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b5a7484-561c-4e1f-9762-8c577362a388 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.112866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b5a7484-561c-4e1f-9762-8c577362a388 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.247644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:05.260320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:05.264116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:05.265718 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de153e7e-e77a-478e-a127-cb920c1e77a2 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2960 microversion: 2.42 time: 1.448881 Jul 26 19:59:05.266662 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1725/3435] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:03 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2960 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:05.294474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d6b9f92a-4547-44f6-8425-e9c728d0cadb tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:05.296022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d6b9f92a-4547-44f6-8425-e9c728d0cadb tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:05.310775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6b9f92a-4547-44f6-8425-e9c728d0cadb tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.314998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6b9f92a-4547-44f6-8425-e9c728d0cadb tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.315897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6b9f92a-4547-44f6-8425-e9c728d0cadb tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.316354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6b9f92a-4547-44f6-8425-e9c728d0cadb tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.412401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b5a7484-561c-4e1f-9762-8c577362a388 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:05.425199 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0b5a7484-561c-4e1f-9762-8c577362a388 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.338499 Jul 26 19:59:05.427376 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1711/3436] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:05 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:05.436279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:05.437778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: dce31da0-9557-46b9-aa38-daa4aa549a5f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:05.444984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.449759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.451864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.452494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.470250 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] HTTP exception thrown: Instance dce31da0-9557-46b9-aa38-daa4aa549a5f could not be found. Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Request method failure captured: Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f HTTP/1.1 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EYulq82l4evePNH-EnUrB8aNchSG0obSZxSAFCGiGA30KsLejIMIeHKcYRU_NVwvYgtFdIUCizbgzOQE4dK_lImElpKgT0IVoGVUQo_PwznaCHhso3Q4Xm7GTqOG2lqkM1e-dUL46F36Hte2s5ki_wMvSADNAbBrHbwhM_DMcFOgZM Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5aa3fa3f76b04006a2cb1c22021083f5 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-MigrationsAdminTest-500580657 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5aa3fa3f76b04006a2cb1c22021083f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5aa3fa3f76b04006a2cb1c22021083f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5aa3fa3f76b04006a2cb1c22021083f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5aa3fa3f76b04006a2cb1c22021083f5"}]}] Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-MigrationsAdminTest-500580657 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5aa3fa3f76b04006a2cb1c22021083f5 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-MigrationsAdminTest-500580657 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-MigrationsAdminTest-500580657-project Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 146ecbca3664463ead84028d4add8b50 Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-MigrationsAdminTest-500580657-project Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance dce31da0-9557-46b9-aa38-daa4aa549a5f could not be found. Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'dce31da0-9557-46b9-aa38-daa4aa549a5f'} Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce31da0-9557-46b9-aa38-daa4aa549a5f could not be found. Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce31da0-9557-46b9-aa38-daa4aa549a5f could not be found. Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:05.472022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:05.477230 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:05.477230 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:05.477230 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:05.477230 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:05.477230 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:05.477230 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce31da0-9557-46b9-aa38-daa4aa549a5f could not be found. Jul 26 19:59:05.477230 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:05.479165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Returning 404 to user: Instance dce31da0-9557-46b9-aa38-daa4aa549a5f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:05.480260 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41ec762e-9fe6-48b5-b954-330a019b40bc tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f" status: 404 len: 111 microversion: 2.1 time: 0.050858 Jul 26 19:59:05.481081 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1712/3437] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:05 2022] GET /compute/v2.1/servers/dce31da0-9557-46b9-aa38-daa4aa549a5f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:59:05.491929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4ed3f10-536c-45e8-b922-750145505637 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:05.492471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b4ed3f10-536c-45e8-b922-750145505637 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:05.498952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4ed3f10-536c-45e8-b922-750145505637 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.499453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4ed3f10-536c-45e8-b922-750145505637 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.500295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4ed3f10-536c-45e8-b922-750145505637 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.500737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4ed3f10-536c-45e8-b922-750145505637 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.519117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:05.534480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b4ed3f10-536c-45e8-b922-750145505637 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:59:05.584904 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d6b9f92a-4547-44f6-8425-e9c728d0cadb tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.316054 Jul 26 19:59:05.586107 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1726/3438] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:59:05 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2/os-interface => generated 285 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:05.633625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:05.653783 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4ed3f10-536c-45e8-b922-750145505637 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 204 len: 0 microversion: 2.1 time: 0.167504 Jul 26 19:59:05.654940 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1713/3439] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:59:05 2022] DELETE /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:59:05.664564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1b42216-4acb-4bd2-8609-da22f8759b88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:05.668213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c1b42216-4acb-4bd2-8609-da22f8759b88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:05.673033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:05.693408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1b42216-4acb-4bd2-8609-da22f8759b88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.698960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1b42216-4acb-4bd2-8609-da22f8759b88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:05.700229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1b42216-4acb-4bd2-8609-da22f8759b88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:05.702547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1b42216-4acb-4bd2-8609-da22f8759b88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:06.114143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:06.116926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:06.150196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:06.154780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:06.161257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:06.164298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:06.456881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c1b42216-4acb-4bd2-8609-da22f8759b88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:06.478086 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1b42216-4acb-4bd2-8609-da22f8759b88 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1467 microversion: 2.1 time: 0.818258 Jul 26 19:59:06.480718 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1727/3440] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:05 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1467 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:06.510853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:06.511504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:06.529654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:06.531127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:06.533384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:06.534101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:06.647386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:06.671756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:06.676694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:06.683593 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1674911-c4f0-46cb-b879-831d6b813340 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.575732 Jul 26 19:59:06.685457 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1714/3441] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:06 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:59:06.698641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3aa15762-391b-43fc-b7e2-36aad2a9bbee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:06.701431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3aa15762-391b-43fc-b7e2-36aad2a9bbee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:06.719437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3aa15762-391b-43fc-b7e2-36aad2a9bbee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:06.720859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3aa15762-391b-43fc-b7e2-36aad2a9bbee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:06.721907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3aa15762-391b-43fc-b7e2-36aad2a9bbee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:06.724302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3aa15762-391b-43fc-b7e2-36aad2a9bbee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:06.971927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3aa15762-391b-43fc-b7e2-36aad2a9bbee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:06.997008 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3aa15762-391b-43fc-b7e2-36aad2a9bbee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.309546 Jul 26 19:59:06.997943 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1715/3442] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:06 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:07.406881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-69de27c2-5498-4c9a-bcb6-db65c2091bc8 req-90b93766-e81b-4529-9a84-c41a4d961af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-unplugged", "status": "completed", "tag": "284685bc-eeaf-4bd9-82d4-f42d9b330786"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:07.433419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-69de27c2-5498-4c9a-bcb6-db65c2091bc8 req-90b93766-e81b-4529-9a84-c41a4d961af0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:07.434160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-69de27c2-5498-4c9a-bcb6-db65c2091bc8 req-90b93766-e81b-4529-9a84-c41a4d961af0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:07.453793 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-69de27c2-5498-4c9a-bcb6-db65c2091bc8 req-90b93766-e81b-4529-9a84-c41a4d961af0 service nova] Creating event network-vif-unplugged:284685bc-eeaf-4bd9-82d4-f42d9b330786 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:07.463813 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-69de27c2-5498-4c9a-bcb6-db65c2091bc8 req-90b93766-e81b-4529-9a84-c41a4d961af0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071924 Jul 26 19:59:07.466900 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1716/3443] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:07.502418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3092457-7925-4ce2-ac48-6940be495cee tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:07.503141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3092457-7925-4ce2-ac48-6940be495cee tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:07.512287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3092457-7925-4ce2-ac48-6940be495cee tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:07.513023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3092457-7925-4ce2-ac48-6940be495cee tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:07.514031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3092457-7925-4ce2-ac48-6940be495cee tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:07.514763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3092457-7925-4ce2-ac48-6940be495cee tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:08.072877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:08.106728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:08.111240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:08.134404 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7a341f21-6df8-4c0f-8965-460dd359f903 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2939 microversion: 2.42 time: 1.631952 Jul 26 19:59:08.136218 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1728/3444] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:06 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2939 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:08.141162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:08.142029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:08.149026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:08.149799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:08.150846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:08.151511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:08.303503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3092457-7925-4ce2-ac48-6940be495cee tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:08.314139 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3092457-7925-4ce2-ac48-6940be495cee tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1467 microversion: 2.1 time: 0.815642 Jul 26 19:59:08.315363 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1717/3445] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:07 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1467 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:08.332483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46a63ebc-da72-4427-9525-f19ca90691e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:08.333931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-46a63ebc-da72-4427-9525-f19ca90691e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:08.345039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46a63ebc-da72-4427-9525-f19ca90691e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:08.345397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46a63ebc-da72-4427-9525-f19ca90691e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:08.349278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46a63ebc-da72-4427-9525-f19ca90691e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:08.349278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46a63ebc-da72-4427-9525-f19ca90691e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:08.688857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:08.705466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:08.708606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:08.713041 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-769e32b2-0175-4145-8e04-5e8d11e4bcb6 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.575395 Jul 26 19:59:08.715629 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1729/3446] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:08 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:08.912221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c03a22d5-7b22-4435-9593-9f977fdc0138 req-53b5adf1-ccfc-410b-a952-ad5672de64f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd66cf0a-f4e4-4302-9442-01163ee9a46d", "tag": "f188fd2b-0a4a-4ea1-a30c-78990e302ca5"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:08.935583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c03a22d5-7b22-4435-9593-9f977fdc0138 req-53b5adf1-ccfc-410b-a952-ad5672de64f5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:08.936157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c03a22d5-7b22-4435-9593-9f977fdc0138 req-53b5adf1-ccfc-410b-a952-ad5672de64f5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:08.977041 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c03a22d5-7b22-4435-9593-9f977fdc0138 req-53b5adf1-ccfc-410b-a952-ad5672de64f5 service nova] Creating event network-changed:f188fd2b-0a4a-4ea1-a30c-78990e302ca5 for instance dd66cf0a-f4e4-4302-9442-01163ee9a46d on n-h1-708768-8 Jul 26 19:59:08.990788 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c03a22d5-7b22-4435-9593-9f977fdc0138 req-53b5adf1-ccfc-410b-a952-ad5672de64f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082017 Jul 26 19:59:08.992454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1730/3447] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:09.061003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-46a63ebc-da72-4427-9525-f19ca90691e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:09.084094 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-46a63ebc-da72-4427-9525-f19ca90691e1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.758237 Jul 26 19:59:09.085065 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1718/3448] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:08 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:09.160276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:09.169219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:09.170451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:09.196772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f42251b-077e-4747-b4b3-48caa79f3099 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:09.197494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5f42251b-077e-4747-b4b3-48caa79f3099 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:09.199474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:09.203464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:09.207170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:09.207487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f42251b-077e-4747-b4b3-48caa79f3099 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:09.207983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f42251b-077e-4747-b4b3-48caa79f3099 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:09.211407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:09.218725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f42251b-077e-4747-b4b3-48caa79f3099 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:09.220141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f42251b-077e-4747-b4b3-48caa79f3099 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:09.848828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5f42251b-077e-4747-b4b3-48caa79f3099 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:09.864653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f42251b-077e-4747-b4b3-48caa79f3099 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1591 microversion: 2.1 time: 0.671765 Jul 26 19:59:09.866318 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1719/3449] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:09 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1591 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:09.882437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-14d5503a-2805-4b16-bf2c-2f603eac9b49 req-4618f075-c94a-4d7e-b5d7-b031e49b6066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c64238-cb11-404b-8360-4c9b9838b1d2", "tag": "b66e0699-9709-4697-827f-5732deb28612"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:09.897996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-14d5503a-2805-4b16-bf2c-2f603eac9b49 req-4618f075-c94a-4d7e-b5d7-b031e49b6066 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:09.901227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-14d5503a-2805-4b16-bf2c-2f603eac9b49 req-4618f075-c94a-4d7e-b5d7-b031e49b6066 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:09.906426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=22 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:09.949299 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-14d5503a-2805-4b16-bf2c-2f603eac9b49 req-4618f075-c94a-4d7e-b5d7-b031e49b6066 service nova] Creating event network-changed:b66e0699-9709-4697-827f-5732deb28612 for instance b3c64238-cb11-404b-8360-4c9b9838b1d2 on n-h2-708768-8 Jul 26 19:59:09.967190 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-14d5503a-2805-4b16-bf2c-2f603eac9b49 req-4618f075-c94a-4d7e-b5d7-b031e49b6066 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099356 Jul 26 19:59:09.980400 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1720/3450] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:09.997938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:10.012647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:10.043479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:10.055222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:10.056499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:10.057441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:10.194114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:10.201905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:10.208359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lazy-loading 'fault' on Instance uuid 4dc3bf14-61a5-413c-ad32-4c9ad235303c {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:59:10.247869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:10.317814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:10.332317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:10.354042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146ecbca3664463ead84028d4add8b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa3fa3f76b04006a2cb1c22021083f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:10.360036 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15e58af0-63cd-4e24-938d-59e673be36c7 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2939 microversion: 2.42 time: 1.190343 Jul 26 19:59:10.363923 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c30f8dca-59a4-4573-a5c9-5f6759dd4fc3 tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 200 len: 1302 microversion: 2.1 time: 0.378816 Jul 26 19:59:10.364970 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1721/3451] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:09 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 1302 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:10.381529 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1731/3452] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:09 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2939 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:10.383281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d1e62fec-cf06-4677-b7b0-a983764a31a4 req-249f53fe-e720-4f39-ac95-6e1e0ef1c3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-unplugged", "status": "completed", "tag": "1836dc79-1df6-4f9f-ad40-28b880acc6bb"}, {"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-unplugged", "status": "completed", "tag": "fe6b2cb8-1d37-4fcb-8207-e8f166570861"}, {"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-unplugged", "status": "completed", "tag": "ec179517-adcc-4787-947f-12e245e9aa0b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:10.402432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d1e62fec-cf06-4677-b7b0-a983764a31a4 req-249f53fe-e720-4f39-ac95-6e1e0ef1c3b6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:10.403305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d1e62fec-cf06-4677-b7b0-a983764a31a4 req-249f53fe-e720-4f39-ac95-6e1e0ef1c3b6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:10.419502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:10.421236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:10.434219 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d1e62fec-cf06-4677-b7b0-a983764a31a4 req-249f53fe-e720-4f39-ac95-6e1e0ef1c3b6 service nova] Creating event network-vif-unplugged:1836dc79-1df6-4f9f-ad40-28b880acc6bb for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:10.435260 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d1e62fec-cf06-4677-b7b0-a983764a31a4 req-249f53fe-e720-4f39-ac95-6e1e0ef1c3b6 service nova] Creating event network-vif-unplugged:fe6b2cb8-1d37-4fcb-8207-e8f166570861 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:10.435905 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d1e62fec-cf06-4677-b7b0-a983764a31a4 req-249f53fe-e720-4f39-ac95-6e1e0ef1c3b6 service nova] Creating event network-vif-unplugged:ec179517-adcc-4787-947f-12e245e9aa0b for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:10.445214 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d1e62fec-cf06-4677-b7b0-a983764a31a4 req-249f53fe-e720-4f39-ac95-6e1e0ef1c3b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.078920 Jul 26 19:59:10.460012 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1722/3453] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:10.464872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:10.465353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:10.466150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:10.466587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:10.473193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55ab9098-9fbd-4b09-bfb7-3a0362b1eae9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:10.474583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55ab9098-9fbd-4b09-bfb7-3a0362b1eae9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:10.492407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55ab9098-9fbd-4b09-bfb7-3a0362b1eae9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:10.492742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55ab9098-9fbd-4b09-bfb7-3a0362b1eae9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:10.493539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55ab9098-9fbd-4b09-bfb7-3a0362b1eae9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:10.494573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55ab9098-9fbd-4b09-bfb7-3a0362b1eae9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:11.173055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55ab9098-9fbd-4b09-bfb7-3a0362b1eae9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:11.182561 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55ab9098-9fbd-4b09-bfb7-3a0362b1eae9 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.721083 Jul 26 19:59:11.185514 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1723/3454] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:10 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:11.394604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:11.396033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] [instance: 4dc3bf14-61a5-413c-ad32-4c9ad235303c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:11.410282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:11.412803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:11.415036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:11.416321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:11.474991 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] HTTP exception thrown: Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c could not be found. Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Request method failure captured: Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c HTTP/1.1 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EYulq82l4evePNH-EnUrB8aNchSG0obSZxSAFCGiGA30KsLejIMIeHKcYRU_NVwvYgtFdIUCizbgzOQE4dK_lImElpKgT0IVoGVUQo_PwznaCHhso3Q4Xm7GTqOG2lqkM1e-dUL46F36Hte2s5ki_wMvSADNAbBrHbwhM_DMcFOgZM Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5aa3fa3f76b04006a2cb1c22021083f5 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-MigrationsAdminTest-500580657 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5aa3fa3f76b04006a2cb1c22021083f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5aa3fa3f76b04006a2cb1c22021083f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5aa3fa3f76b04006a2cb1c22021083f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5aa3fa3f76b04006a2cb1c22021083f5"}]}] Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-MigrationsAdminTest-500580657 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5aa3fa3f76b04006a2cb1c22021083f5 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-MigrationsAdminTest-500580657 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-MigrationsAdminTest-500580657-project Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 146ecbca3664463ead84028d4add8b50 Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-MigrationsAdminTest-500580657-project Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c could not be found. Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '4dc3bf14-61a5-413c-ad32-4c9ad235303c'} Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c could not be found. Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c could not be found. Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:11.479514 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c could not be found. Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] Returning 404 to user: Instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:11.484154 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8e9c11a-8a72-4a71-be9d-d008c392041b tempest-MigrationsAdminTest-500580657 tempest-MigrationsAdminTest-500580657-project] 10.222.0.58 "GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c" status: 404 len: 111 microversion: 2.1 time: 0.094577 Jul 26 19:59:11.494427 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1724/3455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:11 2022] GET /compute/v2.1/servers/4dc3bf14-61a5-413c-ad32-4c9ad235303c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:59:11.532087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:11.538030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:11.570194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:11.570794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:11.571686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:11.572302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:11.677352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:11.695148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:11.700978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:11.703805 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15720bf2-0923-4766-bc0f-d689c39d5019 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 1.321093 Jul 26 19:59:11.706611 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1732/3456] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:10 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:12.006070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6df2b64d-17a7-4cd5-a656-2542755cc868 req-df547204-dedb-4751-a4ec-1cfb5e93efe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-deleted", "tag": "284685bc-eeaf-4bd9-82d4-f42d9b330786"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:12.032263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6df2b64d-17a7-4cd5-a656-2542755cc868 req-df547204-dedb-4751-a4ec-1cfb5e93efe2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:12.034202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6df2b64d-17a7-4cd5-a656-2542755cc868 req-df547204-dedb-4751-a4ec-1cfb5e93efe2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:12.064041 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6df2b64d-17a7-4cd5-a656-2542755cc868 req-df547204-dedb-4751-a4ec-1cfb5e93efe2 service nova] Creating event network-vif-deleted:284685bc-eeaf-4bd9-82d4-f42d9b330786 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:12.077079 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6df2b64d-17a7-4cd5-a656-2542755cc868 req-df547204-dedb-4751-a4ec-1cfb5e93efe2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074831 Jul 26 19:59:12.078454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1733/3457] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:12.139470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5eb6d0de-2b2c-4d93-8ade-907cfe642ada req-a8131da4-bd82-4344-8bf7-cbbf0bc5be66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc3bf14-61a5-413c-ad32-4c9ad235303c", "name": "network-vif-deleted", "tag": "dbf289a8-a47c-4167-811b-3b049fa5db7f"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:12.157493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5eb6d0de-2b2c-4d93-8ade-907cfe642ada req-a8131da4-bd82-4344-8bf7-cbbf0bc5be66 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:12.160601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5eb6d0de-2b2c-4d93-8ade-907cfe642ada req-a8131da4-bd82-4344-8bf7-cbbf0bc5be66 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:12.183705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5eb6d0de-2b2c-4d93-8ade-907cfe642ada req-a8131da4-bd82-4344-8bf7-cbbf0bc5be66 service nova] Creating event network-vif-deleted:dbf289a8-a47c-4167-811b-3b049fa5db7f for instance 4dc3bf14-61a5-413c-ad32-4c9ad235303c on n-h2-708768-8 Jul 26 19:59:12.206214 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5eb6d0de-2b2c-4d93-8ade-907cfe642ada req-a8131da4-bd82-4344-8bf7-cbbf0bc5be66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067444 Jul 26 19:59:12.207216 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1734/3458] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:59:12.221171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-012327cd-dbbd-4799-81f7-f1843feb618c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:12.221906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-012327cd-dbbd-4799-81f7-f1843feb618c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:12.233562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-012327cd-dbbd-4799-81f7-f1843feb618c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:12.234022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-012327cd-dbbd-4799-81f7-f1843feb618c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:12.239965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-012327cd-dbbd-4799-81f7-f1843feb618c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:12.240525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-012327cd-dbbd-4799-81f7-f1843feb618c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:12.634054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:12.657084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:12.660873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:12.662483 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8fc50e69-c790-4b87-ac43-f156127b9580 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2871 microversion: 2.42 time: 1.167045 Jul 26 19:59:12.663227 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1725/3459] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:11 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2871 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:12.692661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bf3e00ad-b2d1-4eb8-9143-3ee24bfc9aed req-77911e2d-3136-4c7b-b912-d57870d877ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-unplugged", "status": "completed", "tag": "0ad81dfc-1d62-45e5-844d-8e3f948affe9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:12.704720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bf3e00ad-b2d1-4eb8-9143-3ee24bfc9aed req-77911e2d-3136-4c7b-b912-d57870d877ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:12.705412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bf3e00ad-b2d1-4eb8-9143-3ee24bfc9aed req-77911e2d-3136-4c7b-b912-d57870d877ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:12.736058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bf3e00ad-b2d1-4eb8-9143-3ee24bfc9aed req-77911e2d-3136-4c7b-b912-d57870d877ca service nova] Creating event network-vif-unplugged:0ad81dfc-1d62-45e5-844d-8e3f948affe9 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:12.742154 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bf3e00ad-b2d1-4eb8-9143-3ee24bfc9aed req-77911e2d-3136-4c7b-b912-d57870d877ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061112 Jul 26 19:59:12.742976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1726/3460] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:12.749542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:12.750496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:12.757683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:12.758647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:12.759874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:12.760578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:13.350822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-012327cd-dbbd-4799-81f7-f1843feb618c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:13.361198 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-012327cd-dbbd-4799-81f7-f1843feb618c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 1.152450 Jul 26 19:59:13.362117 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1735/3461] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:12 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:13.656610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:13.678981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:13.680712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:13.684607 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b2be5382-c6fd-4889-ac56-657e910b0716 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.937673 Jul 26 19:59:13.686679 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1727/3462] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:12 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:13.709348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:13.710230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:13.718711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:13.719757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:13.720741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:13.721339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:14.497894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4074518a-99f0-46de-b391-c3615accc6de tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f875ec61820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1706741964", "description": "tempest-description-74366744"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:14.823424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:14.851522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:14.854525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:14.857095 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0cdb69ec-3b41-4508-ae8d-7226aeff5789 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2710 microversion: 2.42 time: 1.154475 Jul 26 19:59:14.858821 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1736/3463] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:13 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2710 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:14.880227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-cd6ce040-3356-40ca-b8d6-f76c09c03d1e req-5bf946a8-e0ae-4f72-a70e-171c0c126c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-deleted", "tag": "1836dc79-1df6-4f9f-ad40-28b880acc6bb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:14.907232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cd6ce040-3356-40ca-b8d6-f76c09c03d1e req-5bf946a8-e0ae-4f72-a70e-171c0c126c70 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:14.907869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cd6ce040-3356-40ca-b8d6-f76c09c03d1e req-5bf946a8-e0ae-4f72-a70e-171c0c126c70 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:14.937726 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-cd6ce040-3356-40ca-b8d6-f76c09c03d1e req-5bf946a8-e0ae-4f72-a70e-171c0c126c70 service nova] Creating event network-vif-deleted:1836dc79-1df6-4f9f-ad40-28b880acc6bb for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:14.949056 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-cd6ce040-3356-40ca-b8d6-f76c09c03d1e req-5bf946a8-e0ae-4f72-a70e-171c0c126c70 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087052 Jul 26 19:59:14.950302 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1737/3464] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:14.958814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5d741ef9-2d2b-4822-8eb6-12f9bdec71d8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:14.961293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5d741ef9-2d2b-4822-8eb6-12f9bdec71d8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:14.975688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d741ef9-2d2b-4822-8eb6-12f9bdec71d8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:14.976508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d741ef9-2d2b-4822-8eb6-12f9bdec71d8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:14.978737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d741ef9-2d2b-4822-8eb6-12f9bdec71d8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:14.981440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d741ef9-2d2b-4822-8eb6-12f9bdec71d8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:15.388974 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4074518a-99f0-46de-b391-c3615accc6de tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.399451 Jul 26 19:59:15.389585 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1728/3465] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:59:13 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:59:15.403823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:15.405026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:15.413855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:15.414884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:15.417928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:15.418593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:15.536970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5d741ef9-2d2b-4822-8eb6-12f9bdec71d8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:15.548663 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5d741ef9-2d2b-4822-8eb6-12f9bdec71d8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.596513 Jul 26 19:59:15.549936 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1738/3466] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:14 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:15.554863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0350dad7-9501-4542-9248-7aa67ba48f16 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f8756f45ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-558842174", "description": "tempest-description-505436958"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:15.993051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:16.012282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:16.014777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:16.016605 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bcec7123-950a-443a-98df-818a0584bcbf tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.618447 Jul 26 19:59:16.041744 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1729/3467] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:15 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:16.058522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:16.059402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:16.077601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:16.078495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:16.079588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:16.080278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:16.351530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:16.369656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:16.373364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:16.376121 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb4e9a98-86c5-42f4-97ca-68d0c36f8b67 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2502 microversion: 2.42 time: 0.331778 Jul 26 19:59:16.389859 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1730/3468] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:16 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2502 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:16.516054 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0350dad7-9501-4542-9248-7aa67ba48f16 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.964725 Jul 26 19:59:16.516978 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1739/3469] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:59:15 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:16.575491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e6df4e79-997e-40bf-bd16-52eae533f96c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:16.577234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e6df4e79-997e-40bf-bd16-52eae533f96c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:16.598376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6df4e79-997e-40bf-bd16-52eae533f96c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:16.598831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6df4e79-997e-40bf-bd16-52eae533f96c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:16.607810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6df4e79-997e-40bf-bd16-52eae533f96c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:16.608643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6df4e79-997e-40bf-bd16-52eae533f96c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:16.702835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1655895010", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "6800c8f8-c5e5-447f-968f-0e0c70fef4a0"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:16.818312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] validate_networks() for [('6800c8f8-c5e5-447f-968f-0e0c70fef4a0', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:59:16.949506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e6df4e79-997e-40bf-bd16-52eae533f96c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:16.957590 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e6df4e79-997e-40bf-bd16-52eae533f96c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.388464 Jul 26 19:59:16.974406 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1731/3470] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:16 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:17.048944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:17.049988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:17.069734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:17.070353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:17.071260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:17.071907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:17.091989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:17.434950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:17.449398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:17.450958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:17.452873 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ff30825-25d9-479f-8310-60e9a87a1af4 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.407791 Jul 26 19:59:17.454904 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1732/3471] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:17 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:17.464215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1f31584b-6722-4c00-8aed-3fa9478d887b req-8c7eff4d-e728-4a68-8a67-ed9d4323888c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-plugged", "status": "completed", "tag": "2fe790d2-60b2-4792-a59a-9585e6108fb0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:17.490351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1f31584b-6722-4c00-8aed-3fa9478d887b req-8c7eff4d-e728-4a68-8a67-ed9d4323888c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:17.490793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1f31584b-6722-4c00-8aed-3fa9478d887b req-8c7eff4d-e728-4a68-8a67-ed9d4323888c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:17.516890 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1f31584b-6722-4c00-8aed-3fa9478d887b req-8c7eff4d-e728-4a68-8a67-ed9d4323888c service nova] Creating event network-vif-plugged:2fe790d2-60b2-4792-a59a-9585e6108fb0 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:59:17.528395 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1f31584b-6722-4c00-8aed-3fa9478d887b req-8c7eff4d-e728-4a68-8a67-ed9d4323888c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071698 Jul 26 19:59:17.530217 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1733/3472] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:17.536398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:17.537270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:17.546341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:17.547224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:17.548599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:17.550256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:17.804825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:17.818878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:17.821019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:17.822650 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7b37abe8-0394-4cbb-b19b-741a38f1c466 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2502 microversion: 2.42 time: 0.290873 Jul 26 19:59:17.823515 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1734/3473] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:17 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:17.839429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6cdc1eb6-aad8-45e3-98ce-7997530be953 req-d18ae20b-23c2-4d6c-8364-2d5c05347ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-deleted", "tag": "ec179517-adcc-4787-947f-12e245e9aa0b"}, {"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-deleted", "tag": "fe6b2cb8-1d37-4fcb-8207-e8f166570861"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:17.859022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6cdc1eb6-aad8-45e3-98ce-7997530be953 req-d18ae20b-23c2-4d6c-8364-2d5c05347ca1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:17.859763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6cdc1eb6-aad8-45e3-98ce-7997530be953 req-d18ae20b-23c2-4d6c-8364-2d5c05347ca1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:17.876983 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6cdc1eb6-aad8-45e3-98ce-7997530be953 req-d18ae20b-23c2-4d6c-8364-2d5c05347ca1 service nova] Creating event network-vif-deleted:ec179517-adcc-4787-947f-12e245e9aa0b for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:17.877496 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6cdc1eb6-aad8-45e3-98ce-7997530be953 req-d18ae20b-23c2-4d6c-8364-2d5c05347ca1 service nova] Creating event network-vif-deleted:fe6b2cb8-1d37-4fcb-8207-e8f166570861 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:17.890105 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6cdc1eb6-aad8-45e3-98ce-7997530be953 req-d18ae20b-23c2-4d6c-8364-2d5c05347ca1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064773 Jul 26 19:59:17.891489 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1735/3474] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:17.981964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3be4d00f-fda4-4a71-9feb-e16b01670a1c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:17.983106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3be4d00f-fda4-4a71-9feb-e16b01670a1c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:18.008717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3be4d00f-fda4-4a71-9feb-e16b01670a1c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:18.013866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3be4d00f-fda4-4a71-9feb-e16b01670a1c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:18.014582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3be4d00f-fda4-4a71-9feb-e16b01670a1c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:18.019581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3be4d00f-fda4-4a71-9feb-e16b01670a1c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:18.811537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3be4d00f-fda4-4a71-9feb-e16b01670a1c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:18.824594 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3be4d00f-fda4-4a71-9feb-e16b01670a1c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.848546 Jul 26 19:59:18.825507 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1736/3475] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:17 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:19.206711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fd3fd14c-0aec-47bf-8648-8937dfa31bb5 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Calling method '.version_select at 0x7f875ec61790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:19.385644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:59:19.386696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:59:19.387574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:59:19.388222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:59:19.388871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:59:19.402421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:19.402682 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fd3fd14c-0aec-47bf-8648-8937dfa31bb5 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/f21a9083e63f458381839e7f2f110a09" status: 200 len: 371 microversion: 2.1 time: 0.575621 Jul 26 19:59:19.403289 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1737/3476] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 19:59:18 2022] GET /compute/v2.1/os-quota-sets/f21a9083e63f458381839e7f2f110a09 => generated 371 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:19.411466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:19.412976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:19.413979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:19.425900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:19.426578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:19.449035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:19.449866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:19.450003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Getting quotas for project f32b5385a98245f2aa903b2360e4e89a. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:59:19.450975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:19.455655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:19.458805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Getting quotas for user 5a01463edfde4e7eaa354aae42922731 and project f32b5385a98245f2aa903b2360e4e89a. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:59:19.493854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:59:19.498717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:59:19.574101 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-321f86db-766e-4dfb-9085-7b0b693ae911 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.875873 Jul 26 19:59:19.575081 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1740/3477] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 19:59:19.580556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:19.581179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:19.593219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:19.593676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:19.594472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:19.594914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:19.600196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:19.828279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:19.851856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:19.858587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:19.860252 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6414444f-5505-4036-a6d9-cbf1a14af846 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 2163 microversion: 2.42 time: 0.284074 Jul 26 19:59:19.860936 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1741/3478] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:19 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 2163 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:19.870103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1e990f1-9033-4dde-87bb-f13ae13568fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Action: 'update', calling method: .version_select at 0x7f8756f45ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:19.988879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1e990f1-9033-4dde-87bb-f13ae13568fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:19.989331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1e990f1-9033-4dde-87bb-f13ae13568fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:19.990330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1e990f1-9033-4dde-87bb-f13ae13568fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:19.990943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1e990f1-9033-4dde-87bb-f13ae13568fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:20.060839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:20.075017 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1e990f1-9033-4dde-87bb-f13ae13568fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/f21a9083e63f458381839e7f2f110a09" status: 200 len: 328 microversion: 2.1 time: 0.212396 Jul 26 19:59:20.075757 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1742/3479] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:59:19 2022] PUT /compute/v2.1/os-quota-sets/f21a9083e63f458381839e7f2f110a09 => generated 328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:20.092302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:20.097307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:20.098833 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-79918e4c-d23e-436f-86f5-a92c742b28e9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.694550 Jul 26 19:59:20.101981 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1738/3480] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:19 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:20.110175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f54c4bc2-d469-44bf-964c-83fa282f6fb3 req-eda73573-1724-430e-97f1-da653913353a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-plugged", "status": "completed", "tag": "bf0697cb-e330-45a1-909c-22998a643533"}, {"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-plugged", "status": "completed", "tag": "6ad30944-b73a-4ace-827b-888b0b01a8ea"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:20.122870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa4fe2b6-5adf-4ea4-bdbb-f366a71254d0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:20.123573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa4fe2b6-5adf-4ea4-bdbb-f366a71254d0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:20.151401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f54c4bc2-d469-44bf-964c-83fa282f6fb3 req-eda73573-1724-430e-97f1-da653913353a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:20.154386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f54c4bc2-d469-44bf-964c-83fa282f6fb3 req-eda73573-1724-430e-97f1-da653913353a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:20.187513 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f54c4bc2-d469-44bf-964c-83fa282f6fb3 req-eda73573-1724-430e-97f1-da653913353a service nova] Creating event network-vif-plugged:bf0697cb-e330-45a1-909c-22998a643533 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:59:20.188345 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f54c4bc2-d469-44bf-964c-83fa282f6fb3 req-eda73573-1724-430e-97f1-da653913353a service nova] Creating event network-vif-plugged:6ad30944-b73a-4ace-827b-888b0b01a8ea for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:59:20.201560 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f54c4bc2-d469-44bf-964c-83fa282f6fb3 req-eda73573-1724-430e-97f1-da653913353a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.122723 Jul 26 19:59:20.202588 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1743/3481] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:20.208077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2800362-4db4-4692-91ba-bedc2b838c23 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:20.217566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d2800362-4db4-4692-91ba-bedc2b838c23 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:20.230124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2800362-4db4-4692-91ba-bedc2b838c23 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:20.230606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2800362-4db4-4692-91ba-bedc2b838c23 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:20.231562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2800362-4db4-4692-91ba-bedc2b838c23 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:20.232104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2800362-4db4-4692-91ba-bedc2b838c23 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:20.357639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa4fe2b6-5adf-4ea4-bdbb-f366a71254d0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:20.367294 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa4fe2b6-5adf-4ea4-bdbb-f366a71254d0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1216 microversion: 2.1 time: 0.261442 Jul 26 19:59:20.376553 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1739/3482] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:20 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1216 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:20.388181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-65ec846b-5cbd-480a-a9b2-88a99ab56b1f tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:20.428767 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-65ec846b-5cbd-480a-a9b2-88a99ab56b1f tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-quota-sets/f21a9083e63f458381839e7f2f110a09" status: 202 len: 0 microversion: 2.1 time: 0.051022 Jul 26 19:59:20.429680 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1740/3483] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 19:59:20 2022] DELETE /compute/v2.1/os-quota-sets/f21a9083e63f458381839e7f2f110a09 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:59:20.438828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f97eb46a-c6d2-41b4-bedc-85f7ad4bfb72 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Calling method '.version_select at 0x7f875ec63790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:20.640295 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f97eb46a-c6d2-41b4-bedc-85f7ad4bfb72 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/f21a9083e63f458381839e7f2f110a09" status: 200 len: 371 microversion: 2.1 time: 0.205420 Jul 26 19:59:20.651970 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1741/3484] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 19:59:20 2022] GET /compute/v2.1/os-quota-sets/f21a9083e63f458381839e7f2f110a09 => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:20.657138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6632c96b-cc69-4193-8164-aa0dfd737d03 req-cb2bc439-125a-4c87-8964-ab1951794e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0605a-419a-4c09-821e-acdb59458647", "name": "network-vif-deleted", "tag": "0ad81dfc-1d62-45e5-844d-8e3f948affe9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:20.673969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6632c96b-cc69-4193-8164-aa0dfd737d03 req-cb2bc439-125a-4c87-8964-ab1951794e01 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:20.674422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6632c96b-cc69-4193-8164-aa0dfd737d03 req-cb2bc439-125a-4c87-8964-ab1951794e01 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:20.701259 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6632c96b-cc69-4193-8164-aa0dfd737d03 req-cb2bc439-125a-4c87-8964-ab1951794e01 service nova] Creating event network-vif-deleted:0ad81dfc-1d62-45e5-844d-8e3f948affe9 for instance eeb0605a-419a-4c09-821e-acdb59458647 on n-h2-708768-8 Jul 26 19:59:20.724696 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6632c96b-cc69-4193-8164-aa0dfd737d03 req-cb2bc439-125a-4c87-8964-ab1951794e01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064088 Jul 26 19:59:20.725691 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1742/3485] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:20.877398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1074f474-d9e0-4415-b952-e0d65955e07f tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Calling method '.version_select at 0x7f875f117d30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:21.015800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d2800362-4db4-4692-91ba-bedc2b838c23 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:21.040192 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d2800362-4db4-4692-91ba-bedc2b838c23 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.835977 Jul 26 19:59:21.060027 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1744/3486] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:20 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:21.066885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:21.067877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:21.075199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:21.076509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:21.077645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:21.078335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:21.224201 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1074f474-d9e0-4415-b952-e0d65955e07f tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/9135836a59204c24a776b6e4a8b13500/defaults" status: 200 len: 371 microversion: 2.1 time: 0.350770 Jul 26 19:59:21.233813 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1743/3487] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:59:20 2022] GET /compute/v2.1/os-quota-sets/9135836a59204c24a776b6e4a8b13500/defaults => generated 371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:21.234028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:21.245462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:21.247000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:21.247539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:21.248269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f979e357-c4bd-4c44-87ad-30a552468a1b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.187444 Jul 26 19:59:21.248399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:21.259918 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1745/3488] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:21 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:21.284239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:21.284687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:21.293526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:21.294112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:21.396320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-48ca72fd-e797-465b-ad57-457f85f59871 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:21.397216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-48ca72fd-e797-465b-ad57-457f85f59871 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:21.412949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48ca72fd-e797-465b-ad57-457f85f59871 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:21.418947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48ca72fd-e797-465b-ad57-457f85f59871 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:21.429825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48ca72fd-e797-465b-ad57-457f85f59871 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:21.430546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48ca72fd-e797-465b-ad57-457f85f59871 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:21.633259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-48ca72fd-e797-465b-ad57-457f85f59871 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:21.647080 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-48ca72fd-e797-465b-ad57-457f85f59871 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1274 microversion: 2.1 time: 0.254703 Jul 26 19:59:21.659652 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1746/3489] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:21 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:21.701315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-86ddaa37-8a39-4175-b600-181f95757d6e tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Action: 'update', calling method: .version_select at 0x7f875761aa60>, body: {"quota_set": {"ram": "5120"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:21.893700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:21.907196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:21.910023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:21.911372 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-12923700-c95b-494e-920c-283ad93d18d8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.684617 Jul 26 19:59:21.920268 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1744/3490] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:21 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:22.045182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86ddaa37-8a39-4175-b600-181f95757d6e tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.046600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86ddaa37-8a39-4175-b600-181f95757d6e tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.049277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86ddaa37-8a39-4175-b600-181f95757d6e tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.050384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86ddaa37-8a39-4175-b600-181f95757d6e tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.066981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97ea1e26-c9b2-46f1-9ebc-d58eb5359485 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:22.067935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97ea1e26-c9b2-46f1-9ebc-d58eb5359485 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:22.078038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97ea1e26-c9b2-46f1-9ebc-d58eb5359485 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.078487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97ea1e26-c9b2-46f1-9ebc-d58eb5359485 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.079267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97ea1e26-c9b2-46f1-9ebc-d58eb5359485 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.079740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97ea1e26-c9b2-46f1-9ebc-d58eb5359485 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.193545 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-86ddaa37-8a39-4175-b600-181f95757d6e tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/c4374a9eb2de4630ad7e01138b5636c0" status: 200 len: 328 microversion: 2.1 time: 0.495913 Jul 26 19:59:22.199059 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1747/3491] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 19:59:21 2022] PUT /compute/v2.1/os-quota-sets/c4374a9eb2de4630ad7e01138b5636c0 => generated 328 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:22.213373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9fd656e9-86fe-4625-a7da-f0ad3c428354 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Calling method '.version_select at 0x7f87574b3550>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:22.325049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9fd656e9-86fe-4625-a7da-f0ad3c428354 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.325509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9fd656e9-86fe-4625-a7da-f0ad3c428354 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.326319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9fd656e9-86fe-4625-a7da-f0ad3c428354 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.329096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9fd656e9-86fe-4625-a7da-f0ad3c428354 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.381321 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9fd656e9-86fe-4625-a7da-f0ad3c428354 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c4374a9eb2de4630ad7e01138b5636c0/detail" status: 200 len: 916 microversion: 2.1 time: 0.175700 Jul 26 19:59:22.382508 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1748/3492] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:59:22 2022] GET /compute/v2.1/os-quota-sets/c4374a9eb2de4630ad7e01138b5636c0/detail => generated 916 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:59:22.388588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:22.389208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:22.425766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.426264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.427092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.427539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.493195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97ea1e26-c9b2-46f1-9ebc-d58eb5359485 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:22.503640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97ea1e26-c9b2-46f1-9ebc-d58eb5359485 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.441093 Jul 26 19:59:22.506674 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1745/3493] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:22 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:22.674470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f059f395-a31d-4d37-bde3-aca40ebb15af tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:22.676082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f059f395-a31d-4d37-bde3-aca40ebb15af tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:22.703543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f059f395-a31d-4d37-bde3-aca40ebb15af tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.704424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f059f395-a31d-4d37-bde3-aca40ebb15af tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.708205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f059f395-a31d-4d37-bde3-aca40ebb15af tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:22.709743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f059f395-a31d-4d37-bde3-aca40ebb15af tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:22.941051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:22.968255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:22.976385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:22.981730 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-403d11a8-d99f-4ee1-978c-d34c7720b442 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.597097 Jul 26 19:59:22.984023 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1749/3494] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:22 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:22.996356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-307a265c-a2b3-4b31-bdb8-41b2195b5028 req-6735b8fc-8224-4ace-ad7b-97d4f7120741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-plugged", "status": "completed", "tag": "416b5295-1a24-4ec5-b91d-06450d8eb3c8"}, {"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-plugged", "status": "completed", "tag": "4a2560ce-2348-4752-8688-b4bcf611e22a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:23.025456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-307a265c-a2b3-4b31-bdb8-41b2195b5028 req-6735b8fc-8224-4ace-ad7b-97d4f7120741 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.026242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-307a265c-a2b3-4b31-bdb8-41b2195b5028 req-6735b8fc-8224-4ace-ad7b-97d4f7120741 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:23.055826 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-307a265c-a2b3-4b31-bdb8-41b2195b5028 req-6735b8fc-8224-4ace-ad7b-97d4f7120741 service nova] Creating event network-vif-plugged:416b5295-1a24-4ec5-b91d-06450d8eb3c8 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:59:23.068300 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-307a265c-a2b3-4b31-bdb8-41b2195b5028 req-6735b8fc-8224-4ace-ad7b-97d4f7120741 service nova] Creating event network-vif-plugged:4a2560ce-2348-4752-8688-b4bcf611e22a for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:59:23.079755 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-307a265c-a2b3-4b31-bdb8-41b2195b5028 req-6735b8fc-8224-4ace-ad7b-97d4f7120741 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094274 Jul 26 19:59:23.086621 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1750/3495] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:23.097137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Action: 'update', calling method: .version_select at 0x7f8757338160>, body: {"quota_set": {"ram": "2048"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:23.415055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f059f395-a31d-4d37-bde3-aca40ebb15af tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:23.445200 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f059f395-a31d-4d37-bde3-aca40ebb15af tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1316 microversion: 2.1 time: 0.775620 Jul 26 19:59:23.458836 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1746/3496] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:22 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1316 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:23.467529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:23.479411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:23.497953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.500463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:23.503952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.506028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:23.565409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.565860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:23.572322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.573029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:23.660167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.660890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:23.662450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.663067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:23.721003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:23.796177 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b87f5789-d79a-41c3-a98f-1096927db6ab tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/c4374a9eb2de4630ad7e01138b5636c0?user_id=7d027507f2e24bc0ab82e5e7183dd98f" status: 200 len: 328 microversion: 2.1 time: 0.707881 Jul 26 19:59:23.803521 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1751/3497] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 19:59:23 2022] PUT /compute/v2.1/os-quota-sets/c4374a9eb2de4630ad7e01138b5636c0?user_id=7d027507f2e24bc0ab82e5e7183dd98f => generated 328 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:23.811932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4da2fb0e-f574-4a34-829f-63c95f1f7a58 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:23.812692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4da2fb0e-f574-4a34-829f-63c95f1f7a58 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:23.838057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4da2fb0e-f574-4a34-829f-63c95f1f7a58 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.838396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4da2fb0e-f574-4a34-829f-63c95f1f7a58 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:23.842544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4da2fb0e-f574-4a34-829f-63c95f1f7a58 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:23.845590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4da2fb0e-f574-4a34-829f-63c95f1f7a58 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:24.008538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:24.019733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:24.025846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:24.045676 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d91d8263-b03c-4317-a903-46888867a2a0 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.583404 Jul 26 19:59:24.049035 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1747/3498] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:23 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:24.054355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f3640c62-29be-41ba-8a74-f566bfe4e200 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Calling method '.version_select at 0x7f875f43cd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:24.253347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4da2fb0e-f574-4a34-829f-63c95f1f7a58 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:24.266023 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4da2fb0e-f574-4a34-829f-63c95f1f7a58 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.465070 Jul 26 19:59:24.270291 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1752/3499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:23 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:24.275952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:24.276585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:24.303239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:24.308195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:24.316090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:24.316627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:24.450127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:24.463442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:24.476878 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f3640c62-29be-41ba-8a74-f566bfe4e200 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c4374a9eb2de4630ad7e01138b5636c0?user_id=7d027507f2e24bc0ab82e5e7183dd98f" status: 200 len: 370 microversion: 2.1 time: 0.425969 Jul 26 19:59:24.477180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:24.478278 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3c8ab70-4155-4fbc-a053-0fae0ed81e3a tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.206720 Jul 26 19:59:24.478964 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1753/3500] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:24 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:24.479496 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1748/3501] 10.222.0.58 () {58 vars in 1323 bytes} [Tue Jul 26 19:59:24 2022] GET /compute/v2.1/os-quota-sets/c4374a9eb2de4630ad7e01138b5636c0?user_id=7d027507f2e24bc0ab82e5e7183dd98f => generated 370 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:24.499751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2889d59-7048-4738-939c-9a0e284efbcb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:24.500947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f2889d59-7048-4738-939c-9a0e284efbcb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:24.516529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2889d59-7048-4738-939c-9a0e284efbcb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:24.517367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2889d59-7048-4738-939c-9a0e284efbcb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:24.518551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2889d59-7048-4738-939c-9a0e284efbcb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:24.519196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2889d59-7048-4738-939c-9a0e284efbcb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:24.688609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-41956d23-21ae-47f2-afd1-06fc3da09553 req-f77ac6de-46e7-42db-a2e8-1e8ebde52fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0321d941-da42-4951-83a6-0a609cd9344b", "tag": "82a2ab61-ef06-4d3f-9e1d-9cd39e169e96"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:24.718982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-41956d23-21ae-47f2-afd1-06fc3da09553 req-f77ac6de-46e7-42db-a2e8-1e8ebde52fff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:24.719854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-41956d23-21ae-47f2-afd1-06fc3da09553 req-f77ac6de-46e7-42db-a2e8-1e8ebde52fff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:24.766693 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-41956d23-21ae-47f2-afd1-06fc3da09553 req-f77ac6de-46e7-42db-a2e8-1e8ebde52fff service nova] Creating event network-changed:82a2ab61-ef06-4d3f-9e1d-9cd39e169e96 for instance 0321d941-da42-4951-83a6-0a609cd9344b on n-h2-708768-8 Jul 26 19:59:24.781385 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-41956d23-21ae-47f2-afd1-06fc3da09553 req-f77ac6de-46e7-42db-a2e8-1e8ebde52fff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096766 Jul 26 19:59:24.783167 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1749/3502] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:25.076452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b218b895-cea6-4db6-9f24-12387023377b tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Calling method '.version_select at 0x7f875f249670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:25.413733 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b218b895-cea6-4db6-9f24-12387023377b tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/9135836a59204c24a776b6e4a8b13500/defaults" status: 200 len: 371 microversion: 2.1 time: 0.343839 Jul 26 19:59:25.418652 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1750/3503] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:59:25 2022] GET /compute/v2.1/os-quota-sets/9135836a59204c24a776b6e4a8b13500/defaults => generated 371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:59:25.433352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:25.433352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:25.444255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:25.444723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:25.445559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:25.446003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:25.593467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f2889d59-7048-4738-939c-9a0e284efbcb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:25.604735 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f2889d59-7048-4738-939c-9a0e284efbcb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1316 microversion: 2.1 time: 1.124673 Jul 26 19:59:25.606740 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1754/3504] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:24 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1316 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:25.611903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-929b63ef-69b1-4be9-bccf-99d45e74a8e1 req-552d37a8-8e18-47ee-9f9a-bf2fe540ee48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-plugged", "status": "completed", "tag": "60776fda-42ee-4ff6-9939-bd5eb8e38a33"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:25.624118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-929b63ef-69b1-4be9-bccf-99d45e74a8e1 req-552d37a8-8e18-47ee-9f9a-bf2fe540ee48 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:25.625033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-929b63ef-69b1-4be9-bccf-99d45e74a8e1 req-552d37a8-8e18-47ee-9f9a-bf2fe540ee48 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:25.646319 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-929b63ef-69b1-4be9-bccf-99d45e74a8e1 req-552d37a8-8e18-47ee-9f9a-bf2fe540ee48 service nova] Creating event network-vif-plugged:60776fda-42ee-4ff6-9939-bd5eb8e38a33 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:59:25.662694 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-929b63ef-69b1-4be9-bccf-99d45e74a8e1 req-552d37a8-8e18-47ee-9f9a-bf2fe540ee48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054411 Jul 26 19:59:25.663746 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1755/3505] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:25.673546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a20d04c-1490-42d0-be54-200e27c78194 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:25.677215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a20d04c-1490-42d0-be54-200e27c78194 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:25.690801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a20d04c-1490-42d0-be54-200e27c78194 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:25.691167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a20d04c-1490-42d0-be54-200e27c78194 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:25.695313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a20d04c-1490-42d0-be54-200e27c78194 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:25.696013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a20d04c-1490-42d0-be54-200e27c78194 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.082957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9a20d04c-1490-42d0-be54-200e27c78194 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:26.091812 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a20d04c-1490-42d0-be54-200e27c78194 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.426524 Jul 26 19:59:26.092420 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1756/3506] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:25 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:26.110974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-20411803-3637-4837-b72a-331c27e1d8fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Action: 'update', calling method: .version_select at 0x7f8768411310>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:26.252956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20411803-3637-4837-b72a-331c27e1d8fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:26.255722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20411803-3637-4837-b72a-331c27e1d8fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.256647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20411803-3637-4837-b72a-331c27e1d8fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:26.257093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20411803-3637-4837-b72a-331c27e1d8fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.262061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:26.279317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:26.282145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:26.283382 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1768161a-88c3-4024-8b1a-cbe906da3bec tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.863647 Jul 26 19:59:26.288192 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1751/3507] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:25 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:26.295170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:26.301841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:26.315265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:26.317442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.318475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:26.320528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.554497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:26.577217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:26.583213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:26.588472 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0dba8a01-a962-4e0a-8858-90d875cba6df tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.298982 Jul 26 19:59:26.594110 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1752/3508] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:26 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:26.631473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cabd9fd3-e191-4e43-8c3f-6fce15789ffe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:26.632107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cabd9fd3-e191-4e43-8c3f-6fce15789ffe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:26.641875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cabd9fd3-e191-4e43-8c3f-6fce15789ffe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:26.642330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cabd9fd3-e191-4e43-8c3f-6fce15789ffe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.643115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cabd9fd3-e191-4e43-8c3f-6fce15789ffe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:26.643551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cabd9fd3-e191-4e43-8c3f-6fce15789ffe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.662296 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-20411803-3637-4837-b72a-331c27e1d8fa tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/9135836a59204c24a776b6e4a8b13500" status: 200 len: 329 microversion: 2.1 time: 0.567250 Jul 26 19:59:26.670766 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1757/3509] 10.222.0.58 () {60 vars in 1263 bytes} [Tue Jul 26 19:59:26 2022] PUT /compute/v2.1/os-quota-sets/9135836a59204c24a776b6e4a8b13500 => generated 329 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:26.680028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7d3aae28-ac99-4663-92ad-d1911b027170 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Action: 'update', calling method: .version_select at 0x7f8768399940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:26.809882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d3aae28-ac99-4663-92ad-d1911b027170 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:26.810336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d3aae28-ac99-4663-92ad-d1911b027170 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.811235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d3aae28-ac99-4663-92ad-d1911b027170 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:26.811696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d3aae28-ac99-4663-92ad-d1911b027170 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:26.886067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cabd9fd3-e191-4e43-8c3f-6fce15789ffe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:26.896442 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cabd9fd3-e191-4e43-8c3f-6fce15789ffe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1316 microversion: 2.1 time: 0.269801 Jul 26 19:59:26.898426 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1753/3510] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:26 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:27.116720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f4c1016b-91c6-4c65-b510-99acefbe0c51 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:27.117672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f4c1016b-91c6-4c65-b510-99acefbe0c51 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:27.142411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4c1016b-91c6-4c65-b510-99acefbe0c51 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:27.142937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4c1016b-91c6-4c65-b510-99acefbe0c51 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:27.144817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4c1016b-91c6-4c65-b510-99acefbe0c51 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:27.146211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4c1016b-91c6-4c65-b510-99acefbe0c51 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:27.160954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=23,nova_api:UPDATE=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:27.304938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:27.401028 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7d3aae28-ac99-4663-92ad-d1911b027170 tempest-QuotasAdminTestJSON-1513631803 tempest-QuotasAdminTestJSON-1513631803-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/9135836a59204c24a776b6e4a8b13500" status: 200 len: 329 microversion: 2.1 time: 0.729053 Jul 26 19:59:27.409245 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1758/3511] 10.222.0.58 () {60 vars in 1263 bytes} [Tue Jul 26 19:59:26 2022] PUT /compute/v2.1/os-quota-sets/9135836a59204c24a776b6e4a8b13500 => generated 329 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:27.417961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:27.418704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:27.429642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:27.430113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:27.431627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:27.432319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:27.583538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f4c1016b-91c6-4c65-b510-99acefbe0c51 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:27.594990 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f4c1016b-91c6-4c65-b510-99acefbe0c51 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.482862 Jul 26 19:59:27.609097 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1754/3512] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:27 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:27.623036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:27.624066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:27.632189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:27.635125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:27.636277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:27.637275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:27.638045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:27.824668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:27.838008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:27.846202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:27.848827 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c5aa38c2-c1d6-43c9-ad1b-09a6f108ba1c tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.230965 Jul 26 19:59:27.870819 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1755/3513] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:27 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:27.882120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b491a8dc-37f5-400e-97e6-349dfcf1ba88 req-b78b5b8d-0345-4c6a-aaa9-88c8c5e52875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-plugged", "status": "completed", "tag": "e395b810-ac28-4698-a37b-dcec92a493f6"}, {"server_uuid": "dd66cf0a-f4e4-4302-9442-01163ee9a46d", "name": "network-vif-plugged", "status": "completed", "tag": "f188fd2b-0a4a-4ea1-a30c-78990e302ca5"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:27.908949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b491a8dc-37f5-400e-97e6-349dfcf1ba88 req-b78b5b8d-0345-4c6a-aaa9-88c8c5e52875 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:27.909748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b491a8dc-37f5-400e-97e6-349dfcf1ba88 req-b78b5b8d-0345-4c6a-aaa9-88c8c5e52875 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:27.943925 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b491a8dc-37f5-400e-97e6-349dfcf1ba88 req-b78b5b8d-0345-4c6a-aaa9-88c8c5e52875 service nova] Creating event network-vif-plugged:e395b810-ac28-4698-a37b-dcec92a493f6 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:59:27.944970 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b491a8dc-37f5-400e-97e6-349dfcf1ba88 req-b78b5b8d-0345-4c6a-aaa9-88c8c5e52875 service nova] Creating event network-vif-plugged:f188fd2b-0a4a-4ea1-a30c-78990e302ca5 for instance dd66cf0a-f4e4-4302-9442-01163ee9a46d on n-h1-708768-8 Jul 26 19:59:27.961318 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b491a8dc-37f5-400e-97e6-349dfcf1ba88 req-b78b5b8d-0345-4c6a-aaa9-88c8c5e52875 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088755 Jul 26 19:59:27.969815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1756/3514] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:27.985836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0a164f5-fa76-462e-a5c7-004da93b70c5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:27.988746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0a164f5-fa76-462e-a5c7-004da93b70c5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:28.007129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0a164f5-fa76-462e-a5c7-004da93b70c5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:28.009725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0a164f5-fa76-462e-a5c7-004da93b70c5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:28.011329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0a164f5-fa76-462e-a5c7-004da93b70c5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:28.015236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0a164f5-fa76-462e-a5c7-004da93b70c5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:28.019727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:28.054778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:28.078392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:28.080091 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf5af5cc-8c90-4615-b4d0-6ef3b410d754 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.674634 Jul 26 19:59:28.089603 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1759/3515] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:27 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:28.465248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b0a164f5-fa76-462e-a5c7-004da93b70c5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:28.485601 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0a164f5-fa76-462e-a5c7-004da93b70c5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1316 microversion: 2.1 time: 0.508301 Jul 26 19:59:28.500293 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1757/3516] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:27 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:28.618574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-40fb6c51-0b6a-4b90-9e3d-8d1a70314ea2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:28.619949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40fb6c51-0b6a-4b90-9e3d-8d1a70314ea2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:28.628642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40fb6c51-0b6a-4b90-9e3d-8d1a70314ea2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:28.629105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40fb6c51-0b6a-4b90-9e3d-8d1a70314ea2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:28.629949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40fb6c51-0b6a-4b90-9e3d-8d1a70314ea2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:28.630393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40fb6c51-0b6a-4b90-9e3d-8d1a70314ea2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:28.876342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:28.877555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:28.898671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:28.899138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:28.900023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:28.900934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:29.027777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:29.041805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:29.045440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:29.047978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1f231ebb-1527-4cc8-a047-f9ab42321e7b tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.175452 Jul 26 19:59:29.050134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-40fb6c51-0b6a-4b90-9e3d-8d1a70314ea2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:29.054196 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1758/3517] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:28 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:29.064400 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-40fb6c51-0b6a-4b90-9e3d-8d1a70314ea2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.443726 Jul 26 19:59:29.066164 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1760/3518] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:28 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:29.119063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:29.120101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:29.126990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:29.127597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:29.128638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:29.129279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:29.159286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:29.513137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-67778537-31b1-4a33-bfa0-8639b6fffc0e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:29.513557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-67778537-31b1-4a33-bfa0-8639b6fffc0e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:29.529147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67778537-31b1-4a33-bfa0-8639b6fffc0e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:29.530139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67778537-31b1-4a33-bfa0-8639b6fffc0e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:29.532088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67778537-31b1-4a33-bfa0-8639b6fffc0e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:29.532561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-67778537-31b1-4a33-bfa0-8639b6fffc0e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:29.641983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:29.662776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:29.671384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:29.676141 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b5ca101b-3369-4760-a078-b98f3c0bc847 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1874 microversion: 2.32 time: 0.560705 Jul 26 19:59:29.680164 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1759/3519] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:29 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1874 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:29.888472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-67778537-31b1-4a33-bfa0-8639b6fffc0e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:29.897301 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-67778537-31b1-4a33-bfa0-8639b6fffc0e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1316 microversion: 2.1 time: 0.389792 Jul 26 19:59:29.905178 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1761/3520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:29 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:30.074229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:30.074943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:30.089114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c0cb5eaa-39b3-4821-9125-a4a5acc19850 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:30.089828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c0cb5eaa-39b3-4821-9125-a4a5acc19850 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:30.092460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.101247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0cb5eaa-39b3-4821-9125-a4a5acc19850 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.101711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0cb5eaa-39b3-4821-9125-a4a5acc19850 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.102103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.102514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0cb5eaa-39b3-4821-9125-a4a5acc19850 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.102993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0cb5eaa-39b3-4821-9125-a4a5acc19850 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.104090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.113775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.373093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c0cb5eaa-39b3-4821-9125-a4a5acc19850 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:30.386022 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c0cb5eaa-39b3-4821-9125-a4a5acc19850 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1365 microversion: 2.1 time: 0.303660 Jul 26 19:59:30.387081 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1762/3521] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:30 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:30.405150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-235939a1-21c3-432e-92a5-68651f84199e req-c501dcd5-ef0d-4949-a576-5b099e549514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0321d941-da42-4951-83a6-0a609cd9344b", "name": "network-vif-plugged", "status": "completed", "tag": "82a2ab61-ef06-4d3f-9e1d-9cd39e169e96"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:30.425005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-235939a1-21c3-432e-92a5-68651f84199e req-c501dcd5-ef0d-4949-a576-5b099e549514 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.427407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-235939a1-21c3-432e-92a5-68651f84199e req-c501dcd5-ef0d-4949-a576-5b099e549514 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.456388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:30.463214 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-235939a1-21c3-432e-92a5-68651f84199e req-c501dcd5-ef0d-4949-a576-5b099e549514 service nova] Creating event network-vif-plugged:82a2ab61-ef06-4d3f-9e1d-9cd39e169e96 for instance 0321d941-da42-4951-83a6-0a609cd9344b on n-h2-708768-8 Jul 26 19:59:30.473053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:30.474999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:30.481822 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bd4a4a21-5292-451f-9e17-a673b6e5f259 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.411051 Jul 26 19:59:30.485166 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1760/3522] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:30 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:30.504136 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-235939a1-21c3-432e-92a5-68651f84199e req-c501dcd5-ef0d-4949-a576-5b099e549514 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102281 Jul 26 19:59:30.505756 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1763/3523] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:30.705883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:30.706512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:30.719211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.719808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.720791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.721428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.926258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f8665fd-e225-4354-81ba-869cf9edaff2 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:30.926973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f8665fd-e225-4354-81ba-869cf9edaff2 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:30.939279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f8665fd-e225-4354-81ba-869cf9edaff2 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.940727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f8665fd-e225-4354-81ba-869cf9edaff2 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.941690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f8665fd-e225-4354-81ba-869cf9edaff2 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:30.942769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f8665fd-e225-4354-81ba-869cf9edaff2 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:30.971378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:31.178395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:31.200056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:31.202395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:31.204091 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7ae2672-e55c-4743-bc1c-2cf1f70e42de tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2826 microversion: 2.32 time: 0.502300 Jul 26 19:59:31.225302 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1761/3524] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:30 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2826 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:31.231092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97e37ac4-1d72-4bf0-9a90-8a823d876ad2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:31.232363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97e37ac4-1d72-4bf0-9a90-8a823d876ad2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:31.239897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97e37ac4-1d72-4bf0-9a90-8a823d876ad2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:31.240604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97e37ac4-1d72-4bf0-9a90-8a823d876ad2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:31.241848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97e37ac4-1d72-4bf0-9a90-8a823d876ad2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:31.242517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97e37ac4-1d72-4bf0-9a90-8a823d876ad2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:31.328005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f8665fd-e225-4354-81ba-869cf9edaff2 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:31.348517 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f8665fd-e225-4354-81ba-869cf9edaff2 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1316 microversion: 2.1 time: 0.420162 Jul 26 19:59:31.350624 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1764/3525] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:30 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:31.410814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c44e2115-ca86-4b13-92ae-0232fc2b6b28 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:31.413121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c44e2115-ca86-4b13-92ae-0232fc2b6b28 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:31.428053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c44e2115-ca86-4b13-92ae-0232fc2b6b28 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:31.429922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c44e2115-ca86-4b13-92ae-0232fc2b6b28 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:31.434883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c44e2115-ca86-4b13-92ae-0232fc2b6b28 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:31.436006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c44e2115-ca86-4b13-92ae-0232fc2b6b28 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:31.614174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c44e2115-ca86-4b13-92ae-0232fc2b6b28 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:31.617633 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97e37ac4-1d72-4bf0-9a90-8a823d876ad2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.390430 Jul 26 19:59:31.620307 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1762/3526] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Jul 26 19:59:31 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7/os-interface => generated 1831 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:31.623194 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c44e2115-ca86-4b13-92ae-0232fc2b6b28 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1554 microversion: 2.1 time: 0.219510 Jul 26 19:59:31.634507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:31.635527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:31.637873 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1765/3527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:31 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1554 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:31.645557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df20ffd3-2962-41ad-9508-309e3be31a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:31.646310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df20ffd3-2962-41ad-9508-309e3be31a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:31.650516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:31.651928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:31.653765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:31.654216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:31.655151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df20ffd3-2962-41ad-9508-309e3be31a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:31.655964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df20ffd3-2962-41ad-9508-309e3be31a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:31.656944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df20ffd3-2962-41ad-9508-309e3be31a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:31.657551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df20ffd3-2962-41ad-9508-309e3be31a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:31.789832 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df20ffd3-2962-41ad-9508-309e3be31a3e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148075 Jul 26 19:59:31.791201 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1766/3528] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 19:59:31 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:59:31.878090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:31.895919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:31.899953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:31.907251 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9dbceabf-483b-4eca-bd44-7fb9a97b3056 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.282696 Jul 26 19:59:31.920060 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1763/3529] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:31 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:32.375289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1ab428ef-9702-4950-9999-2f3a6c3db56a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:32.376760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1ab428ef-9702-4950-9999-2f3a6c3db56a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:32.389767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ab428ef-9702-4950-9999-2f3a6c3db56a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:32.392872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ab428ef-9702-4950-9999-2f3a6c3db56a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:32.395388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ab428ef-9702-4950-9999-2f3a6c3db56a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:32.396118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ab428ef-9702-4950-9999-2f3a6c3db56a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:32.803265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ab428ef-9702-4950-9999-2f3a6c3db56a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:32.834462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1ab428ef-9702-4950-9999-2f3a6c3db56a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1503 microversion: 2.1 time: 0.461582 Jul 26 19:59:32.837643 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1767/3530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:32 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1503 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:32.867439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87b1c3c7-65a8-4993-a00e-4ebac895ee03 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1706741964"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:32.868929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87b1c3c7-65a8-4993-a00e-4ebac895ee03 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:32.876947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87b1c3c7-65a8-4993-a00e-4ebac895ee03 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:32.877689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87b1c3c7-65a8-4993-a00e-4ebac895ee03 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:32.879584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87b1c3c7-65a8-4993-a00e-4ebac895ee03 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:32.880257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87b1c3c7-65a8-4993-a00e-4ebac895ee03 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:32.934433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:32.935334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:32.944507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:32.945378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:32.948070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:32.949100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:33.110300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:33.119783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:33.121809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:33.123497 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6c4871c1-d53f-4cd6-8350-e8795adc2f71 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.194361 Jul 26 19:59:33.124127 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1768/3531] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:32 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:33.410081 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.security_group_api [None req-87b1c3c7-65a8-4993-a00e-4ebac895ee03 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Adding security group f44a7d1b-5cf6-4f00-90c2-144e25d2cf29 to port 82a2ab61-ef06-4d3f-9e1d-9cd39e169e96 Jul 26 19:59:34.159176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:34.160375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:34.189114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:34.189576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:34.191190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:34.191669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:34.410047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:34.423828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:34.426723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:34.428747 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1469d242-1c5b-47b8-988b-9ae5b22656e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.283468 Jul 26 19:59:34.444330 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1769/3532] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:34 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:59:34.451744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bf63e58a-7c8b-4416-b45c-137d4be89ca3 req-1db93d4a-8287-4489-86dc-eca18f0401a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd66cf0a-f4e4-4302-9442-01163ee9a46d", "tag": "f188fd2b-0a4a-4ea1-a30c-78990e302ca5"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:34.466569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bf63e58a-7c8b-4416-b45c-137d4be89ca3 req-1db93d4a-8287-4489-86dc-eca18f0401a0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:34.467776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bf63e58a-7c8b-4416-b45c-137d4be89ca3 req-1db93d4a-8287-4489-86dc-eca18f0401a0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:34.471383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:34.484658 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bf63e58a-7c8b-4416-b45c-137d4be89ca3 req-1db93d4a-8287-4489-86dc-eca18f0401a0 service nova] Creating event network-changed:f188fd2b-0a4a-4ea1-a30c-78990e302ca5 for instance dd66cf0a-f4e4-4302-9442-01163ee9a46d on n-h1-708768-8 Jul 26 19:59:34.490185 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bf63e58a-7c8b-4416-b45c-137d4be89ca3 req-1db93d4a-8287-4489-86dc-eca18f0401a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044145 Jul 26 19:59:34.491499 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1770/3533] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:35.459107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:35.460010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:35.474494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:35.475042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:35.482033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:35.482648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:35.643784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:35.657563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:35.662709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:35.664165 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c767928-822a-4740-90ee-686f23494dd9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.210377 Jul 26 19:59:35.675452 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1771/3534] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:35 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:35.681887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5ed8314d-9ab2-49aa-905f-4d922dc5fcc3 req-968dc8a0-97b6-4492-a7f6-54108de742ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "tag": "bf0697cb-e330-45a1-909c-22998a643533"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:35.715914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5ed8314d-9ab2-49aa-905f-4d922dc5fcc3 req-968dc8a0-97b6-4492-a7f6-54108de742ff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:35.716543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5ed8314d-9ab2-49aa-905f-4d922dc5fcc3 req-968dc8a0-97b6-4492-a7f6-54108de742ff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:35.739030 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5ed8314d-9ab2-49aa-905f-4d922dc5fcc3 req-968dc8a0-97b6-4492-a7f6-54108de742ff service nova] Creating event network-changed:bf0697cb-e330-45a1-909c-22998a643533 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 19:59:35.753764 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5ed8314d-9ab2-49aa-905f-4d922dc5fcc3 req-968dc8a0-97b6-4492-a7f6-54108de742ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076720 Jul 26 19:59:35.754876 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1772/3535] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:35.871227 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87b1c3c7-65a8-4993-a00e-4ebac895ee03 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b/action" status: 202 len: 0 microversion: 2.1 time: 3.007538 Jul 26 19:59:35.872085 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1764/3536] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:59:32 2022] POST /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b/action => generated 0 bytes in 3009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:59:35.880871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fff855cc-7587-42f8-b669-7be7aae02f14 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-558842174"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:35.881807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fff855cc-7587-42f8-b669-7be7aae02f14 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:35.901578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fff855cc-7587-42f8-b669-7be7aae02f14 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:35.902038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fff855cc-7587-42f8-b669-7be7aae02f14 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:35.902838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fff855cc-7587-42f8-b669-7be7aae02f14 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:35.903280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fff855cc-7587-42f8-b669-7be7aae02f14 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:36.300043 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.network.security_group_api [None req-fff855cc-7587-42f8-b669-7be7aae02f14 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Adding security group 45af0cfc-d550-48c8-a9ce-e35c0de1b845 to port 82a2ab61-ef06-4d3f-9e1d-9cd39e169e96 Jul 26 19:59:36.703586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:36.704245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:36.723442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:36.723932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:36.724722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:36.725159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:36.823159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=17 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:36.864287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:36.874922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:36.877224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:36.878843 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0840b81e-e88c-4b7b-94d0-a84bd4ad207e tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.179142 Jul 26 19:59:36.879939 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1765/3537] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:36 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:59:37.385265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:37.910457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:37.912263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:37.924498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:37.925386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:37.926453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:37.927114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:38.105461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:38.123873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:38.145876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:38.148100 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cdd6916a-4b19-4ed8-b099-d9130d713d57 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.241609 Jul 26 19:59:38.164671 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1766/3538] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:37 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:59:38.178923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d7f8e1bc-b540-4904-b0df-9d3de4a723e6 req-bd257a98-1a91-47bb-a38e-b417d750c2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0321d941-da42-4951-83a6-0a609cd9344b", "tag": "82a2ab61-ef06-4d3f-9e1d-9cd39e169e96"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:38.191879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d7f8e1bc-b540-4904-b0df-9d3de4a723e6 req-bd257a98-1a91-47bb-a38e-b417d750c2e4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:38.198326 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fff855cc-7587-42f8-b669-7be7aae02f14 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b/action" status: 202 len: 0 microversion: 2.1 time: 2.321652 Jul 26 19:59:38.199472 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1773/3539] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 19:59:35 2022] POST /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b/action => generated 0 bytes in 2324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:59:38.202507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d7f8e1bc-b540-4904-b0df-9d3de4a723e6 req-bd257a98-1a91-47bb-a38e-b417d750c2e4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:38.207923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8804d9c2-c9e3-47ab-b0cb-d80f0fda3d9f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:38.208500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8804d9c2-c9e3-47ab-b0cb-d80f0fda3d9f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:38.223170 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d7f8e1bc-b540-4904-b0df-9d3de4a723e6 req-bd257a98-1a91-47bb-a38e-b417d750c2e4 service nova] Creating event network-changed:82a2ab61-ef06-4d3f-9e1d-9cd39e169e96 for instance 0321d941-da42-4951-83a6-0a609cd9344b on n-h2-708768-8 Jul 26 19:59:38.228217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8804d9c2-c9e3-47ab-b0cb-d80f0fda3d9f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:38.228746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8804d9c2-c9e3-47ab-b0cb-d80f0fda3d9f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:38.232182 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d7f8e1bc-b540-4904-b0df-9d3de4a723e6 req-bd257a98-1a91-47bb-a38e-b417d750c2e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065354 Jul 26 19:59:38.232441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8804d9c2-c9e3-47ab-b0cb-d80f0fda3d9f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:38.233578 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1767/3540] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:38.238024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8804d9c2-c9e3-47ab-b0cb-d80f0fda3d9f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:38.262940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e071c752-c0ea-46d1-aaab-69da6e4abb2e req-19bf79e8-566f-472e-a41a-8dfc25b2c8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0321d941-da42-4951-83a6-0a609cd9344b", "tag": "82a2ab61-ef06-4d3f-9e1d-9cd39e169e96"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:38.286300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e071c752-c0ea-46d1-aaab-69da6e4abb2e req-19bf79e8-566f-472e-a41a-8dfc25b2c8fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:38.287069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e071c752-c0ea-46d1-aaab-69da6e4abb2e req-19bf79e8-566f-472e-a41a-8dfc25b2c8fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:38.314797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e071c752-c0ea-46d1-aaab-69da6e4abb2e req-19bf79e8-566f-472e-a41a-8dfc25b2c8fe service nova] Creating event network-changed:82a2ab61-ef06-4d3f-9e1d-9cd39e169e96 for instance 0321d941-da42-4951-83a6-0a609cd9344b on n-h2-708768-8 Jul 26 19:59:38.320925 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e071c752-c0ea-46d1-aaab-69da6e4abb2e req-19bf79e8-566f-472e-a41a-8dfc25b2c8fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085330 Jul 26 19:59:38.325813 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1768/3541] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:38.654183 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8804d9c2-c9e3-47ab-b0cb-d80f0fda3d9f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.450858 Jul 26 19:59:38.655317 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1774/3542] 10.222.0.58 () {58 vars in 1293 bytes} [Tue Jul 26 19:59:38 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b/os-security-groups => generated 1155 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:38.679593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ff42c5b-5b7c-4dbe-940c-4900b78bcdb8 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f875ed345e0>, body: {"security_group": {"name": " tempest-securitygroup -1509416474 ", "description": "tempest-description-1322563898"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:39.063281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:39.071166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:39.073032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Searching by: {'deleted': False, 'project_id': 'c75d41d830114829b39e22cb1a46730e'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:59:39.095635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:39.098375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:39.099844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:39.100478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:39.166447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:59:39.241564 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44640bc4-fcad-4b51-9034-14a0bec2c506 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.192486 Jul 26 19:59:39.243944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1775/3543] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 19:59:39 2022] GET /compute/v2.1/servers => generated 340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:39.250262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:39.251493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:39.261552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:39.262253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:39.263678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:39.264618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:39.362517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:39.377609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:39.383313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:39.384781 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e400a30f-4062-4b1a-8295-38154c4d9702 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.139552 Jul 26 19:59:39.385383 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1776/3544] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:39 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:39.391460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:39.404683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:39.405775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Searching by: {'deleted': False, 'project_id': 'c75d41d830114829b39e22cb1a46730e'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 19:59:39.437871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:39.438354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:39.439164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:39.439726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:39.495039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 19:59:39.570160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:39.587808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:39.588542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:39.933051 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3b4ee7c-6424-4b95-a82e-a26a413322b6 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.546561 Jul 26 19:59:39.933653 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1777/3545] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 19:59:39 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:39.960568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf12aebc-c2e0-405d-885d-4c6c91c2480c tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:39.979990 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf12aebc-c2e0-405d-885d-4c6c91c2480c tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023098 Jul 26 19:59:39.981150 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1778/3546] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 19:59:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:40.349333 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6ff42c5b-5b7c-4dbe-940c-4900b78bcdb8 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.679315 Jul 26 19:59:40.350536 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1769/3547] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:59:38 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:40.366168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-432ef035-71c8-40c5-8312-6bc9643cafec tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f8756e7b700>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:40.408629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:40.409793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:40.424795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:40.425252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:40.426032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:40.428381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:40.536000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:40.552358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:40.553964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:40.563365 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d4369025-f3be-41fb-9634-149ec50038e1 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.155239 Jul 26 19:59:40.581874 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1770/3548] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:40 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 19:59:40.752268 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-432ef035-71c8-40c5-8312-6bc9643cafec tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725" status: 200 len: 224 microversion: 2.1 time: 0.391150 Jul 26 19:59:40.753402 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1779/3549] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:59:40 2022] GET /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725 => generated 224 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:40.773127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aba9a39b-74ec-49f7-b335-b2fe769affb0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ecdc430>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:40.849027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d8ad52d2-9714-45c4-b85b-866dc98272ca tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:40.850582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d8ad52d2-9714-45c4-b85b-866dc98272ca tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:40.864274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8ad52d2-9714-45c4-b85b-866dc98272ca tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:40.865499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8ad52d2-9714-45c4-b85b-866dc98272ca tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:40.867361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8ad52d2-9714-45c4-b85b-866dc98272ca tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:40.868103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8ad52d2-9714-45c4-b85b-866dc98272ca tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:40.924385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d8ad52d2-9714-45c4-b85b-866dc98272ca tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:59:41.198839 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aba9a39b-74ec-49f7-b335-b2fe769affb0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725" status: 202 len: 0 microversion: 2.1 time: 0.436146 Jul 26 19:59:41.199870 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1771/3550] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:59:40 2022] DELETE /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:59:41.209339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-51888dfe-8704-44eb-a507-f83596aa6336 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f8768385ca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:41.248373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d8ad52d2-9714-45c4-b85b-866dc98272ca tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 204 len: 0 microversion: 2.1 time: 0.413051 Jul 26 19:59:41.254637 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1780/3551] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 19:59:40 2022] DELETE /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:59:41.264661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79db541c-9078-4cb2-a450-ce4ec50562b0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:41.265374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-79db541c-9078-4cb2-a450-ce4ec50562b0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:41.285720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-51888dfe-8704-44eb-a507-f83596aa6336 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:59:41.286253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-51888dfe-8704-44eb-a507-f83596aa6336 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 not found {{(pid=125963) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:59:41.286825 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-51888dfe-8704-44eb-a507-f83596aa6336 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 19:59:41.286825 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-5ffdcc8e-4117-49d8-86c8-3450566cecc1'] Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-51888dfe-8704-44eb-a507-f83596aa6336 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725 HTTP/1.1 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-5ffdcc8e-4117-49d8-86c8-3450566cecc1'] Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '14db7ae0-8b06-478a-8f1b-bff7370a7725'} Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:59:41.289189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ffdcc8e-4117-49d8-86c8-3450566cecc1'] Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ffdcc8e-4117-49d8-86c8-3450566cecc1'] Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ffdcc8e-4117-49d8-86c8-3450566cecc1'] Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ffdcc8e-4117-49d8-86c8-3450566cecc1'] Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-51888dfe-8704-44eb-a507-f83596aa6336 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-5ffdcc8e-4117-49d8-86c8-3450566cecc1'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-51888dfe-8704-44eb-a507-f83596aa6336 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725" status: 404 len: 194 microversion: 2.1 time: 0.086780 Jul 26 19:59:41.300075 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1772/3552] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:59:41 2022] GET /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:59:41.306364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79db541c-9078-4cb2-a450-ce4ec50562b0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:41.310127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79db541c-9078-4cb2-a450-ce4ec50562b0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:41.311530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79db541c-9078-4cb2-a450-ce4ec50562b0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:41.314625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79db541c-9078-4cb2-a450-ce4ec50562b0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:41.319402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9bc144f0-b7de-4d47-becd-21ee1625d0ec tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f875e41dd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1300412298", "description": "tempest-description-641555051"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:41.715133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79db541c-9078-4cb2-a450-ce4ec50562b0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:41.728578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79db541c-9078-4cb2-a450-ce4ec50562b0 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1716 microversion: 2.1 time: 0.465867 Jul 26 19:59:41.730959 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1781/3553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:41 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1716 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:41.740496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:41.741861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:41.768519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:41.769373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:41.771937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:41.772927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:41.840604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:41.941941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:41.950237 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9bc144f0-b7de-4d47-becd-21ee1625d0ec tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.652874 Jul 26 19:59:41.960819 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1773/3554] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:59:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:59:41.972583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b326c717-a4a5-4c97-a259-c6c6be685414 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f875ebe1c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1468443865", "description": "tempest-description-1835750969"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:41.983368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:41.984928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:41.989132 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-83952601-e3c1-4214-962a-91928d5faffb tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1602 microversion: 2.42 time: 0.256776 Jul 26 19:59:41.991235 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1782/3555] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:41 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1602 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:42.609311 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b326c717-a4a5-4c97-a259-c6c6be685414 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.647203 Jul 26 19:59:42.610002 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1774/3556] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:59:41 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:42.622437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8af196bc-d32b-4049-b75e-9ba4dc9e5720 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f8756e63040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1507996367", "description": "tempest-description-636603709"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:42.753934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7cd9921-68e6-48eb-9b39-bacf00f5c496 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:42.754478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c7cd9921-68e6-48eb-9b39-bacf00f5c496 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:42.765643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7cd9921-68e6-48eb-9b39-bacf00f5c496 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:42.767363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7cd9921-68e6-48eb-9b39-bacf00f5c496 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:42.770445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7cd9921-68e6-48eb-9b39-bacf00f5c496 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:42.770923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7cd9921-68e6-48eb-9b39-bacf00f5c496 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:43.564469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c7cd9921-68e6-48eb-9b39-bacf00f5c496 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:43.598617 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c7cd9921-68e6-48eb-9b39-bacf00f5c496 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1716 microversion: 2.1 time: 0.843983 Jul 26 19:59:43.606102 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1775/3557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:42 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1716 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:43.625358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:43.626391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:43.651525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:43.656525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:43.658496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:43.659930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:43.713457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:43.714121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:43.715383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lazy-loading 'fault' on Instance uuid eeb0605a-419a-4c09-821e-acdb59458647 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:59:43.747866 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8af196bc-d32b-4049-b75e-9ba4dc9e5720 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.129508 Jul 26 19:59:43.749418 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1783/3558] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:59:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:43.765084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ec16a77-1f4c-4d27-b7d4-e0b16431cd82 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f87565ba160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:44.014512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:44.062356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:44.068477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb05da7a0eb48a182c4910331827161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215594acf68a48d081d99c2f58d35925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:44.076982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2412dffd-19de-4320-8e06-64b4eb0e5da8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 200 len: 1607 microversion: 2.42 time: 0.465851 Jul 26 19:59:44.078282 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1776/3559] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:43 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 1607 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:59:44.559454 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ec16a77-1f4c-4d27-b7d4-e0b16431cd82 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.801102 Jul 26 19:59:44.560617 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1784/3560] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:59:43 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:44.577008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4a76e1f-4029-4e10-8a36-4611a79ff3d5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875eeab5e0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:44.626311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-588f18f2-47bb-49ca-889a-b00dcea28ca7 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:44.627439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-588f18f2-47bb-49ca-889a-b00dcea28ca7 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:44.642118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-588f18f2-47bb-49ca-889a-b00dcea28ca7 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:44.643061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-588f18f2-47bb-49ca-889a-b00dcea28ca7 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:44.651031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-588f18f2-47bb-49ca-889a-b00dcea28ca7 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:44.651847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-588f18f2-47bb-49ca-889a-b00dcea28ca7 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:44.850263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-588f18f2-47bb-49ca-889a-b00dcea28ca7 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a9998874894955891cfe419a49de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75d41d830114829b39e22cb1a46730e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:44.861853 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-588f18f2-47bb-49ca-889a-b00dcea28ca7 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 200 len: 1648 microversion: 2.1 time: 0.237214 Jul 26 19:59:44.862802 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1785/3561] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:44 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 1648 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:45.121626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:45.123968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:45.137687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:45.144735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:45.146009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:45.146675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:45.177107 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] HTTP exception thrown: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Request method failure captured: Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 HTTP/1.1 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EYSvg3T5ylwGkBfitdv2-9K1Y3nHiWNRR6QJWysmdSmwQvl-J2wTKTJl-glNzZzVCBAkovrZrhEtegrQOzT0ceLG0NhBke_MEQfta0fmhQw8D0vq6LLUwTpofqMulweFS5RMLcPAg_0kTyTn26ZYzOAKpna7Px8wR53MiQpAClTnrw Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 215594acf68a48d081d99c2f58d35925 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/215594acf68a48d081d99c2f58d35925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/215594acf68a48d081d99c2f58d35925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_215594acf68a48d081d99c2f58d35925", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/215594acf68a48d081d99c2f58d35925"}]}] Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 215594acf68a48d081d99c2f58d35925 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TaggedBootDevicesTest_v242-1432171755-project Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9cb05da7a0eb48a182c4910331827161 Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1432171755-project Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'eeb0605a-419a-4c09-821e-acdb59458647'} Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.182635 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:45.189158 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.189158 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:45.189158 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:45.189158 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:45.189158 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:45.189158 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:45.189158 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:45.189158 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.191922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Returning 404 to user: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:45.193051 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c93bd5a-2755-4e40-905f-003e20861538 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 404 len: 111 microversion: 2.42 time: 0.092433 Jul 26 19:59:45.200024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1786/3562] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:45 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:59:45.404171 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4a76e1f-4029-4e10-8a36-4611a79ff3d5 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a1014af9-18fc-4a8b-981f-104101a22190" status: 202 len: 0 microversion: 2.1 time: 0.832469 Jul 26 19:59:45.407395 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1777/3563] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:59:44 2022] DELETE /compute/v2.1/os-security-groups/a1014af9-18fc-4a8b-981f-104101a22190 => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:59:45.420227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9eb18d2a-3540-4ea3-9de5-b19e27f4f1d9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '.version_select at 0x7f875ec6bca0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:45.501902 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9eb18d2a-3540-4ea3-9de5-b19e27f4f1d9 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84472231" status: 204 len: 0 microversion: 2.42 time: 0.093115 Jul 26 19:59:45.502608 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1778/3564] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 19:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84472231 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:59:45.518669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-14a2b2f5-c904-45d9-a971-91ac3247450b req-687e1fed-c5cc-42bf-b07a-1f0389b89333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c64238-cb11-404b-8360-4c9b9838b1d2", "name": "network-vif-deleted", "tag": "b66e0699-9709-4697-827f-5732deb28612"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:45.566213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-14a2b2f5-c904-45d9-a971-91ac3247450b req-687e1fed-c5cc-42bf-b07a-1f0389b89333 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:45.566684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-14a2b2f5-c904-45d9-a971-91ac3247450b req-687e1fed-c5cc-42bf-b07a-1f0389b89333 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:45.636259 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-14a2b2f5-c904-45d9-a971-91ac3247450b req-687e1fed-c5cc-42bf-b07a-1f0389b89333 service nova] Creating event network-vif-deleted:b66e0699-9709-4697-827f-5732deb28612 for instance b3c64238-cb11-404b-8360-4c9b9838b1d2 on n-h2-708768-8 Jul 26 19:59:45.692726 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-14a2b2f5-c904-45d9-a971-91ac3247450b req-687e1fed-c5cc-42bf-b07a-1f0389b89333 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169770 Jul 26 19:59:45.693408 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1779/3565] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 19:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:45.723263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3cdd33d-3ba1-4d31-a9a0-e3b4394b148d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ebe1dc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:45.791863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-b3cdd33d-3ba1-4d31-a9a0-e3b4394b148d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:59:45.792488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-b3cdd33d-3ba1-4d31-a9a0-e3b4394b148d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group a1014af9-18fc-4a8b-981f-104101a22190 not found {{(pid=125963) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:59:45.793165 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-b3cdd33d-3ba1-4d31-a9a0-e3b4394b148d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 19:59:45.793165 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-ca65c07a-6506-4d65-a2c5-a8bb10c5966e'] Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3cdd33d-3ba1-4d31-a9a0-e3b4394b148d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-security-groups/a1014af9-18fc-4a8b-981f-104101a22190 HTTP/1.1 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-ca65c07a-6506-4d65-a2c5-a8bb10c5966e'] Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a1014af9-18fc-4a8b-981f-104101a22190'} Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:59:45.795043 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca65c07a-6506-4d65-a2c5-a8bb10c5966e'] Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca65c07a-6506-4d65-a2c5-a8bb10c5966e'] Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca65c07a-6506-4d65-a2c5-a8bb10c5966e'] Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca65c07a-6506-4d65-a2c5-a8bb10c5966e'] Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3cdd33d-3ba1-4d31-a9a0-e3b4394b148d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-ca65c07a-6506-4d65-a2c5-a8bb10c5966e'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3cdd33d-3ba1-4d31-a9a0-e3b4394b148d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/a1014af9-18fc-4a8b-981f-104101a22190" status: 404 len: 194 microversion: 2.1 time: 0.097008 Jul 26 19:59:45.799531 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1780/3566] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:59:45 2022] GET /compute/v2.1/os-security-groups/a1014af9-18fc-4a8b-981f-104101a22190 => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:59:45.812936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-98892ce2-2914-4c68-b085-dea4a1b18936 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ec6baf0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:45.973219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f05f8c96-16c0-4003-b8f5-3bf07c216e12 tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Action: 'create', calling method: .version_select at 0x7f87565baee0>, body: {"pool": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:46.741634 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-98892ce2-2914-4c68-b085-dea4a1b18936 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e8eac663-2da2-46f5-8287-0ba074308b6a" status: 202 len: 0 microversion: 2.1 time: 0.938698 Jul 26 19:59:46.742401 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1781/3567] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:59:45 2022] DELETE /compute/v2.1/os-security-groups/e8eac663-2da2-46f5-8287-0ba074308b6a => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:59:46.747485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:46.748396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] [instance: b3c64238-cb11-404b-8360-4c9b9838b1d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:46.785015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:46.790365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:46.791440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:46.791923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:46.829497 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] HTTP exception thrown: Instance b3c64238-cb11-404b-8360-4c9b9838b1d2 could not be found. Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Request method failure captured: Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 HTTP/1.1 Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EduLBzplDPNo9z2L5re6plycMfx06FvIRSb6CoSndo6RJYqt_gsB73pVatSuYHlLRgW4ruzC90zyuAkYDh60F7Nzc593KJVsxyJ86OGMO0bdidLnuUzuAiFq2vRUuaoBcB23EpTmgXiEZggaTVQ3hJltBd4f8RamEov9mxcjIGSA4k Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: c75d41d830114829b39e22cb1a46730e Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestManualDisk-183867631 Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c75d41d830114829b39e22cb1a46730e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c75d41d830114829b39e22cb1a46730e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c75d41d830114829b39e22cb1a46730e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c75d41d830114829b39e22cb1a46730e"}]}] Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestManualDisk-183867631 Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: c75d41d830114829b39e22cb1a46730e Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestManualDisk-183867631 Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestManualDisk-183867631-project Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 94a9998874894955891cfe419a49de65 Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestManualDisk-183867631-project Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance b3c64238-cb11-404b-8360-4c9b9838b1d2 could not be found. Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'b3c64238-cb11-404b-8360-4c9b9838b1d2'} Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c64238-cb11-404b-8360-4c9b9838b1d2 could not be found. Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c64238-cb11-404b-8360-4c9b9838b1d2 could not be found. Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:46.831789 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.837387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:46.837387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:46.837387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:46.837387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:46.837387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:46.837387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c64238-cb11-404b-8360-4c9b9838b1d2 could not be found. Jul 26 19:59:46.837387 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.839540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Returning 404 to user: Instance b3c64238-cb11-404b-8360-4c9b9838b1d2 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:46.847989 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5081a205-f74d-4da5-a0b3-589601f6ba55 tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2" status: 404 len: 111 microversion: 2.1 time: 0.103923 Jul 26 19:59:46.849267 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1782/3568] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:46 2022] GET /compute/v2.1/servers/b3c64238-cb11-404b-8360-4c9b9838b1d2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:59:46.872199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54466793-921c-47e3-a396-b151e2aec012 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ebe1b80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:46.987890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-54466793-921c-47e3-a396-b151e2aec012 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:59:46.988570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-54466793-921c-47e3-a396-b151e2aec012 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group e8eac663-2da2-46f5-8287-0ba074308b6a not found {{(pid=125963) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:59:46.989158 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-54466793-921c-47e3-a396-b151e2aec012 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 19:59:46.989158 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-9bce7f50-1f6c-4fff-8f18-648e69a6055b'] Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54466793-921c-47e3-a396-b151e2aec012 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-security-groups/e8eac663-2da2-46f5-8287-0ba074308b6a HTTP/1.1 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-9bce7f50-1f6c-4fff-8f18-648e69a6055b'] Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e8eac663-2da2-46f5-8287-0ba074308b6a'} Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:59:46.992064 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bce7f50-1f6c-4fff-8f18-648e69a6055b'] Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bce7f50-1f6c-4fff-8f18-648e69a6055b'] Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bce7f50-1f6c-4fff-8f18-648e69a6055b'] Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bce7f50-1f6c-4fff-8f18-648e69a6055b'] Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54466793-921c-47e3-a396-b151e2aec012 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-9bce7f50-1f6c-4fff-8f18-648e69a6055b'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:46.997130 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54466793-921c-47e3-a396-b151e2aec012 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/e8eac663-2da2-46f5-8287-0ba074308b6a" status: 404 len: 194 microversion: 2.1 time: 0.145289 Jul 26 19:59:47.000801 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1783/3569] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:59:46 2022] GET /compute/v2.1/os-security-groups/e8eac663-2da2-46f5-8287-0ba074308b6a => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:59:47.011415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc5de01f-615c-4819-b0ef-bc5e473d190f tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] Calling method '.version_select at 0x7f876843db80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:47.068716 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc5de01f-615c-4819-b0ef-bc5e473d190f tempest-ServersTestManualDisk-183867631 tempest-ServersTestManualDisk-183867631-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824033096" status: 202 len: 0 microversion: 2.1 time: 0.067747 Jul 26 19:59:47.069484 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1784/3570] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 19:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824033096 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:59:47.075237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7ae1dfa4-4ecc-4432-9fc6-c262c2ba2ba1 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f87683b2f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:48.119576 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7ae1dfa4-4ecc-4432-9fc6-c262c2ba2ba1 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/0092e668-bf05-4105-9ca0-48f21fddface" status: 202 len: 0 microversion: 2.1 time: 1.048926 Jul 26 19:59:48.120838 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1785/3571] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 19:59:47 2022] DELETE /compute/v2.1/os-security-groups/0092e668-bf05-4105-9ca0-48f21fddface => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:59:48.129145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4bdd16a3-2738-4427-8588-764568364383 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ed340d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:48.642321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-4bdd16a3-2738-4427-8588-764568364383 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 19:59:48.643163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-4bdd16a3-2738-4427-8588-764568364383 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group 0092e668-bf05-4105-9ca0-48f21fddface not found {{(pid=125963) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 19:59:48.643874 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-4bdd16a3-2738-4427-8588-764568364383 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 19:59:48.643874 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-b4f4df22-186e-443c-b4a4-a8ce5703432b'] Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4bdd16a3-2738-4427-8588-764568364383 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-security-groups/0092e668-bf05-4105-9ca0-48f21fddface HTTP/1.1 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-b4f4df22-186e-443c-b4a4-a8ce5703432b'] Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '0092e668-bf05-4105-9ca0-48f21fddface'} Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 19:59:48.646033 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4f4df22-186e-443c-b4a4-a8ce5703432b'] Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4f4df22-186e-443c-b4a4-a8ce5703432b'] Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4f4df22-186e-443c-b4a4-a8ce5703432b'] Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4f4df22-186e-443c-b4a4-a8ce5703432b'] Jul 26 19:59:48.651759 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:48.675858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4bdd16a3-2738-4427-8588-764568364383 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 19:59:48.675858 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-b4f4df22-186e-443c-b4a4-a8ce5703432b'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:48.679152 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4bdd16a3-2738-4427-8588-764568364383 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/0092e668-bf05-4105-9ca0-48f21fddface" status: 404 len: 194 microversion: 2.1 time: 0.551757 Jul 26 19:59:48.680191 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1786/3572] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 19:59:48 2022] GET /compute/v2.1/os-security-groups/0092e668-bf05-4105-9ca0-48f21fddface => generated 194 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:59:48.698390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-05cb9f6c-d324-47a7-9433-f477a1c2fb2d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ec6b3a0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:49.442571 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-05cb9f6c-d324-47a7-9433-f477a1c2fb2d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.756537 Jul 26 19:59:49.443483 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1787/3573] 10.222.0.58 () {58 vars in 1158 bytes} [Tue Jul 26 19:59:48 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:49.448464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:49.466150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-35ed6e13-1c91-4c6f-a0c1-331d75fdfe9a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f875ec00ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1630863507", "description": "tempest-description-1567562229"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:49.563099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:50.262029 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-35ed6e13-1c91-4c6f-a0c1-331d75fdfe9a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.804717 Jul 26 19:59:50.263007 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1788/3574] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:59:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:50.278215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d63a5af2-3c0f-4359-9705-4c38e631a44b tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f875e96a160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-79567077", "description": "tempest-description-899120243"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:50.784166 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d63a5af2-3c0f-4359-9705-4c38e631a44b tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.511604 Jul 26 19:59:50.796662 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1789/3575] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 19:59:50 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:50.892364 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f05f8c96-16c0-4003-b8f5-3bf07c216e12 tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.690510 Jul 26 19:59:50.893293 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1787/3576] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:59:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:50.915252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae7ea324-2b1b-4c1e-82b3-835d0d2911f5 tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Calling method '.version_select at 0x7f875ea3c940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:51.103135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-635245152", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "6800c8f8-c5e5-447f-968f-0e0c70fef4a0"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:51.183760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] validate_networks() for [('6800c8f8-c5e5-447f-968f-0e0c70fef4a0', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:59:51.449387 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ae7ea324-2b1b-4c1e-82b3-835d0d2911f5 tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/a9bd8348-ed86-49af-86aa-1ee217d9206a" status: 200 len: 141 microversion: 2.1 time: 0.537950 Jul 26 19:59:51.453920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1790/3577] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 19:59:50 2022] GET /compute/v2.1/os-floating-ips/a9bd8348-ed86-49af-86aa-1ee217d9206a => generated 141 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:51.466819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2ac11c59-4abf-4fa7-97d4-80f516502cc1 tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Calling method '.version_select at 0x7f875e963e50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:51.849574 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2ac11c59-4abf-4fa7-97d4-80f516502cc1 tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.387875 Jul 26 19:59:51.860221 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1791/3578] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Jul 26 19:59:51 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:59:51.865186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-726c110e-4fe9-40d2-95cf-7e45bcf1390b tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Calling method '.version_select at 0x7f875ed34b80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:53.257027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:59:53.257521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:59:53.257923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:59:53.258337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:59:53.259495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:59:53.282493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:53.282493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:53.291260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:53.291756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:53.340497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Getting quotas for project f32b5385a98245f2aa903b2360e4e89a. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:59:53.357180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Getting quotas for user 5a01463edfde4e7eaa354aae42922731 and project f32b5385a98245f2aa903b2360e4e89a. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:59:53.390060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:59:53.400518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:59:53.435637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:UPDATE=7 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:53.506694 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-483be7a3-3025-4db2-971d-ef9455b3decd tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.408589 Jul 26 19:59:53.507579 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1788/3579] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 19:59:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:59:53.519658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4945010b-1f18-4f76-8ac7-1a0baaacc980 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:53.521045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4945010b-1f18-4f76-8ac7-1a0baaacc980 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:53.732701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4945010b-1f18-4f76-8ac7-1a0baaacc980 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:53.745098 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4945010b-1f18-4f76-8ac7-1a0baaacc980 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1215 microversion: 2.1 time: 0.230862 Jul 26 19:59:53.745811 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1789/3580] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:53 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:54.771568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5984f06-8091-4ef1-8c11-5fe7387d9088 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:54.773167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5984f06-8091-4ef1-8c11-5fe7387d9088 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:54.787599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5984f06-8091-4ef1-8c11-5fe7387d9088 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:54.791822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5984f06-8091-4ef1-8c11-5fe7387d9088 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:54.793594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5984f06-8091-4ef1-8c11-5fe7387d9088 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:54.794373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5984f06-8091-4ef1-8c11-5fe7387d9088 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:54.928514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c5984f06-8091-4ef1-8c11-5fe7387d9088 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:54.940692 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5984f06-8091-4ef1-8c11-5fe7387d9088 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1267 microversion: 2.1 time: 0.173837 Jul 26 19:59:54.946537 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1790/3581] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:54 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:55.630449 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-726c110e-4fe9-40d2-95cf-7e45bcf1390b tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/a9bd8348-ed86-49af-86aa-1ee217d9206a" status: 202 len: 0 microversion: 2.1 time: 3.768968 Jul 26 19:59:55.631042 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1792/3582] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 19:59:51 2022] DELETE /compute/v2.1/os-floating-ips/a9bd8348-ed86-49af-86aa-1ee217d9206a => generated 0 bytes in 3770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:59:55.640998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88d6ab2b-923c-4081-9172-8353c3b212e9 tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Action: 'create', calling method: .version_select at 0x7f875679a040>, body: {"pool": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:59:55.968111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f4a3b873-d0ef-462d-a00b-a060ac1aa92d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:55.969258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f4a3b873-d0ef-462d-a00b-a060ac1aa92d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:55.988760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4a3b873-d0ef-462d-a00b-a060ac1aa92d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:55.990867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4a3b873-d0ef-462d-a00b-a060ac1aa92d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:55.992307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4a3b873-d0ef-462d-a00b-a060ac1aa92d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:55.992753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4a3b873-d0ef-462d-a00b-a060ac1aa92d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:56.103638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f4a3b873-d0ef-462d-a00b-a060ac1aa92d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:56.112576 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f4a3b873-d0ef-462d-a00b-a060ac1aa92d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1273 microversion: 2.1 time: 0.150704 Jul 26 19:59:56.127990 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1793/3583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:55 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:57.135692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bb64418-df93-4b16-8411-c928d21e8502 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:57.137015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bb64418-df93-4b16-8411-c928d21e8502 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:57.155369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bb64418-df93-4b16-8411-c928d21e8502 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:57.168860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bb64418-df93-4b16-8411-c928d21e8502 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:57.171361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bb64418-df93-4b16-8411-c928d21e8502 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:57.172362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bb64418-df93-4b16-8411-c928d21e8502 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:57.784095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bb64418-df93-4b16-8411-c928d21e8502 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:57.793975 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bb64418-df93-4b16-8411-c928d21e8502 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1315 microversion: 2.1 time: 0.662802 Jul 26 19:59:57.810420 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1794/3584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:57 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:59:58.825143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bc4a2c0-e718-45eb-9ad8-ad6295ef0790 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:58.826510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bc4a2c0-e718-45eb-9ad8-ad6295ef0790 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:58.829588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:58.846226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bc4a2c0-e718-45eb-9ad8-ad6295ef0790 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:58.848112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bc4a2c0-e718-45eb-9ad8-ad6295ef0790 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:58.851469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bc4a2c0-e718-45eb-9ad8-ad6295ef0790 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:58.851994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bc4a2c0-e718-45eb-9ad8-ad6295ef0790 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:59.205701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bc4a2c0-e718-45eb-9ad8-ad6295ef0790 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:59:59.216446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=86 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:59:59.241853 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bc4a2c0-e718-45eb-9ad8-ad6295ef0790 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1315 microversion: 2.1 time: 0.420106 Jul 26 19:59:59.247743 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1795/3585] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 19:59:58 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:59:59.630464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:59.631111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:59.646260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:59.648710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:59.651757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:59.653101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:59.715045 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] HTTP exception thrown: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Request method failure captured: Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 HTTP/1.1 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EYSvg3T5ylwGkBfitdv2-9K1Y3nHiWNRR6QJWysmdSmwQvl-J2wTKTJl-glNzZzVCBAkovrZrhEtegrQOzT0ceLG0NhBke_MEQfta0fmhQw8D0vq6LLUwTpofqMulweFS5RMLcPAg_0kTyTn26ZYzOAKpna7Px8wR53MiQpAClTnrw Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 215594acf68a48d081d99c2f58d35925 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/215594acf68a48d081d99c2f58d35925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/215594acf68a48d081d99c2f58d35925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_215594acf68a48d081d99c2f58d35925", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/215594acf68a48d081d99c2f58d35925"}]}] Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 215594acf68a48d081d99c2f58d35925 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TaggedBootDevicesTest_v242-1432171755-project Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9cb05da7a0eb48a182c4910331827161 Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1432171755-project Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'eeb0605a-419a-4c09-821e-acdb59458647'} Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:59:59.718078 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.725097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.728453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Returning 404 to user: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:59.729797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-daaf9a7f-3ed0-4105-b590-0e6537dcf0f8 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 404 len: 111 microversion: 2.42 time: 0.103885 Jul 26 19:59:59.730594 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1796/3586] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 19:59:59 2022] DELETE /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:59:59.740697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:59:59.742619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] [instance: eeb0605a-419a-4c09-821e-acdb59458647] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:59:59.776142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:59.776890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:59.778482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:59:59.784353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:59:59.819720 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] HTTP exception thrown: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Request method failure captured: Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 HTTP/1.1 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EYSvg3T5ylwGkBfitdv2-9K1Y3nHiWNRR6QJWysmdSmwQvl-J2wTKTJl-glNzZzVCBAkovrZrhEtegrQOzT0ceLG0NhBke_MEQfta0fmhQw8D0vq6LLUwTpofqMulweFS5RMLcPAg_0kTyTn26ZYzOAKpna7Px8wR53MiQpAClTnrw Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 215594acf68a48d081d99c2f58d35925 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/215594acf68a48d081d99c2f58d35925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/215594acf68a48d081d99c2f58d35925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_215594acf68a48d081d99c2f58d35925", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/215594acf68a48d081d99c2f58d35925"}]}] Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 215594acf68a48d081d99c2f58d35925 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1432171755 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TaggedBootDevicesTest_v242-1432171755-project Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9cb05da7a0eb48a182c4910331827161 Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1432171755-project Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'eeb0605a-419a-4c09-821e-acdb59458647'} Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.821951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 19:59:59.827861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] Returning 404 to user: Instance eeb0605a-419a-4c09-821e-acdb59458647 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:59:59.835875 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7883376-e614-4844-b061-3df87d9dc930 tempest-TaggedBootDevicesTest_v242-1432171755 tempest-TaggedBootDevicesTest_v242-1432171755-project] 10.222.0.58 "GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647" status: 404 len: 111 microversion: 2.42 time: 0.091955 Jul 26 19:59:59.840670 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1797/3587] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 19:59:59 2022] GET /compute/v2.1/servers/eeb0605a-419a-4c09-821e-acdb59458647 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:00:00.264813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6028be37-c8cf-42ec-af44-af05775d4843 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:00.266143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6028be37-c8cf-42ec-af44-af05775d4843 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:00.276577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6028be37-c8cf-42ec-af44-af05775d4843 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:00.277281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6028be37-c8cf-42ec-af44-af05775d4843 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:00.278348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6028be37-c8cf-42ec-af44-af05775d4843 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:00.279759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6028be37-c8cf-42ec-af44-af05775d4843 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:01.217640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6028be37-c8cf-42ec-af44-af05775d4843 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:01.227678 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6028be37-c8cf-42ec-af44-af05775d4843 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1315 microversion: 2.1 time: 0.968491 Jul 26 20:00:01.228277 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1798/3588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:00 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1315 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:00:01.517176 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88d6ab2b-923c-4081-9172-8353c3b212e9 tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.880167 Jul 26 20:00:01.527435 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1791/3589] 10.222.0.58 () {60 vars in 1170 bytes} [Tue Jul 26 19:59:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:00:01.533436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ab14199-aab3-47a1-bc30-ebec824211fa tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Calling method '.version_select at 0x7f87681e95e0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:01.933834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-eb241fbf-e96a-4657-84a3-81251d5142e7 req-18fbe1b7-d44a-45b9-b009-3c85c3cf5888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a024a34-0016-4e24-896e-ee6b513cdb62", "tag": "8202d3eb-939e-480d-9147-b1b4f64867e4"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:01.967082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-eb241fbf-e96a-4657-84a3-81251d5142e7 req-18fbe1b7-d44a-45b9-b009-3c85c3cf5888 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:01.968015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-eb241fbf-e96a-4657-84a3-81251d5142e7 req-18fbe1b7-d44a-45b9-b009-3c85c3cf5888 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:01.986340 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-eb241fbf-e96a-4657-84a3-81251d5142e7 req-18fbe1b7-d44a-45b9-b009-3c85c3cf5888 service nova] Creating event network-changed:8202d3eb-939e-480d-9147-b1b4f64867e4 for instance 2a024a34-0016-4e24-896e-ee6b513cdb62 on n-h2-708768-8 Jul 26 20:00:01.993390 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-eb241fbf-e96a-4657-84a3-81251d5142e7 req-18fbe1b7-d44a-45b9-b009-3c85c3cf5888 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076317 Jul 26 20:00:01.994311 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1792/3590] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:02.252595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e51af4d9-6e30-47ca-bbe2-f18072ce7171 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:02.253311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e51af4d9-6e30-47ca-bbe2-f18072ce7171 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:02.264895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51af4d9-6e30-47ca-bbe2-f18072ce7171 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:02.265349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51af4d9-6e30-47ca-bbe2-f18072ce7171 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:02.272252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51af4d9-6e30-47ca-bbe2-f18072ce7171 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:02.272709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51af4d9-6e30-47ca-bbe2-f18072ce7171 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:02.876567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e51af4d9-6e30-47ca-bbe2-f18072ce7171 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:02.884647 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e51af4d9-6e30-47ca-bbe2-f18072ce7171 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1315 microversion: 2.1 time: 0.636114 Jul 26 20:00:02.893943 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1793/3591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:02 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:00:03.917924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d4cff146-e2b7-47e0-a1da-ef22453f7263 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:03.918577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d4cff146-e2b7-47e0-a1da-ef22453f7263 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:03.924522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:03.927195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:03.945514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4cff146-e2b7-47e0-a1da-ef22453f7263 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:03.947238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4cff146-e2b7-47e0-a1da-ef22453f7263 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:03.948506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4cff146-e2b7-47e0-a1da-ef22453f7263 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:03.949222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4cff146-e2b7-47e0-a1da-ef22453f7263 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:04.074945 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ab14199-aab3-47a1-bc30-ebec824211fa tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/fae1410e-5797-4ccd-ac93-53807151c438" status: 202 len: 0 microversion: 2.1 time: 2.548907 Jul 26 20:00:04.075544 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1799/3592] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 20:00:01 2022] DELETE /compute/v2.1/os-floating-ips/fae1410e-5797-4ccd-ac93-53807151c438 => generated 0 bytes in 2550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:04.083519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f548d5d6-753b-4194-97f4-77bc9e54e47f tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Calling method '.version_select at 0x7f875ea3cf70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:04.228680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d4cff146-e2b7-47e0-a1da-ef22453f7263 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:04.239127 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d4cff146-e2b7-47e0-a1da-ef22453f7263 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1315 microversion: 2.1 time: 0.327019 Jul 26 20:00:04.254629 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1794/3593] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:03 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:00:04.276520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-f548d5d6-753b-4194-97f4-77bc9e54e47f tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fae1410e-5797-4ccd-ac93-53807151c438 could not be found", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:04.277466 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-f548d5d6-753b-4194-97f4-77bc9e54e47f tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] HTTP exception thrown: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f548d5d6-753b-4194-97f4-77bc9e54e47f tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Request method failure captured: Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-floating-ips/fae1410e-5797-4ccd-ac93-53807151c438 HTTP/1.1 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eew5PlbQVv7yowD_cK5WoGi_RjTqoQ519gkG_YM1DjhkUHycb2iz07rK0h1QlB8jsTVEmagAXul77rXz77Y3zgIF8ZSVcxMjlXBKNLbG_F8UGJO8TULM-cEc56nf4RSmcpAd_yCdS5WPA3MSEfpn_UrteysNOfmq-nHdRTx5qN4Qng Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 5f15b4870cc24016b8692cbfb1145f1a Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FloatingIPsTestJSON-589647863 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f15b4870cc24016b8692cbfb1145f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f15b4870cc24016b8692cbfb1145f1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f15b4870cc24016b8692cbfb1145f1a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f15b4870cc24016b8692cbfb1145f1a"}]}] Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FloatingIPsTestJSON-589647863 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 5f15b4870cc24016b8692cbfb1145f1a Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FloatingIPsTestJSON-589647863 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FloatingIPsTestJSON-589647863-project Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9da7d9e22d6b4b0290da65adb27c7cf7 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FloatingIPsTestJSON-589647863-project Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: exception: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'fae1410e-5797-4ccd-ac93-53807151c438'} Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fae1410e-5797-4ccd-ac93-53807151c438 could not be found Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c81eaf97-b3e3-47d0-9282-3a11487004e5'] Jul 26 20:00:04.279691 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438. Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 Jul 26 20:00:04.285841 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.292542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f548d5d6-753b-4194-97f4-77bc9e54e47f tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Returning 404 to user: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:04.294048 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f548d5d6-753b-4194-97f4-77bc9e54e47f tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/fae1410e-5797-4ccd-ac93-53807151c438" status: 404 len: 111 microversion: 2.1 time: 0.214512 Jul 26 20:00:04.298334 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1800/3594] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 20:00:04 2022] GET /compute/v2.1/os-floating-ips/fae1410e-5797-4ccd-ac93-53807151c438 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:04.304245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2d4c76c-f26a-4762-becc-00a598f8573b tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Calling method '.version_select at 0x7f875679ae50>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:04.444936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-f2d4c76c-f26a-4762-becc-00a598f8573b tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fae1410e-5797-4ccd-ac93-53807151c438 could not be found", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:04.445226 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f2d4c76c-f26a-4762-becc-00a598f8573b tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] HTTP exception thrown: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2d4c76c-f26a-4762-becc-00a598f8573b tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Request method failure captured: Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-floating-ips/fae1410e-5797-4ccd-ac93-53807151c438 HTTP/1.1 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eew5PlbQVv7yowD_cK5WoGi_RjTqoQ519gkG_YM1DjhkUHycb2iz07rK0h1QlB8jsTVEmagAXul77rXz77Y3zgIF8ZSVcxMjlXBKNLbG_F8UGJO8TULM-cEc56nf4RSmcpAd_yCdS5WPA3MSEfpn_UrteysNOfmq-nHdRTx5qN4Qng Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 5f15b4870cc24016b8692cbfb1145f1a Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-FloatingIPsTestJSON-589647863 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f15b4870cc24016b8692cbfb1145f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f15b4870cc24016b8692cbfb1145f1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f15b4870cc24016b8692cbfb1145f1a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f15b4870cc24016b8692cbfb1145f1a"}]}] Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-FloatingIPsTestJSON-589647863 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 5f15b4870cc24016b8692cbfb1145f1a Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-FloatingIPsTestJSON-589647863 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-FloatingIPsTestJSON-589647863-project Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9da7d9e22d6b4b0290da65adb27c7cf7 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-FloatingIPsTestJSON-589647863-project Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: exception: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'fae1410e-5797-4ccd-ac93-53807151c438'} Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fae1410e-5797-4ccd-ac93-53807151c438 could not be found Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24bcb6b1-4a6a-408c-aa7b-01113f0a20d0'] Jul 26 20:00:04.448458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438. Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:04.455109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2d4c76c-f26a-4762-becc-00a598f8573b tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] Returning 404 to user: Floating IP not found for ID fae1410e-5797-4ccd-ac93-53807151c438 {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:04.466299 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f2d4c76c-f26a-4762-becc-00a598f8573b tempest-FloatingIPsTestJSON-589647863 tempest-FloatingIPsTestJSON-589647863-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/fae1410e-5797-4ccd-ac93-53807151c438" status: 404 len: 111 microversion: 2.1 time: 0.154785 Jul 26 20:00:04.466299 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1795/3595] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 20:00:04 2022] DELETE /compute/v2.1/os-floating-ips/fae1410e-5797-4ccd-ac93-53807151c438 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:00:05.263305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1cbd8d74-fc35-4a32-91e9-583ca8356003 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:05.264306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1cbd8d74-fc35-4a32-91e9-583ca8356003 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:05.277692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cbd8d74-fc35-4a32-91e9-583ca8356003 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:05.278101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cbd8d74-fc35-4a32-91e9-583ca8356003 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:05.278893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cbd8d74-fc35-4a32-91e9-583ca8356003 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:05.286679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cbd8d74-fc35-4a32-91e9-583ca8356003 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:05.838574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1cbd8d74-fc35-4a32-91e9-583ca8356003 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:05.873137 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1cbd8d74-fc35-4a32-91e9-583ca8356003 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1315 microversion: 2.1 time: 0.612376 Jul 26 20:00:05.877565 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1801/3596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:05 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:06.903292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-480d6987-1873-4ee4-9931-f8b4268ce4fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:06.904116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-480d6987-1873-4ee4-9931-f8b4268ce4fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:06.916753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f99bfeeb-4c65-47cf-bfac-8db22ca5882d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:06.921894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f99bfeeb-4c65-47cf-bfac-8db22ca5882d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:06.943021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-480d6987-1873-4ee4-9931-f8b4268ce4fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:06.948508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f99bfeeb-4c65-47cf-bfac-8db22ca5882d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:06.950313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-480d6987-1873-4ee4-9931-f8b4268ce4fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:06.951836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f99bfeeb-4c65-47cf-bfac-8db22ca5882d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:06.953167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-480d6987-1873-4ee4-9931-f8b4268ce4fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:06.955857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f99bfeeb-4c65-47cf-bfac-8db22ca5882d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:06.956440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-480d6987-1873-4ee4-9931-f8b4268ce4fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:06.957834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f99bfeeb-4c65-47cf-bfac-8db22ca5882d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:07.049383 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f99bfeeb-4c65-47cf-bfac-8db22ca5882d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/ips" status: 200 len: 149 microversion: 2.1 time: 0.145864 Jul 26 20:00:07.054615 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1802/3597] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:00:06 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/ips => generated 149 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:08.292908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-480d6987-1873-4ee4-9931-f8b4268ce4fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:08.302782 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-480d6987-1873-4ee4-9931-f8b4268ce4fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1315 microversion: 2.1 time: 1.404486 Jul 26 20:00:08.315173 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1796/3598] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:06 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1315 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:08.615118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3743286a-c79d-46b1-8adf-782b0e311d30 req-febca05e-e864-4dbb-839c-0557b239b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a024a34-0016-4e24-896e-ee6b513cdb62", "name": "network-vif-plugged", "status": "completed", "tag": "8202d3eb-939e-480d-9147-b1b4f64867e4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:08.646235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3743286a-c79d-46b1-8adf-782b0e311d30 req-febca05e-e864-4dbb-839c-0557b239b1ab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:08.646695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3743286a-c79d-46b1-8adf-782b0e311d30 req-febca05e-e864-4dbb-839c-0557b239b1ab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:08.681219 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3743286a-c79d-46b1-8adf-782b0e311d30 req-febca05e-e864-4dbb-839c-0557b239b1ab service nova] Creating event network-vif-plugged:8202d3eb-939e-480d-9147-b1b4f64867e4 for instance 2a024a34-0016-4e24-896e-ee6b513cdb62 on n-h2-708768-8 Jul 26 20:00:08.689539 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3743286a-c79d-46b1-8adf-782b0e311d30 req-febca05e-e864-4dbb-839c-0557b239b1ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077541 Jul 26 20:00:08.691594 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1803/3599] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:09.328748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3dc7049e-fc03-4c32-9bac-f3bbff47153e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:09.332575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3dc7049e-fc03-4c32-9bac-f3bbff47153e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:09.347548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3dc7049e-fc03-4c32-9bac-f3bbff47153e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:09.348331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3dc7049e-fc03-4c32-9bac-f3bbff47153e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:09.349454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3dc7049e-fc03-4c32-9bac-f3bbff47153e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:09.350063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3dc7049e-fc03-4c32-9bac-f3bbff47153e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:09.889666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3dc7049e-fc03-4c32-9bac-f3bbff47153e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:09.927069 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3dc7049e-fc03-4c32-9bac-f3bbff47153e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1315 microversion: 2.1 time: 0.580496 Jul 26 20:00:09.928622 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1797/3600] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:09 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:10.965838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0696761-3d1f-4f8c-8168-64f6d99dc0bb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:10.969718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c0696761-3d1f-4f8c-8168-64f6d99dc0bb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:10.997948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0696761-3d1f-4f8c-8168-64f6d99dc0bb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:10.998640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0696761-3d1f-4f8c-8168-64f6d99dc0bb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:10.999722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0696761-3d1f-4f8c-8168-64f6d99dc0bb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:11.000775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0696761-3d1f-4f8c-8168-64f6d99dc0bb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:11.153206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-223b03c2-c6ef-49b4-9bdb-050351ad2fbe tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a5bdfc2-37a8-4977-86d9-4c94f70da162"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:11.156604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-223b03c2-c6ef-49b4-9bdb-050351ad2fbe tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:11.188399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-223b03c2-c6ef-49b4-9bdb-050351ad2fbe tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:11.191577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-223b03c2-c6ef-49b4-9bdb-050351ad2fbe tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:11.195435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-223b03c2-c6ef-49b4-9bdb-050351ad2fbe tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:11.196879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-223b03c2-c6ef-49b4-9bdb-050351ad2fbe tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:11.675626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c0696761-3d1f-4f8c-8168-64f6d99dc0bb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:11.692412 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c0696761-3d1f-4f8c-8168-64f6d99dc0bb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1502 microversion: 2.1 time: 0.743460 Jul 26 20:00:11.701647 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1804/3601] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:10 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1502 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:11.717388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdb05aa6-17fe-45e6-b8e7-71f8ca78ba3e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1630863507"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:11.718328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cdb05aa6-17fe-45e6-b8e7-71f8ca78ba3e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:11.762906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdb05aa6-17fe-45e6-b8e7-71f8ca78ba3e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:11.763315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdb05aa6-17fe-45e6-b8e7-71f8ca78ba3e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:11.766207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdb05aa6-17fe-45e6-b8e7-71f8ca78ba3e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:11.767416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdb05aa6-17fe-45e6-b8e7-71f8ca78ba3e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:11.784779 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-223b03c2-c6ef-49b4-9bdb-050351ad2fbe tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637689 Jul 26 20:00:11.795784 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1798/3602] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:00:11 2022] POST /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:12.312573 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.security_group_api [None req-cdb05aa6-17fe-45e6-b8e7-71f8ca78ba3e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Adding security group fd67c068-5e82-4b68-86ef-97d8355838d0 to port 8202d3eb-939e-480d-9147-b1b4f64867e4 Jul 26 20:00:14.288780 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cdb05aa6-17fe-45e6-b8e7-71f8ca78ba3e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62/action" status: 202 len: 0 microversion: 2.1 time: 2.578101 Jul 26 20:00:14.290152 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1805/3603] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:00:11 2022] POST /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62/action => generated 0 bytes in 2580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:14.299441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8bf4e3e6-8ef2-4dba-84ae-d80ff198bb0d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f8756fbf430>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:14.321029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bc044f4e-b35a-4ed1-a87c-77bfb9775bc8 req-bcac3cb1-6341-42d2-b3cb-3cb42474b9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a024a34-0016-4e24-896e-ee6b513cdb62", "tag": "8202d3eb-939e-480d-9147-b1b4f64867e4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:14.360485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bc044f4e-b35a-4ed1-a87c-77bfb9775bc8 req-bcac3cb1-6341-42d2-b3cb-3cb42474b9d7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:14.360942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bc044f4e-b35a-4ed1-a87c-77bfb9775bc8 req-bcac3cb1-6341-42d2-b3cb-3cb42474b9d7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:14.416127 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bc044f4e-b35a-4ed1-a87c-77bfb9775bc8 req-bcac3cb1-6341-42d2-b3cb-3cb42474b9d7 service nova] Creating event network-changed:8202d3eb-939e-480d-9147-b1b4f64867e4 for instance 2a024a34-0016-4e24-896e-ee6b513cdb62 on n-h2-708768-8 Jul 26 20:00:14.433622 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bc044f4e-b35a-4ed1-a87c-77bfb9775bc8 req-bcac3cb1-6341-42d2-b3cb-3cb42474b9d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116624 Jul 26 20:00:14.438047 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1806/3604] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:00:16.081092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-8bf4e3e6-8ef2-4dba-84ae-d80ff198bb0d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group fd67c068-5e82-4b68-86ef-97d8355838d0 in use.", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:16.082372 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-8bf4e3e6-8ef2-4dba-84ae-d80ff198bb0d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security Group fd67c068-5e82-4b68-86ef-97d8355838d0 in use. Jul 26 20:00:16.082372 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-3bfcd748-b1bf-4b93-b3aa-61f45a7bc2aa'] Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8bf4e3e6-8ef2-4dba-84ae-d80ff198bb0d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-security-groups/fd67c068-5e82-4b68-86ef-97d8355838d0 HTTP/1.1 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: exception: Security Group fd67c068-5e82-4b68-86ef-97d8355838d0 in use. Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-3bfcd748-b1bf-4b93-b3aa-61f45a7bc2aa'] Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'fd67c068-5e82-4b68-86ef-97d8355838d0'} Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:16.084759 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group fd67c068-5e82-4b68-86ef-97d8355838d0 in use. Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bfcd748-b1bf-4b93-b3aa-61f45a7bc2aa'] Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group fd67c068-5e82-4b68-86ef-97d8355838d0 in use. Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bfcd748-b1bf-4b93-b3aa-61f45a7bc2aa'] Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group fd67c068-5e82-4b68-86ef-97d8355838d0 in use. Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bfcd748-b1bf-4b93-b3aa-61f45a7bc2aa'] Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group fd67c068-5e82-4b68-86ef-97d8355838d0 in use. Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bfcd748-b1bf-4b93-b3aa-61f45a7bc2aa'] Jul 26 20:00:16.090299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:16.096138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8bf4e3e6-8ef2-4dba-84ae-d80ff198bb0d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 400 to user: Security Group fd67c068-5e82-4b68-86ef-97d8355838d0 in use. Jul 26 20:00:16.096138 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-3bfcd748-b1bf-4b93-b3aa-61f45a7bc2aa'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:16.097412 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8bf4e3e6-8ef2-4dba-84ae-d80ff198bb0d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/fd67c068-5e82-4b68-86ef-97d8355838d0" status: 400 len: 185 microversion: 2.1 time: 1.802650 Jul 26 20:00:16.098482 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1799/3605] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:14 2022] DELETE /compute/v2.1/os-security-groups/fd67c068-5e82-4b68-86ef-97d8355838d0 => generated 185 bytes in 1804 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:00:16.109851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d298e693-8c9f-4ed8-a790-d757e46f6828 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:16.116435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d298e693-8c9f-4ed8-a790-d757e46f6828 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:16.137959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d298e693-8c9f-4ed8-a790-d757e46f6828 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:16.146698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d298e693-8c9f-4ed8-a790-d757e46f6828 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:16.148144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d298e693-8c9f-4ed8-a790-d757e46f6828 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:16.149084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d298e693-8c9f-4ed8-a790-d757e46f6828 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:16.349427 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d298e693-8c9f-4ed8-a790-d757e46f6828 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62/action" status: 202 len: 0 microversion: 2.1 time: 0.245939 Jul 26 20:00:16.354282 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1807/3606] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:00:16 2022] POST /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:16.369977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-356cf55e-a1b0-459d-8a21-eaa16673e0eb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:16.373388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-356cf55e-a1b0-459d-8a21-eaa16673e0eb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:16.416716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-356cf55e-a1b0-459d-8a21-eaa16673e0eb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:16.419888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-356cf55e-a1b0-459d-8a21-eaa16673e0eb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:16.426055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-356cf55e-a1b0-459d-8a21-eaa16673e0eb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:16.426915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-356cf55e-a1b0-459d-8a21-eaa16673e0eb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:16.530948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:17.737337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:17.738678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:17.750727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:17.753492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:17.756678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:17.757415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:17.915983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-356cf55e-a1b0-459d-8a21-eaa16673e0eb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:17.927174 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-356cf55e-a1b0-459d-8a21-eaa16673e0eb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1573 microversion: 2.1 time: 1.570209 Jul 26 20:00:17.931683 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1800/3607] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:16 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1573 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:00:18.682944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:18.699250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:18.712138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:18.716873 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3a01911-c5ec-4d71-848a-e3ca5485d18d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2945 microversion: 2.32 time: 0.983838 Jul 26 20:00:18.718444 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1808/3608] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:00:17 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2945 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:00:18.761748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e85b6708-4d24-412c-9e17-6c6c5d89ec66 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:18.762437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e85b6708-4d24-412c-9e17-6c6c5d89ec66 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:18.781754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e85b6708-4d24-412c-9e17-6c6c5d89ec66 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:18.783113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e85b6708-4d24-412c-9e17-6c6c5d89ec66 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:18.784695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e85b6708-4d24-412c-9e17-6c6c5d89ec66 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:18.791375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e85b6708-4d24-412c-9e17-6c6c5d89ec66 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:18.955480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3d116f60-0f2f-4f49-a3d2-a411ccbed6f9 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:18.956190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3d116f60-0f2f-4f49-a3d2-a411ccbed6f9 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:18.969808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d116f60-0f2f-4f49-a3d2-a411ccbed6f9 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:18.970901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d116f60-0f2f-4f49-a3d2-a411ccbed6f9 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:18.974422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d116f60-0f2f-4f49-a3d2-a411ccbed6f9 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:18.975137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d116f60-0f2f-4f49-a3d2-a411ccbed6f9 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:19.240075 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e85b6708-4d24-412c-9e17-6c6c5d89ec66 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.484858 Jul 26 20:00:19.241738 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1801/3609] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Jul 26 20:00:18 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7/os-interface => generated 1831 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:00:19.394491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3d116f60-0f2f-4f49-a3d2-a411ccbed6f9 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:19.413643 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3d116f60-0f2f-4f49-a3d2-a411ccbed6f9 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1573 microversion: 2.1 time: 0.462900 Jul 26 20:00:19.432867 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1809/3610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:18 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1573 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:20.438927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b901c530-bbb6-4ef5-89f5-9f901c0968fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:20.440213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b901c530-bbb6-4ef5-89f5-9f901c0968fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:20.454298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b901c530-bbb6-4ef5-89f5-9f901c0968fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:20.454858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b901c530-bbb6-4ef5-89f5-9f901c0968fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:20.461732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b901c530-bbb6-4ef5-89f5-9f901c0968fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:20.462396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b901c530-bbb6-4ef5-89f5-9f901c0968fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:21.757623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b901c530-bbb6-4ef5-89f5-9f901c0968fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:21.767534 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b901c530-bbb6-4ef5-89f5-9f901c0968fe tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1573 microversion: 2.1 time: 1.332934 Jul 26 20:00:21.790073 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1802/3611] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:20 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1573 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:22.794478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7fa66760-0b50-4fd7-ac8f-8a7d6a21046d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:22.795254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7fa66760-0b50-4fd7-ac8f-8a7d6a21046d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:22.818002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7fa66760-0b50-4fd7-ac8f-8a7d6a21046d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:22.821361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7fa66760-0b50-4fd7-ac8f-8a7d6a21046d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:22.825075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7fa66760-0b50-4fd7-ac8f-8a7d6a21046d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:22.827726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7fa66760-0b50-4fd7-ac8f-8a7d6a21046d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:23.548820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7fa66760-0b50-4fd7-ac8f-8a7d6a21046d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:23.557158 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7fa66760-0b50-4fd7-ac8f-8a7d6a21046d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1578 microversion: 2.1 time: 0.766582 Jul 26 20:00:23.564045 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1810/3612] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:22 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1578 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:24.593065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1314a795-59af-4626-a452-c1312bbf2045 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:24.594443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1314a795-59af-4626-a452-c1312bbf2045 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:24.613559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=25 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:24.621289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1314a795-59af-4626-a452-c1312bbf2045 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:24.625318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1314a795-59af-4626-a452-c1312bbf2045 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:24.627264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1314a795-59af-4626-a452-c1312bbf2045 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:24.630887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1314a795-59af-4626-a452-c1312bbf2045 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:25.165625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1314a795-59af-4626-a452-c1312bbf2045 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:25.186660 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1314a795-59af-4626-a452-c1312bbf2045 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1571 microversion: 2.1 time: 0.594499 Jul 26 20:00:25.189459 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1803/3613] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:24 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1571 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:25.214409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-188fa7d1-1a60-46ae-b8a6-67a2a8b6c656 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-79567077"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:25.215061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-188fa7d1-1a60-46ae-b8a6-67a2a8b6c656 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:25.230369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-188fa7d1-1a60-46ae-b8a6-67a2a8b6c656 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:25.230837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-188fa7d1-1a60-46ae-b8a6-67a2a8b6c656 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:25.234328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-188fa7d1-1a60-46ae-b8a6-67a2a8b6c656 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:25.234788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-188fa7d1-1a60-46ae-b8a6-67a2a8b6c656 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:26.414374 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.security_group_api [None req-188fa7d1-1a60-46ae-b8a6-67a2a8b6c656 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Adding security group 5e420396-30ae-4026-9bc8-dbbd96e0507c to port 8202d3eb-939e-480d-9147-b1b4f64867e4 Jul 26 20:00:27.667788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1674745764", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "cf54183c-54d3-43e4-9318-ebbfbdade352"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:27.749286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] validate_networks() for [('cf54183c-54d3-43e4-9318-ebbfbdade352', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:00:28.449886 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-188fa7d1-1a60-46ae-b8a6-67a2a8b6c656 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62/action" status: 202 len: 0 microversion: 2.1 time: 3.240828 Jul 26 20:00:28.450773 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1811/3614] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:00:25 2022] POST /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62/action => generated 0 bytes in 3242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:28.458421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-77e61bab-c0e6-432d-af77-8fc4ef2662a0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875e96a790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:28.616802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:00:28.618279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:00:28.619315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:00:28.619947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:00:28.620526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:00:28.637060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:28.637991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:28.639036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:28.640143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:28.665401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Getting quotas for project 0f4b52d086b64580a646df4041fc4335. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:00:28.672563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Getting quotas for user 77c46e5ebc3146719ee212d9f64b0517 and project 0f4b52d086b64580a646df4041fc4335. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:00:28.703420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:00:28.706257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:00:28.815189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7892d785-aefb-4edf-b30f-f60311eb0cc7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.459898 Jul 26 20:00:28.818408 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1804/3615] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:00:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:00:28.825907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-39eea045-fea6-48c7-8434-2ef75c8d4e31 req-b55f6121-6188-4f8e-979f-75c96284e6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a024a34-0016-4e24-896e-ee6b513cdb62", "tag": "8202d3eb-939e-480d-9147-b1b4f64867e4"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:28.840155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-39eea045-fea6-48c7-8434-2ef75c8d4e31 req-b55f6121-6188-4f8e-979f-75c96284e6a4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:28.841093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-39eea045-fea6-48c7-8434-2ef75c8d4e31 req-b55f6121-6188-4f8e-979f-75c96284e6a4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:28.883372 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-39eea045-fea6-48c7-8434-2ef75c8d4e31 req-b55f6121-6188-4f8e-979f-75c96284e6a4 service nova] Creating event network-changed:8202d3eb-939e-480d-9147-b1b4f64867e4 for instance 2a024a34-0016-4e24-896e-ee6b513cdb62 on n-h2-708768-8 Jul 26 20:00:28.891390 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-39eea045-fea6-48c7-8434-2ef75c8d4e31 req-b55f6121-6188-4f8e-979f-75c96284e6a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071357 Jul 26 20:00:28.892477 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1805/3616] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:28.901342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fad341a7-43ce-4b4f-b9f6-db675a62e213 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:28.903517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fad341a7-43ce-4b4f-b9f6-db675a62e213 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:29.143282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-77e61bab-c0e6-432d-af77-8fc4ef2662a0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5e420396-30ae-4026-9bc8-dbbd96e0507c in use.", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:29.144200 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-77e61bab-c0e6-432d-af77-8fc4ef2662a0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security Group 5e420396-30ae-4026-9bc8-dbbd96e0507c in use. Jul 26 20:00:29.144200 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-792c1c5e-b8d0-49ec-93f5-277b963e1b92'] Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-77e61bab-c0e6-432d-af77-8fc4ef2662a0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-security-groups/5e420396-30ae-4026-9bc8-dbbd96e0507c HTTP/1.1 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: exception: Security Group 5e420396-30ae-4026-9bc8-dbbd96e0507c in use. Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-792c1c5e-b8d0-49ec-93f5-277b963e1b92'] Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5e420396-30ae-4026-9bc8-dbbd96e0507c'} Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:29.146482 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5e420396-30ae-4026-9bc8-dbbd96e0507c in use. Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-792c1c5e-b8d0-49ec-93f5-277b963e1b92'] Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5e420396-30ae-4026-9bc8-dbbd96e0507c in use. Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-792c1c5e-b8d0-49ec-93f5-277b963e1b92'] Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5e420396-30ae-4026-9bc8-dbbd96e0507c in use. Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-792c1c5e-b8d0-49ec-93f5-277b963e1b92'] Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5e420396-30ae-4026-9bc8-dbbd96e0507c in use. Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-792c1c5e-b8d0-49ec-93f5-277b963e1b92'] Jul 26 20:00:29.152585 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:29.158720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-77e61bab-c0e6-432d-af77-8fc4ef2662a0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 400 to user: Security Group 5e420396-30ae-4026-9bc8-dbbd96e0507c in use. Jul 26 20:00:29.158720 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-792c1c5e-b8d0-49ec-93f5-277b963e1b92'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:29.158720 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-77e61bab-c0e6-432d-af77-8fc4ef2662a0 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5e420396-30ae-4026-9bc8-dbbd96e0507c" status: 400 len: 185 microversion: 2.1 time: 0.703427 Jul 26 20:00:29.160297 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1812/3617] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:28 2022] DELETE /compute/v2.1/os-security-groups/5e420396-30ae-4026-9bc8-dbbd96e0507c => generated 185 bytes in 706 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:00:29.199724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54118aa2-a92a-4348-803a-a6bbd0fae483 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:29.200521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54118aa2-a92a-4348-803a-a6bbd0fae483 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:29.202829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=30 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:29.214186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fad341a7-43ce-4b4f-b9f6-db675a62e213 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:29.224560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54118aa2-a92a-4348-803a-a6bbd0fae483 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:29.225028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54118aa2-a92a-4348-803a-a6bbd0fae483 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:29.225834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54118aa2-a92a-4348-803a-a6bbd0fae483 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:29.226927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54118aa2-a92a-4348-803a-a6bbd0fae483 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:29.250045 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fad341a7-43ce-4b4f-b9f6-db675a62e213 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1217 microversion: 2.1 time: 0.354338 Jul 26 20:00:29.259862 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1806/3618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:28 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1217 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:29.294445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:29.311280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54118aa2-a92a-4348-803a-a6bbd0fae483 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:00:29.489411 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54118aa2-a92a-4348-803a-a6bbd0fae483 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 204 len: 0 microversion: 2.1 time: 0.307943 Jul 26 20:00:29.490462 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1813/3619] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:00:29 2022] DELETE /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:00:29.502286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-01ead81e-539c-4285-940a-08eed454ff41 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:29.502965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-01ead81e-539c-4285-940a-08eed454ff41 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:29.522107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01ead81e-539c-4285-940a-08eed454ff41 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:29.524170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01ead81e-539c-4285-940a-08eed454ff41 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:29.535990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01ead81e-539c-4285-940a-08eed454ff41 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:29.536550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01ead81e-539c-4285-940a-08eed454ff41 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:29.991500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-01ead81e-539c-4285-940a-08eed454ff41 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:30.016310 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-01ead81e-539c-4285-940a-08eed454ff41 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1644 microversion: 2.1 time: 0.518254 Jul 26 20:00:30.043491 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1807/3620] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:29 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1644 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:30.273911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75d7f831-fc3b-448d-baf9-4c452374e669 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:30.274637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-75d7f831-fc3b-448d-baf9-4c452374e669 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:30.303268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75d7f831-fc3b-448d-baf9-4c452374e669 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:30.305453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75d7f831-fc3b-448d-baf9-4c452374e669 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:30.306345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75d7f831-fc3b-448d-baf9-4c452374e669 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:30.306790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75d7f831-fc3b-448d-baf9-4c452374e669 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:30.519535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-75d7f831-fc3b-448d-baf9-4c452374e669 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:30.528117 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-75d7f831-fc3b-448d-baf9-4c452374e669 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1269 microversion: 2.1 time: 0.258493 Jul 26 20:00:30.532924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1814/3621] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:30 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1269 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:30.850583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a5bdfc2-37a8-4977-86d9-4c94f70da162"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:30.855523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:30.872287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:30.875296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:30.879260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:30.879872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:31.040605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc1d3875-5e97-475e-80d8-9bf2d858f3fb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:31.041849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc1d3875-5e97-475e-80d8-9bf2d858f3fb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:31.064116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc1d3875-5e97-475e-80d8-9bf2d858f3fb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:31.066365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc1d3875-5e97-475e-80d8-9bf2d858f3fb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:31.067460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc1d3875-5e97-475e-80d8-9bf2d858f3fb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:31.074298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc1d3875-5e97-475e-80d8-9bf2d858f3fb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:31.132744 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Invalid volume: volume 0a5bdfc2-37a8-4977-86d9-4c94f70da162 is already attached to instances: dd66cf0a-f4e4-4302-9442-01163ee9a46d Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments HTTP/1.1 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 74 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: {"volumeAttachment": {"volumeId": "0a5bdfc2-37a8-4977-86d9-4c94f70da162"}} Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid volume: volume 0a5bdfc2-37a8-4977-86d9-4c94f70da162 is already attached to instances: dd66cf0a-f4e4-4302-9442-01163ee9a46d Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'server_id': 'dd66cf0a-f4e4-4302-9442-01163ee9a46d', 'body': {'volumeAttachment': {'volumeId': '0a5bdfc2-37a8-4977-86d9-4c94f70da162'}}} Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0a5bdfc2-37a8-4977-86d9-4c94f70da162 is already attached to instances: dd66cf0a-f4e4-4302-9442-01163ee9a46d Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:00:31.134503 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0a5bdfc2-37a8-4977-86d9-4c94f70da162 is already attached to instances: dd66cf0a-f4e4-4302-9442-01163ee9a46d Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0a5bdfc2-37a8-4977-86d9-4c94f70da162 is already attached to instances: dd66cf0a-f4e4-4302-9442-01163ee9a46d Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 400 to user: Invalid volume: volume 0a5bdfc2-37a8-4977-86d9-4c94f70da162 is already attached to instances: dd66cf0a-f4e4-4302-9442-01163ee9a46d {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a6e0193-9669-4faa-ad29-24a59f16f8d2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.289726 Jul 26 20:00:31.142955 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1808/3622] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:00:30 2022] POST /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 174 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:00:31.232664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-098521d1-1bdd-4dd5-8c3d-4b0141029405 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:31.233179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-098521d1-1bdd-4dd5-8c3d-4b0141029405 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:31.243812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-098521d1-1bdd-4dd5-8c3d-4b0141029405 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:31.244265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-098521d1-1bdd-4dd5-8c3d-4b0141029405 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:31.245042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-098521d1-1bdd-4dd5-8c3d-4b0141029405 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:31.245482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-098521d1-1bdd-4dd5-8c3d-4b0141029405 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:31.478811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-098521d1-1bdd-4dd5-8c3d-4b0141029405 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lazy-loading 'services' on Instance uuid dd66cf0a-f4e4-4302-9442-01163ee9a46d {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:00:31.596469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-098521d1-1bdd-4dd5-8c3d-4b0141029405 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments/0a5bdfc2-37a8-4977-86d9-4c94f70da162" status: 202 len: 0 microversion: 2.1 time: 0.367868 Jul 26 20:00:31.599104 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1809/3623] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:00:31 2022] DELETE /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments/0a5bdfc2-37a8-4977-86d9-4c94f70da162 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:00:31.606543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7533831f-fe3a-411c-9e9d-b10115cabafd tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:31.627003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7533831f-fe3a-411c-9e9d-b10115cabafd tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:31.641844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7533831f-fe3a-411c-9e9d-b10115cabafd tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:31.642308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7533831f-fe3a-411c-9e9d-b10115cabafd tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:31.643111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7533831f-fe3a-411c-9e9d-b10115cabafd tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:31.643552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7533831f-fe3a-411c-9e9d-b10115cabafd tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:31.932272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7533831f-fe3a-411c-9e9d-b10115cabafd tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:31.942284 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7533831f-fe3a-411c-9e9d-b10115cabafd tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1275 microversion: 2.1 time: 0.339207 Jul 26 20:00:31.945844 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1810/3624] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:31 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:31.955918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-725034c6-0e71-481d-8851-3534d6c8a361 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:31.963470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-725034c6-0e71-481d-8851-3534d6c8a361 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:31.983449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-725034c6-0e71-481d-8851-3534d6c8a361 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:31.984245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-725034c6-0e71-481d-8851-3534d6c8a361 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:31.986348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-725034c6-0e71-481d-8851-3534d6c8a361 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:31.989097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-725034c6-0e71-481d-8851-3534d6c8a361 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:32.073822 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-725034c6-0e71-481d-8851-3534d6c8a361 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126734 Jul 26 20:00:32.075320 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1811/3625] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:00:31 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:32.967107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-200f9ef4-4f1f-4a09-ae36-f19ae0348d7c tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:32.968524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-200f9ef4-4f1f-4a09-ae36-f19ae0348d7c tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:32.978408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-200f9ef4-4f1f-4a09-ae36-f19ae0348d7c tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:32.979138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-200f9ef4-4f1f-4a09-ae36-f19ae0348d7c tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:32.980176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-200f9ef4-4f1f-4a09-ae36-f19ae0348d7c tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:32.990743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-200f9ef4-4f1f-4a09-ae36-f19ae0348d7c tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:33.437318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-200f9ef4-4f1f-4a09-ae36-f19ae0348d7c tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:33.452163 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-200f9ef4-4f1f-4a09-ae36-f19ae0348d7c tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1275 microversion: 2.1 time: 0.489521 Jul 26 20:00:33.456059 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1812/3626] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:32 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1275 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:33.476960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26f412a3-ec5c-4141-ad2c-8b500a6fc4d4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:33.485466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-26f412a3-ec5c-4141-ad2c-8b500a6fc4d4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:33.500849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26f412a3-ec5c-4141-ad2c-8b500a6fc4d4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:33.503434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26f412a3-ec5c-4141-ad2c-8b500a6fc4d4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:33.504429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26f412a3-ec5c-4141-ad2c-8b500a6fc4d4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:33.505287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26f412a3-ec5c-4141-ad2c-8b500a6fc4d4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:33.513810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bc1d3875-5e97-475e-80d8-9bf2d858f3fb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:33.525784 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc1d3875-5e97-475e-80d8-9bf2d858f3fb tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1644 microversion: 2.1 time: 2.491222 Jul 26 20:00:33.527782 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1815/3627] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:31 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1644 bytes in 2494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:33.650537 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-26f412a3-ec5c-4141-ad2c-8b500a6fc4d4 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191905 Jul 26 20:00:33.658120 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1813/3628] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:00:33 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:34.481678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55d515b0-514b-4fa1-9b09-08dd62923b84 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:34.482560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55d515b0-514b-4fa1-9b09-08dd62923b84 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:34.537818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d515b0-514b-4fa1-9b09-08dd62923b84 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:34.538371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d515b0-514b-4fa1-9b09-08dd62923b84 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:34.541233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d515b0-514b-4fa1-9b09-08dd62923b84 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:34.543175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d515b0-514b-4fa1-9b09-08dd62923b84 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:34.550275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff90991d-2db5-4bfb-84e0-dec913770526 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:34.551458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff90991d-2db5-4bfb-84e0-dec913770526 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:34.597913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff90991d-2db5-4bfb-84e0-dec913770526 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:34.608557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff90991d-2db5-4bfb-84e0-dec913770526 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:34.611418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff90991d-2db5-4bfb-84e0-dec913770526 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:34.618813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff90991d-2db5-4bfb-84e0-dec913770526 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:35.082044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff90991d-2db5-4bfb-84e0-dec913770526 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:35.106622 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff90991d-2db5-4bfb-84e0-dec913770526 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1466 microversion: 2.1 time: 0.549802 Jul 26 20:00:35.124765 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1814/3629] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:34 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1466 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:00:35.140994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-97365e1d-738d-4b21-9a1c-efd6a9af0047 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:35.144112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-97365e1d-738d-4b21-9a1c-efd6a9af0047 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:35.172098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97365e1d-738d-4b21-9a1c-efd6a9af0047 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:35.175201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97365e1d-738d-4b21-9a1c-efd6a9af0047 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:35.178591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97365e1d-738d-4b21-9a1c-efd6a9af0047 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:35.179383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97365e1d-738d-4b21-9a1c-efd6a9af0047 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:35.258871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-97365e1d-738d-4b21-9a1c-efd6a9af0047 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132524 Jul 26 20:00:35.267905 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1815/3630] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:00:35 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:35.617503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-befe446b-3f99-40fd-bf00-b49e4fc9ed9c req-592e9d54-dee6-4dc6-bba9-c02afeb05e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a024a34-0016-4e24-896e-ee6b513cdb62", "name": "network-vif-deleted", "tag": "8202d3eb-939e-480d-9147-b1b4f64867e4"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:35.652837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-befe446b-3f99-40fd-bf00-b49e4fc9ed9c req-592e9d54-dee6-4dc6-bba9-c02afeb05e30 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:35.653551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-befe446b-3f99-40fd-bf00-b49e4fc9ed9c req-592e9d54-dee6-4dc6-bba9-c02afeb05e30 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:35.699316 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-befe446b-3f99-40fd-bf00-b49e4fc9ed9c req-592e9d54-dee6-4dc6-bba9-c02afeb05e30 service nova] Creating event network-vif-deleted:8202d3eb-939e-480d-9147-b1b4f64867e4 for instance 2a024a34-0016-4e24-896e-ee6b513cdb62 on n-h2-708768-8 Jul 26 20:00:35.729140 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-befe446b-3f99-40fd-bf00-b49e4fc9ed9c req-592e9d54-dee6-4dc6-bba9-c02afeb05e30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115699 Jul 26 20:00:35.734897 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1816/3631] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:00:35.783333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55d515b0-514b-4fa1-9b09-08dd62923b84 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:35.799542 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55d515b0-514b-4fa1-9b09-08dd62923b84 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1317 microversion: 2.1 time: 1.321952 Jul 26 20:00:35.801696 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1816/3632] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:34 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1317 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:36.136186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:36.137135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:36.153128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:36.153826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:36.154828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:36.161069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:36.250859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:36.251322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:36.252109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lazy-loading 'fault' on Instance uuid 2a024a34-0016-4e24-896e-ee6b513cdb62 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:00:36.275985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b7f5bdf1-e390-4dd5-977b-23fdf0636bf5 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:36.278525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b7f5bdf1-e390-4dd5-977b-23fdf0636bf5 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:36.295091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7f5bdf1-e390-4dd5-977b-23fdf0636bf5 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:36.299406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7f5bdf1-e390-4dd5-977b-23fdf0636bf5 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:36.300513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7f5bdf1-e390-4dd5-977b-23fdf0636bf5 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:36.301135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7f5bdf1-e390-4dd5-977b-23fdf0636bf5 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:36.370478 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b7f5bdf1-e390-4dd5-977b-23fdf0636bf5 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098655 Jul 26 20:00:36.376035 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1817/3633] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:00:36 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:36.717940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:36.725534 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c34c38b4-feef-4693-b00b-0c6ea59b376d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 200 len: 1305 microversion: 2.1 time: 0.596555 Jul 26 20:00:36.740718 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1817/3634] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:36 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 1305 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:36.823764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e64d96ec-0e5d-4379-bedb-c71c3a48b933 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:36.824396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e64d96ec-0e5d-4379-bedb-c71c3a48b933 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:36.841902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e64d96ec-0e5d-4379-bedb-c71c3a48b933 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:36.842668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e64d96ec-0e5d-4379-bedb-c71c3a48b933 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:36.843641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e64d96ec-0e5d-4379-bedb-c71c3a48b933 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:36.846209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e64d96ec-0e5d-4379-bedb-c71c3a48b933 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:37.383256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34f1256a-9076-40f2-957c-24b19b4c49ee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:37.386009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34f1256a-9076-40f2-957c-24b19b4c49ee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:37.393016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f1256a-9076-40f2-957c-24b19b4c49ee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:37.393807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f1256a-9076-40f2-957c-24b19b4c49ee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:37.394850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f1256a-9076-40f2-957c-24b19b4c49ee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:37.395502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f1256a-9076-40f2-957c-24b19b4c49ee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:37.456632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34f1256a-9076-40f2-957c-24b19b4c49ee tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077931 Jul 26 20:00:37.458001 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1818/3635] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:00:37 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:00:37.634314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-45f9dc71-4a47-44f1-b908-f5b15a68de38 req-ca7d921f-af52-4ef8-9608-c718e97f5e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e2d202-29db-49f8-8579-c4503d488f65", "tag": "99cb05f8-7781-4c63-b1bd-75311cb9642e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:37.646269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-45f9dc71-4a47-44f1-b908-f5b15a68de38 req-ca7d921f-af52-4ef8-9608-c718e97f5e28 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:37.653833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-45f9dc71-4a47-44f1-b908-f5b15a68de38 req-ca7d921f-af52-4ef8-9608-c718e97f5e28 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:37.661584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:37.685257 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-45f9dc71-4a47-44f1-b908-f5b15a68de38 req-ca7d921f-af52-4ef8-9608-c718e97f5e28 service nova] Creating event network-changed:99cb05f8-7781-4c63-b1bd-75311cb9642e for instance 11e2d202-29db-49f8-8579-c4503d488f65 on n-h1-708768-8 Jul 26 20:00:37.696646 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-45f9dc71-4a47-44f1-b908-f5b15a68de38 req-ca7d921f-af52-4ef8-9608-c718e97f5e28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066332 Jul 26 20:00:37.698516 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1819/3636] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:00:37.750158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:37.750865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:37.772707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:37.773102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:37.774894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:37.775524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:37.800610 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 HTTP/1.1 Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '2a024a34-0016-4e24-896e-ee6b513cdb62'} Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:37.802513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:37.808536 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:37.808536 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:37.808536 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:37.808536 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:37.808536 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:37.808536 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:37.808536 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:37.809907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:37.810958 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23161169-da18-4cdd-a88e-389082bda05e tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 404 len: 111 microversion: 2.1 time: 0.065974 Jul 26 20:00:37.812030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1820/3637] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:37 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:37.821221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea2f0ecb-b13f-4a41-bfeb-b4585a6d39d7 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f8756546f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:38.115395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e64d96ec-0e5d-4379-bedb-c71c3a48b933 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:38.126010 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e64d96ec-0e5d-4379-bedb-c71c3a48b933 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1317 microversion: 2.1 time: 1.306374 Jul 26 20:00:38.126615 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1818/3638] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:36 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1317 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:38.469914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-78b66400-95d2-4296-94b2-215352f0a152 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:38.472522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-78b66400-95d2-4296-94b2-215352f0a152 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:38.492102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78b66400-95d2-4296-94b2-215352f0a152 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:38.492606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78b66400-95d2-4296-94b2-215352f0a152 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:38.500780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78b66400-95d2-4296-94b2-215352f0a152 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:38.501876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78b66400-95d2-4296-94b2-215352f0a152 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:38.590723 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-78b66400-95d2-4296-94b2-215352f0a152 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125017 Jul 26 20:00:38.601766 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1819/3639] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:00:38 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:38.654694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:38.894173 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea2f0ecb-b13f-4a41-bfeb-b4585a6d39d7 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/fd67c068-5e82-4b68-86ef-97d8355838d0" status: 202 len: 0 microversion: 2.1 time: 1.074106 Jul 26 20:00:38.896575 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1821/3640] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:37 2022] DELETE /compute/v2.1/os-security-groups/fd67c068-5e82-4b68-86ef-97d8355838d0 => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:38.904520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3590e39-3eec-4e11-b20d-78959bd7eb0f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875e96a0d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:39.147745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-05e37777-f724-4f27-86fc-cbf29a7bc1cb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:39.149226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-05e37777-f724-4f27-86fc-cbf29a7bc1cb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:39.181944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05e37777-f724-4f27-86fc-cbf29a7bc1cb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:39.182960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05e37777-f724-4f27-86fc-cbf29a7bc1cb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:39.185048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05e37777-f724-4f27-86fc-cbf29a7bc1cb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:39.188472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05e37777-f724-4f27-86fc-cbf29a7bc1cb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:39.261194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:40.111981 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3590e39-3eec-4e11-b20d-78959bd7eb0f tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5e420396-30ae-4026-9bc8-dbbd96e0507c" status: 202 len: 0 microversion: 2.1 time: 1.211410 Jul 26 20:00:40.113191 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1820/3641] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:38 2022] DELETE /compute/v2.1/os-security-groups/5e420396-30ae-4026-9bc8-dbbd96e0507c => generated 0 bytes in 1213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:40.125638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6221f0ce-de2e-48aa-90c6-e3abddfe6be0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:40.125638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6221f0ce-de2e-48aa-90c6-e3abddfe6be0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:40.145695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6221f0ce-de2e-48aa-90c6-e3abddfe6be0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:40.151074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6221f0ce-de2e-48aa-90c6-e3abddfe6be0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:40.152099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6221f0ce-de2e-48aa-90c6-e3abddfe6be0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:40.152801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6221f0ce-de2e-48aa-90c6-e3abddfe6be0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:40.196127 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6221f0ce-de2e-48aa-90c6-e3abddfe6be0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081887 Jul 26 20:00:40.197116 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1821/3642] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:00:40 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:40.201968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-40118bac-667f-4ce2-a9fe-b89005f3cc34 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'create', calling method: .version_select at 0x7f875ecdc430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2007343065", "description": "tempest-description-1788214348"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:40.534620 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-40118bac-667f-4ce2-a9fe-b89005f3cc34 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.335988 Jul 26 20:00:40.536120 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1822/3643] 10.222.0.58 () {60 vars in 1180 bytes} [Tue Jul 26 20:00:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:40.551185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5183b38d-2a39-4351-8765-911991c5cc09 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Action: 'update', calling method: .version_select at 0x7f876843da60>, body: {"security_group": {"name": "tempest-sg-hth-1914073927", "description": "tempest-description-hth-1020132813"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:40.597295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05e37777-f724-4f27-86fc-cbf29a7bc1cb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:40.606814 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-05e37777-f724-4f27-86fc-cbf29a7bc1cb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1317 microversion: 2.1 time: 1.463474 Jul 26 20:00:40.612602 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1822/3644] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:39 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1317 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:41.058834 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5183b38d-2a39-4351-8765-911991c5cc09 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/0d890e38-bce3-44f8-a124-643b7c211724" status: 200 len: 218 microversion: 2.1 time: 0.512512 Jul 26 20:00:41.069173 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1823/3645] 10.222.0.58 () {60 vars in 1290 bytes} [Tue Jul 26 20:00:40 2022] PUT /compute/v2.1/os-security-groups/0d890e38-bce3-44f8-a124-643b7c211724 => generated 218 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:41.072552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e6b2378-ae1a-4287-9728-b6e95ed96dc4 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f87565628b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:41.211350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c301e1e-dd22-47ec-90ef-397cb3030be6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:41.214461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c301e1e-dd22-47ec-90ef-397cb3030be6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:41.235108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c301e1e-dd22-47ec-90ef-397cb3030be6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:41.235402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c301e1e-dd22-47ec-90ef-397cb3030be6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:41.236407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c301e1e-dd22-47ec-90ef-397cb3030be6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:41.237016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c301e1e-dd22-47ec-90ef-397cb3030be6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:41.301277 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c301e1e-dd22-47ec-90ef-397cb3030be6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096317 Jul 26 20:00:41.302468 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1824/3646] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:00:41 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:00:41.360507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e6b2378-ae1a-4287-9728-b6e95ed96dc4 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/0d890e38-bce3-44f8-a124-643b7c211724" status: 200 len: 218 microversion: 2.1 time: 0.292003 Jul 26 20:00:41.364374 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1823/3647] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 20:00:41 2022] GET /compute/v2.1/os-security-groups/0d890e38-bce3-44f8-a124-643b7c211724 => generated 218 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:41.376115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9cd1627b-ad66-4edf-b087-c29dc1854c42 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875e9e6160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:41.406742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d4a6392-8854-4381-b4c4-e76aee66e1ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:41.408543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d4a6392-8854-4381-b4c4-e76aee66e1ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:41.436121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d4a6392-8854-4381-b4c4-e76aee66e1ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:41.437530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d4a6392-8854-4381-b4c4-e76aee66e1ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:41.438595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d4a6392-8854-4381-b4c4-e76aee66e1ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:41.443446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d4a6392-8854-4381-b4c4-e76aee66e1ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:41.489720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d4a6392-8854-4381-b4c4-e76aee66e1ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:00:41.640729 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d4a6392-8854-4381-b4c4-e76aee66e1ca tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 204 len: 0 microversion: 2.1 time: 0.237859 Jul 26 20:00:41.641590 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1824/3648] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:00:41 2022] DELETE /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:00:41.654579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f58d0306-3b01-426a-a8d7-4a526105a480 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:41.656576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f58d0306-3b01-426a-a8d7-4a526105a480 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:41.664962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f58d0306-3b01-426a-a8d7-4a526105a480 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:41.665694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f58d0306-3b01-426a-a8d7-4a526105a480 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:41.666840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f58d0306-3b01-426a-a8d7-4a526105a480 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:41.667702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f58d0306-3b01-426a-a8d7-4a526105a480 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:42.168583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f58d0306-3b01-426a-a8d7-4a526105a480 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:42.184768 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f58d0306-3b01-426a-a8d7-4a526105a480 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1317 microversion: 2.1 time: 0.537227 Jul 26 20:00:42.188958 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1825/3649] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:41 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:42.201577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c8aa94d1-f511-4f7e-903a-24b05b3dbfda tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:42.203398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c8aa94d1-f511-4f7e-903a-24b05b3dbfda tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:42.224439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8aa94d1-f511-4f7e-903a-24b05b3dbfda tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:42.225784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8aa94d1-f511-4f7e-903a-24b05b3dbfda tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:42.227676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8aa94d1-f511-4f7e-903a-24b05b3dbfda tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:42.229783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8aa94d1-f511-4f7e-903a-24b05b3dbfda tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:42.272736 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9cd1627b-ad66-4edf-b087-c29dc1854c42 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/0d890e38-bce3-44f8-a124-643b7c211724" status: 202 len: 0 microversion: 2.1 time: 0.901156 Jul 26 20:00:42.275986 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1825/3650] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:41 2022] DELETE /compute/v2.1/os-security-groups/0d890e38-bce3-44f8-a124-643b7c211724 => generated 0 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:42.290775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:42.291292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:42.306994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:42.307457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:42.308877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:42.309330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:42.352603 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 HTTP/1.1 Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '2a024a34-0016-4e24-896e-ee6b513cdb62'} Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:00:42.355226 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.360637 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.363046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:42.364258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2457cf15-c89e-4490-ab9d-c59efae10f02 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 404 len: 111 microversion: 2.1 time: 0.086883 Jul 26 20:00:42.365364 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1826/3651] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:00:42 2022] DELETE /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:42.374845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:42.375527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 2a024a34-0016-4e24-896e-ee6b513cdb62] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:42.384066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:42.384760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:42.385724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:42.386354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:42.404627 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 HTTP/1.1 Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '2a024a34-0016-4e24-896e-ee6b513cdb62'} Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:42.406704 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.411486 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.411486 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:42.411486 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:42.411486 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:42.411486 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:42.411486 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. Jul 26 20:00:42.411486 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.415083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Instance 2a024a34-0016-4e24-896e-ee6b513cdb62 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:42.416923 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-99789faf-18b6-468d-af23-25d125987eae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62" status: 404 len: 111 microversion: 2.1 time: 0.046290 Jul 26 20:00:42.417512 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1827/3652] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:42 2022] GET /compute/v2.1/servers/2a024a34-0016-4e24-896e-ee6b513cdb62 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:42.443448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e90bf8b7-7457-43bb-abec-b3ff1fbb01ef tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f87681ccd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:42.622556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-e90bf8b7-7457-43bb-abec-b3ff1fbb01ef tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e420396-30ae-4026-9bc8-dbbd96e0507c does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:42.623179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-e90bf8b7-7457-43bb-abec-b3ff1fbb01ef tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group 5e420396-30ae-4026-9bc8-dbbd96e0507c not found {{(pid=125963) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 20:00:42.623789 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-e90bf8b7-7457-43bb-abec-b3ff1fbb01ef tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group 5e420396-30ae-4026-9bc8-dbbd96e0507c does not exist Jul 26 20:00:42.623789 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-45e31537-3cc1-473b-964c-29e0b535aab1'] Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e90bf8b7-7457-43bb-abec-b3ff1fbb01ef tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-security-groups/5e420396-30ae-4026-9bc8-dbbd96e0507c HTTP/1.1 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group 5e420396-30ae-4026-9bc8-dbbd96e0507c does not exist Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-45e31537-3cc1-473b-964c-29e0b535aab1'] Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5e420396-30ae-4026-9bc8-dbbd96e0507c'} Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:42.626296 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e420396-30ae-4026-9bc8-dbbd96e0507c does not exist Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45e31537-3cc1-473b-964c-29e0b535aab1'] Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e420396-30ae-4026-9bc8-dbbd96e0507c does not exist Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45e31537-3cc1-473b-964c-29e0b535aab1'] Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e420396-30ae-4026-9bc8-dbbd96e0507c does not exist Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45e31537-3cc1-473b-964c-29e0b535aab1'] Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e420396-30ae-4026-9bc8-dbbd96e0507c does not exist Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45e31537-3cc1-473b-964c-29e0b535aab1'] Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e90bf8b7-7457-43bb-abec-b3ff1fbb01ef tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group 5e420396-30ae-4026-9bc8-dbbd96e0507c does not exist Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-45e31537-3cc1-473b-964c-29e0b535aab1'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:42.631328 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e90bf8b7-7457-43bb-abec-b3ff1fbb01ef tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/5e420396-30ae-4026-9bc8-dbbd96e0507c" status: 404 len: 194 microversion: 2.1 time: 0.188318 Jul 26 20:00:42.637963 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1828/3653] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:42 2022] DELETE /compute/v2.1/os-security-groups/5e420396-30ae-4026-9bc8-dbbd96e0507c => generated 194 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:42.640390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75619a27-7567-4849-b405-ac1fdbdce104 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ecdc8b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:42.700819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c8aa94d1-f511-4f7e-903a-24b05b3dbfda tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:42.714629 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c8aa94d1-f511-4f7e-903a-24b05b3dbfda tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1679 microversion: 2.1 time: 0.524358 Jul 26 20:00:42.715904 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1826/3654] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:42 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1679 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:43.166459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-75619a27-7567-4849-b405-ac1fdbdce104 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fd67c068-5e82-4b68-86ef-97d8355838d0 does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:43.167093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-75619a27-7567-4849-b405-ac1fdbdce104 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group fd67c068-5e82-4b68-86ef-97d8355838d0 not found {{(pid=125963) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 20:00:43.167639 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-75619a27-7567-4849-b405-ac1fdbdce104 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group fd67c068-5e82-4b68-86ef-97d8355838d0 does not exist Jul 26 20:00:43.167639 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-dbf7c679-5f91-4778-a864-3e2a4dfceecc'] Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75619a27-7567-4849-b405-ac1fdbdce104 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-security-groups/fd67c068-5e82-4b68-86ef-97d8355838d0 HTTP/1.1 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group fd67c068-5e82-4b68-86ef-97d8355838d0 does not exist Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-dbf7c679-5f91-4778-a864-3e2a4dfceecc'] Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'fd67c068-5e82-4b68-86ef-97d8355838d0'} Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:43.169479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fd67c068-5e82-4b68-86ef-97d8355838d0 does not exist Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbf7c679-5f91-4778-a864-3e2a4dfceecc'] Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fd67c068-5e82-4b68-86ef-97d8355838d0 does not exist Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbf7c679-5f91-4778-a864-3e2a4dfceecc'] Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fd67c068-5e82-4b68-86ef-97d8355838d0 does not exist Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbf7c679-5f91-4778-a864-3e2a4dfceecc'] Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fd67c068-5e82-4b68-86ef-97d8355838d0 does not exist Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbf7c679-5f91-4778-a864-3e2a4dfceecc'] Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75619a27-7567-4849-b405-ac1fdbdce104 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group fd67c068-5e82-4b68-86ef-97d8355838d0 does not exist Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-dbf7c679-5f91-4778-a864-3e2a4dfceecc'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-75619a27-7567-4849-b405-ac1fdbdce104 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/fd67c068-5e82-4b68-86ef-97d8355838d0" status: 404 len: 194 microversion: 2.1 time: 0.537081 Jul 26 20:00:43.174786 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1829/3655] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:42 2022] DELETE /compute/v2.1/os-security-groups/fd67c068-5e82-4b68-86ef-97d8355838d0 => generated 194 bytes in 539 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:43.184740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7305f42d-8cf2-49dc-8a1e-5a9466be6f4a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f87570f6c10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:43.209440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bf69665c-a413-4635-98ce-00acf12975ed tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:43.210066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bf69665c-a413-4635-98ce-00acf12975ed tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:43.221980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf69665c-a413-4635-98ce-00acf12975ed tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:43.222436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf69665c-a413-4635-98ce-00acf12975ed tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:43.223226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf69665c-a413-4635-98ce-00acf12975ed tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:43.223683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf69665c-a413-4635-98ce-00acf12975ed tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:43.316227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-7305f42d-8cf2-49dc-8a1e-5a9466be6f4a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:43.316839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.security_group_api [None req-7305f42d-8cf2-49dc-8a1e-5a9466be6f4a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group 0092e668-bf05-4105-9ca0-48f21fddface not found {{(pid=125964) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 20:00:43.317367 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-7305f42d-8cf2-49dc-8a1e-5a9466be6f4a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 20:00:43.317367 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-82f3fe7a-be96-49a2-aab5-20bf107d2d58'] Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7305f42d-8cf2-49dc-8a1e-5a9466be6f4a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-security-groups/0092e668-bf05-4105-9ca0-48f21fddface HTTP/1.1 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: exception: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-82f3fe7a-be96-49a2-aab5-20bf107d2d58'] Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '0092e668-bf05-4105-9ca0-48f21fddface'} Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:43.319329 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82f3fe7a-be96-49a2-aab5-20bf107d2d58'] Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82f3fe7a-be96-49a2-aab5-20bf107d2d58'] Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82f3fe7a-be96-49a2-aab5-20bf107d2d58'] Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82f3fe7a-be96-49a2-aab5-20bf107d2d58'] Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7305f42d-8cf2-49dc-8a1e-5a9466be6f4a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group 0092e668-bf05-4105-9ca0-48f21fddface does not exist Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-82f3fe7a-be96-49a2-aab5-20bf107d2d58'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7305f42d-8cf2-49dc-8a1e-5a9466be6f4a tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/0092e668-bf05-4105-9ca0-48f21fddface" status: 404 len: 194 microversion: 2.1 time: 0.140237 Jul 26 20:00:43.323717 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1827/3656] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:43 2022] DELETE /compute/v2.1/os-security-groups/0092e668-bf05-4105-9ca0-48f21fddface => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:43.335745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1a234e3-5455-4aa7-89be-117844812e52 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f87565ba0d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:43.432315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-c1a234e3-5455-4aa7-89be-117844812e52 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:43.433262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.security_group_api [None req-c1a234e3-5455-4aa7-89be-117844812e52 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group e8eac663-2da2-46f5-8287-0ba074308b6a not found {{(pid=125964) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 20:00:43.434229 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c1a234e3-5455-4aa7-89be-117844812e52 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 20:00:43.434229 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-4870c059-6326-4106-b481-851aad1c815b'] Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1a234e3-5455-4aa7-89be-117844812e52 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-security-groups/e8eac663-2da2-46f5-8287-0ba074308b6a HTTP/1.1 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: exception: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-4870c059-6326-4106-b481-851aad1c815b'] Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'e8eac663-2da2-46f5-8287-0ba074308b6a'} Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:43.441809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4870c059-6326-4106-b481-851aad1c815b'] Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4870c059-6326-4106-b481-851aad1c815b'] Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4870c059-6326-4106-b481-851aad1c815b'] Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4870c059-6326-4106-b481-851aad1c815b'] Jul 26 20:00:43.451492 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.459300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1a234e3-5455-4aa7-89be-117844812e52 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group e8eac663-2da2-46f5-8287-0ba074308b6a does not exist Jul 26 20:00:43.459300 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-4870c059-6326-4106-b481-851aad1c815b'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:43.459300 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1a234e3-5455-4aa7-89be-117844812e52 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e8eac663-2da2-46f5-8287-0ba074308b6a" status: 404 len: 194 microversion: 2.1 time: 0.132013 Jul 26 20:00:43.459300 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1828/3657] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:43 2022] DELETE /compute/v2.1/os-security-groups/e8eac663-2da2-46f5-8287-0ba074308b6a => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:43.467297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23e195a0-8996-4fd8-b5f9-741f2196c78d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f8756e04280>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:43.721485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG neutronclient.v2_0.client [None req-23e195a0-8996-4fd8-b5f9-741f2196c78d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist", "detail": ""}} {{(pid=125964) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:43.725760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.security_group_api [None req-23e195a0-8996-4fd8-b5f9-741f2196c78d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group a1014af9-18fc-4a8b-981f-104101a22190 not found {{(pid=125964) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 20:00:43.732206 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-23e195a0-8996-4fd8-b5f9-741f2196c78d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 20:00:43.732206 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-96d3c390-5b31-403e-bd53-52d7ec45056c'] Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23e195a0-8996-4fd8-b5f9-741f2196c78d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-security-groups/a1014af9-18fc-4a8b-981f-104101a22190 HTTP/1.1 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: exception: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-96d3c390-5b31-403e-bd53-52d7ec45056c'] Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a1014af9-18fc-4a8b-981f-104101a22190'} Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:43.737225 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d3c390-5b31-403e-bd53-52d7ec45056c'] Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d3c390-5b31-403e-bd53-52d7ec45056c'] Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d3c390-5b31-403e-bd53-52d7ec45056c'] Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d3c390-5b31-403e-bd53-52d7ec45056c'] Jul 26 20:00:43.741674 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.748604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23e195a0-8996-4fd8-b5f9-741f2196c78d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group a1014af9-18fc-4a8b-981f-104101a22190 does not exist Jul 26 20:00:43.748604 n-d-708768-8 devstack@n-api.service[125964]: Neutron server returns request_ids: ['req-96d3c390-5b31-403e-bd53-52d7ec45056c'] {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:43.749880 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23e195a0-8996-4fd8-b5f9-741f2196c78d tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a1014af9-18fc-4a8b-981f-104101a22190" status: 404 len: 194 microversion: 2.1 time: 0.286598 Jul 26 20:00:43.751061 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1829/3658] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:43 2022] DELETE /compute/v2.1/os-security-groups/a1014af9-18fc-4a8b-981f-104101a22190 => generated 194 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:43.758701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f6bbf5d-9bdb-401f-b6ce-d17aa68ed44c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:43.761114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f6bbf5d-9bdb-401f-b6ce-d17aa68ed44c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:43.769525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6bbf5d-9bdb-401f-b6ce-d17aa68ed44c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:43.783990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6bbf5d-9bdb-401f-b6ce-d17aa68ed44c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:43.793499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6bbf5d-9bdb-401f-b6ce-d17aa68ed44c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:43.793835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bf69665c-a413-4635-98ce-00acf12975ed tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:43.794318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6bbf5d-9bdb-401f-b6ce-d17aa68ed44c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:43.824729 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bf69665c-a413-4635-98ce-00acf12975ed tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1317 microversion: 2.1 time: 0.619061 Jul 26 20:00:43.841191 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1830/3659] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:43 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:00:43.858255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b64095bc-6370-49dd-9ba5-06b478a7fbea tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ec00670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:43.902385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-b64095bc-6370-49dd-9ba5-06b478a7fbea tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:43.902993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.security_group_api [None req-b64095bc-6370-49dd-9ba5-06b478a7fbea tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Neutron security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 not found {{(pid=125963) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 20:00:43.903513 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-b64095bc-6370-49dd-9ba5-06b478a7fbea tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 20:00:43.903513 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-bde0b848-c864-46e2-9a2b-20ce598efab4'] Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b64095bc-6370-49dd-9ba5-06b478a7fbea tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725 HTTP/1.1 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: exception: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-bde0b848-c864-46e2-9a2b-20ce598efab4'] Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '14db7ae0-8b06-478a-8f1b-bff7370a7725'} Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:43.905392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bde0b848-c864-46e2-9a2b-20ce598efab4'] Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bde0b848-c864-46e2-9a2b-20ce598efab4'] Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bde0b848-c864-46e2-9a2b-20ce598efab4'] Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bde0b848-c864-46e2-9a2b-20ce598efab4'] Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b64095bc-6370-49dd-9ba5-06b478a7fbea tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Security group 14db7ae0-8b06-478a-8f1b-bff7370a7725 does not exist Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: Neutron server returns request_ids: ['req-bde0b848-c864-46e2-9a2b-20ce598efab4'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b64095bc-6370-49dd-9ba5-06b478a7fbea tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725" status: 404 len: 194 microversion: 2.1 time: 0.064835 Jul 26 20:00:43.916730 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1831/3660] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:43 2022] DELETE /compute/v2.1/os-security-groups/14db7ae0-8b06-478a-8f1b-bff7370a7725 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:43.926830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-752a5737-fe24-45f1-a06d-f0ef5774f5ae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:43.926830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-752a5737-fe24-45f1-a06d-f0ef5774f5ae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:43.953721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-752a5737-fe24-45f1-a06d-f0ef5774f5ae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:43.955738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-752a5737-fe24-45f1-a06d-f0ef5774f5ae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:43.959006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-752a5737-fe24-45f1-a06d-f0ef5774f5ae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:43.959764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-752a5737-fe24-45f1-a06d-f0ef5774f5ae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:44.020411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-752a5737-fe24-45f1-a06d-f0ef5774f5ae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:00:44.228496 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-752a5737-fe24-45f1-a06d-f0ef5774f5ae tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 204 len: 0 microversion: 2.1 time: 0.312557 Jul 26 20:00:44.229282 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1832/3661] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:00:43 2022] DELETE /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:00:44.237958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f9e4a93-54b5-4d8c-b120-25fad66658cf tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:44.238813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5f9e4a93-54b5-4d8c-b120-25fad66658cf tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:44.262498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f9e4a93-54b5-4d8c-b120-25fad66658cf tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:44.263568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f9e4a93-54b5-4d8c-b120-25fad66658cf tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:44.264510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f9e4a93-54b5-4d8c-b120-25fad66658cf tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:44.265168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f9e4a93-54b5-4d8c-b120-25fad66658cf tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:44.583683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5f9e4a93-54b5-4d8c-b120-25fad66658cf tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:44.591695 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f9e4a93-54b5-4d8c-b120-25fad66658cf tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1646 microversion: 2.1 time: 0.357848 Jul 26 20:00:44.606640 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1833/3662] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:44 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1646 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:00:44.937870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f6bbf5d-9bdb-401f-b6ce-d17aa68ed44c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:44.951131 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f6bbf5d-9bdb-401f-b6ce-d17aa68ed44c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1679 microversion: 2.1 time: 1.198217 Jul 26 20:00:44.952588 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1830/3663] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:43 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1679 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:44.959487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e838e984-db90-492a-83da-125e9f75af11 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:44.960605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e838e984-db90-492a-83da-125e9f75af11 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:44.968135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e838e984-db90-492a-83da-125e9f75af11 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:44.968857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e838e984-db90-492a-83da-125e9f75af11 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:44.970887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e838e984-db90-492a-83da-125e9f75af11 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:44.972261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e838e984-db90-492a-83da-125e9f75af11 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:45.200471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2793a26e-522b-48aa-b7fc-3d02e0c6eb0f tempest-FloatingIPDetailsNegativeTestJSON-1026329371 tempest-FloatingIPDetailsNegativeTestJSON-1026329371-project] Calling method '.version_select at 0x7f875ec6b940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:45.272414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG neutronclient.v2_0.client [None req-2793a26e-522b-48aa-b7fc-3d02e0c6eb0f tempest-FloatingIPDetailsNegativeTestJSON-1026329371 tempest-FloatingIPDetailsNegativeTestJSON-1026329371-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 24e8e9dd-9b45-4185-8c92-000658bb4ab3 could not be found", "detail": ""}} {{(pid=125963) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 20:00:45.273290 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2793a26e-522b-48aa-b7fc-3d02e0c6eb0f tempest-FloatingIPDetailsNegativeTestJSON-1026329371 tempest-FloatingIPDetailsNegativeTestJSON-1026329371-project] HTTP exception thrown: Floating IP not found for ID 24e8e9dd-9b45-4185-8c92-000658bb4ab3 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2793a26e-522b-48aa-b7fc-3d02e0c6eb0f tempest-FloatingIPDetailsNegativeTestJSON-1026329371 tempest-FloatingIPDetailsNegativeTestJSON-1026329371-project] Request method failure captured: Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-floating-ips/24e8e9dd-9b45-4185-8c92-000658bb4ab3 HTTP/1.1 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EfsvYQQZBgR7vJJiATqh-bWo3Aqaw4wumtsiJ_imF6Vikkjbo-EAb-AR4d8RBN46SLbj0E4zAMqI6XLUQno2sEQ2BVTOPRqzOWmpAUE8ULiiKN6fYiGKoInyF9wCyWaBogKLay38z6KMizModcg91zsE_ndM74Q0jgxt7zVHMod63w Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e02d0f743ca44341885aaa585eb1b787 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1026329371 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e02d0f743ca44341885aaa585eb1b787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e02d0f743ca44341885aaa585eb1b787"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e02d0f743ca44341885aaa585eb1b787", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e02d0f743ca44341885aaa585eb1b787"}]}] Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1026329371 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e02d0f743ca44341885aaa585eb1b787 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1026329371 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1026329371-project Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: d1cd16d53cef40f28ffd597f1e238d8e Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1026329371-project Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: exception: Floating IP not found for ID 24e8e9dd-9b45-4185-8c92-000658bb4ab3 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '24e8e9dd-9b45-4185-8c92-000658bb4ab3'} Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 24e8e9dd-9b45-4185-8c92-000658bb4ab3 could not be found Jul 26 20:00:45.275863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37652bba-5a30-4a38-9a7b-ff3a026e6152'] Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 24e8e9dd-9b45-4185-8c92-000658bb4ab3. Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 24e8e9dd-9b45-4185-8c92-000658bb4ab3 Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 24e8e9dd-9b45-4185-8c92-000658bb4ab3 Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2793a26e-522b-48aa-b7fc-3d02e0c6eb0f tempest-FloatingIPDetailsNegativeTestJSON-1026329371 tempest-FloatingIPDetailsNegativeTestJSON-1026329371-project] Returning 404 to user: Floating IP not found for ID 24e8e9dd-9b45-4185-8c92-000658bb4ab3 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:45.281369 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2793a26e-522b-48aa-b7fc-3d02e0c6eb0f tempest-FloatingIPDetailsNegativeTestJSON-1026329371 tempest-FloatingIPDetailsNegativeTestJSON-1026329371-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/24e8e9dd-9b45-4185-8c92-000658bb4ab3" status: 404 len: 111 microversion: 2.1 time: 0.477515 Jul 26 20:00:45.284789 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1834/3664] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 20:00:44 2022] GET /compute/v2.1/os-floating-ips/24e8e9dd-9b45-4185-8c92-000658bb4ab3 => generated 111 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:45.620818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1dc52fdf-3e9e-44c4-bb6a-1fb1c732756e req-a9b6b2ca-b742-4af7-a895-9b7bcbd31cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e2d202-29db-49f8-8579-c4503d488f65", "name": "network-vif-plugged", "status": "completed", "tag": "99cb05f8-7781-4c63-b1bd-75311cb9642e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:45.667734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1dc52fdf-3e9e-44c4-bb6a-1fb1c732756e req-a9b6b2ca-b742-4af7-a895-9b7bcbd31cae service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:45.668379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1dc52fdf-3e9e-44c4-bb6a-1fb1c732756e req-a9b6b2ca-b742-4af7-a895-9b7bcbd31cae service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:45.697259 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1dc52fdf-3e9e-44c4-bb6a-1fb1c732756e req-a9b6b2ca-b742-4af7-a895-9b7bcbd31cae service nova] Creating event network-vif-plugged:99cb05f8-7781-4c63-b1bd-75311cb9642e for instance 11e2d202-29db-49f8-8579-c4503d488f65 on n-h1-708768-8 Jul 26 20:00:45.713232 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1dc52fdf-3e9e-44c4-bb6a-1fb1c732756e req-a9b6b2ca-b742-4af7-a895-9b7bcbd31cae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099921 Jul 26 20:00:45.714917 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1835/3665] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:45.748348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42eda81a-f870-4afc-9c53-f3a3b4076702 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:45.755373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-42eda81a-f870-4afc-9c53-f3a3b4076702 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:45.785571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42eda81a-f870-4afc-9c53-f3a3b4076702 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:45.786028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42eda81a-f870-4afc-9c53-f3a3b4076702 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:45.786820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42eda81a-f870-4afc-9c53-f3a3b4076702 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:45.794481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42eda81a-f870-4afc-9c53-f3a3b4076702 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:45.832926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:46.309947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e838e984-db90-492a-83da-125e9f75af11 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:46.320989 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e838e984-db90-492a-83da-125e9f75af11 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1317 microversion: 2.1 time: 1.366648 Jul 26 20:00:46.323239 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1831/3666] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:44 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1317 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:46.328867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c011fd76-2155-424d-bcf2-b98521a758e6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:46.329701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c011fd76-2155-424d-bcf2-b98521a758e6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:46.340672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c011fd76-2155-424d-bcf2-b98521a758e6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:46.341501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c011fd76-2155-424d-bcf2-b98521a758e6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:46.342708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c011fd76-2155-424d-bcf2-b98521a758e6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:46.344052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c011fd76-2155-424d-bcf2-b98521a758e6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:46.570405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-42eda81a-f870-4afc-9c53-f3a3b4076702 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:46.581062 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-42eda81a-f870-4afc-9c53-f3a3b4076702 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1646 microversion: 2.1 time: 0.864705 Jul 26 20:00:46.587086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c011fd76-2155-424d-bcf2-b98521a758e6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:46.595997 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c011fd76-2155-424d-bcf2-b98521a758e6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1613 microversion: 2.1 time: 0.271316 Jul 26 20:00:46.596583 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1832/3667] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:46 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1613 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:46.604107 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1836/3668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:45 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1646 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:47.356898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c5fc3513-3b81-4f41-ba34-a26ff090bc93 req-cffff379-65ef-4033-afae-1aa98cf2a5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd66cf0a-f4e4-4302-9442-01163ee9a46d", "name": "network-vif-deleted", "tag": "f188fd2b-0a4a-4ea1-a30c-78990e302ca5"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:47.358842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-133b510f-11db-4b86-bf54-74de01f59acc tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:47.362147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-133b510f-11db-4b86-bf54-74de01f59acc tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:47.397734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-133b510f-11db-4b86-bf54-74de01f59acc tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:47.399177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-133b510f-11db-4b86-bf54-74de01f59acc tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:47.405011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-133b510f-11db-4b86-bf54-74de01f59acc tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:47.407760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-133b510f-11db-4b86-bf54-74de01f59acc tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:47.410116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c5fc3513-3b81-4f41-ba34-a26ff090bc93 req-cffff379-65ef-4033-afae-1aa98cf2a5df service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:47.411567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c5fc3513-3b81-4f41-ba34-a26ff090bc93 req-cffff379-65ef-4033-afae-1aa98cf2a5df service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:47.472624 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c5fc3513-3b81-4f41-ba34-a26ff090bc93 req-cffff379-65ef-4033-afae-1aa98cf2a5df service nova] Creating event network-vif-deleted:f188fd2b-0a4a-4ea1-a30c-78990e302ca5 for instance dd66cf0a-f4e4-4302-9442-01163ee9a46d on n-h1-708768-8 Jul 26 20:00:47.489579 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c5fc3513-3b81-4f41-ba34-a26ff090bc93 req-cffff379-65ef-4033-afae-1aa98cf2a5df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144226 Jul 26 20:00:47.494353 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1837/3669] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:47.607395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e7ee4c60-83fc-4897-8268-a89cb9b941a5 req-1e2cf512-c6bf-4db4-baf5-d2d5a966b5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0321d941-da42-4951-83a6-0a609cd9344b", "name": "network-vif-deleted", "tag": "82a2ab61-ef06-4d3f-9e1d-9cd39e169e96"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:47.643104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e7ee4c60-83fc-4897-8268-a89cb9b941a5 req-1e2cf512-c6bf-4db4-baf5-d2d5a966b5be service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:47.647408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e7ee4c60-83fc-4897-8268-a89cb9b941a5 req-1e2cf512-c6bf-4db4-baf5-d2d5a966b5be service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:47.684798 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e7ee4c60-83fc-4897-8268-a89cb9b941a5 req-1e2cf512-c6bf-4db4-baf5-d2d5a966b5be service nova] Creating event network-vif-deleted:82a2ab61-ef06-4d3f-9e1d-9cd39e169e96 for instance 0321d941-da42-4951-83a6-0a609cd9344b on n-h2-708768-8 Jul 26 20:00:47.698018 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e7ee4c60-83fc-4897-8268-a89cb9b941a5 req-1e2cf512-c6bf-4db4-baf5-d2d5a966b5be service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094815 Jul 26 20:00:47.700711 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1838/3670] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:00:48.087835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:48.089609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:48.125003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:48.127779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:48.136365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:48.136874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:48.173443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-133b510f-11db-4b86-bf54-74de01f59acc tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:48.188614 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-133b510f-11db-4b86-bf54-74de01f59acc tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1317 microversion: 2.1 time: 0.848330 Jul 26 20:00:48.189216 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1833/3671] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:47 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1317 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:48.206529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:48.207141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:48.235880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:48.239228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:48.242815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:48.244099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:48.296952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:48.297598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:48.299449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lazy-loading 'fault' on Instance uuid dd66cf0a-f4e4-4302-9442-01163ee9a46d {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:00:48.336756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:48.337476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:48.338108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lazy-loading 'fault' on Instance uuid 0321d941-da42-4951-83a6-0a609cd9344b {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:00:48.515652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:48.526360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d7a793b-7ec9-4cb5-831e-3f2a41440bfd tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 200 len: 1331 microversion: 2.1 time: 0.823444 Jul 26 20:00:48.527074 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1839/3672] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:47 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 1331 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:48.596508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a01463edfde4e7eaa354aae42922731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32b5385a98245f2aa903b2360e4e89a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:48.614759 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-629c9d03-fada-4632-84dc-6c846e9aff10 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 200 len: 1306 microversion: 2.1 time: 0.408554 Jul 26 20:00:48.618525 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1834/3673] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:48 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 1306 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:49.261884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-570279c5-481d-43ec-bb90-9a3d4cf82056 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:49.261884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-570279c5-481d-43ec-bb90-9a3d4cf82056 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:49.261884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-570279c5-481d-43ec-bb90-9a3d4cf82056 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:49.261884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-570279c5-481d-43ec-bb90-9a3d4cf82056 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:49.261884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-570279c5-481d-43ec-bb90-9a3d4cf82056 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:49.261884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-570279c5-481d-43ec-bb90-9a3d4cf82056 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:49.576978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:49.578068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:49.615583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:49.622611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:49.627247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:49.629830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-570279c5-481d-43ec-bb90-9a3d4cf82056 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:49.631194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:49.649435 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-570279c5-481d-43ec-bb90-9a3d4cf82056 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1504 microversion: 2.1 time: 0.433172 Jul 26 20:00:49.651921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1840/3674] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:49 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:49.669903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:49.678418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] [instance: 0321d941-da42-4951-83a6-0a609cd9344b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:49.697750 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d HTTP/1.1 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'dd66cf0a-f4e4-4302-9442-01163ee9a46d'} Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:49.706869 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.710640 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:49.710640 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:49.710640 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:49.710640 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:49.710640 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:49.710640 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:00:49.710640 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.710640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:49.711415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e8b5193e-3be8-4e50-aaba-681f85a43605 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 404 len: 111 microversion: 2.1 time: 0.160354 Jul 26 20:00:49.714914 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1835/3675] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:49 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:49.715152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:49.715850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:49.719163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:49.719745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:49.723835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d776604-4eed-4e05-8083-573a5f80c2bb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:49.724359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d776604-4eed-4e05-8083-573a5f80c2bb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:49.749205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d776604-4eed-4e05-8083-573a5f80c2bb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:49.751075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d776604-4eed-4e05-8083-573a5f80c2bb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:49.754397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d776604-4eed-4e05-8083-573a5f80c2bb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:49.756820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d776604-4eed-4e05-8083-573a5f80c2bb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:49.774140 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] HTTP exception thrown: Instance 0321d941-da42-4951-83a6-0a609cd9344b could not be found. Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Request method failure captured: Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b HTTP/1.1 Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EeRG9kGjC2LhHFztDtiqX9QJaU1r22GJOgMwNpWOUUQZ2HczeY7VOEhhX3j4UTpJnkkZLMzBRWOSCOfXz04OLKn4j5vBYn0uB6God8jXl1BW8dKaK4MNDkW-bs_2eimpdYPeolRCPWU2T8S7Bzgx8mgzQ4cd4nmfZSSAo0V7SzZkYg Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f32b5385a98245f2aa903b2360e4e89a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f32b5385a98245f2aa903b2360e4e89a"}]}] Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f32b5385a98245f2aa903b2360e4e89a Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1111020839 Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5a01463edfde4e7eaa354aae42922731 Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-SecurityGroupsTestJSON-1111020839-project Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 0321d941-da42-4951-83a6-0a609cd9344b could not be found. Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '0321d941-da42-4951-83a6-0a609cd9344b'} Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0321d941-da42-4951-83a6-0a609cd9344b could not be found. Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0321d941-da42-4951-83a6-0a609cd9344b could not be found. Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:49.782702 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.786274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:49.786274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:49.786274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:49.786274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:49.786274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:49.786274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0321d941-da42-4951-83a6-0a609cd9344b could not be found. Jul 26 20:00:49.786274 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:00:49.792586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Returning 404 to user: Instance 0321d941-da42-4951-83a6-0a609cd9344b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:49.795704 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf175c2b-8c19-4e25-a2f7-b9f9d85e3733 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b" status: 404 len: 111 microversion: 2.1 time: 0.138663 Jul 26 20:00:49.798496 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1841/3676] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:49 2022] GET /compute/v2.1/servers/0321d941-da42-4951-83a6-0a609cd9344b => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:49.813711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-07b7783d-911b-4f55-963a-6ab205383552 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '.version_select at 0x7f875e3fc5e0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:49.848540 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-07b7783d-911b-4f55-963a-6ab205383552 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519705480" status: 202 len: 0 microversion: 2.1 time: 0.046199 Jul 26 20:00:49.849852 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1842/3677] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 20:00:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519705480 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:49.858797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8a14016-ceb2-4769-82bf-9495ccc91c27 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f875ebe1310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:49.940976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d776604-4eed-4e05-8083-573a5f80c2bb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:49.942147 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d776604-4eed-4e05-8083-573a5f80c2bb tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65/os-instance-actions/req-7892d785-aefb-4edf-b30f-f60311eb0cc7" status: 200 len: 313 microversion: 2.1 time: 0.228122 Jul 26 20:00:49.959667 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1836/3678] 10.222.0.58 () {58 vars in 1419 bytes} [Tue Jul 26 20:00:49 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65/os-instance-actions/req-7892d785-aefb-4edf-b30f-f60311eb0cc7 => generated 313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:49.974386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-316c8b15-802d-4ef8-95eb-d69e560ce346 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:49.992524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-316c8b15-802d-4ef8-95eb-d69e560ce346 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:50.006752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-316c8b15-802d-4ef8-95eb-d69e560ce346 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:50.010586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-316c8b15-802d-4ef8-95eb-d69e560ce346 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:50.011587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-316c8b15-802d-4ef8-95eb-d69e560ce346 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:50.012196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-316c8b15-802d-4ef8-95eb-d69e560ce346 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:50.219455 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-316c8b15-802d-4ef8-95eb-d69e560ce346 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "POST /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65/action" status: 202 len: 0 microversion: 2.1 time: 0.256096 Jul 26 20:00:50.234618 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1837/3679] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:00:49 2022] POST /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:50.244610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e86dc6f-ebdd-4f43-b606-f038b5acf174 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:50.245642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e86dc6f-ebdd-4f43-b606-f038b5acf174 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:50.268840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e86dc6f-ebdd-4f43-b606-f038b5acf174 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:50.269553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e86dc6f-ebdd-4f43-b606-f038b5acf174 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:50.270762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e86dc6f-ebdd-4f43-b606-f038b5acf174 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:50.271697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e86dc6f-ebdd-4f43-b606-f038b5acf174 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:50.846655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e86dc6f-ebdd-4f43-b606-f038b5acf174 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:50.855426 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e86dc6f-ebdd-4f43-b606-f038b5acf174 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1506 microversion: 2.1 time: 0.619404 Jul 26 20:00:50.858696 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1838/3680] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:50 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:51.823648 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8a14016-ceb2-4769-82bf-9495ccc91c27 tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/45af0cfc-d550-48c8-a9ce-e35c0de1b845" status: 202 len: 0 microversion: 2.1 time: 1.972507 Jul 26 20:00:51.824231 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1843/3681] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:49 2022] DELETE /compute/v2.1/os-security-groups/45af0cfc-d550-48c8-a9ce-e35c0de1b845 => generated 0 bytes in 1974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:51.832939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1625a6a-8f44-4da3-a981-2637f2cad5ec tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] Calling method '.version_select at 0x7f87565a2430>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:51.884348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1599b1ea-8f4b-4093-9607-0abb4a7a6318 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:51.885157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1599b1ea-8f4b-4093-9607-0abb4a7a6318 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:51.900165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1599b1ea-8f4b-4093-9607-0abb4a7a6318 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:51.906266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1599b1ea-8f4b-4093-9607-0abb4a7a6318 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:51.907336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1599b1ea-8f4b-4093-9607-0abb4a7a6318 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:51.907979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1599b1ea-8f4b-4093-9607-0abb4a7a6318 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:52.473710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1599b1ea-8f4b-4093-9607-0abb4a7a6318 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:52.488044 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1599b1ea-8f4b-4093-9607-0abb4a7a6318 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1506 microversion: 2.1 time: 0.608164 Jul 26 20:00:52.492343 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1844/3682] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:51 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:52.505443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b02dca6f-ef0f-458e-8d75-d053671cf3d1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: .version_select at 0x7f875ea3cca0>, body: {"keypair": {"name": "tempest-keypair-606940378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM+wtt2e9MAgqBFUe9/qYF9xjTbFyUjdHcuUhvd38eO5yN1jJm3YyvDmyyfl6GCz+gFFFtAeJVhkBiD7EkeMFtAS/9/0ey7oE7bqyg66H7d+IwMnVPj4qw7gVIkhqIHyg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:52.547356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-b02dca6f-ef0f-458e-8d75-d053671cf3d1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for project 2a16253a71a24312a17022e4f01ed652. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:00:52.566636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-b02dca6f-ef0f-458e-8d75-d053671cf3d1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for user 889459c783694048b93438ce16b75d0f and project 2a16253a71a24312a17022e4f01ed652. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:00:52.625048 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b02dca6f-ef0f-458e-8d75-d053671cf3d1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128758 Jul 26 20:00:52.625661 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1845/3683] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:00:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:53.078314 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1625a6a-8f44-4da3-a981-2637f2cad5ec tempest-SecurityGroupsTestJSON-1111020839 tempest-SecurityGroupsTestJSON-1111020839-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/f44a7d1b-5cf6-4f00-90c2-144e25d2cf29" status: 202 len: 0 microversion: 2.1 time: 1.249589 Jul 26 20:00:53.078898 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1839/3684] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:00:51 2022] DELETE /compute/v2.1/os-security-groups/f44a7d1b-5cf6-4f00-90c2-144e25d2cf29 => generated 0 bytes in 1251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:00:53.515278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0ab0a7b-cfec-43e6-84e9-692b4b603ff7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:53.516061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0ab0a7b-cfec-43e6-84e9-692b4b603ff7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:53.531428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ab0a7b-cfec-43e6-84e9-692b4b603ff7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:53.533856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ab0a7b-cfec-43e6-84e9-692b4b603ff7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:53.534860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ab0a7b-cfec-43e6-84e9-692b4b603ff7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:53.540206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ab0a7b-cfec-43e6-84e9-692b4b603ff7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:54.385059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0ab0a7b-cfec-43e6-84e9-692b4b603ff7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:54.403207 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0ab0a7b-cfec-43e6-84e9-692b4b603ff7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1504 microversion: 2.1 time: 0.888863 Jul 26 20:00:54.415638 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1846/3685] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:53 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1504 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:54.429745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1c8f4f53-43e0-4468-8f2f-35e5128da6f9 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '.version_select at 0x7f876830ec10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:54.430529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1c8f4f53-43e0-4468-8f2f-35e5128da6f9 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:54.449885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c8f4f53-43e0-4468-8f2f-35e5128da6f9 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:54.450016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c8f4f53-43e0-4468-8f2f-35e5128da6f9 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:54.450855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c8f4f53-43e0-4468-8f2f-35e5128da6f9 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:54.451364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c8f4f53-43e0-4468-8f2f-35e5128da6f9 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:54.512040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:54.514868 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1c8f4f53-43e0-4468-8f2f-35e5128da6f9 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.089719 Jul 26 20:00:54.516069 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1840/3686] 10.222.0.58 () {58 vars in 1296 bytes} [Tue Jul 26 20:00:54 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65/os-instance-actions => generated 611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:54.529817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30216cae-8566-4bbc-8101-a46d3d97982d tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:54.531246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30216cae-8566-4bbc-8101-a46d3d97982d tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:54.546225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30216cae-8566-4bbc-8101-a46d3d97982d tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:54.549755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30216cae-8566-4bbc-8101-a46d3d97982d tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:54.550760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30216cae-8566-4bbc-8101-a46d3d97982d tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:54.551341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30216cae-8566-4bbc-8101-a46d3d97982d tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:54.605685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30216cae-8566-4bbc-8101-a46d3d97982d tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:00:54.742119 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-30216cae-8566-4bbc-8101-a46d3d97982d tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "DELETE /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 204 len: 0 microversion: 2.1 time: 0.215525 Jul 26 20:00:54.743590 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1847/3687] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:00:54 2022] DELETE /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:00:54.750989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-18d43922-9269-4396-aa63-b33f04b18f9f tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:54.751620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-18d43922-9269-4396-aa63-b33f04b18f9f tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:54.761615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:00:54.763479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18d43922-9269-4396-aa63-b33f04b18f9f tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:54.764108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18d43922-9269-4396-aa63-b33f04b18f9f tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:54.765272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18d43922-9269-4396-aa63-b33f04b18f9f tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:54.765927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18d43922-9269-4396-aa63-b33f04b18f9f tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:55.299671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-18d43922-9269-4396-aa63-b33f04b18f9f tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:55.309649 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-18d43922-9269-4396-aa63-b33f04b18f9f tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1510 microversion: 2.1 time: 0.562567 Jul 26 20:00:55.327084 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1841/3688] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:54 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1510 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:56.354242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dc1c013-5c71-46f4-915b-96306ae4a782 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:56.355672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1dc1c013-5c71-46f4-915b-96306ae4a782 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:56.363190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dc1c013-5c71-46f4-915b-96306ae4a782 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:56.364109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dc1c013-5c71-46f4-915b-96306ae4a782 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:56.365096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dc1c013-5c71-46f4-915b-96306ae4a782 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:56.365723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dc1c013-5c71-46f4-915b-96306ae4a782 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:57.184492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1dc1c013-5c71-46f4-915b-96306ae4a782 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:57.193726 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1dc1c013-5c71-46f4-915b-96306ae4a782 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1510 microversion: 2.1 time: 0.844791 Jul 26 20:00:57.212599 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1848/3689] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:56 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1510 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:58.003956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-58c401c6-6142-463d-b624-b66264ac309f req-dedf1434-6bc8-4574-94c4-53640295f159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e2d202-29db-49f8-8579-c4503d488f65", "name": "network-vif-deleted", "tag": "99cb05f8-7781-4c63-b1bd-75311cb9642e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:58.017876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-58c401c6-6142-463d-b624-b66264ac309f req-dedf1434-6bc8-4574-94c4-53640295f159 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:58.018694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-58c401c6-6142-463d-b624-b66264ac309f req-dedf1434-6bc8-4574-94c4-53640295f159 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:58.055939 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-58c401c6-6142-463d-b624-b66264ac309f req-dedf1434-6bc8-4574-94c4-53640295f159 service nova] Creating event network-vif-deleted:99cb05f8-7781-4c63-b1bd-75311cb9642e for instance 11e2d202-29db-49f8-8579-c4503d488f65 on n-h1-708768-8 Jul 26 20:00:58.063361 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-58c401c6-6142-463d-b624-b66264ac309f req-dedf1434-6bc8-4574-94c4-53640295f159 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064646 Jul 26 20:00:58.067382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1842/3690] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:00:58.217942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:58.218637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:58.237275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:58.238222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:58.239322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:58.239972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:58.340170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:58.341288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:58.342259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lazy-loading 'fault' on Instance uuid 11e2d202-29db-49f8-8579-c4503d488f65 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:00:58.646598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c46e5ebc3146719ee212d9f64b0517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b52d086b64580a646df4041fc4335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:00:58.656216 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3174ebaf-605c-4a0f-a262-6ed8a346e5e7 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 200 len: 1307 microversion: 2.1 time: 0.442139 Jul 26 20:00:58.659940 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1849/3691] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:58 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 1307 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:00:59.679207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:00:59.680702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] [instance: 11e2d202-29db-49f8-8579-c4503d488f65] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:00:59.692986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:59.694932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:59.701677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:00:59.702150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:00:59.721674 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] HTTP exception thrown: Instance 11e2d202-29db-49f8-8579-c4503d488f65 could not be found. Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Request method failure captured: Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 HTTP/1.1 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EfbF7G4fahHm-F0RrXVLFFbqIfo1P6jVreXhZuuK78Lsw3SowFzz3ZKUgeQRqu03TsP21EI-ebF59fBMmj-W26YjQX7Tzu4yRjCD3YerDF6icSxK72mUMnjH6e3OGl2LzO1jnaAVFhb5vPbghLoF7yK768G9hlVuAUIsPxagu60FjU Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 0f4b52d086b64580a646df4041fc4335 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-InstanceActionsTestJSON-1636687803 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0f4b52d086b64580a646df4041fc4335"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f4b52d086b64580a646df4041fc4335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0f4b52d086b64580a646df4041fc4335", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f4b52d086b64580a646df4041fc4335"}]}] Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-InstanceActionsTestJSON-1636687803 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 0f4b52d086b64580a646df4041fc4335 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1636687803 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-InstanceActionsTestJSON-1636687803-project Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 77c46e5ebc3146719ee212d9f64b0517 Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-InstanceActionsTestJSON-1636687803-project Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 11e2d202-29db-49f8-8579-c4503d488f65 could not be found. Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '11e2d202-29db-49f8-8579-c4503d488f65'} Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e2d202-29db-49f8-8579-c4503d488f65 could not be found. Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e2d202-29db-49f8-8579-c4503d488f65 could not be found. Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:00:59.723384 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e2d202-29db-49f8-8579-c4503d488f65 could not be found. Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] Returning 404 to user: Instance 11e2d202-29db-49f8-8579-c4503d488f65 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:00:59.727521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1cf1a4bc-5a24-4987-893f-2cc75ecbdf95 tempest-InstanceActionsTestJSON-1636687803 tempest-InstanceActionsTestJSON-1636687803-project] 10.222.0.58 "GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65" status: 404 len: 111 microversion: 2.1 time: 0.051232 Jul 26 20:00:59.729320 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1843/3692] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:00:59 2022] GET /compute/v2.1/servers/11e2d202-29db-49f8-8579-c4503d488f65 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:00:59.815841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-82078939", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa81df3d-9f96-49e8-813d-dbedef5ea966"}], "security_groups": [{"name": "tempest-securitygroup--1819986636"}], "key_name": "tempest-keypair-606940378", "user_data": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:00:59.892189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:00.278373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] validate_networks() for [('aa81df3d-9f96-49e8-813d-dbedef5ea966', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:01:01.797944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:01:01.798938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:01:01.799566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:01:01.800171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:01:01.800720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:01:01.826022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:01.826460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:01.827276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:01.830638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:01.905010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for project 2a16253a71a24312a17022e4f01ed652. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:01.917194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Getting quotas for user 889459c783694048b93438ce16b75d0f and project 2a16253a71a24312a17022e4f01ed652. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:01.986824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:01:01.992116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:01:02.134967 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08dfbf1b-9d39-455f-b7fd-7e254c5f937c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.329950 Jul 26 20:01:02.136178 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1850/3693] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:00:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:01:02.147027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d4aaca6-d16c-4a20-8f3a-bc5d90857416 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:02.149383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d4aaca6-d16c-4a20-8f3a-bc5d90857416 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:02.528240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d4aaca6-d16c-4a20-8f3a-bc5d90857416 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:02.539365 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d4aaca6-d16c-4a20-8f3a-bc5d90857416 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1239 microversion: 2.1 time: 0.396354 Jul 26 20:01:02.557081 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1844/3694] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:02 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1239 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:03.389694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df51ab34-a48f-4a91-99d1-765dc01362cb tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Calling method '.version_select at 0x7f875ecdc5e0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:03.467488 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df51ab34-a48f-4a91-99d1-765dc01362cb tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e" status: 200 len: 636 microversion: 2.1 time: 0.082697 Jul 26 20:01:03.483519 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1851/3695] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:01:03 2022] GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e => generated 636 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:03.488783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99cf39c0-56e7-4898-b90d-3a9f0c8121cc tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'update_all', calling method: .version_select at 0x7f87565a2430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:03.572694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5fdaee9d-45e8-4d7c-b0fb-1d2e63981260 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:03.573605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5fdaee9d-45e8-4d7c-b0fb-1d2e63981260 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:03.588975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fdaee9d-45e8-4d7c-b0fb-1d2e63981260 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:03.589492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fdaee9d-45e8-4d7c-b0fb-1d2e63981260 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:03.590361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fdaee9d-45e8-4d7c-b0fb-1d2e63981260 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:03.590833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5fdaee9d-45e8-4d7c-b0fb-1d2e63981260 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:03.646908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-99cf39c0-56e7-4898-b90d-3a9f0c8121cc tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:03.677455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-99cf39c0-56e7-4898-b90d-3a9f0c8121cc tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:03.796384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5fdaee9d-45e8-4d7c-b0fb-1d2e63981260 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:03.812138 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5fdaee9d-45e8-4d7c-b0fb-1d2e63981260 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1235 microversion: 2.1 time: 0.245187 Jul 26 20:01:03.813011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1852/3696] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:03 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1235 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:04.296212 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-99cf39c0-56e7-4898-b90d-3a9f0c8121cc tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.811063 Jul 26 20:01:04.297191 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1845/3697] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:03 2022] PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 61 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:04.309057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5935d4f3-4f18-4070-a7ec-5c28bd3f152d tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Calling method '.version_select at 0x7f875ecdc280>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:04.723598 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5935d4f3-4f18-4070-a7ec-5c28bd3f152d tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "DELETE /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.420536 Jul 26 20:01:04.725894 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1853/3698] 10.222.0.58 () {58 vars in 1296 bytes} [Tue Jul 26 20:01:04 2022] DELETE /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata/os_version => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:01:04.733927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d51b7930-96c1-4e89-bf2e-504bd6c21749 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Calling method '.version_select at 0x7f8756604670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:04.797277 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d51b7930-96c1-4e89-bf2e-504bd6c21749 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.066822 Jul 26 20:01:04.805390 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1846/3699] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 20:01:04 2022] GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 37 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:04.810371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a2ccd0a3-17b9-4cb6-92a6-4d75f3e06a8e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'update_all', calling method: .version_select at 0x7f87682b6670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:04.834681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0fa7b96b-00e8-4052-b628-e7f2fa81eba0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:04.835724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0fa7b96b-00e8-4052-b628-e7f2fa81eba0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:04.849422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fa7b96b-00e8-4052-b628-e7f2fa81eba0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:04.850065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fa7b96b-00e8-4052-b628-e7f2fa81eba0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:04.852537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fa7b96b-00e8-4052-b628-e7f2fa81eba0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:04.853177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fa7b96b-00e8-4052-b628-e7f2fa81eba0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:04.889467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a2ccd0a3-17b9-4cb6-92a6-4d75f3e06a8e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:04.905095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a2ccd0a3-17b9-4cb6-92a6-4d75f3e06a8e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:05.076030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0fa7b96b-00e8-4052-b628-e7f2fa81eba0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:05.088602 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0fa7b96b-00e8-4052-b628-e7f2fa81eba0 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1297 microversion: 2.1 time: 0.257997 Jul 26 20:01:05.091004 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1847/3700] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:04 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1297 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:05.377208 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a2ccd0a3-17b9-4cb6-92a6-4d75f3e06a8e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.570893 Jul 26 20:01:05.378055 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1854/3701] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:04 2022] PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 61 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:01:05.387654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-71f9dc90-766b-4dc8-9dc0-79e6a0c98c0e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Calling method '.version_select at 0x7f875654aee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:05.444567 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-71f9dc90-766b-4dc8-9dc0-79e6a0c98c0e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.060650 Jul 26 20:01:05.445565 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1848/3702] 10.222.0.58 () {58 vars in 1290 bytes} [Tue Jul 26 20:01:05 2022] GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata/os_distro => generated 33 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:05.460414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9c22808e-7fa5-4908-ab3f-3ee8ccab3850 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'update_all', calling method: .version_select at 0x7f875ec00a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:05.545848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9c22808e-7fa5-4908-ab3f-3ee8ccab3850 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:05.555918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9c22808e-7fa5-4908-ab3f-3ee8ccab3850 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:05.886631 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9c22808e-7fa5-4908-ab3f-3ee8ccab3850 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.431569 Jul 26 20:01:05.888992 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1855/3703] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:05 2022] PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 61 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:05.902279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b4dd553-a466-4e76-a50f-0ef7a060e254 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Calling method '.version_select at 0x7f875654b5e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:05.995741 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b4dd553-a466-4e76-a50f-0ef7a060e254 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.100489 Jul 26 20:01:05.996673 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1849/3704] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 20:01:05 2022] GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 61 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:06.009458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d3946dee-2190-41bc-aa01-855ec8f1d9f2 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'update_all', calling method: .version_select at 0x7f875e2ec040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:06.091742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-d3946dee-2190-41bc-aa01-855ec8f1d9f2 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:06.101518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-d3946dee-2190-41bc-aa01-855ec8f1d9f2 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:06.118929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c4eddedc-eadd-4907-a9a2-0506a5e6652f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:06.120292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c4eddedc-eadd-4907-a9a2-0506a5e6652f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:06.129720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4eddedc-eadd-4907-a9a2-0506a5e6652f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:06.132874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4eddedc-eadd-4907-a9a2-0506a5e6652f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:06.133694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4eddedc-eadd-4907-a9a2-0506a5e6652f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:06.135595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4eddedc-eadd-4907-a9a2-0506a5e6652f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:06.356756 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d3946dee-2190-41bc-aa01-855ec8f1d9f2 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.352708 Jul 26 20:01:06.357477 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1856/3705] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:06 2022] PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 61 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:06.374070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9373f0ca-73d0-40a2-a7b9-5a297706f9cd tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'update_all', calling method: .version_select at 0x7f87683e54c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:06.440256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c4eddedc-eadd-4907-a9a2-0506a5e6652f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:06.445764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9373f0ca-73d0-40a2-a7b9-5a297706f9cd tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:06.450137 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c4eddedc-eadd-4907-a9a2-0506a5e6652f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1297 microversion: 2.1 time: 0.336310 Jul 26 20:01:06.453668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9373f0ca-73d0-40a2-a7b9-5a297706f9cd tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:06.454767 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1850/3706] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:06 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1297 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:07.289730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9373f0ca-73d0-40a2-a7b9-5a297706f9cd tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.925709 Jul 26 20:01:07.291784 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1857/3707] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:06 2022] PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 64 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:01:07.301061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d06d27a-4086-4eae-af73-f605d464c2e9 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Calling method '.version_select at 0x7f876830edc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:07.380208 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d06d27a-4086-4eae-af73-f605d464c2e9 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.083109 Jul 26 20:01:07.381390 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1851/3708] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 20:01:07 2022] GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:07.397717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60fde790-75a0-4c32-808d-64960e69e8e6 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'update_all', calling method: .version_select at 0x7f875ec61160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:07.478930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ddc5e015-a56a-4d63-a9b7-ae9b5a5ad737 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:07.479574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ddc5e015-a56a-4d63-a9b7-ae9b5a5ad737 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:07.481310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-60fde790-75a0-4c32-808d-64960e69e8e6 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:07.490240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-60fde790-75a0-4c32-808d-64960e69e8e6 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:07.498192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddc5e015-a56a-4d63-a9b7-ae9b5a5ad737 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:07.500460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddc5e015-a56a-4d63-a9b7-ae9b5a5ad737 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:07.501430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddc5e015-a56a-4d63-a9b7-ae9b5a5ad737 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:07.503479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ddc5e015-a56a-4d63-a9b7-ae9b5a5ad737 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:08.191050 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60fde790-75a0-4c32-808d-64960e69e8e6 tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.802419 Jul 26 20:01:08.192474 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1858/3709] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:07 2022] PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 61 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:08.202680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7e70622d-450f-4c7e-a12a-b709bdd7a75e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'update', calling method: .version_select at 0x7f875ec6b1f0>, body: {"meta": {"os_version": "alt"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:08.309339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7e70622d-450f-4c7e-a12a-b709bdd7a75e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:08.340102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7e70622d-450f-4c7e-a12a-b709bdd7a75e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:08.482786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ddc5e015-a56a-4d63-a9b7-ae9b5a5ad737 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:08.491492 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ddc5e015-a56a-4d63-a9b7-ae9b5a5ad737 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1365 microversion: 2.1 time: 1.018606 Jul 26 20:01:08.492488 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1852/3710] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:07 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1365 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:08.954058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7e70622d-450f-4c7e-a12a-b709bdd7a75e tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.756091 Jul 26 20:01:08.957006 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1859/3711] 10.222.0.58 () {60 vars in 1313 bytes} [Tue Jul 26 20:01:08 2022] PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata/os_version => generated 31 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:01:08.967265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f97d4c90-221d-4de6-ade7-c0a866d8164c tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Calling method '.version_select at 0x7f875656fd30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:09.057020 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f97d4c90-221d-4de6-ade7-c0a866d8164c tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.093646 Jul 26 20:01:09.062916 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1853/3712] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 20:01:08 2022] GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 58 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:09.070616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc642e9f-c132-4708-9723-fcb9a1fe98fb tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'update_all', calling method: .version_select at 0x7f875e2e90d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:09.197394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fc642e9f-c132-4708-9723-fcb9a1fe98fb tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:09.212987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fc642e9f-c132-4708-9723-fcb9a1fe98fb tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:09.514684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-578b66c0-9537-44c9-93eb-eefe5b2b245e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:09.515963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-578b66c0-9537-44c9-93eb-eefe5b2b245e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:09.530699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578b66c0-9537-44c9-93eb-eefe5b2b245e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:09.540631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578b66c0-9537-44c9-93eb-eefe5b2b245e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:09.541913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578b66c0-9537-44c9-93eb-eefe5b2b245e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:09.542594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578b66c0-9537-44c9-93eb-eefe5b2b245e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:09.958648 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc642e9f-c132-4708-9723-fcb9a1fe98fb tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.893937 Jul 26 20:01:09.959254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1860/3713] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:09 2022] PUT /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 61 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:01:09.970510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-097645fa-7dce-46db-a6c1-c7c6f6441d3d tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Action: 'create', calling method: .version_select at 0x7f875e2f21f0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:10.081702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-097645fa-7dce-46db-a6c1-c7c6f6441d3d tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:10.090536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-097645fa-7dce-46db-a6c1-c7c6f6441d3d tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Getting quotas for user e93dc0ff458242dcb3d034442573e17e and project d6cf54a4b8cd4a6c9672307564d54df7. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:10.643207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-578b66c0-9537-44c9-93eb-eefe5b2b245e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:10.662015 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-578b66c0-9537-44c9-93eb-eefe5b2b245e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1365 microversion: 2.1 time: 1.151477 Jul 26 20:01:10.666944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1854/3714] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:09 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1365 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:10.700374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-897832831", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "3cdc6733-4307-4559-ac37-6ca56c9c6ea9"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:10.826801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] validate_networks() for [('3cdc6733-4307-4559-ac37-6ca56c9c6ea9', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:01:11.093897 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-097645fa-7dce-46db-a6c1-c7c6f6441d3d tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "POST /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 85 microversion: 2.1 time: 1.128377 Jul 26 20:01:11.094609 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1861/3715] 10.222.0.58 () {60 vars in 1281 bytes} [Tue Jul 26 20:01:09 2022] POST /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 85 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:01:11.104693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6a9f0937-1f8e-4ea5-9163-d5d03d813b9c tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] Calling method '.version_select at 0x7f875e2f3550>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:11.189711 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6a9f0937-1f8e-4ea5-9163-d5d03d813b9c tempest-ImagesMetadataTestJSON-1368578675 tempest-ImagesMetadataTestJSON-1368578675-project] 10.222.0.58 "GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.086313 Jul 26 20:01:11.190975 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1862/3716] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Jul 26 20:01:11 2022] GET /compute/v2.1/images/befc54cc-a29b-4e41-8300-5043c0f79c5e/metadata => generated 85 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:01:11.628647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ecf84292-1cf6-4af6-a265-0121f970342d req-b0794712-bdf5-4245-810a-bb66f0752c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c9b8aa-c3eb-4a64-aed8-59f12802443f", "tag": "bd198809-bf20-433c-b369-1d8bfd37b9b6"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:11.672115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ecf84292-1cf6-4af6-a265-0121f970342d req-b0794712-bdf5-4245-810a-bb66f0752c5a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:11.672583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ecf84292-1cf6-4af6-a265-0121f970342d req-b0794712-bdf5-4245-810a-bb66f0752c5a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:11.701552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ecf84292-1cf6-4af6-a265-0121f970342d req-b0794712-bdf5-4245-810a-bb66f0752c5a service nova] Creating event network-changed:bd198809-bf20-433c-b369-1d8bfd37b9b6 for instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f on n-h2-708768-8 Jul 26 20:01:11.713523 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ecf84292-1cf6-4af6-a265-0121f970342d req-b0794712-bdf5-4245-810a-bb66f0752c5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090661 Jul 26 20:01:11.714146 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1863/3717] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:01:11.724494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1cbe8f7f-bd6b-48fa-be07-79f40b80f9fb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:11.725258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1cbe8f7f-bd6b-48fa-be07-79f40b80f9fb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:11.754239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cbe8f7f-bd6b-48fa-be07-79f40b80f9fb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:11.754528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cbe8f7f-bd6b-48fa-be07-79f40b80f9fb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:11.755324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cbe8f7f-bd6b-48fa-be07-79f40b80f9fb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:11.767981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cbe8f7f-bd6b-48fa-be07-79f40b80f9fb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:11.880082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:12.456383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1cbe8f7f-bd6b-48fa-be07-79f40b80f9fb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:12.469890 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1cbe8f7f-bd6b-48fa-be07-79f40b80f9fb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1365 microversion: 2.1 time: 0.753139 Jul 26 20:01:12.470508 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1864/3718] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:11 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1365 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:12.602675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:01:12.603182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:01:12.603806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:01:12.604296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:01:12.604866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:01:12.625415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:12.627759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:12.628867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:12.629507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:12.698124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Getting quotas for project 33d19bedc79942d08bb1c0c5006f8764. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:12.709509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Getting quotas for user 9b389e99c8f34d16889b21af192dcf99 and project 33d19bedc79942d08bb1c0c5006f8764. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:12.765350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:01:12.773668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:01:12.877499 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f47a086-1c4d-4a92-836f-a1a947658e88 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.181656 Jul 26 20:01:12.878947 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1855/3719] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:01:12.892344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-122d8ec3-37b5-4372-aaa9-56d9ff7cd7a2 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:12.893185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-122d8ec3-37b5-4372-aaa9-56d9ff7cd7a2 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:13.020374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-808991458", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "cf037c02-1617-4c0e-9c3f-0a7a9367a791"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:13.093388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-122d8ec3-37b5-4372-aaa9-56d9ff7cd7a2 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:13.116698 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-122d8ec3-37b5-4372-aaa9-56d9ff7cd7a2 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1213 microversion: 2.1 time: 0.225878 Jul 26 20:01:13.131435 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1856/3720] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:12 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:13.146773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] validate_networks() for [('cf037c02-1617-4c0e-9c3f-0a7a9367a791', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:01:13.490568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8ced2f6f-9ade-42b1-ab5e-1319337e14a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:13.492709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8ced2f6f-9ade-42b1-ab5e-1319337e14a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:13.504765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ced2f6f-9ade-42b1-ab5e-1319337e14a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:13.510674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ced2f6f-9ade-42b1-ab5e-1319337e14a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:13.511975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ced2f6f-9ade-42b1-ab5e-1319337e14a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:13.512596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ced2f6f-9ade-42b1-ab5e-1319337e14a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:14.083266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8ced2f6f-9ade-42b1-ab5e-1319337e14a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:14.104955 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8ced2f6f-9ade-42b1-ab5e-1319337e14a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1365 microversion: 2.1 time: 0.615148 Jul 26 20:01:14.111763 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1857/3721] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:13 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1365 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:14.140798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7e66168e-e010-4d59-ad53-342e7a4c5fdb tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:14.142594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7e66168e-e010-4d59-ad53-342e7a4c5fdb tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:14.168199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e66168e-e010-4d59-ad53-342e7a4c5fdb tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:14.171964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e66168e-e010-4d59-ad53-342e7a4c5fdb tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:14.173007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e66168e-e010-4d59-ad53-342e7a4c5fdb tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:14.175970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e66168e-e010-4d59-ad53-342e7a4c5fdb tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:14.309975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7e66168e-e010-4d59-ad53-342e7a4c5fdb tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:14.330114 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7e66168e-e010-4d59-ad53-342e7a4c5fdb tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1265 microversion: 2.1 time: 0.194915 Jul 26 20:01:14.331328 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1858/3722] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:14 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:15.133666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d2b6896-28f7-4841-8924-9d9c18014939 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:15.139014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d2b6896-28f7-4841-8924-9d9c18014939 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:15.155624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d2b6896-28f7-4841-8924-9d9c18014939 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:15.157362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d2b6896-28f7-4841-8924-9d9c18014939 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:15.159846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d2b6896-28f7-4841-8924-9d9c18014939 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:15.161363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d2b6896-28f7-4841-8924-9d9c18014939 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:15.258088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:01:15.259170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:01:15.259915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:01:15.260544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:01:15.261169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:01:15.286392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:15.287231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:15.289116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:15.289807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:15.334889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Getting quotas for project 77f045929c9c4ea19c0aacbb25ae567c. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:15.343239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Getting quotas for user 64b1ab7fc09e4125aaa099cba8b299a1 and project 77f045929c9c4ea19c0aacbb25ae567c. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:15.373948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:01:15.380822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:01:15.449481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:15.499156 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-33fb277a-4dde-4611-be3e-b19a4ad23e0d tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.025377 Jul 26 20:01:15.506587 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1865/3723] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 20:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 20:01:15.516057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dd3b0fb0-f1c7-42d1-91a8-b645f702f1d3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:15.516885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dd3b0fb0-f1c7-42d1-91a8-b645f702f1d3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:15.530928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd3b0fb0-f1c7-42d1-91a8-b645f702f1d3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:15.536238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd3b0fb0-f1c7-42d1-91a8-b645f702f1d3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:15.537288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd3b0fb0-f1c7-42d1-91a8-b645f702f1d3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:15.538435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd3b0fb0-f1c7-42d1-91a8-b645f702f1d3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:15.858713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dd3b0fb0-f1c7-42d1-91a8-b645f702f1d3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:15.866509 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dd3b0fb0-f1c7-42d1-91a8-b645f702f1d3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1271 microversion: 2.1 time: 0.358743 Jul 26 20:01:15.867198 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1866/3724] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:15 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1271 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:15.888000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15036211-7883-4714-874e-bfa1f300e13f tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:15.888746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-15036211-7883-4714-874e-bfa1f300e13f tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:16.092476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d2b6896-28f7-4841-8924-9d9c18014939 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:16.109033 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d2b6896-28f7-4841-8924-9d9c18014939 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1365 microversion: 2.1 time: 0.985035 Jul 26 20:01:16.112046 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1859/3725] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:15 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1365 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:16.188413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15036211-7883-4714-874e-bfa1f300e13f tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:16.204307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15036211-7883-4714-874e-bfa1f300e13f tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:16.206686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15036211-7883-4714-874e-bfa1f300e13f tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:16.208212 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15036211-7883-4714-874e-bfa1f300e13f tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1258 microversion: 2.21 time: 0.340027 Jul 26 20:01:16.209038 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1867/3726] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:15 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1258 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:16.889887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-019775e2-32cf-48d3-84c6-9715d027ae93 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:16.891103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-019775e2-32cf-48d3-84c6-9715d027ae93 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:16.901807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-019775e2-32cf-48d3-84c6-9715d027ae93 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:16.902927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-019775e2-32cf-48d3-84c6-9715d027ae93 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:16.905111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-019775e2-32cf-48d3-84c6-9715d027ae93 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:16.905721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-019775e2-32cf-48d3-84c6-9715d027ae93 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:17.135129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-44472e1e-3076-44bd-8e0a-fa7024432f5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:17.135871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-44472e1e-3076-44bd-8e0a-fa7024432f5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:17.150629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44472e1e-3076-44bd-8e0a-fa7024432f5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:17.151468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44472e1e-3076-44bd-8e0a-fa7024432f5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:17.153775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44472e1e-3076-44bd-8e0a-fa7024432f5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:17.156898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44472e1e-3076-44bd-8e0a-fa7024432f5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:17.194835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:17.383086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-019775e2-32cf-48d3-84c6-9715d027ae93 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:17.396903 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-019775e2-32cf-48d3-84c6-9715d027ae93 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 0.512105 Jul 26 20:01:17.398573 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1860/3727] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:16 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:17.405535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:17.407153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:17.432156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:17.441363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:17.442490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:17.444558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:17.746290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-44472e1e-3076-44bd-8e0a-fa7024432f5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:17.771325 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-44472e1e-3076-44bd-8e0a-fa7024432f5d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1365 microversion: 2.1 time: 0.639991 Jul 26 20:01:17.784569 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1868/3728] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:17 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1365 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:17.862243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:17.921379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:17.942439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:17.947832 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-86053433-30aa-4c3c-be2b-897326b209fc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1316 microversion: 2.21 time: 0.546263 Jul 26 20:01:17.948687 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1861/3729] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:17 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:18.424195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6108bf87-ee4a-4c60-8977-40a45cca7bd4 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:18.424894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6108bf87-ee4a-4c60-8977-40a45cca7bd4 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:18.438251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6108bf87-ee4a-4c60-8977-40a45cca7bd4 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:18.438704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6108bf87-ee4a-4c60-8977-40a45cca7bd4 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:18.444173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6108bf87-ee4a-4c60-8977-40a45cca7bd4 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:18.444528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6108bf87-ee4a-4c60-8977-40a45cca7bd4 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:18.800765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f68e38a-bc33-4cf8-b900-370443837196 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:18.801397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f68e38a-bc33-4cf8-b900-370443837196 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:18.818387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f68e38a-bc33-4cf8-b900-370443837196 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:18.819731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f68e38a-bc33-4cf8-b900-370443837196 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:18.824166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f68e38a-bc33-4cf8-b900-370443837196 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:18.825435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f68e38a-bc33-4cf8-b900-370443837196 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:19.209109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6108bf87-ee4a-4c60-8977-40a45cca7bd4 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:19.238510 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6108bf87-ee4a-4c60-8977-40a45cca7bd4 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 0.818233 Jul 26 20:01:19.254496 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1869/3730] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:18 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:19.277619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:19.278564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:19.290774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:19.291690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:19.292809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:19.293813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:19.467211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:19.479363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:19.484371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1f68e38a-bc33-4cf8-b900-370443837196 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:19.487919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:19.495844 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f68e38a-bc33-4cf8-b900-370443837196 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1365 microversion: 2.1 time: 0.700782 Jul 26 20:01:19.503888 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1862/3731] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:18 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1365 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:19.504566 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-353a2e3d-01fe-4bb6-98ec-46e765e6be62 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1316 microversion: 2.21 time: 0.243408 Jul 26 20:01:19.505638 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1870/3732] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:19 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:19.524511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-acdf660a-d870-43e8-a0ee-0cb1bf2fafbf req-cd91eda1-c566-4015-b678-c978901a954c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c9b8aa-c3eb-4a64-aed8-59f12802443f", "name": "network-vif-plugged", "status": "completed", "tag": "bd198809-bf20-433c-b369-1d8bfd37b9b6"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:19.535856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-acdf660a-d870-43e8-a0ee-0cb1bf2fafbf req-cd91eda1-c566-4015-b678-c978901a954c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:19.536591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-acdf660a-d870-43e8-a0ee-0cb1bf2fafbf req-cd91eda1-c566-4015-b678-c978901a954c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:19.550236 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-acdf660a-d870-43e8-a0ee-0cb1bf2fafbf req-cd91eda1-c566-4015-b678-c978901a954c service nova] Creating event network-vif-plugged:bd198809-bf20-433c-b369-1d8bfd37b9b6 for instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f on n-h2-708768-8 Jul 26 20:01:19.556141 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-acdf660a-d870-43e8-a0ee-0cb1bf2fafbf req-cd91eda1-c566-4015-b678-c978901a954c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050790 Jul 26 20:01:19.557162 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1863/3733] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:19.892489 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:01:19.895156 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 20:01:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:01:20.266711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2be41ce0-6bd9-4337-8efe-da4d5eaf4f17 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:20.267511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2be41ce0-6bd9-4337-8efe-da4d5eaf4f17 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:20.275198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2be41ce0-6bd9-4337-8efe-da4d5eaf4f17 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:20.284442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2be41ce0-6bd9-4337-8efe-da4d5eaf4f17 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:20.285530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2be41ce0-6bd9-4337-8efe-da4d5eaf4f17 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:20.288842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2be41ce0-6bd9-4337-8efe-da4d5eaf4f17 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:20.503922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f167f6c2-c8d3-4df8-b645-af9cfebda0d2 req-79632a1d-415b-4533-8838-3c5eec55bd35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d828ee1c-a310-4e15-a1ad-b98d5f41ec71", "tag": "6d7d84f5-0e31-4afb-b700-22ff10534724"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:20.592921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f167f6c2-c8d3-4df8-b645-af9cfebda0d2 req-79632a1d-415b-4533-8838-3c5eec55bd35 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:20.593835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f167f6c2-c8d3-4df8-b645-af9cfebda0d2 req-79632a1d-415b-4533-8838-3c5eec55bd35 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:20.607791 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f167f6c2-c8d3-4df8-b645-af9cfebda0d2 req-79632a1d-415b-4533-8838-3c5eec55bd35 service nova] Creating event network-changed:6d7d84f5-0e31-4afb-b700-22ff10534724 for instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 on n-h1-708768-8 Jul 26 20:01:20.615548 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f167f6c2-c8d3-4df8-b645-af9cfebda0d2 req-79632a1d-415b-4533-8838-3c5eec55bd35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125743 Jul 26 20:01:20.617394 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1864/3734] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:01:20.624124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a8a254c5-855a-42d8-8a92-da57195101a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:20.625074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a8a254c5-855a-42d8-8a92-da57195101a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:20.632504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8a254c5-855a-42d8-8a92-da57195101a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:20.633243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8a254c5-855a-42d8-8a92-da57195101a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:20.634931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8a254c5-855a-42d8-8a92-da57195101a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:20.635756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8a254c5-855a-42d8-8a92-da57195101a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:21.345982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2be41ce0-6bd9-4337-8efe-da4d5eaf4f17 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:21.371241 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2be41ce0-6bd9-4337-8efe-da4d5eaf4f17 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 1.108441 Jul 26 20:01:21.374789 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1871/3735] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:20 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:21.393190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:21.399058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:21.420159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:21.420875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:21.421804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:21.422434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:21.880917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a8a254c5-855a-42d8-8a92-da57195101a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:21.893081 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a8a254c5-855a-42d8-8a92-da57195101a8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1365 microversion: 2.1 time: 1.272802 Jul 26 20:01:21.894542 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1865/3736] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:20 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1365 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:22.398225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-caf71078-0d3f-480e-88ba-989a9f918300 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:22.399344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-caf71078-0d3f-480e-88ba-989a9f918300 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:22.422201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-caf71078-0d3f-480e-88ba-989a9f918300 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:22.423347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-caf71078-0d3f-480e-88ba-989a9f918300 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:22.425415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-caf71078-0d3f-480e-88ba-989a9f918300 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:22.426022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-caf71078-0d3f-480e-88ba-989a9f918300 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:22.665057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:22.749295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:22.763138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:22.764976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:22.768629 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ee9e2d88-874b-4b74-9a92-5a22302eb9a2 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1358 microversion: 2.21 time: 1.390784 Jul 26 20:01:22.771503 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1872/3737] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:21 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1358 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:22.878565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-caf71078-0d3f-480e-88ba-989a9f918300 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:22.909123 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-caf71078-0d3f-480e-88ba-989a9f918300 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 0.513391 Jul 26 20:01:22.914639 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1866/3738] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:22 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:22.917063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e625b1d5-0274-4f13-84af-27624c92d0aa tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:22.917859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e625b1d5-0274-4f13-84af-27624c92d0aa tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:22.930542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e625b1d5-0274-4f13-84af-27624c92d0aa tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:22.931109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e625b1d5-0274-4f13-84af-27624c92d0aa tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:22.936638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e625b1d5-0274-4f13-84af-27624c92d0aa tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:22.937240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e625b1d5-0274-4f13-84af-27624c92d0aa tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:23.619451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e625b1d5-0274-4f13-84af-27624c92d0aa tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:23.668113 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e625b1d5-0274-4f13-84af-27624c92d0aa tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1554 microversion: 2.1 time: 0.755848 Jul 26 20:01:23.695063 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1873/3739] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:22 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1554 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:23.696322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4fda52b5-62b3-4c98-9a28-0212f1d43f7e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:23.697243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4fda52b5-62b3-4c98-9a28-0212f1d43f7e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:23.708933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=14 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:23.717629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fda52b5-62b3-4c98-9a28-0212f1d43f7e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:23.718305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fda52b5-62b3-4c98-9a28-0212f1d43f7e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:23.719293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fda52b5-62b3-4c98-9a28-0212f1d43f7e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:23.720107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fda52b5-62b3-4c98-9a28-0212f1d43f7e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:23.806538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:23.809994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:23.829094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:23.840049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:23.841140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:23.841766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:24.283735 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4fda52b5-62b3-4c98-9a28-0212f1d43f7e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.593703 Jul 26 20:01:24.285499 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1867/3740] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:01:23 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-interface => generated 284 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:24.300245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9dcffd50-9b9b-4934-9c5f-acb5ca88a3af tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:24.301019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9dcffd50-9b9b-4934-9c5f-acb5ca88a3af tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:24.372917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dcffd50-9b9b-4934-9c5f-acb5ca88a3af tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:24.373369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dcffd50-9b9b-4934-9c5f-acb5ca88a3af tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:24.374165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dcffd50-9b9b-4934-9c5f-acb5ca88a3af tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:24.374606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dcffd50-9b9b-4934-9c5f-acb5ca88a3af tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:24.982651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:25.006038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:25.016948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:25.021934 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08b50ab7-fad7-474a-a8a7-f43262bdc240 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1358 microversion: 2.21 time: 1.224838 Jul 26 20:01:25.024222 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1874/3741] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:23 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1358 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:25.041398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b4fd2bf9-db7c-48b4-8e31-fc8b521fca80 req-040bd787-c6f0-41d7-b5ea-cf3565ce18cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9", "tag": "5a67838a-d071-4a9f-b103-416ed5d3fbdc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:25.081999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b4fd2bf9-db7c-48b4-8e31-fc8b521fca80 req-040bd787-c6f0-41d7-b5ea-cf3565ce18cc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:25.087028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b4fd2bf9-db7c-48b4-8e31-fc8b521fca80 req-040bd787-c6f0-41d7-b5ea-cf3565ce18cc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:25.128017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b4fd2bf9-db7c-48b4-8e31-fc8b521fca80 req-040bd787-c6f0-41d7-b5ea-cf3565ce18cc service nova] Creating event network-changed:5a67838a-d071-4a9f-b103-416ed5d3fbdc for instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 on n-h2-708768-8 Jul 26 20:01:25.139500 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b4fd2bf9-db7c-48b4-8e31-fc8b521fca80 req-040bd787-c6f0-41d7-b5ea-cf3565ce18cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113597 Jul 26 20:01:25.140378 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1875/3742] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:25.439596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9dcffd50-9b9b-4934-9c5f-acb5ca88a3af tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:25.450785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:25.459036 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9dcffd50-9b9b-4934-9c5f-acb5ca88a3af tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 1.163711 Jul 26 20:01:25.461519 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1868/3743] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:24 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:26.046831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:26.060799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:26.062389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:26.072949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:26.073410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:26.074571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:26.075022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:26.194645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=50 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:26.485169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0a85f43-4e63-46a6-a65f-bdeb68b41ae3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:26.486401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0a85f43-4e63-46a6-a65f-bdeb68b41ae3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:26.496135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:26.498513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a85f43-4e63-46a6-a65f-bdeb68b41ae3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:26.499657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a85f43-4e63-46a6-a65f-bdeb68b41ae3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:26.502051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a85f43-4e63-46a6-a65f-bdeb68b41ae3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:26.503829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a85f43-4e63-46a6-a65f-bdeb68b41ae3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:26.719371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:26.795985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:26.802277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:26.806175 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8a7ce6b8-7e5d-49d7-9a29-bc50bf2d8650 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1358 microversion: 2.21 time: 0.761059 Jul 26 20:01:26.832598 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1876/3744] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:26 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1358 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:27.215016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0a85f43-4e63-46a6-a65f-bdeb68b41ae3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:27.237952 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0a85f43-4e63-46a6-a65f-bdeb68b41ae3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 0.746219 Jul 26 20:01:27.243166 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1869/3745] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:26 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:27.837001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:27.838963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:27.887352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:27.893309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:27.895771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:27.897059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:28.263408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34389c45-201b-40a9-b9f1-233fe7f9dfb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:28.264968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34389c45-201b-40a9-b9f1-233fe7f9dfb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:28.278083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34389c45-201b-40a9-b9f1-233fe7f9dfb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:28.279396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34389c45-201b-40a9-b9f1-233fe7f9dfb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:28.284089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34389c45-201b-40a9-b9f1-233fe7f9dfb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:28.285325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34389c45-201b-40a9-b9f1-233fe7f9dfb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:28.464218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:28.476696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:28.481301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:28.485207 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1cc89bf-0c6f-48ec-9e90-2bb35daf9035 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1358 microversion: 2.21 time: 0.654643 Jul 26 20:01:28.488660 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1877/3746] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:27 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1358 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:28.987405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34389c45-201b-40a9-b9f1-233fe7f9dfb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:29.000662 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34389c45-201b-40a9-b9f1-233fe7f9dfb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 0.741111 Jul 26 20:01:29.006929 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1870/3747] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:28 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:29.186604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0d415dbd-c125-4326-80ca-0184e9d13907 req-329d7007-3716-4c3e-8d8f-938dc9e538ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c9b8aa-c3eb-4a64-aed8-59f12802443f", "tag": "bd198809-bf20-433c-b369-1d8bfd37b9b6"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:29.210974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0d415dbd-c125-4326-80ca-0184e9d13907 req-329d7007-3716-4c3e-8d8f-938dc9e538ea service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:29.211731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0d415dbd-c125-4326-80ca-0184e9d13907 req-329d7007-3716-4c3e-8d8f-938dc9e538ea service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:29.231469 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0d415dbd-c125-4326-80ca-0184e9d13907 req-329d7007-3716-4c3e-8d8f-938dc9e538ea service nova] Creating event network-changed:bd198809-bf20-433c-b369-1d8bfd37b9b6 for instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f on n-h2-708768-8 Jul 26 20:01:29.237017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0d415dbd-c125-4326-80ca-0184e9d13907 req-329d7007-3716-4c3e-8d8f-938dc9e538ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055753 Jul 26 20:01:29.238916 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1878/3748] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:29.516867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:29.521257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:29.548062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:29.549665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:29.551213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:29.551967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:30.036866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-48dd1882-8a32-4138-abc4-d4b0d46055e5 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:30.038210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-48dd1882-8a32-4138-abc4-d4b0d46055e5 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:30.074320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48dd1882-8a32-4138-abc4-d4b0d46055e5 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:30.077412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48dd1882-8a32-4138-abc4-d4b0d46055e5 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:30.078813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48dd1882-8a32-4138-abc4-d4b0d46055e5 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:30.084023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48dd1882-8a32-4138-abc4-d4b0d46055e5 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:30.161099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:30.186922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:30.194458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:30.200265 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-296bcc4b-cad0-437c-9c0a-46ac00a5a9d1 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1358 microversion: 2.21 time: 0.688921 Jul 26 20:01:30.201818 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1871/3749] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:29 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1358 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:31.249717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:31.253002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:31.277123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:31.291123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:31.292937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:31.293613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:31.745306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:31.761526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:31.763039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:31.774273 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82fb192c-b062-4f0e-8186-74b121791b12 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1358 microversion: 2.21 time: 0.541939 Jul 26 20:01:31.774899 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1872/3750] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:31 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1358 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:31.779551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-8db35244-dcdf-450e-81de-a7119f082d04 req-7ff23d54-36cc-4ac1-a1c5-73d5031a2719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d828ee1c-a310-4e15-a1ad-b98d5f41ec71", "name": "network-vif-plugged", "status": "completed", "tag": "6d7d84f5-0e31-4afb-b700-22ff10534724"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:31.808620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8db35244-dcdf-450e-81de-a7119f082d04 req-7ff23d54-36cc-4ac1-a1c5-73d5031a2719 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:31.809313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8db35244-dcdf-450e-81de-a7119f082d04 req-7ff23d54-36cc-4ac1-a1c5-73d5031a2719 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:31.824961 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-8db35244-dcdf-450e-81de-a7119f082d04 req-7ff23d54-36cc-4ac1-a1c5-73d5031a2719 service nova] Creating event network-vif-plugged:6d7d84f5-0e31-4afb-b700-22ff10534724 for instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 on n-h1-708768-8 Jul 26 20:01:31.846182 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-8db35244-dcdf-450e-81de-a7119f082d04 req-7ff23d54-36cc-4ac1-a1c5-73d5031a2719 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068902 Jul 26 20:01:31.864565 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1873/3751] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:31.939839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-48dd1882-8a32-4138-abc4-d4b0d46055e5 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:31.965095 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-48dd1882-8a32-4138-abc4-d4b0d46055e5 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 1.942963 Jul 26 20:01:31.965712 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1879/3752] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:30 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:32.804451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:32.805163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:32.828507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:32.828965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:32.829759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:32.830192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:33.243993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2158299-2dd4-4ed8-b774-626297474508 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Action: 'create', calling method: .version_select at 0x7f87681ccaf0>, body: {"keypair": {"name": "tempest-keypair-722470880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3v9IamjtjmKBvD9rUW/g41ZXV25dEd3ZOJL/s4EKybyp+8KNjyOAOHWLKeny3pWI9QU5M3co+Jl5JZkpDUmAW4vy8+2uZKqyUe7J+84F0cTPexgOc0vrNxaZu+2OOsow=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:33.281137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-b2158299-2dd4-4ed8-b774-626297474508 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Getting quotas for project 51d7777de15c469a9ac15b3a91615a0f. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:33.303788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-b2158299-2dd4-4ed8-b774-626297474508 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Getting quotas for user af334bdeafde443286eab25df33b58a0 and project 51d7777de15c469a9ac15b3a91615a0f. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:33.359687 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b2158299-2dd4-4ed8-b774-626297474508 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.507595 Jul 26 20:01:33.366649 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1880/3753] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:01:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:33.371877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2890ea3b-baa8-4b80-92cd-31604855f758 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:33.374708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2890ea3b-baa8-4b80-92cd-31604855f758 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:33.382720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2890ea3b-baa8-4b80-92cd-31604855f758 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:33.383526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2890ea3b-baa8-4b80-92cd-31604855f758 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:33.384513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2890ea3b-baa8-4b80-92cd-31604855f758 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:33.385294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2890ea3b-baa8-4b80-92cd-31604855f758 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:33.416586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:33.434027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:33.442515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:33.445718 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1358 microversion: 2.21 time: 0.645721 Jul 26 20:01:33.448659 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1874/3754] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:32 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1358 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:33.742276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:33.743328 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cbfcfda-81f3-4c35-abf7-9edd642307cc tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001479 Jul 26 20:01:33.743948 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1875/3755] 10.222.0.58 () {56 vars in 886 bytes} [Tue Jul 26 20:01:33 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 20:01:33.839884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2890ea3b-baa8-4b80-92cd-31604855f758 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:33.852386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2890ea3b-baa8-4b80-92cd-31604855f758 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1313 microversion: 2.1 time: 0.484325 Jul 26 20:01:33.868564 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1881/3756] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:33 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:33.957530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6f6b55f2-cfd2-4e2e-91e2-95d5a5a0a129 req-4999d4b0-a4d7-4353-ae06-59c38d89f68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9", "name": "network-vif-plugged", "status": "completed", "tag": "5a67838a-d071-4a9f-b103-416ed5d3fbdc"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:33.987834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6f6b55f2-cfd2-4e2e-91e2-95d5a5a0a129 req-4999d4b0-a4d7-4353-ae06-59c38d89f68a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:33.988988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6f6b55f2-cfd2-4e2e-91e2-95d5a5a0a129 req-4999d4b0-a4d7-4353-ae06-59c38d89f68a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:34.002943 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6f6b55f2-cfd2-4e2e-91e2-95d5a5a0a129 req-4999d4b0-a4d7-4353-ae06-59c38d89f68a service nova] Creating event network-vif-plugged:5a67838a-d071-4a9f-b103-416ed5d3fbdc for instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 on n-h2-708768-8 Jul 26 20:01:34.023654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6f6b55f2-cfd2-4e2e-91e2-95d5a5a0a129 req-4999d4b0-a4d7-4353-ae06-59c38d89f68a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069644 Jul 26 20:01:34.027527 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1876/3757] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:34.475745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:34.478439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:34.495283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:34.507055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:34.508647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:34.509278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:34.884684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1d4a34e-3157-4240-a43d-e2d2af15f7c7 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:34.886510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f1d4a34e-3157-4240-a43d-e2d2af15f7c7 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:34.896257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1d4a34e-3157-4240-a43d-e2d2af15f7c7 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:34.897178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1d4a34e-3157-4240-a43d-e2d2af15f7c7 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:34.898836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1d4a34e-3157-4240-a43d-e2d2af15f7c7 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:34.899430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1d4a34e-3157-4240-a43d-e2d2af15f7c7 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:35.087067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:35.105517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:35.107162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:35.111404 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7dfaaca6-6b61-4134-b24e-188573b44854 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1358 microversion: 2.21 time: 0.640556 Jul 26 20:01:35.132705 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1882/3758] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:34 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1358 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:35.550708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1301742293", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7c43ed99-78c0-4e29-b511-cd8d44018d0b"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:35.637911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f1d4a34e-3157-4240-a43d-e2d2af15f7c7 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:35.659994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f1d4a34e-3157-4240-a43d-e2d2af15f7c7 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1498 microversion: 2.1 time: 0.784518 Jul 26 20:01:35.681183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] validate_networks() for [('7c43ed99-78c0-4e29-b511-cd8d44018d0b', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:01:35.683853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1877/3759] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:34 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1498 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:36.136799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:36.137235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:36.153132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:36.153585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:36.154372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:36.160181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:36.710028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:36.729618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:36.731417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:36.732803 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-983ff800-a2ae-4b74-b982-7e5da13a060a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1551 microversion: 2.21 time: 0.602189 Jul 26 20:01:36.733858 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1878/3760] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:36 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1551 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:01:36.738584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65bbca81-53d1-4da0-9c6c-b524337f3794 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:36.744461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65bbca81-53d1-4da0-9c6c-b524337f3794 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:36.754840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65bbca81-53d1-4da0-9c6c-b524337f3794 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:36.760367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65bbca81-53d1-4da0-9c6c-b524337f3794 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:36.761476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65bbca81-53d1-4da0-9c6c-b524337f3794 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:36.762072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65bbca81-53d1-4da0-9c6c-b524337f3794 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:36.823409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65bbca81-53d1-4da0-9c6c-b524337f3794 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:01:37.056377 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65bbca81-53d1-4da0-9c6c-b524337f3794 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 204 len: 0 microversion: 2.1 time: 0.319221 Jul 26 20:01:37.059829 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1879/3761] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:01:36 2022] DELETE /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:01:37.069791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ba6a331-cfd0-4e13-9899-6f0b9f459f7e tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:37.073585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ba6a331-cfd0-4e13-9899-6f0b9f459f7e tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:37.088021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ba6a331-cfd0-4e13-9899-6f0b9f459f7e tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:37.089913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ba6a331-cfd0-4e13-9899-6f0b9f459f7e tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:37.091926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ba6a331-cfd0-4e13-9899-6f0b9f459f7e tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:37.093858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ba6a331-cfd0-4e13-9899-6f0b9f459f7e tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:37.169483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ba6a331-cfd0-4e13-9899-6f0b9f459f7e tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:01:37.330686 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ba6a331-cfd0-4e13-9899-6f0b9f459f7e tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 204 len: 0 microversion: 2.21 time: 0.268944 Jul 26 20:01:37.332793 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1880/3762] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:37 2022] DELETE /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:01:37.345666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-64c78cd6-84ca-4b9f-a2ca-3eb982b03fc6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:37.346414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-64c78cd6-84ca-4b9f-a2ca-3eb982b03fc6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:37.360565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64c78cd6-84ca-4b9f-a2ca-3eb982b03fc6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:37.361197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64c78cd6-84ca-4b9f-a2ca-3eb982b03fc6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:37.362867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64c78cd6-84ca-4b9f-a2ca-3eb982b03fc6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:37.363823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64c78cd6-84ca-4b9f-a2ca-3eb982b03fc6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:37.639374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-64c78cd6-84ca-4b9f-a2ca-3eb982b03fc6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:37.651328 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-64c78cd6-84ca-4b9f-a2ca-3eb982b03fc6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1504 microversion: 2.1 time: 0.313649 Jul 26 20:01:37.653091 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1881/3763] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:37 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:37.659432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:37.660378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:37.667648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:37.668311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:37.669084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:37.669983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:37.831647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:37.841676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:37.844600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:37.846198 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e30dc7b8-c636-429e-b74d-2ecc86f07c99 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1557 microversion: 2.21 time: 0.191989 Jul 26 20:01:37.847280 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1882/3764] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:37 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1557 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:38.090536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:01:38.091759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:01:38.105053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:01:38.106179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:01:38.109439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:01:38.140774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:38.145652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:38.147345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:38.147571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:38.187872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Getting quotas for project a715ad339a264f918507acfd8a1180f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:38.201565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Getting quotas for user f82c738a399d4688b1870ea46700ac71 and project a715ad339a264f918507acfd8a1180f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:38.230685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:01:38.233019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:01:38.323572 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bb236f15-a377-4361-af78-26b3f535a825 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.920495 Jul 26 20:01:38.332493 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1883/3765] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:01:38.343527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1c10007e-a486-4104-b326-a5172a7a8df3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:38.344381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1c10007e-a486-4104-b326-a5172a7a8df3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:38.587285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1c10007e-a486-4104-b326-a5172a7a8df3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:38.602023 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1c10007e-a486-4104-b326-a5172a7a8df3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1208 microversion: 2.1 time: 0.261732 Jul 26 20:01:38.603936 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1883/3766] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:38 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1208 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:38.674931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a852eb12-0caa-46f6-8995-2f7d3ab2bff0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:38.676180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a852eb12-0caa-46f6-8995-2f7d3ab2bff0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:38.699170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a852eb12-0caa-46f6-8995-2f7d3ab2bff0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:38.699591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a852eb12-0caa-46f6-8995-2f7d3ab2bff0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:38.701387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a852eb12-0caa-46f6-8995-2f7d3ab2bff0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:38.703686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a852eb12-0caa-46f6-8995-2f7d3ab2bff0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:38.877524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:38.879045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:38.890580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:38.891570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:38.892663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:38.893388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:39.410378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:39.437378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:39.442293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:39.447125 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6cf2ddc5-1984-434c-a8fb-20c1a0e3957a tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1557 microversion: 2.21 time: 0.578258 Jul 26 20:01:39.448046 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1884/3767] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:38 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1557 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:01:39.461271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a852eb12-0caa-46f6-8995-2f7d3ab2bff0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:39.476493 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a852eb12-0caa-46f6-8995-2f7d3ab2bff0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1504 microversion: 2.1 time: 0.804448 Jul 26 20:01:39.480332 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1884/3768] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:38 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1504 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:39.628340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c62381e9-7a88-4394-ba71-6ac9eab8cf5c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:39.628976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c62381e9-7a88-4394-ba71-6ac9eab8cf5c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:39.649789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c62381e9-7a88-4394-ba71-6ac9eab8cf5c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:39.650242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c62381e9-7a88-4394-ba71-6ac9eab8cf5c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:39.651031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c62381e9-7a88-4394-ba71-6ac9eab8cf5c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:39.651463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c62381e9-7a88-4394-ba71-6ac9eab8cf5c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:39.682065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:39.788056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c62381e9-7a88-4394-ba71-6ac9eab8cf5c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:39.802421 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c62381e9-7a88-4394-ba71-6ac9eab8cf5c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1260 microversion: 2.1 time: 0.181689 Jul 26 20:01:39.805305 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1885/3769] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:39 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:40.251907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-96e64741-5148-484c-8434-8d2f1df17017 req-ed543282-3633-439e-aec8-a6d3029b41cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9", "name": "network-vif-deleted", "tag": "5a67838a-d071-4a9f-b103-416ed5d3fbdc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:40.273505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-96e64741-5148-484c-8434-8d2f1df17017 req-ed543282-3633-439e-aec8-a6d3029b41cd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.279961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-96e64741-5148-484c-8434-8d2f1df17017 req-ed543282-3633-439e-aec8-a6d3029b41cd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.306130 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-96e64741-5148-484c-8434-8d2f1df17017 req-ed543282-3633-439e-aec8-a6d3029b41cd service nova] Creating event network-vif-deleted:5a67838a-d071-4a9f-b103-416ed5d3fbdc for instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 on n-h2-708768-8 Jul 26 20:01:40.317892 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-96e64741-5148-484c-8434-8d2f1df17017 req-ed543282-3633-439e-aec8-a6d3029b41cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070378 Jul 26 20:01:40.319008 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1885/3770] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:40.477284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:40.478049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:40.487944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.488531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.489755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.490471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.503974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:40.505282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:40.512415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.513185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.514208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.514913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.554244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.554696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.555850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lazy-loading 'fault' on Instance uuid c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:01:40.563856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.564749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.565347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lazy-loading 'fault' on Instance uuid d828ee1c-a310-4e15-a1ad-b98d5f41ec71 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:01:40.611984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:40.621835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:40.623349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64b1ab7fc09e4125aaa099cba8b299a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f045929c9c4ea19c0aacbb25ae567c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:40.624620 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-453790bc-cd0b-4ff8-9901-a0ec06218969 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 200 len: 1348 microversion: 2.21 time: 0.154126 Jul 26 20:01:40.625182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1886/3771] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:40 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 1348 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:01:40.703040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:40.725731 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e5a1fa3-94b4-4242-bc28-2d25b083de45 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 200 len: 1303 microversion: 2.1 time: 0.222556 Jul 26 20:01:40.729194 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1886/3772] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:40 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:40.832895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-260e30f6-1f66-4574-b074-0e18e1e2856b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:40.833520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-260e30f6-1f66-4574-b074-0e18e1e2856b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:40.847106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-260e30f6-1f66-4574-b074-0e18e1e2856b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.847563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-260e30f6-1f66-4574-b074-0e18e1e2856b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.848368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-260e30f6-1f66-4574-b074-0e18e1e2856b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:40.855542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-260e30f6-1f66-4574-b074-0e18e1e2856b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:40.909456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-362115611", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "344c96ce-81cd-4016-9200-5d0d04dfb0b2"}], "security_groups": [{"name": "tempest-securitygroup--1439697339"}], "key_name": "tempest-keypair-722470880", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:41.012270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-260e30f6-1f66-4574-b074-0e18e1e2856b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:41.022371 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-260e30f6-1f66-4574-b074-0e18e1e2856b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1266 microversion: 2.1 time: 0.193183 Jul 26 20:01:41.032804 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1887/3773] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:40 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:41.205758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] validate_networks() for [('344c96ce-81cd-4016-9200-5d0d04dfb0b2', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:01:41.647533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:41.648842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:41.658969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:41.664277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:41.665364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:41.671929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:41.700469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] HTTP exception thrown: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Request method failure captured: Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 HTTP/1.1 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgIgH5Uii4TBK7DkiCCTjpyAxJDxAN_eMGvORmifJzZ3YGWpZ_-NFa1VLVD6Cxp3x9JizL3-78UTnucTl0NYiTqCJbeIlg2ICGFLb35gwXHnK33eb1ytVXr_TgTn-CrmHykuei0n3MEaVRXjbIYDMxc3YUt-axGJjVhvPiDe9ZmvYA Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 77f045929c9c4ea19c0aacbb25ae567c Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77f045929c9c4ea19c0aacbb25ae567c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77f045929c9c4ea19c0aacbb25ae567c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77f045929c9c4ea19c0aacbb25ae567c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77f045929c9c4ea19c0aacbb25ae567c"}]}] Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 77f045929c9c4ea19c0aacbb25ae567c Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-InstanceActionsV221TestJSON-298502414-project Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 64b1ab7fc09e4125aaa099cba8b299a1 Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-InstanceActionsV221TestJSON-298502414-project Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9'} Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.705913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Returning 404 to user: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce6834cb-2ca7-4dc3-9040-21f7c9e1a408 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 404 len: 111 microversion: 2.21 time: 0.064029 Jul 26 20:01:41.709742 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1888/3774] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:41 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:01:41.716578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8de46ad8-822d-44a6-b5c3-b8e13e7a075c tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '.version_select at 0x7f8756604160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:41.719018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8de46ad8-822d-44a6-b5c3-b8e13e7a075c tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:41.727359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8de46ad8-822d-44a6-b5c3-b8e13e7a075c tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:41.727851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8de46ad8-822d-44a6-b5c3-b8e13e7a075c tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:41.728640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8de46ad8-822d-44a6-b5c3-b8e13e7a075c tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:41.729083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8de46ad8-822d-44a6-b5c3-b8e13e7a075c tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:41.822054 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8de46ad8-822d-44a6-b5c3-b8e13e7a075c tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.109236 Jul 26 20:01:41.823382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1889/3775] 10.222.0.58 () {60 vars in 1337 bytes} [Tue Jul 26 20:01:41 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9/os-instance-actions => generated 611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:01:41.847843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:41.848725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: d828ee1c-a310-4e15-a1ad-b98d5f41ec71] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:41.862420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:41.863265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:41.864179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:41.864633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:41.902942 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] HTTP exception thrown: Instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 could not be found. Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Request method failure captured: Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 HTTP/1.1 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgCG8e8GjUlPQF8oCh-xlkNfDeuxIqtNnxrtjN61WE9vmT5vtTandFd0HmTmKmycmRmP52PdTS0Xi5RD0LLjolW_oCcngD_ijKGR0JuQUXK7E5XxuiomafKk5vaPrOGsPLqzqmz3qh2TdpEg1zwkKqrAR22ki-ehfUsCCCWKdMIcqs Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 33d19bedc79942d08bb1c0c5006f8764 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-VolumesActionsTest-864393083 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33d19bedc79942d08bb1c0c5006f8764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33d19bedc79942d08bb1c0c5006f8764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33d19bedc79942d08bb1c0c5006f8764", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33d19bedc79942d08bb1c0c5006f8764"}]}] Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-VolumesActionsTest-864393083 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 33d19bedc79942d08bb1c0c5006f8764 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-VolumesActionsTest-864393083 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-VolumesActionsTest-864393083-project Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9b389e99c8f34d16889b21af192dcf99 Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-VolumesActionsTest-864393083-project Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 could not be found. Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd828ee1c-a310-4e15-a1ad-b98d5f41ec71'} Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 could not be found. Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 could not be found. Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:01:41.904614 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 could not be found. Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Returning 404 to user: Instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:01:41.908751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-929f0c91-211d-41df-9763-71fa8ed3a8ab tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71" status: 404 len: 111 microversion: 2.1 time: 0.081529 Jul 26 20:01:41.924020 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1890/3776] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:41 2022] GET /compute/v2.1/servers/d828ee1c-a310-4e15-a1ad-b98d5f41ec71 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:01:41.924020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:41.924020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:41.946467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:41.954229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:41.955538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:41.956834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:41.987402 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] HTTP exception thrown: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Request method failure captured: Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 HTTP/1.1 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgIgH5Uii4TBK7DkiCCTjpyAxJDxAN_eMGvORmifJzZ3YGWpZ_-NFa1VLVD6Cxp3x9JizL3-78UTnucTl0NYiTqCJbeIlg2ICGFLb35gwXHnK33eb1ytVXr_TgTn-CrmHykuei0n3MEaVRXjbIYDMxc3YUt-axGJjVhvPiDe9ZmvYA Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 77f045929c9c4ea19c0aacbb25ae567c Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77f045929c9c4ea19c0aacbb25ae567c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77f045929c9c4ea19c0aacbb25ae567c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77f045929c9c4ea19c0aacbb25ae567c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77f045929c9c4ea19c0aacbb25ae567c"}]}] Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 77f045929c9c4ea19c0aacbb25ae567c Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-InstanceActionsV221TestJSON-298502414-project Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 64b1ab7fc09e4125aaa099cba8b299a1 Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-InstanceActionsV221TestJSON-298502414-project Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9'} Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:01:41.991733 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:41.996100 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:42.006434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Returning 404 to user: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:01:42.007901 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0dd8643b-b84e-4ca7-8722-4a88a61dc9d4 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 404 len: 111 microversion: 2.21 time: 0.096729 Jul 26 20:01:42.019330 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1891/3777] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:01:41 2022] DELETE /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:01:42.031308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:42.034454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] [instance: c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:42.052719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:42.053709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:42.054720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:42.054720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:42.078967 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] HTTP exception thrown: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Request method failure captured: Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 HTTP/1.1 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgIgH5Uii4TBK7DkiCCTjpyAxJDxAN_eMGvORmifJzZ3YGWpZ_-NFa1VLVD6Cxp3x9JizL3-78UTnucTl0NYiTqCJbeIlg2ICGFLb35gwXHnK33eb1ytVXr_TgTn-CrmHykuei0n3MEaVRXjbIYDMxc3YUt-axGJjVhvPiDe9ZmvYA Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 77f045929c9c4ea19c0aacbb25ae567c Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/77f045929c9c4ea19c0aacbb25ae567c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77f045929c9c4ea19c0aacbb25ae567c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_77f045929c9c4ea19c0aacbb25ae567c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/77f045929c9c4ea19c0aacbb25ae567c"}]}] Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 77f045929c9c4ea19c0aacbb25ae567c Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-298502414 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-InstanceActionsV221TestJSON-298502414-project Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 64b1ab7fc09e4125aaa099cba8b299a1 Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-InstanceActionsV221TestJSON-298502414-project Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9'} Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:42.080703 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] Returning 404 to user: Instance c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:01:42.086639 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-95155a8c-bd58-4d41-9176-ff525beb64a8 tempest-InstanceActionsV221TestJSON-298502414 tempest-InstanceActionsV221TestJSON-298502414-project] 10.222.0.58 "GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9" status: 404 len: 111 microversion: 2.21 time: 0.065331 Jul 26 20:01:42.092382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1892/3778] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:01:42 2022] GET /compute/v2.1/servers/c6be1e1a-e80c-4e90-9e47-4d26a7f7fec9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:01:42.098286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b3a19cd-bba5-443c-83a2-1419dcab5f11 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:42.098985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0b3a19cd-bba5-443c-83a2-1419dcab5f11 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:42.106502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b3a19cd-bba5-443c-83a2-1419dcab5f11 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:42.106960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b3a19cd-bba5-443c-83a2-1419dcab5f11 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:42.107795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b3a19cd-bba5-443c-83a2-1419dcab5f11 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:42.108243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b3a19cd-bba5-443c-83a2-1419dcab5f11 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:42.547296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0b3a19cd-bba5-443c-83a2-1419dcab5f11 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:42.555233 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0b3a19cd-bba5-443c-83a2-1419dcab5f11 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1308 microversion: 2.1 time: 0.461461 Jul 26 20:01:42.555853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1893/3779] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:42 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:42.573346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1363024313", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "3cdc6733-4307-4559-ac37-6ca56c9c6ea9"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:42.613486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Getting quotas for project 51d7777de15c469a9ac15b3a91615a0f. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:42.623590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Getting quotas for user af334bdeafde443286eab25df33b58a0 and project 51d7777de15c469a9ac15b3a91615a0f. Resources: dict_keys(['metadata_items']) {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:42.660046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:01:42.664106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:01:42.664796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:01:42.665537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:01:42.666378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] validate_networks() for [('3cdc6733-4307-4559-ac37-6ca56c9c6ea9', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:01:42.667586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:01:42.680014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:42.680852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:42.681812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:42.682388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:42.702126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Getting quotas for project 51d7777de15c469a9ac15b3a91615a0f. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:42.711783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Getting quotas for user af334bdeafde443286eab25df33b58a0 and project 51d7777de15c469a9ac15b3a91615a0f. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:42.746369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:01:42.749041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:01:42.820451 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-30ed6476-9bf2-4539-a908-7e1a3da61159 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.916637 Jul 26 20:01:42.827739 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1887/3780] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:01:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:01:42.835919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-cd27334a-3edd-4ebc-98ca-5f32205405ae req-63a4cd8d-13c2-4bf8-8a20-687f9aa244ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d828ee1c-a310-4e15-a1ad-b98d5f41ec71", "name": "network-vif-deleted", "tag": "6d7d84f5-0e31-4afb-b700-22ff10534724"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:42.855860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:42.869197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cd27334a-3edd-4ebc-98ca-5f32205405ae req-63a4cd8d-13c2-4bf8-8a20-687f9aa244ce service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:42.869870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cd27334a-3edd-4ebc-98ca-5f32205405ae req-63a4cd8d-13c2-4bf8-8a20-687f9aa244ce service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:42.903679 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-cd27334a-3edd-4ebc-98ca-5f32205405ae req-63a4cd8d-13c2-4bf8-8a20-687f9aa244ce service nova] Creating event network-vif-deleted:6d7d84f5-0e31-4afb-b700-22ff10534724 for instance d828ee1c-a310-4e15-a1ad-b98d5f41ec71 on n-h1-708768-8 Jul 26 20:01:42.916494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-cd27334a-3edd-4ebc-98ca-5f32205405ae req-63a4cd8d-13c2-4bf8-8a20-687f9aa244ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084698 Jul 26 20:01:42.918138 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1888/3781] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:42.931437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f29ea409-65cf-4c20-9fe4-41897aebc4d9 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:42.933432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f29ea409-65cf-4c20-9fe4-41897aebc4d9 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:43.106103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f29ea409-65cf-4c20-9fe4-41897aebc4d9 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:43.115921 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f29ea409-65cf-4c20-9fe4-41897aebc4d9 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1268 microversion: 2.1 time: 0.191044 Jul 26 20:01:43.127176 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1889/3782] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:42 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:43.581080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-854e98c0-27bc-4061-9e79-f8a3bb019ef9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:43.582060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-854e98c0-27bc-4061-9e79-f8a3bb019ef9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:43.601969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854e98c0-27bc-4061-9e79-f8a3bb019ef9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:43.609554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854e98c0-27bc-4061-9e79-f8a3bb019ef9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:43.611041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854e98c0-27bc-4061-9e79-f8a3bb019ef9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:43.611755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854e98c0-27bc-4061-9e79-f8a3bb019ef9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:43.647953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:43.900132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:01:43.901483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:01:43.903234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:01:43.905602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:01:43.906242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:01:43.926562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:43.927249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:43.930512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:43.931351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:43.966931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Getting quotas for project 33d19bedc79942d08bb1c0c5006f8764. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:01:43.981931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Getting quotas for user 9b389e99c8f34d16889b21af192dcf99 and project 33d19bedc79942d08bb1c0c5006f8764. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:01:44.013444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:01:44.016166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:01:44.053900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-854e98c0-27bc-4061-9e79-f8a3bb019ef9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:44.067306 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-854e98c0-27bc-4061-9e79-f8a3bb019ef9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1308 microversion: 2.1 time: 0.492210 Jul 26 20:01:44.087053 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1890/3783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:43 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1308 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:44.145863 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-668605a2-13f0-48a0-b7e8-48ffa183352b tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588901 Jul 26 20:01:44.147567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-19d21efa-c4ef-4992-a828-a2d972e857db tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:44.149781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-19d21efa-c4ef-4992-a828-a2d972e857db tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:44.150285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1894/3784] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:01:44.159251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19d21efa-c4ef-4992-a828-a2d972e857db tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:44.160004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19d21efa-c4ef-4992-a828-a2d972e857db tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:44.161211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aa6c0ed9-cb3b-49dc-90c8-0ca88e69586f tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:44.161512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19d21efa-c4ef-4992-a828-a2d972e857db tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:44.162816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19d21efa-c4ef-4992-a828-a2d972e857db tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:44.165934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aa6c0ed9-cb3b-49dc-90c8-0ca88e69586f tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:44.327997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-19d21efa-c4ef-4992-a828-a2d972e857db tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:44.336290 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-19d21efa-c4ef-4992-a828-a2d972e857db tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1264 microversion: 2.1 time: 0.198646 Jul 26 20:01:44.336892 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1891/3785] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:44 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:44.450376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-aa6c0ed9-cb3b-49dc-90c8-0ca88e69586f tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:44.463012 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aa6c0ed9-cb3b-49dc-90c8-0ca88e69586f tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1214 microversion: 2.1 time: 0.306657 Jul 26 20:01:44.463625 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1895/3786] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:44 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:44.543674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-8d6936a3-f858-4fcc-b082-b03da18104f7 req-2e2c9034-459d-4afa-a6b8-e9f2b12c3ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a", "tag": "e208acc1-d66c-4acc-81b0-0771a8806062"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:44.572445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8d6936a3-f858-4fcc-b082-b03da18104f7 req-2e2c9034-459d-4afa-a6b8-e9f2b12c3ab3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:44.573993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8d6936a3-f858-4fcc-b082-b03da18104f7 req-2e2c9034-459d-4afa-a6b8-e9f2b12c3ab3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:44.600448 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-8d6936a3-f858-4fcc-b082-b03da18104f7 req-2e2c9034-459d-4afa-a6b8-e9f2b12c3ab3 service nova] Creating event network-changed:e208acc1-d66c-4acc-81b0-0771a8806062 for instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a on n-h1-708768-8 Jul 26 20:01:44.606258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-8d6936a3-f858-4fcc-b082-b03da18104f7 req-2e2c9034-459d-4afa-a6b8-e9f2b12c3ab3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070458 Jul 26 20:01:44.607979 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1892/3787] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:45.088581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b0036b80-2ea7-40af-989d-d5724498aac4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:45.089764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b0036b80-2ea7-40af-989d-d5724498aac4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:45.112481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0036b80-2ea7-40af-989d-d5724498aac4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:45.116548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0036b80-2ea7-40af-989d-d5724498aac4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:45.118285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0036b80-2ea7-40af-989d-d5724498aac4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:45.120005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0036b80-2ea7-40af-989d-d5724498aac4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:45.372996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af8d9c6a-b2cd-4721-a803-f47e39c979df tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:45.373724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af8d9c6a-b2cd-4721-a803-f47e39c979df tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:45.394049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af8d9c6a-b2cd-4721-a803-f47e39c979df tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:45.400236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af8d9c6a-b2cd-4721-a803-f47e39c979df tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:45.401267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af8d9c6a-b2cd-4721-a803-f47e39c979df tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:45.401722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af8d9c6a-b2cd-4721-a803-f47e39c979df tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:45.635229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0036b80-2ea7-40af-989d-d5724498aac4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:45.647089 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b0036b80-2ea7-40af-989d-d5724498aac4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1308 microversion: 2.1 time: 0.561929 Jul 26 20:01:45.653267 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1896/3788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:45 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1308 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:45.661074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-765a7686-77b0-4634-960e-b252a87b4af0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:45.661819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-765a7686-77b0-4634-960e-b252a87b4af0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:45.668619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-765a7686-77b0-4634-960e-b252a87b4af0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:45.669157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-765a7686-77b0-4634-960e-b252a87b4af0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:45.670035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-765a7686-77b0-4634-960e-b252a87b4af0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:45.670542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-765a7686-77b0-4634-960e-b252a87b4af0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:45.773551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-af8d9c6a-b2cd-4721-a803-f47e39c979df tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:45.777026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-765a7686-77b0-4634-960e-b252a87b4af0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:45.789138 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af8d9c6a-b2cd-4721-a803-f47e39c979df tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1326 microversion: 2.1 time: 0.430030 Jul 26 20:01:45.791741 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-765a7686-77b0-4634-960e-b252a87b4af0 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1266 microversion: 2.1 time: 0.137058 Jul 26 20:01:45.792533 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1893/3789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:45 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1326 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:45.793251 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1897/3790] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:45 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:46.675808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-05e5bbfa-0866-4630-976d-bab8d47b504f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:46.677130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-05e5bbfa-0866-4630-976d-bab8d47b504f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:46.686039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05e5bbfa-0866-4630-976d-bab8d47b504f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:46.686808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05e5bbfa-0866-4630-976d-bab8d47b504f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:46.688140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05e5bbfa-0866-4630-976d-bab8d47b504f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:46.688586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05e5bbfa-0866-4630-976d-bab8d47b504f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:46.816789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0507461c-5375-4f7e-8c60-feee7349cacd tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:46.818150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0507461c-5375-4f7e-8c60-feee7349cacd tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:46.829870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0507461c-5375-4f7e-8c60-feee7349cacd tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:46.831366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0507461c-5375-4f7e-8c60-feee7349cacd tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:46.832861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0507461c-5375-4f7e-8c60-feee7349cacd tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:46.833942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0507461c-5375-4f7e-8c60-feee7349cacd tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:47.356297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-05e5bbfa-0866-4630-976d-bab8d47b504f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:47.368769 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-05e5bbfa-0866-4630-976d-bab8d47b504f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1308 microversion: 2.1 time: 0.698176 Jul 26 20:01:47.369381 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1894/3791] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:46 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1308 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:47.380773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f3de7c1-680d-45b5-97b2-9b8b15462bb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:47.382398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5f3de7c1-680d-45b5-97b2-9b8b15462bb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:47.401190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f3de7c1-680d-45b5-97b2-9b8b15462bb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:47.401995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f3de7c1-680d-45b5-97b2-9b8b15462bb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:47.403151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f3de7c1-680d-45b5-97b2-9b8b15462bb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:47.403524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f3de7c1-680d-45b5-97b2-9b8b15462bb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:47.463237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0507461c-5375-4f7e-8c60-feee7349cacd tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:47.470942 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0507461c-5375-4f7e-8c60-feee7349cacd tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1394 microversion: 2.1 time: 0.660319 Jul 26 20:01:47.471515 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1898/3792] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:46 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1394 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:47.566558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5f3de7c1-680d-45b5-97b2-9b8b15462bb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:47.577005 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f3de7c1-680d-45b5-97b2-9b8b15462bb1 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1272 microversion: 2.1 time: 0.206584 Jul 26 20:01:47.580334 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1895/3793] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:47 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:48.395165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-62eeac95-1da2-44af-9ce7-56755f23294a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:48.396155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-62eeac95-1da2-44af-9ce7-56755f23294a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:48.434200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62eeac95-1da2-44af-9ce7-56755f23294a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:48.434650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62eeac95-1da2-44af-9ce7-56755f23294a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:48.435448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62eeac95-1da2-44af-9ce7-56755f23294a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:48.435914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62eeac95-1da2-44af-9ce7-56755f23294a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:48.494810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8bba4cf-5eac-4c40-bd93-ae03d6ff5eb0 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:48.495431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8bba4cf-5eac-4c40-bd93-ae03d6ff5eb0 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:48.513809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8bba4cf-5eac-4c40-bd93-ae03d6ff5eb0 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:48.514259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8bba4cf-5eac-4c40-bd93-ae03d6ff5eb0 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:48.515041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8bba4cf-5eac-4c40-bd93-ae03d6ff5eb0 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:48.515477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8bba4cf-5eac-4c40-bd93-ae03d6ff5eb0 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:49.040768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62eeac95-1da2-44af-9ce7-56755f23294a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:49.053641 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-62eeac95-1da2-44af-9ce7-56755f23294a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1308 microversion: 2.1 time: 0.662774 Jul 26 20:01:49.072022 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1899/3794] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:48 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1308 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:49.089590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77f6a281-8817-4450-bf5b-597eeffa1ec8 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:49.090870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77f6a281-8817-4450-bf5b-597eeffa1ec8 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:49.113102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77f6a281-8817-4450-bf5b-597eeffa1ec8 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:49.116217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77f6a281-8817-4450-bf5b-597eeffa1ec8 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:49.119236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77f6a281-8817-4450-bf5b-597eeffa1ec8 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:49.120303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77f6a281-8817-4450-bf5b-597eeffa1ec8 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:49.126952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8bba4cf-5eac-4c40-bd93-ae03d6ff5eb0 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:49.138982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8bba4cf-5eac-4c40-bd93-ae03d6ff5eb0 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1394 microversion: 2.1 time: 0.649025 Jul 26 20:01:49.152877 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1896/3795] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:48 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1394 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:49.474164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ed0be879-2925-4856-974c-4ec706542424 req-c40917fa-4327-48ab-aff8-5fd5520459bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27aa1dd-25d2-408d-a41b-d6fe723c880b", "tag": "619b7ef1-59e5-47a5-8358-e425c54aed21"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:49.495892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ed0be879-2925-4856-974c-4ec706542424 req-c40917fa-4327-48ab-aff8-5fd5520459bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:49.497677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ed0be879-2925-4856-974c-4ec706542424 req-c40917fa-4327-48ab-aff8-5fd5520459bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:49.541231 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ed0be879-2925-4856-974c-4ec706542424 req-c40917fa-4327-48ab-aff8-5fd5520459bb service nova] Creating event network-changed:619b7ef1-59e5-47a5-8358-e425c54aed21 for instance c27aa1dd-25d2-408d-a41b-d6fe723c880b on n-h2-708768-8 Jul 26 20:01:49.557405 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ed0be879-2925-4856-974c-4ec706542424 req-c40917fa-4327-48ab-aff8-5fd5520459bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093699 Jul 26 20:01:49.561881 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1897/3796] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:50.077445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03fab8c0-ed7f-48fa-a915-5ab02d5b0a77 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:50.078430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03fab8c0-ed7f-48fa-a915-5ab02d5b0a77 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:50.088113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03fab8c0-ed7f-48fa-a915-5ab02d5b0a77 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:50.088821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03fab8c0-ed7f-48fa-a915-5ab02d5b0a77 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:50.089812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03fab8c0-ed7f-48fa-a915-5ab02d5b0a77 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:50.091043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03fab8c0-ed7f-48fa-a915-5ab02d5b0a77 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:50.193906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77f6a281-8817-4450-bf5b-597eeffa1ec8 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:50.206119 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77f6a281-8817-4450-bf5b-597eeffa1ec8 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1314 microversion: 2.1 time: 1.132713 Jul 26 20:01:50.206930 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1900/3797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:49 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1314 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:50.230093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af9fdb66-3bf4-4821-9c8a-b8df7ec246c3 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:50.233625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-af9fdb66-3bf4-4821-9c8a-b8df7ec246c3 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:50.254089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af9fdb66-3bf4-4821-9c8a-b8df7ec246c3 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:50.258098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af9fdb66-3bf4-4821-9c8a-b8df7ec246c3 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:50.268817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af9fdb66-3bf4-4821-9c8a-b8df7ec246c3 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:50.275862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af9fdb66-3bf4-4821-9c8a-b8df7ec246c3 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:50.595338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af9fdb66-3bf4-4821-9c8a-b8df7ec246c3 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:50.638060 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-af9fdb66-3bf4-4821-9c8a-b8df7ec246c3 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1394 microversion: 2.1 time: 0.404834 Jul 26 20:01:50.639404 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1901/3798] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:50 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1394 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:50.648362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d9f732c2-466a-4055-8cae-4b07f28c5a6f req-b33ce935-e687-4f4c-97bb-530281dfd540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a", "name": "network-vif-plugged", "status": "completed", "tag": "e208acc1-d66c-4acc-81b0-0771a8806062"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:50.660272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d9f732c2-466a-4055-8cae-4b07f28c5a6f req-b33ce935-e687-4f4c-97bb-530281dfd540 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:50.660721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d9f732c2-466a-4055-8cae-4b07f28c5a6f req-b33ce935-e687-4f4c-97bb-530281dfd540 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:50.674332 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d9f732c2-466a-4055-8cae-4b07f28c5a6f req-b33ce935-e687-4f4c-97bb-530281dfd540 service nova] Creating event network-vif-plugged:e208acc1-d66c-4acc-81b0-0771a8806062 for instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a on n-h1-708768-8 Jul 26 20:01:50.680869 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d9f732c2-466a-4055-8cae-4b07f28c5a6f req-b33ce935-e687-4f4c-97bb-530281dfd540 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039799 Jul 26 20:01:50.681121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03fab8c0-ed7f-48fa-a915-5ab02d5b0a77 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:50.682255 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1902/3799] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:50.710664 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03fab8c0-ed7f-48fa-a915-5ab02d5b0a77 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1308 microversion: 2.1 time: 0.639470 Jul 26 20:01:50.713844 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1898/3800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:50 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:51.234013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2d3a7b64-5abc-4d13-a8e8-c69031c2ea32 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:51.235225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2d3a7b64-5abc-4d13-a8e8-c69031c2ea32 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:51.242502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d3a7b64-5abc-4d13-a8e8-c69031c2ea32 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:51.242959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d3a7b64-5abc-4d13-a8e8-c69031c2ea32 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:51.243947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d3a7b64-5abc-4d13-a8e8-c69031c2ea32 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:51.244395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d3a7b64-5abc-4d13-a8e8-c69031c2ea32 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:51.560993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2d3a7b64-5abc-4d13-a8e8-c69031c2ea32 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:51.571080 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2d3a7b64-5abc-4d13-a8e8-c69031c2ea32 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1314 microversion: 2.1 time: 0.342692 Jul 26 20:01:51.573359 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1903/3801] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:51 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:51.661282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5e5cf2e-a5f9-4cc7-9d91-0b2c9c70efee tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:51.663227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5e5cf2e-a5f9-4cc7-9d91-0b2c9c70efee tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:51.674727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5e5cf2e-a5f9-4cc7-9d91-0b2c9c70efee tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:51.676561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5e5cf2e-a5f9-4cc7-9d91-0b2c9c70efee tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:51.678737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5e5cf2e-a5f9-4cc7-9d91-0b2c9c70efee tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:51.680025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5e5cf2e-a5f9-4cc7-9d91-0b2c9c70efee tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:51.732737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-995c5404-ce9d-48db-829c-f91cc552db32 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:51.733706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-995c5404-ce9d-48db-829c-f91cc552db32 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:51.737432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:51.758616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-995c5404-ce9d-48db-829c-f91cc552db32 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:51.759292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-995c5404-ce9d-48db-829c-f91cc552db32 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:51.760277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-995c5404-ce9d-48db-829c-f91cc552db32 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:51.760871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-995c5404-ce9d-48db-829c-f91cc552db32 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:52.146860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-995c5404-ce9d-48db-829c-f91cc552db32 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:52.169329 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-995c5404-ce9d-48db-829c-f91cc552db32 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1308 microversion: 2.1 time: 0.440138 Jul 26 20:01:52.171477 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1904/3802] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:51 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:52.191491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-336f1ebe-7540-468e-9a23-41e5c8d7d80f req-1f2f7b79-9d13-4025-928b-e7f337ba8366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a04d6d-5ca6-447b-832b-3f980a65e1b5", "tag": "ee85e7f4-5d6f-45fa-bcdc-7a422a508ef3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:52.202613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-336f1ebe-7540-468e-9a23-41e5c8d7d80f req-1f2f7b79-9d13-4025-928b-e7f337ba8366 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:52.203321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-336f1ebe-7540-468e-9a23-41e5c8d7d80f req-1f2f7b79-9d13-4025-928b-e7f337ba8366 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:52.228557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-336f1ebe-7540-468e-9a23-41e5c8d7d80f req-1f2f7b79-9d13-4025-928b-e7f337ba8366 service nova] Creating event network-changed:ee85e7f4-5d6f-45fa-bcdc-7a422a508ef3 for instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 on n-h2-708768-8 Jul 26 20:01:52.241593 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-336f1ebe-7540-468e-9a23-41e5c8d7d80f req-1f2f7b79-9d13-4025-928b-e7f337ba8366 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066856 Jul 26 20:01:52.242403 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1905/3803] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:52.525938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f5e5cf2e-a5f9-4cc7-9d91-0b2c9c70efee tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:52.535082 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5e5cf2e-a5f9-4cc7-9d91-0b2c9c70efee tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1394 microversion: 2.1 time: 0.877902 Jul 26 20:01:52.536248 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1899/3804] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:51 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1394 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:52.597666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4fa8e867-fe76-4cf6-9018-74f856b333b6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:52.600115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4fa8e867-fe76-4cf6-9018-74f856b333b6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:52.608154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fa8e867-fe76-4cf6-9018-74f856b333b6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:52.609460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fa8e867-fe76-4cf6-9018-74f856b333b6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:52.627221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fa8e867-fe76-4cf6-9018-74f856b333b6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:52.628405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fa8e867-fe76-4cf6-9018-74f856b333b6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:52.838380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4fa8e867-fe76-4cf6-9018-74f856b333b6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:52.856259 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4fa8e867-fe76-4cf6-9018-74f856b333b6 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1314 microversion: 2.1 time: 0.264086 Jul 26 20:01:52.857179 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1906/3805] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:52 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:53.192629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a92a7aa5-349b-4df5-a7fa-49ffd5fcc85f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:53.195580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a92a7aa5-349b-4df5-a7fa-49ffd5fcc85f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:53.206565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:53.209373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=22 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:53.214822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a92a7aa5-349b-4df5-a7fa-49ffd5fcc85f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:53.215642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a92a7aa5-349b-4df5-a7fa-49ffd5fcc85f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:53.220651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a92a7aa5-349b-4df5-a7fa-49ffd5fcc85f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:53.221579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a92a7aa5-349b-4df5-a7fa-49ffd5fcc85f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:53.559416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7737a65-1901-40b3-9ec4-615f99c3ff78 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:53.559830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7737a65-1901-40b3-9ec4-615f99c3ff78 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:53.570308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7737a65-1901-40b3-9ec4-615f99c3ff78 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:53.570766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7737a65-1901-40b3-9ec4-615f99c3ff78 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:53.573787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7737a65-1901-40b3-9ec4-615f99c3ff78 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:53.574426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7737a65-1901-40b3-9ec4-615f99c3ff78 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:53.582483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a92a7aa5-349b-4df5-a7fa-49ffd5fcc85f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:53.594471 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a92a7aa5-349b-4df5-a7fa-49ffd5fcc85f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1488 microversion: 2.1 time: 0.404459 Jul 26 20:01:53.596217 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1900/3806] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:53 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1488 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:53.620914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-600fb62c-f3a5-46cb-90b9-dc1fd578cde8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:53.621463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-600fb62c-f3a5-46cb-90b9-dc1fd578cde8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:53.639923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-600fb62c-f3a5-46cb-90b9-dc1fd578cde8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:53.640394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:53.640540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-600fb62c-f3a5-46cb-90b9-dc1fd578cde8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:53.642794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-600fb62c-f3a5-46cb-90b9-dc1fd578cde8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:53.643247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-600fb62c-f3a5-46cb-90b9-dc1fd578cde8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:53.767645 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-600fb62c-f3a5-46cb-90b9-dc1fd578cde8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a/action" status: 202 len: 0 microversion: 2.1 time: 0.147766 Jul 26 20:01:53.772926 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1901/3807] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:01:53 2022] POST /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:01:53.786119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80e033db-8ef1-477f-afe3-0e3cd0c6405a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:53.790629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80e033db-8ef1-477f-afe3-0e3cd0c6405a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:53.803266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e033db-8ef1-477f-afe3-0e3cd0c6405a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:53.804045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e033db-8ef1-477f-afe3-0e3cd0c6405a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:53.805324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e033db-8ef1-477f-afe3-0e3cd0c6405a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:53.806093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e033db-8ef1-477f-afe3-0e3cd0c6405a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:53.948110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:53.992823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7737a65-1901-40b3-9ec4-615f99c3ff78 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:54.008310 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7737a65-1901-40b3-9ec4-615f99c3ff78 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1394 microversion: 2.1 time: 0.453739 Jul 26 20:01:54.010454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1907/3808] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:53 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1394 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:54.022687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c74378f2-781d-499b-a1c5-c48306562d12 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:54.024954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c74378f2-781d-499b-a1c5-c48306562d12 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:54.041970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c74378f2-781d-499b-a1c5-c48306562d12 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:54.044530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c74378f2-781d-499b-a1c5-c48306562d12 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:54.045583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c74378f2-781d-499b-a1c5-c48306562d12 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:54.048299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c74378f2-781d-499b-a1c5-c48306562d12 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:54.234400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-80e033db-8ef1-477f-afe3-0e3cd0c6405a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:54.244864 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80e033db-8ef1-477f-afe3-0e3cd0c6405a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1493 microversion: 2.1 time: 0.468209 Jul 26 20:01:54.245461 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1902/3809] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:53 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1493 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:54.423507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c74378f2-781d-499b-a1c5-c48306562d12 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:54.432269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c74378f2-781d-499b-a1c5-c48306562d12 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1314 microversion: 2.1 time: 0.419818 Jul 26 20:01:54.447320 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1908/3810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:54 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:55.025825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-93a55620-640b-4eaf-89f0-d73f8ce12ff5 req-7919ad76-daec-4efe-9308-6fae5847c8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27aa1dd-25d2-408d-a41b-d6fe723c880b", "name": "network-vif-plugged", "status": "completed", "tag": "619b7ef1-59e5-47a5-8358-e425c54aed21"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:55.031526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-90f167cf-9ece-4b23-88d0-6a5c6311bb33 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:55.033478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-90f167cf-9ece-4b23-88d0-6a5c6311bb33 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:55.045717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-93a55620-640b-4eaf-89f0-d73f8ce12ff5 req-7919ad76-daec-4efe-9308-6fae5847c8a3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.046173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-93a55620-640b-4eaf-89f0-d73f8ce12ff5 req-7919ad76-daec-4efe-9308-6fae5847c8a3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:55.046684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:55.058015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f167cf-9ece-4b23-88d0-6a5c6311bb33 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.072173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f167cf-9ece-4b23-88d0-6a5c6311bb33 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:55.077596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f167cf-9ece-4b23-88d0-6a5c6311bb33 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.079784 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-93a55620-640b-4eaf-89f0-d73f8ce12ff5 req-7919ad76-daec-4efe-9308-6fae5847c8a3 service nova] Creating event network-vif-plugged:619b7ef1-59e5-47a5-8358-e425c54aed21 for instance c27aa1dd-25d2-408d-a41b-d6fe723c880b on n-h2-708768-8 Jul 26 20:01:55.082813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90f167cf-9ece-4b23-88d0-6a5c6311bb33 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:55.097430 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-93a55620-640b-4eaf-89f0-d73f8ce12ff5 req-7919ad76-daec-4efe-9308-6fae5847c8a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076049 Jul 26 20:01:55.103385 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1903/3811] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:55.267722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73b34b53-c818-497b-a7b4-cbff7e362a6a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:55.268669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73b34b53-c818-497b-a7b4-cbff7e362a6a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:55.276309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73b34b53-c818-497b-a7b4-cbff7e362a6a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.276694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73b34b53-c818-497b-a7b4-cbff7e362a6a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:55.282373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73b34b53-c818-497b-a7b4-cbff7e362a6a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.283079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73b34b53-c818-497b-a7b4-cbff7e362a6a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:55.552149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-90f167cf-9ece-4b23-88d0-6a5c6311bb33 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:55.561297 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-90f167cf-9ece-4b23-88d0-6a5c6311bb33 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1394 microversion: 2.1 time: 0.534091 Jul 26 20:01:55.567868 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1909/3812] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:55 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1394 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:55.572944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46911256-a154-4d7a-bb46-fb1132688539 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:55.577937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-46911256-a154-4d7a-bb46-fb1132688539 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:55.594111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46911256-a154-4d7a-bb46-fb1132688539 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.594819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46911256-a154-4d7a-bb46-fb1132688539 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:55.595858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46911256-a154-4d7a-bb46-fb1132688539 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.596510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46911256-a154-4d7a-bb46-fb1132688539 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:55.773537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-73b34b53-c818-497b-a7b4-cbff7e362a6a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:55.789346 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73b34b53-c818-497b-a7b4-cbff7e362a6a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 200 len: 1473 microversion: 2.1 time: 0.525773 Jul 26 20:01:55.792737 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1904/3813] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:55 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 1473 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:55.815395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d08b6989-af3f-46c4-b241-169f2d0e0b3a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2082231492"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:55.819077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d08b6989-af3f-46c4-b241-169f2d0e0b3a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:55.828146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d08b6989-af3f-46c4-b241-169f2d0e0b3a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.828813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d08b6989-af3f-46c4-b241-169f2d0e0b3a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:55.829760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d08b6989-af3f-46c4-b241-169f2d0e0b3a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:55.830926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d08b6989-af3f-46c4-b241-169f2d0e0b3a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:56.076614 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d08b6989-af3f-46c4-b241-169f2d0e0b3a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a/action" status: 202 len: 0 microversion: 2.1 time: 0.266160 Jul 26 20:01:56.085505 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1905/3814] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:01:55 2022] POST /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 20:01:56.095271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-48ed874e-9a37-4d78-a462-f2605296bfca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875ec00a60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:56.150796 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-48ed874e-9a37-4d78-a462-f2605296bfca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.063657 Jul 26 20:01:56.159548 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1906/3815] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:01:56 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:56.477342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-46911256-a154-4d7a-bb46-fb1132688539 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:56.486243 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-46911256-a154-4d7a-bb46-fb1132688539 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1314 microversion: 2.1 time: 0.917013 Jul 26 20:01:56.487246 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1910/3816] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:55 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:56.589197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c62f02f3-d1ae-4984-83f6-8b3aa09d5e1f tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:56.590207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c62f02f3-d1ae-4984-83f6-8b3aa09d5e1f tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:56.598403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c62f02f3-d1ae-4984-83f6-8b3aa09d5e1f tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:56.599985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c62f02f3-d1ae-4984-83f6-8b3aa09d5e1f tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:56.601491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c62f02f3-d1ae-4984-83f6-8b3aa09d5e1f tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:56.602145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c62f02f3-d1ae-4984-83f6-8b3aa09d5e1f tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:57.109014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c62f02f3-d1ae-4984-83f6-8b3aa09d5e1f tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:57.112720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:01:57.142986 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c62f02f3-d1ae-4984-83f6-8b3aa09d5e1f tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1394 microversion: 2.1 time: 0.558397 Jul 26 20:01:57.143878 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1907/3817] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:56 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1394 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:57.167704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fd67ced7-b31f-45e0-ac6b-0f3f0cce1a2d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87564b8f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:57.234122 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fd67ced7-b31f-45e0-ac6b-0f3f0cce1a2d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.070858 Jul 26 20:01:57.235222 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1911/3818] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:01:57 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:57.413208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a4ec5b38-7231-42a4-9c11-e45578d84113 req-ad9c91eb-877c-4d8f-a747-85bd2dd4fe33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a04d6d-5ca6-447b-832b-3f980a65e1b5", "name": "network-vif-plugged", "status": "completed", "tag": "ee85e7f4-5d6f-45fa-bcdc-7a422a508ef3"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:01:57.435926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a4ec5b38-7231-42a4-9c11-e45578d84113 req-ad9c91eb-877c-4d8f-a747-85bd2dd4fe33 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:57.436630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a4ec5b38-7231-42a4-9c11-e45578d84113 req-ad9c91eb-877c-4d8f-a747-85bd2dd4fe33 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:57.455087 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a4ec5b38-7231-42a4-9c11-e45578d84113 req-ad9c91eb-877c-4d8f-a747-85bd2dd4fe33 service nova] Creating event network-vif-plugged:ee85e7f4-5d6f-45fa-bcdc-7a422a508ef3 for instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 on n-h2-708768-8 Jul 26 20:01:57.466668 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a4ec5b38-7231-42a4-9c11-e45578d84113 req-ad9c91eb-877c-4d8f-a747-85bd2dd4fe33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066417 Jul 26 20:01:57.468742 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1908/3819] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:57.514627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-112fdb8c-f8b7-45da-baf3-bc7d98eeb512 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:57.516230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-112fdb8c-f8b7-45da-baf3-bc7d98eeb512 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:57.524888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-112fdb8c-f8b7-45da-baf3-bc7d98eeb512 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:57.525345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-112fdb8c-f8b7-45da-baf3-bc7d98eeb512 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:57.526626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-112fdb8c-f8b7-45da-baf3-bc7d98eeb512 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:57.527074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-112fdb8c-f8b7-45da-baf3-bc7d98eeb512 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:57.737981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-112fdb8c-f8b7-45da-baf3-bc7d98eeb512 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:57.758994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-112fdb8c-f8b7-45da-baf3-bc7d98eeb512 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1314 microversion: 2.1 time: 0.251108 Jul 26 20:01:57.759385 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1912/3820] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:57 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:58.166661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dfb03f8c-8679-4b06-b488-5a72810f34b8 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:58.167460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dfb03f8c-8679-4b06-b488-5a72810f34b8 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:58.177833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfb03f8c-8679-4b06-b488-5a72810f34b8 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:58.179345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfb03f8c-8679-4b06-b488-5a72810f34b8 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:58.180472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfb03f8c-8679-4b06-b488-5a72810f34b8 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:58.183769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfb03f8c-8679-4b06-b488-5a72810f34b8 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:58.249206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c98ee3f9-c567-4181-8756-da50749c4770 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87564bfd30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:58.316004 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c98ee3f9-c567-4181-8756-da50749c4770 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.070461 Jul 26 20:01:58.317148 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1913/3821] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:01:58 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:01:58.785261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb28da12-d9c6-42e6-80d5-986f51843656 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:58.789525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eb28da12-d9c6-42e6-80d5-986f51843656 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:58.819063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb28da12-d9c6-42e6-80d5-986f51843656 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:58.819770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb28da12-d9c6-42e6-80d5-986f51843656 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:58.832249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb28da12-d9c6-42e6-80d5-986f51843656 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:58.832768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb28da12-d9c6-42e6-80d5-986f51843656 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:59.234528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dfb03f8c-8679-4b06-b488-5a72810f34b8 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:59.246611 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dfb03f8c-8679-4b06-b488-5a72810f34b8 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1575 microversion: 2.1 time: 1.085084 Jul 26 20:01:59.250454 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1909/3822] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:58 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1575 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:59.260416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3d92b456-b45f-4fbb-94a0-72d6721ae523 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:59.263964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3d92b456-b45f-4fbb-94a0-72d6721ae523 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:59.278955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d92b456-b45f-4fbb-94a0-72d6721ae523 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:59.279492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d92b456-b45f-4fbb-94a0-72d6721ae523 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:59.285287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d92b456-b45f-4fbb-94a0-72d6721ae523 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:59.285857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d92b456-b45f-4fbb-94a0-72d6721ae523 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:59.361965 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3d92b456-b45f-4fbb-94a0-72d6721ae523 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/ips" status: 200 len: 149 microversion: 2.1 time: 0.099945 Jul 26 20:01:59.364375 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1910/3823] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:01:59 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/ips => generated 149 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:59.377004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-77a38167-bb07-471a-977d-53bd9e24a5ef tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:59.377512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-77a38167-bb07-471a-977d-53bd9e24a5ef tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:01:59.391570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77a38167-bb07-471a-977d-53bd9e24a5ef tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:59.392063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77a38167-bb07-471a-977d-53bd9e24a5ef tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:59.392856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77a38167-bb07-471a-977d-53bd9e24a5ef tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:01:59.393294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77a38167-bb07-471a-977d-53bd9e24a5ef tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:01:59.572313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eb28da12-d9c6-42e6-80d5-986f51843656 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:01:59.590588 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb28da12-d9c6-42e6-80d5-986f51843656 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1314 microversion: 2.1 time: 0.810597 Jul 26 20:01:59.592818 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1914/3824] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:01:58 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:01:59.606619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f6fa9a1-7e71-42a4-a459-a1be286239ee tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8756447ca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:01:59.692138 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-77a38167-bb07-471a-977d-53bd9e24a5ef tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.325841 Jul 26 20:01:59.694060 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1911/3825] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:01:59 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b/os-interface => generated 284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:01:59.747352 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f6fa9a1-7e71-42a4-a459-a1be286239ee tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.152539 Jul 26 20:01:59.748193 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1915/3826] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:01:59 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:00.487911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f0212af3-17b3-4b19-ab7c-3289aa3d3f92 req-c4884cb9-ef39-4365-a36a-ce8576e768a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a", "name": "network-vif-plugged", "status": "completed", "tag": "e208acc1-d66c-4acc-81b0-0771a8806062"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:00.504803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f0212af3-17b3-4b19-ab7c-3289aa3d3f92 req-c4884cb9-ef39-4365-a36a-ce8576e768a7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:00.507862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f0212af3-17b3-4b19-ab7c-3289aa3d3f92 req-c4884cb9-ef39-4365-a36a-ce8576e768a7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:00.550530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f0212af3-17b3-4b19-ab7c-3289aa3d3f92 req-c4884cb9-ef39-4365-a36a-ce8576e768a7 service nova] Creating event network-vif-plugged:e208acc1-d66c-4acc-81b0-0771a8806062 for instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a on n-h1-708768-8 Jul 26 20:02:00.564623 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f0212af3-17b3-4b19-ab7c-3289aa3d3f92 req-c4884cb9-ef39-4365-a36a-ce8576e768a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080215 Jul 26 20:02:00.565480 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1912/3827] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:00.623256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db61fe75-00a5-4fde-adb3-3eb7ae755d65 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:00.624108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-db61fe75-00a5-4fde-adb3-3eb7ae755d65 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:00.638538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db61fe75-00a5-4fde-adb3-3eb7ae755d65 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:00.643237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db61fe75-00a5-4fde-adb3-3eb7ae755d65 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:00.644459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db61fe75-00a5-4fde-adb3-3eb7ae755d65 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:00.648448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db61fe75-00a5-4fde-adb3-3eb7ae755d65 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:00.766427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-50b78364-b495-4c60-b38b-6a5da8d39d69 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e2e90d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:00.857789 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-50b78364-b495-4c60-b38b-6a5da8d39d69 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.098313 Jul 26 20:02:00.858393 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1913/3828] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:00 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:02:01.532177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-db61fe75-00a5-4fde-adb3-3eb7ae755d65 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:01.549498 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db61fe75-00a5-4fde-adb3-3eb7ae755d65 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1498 microversion: 2.1 time: 0.928702 Jul 26 20:02:01.550161 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1916/3829] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:00 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1498 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:01.876433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3b11869-d250-4621-96fa-56d0c8c22d8d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e289ee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:01.980002 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3b11869-d250-4621-96fa-56d0c8c22d8d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.109791 Jul 26 20:02:01.988578 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1914/3830] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:01 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:02.871814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-31a3b987-80a8-410f-9814-eda15744fde3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:02.872333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-31a3b987-80a8-410f-9814-eda15744fde3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:02.901087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31a3b987-80a8-410f-9814-eda15744fde3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:02.904226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31a3b987-80a8-410f-9814-eda15744fde3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:02.908602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31a3b987-80a8-410f-9814-eda15744fde3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:02.909376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31a3b987-80a8-410f-9814-eda15744fde3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:02.983561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-31a3b987-80a8-410f-9814-eda15744fde3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:02:02.995509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2da3fca7-4a5e-460e-8f83-f5bc5cc7847b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87683858b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:03.086712 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2da3fca7-4a5e-460e-8f83-f5bc5cc7847b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.095914 Jul 26 20:02:03.095353 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1915/3831] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:02 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:03.232466 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-31a3b987-80a8-410f-9814-eda15744fde3 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 204 len: 0 microversion: 2.1 time: 0.367140 Jul 26 20:02:03.237293 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1917/3832] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:02:02 2022] DELETE /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:02:03.243224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37b727df-e010-44a7-9d9d-c2b6e2a85924 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:03.244117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37b727df-e010-44a7-9d9d-c2b6e2a85924 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:03.264453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37b727df-e010-44a7-9d9d-c2b6e2a85924 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:03.268294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37b727df-e010-44a7-9d9d-c2b6e2a85924 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:03.272891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37b727df-e010-44a7-9d9d-c2b6e2a85924 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:03.273416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37b727df-e010-44a7-9d9d-c2b6e2a85924 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:03.415538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de805f88-b49c-4b83-9cd7-41eef551e8eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0799dab-4a2b-4ab9-a51a-995e0cfd85c7"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:03.419272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de805f88-b49c-4b83-9cd7-41eef551e8eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:03.433390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de805f88-b49c-4b83-9cd7-41eef551e8eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:03.436525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de805f88-b49c-4b83-9cd7-41eef551e8eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:03.438691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de805f88-b49c-4b83-9cd7-41eef551e8eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:03.439149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de805f88-b49c-4b83-9cd7-41eef551e8eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:04.315943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-37b727df-e010-44a7-9d9d-c2b6e2a85924 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:04.332939 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37b727df-e010-44a7-9d9d-c2b6e2a85924 tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1504 microversion: 2.1 time: 1.094260 Jul 26 20:02:04.336678 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1916/3833] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:03 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1504 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:04.360955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d6ed751a-ff37-4af0-8b6e-4a8307882492 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e29d0d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:04.459218 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d6ed751a-ff37-4af0-8b6e-4a8307882492 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.113645 Jul 26 20:02:04.462294 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1917/3834] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:04 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:04.718051 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de805f88-b49c-4b83-9cd7-41eef551e8eb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "POST /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.307647 Jul 26 20:02:04.725866 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1918/3835] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:02:03 2022] POST /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments => generated 194 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:05.363216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-50ee3625-9e4c-47b0-a255-57c3a97b44fe tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:05.364484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-50ee3625-9e4c-47b0-a255-57c3a97b44fe tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:05.379428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50ee3625-9e4c-47b0-a255-57c3a97b44fe tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:05.381646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50ee3625-9e4c-47b0-a255-57c3a97b44fe tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:05.384870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50ee3625-9e4c-47b0-a255-57c3a97b44fe tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:05.385623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50ee3625-9e4c-47b0-a255-57c3a97b44fe tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:05.477640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e62e99a6-66b2-4bf0-955a-e1eab8c1a040 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8756452d30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:05.565139 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e62e99a6-66b2-4bf0-955a-e1eab8c1a040 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.088220 Jul 26 20:02:05.565769 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1919/3836] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:05 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:02:06.570205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-34925d82-3bda-4f52-a665-04c23d69adaf req-9e2fc378-9cde-4354-8232-f5d5c6358743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a04d6d-5ca6-447b-832b-3f980a65e1b5", "name": "network-vif-deleted", "tag": "ee85e7f4-5d6f-45fa-bcdc-7a422a508ef3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:06.591266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-34925d82-3bda-4f52-a665-04c23d69adaf req-9e2fc378-9cde-4354-8232-f5d5c6358743 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:06.592104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-34925d82-3bda-4f52-a665-04c23d69adaf req-9e2fc378-9cde-4354-8232-f5d5c6358743 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:06.606796 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-34925d82-3bda-4f52-a665-04c23d69adaf req-9e2fc378-9cde-4354-8232-f5d5c6358743 service nova] Creating event network-vif-deleted:ee85e7f4-5d6f-45fa-bcdc-7a422a508ef3 for instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 on n-h2-708768-8 Jul 26 20:02:06.613431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-34925d82-3bda-4f52-a665-04c23d69adaf req-9e2fc378-9cde-4354-8232-f5d5c6358743 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047892 Jul 26 20:02:06.615668 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1920/3837] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:02:06.623320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98d3d0ea-7953-421f-81cd-76f6d0ec5350 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87564474c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:06.676137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-50ee3625-9e4c-47b0-a255-57c3a97b44fe tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b389e99c8f34d16889b21af192dcf99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d19bedc79942d08bb1c0c5006f8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:06.722696 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-50ee3625-9e4c-47b0-a255-57c3a97b44fe tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 200 len: 1504 microversion: 2.1 time: 1.364558 Jul 26 20:02:06.726210 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1918/3838] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:05 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 1504 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:06.734622 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98d3d0ea-7953-421f-81cd-76f6d0ec5350 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.117180 Jul 26 20:02:06.737076 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1921/3839] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:06 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:07.180465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b8fe3dca-ec8c-4c40-a4ef-28ea5806da36 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:07.181566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b8fe3dca-ec8c-4c40-a4ef-28ea5806da36 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:07.211517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8fe3dca-ec8c-4c40-a4ef-28ea5806da36 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:07.212194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8fe3dca-ec8c-4c40-a4ef-28ea5806da36 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:07.213060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8fe3dca-ec8c-4c40-a4ef-28ea5806da36 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:07.213506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8fe3dca-ec8c-4c40-a4ef-28ea5806da36 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:07.304582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1c982b20-c6b3-43af-9585-4385991e0510 req-95c95c56-e1c5-4221-bbb4-2fbb01d56527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27aa1dd-25d2-408d-a41b-d6fe723c880b", "tag": "619b7ef1-59e5-47a5-8358-e425c54aed21"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:07.326405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1c982b20-c6b3-43af-9585-4385991e0510 req-95c95c56-e1c5-4221-bbb4-2fbb01d56527 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:07.327153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1c982b20-c6b3-43af-9585-4385991e0510 req-95c95c56-e1c5-4221-bbb4-2fbb01d56527 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:07.368541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1c982b20-c6b3-43af-9585-4385991e0510 req-95c95c56-e1c5-4221-bbb4-2fbb01d56527 service nova] Creating event network-changed:619b7ef1-59e5-47a5-8358-e425c54aed21 for instance c27aa1dd-25d2-408d-a41b-d6fe723c880b on n-h2-708768-8 Jul 26 20:02:07.380228 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1c982b20-c6b3-43af-9585-4385991e0510 req-95c95c56-e1c5-4221-bbb4-2fbb01d56527 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083676 Jul 26 20:02:07.381131 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1919/3840] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:07.754290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:07.757555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] [instance: 03a04d6d-5ca6-447b-832b-3f980a65e1b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:07.788348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:07.788811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:07.789620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:07.800095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:07.876791 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] HTTP exception thrown: Instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 could not be found. Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Request method failure captured: Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 HTTP/1.1 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgCG8e8GjUlPQF8oCh-xlkNfDeuxIqtNnxrtjN61WE9vmT5vtTandFd0HmTmKmycmRmP52PdTS0Xi5RD0LLjolW_oCcngD_ijKGR0JuQUXK7E5XxuiomafKk5vaPrOGsPLqzqmz3qh2TdpEg1zwkKqrAR22ki-ehfUsCCCWKdMIcqs Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 33d19bedc79942d08bb1c0c5006f8764 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesActionsTest-864393083 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33d19bedc79942d08bb1c0c5006f8764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33d19bedc79942d08bb1c0c5006f8764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33d19bedc79942d08bb1c0c5006f8764", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33d19bedc79942d08bb1c0c5006f8764"}]}] Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesActionsTest-864393083 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 33d19bedc79942d08bb1c0c5006f8764 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesActionsTest-864393083 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesActionsTest-864393083-project Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9b389e99c8f34d16889b21af192dcf99 Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesActionsTest-864393083-project Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 could not be found. Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '03a04d6d-5ca6-447b-832b-3f980a65e1b5'} Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 could not be found. Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 could not be found. Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:02:07.878761 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:07.883797 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:07.883797 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:02:07.883797 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:02:07.883797 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:02:07.883797 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:02:07.883797 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 could not be found. Jul 26 20:02:07.883797 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:07.886516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] Returning 404 to user: Instance 03a04d6d-5ca6-447b-832b-3f980a65e1b5 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:02:07.889668 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0090c8e3-7e47-46b5-a495-8dff98d308db tempest-VolumesActionsTest-864393083 tempest-VolumesActionsTest-864393083-project] 10.222.0.58 "GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5" status: 404 len: 111 microversion: 2.1 time: 0.141726 Jul 26 20:02:07.894955 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1920/3841] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:07 2022] GET /compute/v2.1/servers/03a04d6d-5ca6-447b-832b-3f980a65e1b5 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:02:07.904748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c9fe951-06d0-4fb6-9638-02cf7d4af2b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875ec6b820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:07.984327 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c9fe951-06d0-4fb6-9638-02cf7d4af2b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.087698 Jul 26 20:02:07.984966 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1921/3842] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:07 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:08.417516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b8fe3dca-ec8c-4c40-a4ef-28ea5806da36 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:08.444936 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b8fe3dca-ec8c-4c40-a4ef-28ea5806da36 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1575 microversion: 2.1 time: 1.250601 Jul 26 20:02:08.446389 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1922/3843] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:07 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1575 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:09.001558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d468fa23-e041-4c22-bce9-1e370768cfd0 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87681ccd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:09.100867 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d468fa23-e041-4c22-bce9-1e370768cfd0 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.105037 Jul 26 20:02:09.112623 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1922/3844] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:08 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:10.126885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f99ab8b5-6a4a-42db-81dd-9dd1328bf124 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8756452ca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:10.245532 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f99ab8b5-6a4a-42db-81dd-9dd1328bf124 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.127323 Jul 26 20:02:10.249608 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1923/3845] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:10 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:11.272698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cb770f4a-a464-4b9c-a99b-0ac8e5428a83 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e289040>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:11.389589 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cb770f4a-a464-4b9c-a99b-0ac8e5428a83 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1414 microversion: 2.1 time: 0.122953 Jul 26 20:02:11.390498 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1923/3846] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:11 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:12.406748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aefdc428-ff6a-487c-b70c-cd03e6a3427d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8756562160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:15.130715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-037f6562-4024-49ca-9535-30dee4d473b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'create', calling method: .version_select at 0x7f875e2e9550>, body: {"keypair": {"name": "tempest-keypair-43413789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXvyYwGut9/8x5gGaZ8msY19gOZB80oSMepok2qUKR6Z6Tqxxh1dfd/Y6Zp8tHwAIc516nax4y9S5453Tzyufe3ptYq39/RjCZfkgjvasV1Kpq8Dl1ln6Hu9x0UoqSXtg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:15.168510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=58 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:15.216072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-037f6562-4024-49ca-9535-30dee4d473b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Getting quotas for project 656858d44e9c4e0d93600f0f59e9d409. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:02:15.253404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-037f6562-4024-49ca-9535-30dee4d473b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Getting quotas for user 9c1dc05eec494fe6bf60bf0fc16ce47e and project 656858d44e9c4e0d93600f0f59e9d409. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:02:15.402240 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-037f6562-4024-49ca-9535-30dee4d473b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.939544 Jul 26 20:02:15.412369 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1924/3847] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 20:02:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 950 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 26 20:02:17.186632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:18.427767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:22.638516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=35 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:22.776837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1649172017", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "469c7ab3-f1d8-42a0-938b-c1c294ea6979"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:25.300286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:28.576184 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aefdc428-ff6a-487c-b70c-cd03e6a3427d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1423 microversion: 2.1 time: 16.174284 Jul 26 20:02:28.579237 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1924/3848] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:12 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1423 bytes in 16178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:28.580282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] validate_networks() for [('469c7ab3-f1d8-42a0-938b-c1c294ea6979', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:02:28.597470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1148319083", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46e47e89-5e7a-4dbc-a70d-bbebb8152491"}], "security_groups": [{"name": "tempest-securitygroup--1029617533"}], "key_name": "tempest-keypair-43413789", "user_data": "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:28.869766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] validate_networks() for [('46e47e89-5e7a-4dbc-a70d-bbebb8152491', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:02:29.600706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:02:29.601374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:02:29.601601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:02:29.602248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:02:29.612670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:02:29.634633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:02:29.635118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:02:29.635985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:02:29.636430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:02:29.636849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:02:29.649786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:29.650238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:29.651052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:29.660842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:29.666276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:29.671920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:29.673113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:29.673569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:29.739753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Getting quotas for project 656858d44e9c4e0d93600f0f59e9d409. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:02:29.744401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Getting quotas for project 547dab22ce93445d964cff0949ebf9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:02:29.756249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Getting quotas for user 9c1dc05eec494fe6bf60bf0fc16ce47e and project 656858d44e9c4e0d93600f0f59e9d409. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:02:29.761698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Getting quotas for user 2bc86400878e478d813ada004d9aabea and project 547dab22ce93445d964cff0949ebf9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:02:29.790970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Going to run 3 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:02:29.795180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:02:29.797546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:02:29.798657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:02:29.890686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 5cd4c910-5089-44d9-a86d-f1043919d579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=1d1b6c16-d1b4-455c-b4d0-5f4828075243,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:02:29.930506 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d0311b83-a046-4144-bc0a-fa0694e42429 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.349849 Jul 26 20:02:29.937540 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1925/3849] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 20:02:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 20:02:29.943093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7fb1edbe-1f54-4aff-8e2a-9f3aaae47188 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:29.943985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7fb1edbe-1f54-4aff-8e2a-9f3aaae47188 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:29.951120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fb1edbe-1f54-4aff-8e2a-9f3aaae47188 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:29.951525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fb1edbe-1f54-4aff-8e2a-9f3aaae47188 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:29.952331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fb1edbe-1f54-4aff-8e2a-9f3aaae47188 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:29.952766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fb1edbe-1f54-4aff-8e2a-9f3aaae47188 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:29.984431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=5cd4c910-5089-44d9-a86d-f1043919d579,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:02:30.173360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fd65cb46-17f6-46a0-8864-2fa03e00ac68 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.540583 Jul 26 20:02:30.174011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1925/3850] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:02:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 7542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:02:30.183722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-7fb1edbe-1f54-4aff-8e2a-9f3aaae47188 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lazy-loading 'services' on Instance uuid 08c9b8aa-c3eb-4a64-aed8-59f12802443f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:02:30.587956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-430fa574-d6dc-4261-85bf-47542282e386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:30.588462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-430fa574-d6dc-4261-85bf-47542282e386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:30.612000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-430fa574-d6dc-4261-85bf-47542282e386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:30.615841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-430fa574-d6dc-4261-85bf-47542282e386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:30.620833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-430fa574-d6dc-4261-85bf-47542282e386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:30.624448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-430fa574-d6dc-4261-85bf-47542282e386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:30.726249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-430fa574-d6dc-4261-85bf-47542282e386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:02:30.772423 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7fb1edbe-1f54-4aff-8e2a-9f3aaae47188 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments/d0799dab-4a2b-4ab9-a51a-995e0cfd85c7" status: 202 len: 0 microversion: 2.1 time: 0.833256 Jul 26 20:02:30.801767 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1926/3851] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:02:29 2022] DELETE /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments/d0799dab-4a2b-4ab9-a51a-995e0cfd85c7 => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:02:30.813435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8773118d-2acf-46c0-8d77-c93cb2dc300f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8756546160>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:30.973037 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8773118d-2acf-46c0-8d77-c93cb2dc300f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 200 len: 1423 microversion: 2.1 time: 0.168885 Jul 26 20:02:30.973829 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1927/3852] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:02:30 2022] GET /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 1423 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:30.992307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-527e92f3-e895-428d-893f-d39b1a09bb93 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:30.995339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-527e92f3-e895-428d-893f-d39b1a09bb93 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:31.002656 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-430fa574-d6dc-4261-85bf-47542282e386 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "DELETE /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 204 len: 0 microversion: 2.32 time: 0.818959 Jul 26 20:02:31.003261 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1926/3853] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:02:30 2022] DELETE /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:02:31.023164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b2cf0c9-ce80-4fa3-b92f-036f9fa3ec6a tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:31.057578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9b2cf0c9-ce80-4fa3-b92f-036f9fa3ec6a tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:31.058385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9b2cf0c9-ce80-4fa3-b92f-036f9fa3ec6a tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'deleted': False, 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:02:31.126300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b2cf0c9-ce80-4fa3-b92f-036f9fa3ec6a tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:31.134753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b2cf0c9-ce80-4fa3-b92f-036f9fa3ec6a tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:31.135933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b2cf0c9-ce80-4fa3-b92f-036f9fa3ec6a tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:31.136209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-527e92f3-e895-428d-893f-d39b1a09bb93 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:31.136728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b2cf0c9-ce80-4fa3-b92f-036f9fa3ec6a tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:31.159562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-527e92f3-e895-428d-893f-d39b1a09bb93 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:31.164637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-527e92f3-e895-428d-893f-d39b1a09bb93 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:31.167042 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-527e92f3-e895-428d-893f-d39b1a09bb93 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1280 microversion: 2.20 time: 0.190331 Jul 26 20:02:31.183459 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1928/3854] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:30 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:31.187070 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9b2cf0c9-ce80-4fa3-b92f-036f9fa3ec6a tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.168603 Jul 26 20:02:31.189221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bb9855b7-7194-47f1-a3b4-0913390b3c0c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:31.191707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bb9855b7-7194-47f1-a3b4-0913390b3c0c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:31.200058 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1927/3855] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 20:02:31 2022] GET /compute/v2.1/servers => generated 1018 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:31.201227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb9855b7-7194-47f1-a3b4-0913390b3c0c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:31.201958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb9855b7-7194-47f1-a3b4-0913390b3c0c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:31.203030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb9855b7-7194-47f1-a3b4-0913390b3c0c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:31.204310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb9855b7-7194-47f1-a3b4-0913390b3c0c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:31.204834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6027163b-9ac7-4afb-a4ba-7ab0c9785716 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87682bd0d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:31.290694 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bb9855b7-7194-47f1-a3b4-0913390b3c0c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099490 Jul 26 20:02:31.299221 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1929/3856] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:02:31 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:31.348387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:31.354536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:31.378188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:31.383561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:31.387115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:31.388578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:32.076456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:32.171366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:32.198124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:32.202435 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ac89586-0ace-4108-a09c-5973e91953ab tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2951 microversion: 2.32 time: 0.899647 Jul 26 20:02:32.210620 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1930/3857] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:31 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2951 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:32.232957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39a794ce-c952-48c6-9e86-d4eb14d8ed60 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:32.245668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39a794ce-c952-48c6-9e86-d4eb14d8ed60 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:32.387573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-39a794ce-c952-48c6-9e86-d4eb14d8ed60 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:32.395046 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39a794ce-c952-48c6-9e86-d4eb14d8ed60 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1223 microversion: 2.1 time: 0.183457 Jul 26 20:02:32.399386 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1931/3858] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:32 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1223 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:32.413293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:32.414204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:32.431562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:32.432245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:32.435472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:32.436137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:32.574199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:32.584086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:32.596735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:32.597926 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5257409-d2f5-4e4a-9b7f-f10156474532 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1284 microversion: 2.20 time: 0.197265 Jul 26 20:02:32.607546 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1932/3859] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:32 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:32.644793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-64672b7f-306a-4f78-b014-eb1c028f994d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:32.647950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-64672b7f-306a-4f78-b014-eb1c028f994d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:32.674333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64672b7f-306a-4f78-b014-eb1c028f994d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:32.676223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64672b7f-306a-4f78-b014-eb1c028f994d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:32.679516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64672b7f-306a-4f78-b014-eb1c028f994d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:32.680241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64672b7f-306a-4f78-b014-eb1c028f994d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:32.765391 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-64672b7f-306a-4f78-b014-eb1c028f994d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155290 Jul 26 20:02:32.771910 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1933/3860] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:02:32 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:32.776222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6027163b-9ac7-4afb-a4ba-7ab0c9785716 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 204 len: 0 microversion: 2.1 time: 1.574959 Jul 26 20:02:32.777854 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1928/3861] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:31 2022] DELETE /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 0 bytes in 1577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:02:32.779185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-949d96fe-db2e-49a3-a108-8f9aec413258 req-8e7472a1-ae2c-44c0-8fcf-b461c146168e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a", "name": "network-vif-unplugged", "status": "completed", "tag": "e208acc1-d66c-4acc-81b0-0771a8806062"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:32.786681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2799781b-1525-4eee-abed-c72a1d102627 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:32.787093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2799781b-1525-4eee-abed-c72a1d102627 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:32.795628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-949d96fe-db2e-49a3-a108-8f9aec413258 req-8e7472a1-ae2c-44c0-8fcf-b461c146168e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:32.797111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-949d96fe-db2e-49a3-a108-8f9aec413258 req-8e7472a1-ae2c-44c0-8fcf-b461c146168e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:32.808431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2799781b-1525-4eee-abed-c72a1d102627 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:32.809146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2799781b-1525-4eee-abed-c72a1d102627 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:32.810232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2799781b-1525-4eee-abed-c72a1d102627 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:32.811878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2799781b-1525-4eee-abed-c72a1d102627 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:32.825002 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-949d96fe-db2e-49a3-a108-8f9aec413258 req-8e7472a1-ae2c-44c0-8fcf-b461c146168e service nova] Creating event network-vif-unplugged:e208acc1-d66c-4acc-81b0-0771a8806062 for instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a on n-h1-708768-8 Jul 26 20:02:32.836554 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-949d96fe-db2e-49a3-a108-8f9aec413258 req-8e7472a1-ae2c-44c0-8fcf-b461c146168e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062610 Jul 26 20:02:32.839040 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1934/3862] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:32.899262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2799781b-1525-4eee-abed-c72a1d102627 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:02:33.119017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2799781b-1525-4eee-abed-c72a1d102627 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 204 len: 0 microversion: 2.1 time: 0.336854 Jul 26 20:02:33.119850 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1929/3863] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:02:32 2022] DELETE /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:02:33.238640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:33.240132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:33.260867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:33.263696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:33.264709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:33.267420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:33.394111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-780175515", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7c43ed99-78c0-4e29-b511-cd8d44018d0b"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:33.471077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] validate_networks() for [('7c43ed99-78c0-4e29-b511-cd8d44018d0b', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:02:33.706164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:33.716568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:33.718069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:33.719327 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-43f9ace3-eb25-446e-8f5c-a94a0c2e0bed tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2951 microversion: 2.32 time: 0.485605 Jul 26 20:02:33.720052 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1935/3864] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:33 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2951 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:33.740346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:33.752998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:33.756730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Searching by: {'deleted': False, 'project_id': '51d7777de15c469a9ac15b3a91615a0f'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:02:33.770223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:33.773335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:33.776630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:33.777154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:33.856532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:02:33.952315 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-80688043-6e2c-4544-9788-8e71022fc535 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.230596 Jul 26 20:02:33.955331 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1936/3865] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 20:02:33 2022] GET /compute/v2.1/servers => generated 333 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:33.970710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e51e8955-834c-4807-89b9-96f6380fcf45 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:33.972301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e51e8955-834c-4807-89b9-96f6380fcf45 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:34.017290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51e8955-834c-4807-89b9-96f6380fcf45 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.020728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51e8955-834c-4807-89b9-96f6380fcf45 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.022083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51e8955-834c-4807-89b9-96f6380fcf45 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.024650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e51e8955-834c-4807-89b9-96f6380fcf45 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.305260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e51e8955-834c-4807-89b9-96f6380fcf45 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:34.313488 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e51e8955-834c-4807-89b9-96f6380fcf45 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1219 microversion: 2.1 time: 0.354643 Jul 26 20:02:34.314073 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1937/3866] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:33 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1219 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:34.338186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:34.338585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:34.350287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.350881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.351800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.352691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.410079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:02:34.410635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:02:34.411378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:02:34.412159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:02:34.412577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:02:34.430036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.430650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.432295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.432724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.477886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Getting quotas for project a715ad339a264f918507acfd8a1180f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:02:34.489941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:34.495482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Getting quotas for user f82c738a399d4688b1870ea46700ac71 and project a715ad339a264f918507acfd8a1180f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:02:34.519872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:34.528292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:34.530261 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-04da40b0-03ab-47ea-a055-b610c1788135 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1332 microversion: 2.20 time: 0.202385 Jul 26 20:02:34.530718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:02:34.531295 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1938/3867] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:34 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1332 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:34.546583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:02:34.553071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b06db2dc-ace5-442f-a1ab-cbc14d0fe03d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:34.566640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b06db2dc-ace5-442f-a1ab-cbc14d0fe03d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:34.575064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b06db2dc-ace5-442f-a1ab-cbc14d0fe03d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.578159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b06db2dc-ace5-442f-a1ab-cbc14d0fe03d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.579539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b06db2dc-ace5-442f-a1ab-cbc14d0fe03d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.583569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b06db2dc-ace5-442f-a1ab-cbc14d0fe03d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.641478 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b06db2dc-ace5-442f-a1ab-cbc14d0fe03d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093145 Jul 26 20:02:34.651285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1939/3868] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:02:34 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:34.653450 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd6fc587-93c9-41c4-926d-4c17b0af6fd8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270232 Jul 26 20:02:34.660530 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1930/3869] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:02:34.668039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dc2c1faf-b5da-4a74-93d9-24c76a620c22 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:34.668876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dc2c1faf-b5da-4a74-93d9-24c76a620c22 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:34.681449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:34.687004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:34.688277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Searching by: {'deleted': False, 'project_id': '51d7777de15c469a9ac15b3a91615a0f'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:02:34.700549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.701247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.726432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.728563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.771771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:02:34.856158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dc2c1faf-b5da-4a74-93d9-24c76a620c22 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:34.867527 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dc2c1faf-b5da-4a74-93d9-24c76a620c22 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1207 microversion: 2.1 time: 0.204453 Jul 26 20:02:34.882460 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1931/3870] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:34 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1207 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:34.911940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:34.912585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:34.935372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.936079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.937026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.937322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:34.937797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:34.974480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:34.980852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:35.497294 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2a1a62ca-0216-4199-8028-644216769155 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.839437 Jul 26 20:02:35.513939 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1940/3871] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 20:02:34 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:35.523330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ae6d28d9-e803-45ce-8772-98f2d0b368bd tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:35.524211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ae6d28d9-e803-45ce-8772-98f2d0b368bd tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:35.532216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae6d28d9-e803-45ce-8772-98f2d0b368bd tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:35.533138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae6d28d9-e803-45ce-8772-98f2d0b368bd tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:35.534079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae6d28d9-e803-45ce-8772-98f2d0b368bd tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:35.534671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae6d28d9-e803-45ce-8772-98f2d0b368bd tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:36.331738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae6d28d9-e803-45ce-8772-98f2d0b368bd tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:36.345507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ae6d28d9-e803-45ce-8772-98f2d0b368bd tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1275 microversion: 2.1 time: 0.830431 Jul 26 20:02:36.348977 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1941/3872] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:35 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1275 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:36.366415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-32ad62c6-86bf-4413-ae4e-037af6ab8627 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:36.400857 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-32ad62c6-86bf-4413-ae4e-037af6ab8627 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049134 Jul 26 20:02:36.408938 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1942/3873] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 20:02:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:36.422321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:36.424275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:36.443582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:36.445495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:36.446361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:36.449022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:36.775638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:36.798249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:36.799874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:36.803256 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e65c6bd9-de59-4bca-9c30-c1247c2627db tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1338 microversion: 2.20 time: 0.398615 Jul 26 20:02:36.810959 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1943/3874] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:36 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1338 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:36.833736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3933f283-4bbb-49eb-89cf-01ee811da858 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:36.842264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3933f283-4bbb-49eb-89cf-01ee811da858 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:36.870089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3933f283-4bbb-49eb-89cf-01ee811da858 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:36.870557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3933f283-4bbb-49eb-89cf-01ee811da858 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:36.871342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3933f283-4bbb-49eb-89cf-01ee811da858 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:36.880869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3933f283-4bbb-49eb-89cf-01ee811da858 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:37.046769 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3933f283-4bbb-49eb-89cf-01ee811da858 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.234535 Jul 26 20:02:37.047375 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1944/3875] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:02:36 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:37.062126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4ca8113e-414d-446e-b291-75aaed4934ce tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:37.062677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4ca8113e-414d-446e-b291-75aaed4934ce tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:37.085681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ca8113e-414d-446e-b291-75aaed4934ce tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:37.086159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ca8113e-414d-446e-b291-75aaed4934ce tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:37.086998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ca8113e-414d-446e-b291-75aaed4934ce tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:37.087373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ca8113e-414d-446e-b291-75aaed4934ce tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:37.091991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:37.708843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4ca8113e-414d-446e-b291-75aaed4934ce tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:37.717215 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4ca8113e-414d-446e-b291-75aaed4934ce tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1259 microversion: 2.1 time: 0.663351 Jul 26 20:02:37.720006 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1945/3876] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:37 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1259 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:37.740218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-726bebc2-a9a5-4c8c-9d6a-7d8c268b60cc req-5f59118b-193e-4a55-9e2f-4d1e292304cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "2fe790d2-60b2-4792-a59a-9585e6108fb0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:37.776993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-726bebc2-a9a5-4c8c-9d6a-7d8c268b60cc req-5f59118b-193e-4a55-9e2f-4d1e292304cb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:37.778165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-726bebc2-a9a5-4c8c-9d6a-7d8c268b60cc req-5f59118b-193e-4a55-9e2f-4d1e292304cb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:37.810129 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-726bebc2-a9a5-4c8c-9d6a-7d8c268b60cc req-5f59118b-193e-4a55-9e2f-4d1e292304cb service nova] Creating event network-vif-unplugged:2fe790d2-60b2-4792-a59a-9585e6108fb0 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:37.821256 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-726bebc2-a9a5-4c8c-9d6a-7d8c268b60cc req-5f59118b-193e-4a55-9e2f-4d1e292304cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090183 Jul 26 20:02:37.829110 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1946/3877] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:37.845111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0e798738-dd31-4161-99f5-28d4e391f62d tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:37.845721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0e798738-dd31-4161-99f5-28d4e391f62d tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:37.876096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e798738-dd31-4161-99f5-28d4e391f62d tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:37.876578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e798738-dd31-4161-99f5-28d4e391f62d tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:37.877756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e798738-dd31-4161-99f5-28d4e391f62d tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:37.878205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e798738-dd31-4161-99f5-28d4e391f62d tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:37.999064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0e798738-dd31-4161-99f5-28d4e391f62d tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:02:38.238917 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0e798738-dd31-4161-99f5-28d4e391f62d tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 204 len: 0 microversion: 2.1 time: 0.408030 Jul 26 20:02:38.239757 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1947/3878] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:02:37 2022] DELETE /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:02:38.259167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe717dd3-2202-4d99-b9ab-ddc8a53c5ee1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:38.268370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fe717dd3-2202-4d99-b9ab-ddc8a53c5ee1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:38.281889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe717dd3-2202-4d99-b9ab-ddc8a53c5ee1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:38.282344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe717dd3-2202-4d99-b9ab-ddc8a53c5ee1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:38.283400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe717dd3-2202-4d99-b9ab-ddc8a53c5ee1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:38.283872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe717dd3-2202-4d99-b9ab-ddc8a53c5ee1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:38.477390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:38.493831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:38.502891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:38.504412 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c5e1fd31-a41e-466e-a54c-bcff037d83da tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2951 microversion: 2.32 time: 3.620679 Jul 26 20:02:38.509628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fe717dd3-2202-4d99-b9ab-ddc8a53c5ee1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:38.521380 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1932/3879] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:34 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2951 bytes in 3638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:38.524814 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe717dd3-2202-4d99-b9ab-ddc8a53c5ee1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1281 microversion: 2.1 time: 0.283806 Jul 26 20:02:38.526471 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1948/3880] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:38 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1281 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:38.536493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:38.538114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:38.544042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7330250b-705a-4431-91fb-b98f1e23c170 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:38.547153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7330250b-705a-4431-91fb-b98f1e23c170 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:38.553126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:38.556005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:38.557021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:38.557616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:38.568856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7330250b-705a-4431-91fb-b98f1e23c170 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:38.575951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7330250b-705a-4431-91fb-b98f1e23c170 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:38.577087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7330250b-705a-4431-91fb-b98f1e23c170 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:38.577689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7330250b-705a-4431-91fb-b98f1e23c170 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:38.645290 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7330250b-705a-4431-91fb-b98f1e23c170 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116808 Jul 26 20:02:38.646678 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1949/3881] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:02:38 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:38.651467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61b48207-c235-4f82-bb97-4a1e92dfa4fe tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:38.660579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61b48207-c235-4f82-bb97-4a1e92dfa4fe tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:38.667641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61b48207-c235-4f82-bb97-4a1e92dfa4fe tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:38.675366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61b48207-c235-4f82-bb97-4a1e92dfa4fe tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:38.677105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61b48207-c235-4f82-bb97-4a1e92dfa4fe tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:38.677808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61b48207-c235-4f82-bb97-4a1e92dfa4fe tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:38.955571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:38.966229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:38.978286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:38.979196 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03db4c8c-e7d6-4da6-8b63-ad38c1a7f544 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1338 microversion: 2.20 time: 0.456386 Jul 26 20:02:39.009020 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1933/3882] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:38 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1338 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:39.014545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2021c7ca-ae7f-467f-9e63-f7abe593d4b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:39.037997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2021c7ca-ae7f-467f-9e63-f7abe593d4b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:39.097325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2021c7ca-ae7f-467f-9e63-f7abe593d4b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:39.097926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2021c7ca-ae7f-467f-9e63-f7abe593d4b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:39.114174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2021c7ca-ae7f-467f-9e63-f7abe593d4b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:39.114875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2021c7ca-ae7f-467f-9e63-f7abe593d4b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:39.792273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2021c7ca-ae7f-467f-9e63-f7abe593d4b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:39.801295 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2021c7ca-ae7f-467f-9e63-f7abe593d4b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1265 microversion: 2.1 time: 0.790473 Jul 26 20:02:39.806186 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1934/3883] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:39 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1265 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:39.820727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:39.826990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:39.852325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:39.853006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:39.855910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:39.856767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:40.230132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61b48207-c235-4f82-bb97-4a1e92dfa4fe tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:40.248487 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61b48207-c235-4f82-bb97-4a1e92dfa4fe tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1700 microversion: 2.1 time: 1.600121 Jul 26 20:02:40.264714 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1950/3884] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:38 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1700 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:40.272067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-033abd49-4429-40ba-b463-d9986351daa5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:40.273301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-033abd49-4429-40ba-b463-d9986351daa5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:40.348853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-033abd49-4429-40ba-b463-d9986351daa5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:40.351180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-033abd49-4429-40ba-b463-d9986351daa5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:40.352124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-033abd49-4429-40ba-b463-d9986351daa5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:40.352575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-033abd49-4429-40ba-b463-d9986351daa5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.362285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-033abd49-4429-40ba-b463-d9986351daa5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:41.371603 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-033abd49-4429-40ba-b463-d9986351daa5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 1.105293 Jul 26 20:02:41.383850 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1951/3885] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:40 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:41.383850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-50f98251-c4e1-4cd2-b5e7-04ea15614ca6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:41.410094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-50f98251-c4e1-4cd2-b5e7-04ea15614ca6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:41.430529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50f98251-c4e1-4cd2-b5e7-04ea15614ca6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.430720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:41.431225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50f98251-c4e1-4cd2-b5e7-04ea15614ca6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.431774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50f98251-c4e1-4cd2-b5e7-04ea15614ca6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.438575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50f98251-c4e1-4cd2-b5e7-04ea15614ca6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.459782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:41.469230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:41.471143 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ddc1da9c-c132-4cd1-8791-65f71828a196 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2951 microversion: 2.32 time: 1.662975 Jul 26 20:02:41.471930 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1935/3886] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:39 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2951 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:41.511111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:41.512625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:41.536538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.538129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.542775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.544433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.547182 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-50f98251-c4e1-4cd2-b5e7-04ea15614ca6 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171848 Jul 26 20:02:41.548367 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1952/3887] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:02:41 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:41.554009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "bf0697cb-e330-45a1-909c-22998a643533"}, {"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "6ad30944-b73a-4ace-827b-888b0b01a8ea"}, {"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "416b5295-1a24-4ec5-b91d-06450d8eb3c8"}, {"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "4a2560ce-2348-4752-8688-b4bcf611e22a"}, {"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "60776fda-42ee-4ff6-9939-bd5eb8e38a33"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:41.565061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.565750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.579024 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] Creating event network-vif-unplugged:bf0697cb-e330-45a1-909c-22998a643533 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:41.579810 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] Creating event network-vif-unplugged:6ad30944-b73a-4ace-827b-888b0b01a8ea for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:41.580542 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] Creating event network-vif-unplugged:416b5295-1a24-4ec5-b91d-06450d8eb3c8 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:41.581205 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] Creating event network-vif-unplugged:4a2560ce-2348-4752-8688-b4bcf611e22a for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:41.581874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] Creating event network-vif-unplugged:60776fda-42ee-4ff6-9939-bd5eb8e38a33 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:41.590841 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-13341ad9-e915-4cec-9875-9cfae634983c req-e326cbd8-c966-4ace-b7d1-3d5378796954 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.040710 Jul 26 20:02:41.592116 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1953/3888] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:41.599859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b237ce4c-9776-4cba-8bf9-ec49e7ed5863 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:41.600771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b237ce4c-9776-4cba-8bf9-ec49e7ed5863 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:41.608218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b237ce4c-9776-4cba-8bf9-ec49e7ed5863 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.608843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b237ce4c-9776-4cba-8bf9-ec49e7ed5863 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.609940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b237ce4c-9776-4cba-8bf9-ec49e7ed5863 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.610657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b237ce4c-9776-4cba-8bf9-ec49e7ed5863 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.800273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b237ce4c-9776-4cba-8bf9-ec49e7ed5863 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:41.813058 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b237ce4c-9776-4cba-8bf9-ec49e7ed5863 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1265 microversion: 2.1 time: 0.219483 Jul 26 20:02:41.814547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1954/3889] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:41 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:41.831646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c20d5aa2-4098-4508-8837-58ef281b11a6 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:41.832885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c20d5aa2-4098-4508-8837-58ef281b11a6 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:41.847205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c20d5aa2-4098-4508-8837-58ef281b11a6 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.848073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c20d5aa2-4098-4508-8837-58ef281b11a6 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:41.851588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c20d5aa2-4098-4508-8837-58ef281b11a6 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:41.852248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c20d5aa2-4098-4508-8837-58ef281b11a6 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:42.257448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c20d5aa2-4098-4508-8837-58ef281b11a6 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:42.266631 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c20d5aa2-4098-4508-8837-58ef281b11a6 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1632 microversion: 2.1 time: 0.447838 Jul 26 20:02:42.269582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1955/3890] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:41 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1632 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:42.399719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-642717c2-3906-4e62-b074-91be776b1b4b tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:42.401099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-642717c2-3906-4e62-b074-91be776b1b4b tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:42.419804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-642717c2-3906-4e62-b074-91be776b1b4b tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:42.424661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-642717c2-3906-4e62-b074-91be776b1b4b tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:42.425780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-642717c2-3906-4e62-b074-91be776b1b4b tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:42.428289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-642717c2-3906-4e62-b074-91be776b1b4b tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:43.454099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:43.473062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:43.477117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:43.479515 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c638a88-7a9b-43ac-af93-57d2793791e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 1.991227 Jul 26 20:02:43.481253 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1936/3891] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:41 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:43.486196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:43.487243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:43.501311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:43.502035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:43.502991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:43.506726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:43.578880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-642717c2-3906-4e62-b074-91be776b1b4b tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:43.592346 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-642717c2-3906-4e62-b074-91be776b1b4b tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 1.197690 Jul 26 20:02:43.593310 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1956/3892] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:42 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:43.598199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ea8eebe-77f2-4be0-b43e-50cbb534edf1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:43.601247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ea8eebe-77f2-4be0-b43e-50cbb534edf1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:43.632176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea8eebe-77f2-4be0-b43e-50cbb534edf1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:43.632667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea8eebe-77f2-4be0-b43e-50cbb534edf1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:43.633523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea8eebe-77f2-4be0-b43e-50cbb534edf1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:43.634288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea8eebe-77f2-4be0-b43e-50cbb534edf1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:44.242530 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ea8eebe-77f2-4be0-b43e-50cbb534edf1 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.647981 Jul 26 20:02:44.249091 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1957/3893] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:02:43 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f/os-volume_attachments => generated 25 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:02:44.254286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a7f48cf5-1819-40fb-881e-973120045702 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:44.255327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a7f48cf5-1819-40fb-881e-973120045702 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:44.262146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7f48cf5-1819-40fb-881e-973120045702 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:44.262767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7f48cf5-1819-40fb-881e-973120045702 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:44.263691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7f48cf5-1819-40fb-881e-973120045702 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:44.264377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7f48cf5-1819-40fb-881e-973120045702 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:44.451916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:44.553399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:44.596008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:44.616602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:44.621022 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c24e3a73-b040-472c-9f57-d75313eee91a tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2930 microversion: 2.32 time: 1.138538 Jul 26 20:02:44.628807 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1937/3894] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:43 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2930 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:44.671039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-cb3291c8-37a8-4ee3-9364-777f5207bf29 req-932432d9-12db-4f7a-aea3-4103c15f744f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a", "name": "network-vif-deleted", "tag": "e208acc1-d66c-4acc-81b0-0771a8806062"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:44.713361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cb3291c8-37a8-4ee3-9364-777f5207bf29 req-932432d9-12db-4f7a-aea3-4103c15f744f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:44.719878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cb3291c8-37a8-4ee3-9364-777f5207bf29 req-932432d9-12db-4f7a-aea3-4103c15f744f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:44.739406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:44.749769 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-cb3291c8-37a8-4ee3-9364-777f5207bf29 req-932432d9-12db-4f7a-aea3-4103c15f744f service nova] Creating event network-vif-deleted:e208acc1-d66c-4acc-81b0-0771a8806062 for instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a on n-h1-708768-8 Jul 26 20:02:44.772453 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-cb3291c8-37a8-4ee3-9364-777f5207bf29 req-932432d9-12db-4f7a-aea3-4103c15f744f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113855 Jul 26 20:02:44.774124 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1938/3895] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:44.779536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85150854-8c1c-4d88-a55a-a1a8890b3824 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:44.780764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-85150854-8c1c-4d88-a55a-a1a8890b3824 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:44.811356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85150854-8c1c-4d88-a55a-a1a8890b3824 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:44.812189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85150854-8c1c-4d88-a55a-a1a8890b3824 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:44.813432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85150854-8c1c-4d88-a55a-a1a8890b3824 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:44.814051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85150854-8c1c-4d88-a55a-a1a8890b3824 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:44.872296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=14 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:44.925254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=12 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:44.977825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a7f48cf5-1819-40fb-881e-973120045702 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:44.986814 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a7f48cf5-1819-40fb-881e-973120045702 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.736485 Jul 26 20:02:44.994923 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1958/3896] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:44 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:45.006459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-40fc95c8-27b4-4c1f-b3c4-d93882807868 req-69878143-5071-434e-935b-65803a39e1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "e395b810-ac28-4698-a37b-dcec92a493f6"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:45.064294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-40fc95c8-27b4-4c1f-b3c4-d93882807868 req-69878143-5071-434e-935b-65803a39e1e3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:45.069389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-40fc95c8-27b4-4c1f-b3c4-d93882807868 req-69878143-5071-434e-935b-65803a39e1e3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:45.113132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-85150854-8c1c-4d88-a55a-a1a8890b3824 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af334bdeafde443286eab25df33b58a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d7777de15c469a9ac15b3a91615a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:45.120120 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-40fc95c8-27b4-4c1f-b3c4-d93882807868 req-69878143-5071-434e-935b-65803a39e1e3 service nova] Creating event network-vif-unplugged:e395b810-ac28-4698-a37b-dcec92a493f6 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:45.131409 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85150854-8c1c-4d88-a55a-a1a8890b3824 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 200 len: 1632 microversion: 2.1 time: 0.355522 Jul 26 20:02:45.148139 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-40fc95c8-27b4-4c1f-b3c4-d93882807868 req-69878143-5071-434e-935b-65803a39e1e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148418 Jul 26 20:02:45.163641 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1939/3897] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:44 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 1632 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:45.163641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aef8e596-462a-4733-a2c7-a01d06b4bd6f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:45.176039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aef8e596-462a-4733-a2c7-a01d06b4bd6f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:45.180739 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1959/3898] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:45.182283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aef8e596-462a-4733-a2c7-a01d06b4bd6f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:45.189334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aef8e596-462a-4733-a2c7-a01d06b4bd6f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:45.190349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aef8e596-462a-4733-a2c7-a01d06b4bd6f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:45.190900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aef8e596-462a-4733-a2c7-a01d06b4bd6f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:45.202659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:45.206573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:45.234041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:45.239864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:45.244439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:45.251929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:45.261890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aef8e596-462a-4733-a2c7-a01d06b4bd6f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:02:45.463422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=13,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:45.497441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aef8e596-462a-4733-a2c7-a01d06b4bd6f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 204 len: 0 microversion: 2.1 time: 0.344154 Jul 26 20:02:45.498039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1940/3899] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:02:45 2022] DELETE /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:02:45.523307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dbf6fab-e650-4a45-8e5a-9c29456657f6 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:45.527407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1dbf6fab-e650-4a45-8e5a-9c29456657f6 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:45.537665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dbf6fab-e650-4a45-8e5a-9c29456657f6 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:45.538455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dbf6fab-e650-4a45-8e5a-9c29456657f6 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:45.540138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dbf6fab-e650-4a45-8e5a-9c29456657f6 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:45.540788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dbf6fab-e650-4a45-8e5a-9c29456657f6 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:45.549432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:46.430082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1dbf6fab-e650-4a45-8e5a-9c29456657f6 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:46.445636 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1dbf6fab-e650-4a45-8e5a-9c29456657f6 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 0.943918 Jul 26 20:02:46.446242 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1941/3900] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:45 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:46.477267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-77493932-aac3-4857-9fbf-2768f315f995 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:46.478808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-77493932-aac3-4857-9fbf-2768f315f995 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:46.487373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77493932-aac3-4857-9fbf-2768f315f995 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:46.488203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77493932-aac3-4857-9fbf-2768f315f995 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:46.489460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77493932-aac3-4857-9fbf-2768f315f995 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:46.490362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77493932-aac3-4857-9fbf-2768f315f995 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:47.190611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:47.224948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:47.226582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:47.227794 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-439f85ce-aabf-44e8-b06a-91db493f8122 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 2.045535 Jul 26 20:02:47.228357 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1960/3901] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:45 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:47.259139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:47.276493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:47.282664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:47.287375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:47.288195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:47.289299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:47.289960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:47.471630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-77493932-aac3-4857-9fbf-2768f315f995 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:47.482063 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-77493932-aac3-4857-9fbf-2768f315f995 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1679 microversion: 2.1 time: 1.033366 Jul 26 20:02:47.486046 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1942/3902] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:46 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1679 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:47.512451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-204c27c0-aa2b-41c6-b7f1-bc1d8590b947 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:47.513907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-204c27c0-aa2b-41c6-b7f1-bc1d8590b947 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:47.525688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-204c27c0-aa2b-41c6-b7f1-bc1d8590b947 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:47.525798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-204c27c0-aa2b-41c6-b7f1-bc1d8590b947 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:47.526568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-204c27c0-aa2b-41c6-b7f1-bc1d8590b947 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:47.527003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-204c27c0-aa2b-41c6-b7f1-bc1d8590b947 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.116160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-204c27c0-aa2b-41c6-b7f1-bc1d8590b947 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:48.150934 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-204c27c0-aa2b-41c6-b7f1-bc1d8590b947 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.661922 Jul 26 20:02:48.156178 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1943/3903] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:47 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:48.164045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:48.165214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] [instance: c27aa1dd-25d2-408d-a41b-d6fe723c880b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:48.173549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.174349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.175351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.176154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.210779 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] HTTP exception thrown: Instance c27aa1dd-25d2-408d-a41b-d6fe723c880b could not be found. Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Request method failure captured: Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b HTTP/1.1 Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgcntOqbyPZqZXSeieim8eSx0YTI1_WhqWRQ3iPnUuSEJ3ghxSuCcJ6C2gjikQxSMrtixljn4DQNJI6Ra-GSjs5dljaOcG-8jw-SwQH_S-18fyP_51m6VwnZRHEIFxxjcQjqp73QSy4kcILDrUjGn8k0Ij_UHOYUyFEvMb4PNi0ewY Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 51d7777de15c469a9ac15b3a91615a0f Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-584015223 Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/51d7777de15c469a9ac15b3a91615a0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/51d7777de15c469a9ac15b3a91615a0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_51d7777de15c469a9ac15b3a91615a0f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/51d7777de15c469a9ac15b3a91615a0f"}]}] Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-584015223 Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 51d7777de15c469a9ac15b3a91615a0f Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-584015223 Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-584015223-project Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: af334bdeafde443286eab25df33b58a0 Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-584015223-project Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance c27aa1dd-25d2-408d-a41b-d6fe723c880b could not be found. Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c27aa1dd-25d2-408d-a41b-d6fe723c880b'} Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c27aa1dd-25d2-408d-a41b-d6fe723c880b could not be found. Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c27aa1dd-25d2-408d-a41b-d6fe723c880b could not be found. Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:48.214192 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:48.218607 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:02:48.218607 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:02:48.218607 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:02:48.218607 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:02:48.218607 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c27aa1dd-25d2-408d-a41b-d6fe723c880b could not be found. Jul 26 20:02:48.218607 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:48.219185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Returning 404 to user: Instance c27aa1dd-25d2-408d-a41b-d6fe723c880b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:02:48.221146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a12d2699-2612-483f-9b76-d9e6e9c29107 tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b" status: 404 len: 111 microversion: 2.1 time: 0.063527 Jul 26 20:02:48.222348 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1944/3904] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:48 2022] GET /compute/v2.1/servers/c27aa1dd-25d2-408d-a41b-d6fe723c880b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:02:48.227518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d0517520-3c46-4603-aaed-68e1cb586113 req-8a6126a9-16ab-455a-a948-a615a7974f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd4c910-5089-44d9-a86d-f1043919d579", "tag": "465d4a94-d415-4c98-9e02-a1a7ceb982d2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:48.241306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d0517520-3c46-4603-aaed-68e1cb586113 req-8a6126a9-16ab-455a-a948-a615a7974f20 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.242182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d0517520-3c46-4603-aaed-68e1cb586113 req-8a6126a9-16ab-455a-a948-a615a7974f20 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.259980 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d0517520-3c46-4603-aaed-68e1cb586113 req-8a6126a9-16ab-455a-a948-a615a7974f20 service nova] Creating event network-changed:465d4a94-d415-4c98-9e02-a1a7ceb982d2 for instance 5cd4c910-5089-44d9-a86d-f1043919d579 on n-h2-708768-8 Jul 26 20:02:48.267956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d0517520-3c46-4603-aaed-68e1cb586113 req-8a6126a9-16ab-455a-a948-a615a7974f20 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043603 Jul 26 20:02:48.269416 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1945/3905] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:48.277956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-535ae9bb-0803-4886-93a9-725a98eef6e0 req-35c21577-a482-486a-8dfa-266df7499a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27aa1dd-25d2-408d-a41b-d6fe723c880b", "name": "network-vif-deleted", "tag": "619b7ef1-59e5-47a5-8358-e425c54aed21"}, {"name": "network-changed", "server_uuid": "8fd2515f-1836-4131-a11e-2c37104643dc", "tag": "022e268e-ef4f-4179-a386-1d449034fa02"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:48.292533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-535ae9bb-0803-4886-93a9-725a98eef6e0 req-35c21577-a482-486a-8dfa-266df7499a35 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.293319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-535ae9bb-0803-4886-93a9-725a98eef6e0 req-35c21577-a482-486a-8dfa-266df7499a35 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.309932 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-535ae9bb-0803-4886-93a9-725a98eef6e0 req-35c21577-a482-486a-8dfa-266df7499a35 service nova] Creating event network-vif-deleted:619b7ef1-59e5-47a5-8358-e425c54aed21 for instance c27aa1dd-25d2-408d-a41b-d6fe723c880b on n-h2-708768-8 Jul 26 20:02:48.311999 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-535ae9bb-0803-4886-93a9-725a98eef6e0 req-35c21577-a482-486a-8dfa-266df7499a35 service nova] Creating event network-changed:022e268e-ef4f-4179-a386-1d449034fa02 for instance 8fd2515f-1836-4131-a11e-2c37104643dc on n-h1-708768-8 Jul 26 20:02:48.333626 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-535ae9bb-0803-4886-93a9-725a98eef6e0 req-35c21577-a482-486a-8dfa-266df7499a35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061263 Jul 26 20:02:48.335132 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1946/3906] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:48.342849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee0042b9-17f6-4963-bfea-a7a7c7f73276 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:48.343911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ee0042b9-17f6-4963-bfea-a7a7c7f73276 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:48.358309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee0042b9-17f6-4963-bfea-a7a7c7f73276 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.359197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee0042b9-17f6-4963-bfea-a7a7c7f73276 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.360407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee0042b9-17f6-4963-bfea-a7a7c7f73276 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.361059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee0042b9-17f6-4963-bfea-a7a7c7f73276 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.570214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:48.589056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:48.590599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:48.605491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82e62c7b-c4e3-445a-b64d-adf1cda35610 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2930 microversion: 2.32 time: 1.344454 Jul 26 20:02:48.606491 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1961/3907] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:47 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2930 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:48.621394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-71bfc43e-dd56-4991-9f81-88a9586e5eed tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] Calling method '.version_select at 0x7f8756495670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:48.680918 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-71bfc43e-dd56-4991-9f81-88a9586e5eed tempest-ServersTestJSON-584015223 tempest-ServersTestJSON-584015223-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722470880" status: 202 len: 0 microversion: 2.1 time: 0.072478 Jul 26 20:02:48.681517 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1962/3908] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 20:02:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722470880 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:02:48.693282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:48.700891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:48.717352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.718044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.719049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.729626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.734724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:48.857200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee0042b9-17f6-4963-bfea-a7a7c7f73276 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:48.872526 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ee0042b9-17f6-4963-bfea-a7a7c7f73276 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 0.535920 Jul 26 20:02:48.891507 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1947/3909] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:48 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:48.925333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f10523a3-d9b0-4575-adff-b5b5fb24ef5c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:48.930735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f10523a3-d9b0-4575-adff-b5b5fb24ef5c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:48.943290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f10523a3-d9b0-4575-adff-b5b5fb24ef5c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.943773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f10523a3-d9b0-4575-adff-b5b5fb24ef5c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:48.944564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f10523a3-d9b0-4575-adff-b5b5fb24ef5c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:48.945002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f10523a3-d9b0-4575-adff-b5b5fb24ef5c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:49.464183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:49.515597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:49.523848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:49.528906 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-62dbb04a-9a16-4c0c-9b61-29418fde81b1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 0.840035 Jul 26 20:02:49.530087 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1963/3910] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:48 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:49.539520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed9ae0c4-5060-455d-a0c5-7f7ff8d8f42a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:49.540167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed9ae0c4-5060-455d-a0c5-7f7ff8d8f42a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:49.547891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed9ae0c4-5060-455d-a0c5-7f7ff8d8f42a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:49.548804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed9ae0c4-5060-455d-a0c5-7f7ff8d8f42a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:49.549797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed9ae0c4-5060-455d-a0c5-7f7ff8d8f42a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:49.550433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed9ae0c4-5060-455d-a0c5-7f7ff8d8f42a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:50.027857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f10523a3-d9b0-4575-adff-b5b5fb24ef5c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:50.048968 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f10523a3-d9b0-4575-adff-b5b5fb24ef5c tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1679 microversion: 2.1 time: 1.156226 Jul 26 20:02:50.050238 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1948/3911] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:48 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1679 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:50.063776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:50.065003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:50.078390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:50.086912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:50.090524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:50.095289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:50.943115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:50.965002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:50.968716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:50.972558 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f075ec1b-a6ed-4e34-99c9-f45ba42c484d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2909 microversion: 2.32 time: 0.920744 Jul 26 20:02:50.976275 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1949/3912] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:50 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2909 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:50.984068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d8d74fb-617b-4a20-99a6-e499a4d60379 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:50.985404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8d8d74fb-617b-4a20-99a6-e499a4d60379 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:51.001309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d8d74fb-617b-4a20-99a6-e499a4d60379 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:51.015263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d8d74fb-617b-4a20-99a6-e499a4d60379 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:51.017970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d8d74fb-617b-4a20-99a6-e499a4d60379 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:51.021505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d8d74fb-617b-4a20-99a6-e499a4d60379 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:51.401837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ed9ae0c4-5060-455d-a0c5-7f7ff8d8f42a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:51.428479 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed9ae0c4-5060-455d-a0c5-7f7ff8d8f42a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 1.897045 Jul 26 20:02:51.430299 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1964/3913] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:49 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:51.444816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b07e2d25-87c0-4398-8bda-f2c1edf9703a req-4d32df84-ef2f-435c-b192-60585fbf719e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f87df55d-ecd6-431b-8f7b-95ef5e1132eb", "tag": "5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:51.485501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b07e2d25-87c0-4398-8bda-f2c1edf9703a req-4d32df84-ef2f-435c-b192-60585fbf719e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:51.485952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b07e2d25-87c0-4398-8bda-f2c1edf9703a req-4d32df84-ef2f-435c-b192-60585fbf719e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:51.531032 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b07e2d25-87c0-4398-8bda-f2c1edf9703a req-4d32df84-ef2f-435c-b192-60585fbf719e service nova] Creating event network-changed:5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad for instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb on n-h1-708768-8 Jul 26 20:02:51.568186 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b07e2d25-87c0-4398-8bda-f2c1edf9703a req-4d32df84-ef2f-435c-b192-60585fbf719e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135009 Jul 26 20:02:51.570227 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1965/3914] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:51.575602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:51.576338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:51.590271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:51.590900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:51.592085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:51.592669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:52.074227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8d8d74fb-617b-4a20-99a6-e499a4d60379 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:52.085793 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d8d74fb-617b-4a20-99a6-e499a4d60379 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 1.107693 Jul 26 20:02:52.088117 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1950/3915] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:50 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:52.099898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-beb72d42-acf2-405a-b571-0d524ffd739d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:52.104195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-beb72d42-acf2-405a-b571-0d524ffd739d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:52.123495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-beb72d42-acf2-405a-b571-0d524ffd739d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:52.126162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-beb72d42-acf2-405a-b571-0d524ffd739d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:52.127267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-beb72d42-acf2-405a-b571-0d524ffd739d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:52.129354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-beb72d42-acf2-405a-b571-0d524ffd739d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:52.330894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-beb72d42-acf2-405a-b571-0d524ffd739d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:52.341618 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-beb72d42-acf2-405a-b571-0d524ffd739d tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1611 microversion: 2.1 time: 0.250301 Jul 26 20:02:52.347919 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1951/3916] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:52 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1611 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:52.356768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:52.359774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:52.374052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:52.374761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:52.381573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:52.382190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:53.015648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:53.027319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:53.039003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:53.046885 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a8af14aa-34fc-46f0-8e36-7adb114dfe05 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 1.475677 Jul 26 20:02:53.054395 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1966/3917] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:51 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:53.075060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ad02fbe7-415c-4385-88e6-5ad319631270 req-9bd3907b-f12e-42d0-887c-df4d59358743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-deleted", "tag": "6ad30944-b73a-4ace-827b-888b0b01a8ea"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:53.130091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ad02fbe7-415c-4385-88e6-5ad319631270 req-9bd3907b-f12e-42d0-887c-df4d59358743 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:53.133959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ad02fbe7-415c-4385-88e6-5ad319631270 req-9bd3907b-f12e-42d0-887c-df4d59358743 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:53.172444 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ad02fbe7-415c-4385-88e6-5ad319631270 req-9bd3907b-f12e-42d0-887c-df4d59358743 service nova] Creating event network-vif-deleted:6ad30944-b73a-4ace-827b-888b0b01a8ea for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:53.186542 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ad02fbe7-415c-4385-88e6-5ad319631270 req-9bd3907b-f12e-42d0-887c-df4d59358743 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129768 Jul 26 20:02:53.187182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1967/3918] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:53.198891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b89423ac-354a-4bf7-b946-f75ed8cfae1e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:53.201335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b89423ac-354a-4bf7-b946-f75ed8cfae1e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:53.219376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b89423ac-354a-4bf7-b946-f75ed8cfae1e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:53.220718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b89423ac-354a-4bf7-b946-f75ed8cfae1e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:53.224001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b89423ac-354a-4bf7-b946-f75ed8cfae1e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:53.225500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b89423ac-354a-4bf7-b946-f75ed8cfae1e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:53.751603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:53.768963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:53.775598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:53.781588 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c9337e0-a72e-4daa-a2c7-c3efb5d7b246 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2863 microversion: 2.32 time: 1.428779 Jul 26 20:02:53.783993 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1952/3919] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:52 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2863 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:53.797965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d559e3bd-7a40-4caf-86b7-2fa1dc240391 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:53.804463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d559e3bd-7a40-4caf-86b7-2fa1dc240391 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:53.845396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d559e3bd-7a40-4caf-86b7-2fa1dc240391 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:53.845851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d559e3bd-7a40-4caf-86b7-2fa1dc240391 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:53.846900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d559e3bd-7a40-4caf-86b7-2fa1dc240391 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:53.847064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d559e3bd-7a40-4caf-86b7-2fa1dc240391 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:54.184559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b89423ac-354a-4bf7-b946-f75ed8cfae1e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:54.200601 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b89423ac-354a-4bf7-b946-f75ed8cfae1e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 1.010100 Jul 26 20:02:54.201882 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1968/3920] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:53 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:54.214425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:54.216706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:54.234200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:54.235276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:54.236318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:54.236974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:54.314679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:54.315510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:54.318910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lazy-loading 'fault' on Instance uuid 08c9b8aa-c3eb-4a64-aed8-59f12802443f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:02:54.575429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d559e3bd-7a40-4caf-86b7-2fa1dc240391 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:54.589495 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d559e3bd-7a40-4caf-86b7-2fa1dc240391 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 0.802829 Jul 26 20:02:54.602862 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1953/3921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:53 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:54.602862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-91cb4570-37e6-4028-8bb9-26c3125371fe req-5a882992-a22d-44c7-acd4-a78c52beef16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f5ce3e-2965-4521-9c04-54f6b5b3836b", "tag": "fea01703-4f87-46fa-baa0-8d144d9b823c"}, {"name": "network-changed", "server_uuid": "1d1b6c16-d1b4-455c-b4d0-5f4828075243", "tag": "66a5eded-1218-44ac-9d6a-b19b94ed40a3"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:54.604557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889459c783694048b93438ce16b75d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a16253a71a24312a17022e4f01ed652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:54.618463 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0cbdba49-b1cf-49e0-a3e6-20bf4325f7cb tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 200 len: 1329 microversion: 2.1 time: 0.409219 Jul 26 20:02:54.619446 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1969/3922] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:54 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 1329 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:54.628132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-91cb4570-37e6-4028-8bb9-26c3125371fe req-5a882992-a22d-44c7-acd4-a78c52beef16 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:54.628615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-91cb4570-37e6-4028-8bb9-26c3125371fe req-5a882992-a22d-44c7-acd4-a78c52beef16 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:54.628910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:54.629998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:54.646148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:54.646968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:54.652686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:54.653567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:54.656892 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-91cb4570-37e6-4028-8bb9-26c3125371fe req-5a882992-a22d-44c7-acd4-a78c52beef16 service nova] Creating event network-changed:fea01703-4f87-46fa-baa0-8d144d9b823c for instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b on n-h1-708768-8 Jul 26 20:02:54.657394 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-91cb4570-37e6-4028-8bb9-26c3125371fe req-5a882992-a22d-44c7-acd4-a78c52beef16 service nova] Creating event network-changed:66a5eded-1218-44ac-9d6a-b19b94ed40a3 for instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 on n-h1-708768-8 Jul 26 20:02:54.674674 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-91cb4570-37e6-4028-8bb9-26c3125371fe req-5a882992-a22d-44c7-acd4-a78c52beef16 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082499 Jul 26 20:02:54.681102 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1954/3923] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:54.815430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:54.817841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:54.831811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:54.837863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:54.842463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:54.845667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:55.511152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:55.529187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:55.530766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:55.540538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:55.551871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26982fbc-d341-46f1-8295-e733340ae25c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2704 microversion: 2.32 time: 0.739841 Jul 26 20:02:55.553184 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1955/3924] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:54 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2704 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:02:55.566110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-12e696c0-d143-4ebb-b012-8315af99db41 req-d3f7ae32-28f8-4187-a2f2-3327f7192c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4c910-5089-44d9-a86d-f1043919d579", "name": "network-vif-plugged", "status": "completed", "tag": "465d4a94-d415-4c98-9e02-a1a7ceb982d2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:55.575656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:55.581441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:55.583551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-12e696c0-d143-4ebb-b012-8315af99db41 req-d3f7ae32-28f8-4187-a2f2-3327f7192c07 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:55.584685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-12e696c0-d143-4ebb-b012-8315af99db41 req-d3f7ae32-28f8-4187-a2f2-3327f7192c07 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:55.585492 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff336204-df57-40f4-9b5e-5be45cc08b59 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 0.964739 Jul 26 20:02:55.588023 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1970/3925] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:54 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:55.595053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89c9cf8c-aa4d-4e7b-9da1-f5ea3ce32872 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:55.602540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89c9cf8c-aa4d-4e7b-9da1-f5ea3ce32872 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:55.615937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c9cf8c-aa4d-4e7b-9da1-f5ea3ce32872 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:55.616859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c9cf8c-aa4d-4e7b-9da1-f5ea3ce32872 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:55.621252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c9cf8c-aa4d-4e7b-9da1-f5ea3ce32872 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:55.621976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89c9cf8c-aa4d-4e7b-9da1-f5ea3ce32872 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:55.642492 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-12e696c0-d143-4ebb-b012-8315af99db41 req-d3f7ae32-28f8-4187-a2f2-3327f7192c07 service nova] Creating event network-vif-plugged:465d4a94-d415-4c98-9e02-a1a7ceb982d2 for instance 5cd4c910-5089-44d9-a86d-f1043919d579 on n-h2-708768-8 Jul 26 20:02:55.659691 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-12e696c0-d143-4ebb-b012-8315af99db41 req-d3f7ae32-28f8-4187-a2f2-3327f7192c07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102515 Jul 26 20:02:55.660459 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1956/3926] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:55.679875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-63a670ae-53df-48a9-9017-82daa6bdc5b5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:55.681052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-63a670ae-53df-48a9-9017-82daa6bdc5b5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:55.692332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-63a670ae-53df-48a9-9017-82daa6bdc5b5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:55.695797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-63a670ae-53df-48a9-9017-82daa6bdc5b5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:55.696921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-63a670ae-53df-48a9-9017-82daa6bdc5b5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:55.699324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-63a670ae-53df-48a9-9017-82daa6bdc5b5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:56.040951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-63a670ae-53df-48a9-9017-82daa6bdc5b5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:56.051758 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-63a670ae-53df-48a9-9017-82daa6bdc5b5 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 0.388428 Jul 26 20:02:56.065033 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1957/3927] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:55 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:56.073350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:56.074148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:56.081246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:56.081875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:56.083393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:56.084018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:56.101051 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f HTTP/1.1 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '08c9b8aa-c3eb-4a64-aed8-59f12802443f'} Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:02:56.102988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:56.107237 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:02:56.107237 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:02:56.107237 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:02:56.107237 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:02:56.107237 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:02:56.107237 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:02:56.107237 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:02:56.108405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:02:56.113387 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb55f6b4-3755-4d10-88e6-2046e6ed9480 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 404 len: 111 microversion: 2.1 time: 0.045036 Jul 26 20:02:56.117721 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1958/3928] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:56 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:02:56.133056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-aefb5bab-21f0-46c0-8ab4-5e85898240cb req-1c7f1edc-74f6-41ec-8c86-b22c60257a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c9b8aa-c3eb-4a64-aed8-59f12802443f", "name": "network-vif-deleted", "tag": "bd198809-bf20-433c-b369-1d8bfd37b9b6"}, {"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-deleted", "tag": "416b5295-1a24-4ec5-b91d-06450d8eb3c8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:56.163735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aefb5bab-21f0-46c0-8ab4-5e85898240cb req-1c7f1edc-74f6-41ec-8c86-b22c60257a03 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:56.165950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aefb5bab-21f0-46c0-8ab4-5e85898240cb req-1c7f1edc-74f6-41ec-8c86-b22c60257a03 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:56.179165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-89c9cf8c-aa4d-4e7b-9da1-f5ea3ce32872 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:56.187854 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89c9cf8c-aa4d-4e7b-9da1-f5ea3ce32872 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.598514 Jul 26 20:02:56.196960 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aefb5bab-21f0-46c0-8ab4-5e85898240cb req-1c7f1edc-74f6-41ec-8c86-b22c60257a03 service nova] Creating event network-vif-deleted:bd198809-bf20-433c-b369-1d8bfd37b9b6 for instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f on n-h2-708768-8 Jul 26 20:02:56.200212 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aefb5bab-21f0-46c0-8ab4-5e85898240cb req-1c7f1edc-74f6-41ec-8c86-b22c60257a03 service nova] Creating event network-vif-deleted:416b5295-1a24-4ec5-b91d-06450d8eb3c8 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:56.211975 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1971/3929] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:55 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:56.227491 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-aefb5bab-21f0-46c0-8ab4-5e85898240cb req-1c7f1edc-74f6-41ec-8c86-b22c60257a03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.112035 Jul 26 20:02:56.228616 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1959/3930] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:56.229886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5c406e32-5b27-4af0-8cbd-36e74398e355 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '.version_select at 0x7f875651bc10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:56.269399 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5c406e32-5b27-4af0-8cbd-36e74398e355 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-606940378" status: 202 len: 0 microversion: 2.1 time: 0.056078 Jul 26 20:02:56.270923 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1972/3931] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 20:02:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-606940378 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:02:56.581136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:56.582082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:56.595805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:56.600372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:56.602011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:56.603478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:56.614933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:56.615395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:56.661275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:56.662233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:56.664402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:56.667134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:57.152908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:57.185538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:57.189091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:57.195194 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc94b66d-fddd-446b-8a24-0f09bc9dba6c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 0.583818 Jul 26 20:02:57.196140 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1973/3932] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:56 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:57.213613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-879fde31-35a7-4f04-ad13-3ecee5b0dacb tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:57.215164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-879fde31-35a7-4f04-ad13-3ecee5b0dacb tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:57.240769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-879fde31-35a7-4f04-ad13-3ecee5b0dacb tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:57.243982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-879fde31-35a7-4f04-ad13-3ecee5b0dacb tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:57.247053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-879fde31-35a7-4f04-ad13-3ecee5b0dacb tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:57.250140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-879fde31-35a7-4f04-ad13-3ecee5b0dacb tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:57.719539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-879fde31-35a7-4f04-ad13-3ecee5b0dacb tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:57.734062 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-879fde31-35a7-4f04-ad13-3ecee5b0dacb tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 0.528541 Jul 26 20:02:57.734769 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1974/3933] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:57 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:57.755510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87c07b94-47be-41f5-b330-e336ec4e94ca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:57.758769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-87c07b94-47be-41f5-b330-e336ec4e94ca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:57.780041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87c07b94-47be-41f5-b330-e336ec4e94ca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:57.780491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87c07b94-47be-41f5-b330-e336ec4e94ca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:57.781281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87c07b94-47be-41f5-b330-e336ec4e94ca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:57.781718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87c07b94-47be-41f5-b330-e336ec4e94ca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:57.899994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:57.909789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:57.912265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:57.913682 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-04c844c0-6d56-4268-a883-08ad9012a3b8 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2590 microversion: 2.32 time: 1.339625 Jul 26 20:02:57.914400 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1960/3934] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:56 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2590 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:57.919520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a7a40f03-c529-4af2-89ff-1e0f68553386 req-f0ffc35d-06fd-493e-ac03-bd0f2b37391d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd2515f-1836-4131-a11e-2c37104643dc", "name": "network-vif-plugged", "status": "completed", "tag": "022e268e-ef4f-4179-a386-1d449034fa02"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:57.930208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a7a40f03-c529-4af2-89ff-1e0f68553386 req-f0ffc35d-06fd-493e-ac03-bd0f2b37391d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:57.930908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a7a40f03-c529-4af2-89ff-1e0f68553386 req-f0ffc35d-06fd-493e-ac03-bd0f2b37391d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:57.942587 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a7a40f03-c529-4af2-89ff-1e0f68553386 req-f0ffc35d-06fd-493e-ac03-bd0f2b37391d service nova] Creating event network-vif-plugged:022e268e-ef4f-4179-a386-1d449034fa02 for instance 8fd2515f-1836-4131-a11e-2c37104643dc on n-h1-708768-8 Jul 26 20:02:57.947472 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a7a40f03-c529-4af2-89ff-1e0f68553386 req-f0ffc35d-06fd-493e-ac03-bd0f2b37391d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Jul 26 20:02:57.948619 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1961/3935] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:58.027179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-87c07b94-47be-41f5-b330-e336ec4e94ca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:58.042327 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-87c07b94-47be-41f5-b330-e336ec4e94ca tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.297385 Jul 26 20:02:58.046025 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1975/3936] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:57 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:58.222631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:58.224312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:58.233954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:58.234396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:58.235175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:58.235656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:58.754873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7c34b9e1-d558-497f-9ef3-08da436e1986 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:58.755820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7c34b9e1-d558-497f-9ef3-08da436e1986 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:58.769769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c34b9e1-d558-497f-9ef3-08da436e1986 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:58.770509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c34b9e1-d558-497f-9ef3-08da436e1986 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:58.779190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c34b9e1-d558-497f-9ef3-08da436e1986 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:58.779995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c34b9e1-d558-497f-9ef3-08da436e1986 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:59.056851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:59.070485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:59.072641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:59.077014 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-346218aa-ab49-4704-afab-6ed515b33adb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 0.858646 Jul 26 20:02:59.078542 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1962/3937] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:58 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:59.096786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:59.096998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:59.117524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:59.123694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:59.126491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:59.126954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:59.134643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7c34b9e1-d558-497f-9ef3-08da436e1986 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:59.146910 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7c34b9e1-d558-497f-9ef3-08da436e1986 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1323 microversion: 2.1 time: 0.393008 Jul 26 20:02:59.147807 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1976/3938] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:58 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:02:59.153248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e472bd76-6ffc-462e-973d-54450686c0da tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:02:59.154185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e472bd76-6ffc-462e-973d-54450686c0da tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:02:59.176381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:02:59.185232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e472bd76-6ffc-462e-973d-54450686c0da tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:59.186247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e472bd76-6ffc-462e-973d-54450686c0da tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:59.188824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e472bd76-6ffc-462e-973d-54450686c0da tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:59.190172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e472bd76-6ffc-462e-973d-54450686c0da tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:59.428449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e472bd76-6ffc-462e-973d-54450686c0da tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:59.437443 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e472bd76-6ffc-462e-973d-54450686c0da tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.288227 Jul 26 20:02:59.451462 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1977/3939] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:02:59 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:02:59.451462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-646096fa-d22e-442a-94d1-0887879b313b req-34bdb8f6-7fd4-4646-9d10-4d43f58584b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-deleted", "tag": "2fe790d2-60b2-4792-a59a-9585e6108fb0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:59.459025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-646096fa-d22e-442a-94d1-0887879b313b req-34bdb8f6-7fd4-4646-9d10-4d43f58584b3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:59.459478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-646096fa-d22e-442a-94d1-0887879b313b req-34bdb8f6-7fd4-4646-9d10-4d43f58584b3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:02:59.474911 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-646096fa-d22e-442a-94d1-0887879b313b req-34bdb8f6-7fd4-4646-9d10-4d43f58584b3 service nova] Creating event network-vif-deleted:2fe790d2-60b2-4792-a59a-9585e6108fb0 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:02:59.480723 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-646096fa-d22e-442a-94d1-0887879b313b req-34bdb8f6-7fd4-4646-9d10-4d43f58584b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041103 Jul 26 20:02:59.481394 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1978/3940] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:02:59.925271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:59.946368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:59.948322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:02:59.951803 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-374970fe-082f-4dc9-b5ad-a0dc63ca6c8e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2544 microversion: 2.32 time: 0.871525 Jul 26 20:02:59.953994 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1963/3941] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:02:59 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2544 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:02:59.979707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bb9a1c3c-c71e-43e8-b0d1-f2e7e9795b83 req-cc2716bb-21b8-496f-b20f-02bec82cbe1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f87df55d-ecd6-431b-8f7b-95ef5e1132eb", "name": "network-vif-plugged", "status": "completed", "tag": "5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:02:59.993423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bb9a1c3c-c71e-43e8-b0d1-f2e7e9795b83 req-cc2716bb-21b8-496f-b20f-02bec82cbe1f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:02:59.993876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bb9a1c3c-c71e-43e8-b0d1-f2e7e9795b83 req-cc2716bb-21b8-496f-b20f-02bec82cbe1f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:00.006703 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bb9a1c3c-c71e-43e8-b0d1-f2e7e9795b83 req-cc2716bb-21b8-496f-b20f-02bec82cbe1f service nova] Creating event network-vif-plugged:5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad for instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb on n-h1-708768-8 Jul 26 20:03:00.012656 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bb9a1c3c-c71e-43e8-b0d1-f2e7e9795b83 req-cc2716bb-21b8-496f-b20f-02bec82cbe1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038851 Jul 26 20:03:00.013638 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1979/3942] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:03:00.104269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:00.113151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:00.119968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:00.120734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:00.121776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:00.122435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:00.173578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-402d193b-922b-4d0f-b528-c01ab750616d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:00.174670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-402d193b-922b-4d0f-b528-c01ab750616d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:00.185604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-402d193b-922b-4d0f-b528-c01ab750616d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:00.190115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-402d193b-922b-4d0f-b528-c01ab750616d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:00.191291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-402d193b-922b-4d0f-b528-c01ab750616d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:00.192697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-402d193b-922b-4d0f-b528-c01ab750616d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:00.881403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:00.893070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:00.895301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:00.898523 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ab04c7c-c156-4682-8512-5154438087f6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 0.797964 Jul 26 20:03:00.903799 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1964/3943] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:00 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:03:00.914671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9744a969-8930-406c-ae67-bbc0fdb67e43 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:00.915845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9744a969-8930-406c-ae67-bbc0fdb67e43 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:00.922942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9744a969-8930-406c-ae67-bbc0fdb67e43 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:00.923712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9744a969-8930-406c-ae67-bbc0fdb67e43 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:00.924725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9744a969-8930-406c-ae67-bbc0fdb67e43 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:00.925836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9744a969-8930-406c-ae67-bbc0fdb67e43 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:01.100902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-402d193b-922b-4d0f-b528-c01ab750616d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:01.116817 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-402d193b-922b-4d0f-b528-c01ab750616d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1517 microversion: 2.1 time: 0.947393 Jul 26 20:03:01.118868 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1980/3944] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:00 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1517 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:03:01.170343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:01.171564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:01.193446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:01.197678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:01.199036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:01.199860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:01.747392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9744a969-8930-406c-ae67-bbc0fdb67e43 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:01.760078 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9744a969-8930-406c-ae67-bbc0fdb67e43 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.853657 Jul 26 20:03:01.777605 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1965/3945] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:00 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:01.788345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4af04b6-73f1-4080-8a17-7085fb8cf9c3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:01.790822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4af04b6-73f1-4080-8a17-7085fb8cf9c3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 5cd4c910-5089-44d9-a86d-f1043919d579] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:01.803106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4af04b6-73f1-4080-8a17-7085fb8cf9c3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:01.803558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4af04b6-73f1-4080-8a17-7085fb8cf9c3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:01.810421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4af04b6-73f1-4080-8a17-7085fb8cf9c3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:01.810980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4af04b6-73f1-4080-8a17-7085fb8cf9c3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:01.814278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:01.833082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:01.834914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:01.849388 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4201be59-8ba1-4ad2-9609-0162395a167c tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2387 microversion: 2.32 time: 0.686147 Jul 26 20:03:01.852349 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1981/3946] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:01 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2387 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:01.923336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:01.924270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:01.936550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:01.943558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:01.945513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:01.950461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:02.680586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:02.697697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:02.699475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:02.700654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-edcbc5c9-305c-40fb-9a6f-93b78d2fb90e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1406 microversion: 2.20 time: 0.781989 Jul 26 20:03:02.710682 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1982/3947] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:01 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1406 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:03:02.717631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0f829828-b5af-4e32-a100-074184a868b4 req-eb435809-f8b0-43e6-983f-a59ee9a159c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-deleted", "tag": "e395b810-ac28-4698-a37b-dcec92a493f6"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:02.741713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0f829828-b5af-4e32-a100-074184a868b4 req-eb435809-f8b0-43e6-983f-a59ee9a159c2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:02.744450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0f829828-b5af-4e32-a100-074184a868b4 req-eb435809-f8b0-43e6-983f-a59ee9a159c2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:02.752748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:02.767424 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0f829828-b5af-4e32-a100-074184a868b4 req-eb435809-f8b0-43e6-983f-a59ee9a159c2 service nova] Creating event network-vif-deleted:e395b810-ac28-4698-a37b-dcec92a493f6 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:03:02.775590 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0f829828-b5af-4e32-a100-074184a868b4 req-eb435809-f8b0-43e6-983f-a59ee9a159c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063380 Jul 26 20:03:02.779454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1983/3948] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:02.798303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-70ddf8b2-0e82-4fb1-8c4a-384510a01c41 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:02.804628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-70ddf8b2-0e82-4fb1-8c4a-384510a01c41 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:02.822881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70ddf8b2-0e82-4fb1-8c4a-384510a01c41 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:02.824041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70ddf8b2-0e82-4fb1-8c4a-384510a01c41 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:02.826773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70ddf8b2-0e82-4fb1-8c4a-384510a01c41 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:02.827520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70ddf8b2-0e82-4fb1-8c4a-384510a01c41 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:02.995876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a4af04b6-73f1-4080-8a17-7085fb8cf9c3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:03.005064 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4af04b6-73f1-4080-8a17-7085fb8cf9c3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579" status: 200 len: 1516 microversion: 2.1 time: 1.225994 Jul 26 20:03:03.005654 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1966/3949] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:01 2022] GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579 => generated 1516 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:03.027453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:03.032633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:03.048146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:03.048922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:03.050522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:03.053619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:03.214175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-70ddf8b2-0e82-4fb1-8c4a-384510a01c41 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:03.227652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-70ddf8b2-0e82-4fb1-8c4a-384510a01c41 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.446488 Jul 26 20:03:03.228560 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1984/3950] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:02 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:03.248929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77bcde93-abfd-4562-a932-33ffe4060d05 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:03.250186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77bcde93-abfd-4562-a932-33ffe4060d05 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:03.261061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77bcde93-abfd-4562-a932-33ffe4060d05 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:03.265870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77bcde93-abfd-4562-a932-33ffe4060d05 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:03.268211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77bcde93-abfd-4562-a932-33ffe4060d05 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:03.268894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77bcde93-abfd-4562-a932-33ffe4060d05 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:03.512965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77bcde93-abfd-4562-a932-33ffe4060d05 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:03.525061 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77bcde93-abfd-4562-a932-33ffe4060d05 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 200 len: 1323 microversion: 2.1 time: 0.295041 Jul 26 20:03:03.526452 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1985/3951] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:03 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:03.732045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:03.734194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:03.742237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:03.743148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:03.744552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:03.745363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:03.911166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:03.921866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:03.924137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:03.925821 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-422ac7cf-a1b6-4219-a0aa-8abc873296fd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1598 microversion: 2.20 time: 0.199861 Jul 26 20:03:03.927522 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1986/3952] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:03 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1598 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:03.950636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-78097f72-0996-4bc2-893c-0fe4d2850c31 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:03.952438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-78097f72-0996-4bc2-893c-0fe4d2850c31 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:03.959192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78097f72-0996-4bc2-893c-0fe4d2850c31 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:03.959590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78097f72-0996-4bc2-893c-0fe4d2850c31 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:03.970663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78097f72-0996-4bc2-893c-0fe4d2850c31 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:03.971453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78097f72-0996-4bc2-893c-0fe4d2850c31 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:04.118176 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-78097f72-0996-4bc2-893c-0fe4d2850c31 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.171475 Jul 26 20:03:04.127691 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1987/3953] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Jul 26 20:03:03 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:03:04.250379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-468906b5-12be-4b99-9bb3-7ab6acd8f9de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:04.251210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-468906b5-12be-4b99-9bb3-7ab6acd8f9de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:04.260776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-468906b5-12be-4b99-9bb3-7ab6acd8f9de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:04.262651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-468906b5-12be-4b99-9bb3-7ab6acd8f9de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:04.266329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-468906b5-12be-4b99-9bb3-7ab6acd8f9de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:04.266954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-468906b5-12be-4b99-9bb3-7ab6acd8f9de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:04.426805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:04.446791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:04.450167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:04.458640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-52764d55-fb0f-44af-b540-1332a9c68f09 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2227 microversion: 2.32 time: 1.434087 Jul 26 20:03:04.478333 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1967/3954] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:03 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2227 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:04.547840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f4c89d99-a7c8-48ec-a5a5-54f6cab246d1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:04.548677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f4c89d99-a7c8-48ec-a5a5-54f6cab246d1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:04.559823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4c89d99-a7c8-48ec-a5a5-54f6cab246d1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:04.567311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4c89d99-a7c8-48ec-a5a5-54f6cab246d1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:04.569545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4c89d99-a7c8-48ec-a5a5-54f6cab246d1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:04.570460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4c89d99-a7c8-48ec-a5a5-54f6cab246d1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:04.899929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-468906b5-12be-4b99-9bb3-7ab6acd8f9de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:04.913132 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-468906b5-12be-4b99-9bb3-7ab6acd8f9de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.666520 Jul 26 20:03:04.914266 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1988/3955] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:04 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:04.919261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4c4c3380-d432-4783-be3c-7ec17feb70fd req-6cc15b09-3db0-4df6-80dd-7b2e0860c337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1b6c16-d1b4-455c-b4d0-5f4828075243", "name": "network-vif-plugged", "status": "completed", "tag": "66a5eded-1218-44ac-9d6a-b19b94ed40a3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:04.945828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4c4c3380-d432-4783-be3c-7ec17feb70fd req-6cc15b09-3db0-4df6-80dd-7b2e0860c337 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:04.947214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4c4c3380-d432-4783-be3c-7ec17feb70fd req-6cc15b09-3db0-4df6-80dd-7b2e0860c337 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:04.974510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4c4c3380-d432-4783-be3c-7ec17feb70fd req-6cc15b09-3db0-4df6-80dd-7b2e0860c337 service nova] Creating event network-vif-plugged:66a5eded-1218-44ac-9d6a-b19b94ed40a3 for instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 on n-h1-708768-8 Jul 26 20:03:04.988385 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4c4c3380-d432-4783-be3c-7ec17feb70fd req-6cc15b09-3db0-4df6-80dd-7b2e0860c337 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072462 Jul 26 20:03:04.989987 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1989/3956] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:05.338201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f4c89d99-a7c8-48ec-a5a5-54f6cab246d1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:05.348768 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f4c89d99-a7c8-48ec-a5a5-54f6cab246d1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 200 len: 1323 microversion: 2.1 time: 0.803990 Jul 26 20:03:05.351123 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1968/3957] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:04 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 1323 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:03:05.486534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:05.487439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:05.502431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:05.503919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:05.508800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:05.509310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:05.934541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-58162760-730b-4aa0-a30a-2e7e5cea9ab4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:05.935826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-58162760-730b-4aa0-a30a-2e7e5cea9ab4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:05.950390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58162760-730b-4aa0-a30a-2e7e5cea9ab4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:05.951218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58162760-730b-4aa0-a30a-2e7e5cea9ab4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:05.955959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58162760-730b-4aa0-a30a-2e7e5cea9ab4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:05.963390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58162760-730b-4aa0-a30a-2e7e5cea9ab4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:06.734641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:06.765742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:06.773951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:06.775251 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f36969e-62f8-4083-a70b-e28a5969f4c2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2227 microversion: 2.32 time: 1.293329 Jul 26 20:03:06.775856 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1990/3958] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:05 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2227 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:06.790808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e805505-926a-4a61-be0f-574dcb2f5946 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:06.791748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e805505-926a-4a61-be0f-574dcb2f5946 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:06.804833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e805505-926a-4a61-be0f-574dcb2f5946 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:06.810304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e805505-926a-4a61-be0f-574dcb2f5946 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:06.811376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e805505-926a-4a61-be0f-574dcb2f5946 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:06.812018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e805505-926a-4a61-be0f-574dcb2f5946 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:07.216004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-58162760-730b-4aa0-a30a-2e7e5cea9ab4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:07.224754 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-58162760-730b-4aa0-a30a-2e7e5cea9ab4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 1.294222 Jul 26 20:03:07.228020 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1969/3959] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:05 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:07.232190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e805505-926a-4a61-be0f-574dcb2f5946 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:07.242507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e805505-926a-4a61-be0f-574dcb2f5946 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 200 len: 1323 microversion: 2.1 time: 0.462878 Jul 26 20:03:07.243129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-55133da9-f884-493a-90c9-d26436837cd7 req-37b89ffa-c3c5-4f00-af02-5e5fe425d9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f5ce3e-2965-4521-9c04-54f6b5b3836b", "name": "network-vif-plugged", "status": "completed", "tag": "fea01703-4f87-46fa-baa0-8d144d9b823c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:07.244880 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1991/3960] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:06 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 1323 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:07.253932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-153a9050-8633-46fa-a75d-e90dac7d0650 req-10eeddc3-5786-4933-af6e-04d86a111ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f87df55d-ecd6-431b-8f7b-95ef5e1132eb", "tag": "5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:07.268464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-55133da9-f884-493a-90c9-d26436837cd7 req-37b89ffa-c3c5-4f00-af02-5e5fe425d9cf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:07.269140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-55133da9-f884-493a-90c9-d26436837cd7 req-37b89ffa-c3c5-4f00-af02-5e5fe425d9cf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:07.279386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-153a9050-8633-46fa-a75d-e90dac7d0650 req-10eeddc3-5786-4933-af6e-04d86a111ce9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:07.280204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-153a9050-8633-46fa-a75d-e90dac7d0650 req-10eeddc3-5786-4933-af6e-04d86a111ce9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:07.295121 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-153a9050-8633-46fa-a75d-e90dac7d0650 req-10eeddc3-5786-4933-af6e-04d86a111ce9 service nova] Creating event network-changed:5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad for instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb on n-h1-708768-8 Jul 26 20:03:07.298913 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-55133da9-f884-493a-90c9-d26436837cd7 req-37b89ffa-c3c5-4f00-af02-5e5fe425d9cf service nova] Creating event network-vif-plugged:fea01703-4f87-46fa-baa0-8d144d9b823c for instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b on n-h1-708768-8 Jul 26 20:03:07.308502 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-55133da9-f884-493a-90c9-d26436837cd7 req-37b89ffa-c3c5-4f00-af02-5e5fe425d9cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079201 Jul 26 20:03:07.310365 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-153a9050-8633-46fa-a75d-e90dac7d0650 req-10eeddc3-5786-4933-af6e-04d86a111ce9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063957 Jul 26 20:03:07.311175 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1970/3961] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:07.312589 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1992/3962] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:07.361169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:07.361874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:07.376510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:07.376985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:07.378046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:07.378769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:07.410505 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f HTTP/1.1 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '08c9b8aa-c3eb-4a64-aed8-59f12802443f'} Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:07.417171 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.421063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.424493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:07.425574 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-310dae80-610f-4dba-8796-9ec5625d4c44 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 404 len: 111 microversion: 2.1 time: 0.070118 Jul 26 20:03:07.430282 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1971/3963] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:03:07 2022] DELETE /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:07.439933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:07.439933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 08c9b8aa-c3eb-4a64-aed8-59f12802443f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:07.455498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:07.456271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:07.458184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:07.458938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:07.494174 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f HTTP/1.1 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '08c9b8aa-c3eb-4a64-aed8-59f12802443f'} Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:07.501500 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance 08c9b8aa-c3eb-4a64-aed8-59f12802443f could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c897dd37-9f77-4b72-9257-17bda890fef8 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f" status: 404 len: 111 microversion: 2.1 time: 0.071427 Jul 26 20:03:07.505951 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1993/3964] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:07 2022] GET /compute/v2.1/servers/08c9b8aa-c3eb-4a64-aed8-59f12802443f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:07.804390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:07.805198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:07.825010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:07.825706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:07.833578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:07.836464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:08.251977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7c255c3a-84f7-48c2-8dad-03e49f656ef2 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:08.253305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7c255c3a-84f7-48c2-8dad-03e49f656ef2 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:08.266594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c255c3a-84f7-48c2-8dad-03e49f656ef2 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:08.267064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c255c3a-84f7-48c2-8dad-03e49f656ef2 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:08.268518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c255c3a-84f7-48c2-8dad-03e49f656ef2 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:08.268968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c255c3a-84f7-48c2-8dad-03e49f656ef2 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:08.325907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:08.336529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:08.341313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:08.348230 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9748f092-b919-4fbd-8e80-33cc6aae96b9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 2160 microversion: 2.32 time: 0.544847 Jul 26 20:03:08.349403 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1972/3965] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:07 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 2160 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:08.360640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d1e790bd-9519-4fec-83dc-2f1df6b0ecc1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:08.361458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d1e790bd-9519-4fec-83dc-2f1df6b0ecc1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:08.373356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1e790bd-9519-4fec-83dc-2f1df6b0ecc1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:08.375994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1e790bd-9519-4fec-83dc-2f1df6b0ecc1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:08.376975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1e790bd-9519-4fec-83dc-2f1df6b0ecc1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:08.378669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1e790bd-9519-4fec-83dc-2f1df6b0ecc1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:08.615518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7c255c3a-84f7-48c2-8dad-03e49f656ef2 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:08.641689 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7c255c3a-84f7-48c2-8dad-03e49f656ef2 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1307 microversion: 2.1 time: 0.382982 Jul 26 20:03:08.660919 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1994/3966] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:08 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1307 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:08.733969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-49283ad0-4b5d-42d5-a18c-b212c3049405 req-fbdd01a2-66c6-4f40-a317-4e65d69869fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7", "name": "network-vif-deleted", "tag": "bf0697cb-e330-45a1-909c-22998a643533"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:08.789844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-49283ad0-4b5d-42d5-a18c-b212c3049405 req-fbdd01a2-66c6-4f40-a317-4e65d69869fb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:08.795999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-49283ad0-4b5d-42d5-a18c-b212c3049405 req-fbdd01a2-66c6-4f40-a317-4e65d69869fb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:08.825095 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-49283ad0-4b5d-42d5-a18c-b212c3049405 req-fbdd01a2-66c6-4f40-a317-4e65d69869fb service nova] Creating event network-vif-deleted:bf0697cb-e330-45a1-909c-22998a643533 for instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 on n-h1-708768-8 Jul 26 20:03:08.837613 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-49283ad0-4b5d-42d5-a18c-b212c3049405 req-fbdd01a2-66c6-4f40-a317-4e65d69869fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107549 Jul 26 20:03:08.840807 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1995/3967] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:03:09.381629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:09.383834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:09.403376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:09.405512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:09.407289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:09.412208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:09.712600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:09.722899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:09.730015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:09.737197 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5e5396a-0f28-4c7c-9797-899dd3a90f5b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.362366 Jul 26 20:03:09.738012 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1996/3968] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:09 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:03:09.756558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f2314bf-fd63-4031-83b2-86efbe0ef67e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:09.759327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4f2314bf-fd63-4031-83b2-86efbe0ef67e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:09.777533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f2314bf-fd63-4031-83b2-86efbe0ef67e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:09.780162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f2314bf-fd63-4031-83b2-86efbe0ef67e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:09.784067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f2314bf-fd63-4031-83b2-86efbe0ef67e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:09.784692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f2314bf-fd63-4031-83b2-86efbe0ef67e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:10.644338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d1e790bd-9519-4fec-83dc-2f1df6b0ecc1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:10.660650 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d1e790bd-9519-4fec-83dc-2f1df6b0ecc1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 200 len: 1516 microversion: 2.1 time: 2.309970 Jul 26 20:03:10.661251 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1973/3969] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:08 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 1516 bytes in 2311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:10.685623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e22dc3f-15d8-45fc-8323-7b5e491c9fad tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:10.686485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e22dc3f-15d8-45fc-8323-7b5e491c9fad tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:10.698599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e22dc3f-15d8-45fc-8323-7b5e491c9fad tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:10.699982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e22dc3f-15d8-45fc-8323-7b5e491c9fad tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:10.700964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e22dc3f-15d8-45fc-8323-7b5e491c9fad tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:10.708502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e22dc3f-15d8-45fc-8323-7b5e491c9fad tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:10.792580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e22dc3f-15d8-45fc-8323-7b5e491c9fad tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:03:10.795582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4f2314bf-fd63-4031-83b2-86efbe0ef67e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:10.812182 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f2314bf-fd63-4031-83b2-86efbe0ef67e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1488 microversion: 2.1 time: 1.065773 Jul 26 20:03:10.816111 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1997/3970] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:09 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1488 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:10.838938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:10.839920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:10.854339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:10.854798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:10.859390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:10.862735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:11.121863 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e22dc3f-15d8-45fc-8323-7b5e491c9fad tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 204 len: 0 microversion: 2.1 time: 0.439802 Jul 26 20:03:11.123037 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1974/3971] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:03:10 2022] DELETE /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:03:11.139695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5751c762-9a24-4feb-99d9-d3b88828f94e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:11.157567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5751c762-9a24-4feb-99d9-d3b88828f94e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:11.158680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5751c762-9a24-4feb-99d9-d3b88828f94e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:11.201276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:11.224492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:11.230674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:11.234632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-516effbe-8a15-4c46-a8b7-48c1311314c1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.416700 Jul 26 20:03:11.242499 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1998/3972] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:10 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:11.248594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5751c762-9a24-4feb-99d9-d3b88828f94e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Going to try to stop instance {{(pid=125963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:03:11.261188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc392512-3201-4564-895d-b7fd6de9c52e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:11.262326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bc392512-3201-4564-895d-b7fd6de9c52e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:11.290209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc392512-3201-4564-895d-b7fd6de9c52e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:11.294232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc392512-3201-4564-895d-b7fd6de9c52e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:11.295385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc392512-3201-4564-895d-b7fd6de9c52e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:11.300455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc392512-3201-4564-895d-b7fd6de9c52e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:11.396229 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5751c762-9a24-4feb-99d9-d3b88828f94e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b/action" status: 202 len: 0 microversion: 2.1 time: 0.265708 Jul 26 20:03:11.403160 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1975/3973] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:03:11 2022] POST /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:03:11.409278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bca264ef-aaee-4d83-8f57-1c22ec5ddc7d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:11.411591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bca264ef-aaee-4d83-8f57-1c22ec5ddc7d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:11.453159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bca264ef-aaee-4d83-8f57-1c22ec5ddc7d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:11.453652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bca264ef-aaee-4d83-8f57-1c22ec5ddc7d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:11.460885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bca264ef-aaee-4d83-8f57-1c22ec5ddc7d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:11.461630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bca264ef-aaee-4d83-8f57-1c22ec5ddc7d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:11.817764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc392512-3201-4564-895d-b7fd6de9c52e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:11.829512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc392512-3201-4564-895d-b7fd6de9c52e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 200 len: 1522 microversion: 2.1 time: 0.585516 Jul 26 20:03:11.830491 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 1999/3974] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:11 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:12.011691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bca264ef-aaee-4d83-8f57-1c22ec5ddc7d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:12.023312 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bca264ef-aaee-4d83-8f57-1c22ec5ddc7d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.618732 Jul 26 20:03:12.036626 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1976/3975] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:11 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:12.271942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:12.272745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:12.285695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:12.288270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:12.294050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:12.296428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:12.563567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:12.576538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:12.588579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:12.591079 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2b7e0eae-36e6-4cd5-ad89-b73c6d6ed2ad tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.324626 Jul 26 20:03:12.598527 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2000/3976] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:12 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:12.855132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-85cabe35-5920-41ac-8f18-693adb7711a7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:12.856602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-85cabe35-5920-41ac-8f18-693adb7711a7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:12.867352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85cabe35-5920-41ac-8f18-693adb7711a7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:12.873928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85cabe35-5920-41ac-8f18-693adb7711a7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:12.875027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85cabe35-5920-41ac-8f18-693adb7711a7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:12.876112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-85cabe35-5920-41ac-8f18-693adb7711a7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:13.054992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e79b4c4-3705-4334-bca3-0ecb0a9de00f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:13.056793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e79b4c4-3705-4334-bca3-0ecb0a9de00f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:13.069366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e79b4c4-3705-4334-bca3-0ecb0a9de00f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:13.071243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e79b4c4-3705-4334-bca3-0ecb0a9de00f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:13.074360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e79b4c4-3705-4334-bca3-0ecb0a9de00f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:13.076730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e79b4c4-3705-4334-bca3-0ecb0a9de00f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:13.399221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3e79b4c4-3705-4334-bca3-0ecb0a9de00f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:13.409008 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e79b4c4-3705-4334-bca3-0ecb0a9de00f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.358972 Jul 26 20:03:13.423641 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2001/3977] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:13 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:13.512844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-85cabe35-5920-41ac-8f18-693adb7711a7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:13.526121 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-85cabe35-5920-41ac-8f18-693adb7711a7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 200 len: 1522 microversion: 2.1 time: 0.674793 Jul 26 20:03:13.529685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1977/3978] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:12 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 1522 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:13.626428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:13.627055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:13.642229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:13.642681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:13.643470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:13.646459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:13.780720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:13.799327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:13.805724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:13.811122 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a8be03a5-3c96-4e68-bb2a-362666e8a1dc tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.188244 Jul 26 20:03:13.812763 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2002/3979] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:13 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:14.349328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ac6e7cce-5e84-449f-871d-3c597a5e8de4 req-f29df370-0040-4b36-bb44-d6a72b7fd0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1b6c16-d1b4-455c-b4d0-5f4828075243", "name": "network-vif-deleted", "tag": "66a5eded-1218-44ac-9d6a-b19b94ed40a3"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:14.387993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ac6e7cce-5e84-449f-871d-3c597a5e8de4 req-f29df370-0040-4b36-bb44-d6a72b7fd0df service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:14.388766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ac6e7cce-5e84-449f-871d-3c597a5e8de4 req-f29df370-0040-4b36-bb44-d6a72b7fd0df service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:14.406184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:14.406692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:14.449805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:14.452499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:14.454922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:14.460280 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ac6e7cce-5e84-449f-871d-3c597a5e8de4 req-f29df370-0040-4b36-bb44-d6a72b7fd0df service nova] Creating event network-vif-deleted:66a5eded-1218-44ac-9d6a-b19b94ed40a3 for instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 on n-h1-708768-8 Jul 26 20:03:14.462447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:14.479120 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ac6e7cce-5e84-449f-871d-3c597a5e8de4 req-f29df370-0040-4b36-bb44-d6a72b7fd0df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143203 Jul 26 20:03:14.483172 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1978/3980] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:14.500655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e6e75ea3-2d1c-4731-ac73-a43c33fa25cb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:14.503048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e6e75ea3-2d1c-4731-ac73-a43c33fa25cb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:14.527705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6e75ea3-2d1c-4731-ac73-a43c33fa25cb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:14.528920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6e75ea3-2d1c-4731-ac73-a43c33fa25cb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:14.531803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6e75ea3-2d1c-4731-ac73-a43c33fa25cb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:14.534504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6e75ea3-2d1c-4731-ac73-a43c33fa25cb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:14.549642 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d HTTP/1.1 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'dd66cf0a-f4e4-4302-9442-01163ee9a46d'} Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:14.554256 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:14.557814 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:14.561530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:14.562876 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06f23608-a9be-44bc-b1d7-3794e494c1e2 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 404 len: 111 microversion: 2.1 time: 0.161551 Jul 26 20:03:14.564072 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2003/3981] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:03:14 2022] DELETE /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:14.570997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:14.572086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:14.585294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:14.603026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:14.605889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:14.608644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:14.610313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:14.685679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:14.721441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:14.722070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:14.723249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lazy-loading 'fault' on Instance uuid 1d1b6c16-d1b4-455c-b4d0-5f4828075243 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:03:14.953590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e6e75ea3-2d1c-4731-ac73-a43c33fa25cb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:14.968140 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e6e75ea3-2d1c-4731-ac73-a43c33fa25cb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.482191 Jul 26 20:03:14.968964 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1979/3982] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:14 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:14.977952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:14.996469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: dd66cf0a-f4e4-4302-9442-01163ee9a46d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:15.002771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:15.003461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:15.006176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:15.013653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:15.076799 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d HTTP/1.1 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'dd66cf0a-f4e4-4302-9442-01163ee9a46d'} Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:15.078788 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance dd66cf0a-f4e4-4302-9442-01163ee9a46d could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:15.086001 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d914a6d4-dd63-45be-b2fd-05d8189ec80f tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d" status: 404 len: 111 microversion: 2.1 time: 0.110424 Jul 26 20:03:15.091973 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1980/3983] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:14 2022] GET /compute/v2.1/servers/dd66cf0a-f4e4-4302-9442-01163ee9a46d => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:15.103656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:15.104491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:15.122118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:15.122569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:15.123351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:15.140066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:15.243134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:15.249296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:15.269521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9140612-7427-4b8f-a1a4-a2537bcfb557 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 200 len: 1313 microversion: 2.1 time: 0.703757 Jul 26 20:03:15.271935 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2004/3984] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:14 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:15.277584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:15.280714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:15.285026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:15.286761 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc582365-cdd2-4c4f-95a8-221f02c2213b tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.191719 Jul 26 20:03:15.287280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:15.307534 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1981/3985] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:15 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:15.317207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:15.318103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:15.319198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:15.319841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:15.356651 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 HTTP/1.1 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '6c84435b-ff31-447e-887e-4c244035e948'} Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:15.360190 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.364700 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.366987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:15.368485 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7daf9efe-5f63-4c8e-b809-2bbee770aa2b tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 404 len: 111 microversion: 2.1 time: 0.094626 Jul 26 20:03:15.370088 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2005/3986] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:03:15 2022] DELETE /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:15.380991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:15.381922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: 6c84435b-ff31-447e-887e-4c244035e948] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:15.417731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:15.418952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:15.422469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:15.423748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:15.452678 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 HTTP/1.1 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6c84435b-ff31-447e-887e-4c244035e948'} Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:15.454234 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.459742 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:15.459742 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:15.459742 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:15.459742 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:15.459742 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:15.459742 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. Jul 26 20:03:15.459742 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:15.459742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance 6c84435b-ff31-447e-887e-4c244035e948 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:15.462528 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cb6985a3-b7b8-4177-b1dd-cf28be728cfc tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948" status: 404 len: 111 microversion: 2.1 time: 0.081501 Jul 26 20:03:15.466157 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1982/3987] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:15 2022] GET /compute/v2.1/servers/6c84435b-ff31-447e-887e-4c244035e948 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:15.999469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e327e95a-9dd4-46bc-9f56-5456efa7189c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:16.000202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e327e95a-9dd4-46bc-9f56-5456efa7189c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:16.013884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e327e95a-9dd4-46bc-9f56-5456efa7189c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.014902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e327e95a-9dd4-46bc-9f56-5456efa7189c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.016447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e327e95a-9dd4-46bc-9f56-5456efa7189c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.017061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e327e95a-9dd4-46bc-9f56-5456efa7189c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.226853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e327e95a-9dd4-46bc-9f56-5456efa7189c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:16.236459 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e327e95a-9dd4-46bc-9f56-5456efa7189c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.249212 Jul 26 20:03:16.237714 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2006/3988] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:15 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:16.296095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:16.298179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:16.305345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:16.307121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.308102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.309365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.309978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.318964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:16.319732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:16.327603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:16.329573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.330940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.333238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.333871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.336438 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] HTTP exception thrown: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Request method failure captured: Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 HTTP/1.1 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EhO-LnWvRuPdHsfzbcAa5zAgqHELa8EaDcw_4gTUdnwhZis7xjUUc0YmqJC6Qxe708aSLa8_399VEcC8BZHArPTRKPlhEV7D3JLM9sGAvrZdyHh2C5tjje0H7BHMCLG146BWYvObuRvT8vQrrMcHYwq-2fcJO09BSyqIiNFnKy6dHU Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547dab22ce93445d964cff0949ebf9b0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}] Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 2bc86400878e478d813ada004d9aabea Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '1d1b6c16-d1b4-455c-b4d0-5f4828075243'} Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:16.338872 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.343045 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:16.343045 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:16.343045 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:16.343045 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:16.343045 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:16.343045 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:16.343045 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.344433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Returning 404 to user: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:16.345553 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-207caa7e-e096-4504-94cc-16958ac14805 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 404 len: 111 microversion: 2.1 time: 0.053985 Jul 26 20:03:16.349382 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1983/3989] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:16 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:16.365839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-23413dc3-2bbc-45a4-912b-f84b572ef128 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:16.380092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-23413dc3-2bbc-45a4-912b-f84b572ef128 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:16.381029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-23413dc3-2bbc-45a4-912b-f84b572ef128 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:16.399856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23413dc3-2bbc-45a4-912b-f84b572ef128 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.400319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23413dc3-2bbc-45a4-912b-f84b572ef128 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.403237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23413dc3-2bbc-45a4-912b-f84b572ef128 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.403948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23413dc3-2bbc-45a4-912b-f84b572ef128 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.510920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:16.533813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:16.536617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:16.543713 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f4270abd-ce04-4571-b8dd-534e5c0de172 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.229689 Jul 26 20:03:16.547031 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2007/3990] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:16 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:16.676667 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-23413dc3-2bbc-45a4-912b-f84b572ef128 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.321586 Jul 26 20:03:16.678694 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1984/3991] 10.222.0.58 () {58 vars in 1230 bytes} [Tue Jul 26 20:03:16 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:03:16.692862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7ad818f-6b32-4257-b829-e8161ea2b196 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7ad818f-6b32-4257-b829-e8161ea2b196 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Request method failure captured: Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EhO-LnWvRuPdHsfzbcAa5zAgqHELa8EaDcw_4gTUdnwhZis7xjUUc0YmqJC6Qxe708aSLa8_399VEcC8BZHArPTRKPlhEV7D3JLM9sGAvrZdyHh2C5tjje0H7BHMCLG146BWYvObuRvT8vQrrMcHYwq-2fcJO09BSyqIiNFnKy6dHU Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547dab22ce93445d964cff0949ebf9b0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}] Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2bc86400878e478d813ada004d9aabea Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: action_args: {} Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 20:03:16.698569 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 20:03:16.702257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:16.708569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7ad818f-6b32-4257-b829-e8161ea2b196 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:16.712921 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f7ad818f-6b32-4257-b829-e8161ea2b196 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.026625 Jul 26 20:03:16.715220 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2008/3992] 10.222.0.58 () {58 vars in 1182 bytes} [Tue Jul 26 20:03:16 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:03:16.729738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:16.737732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:16.738829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'deleted': False, 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:16.755638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.756013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.757437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.757874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.832790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:16.912362 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6e967b24-fcb3-440d-b9c6-ed7d55ed1ea3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.188962 Jul 26 20:03:16.920992 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1985/3993] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 20:03:16 2022] GET /compute/v2.1/servers => generated 683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:16.925029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:16.954006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:16.954780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.servers [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Removing options 'limit' from query {{(pid=125964) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 20:03:16.957124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'deleted': False, 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:16.976967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:16.988080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:16.990449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:17.000150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:17.081823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:17.184063 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82aee7bf-fb3d-4d8f-94f7-2d974851353d tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.259637 Jul 26 20:03:17.188150 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2009/3994] 10.222.0.58 () {58 vars in 1144 bytes} [Tue Jul 26 20:03:16 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:03:17.205176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-630a217c-97d2-42a8-bdee-0fafb0343eb7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-630a217c-97d2-42a8-bdee-0fafb0343eb7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Request method failure captured: Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EhO-LnWvRuPdHsfzbcAa5zAgqHELa8EaDcw_4gTUdnwhZis7xjUUc0YmqJC6Qxe708aSLa8_399VEcC8BZHArPTRKPlhEV7D3JLM9sGAvrZdyHh2C5tjje0H7BHMCLG146BWYvObuRvT8vQrrMcHYwq-2fcJO09BSyqIiNFnKy6dHU Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547dab22ce93445d964cff0949ebf9b0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}] Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2bc86400878e478d813ada004d9aabea Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: action_args: {} Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi '-1' Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 20:03:17.218992 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 20:03:17.223929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.229193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-630a217c-97d2-42a8-bdee-0fafb0343eb7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:17.232740 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-630a217c-97d2-42a8-bdee-0fafb0343eb7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.034365 Jul 26 20:03:17.236550 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2010/3995] 10.222.0.58 () {58 vars in 1142 bytes} [Tue Jul 26 20:03:17 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:03:17.246183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12b1883c-91ae-4189-9b7c-8cfd90a387e4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12b1883c-91ae-4189-9b7c-8cfd90a387e4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Request method failure captured: Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EhO-LnWvRuPdHsfzbcAa5zAgqHELa8EaDcw_4gTUdnwhZis7xjUUc0YmqJC6Qxe708aSLa8_399VEcC8BZHArPTRKPlhEV7D3JLM9sGAvrZdyHh2C5tjje0H7BHMCLG146BWYvObuRvT8vQrrMcHYwq-2fcJO09BSyqIiNFnKy6dHU Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547dab22ce93445d964cff0949ebf9b0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}] Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2bc86400878e478d813ada004d9aabea Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: action_args: {} Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'testing' Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 20:03:17.267913 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12b1883c-91ae-4189-9b7c-8cfd90a387e4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-12b1883c-91ae-4189-9b7c-8cfd90a387e4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.027079 Jul 26 20:03:17.278469 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2011/3996] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:03:17 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:03:17.280194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45ff15c4-e765-4e2e-aa02-4aadd2e1d5c3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:17.280194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45ff15c4-e765-4e2e-aa02-4aadd2e1d5c3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:17.299286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45ff15c4-e765-4e2e-aa02-4aadd2e1d5c3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:17.299780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45ff15c4-e765-4e2e-aa02-4aadd2e1d5c3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:17.300580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45ff15c4-e765-4e2e-aa02-4aadd2e1d5c3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:17.306626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45ff15c4-e765-4e2e-aa02-4aadd2e1d5c3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:17.395246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-603619539", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "3bc53748-9257-422a-af2f-7e895373bab7"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:17.522532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] validate_networks() for [('3bc53748-9257-422a-af2f-7e895373bab7', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:03:17.676986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45ff15c4-e765-4e2e-aa02-4aadd2e1d5c3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:17.695362 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45ff15c4-e765-4e2e-aa02-4aadd2e1d5c3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.419698 Jul 26 20:03:17.718437 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2012/3997] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:17 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:17.733149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96378595-bd2c-47a8-a2db-b8cdd66f69ce tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:17.745010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-96378595-bd2c-47a8-a2db-b8cdd66f69ce tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:17.748983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-96378595-bd2c-47a8-a2db-b8cdd66f69ce tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:17.765810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.servers [None req-96378595-bd2c-47a8-a2db-b8cdd66f69ce tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Flavor 'non_existing_flavor' could not be found {{(pid=125964) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 26 20:03:17.766892 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96378595-bd2c-47a8-a2db-b8cdd66f69ce tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.047218 Jul 26 20:03:17.771832 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2013/3998] 10.222.0.58 () {58 vars in 1178 bytes} [Tue Jul 26 20:03:17 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:03:17.779677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:17.780547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:17.796604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:17.797320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:17.798887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:17.799486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:17.963493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:17.977980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:17.983855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:17.989375 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-83c32c11-3b5d-4cf8-806a-304fa1a5c6cb tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.216204 Jul 26 20:03:17.990816 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2014/3999] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:17 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:17.998354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ace81f20-2a4f-4626-9b36-59d7c3be5243 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:18.027982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ace81f20-2a4f-4626-9b36-59d7c3be5243 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:18.029561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ace81f20-2a4f-4626-9b36-59d7c3be5243 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:18.049642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace81f20-2a4f-4626-9b36-59d7c3be5243 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.050363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace81f20-2a4f-4626-9b36-59d7c3be5243 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.052473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace81f20-2a4f-4626-9b36-59d7c3be5243 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.053163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace81f20-2a4f-4626-9b36-59d7c3be5243 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.265230 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ace81f20-2a4f-4626-9b36-59d7c3be5243 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.273067 Jul 26 20:03:18.271412 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2015/4000] 10.222.0.58 () {58 vars in 1174 bytes} [Tue Jul 26 20:03:17 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:03:18.284428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c524d6de-4c58-4164-9e5e-20366bb28248 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:18.295377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c524d6de-4c58-4164-9e5e-20366bb28248 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:18.301264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c524d6de-4c58-4164-9e5e-20366bb28248 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:18.319196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c524d6de-4c58-4164-9e5e-20366bb28248 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.319591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c524d6de-4c58-4164-9e5e-20366bb28248 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.328037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c524d6de-4c58-4164-9e5e-20366bb28248 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.328499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c524d6de-4c58-4164-9e5e-20366bb28248 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.559374 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c524d6de-4c58-4164-9e5e-20366bb28248 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.283836 Jul 26 20:03:18.570414 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2016/4001] 10.222.0.58 () {58 vars in 1184 bytes} [Tue Jul 26 20:03:18 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:03:18.575885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:18.584065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:18.586591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'deleted': False, 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:18.592912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:03:18.593393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:03:18.594578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:03:18.594993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:03:18.595402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:03:18.596880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.603402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.606403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.609723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.610994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.611580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.611741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.612419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.678236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Getting quotas for project 0fe59cccd02a4327b666ecb3286d48a1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:03:18.724715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Getting quotas for user f7ed53afd4d84358bc412f5039303380 and project 0fe59cccd02a4327b666ecb3286d48a1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:03:18.740328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:18.769162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:03:18.780216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:03:18.856359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:18.877363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:18.878295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:18.916029 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ee30e56-7cb7-4512-9f2a-9ad73b860ab0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.744891 Jul 26 20:03:18.920927 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1986/4002] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:03:18.974166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-06faa9ae-9efb-4ab6-b576-b2387b98dbd9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:18.974864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-06faa9ae-9efb-4ab6-b576-b2387b98dbd9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:19.002029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06faa9ae-9efb-4ab6-b576-b2387b98dbd9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:19.002709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06faa9ae-9efb-4ab6-b576-b2387b98dbd9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:19.004227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06faa9ae-9efb-4ab6-b576-b2387b98dbd9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:19.005877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06faa9ae-9efb-4ab6-b576-b2387b98dbd9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:19.238769 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-10396a74-66bf-4606-ae41-113d35070461 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.666762 Jul 26 20:03:19.239484 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2017/4003] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 20:03:18 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:19.263347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1139401200", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "3bc53748-9257-422a-af2f-7e895373bab7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:19.419813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-06faa9ae-9efb-4ab6-b576-b2387b98dbd9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:19.425863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] validate_networks() for [('3bc53748-9257-422a-af2f-7e895373bab7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:03:19.450384 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-06faa9ae-9efb-4ab6-b576-b2387b98dbd9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.528026 Jul 26 20:03:19.460591 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1987/4004] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:18 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:19.466680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:19.467890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:19.484648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:19.486067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:19.487193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:19.487860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:19.780597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:19.800181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:19.803499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:19.811817 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ede31c72-2918-4715-b047-491d3e59cdfd tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.349751 Jul 26 20:03:19.814317 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1988/4005] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:19 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:19.838059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-62558c22-7ff9-4a6f-af33-a0df4b5169fa tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:19.854561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-62558c22-7ff9-4a6f-af33-a0df4b5169fa tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:19.855517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-62558c22-7ff9-4a6f-af33-a0df4b5169fa tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.037366 Jul 26 20:03:19.864480 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1989/4006] 10.222.0.58 () {58 vars in 1178 bytes} [Tue Jul 26 20:03:19 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:03:19.881425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:19.901348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:19.903449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Searching by: {'deleted': False, 'project_id': '547dab22ce93445d964cff0949ebf9b0'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:19.916675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:19.925161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:19.928394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:19.929882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:19.995796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:20.079188 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ddddab81-2156-4173-a8fb-fefd602b13f3 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.205954 Jul 26 20:03:20.087062 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1990/4007] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 20:03:19 2022] GET /compute/v2.1/servers => generated 683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:20.102744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:20.103510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:20.110337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.110989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.111965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.112714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.149857 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] HTTP exception thrown: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Request method failure captured: Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 HTTP/1.1 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EhO-LnWvRuPdHsfzbcAa5zAgqHELa8EaDcw_4gTUdnwhZis7xjUUc0YmqJC6Qxe708aSLa8_399VEcC8BZHArPTRKPlhEV7D3JLM9sGAvrZdyHh2C5tjje0H7BHMCLG146BWYvObuRvT8vQrrMcHYwq-2fcJO09BSyqIiNFnKy6dHU Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547dab22ce93445d964cff0949ebf9b0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}] Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 2bc86400878e478d813ada004d9aabea Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '1d1b6c16-d1b4-455c-b4d0-5f4828075243'} Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:20.152986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:20.161052 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:20.165529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Returning 404 to user: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:20.166875 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0eb0aa67-b94c-4648-9ee4-f3726ce9c3ee tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 404 len: 111 microversion: 2.1 time: 0.068323 Jul 26 20:03:20.173312 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1991/4008] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:03:20 2022] DELETE /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:20.178873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc5153ce-c894-47ea-a1f4-ea0565f3bed4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:20.185916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc5153ce-c894-47ea-a1f4-ea0565f3bed4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 5cd4c910-5089-44d9-a86d-f1043919d579] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:20.200833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc5153ce-c894-47ea-a1f4-ea0565f3bed4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.203242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc5153ce-c894-47ea-a1f4-ea0565f3bed4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.204600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc5153ce-c894-47ea-a1f4-ea0565f3bed4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.206843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc5153ce-c894-47ea-a1f4-ea0565f3bed4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.272034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc5153ce-c894-47ea-a1f4-ea0565f3bed4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 5cd4c910-5089-44d9-a86d-f1043919d579] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:03:20.313021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:03:20.313555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:03:20.313918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:03:20.314335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:03:20.314754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:03:20.335084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.337252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.338530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.340107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.394808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Getting quotas for project 0fe59cccd02a4327b666ecb3286d48a1. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:03:20.414474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Getting quotas for user f7ed53afd4d84358bc412f5039303380 and project 0fe59cccd02a4327b666ecb3286d48a1. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:03:20.448746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:03:20.459686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:03:20.497889 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc5153ce-c894-47ea-a1f4-ea0565f3bed4 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579" status: 204 len: 0 microversion: 2.1 time: 0.323060 Jul 26 20:03:20.498744 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1992/4009] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:03:20 2022] DELETE /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:03:20.504684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e87751b9-acb7-4397-a340-5866c8f6c668 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:20.505655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e87751b9-acb7-4397-a340-5866c8f6c668 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:20.543405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e87751b9-acb7-4397-a340-5866c8f6c668 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.543966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e87751b9-acb7-4397-a340-5866c8f6c668 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.545915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e87751b9-acb7-4397-a340-5866c8f6c668 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.546608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e87751b9-acb7-4397-a340-5866c8f6c668 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.553370 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02a548d7-d498-40a5-b4bd-9f7ca8f8da57 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300085 Jul 26 20:03:20.557386 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2018/4010] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:03:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:03:20.575110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16a4d36c-5338-41bd-a767-ee3fcd7f3a58 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:20.575831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-16a4d36c-5338-41bd-a767-ee3fcd7f3a58 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:20.593072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16a4d36c-5338-41bd-a767-ee3fcd7f3a58 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.593621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16a4d36c-5338-41bd-a767-ee3fcd7f3a58 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.594915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16a4d36c-5338-41bd-a767-ee3fcd7f3a58 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.595548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16a4d36c-5338-41bd-a767-ee3fcd7f3a58 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.698456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-16a4d36c-5338-41bd-a767-ee3fcd7f3a58 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:03:20.846168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e87751b9-acb7-4397-a340-5866c8f6c668 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:20.863392 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e87751b9-acb7-4397-a340-5866c8f6c668 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.360568 Jul 26 20:03:20.866763 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1993/4011] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:20 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:20.874660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-361196612", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "451", "networks": [{"uuid": "3bc53748-9257-422a-af2f-7e895373bab7"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:20.935063 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16a4d36c-5338-41bd-a767-ee3fcd7f3a58 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 204 len: 0 microversion: 2.1 time: 0.376145 Jul 26 20:03:20.935711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2019/4012] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:03:20 2022] DELETE /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:03:20.947832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:20.948560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:20.956338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.957601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.958879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:20.959535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:20.987016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] validate_networks() for [('3bc53748-9257-422a-af2f-7e895373bab7', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:03:21.213210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:21.225858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:21.232067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:21.242359 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45f273fe-8309-494c-8aca-91fa37105c7e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.305414 Jul 26 20:03:21.244233 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2020/4013] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:20 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:21.255202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:21.260462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 1d1b6c16-d1b4-455c-b4d0-5f4828075243] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:21.275496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:21.276008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:21.276911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:21.277363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:21.324966 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] HTTP exception thrown: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Request method failure captured: Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 HTTP/1.1 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EhO-LnWvRuPdHsfzbcAa5zAgqHELa8EaDcw_4gTUdnwhZis7xjUUc0YmqJC6Qxe708aSLa8_399VEcC8BZHArPTRKPlhEV7D3JLM9sGAvrZdyHh2C5tjje0H7BHMCLG146BWYvObuRvT8vQrrMcHYwq-2fcJO09BSyqIiNFnKy6dHU Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547dab22ce93445d964cff0949ebf9b0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}] Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 2bc86400878e478d813ada004d9aabea Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '1d1b6c16-d1b4-455c-b4d0-5f4828075243'} Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:21.326656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:21.331385 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:21.331385 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:21.331385 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:21.331385 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:21.331385 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:21.331385 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. Jul 26 20:03:21.331385 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:21.337058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Returning 404 to user: Instance 1d1b6c16-d1b4-455c-b4d0-5f4828075243 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:21.339188 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-374fa1ce-156e-4b3f-9077-6b7922e727e1 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243" status: 404 len: 111 microversion: 2.1 time: 0.093776 Jul 26 20:03:21.342677 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2021/4014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:21 2022] GET /compute/v2.1/servers/1d1b6c16-d1b4-455c-b4d0-5f4828075243 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:21.355456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ec6c394-9502-4b48-a142-75effb54e97e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:21.356559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ec6c394-9502-4b48-a142-75effb54e97e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 5cd4c910-5089-44d9-a86d-f1043919d579] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:21.372550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ec6c394-9502-4b48-a142-75effb54e97e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:21.373508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ec6c394-9502-4b48-a142-75effb54e97e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:21.376139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ec6c394-9502-4b48-a142-75effb54e97e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:21.376821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ec6c394-9502-4b48-a142-75effb54e97e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:22.294290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:03:22.294813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:03:22.295168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:03:22.295575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:03:22.296007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:03:22.325282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:22.326452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:22.330900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:22.331355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:22.389783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Getting quotas for project 0fe59cccd02a4327b666ecb3286d48a1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:03:22.404575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Getting quotas for user f7ed53afd4d84358bc412f5039303380 and project 0fe59cccd02a4327b666ecb3286d48a1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:03:22.431352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:03:22.435490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:03:22.507064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ec6c394-9502-4b48-a142-75effb54e97e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:22.515802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ec6c394-9502-4b48-a142-75effb54e97e tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579" status: 200 len: 1522 microversion: 2.1 time: 1.170499 Jul 26 20:03:22.527630 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2022/4015] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:21 2022] GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579 => generated 1522 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:22.536033 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a36f5cdf-5712-4c57-916d-44fb7dbfb570 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.665601 Jul 26 20:03:22.538419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-145ff90e-97df-4771-a84f-571cd24fe1b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:22.539263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-145ff90e-97df-4771-a84f-571cd24fe1b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:22.546196 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1994/4016] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:03:22.563122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-145ff90e-97df-4771-a84f-571cd24fe1b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:22.563995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-145ff90e-97df-4771-a84f-571cd24fe1b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:22.565021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-145ff90e-97df-4771-a84f-571cd24fe1b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:22.565687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-145ff90e-97df-4771-a84f-571cd24fe1b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:22.576691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:22.579344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:22.600449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:22.601407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:22.606190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:22.606738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:22.918903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:22.945984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:22.951840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:22.953146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7723405d-fb94-49de-b63c-cb67e883ad77 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.404553 Jul 26 20:03:22.954052 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1995/4017] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:22 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:22.970447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3cc318c6-51b0-436a-a6b2-b5a29724d0d6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:22.971070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3cc318c6-51b0-436a-a6b2-b5a29724d0d6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:23.166518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3cc318c6-51b0-436a-a6b2-b5a29724d0d6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:23.180218 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3cc318c6-51b0-436a-a6b2-b5a29724d0d6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1220 microversion: 2.1 time: 0.225087 Jul 26 20:03:23.181143 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1996/4018] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:22 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1220 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:23.553910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-05660987-4c94-40bb-90bb-90abd79d87f7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:23.555351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-05660987-4c94-40bb-90bb-90abd79d87f7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 5cd4c910-5089-44d9-a86d-f1043919d579] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:23.576268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05660987-4c94-40bb-90bb-90abd79d87f7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:23.579783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05660987-4c94-40bb-90bb-90abd79d87f7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:23.583545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05660987-4c94-40bb-90bb-90abd79d87f7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:23.586040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05660987-4c94-40bb-90bb-90abd79d87f7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:23.952100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-145ff90e-97df-4771-a84f-571cd24fe1b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:23.966200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-145ff90e-97df-4771-a84f-571cd24fe1b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 1.431714 Jul 26 20:03:23.966883 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2023/4019] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:22 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:23.971592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6afeef83-8d85-4c8d-be7f-f8f8df26d8d4 req-e013741a-76f6-4e59-b00f-a7bc930329a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4c910-5089-44d9-a86d-f1043919d579", "name": "network-vif-deleted", "tag": "465d4a94-d415-4c98-9e02-a1a7ceb982d2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:24.010242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6afeef83-8d85-4c8d-be7f-f8f8df26d8d4 req-e013741a-76f6-4e59-b00f-a7bc930329a0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:24.010989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6afeef83-8d85-4c8d-be7f-f8f8df26d8d4 req-e013741a-76f6-4e59-b00f-a7bc930329a0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:24.047173 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6afeef83-8d85-4c8d-be7f-f8f8df26d8d4 req-e013741a-76f6-4e59-b00f-a7bc930329a0 service nova] Creating event network-vif-deleted:465d4a94-d415-4c98-9e02-a1a7ceb982d2 for instance 5cd4c910-5089-44d9-a86d-f1043919d579 on n-h2-708768-8 Jul 26 20:03:24.067791 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6afeef83-8d85-4c8d-be7f-f8f8df26d8d4 req-e013741a-76f6-4e59-b00f-a7bc930329a0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094369 Jul 26 20:03:24.072752 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2024/4020] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:24.084097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:24.086008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:24.095719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:24.096430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:24.097403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:24.098169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:24.113136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-05660987-4c94-40bb-90bb-90abd79d87f7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:24.127455 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-05660987-4c94-40bb-90bb-90abd79d87f7 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579" status: 200 len: 1480 microversion: 2.1 time: 0.576364 Jul 26 20:03:24.129650 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1997/4021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:23 2022] GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579 => generated 1480 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:03:24.202823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-107d4723-2239-4ff9-aa02-d70bb12f1f06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:24.204267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-107d4723-2239-4ff9-aa02-d70bb12f1f06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:24.208164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:24.211792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:24.223965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-107d4723-2239-4ff9-aa02-d70bb12f1f06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:24.224140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:24.225659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:24.226050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-107d4723-2239-4ff9-aa02-d70bb12f1f06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:24.229909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-107d4723-2239-4ff9-aa02-d70bb12f1f06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:24.231210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-107d4723-2239-4ff9-aa02-d70bb12f1f06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:24.232370 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5010aecc-1103-4eb2-b0d7-cb9e20cd243e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.158126 Jul 26 20:03:24.235294 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2025/4022] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:24 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:24.572044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-107d4723-2239-4ff9-aa02-d70bb12f1f06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:24.587590 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-107d4723-2239-4ff9-aa02-d70bb12f1f06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1272 microversion: 2.1 time: 0.387684 Jul 26 20:03:24.601104 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1998/4023] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:24 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1272 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:25.000749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5aad9a2b-2e0d-4fed-991b-97231e9ca58a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:25.001501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5aad9a2b-2e0d-4fed-991b-97231e9ca58a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:25.018762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5aad9a2b-2e0d-4fed-991b-97231e9ca58a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.019228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5aad9a2b-2e0d-4fed-991b-97231e9ca58a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.043567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5aad9a2b-2e0d-4fed-991b-97231e9ca58a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.044207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5aad9a2b-2e0d-4fed-991b-97231e9ca58a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.151929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:25.152516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 5cd4c910-5089-44d9-a86d-f1043919d579] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:25.172050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.172494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.173287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.173741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.204336 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] HTTP exception thrown: Instance 5cd4c910-5089-44d9-a86d-f1043919d579 could not be found. Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Request method failure captured: Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579 HTTP/1.1 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EhO-LnWvRuPdHsfzbcAa5zAgqHELa8EaDcw_4gTUdnwhZis7xjUUc0YmqJC6Qxe708aSLa8_399VEcC8BZHArPTRKPlhEV7D3JLM9sGAvrZdyHh2C5tjje0H7BHMCLG146BWYvObuRvT8vQrrMcHYwq-2fcJO09BSyqIiNFnKy6dHU Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547dab22ce93445d964cff0949ebf9b0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}] Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 2bc86400878e478d813ada004d9aabea Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 5cd4c910-5089-44d9-a86d-f1043919d579 could not be found. Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5cd4c910-5089-44d9-a86d-f1043919d579'} Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd4c910-5089-44d9-a86d-f1043919d579 could not be found. Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd4c910-5089-44d9-a86d-f1043919d579 could not be found. Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:25.205940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:25.211235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:25.211235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:25.211235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:25.211235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:25.211235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:25.211235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd4c910-5089-44d9-a86d-f1043919d579 could not be found. Jul 26 20:03:25.211235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:25.212509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Returning 404 to user: Instance 5cd4c910-5089-44d9-a86d-f1043919d579 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:25.213381 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-59f534d2-b6e7-45a5-bee1-01605fce2821 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579" status: 404 len: 111 microversion: 2.1 time: 0.065437 Jul 26 20:03:25.217209 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 1999/4024] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:25 2022] GET /compute/v2.1/servers/5cd4c910-5089-44d9-a86d-f1043919d579 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:03:25.223398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26ca109c-0440-471a-a650-b88a048f5acc tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:25.236534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-26ca109c-0440-471a-a650-b88a048f5acc tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:25.243449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26ca109c-0440-471a-a650-b88a048f5acc tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.244296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26ca109c-0440-471a-a650-b88a048f5acc tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.245564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26ca109c-0440-471a-a650-b88a048f5acc tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.249596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26ca109c-0440-471a-a650-b88a048f5acc tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.448711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5aad9a2b-2e0d-4fed-991b-97231e9ca58a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:25.458962 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5aad9a2b-2e0d-4fed-991b-97231e9ca58a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.462437 Jul 26 20:03:25.465966 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2026/4025] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:24 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:25.471250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:25.478421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:25.493664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.498607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.508998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.509728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.711737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:25.726518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:25.733723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:25.744132 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5c65b70b-6cd2-4730-96d6-c807fc33db76 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.268653 Jul 26 20:03:25.745224 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2027/4026] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:25 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:25.751434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74c6c7de-97cd-4cd0-966b-30e91e1ab357 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:25.753564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74c6c7de-97cd-4cd0-966b-30e91e1ab357 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:25.781230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74c6c7de-97cd-4cd0-966b-30e91e1ab357 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.784349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74c6c7de-97cd-4cd0-966b-30e91e1ab357 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.794767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74c6c7de-97cd-4cd0-966b-30e91e1ab357 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:25.795644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74c6c7de-97cd-4cd0-966b-30e91e1ab357 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:25.796920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-26ca109c-0440-471a-a650-b88a048f5acc tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc86400878e478d813ada004d9aabea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547dab22ce93445d964cff0949ebf9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:25.807224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:25.822562 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26ca109c-0440-471a-a650-b88a048f5acc tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 200 len: 1481 microversion: 2.1 time: 0.598379 Jul 26 20:03:25.829978 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2000/4027] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:25 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 1481 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:25.975267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0d5cca59-5216-477b-a877-59a2a747c94d req-0013d4d7-2790-4fae-9999-d99b7f1d1964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd2515f-1836-4131-a11e-2c37104643dc", "name": "network-vif-deleted", "tag": "022e268e-ef4f-4179-a386-1d449034fa02"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:26.009914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0d5cca59-5216-477b-a877-59a2a747c94d req-0013d4d7-2790-4fae-9999-d99b7f1d1964 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.012444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0d5cca59-5216-477b-a877-59a2a747c94d req-0013d4d7-2790-4fae-9999-d99b7f1d1964 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:26.085324 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0d5cca59-5216-477b-a877-59a2a747c94d req-0013d4d7-2790-4fae-9999-d99b7f1d1964 service nova] Creating event network-vif-deleted:022e268e-ef4f-4179-a386-1d449034fa02 for instance 8fd2515f-1836-4131-a11e-2c37104643dc on n-h1-708768-8 Jul 26 20:03:26.095638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0d5cca59-5216-477b-a877-59a2a747c94d req-0013d4d7-2790-4fae-9999-d99b7f1d1964 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263323 Jul 26 20:03:26.097089 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2001/4028] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:26.105923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:26.106914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:26.145537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.146064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:26.147236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.149096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-74c6c7de-97cd-4cd0-966b-30e91e1ab357 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:26.149579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:26.158789 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74c6c7de-97cd-4cd0-966b-30e91e1ab357 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1278 microversion: 2.1 time: 0.411806 Jul 26 20:03:26.171775 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2028/4029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:25 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1278 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:26.205756 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef HTTP/1.1 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'c8827133-9f6e-48f6-9ae4-d4be69370eef'} Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:26.211678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:26.217437 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ee21dd30-a73b-4a15-b0b7-b362fa623692 tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 404 len: 111 microversion: 2.1 time: 0.119094 Jul 26 20:03:26.233137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:26.233780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] [instance: c8827133-9f6e-48f6-9ae4-d4be69370eef] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:26.244429 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2002/4030] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:03:26 2022] DELETE /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:26.254764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.255237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:26.256071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.256519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:26.304978 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] HTTP exception thrown: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Request method failure captured: Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef HTTP/1.1 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EbCYOVMhkVksUdjkXxMugsrgN6C5AQbSlv0TTB1g-Jz-shjITUWHFLkP8zbWpScPbd5UGWIo4NGQyh0cM9CycUKwrXaYBBkJ_3VviOGbPGNzP9fHkwBIYZ1pz6zDNhzdUoozNiKia9pUagJUl_JdIWy0GJ3Vf7-PElJboku7-h26jU Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a16253a71a24312a17022e4f01ed652", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a16253a71a24312a17022e4f01ed652"}]}] Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2a16253a71a24312a17022e4f01ed652 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1592040813 Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 889459c783694048b93438ce16b75d0f Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeNegativeTest-1592040813-project Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'c8827133-9f6e-48f6-9ae4-d4be69370eef'} Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:26.306710 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] Returning 404 to user: Instance c8827133-9f6e-48f6-9ae4-d4be69370eef could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-055db3b5-a821-4f6c-bab1-845dd53ea92e tempest-AttachVolumeNegativeTest-1592040813 tempest-AttachVolumeNegativeTest-1592040813-project] 10.222.0.58 "GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef" status: 404 len: 111 microversion: 2.1 time: 0.079774 Jul 26 20:03:26.310800 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2029/4031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:26 2022] GET /compute/v2.1/servers/c8827133-9f6e-48f6-9ae4-d4be69370eef => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:03:26.487737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2f919866-4e09-490e-ba2c-211ebc47ff8e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:26.488869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2f919866-4e09-490e-ba2c-211ebc47ff8e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:26.508147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f919866-4e09-490e-ba2c-211ebc47ff8e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.508616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f919866-4e09-490e-ba2c-211ebc47ff8e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:26.521013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f919866-4e09-490e-ba2c-211ebc47ff8e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.521656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f919866-4e09-490e-ba2c-211ebc47ff8e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:26.773351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:26.774151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:26.790297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.790861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:26.791545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:26.792019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:27.024376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2f919866-4e09-490e-ba2c-211ebc47ff8e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:27.034780 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2f919866-4e09-490e-ba2c-211ebc47ff8e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.552177 Jul 26 20:03:27.038053 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2003/4032] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:26 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:27.043865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:27.044643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] [instance: 8fd2515f-1836-4131-a11e-2c37104643dc] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:27.062194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:27.063074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:27.064180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:27.064773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:27.087836 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] HTTP exception thrown: Instance 8fd2515f-1836-4131-a11e-2c37104643dc could not be found. Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Request method failure captured: Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc HTTP/1.1 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EhO-LnWvRuPdHsfzbcAa5zAgqHELa8EaDcw_4gTUdnwhZis7xjUUc0YmqJC6Qxe708aSLa8_399VEcC8BZHArPTRKPlhEV7D3JLM9sGAvrZdyHh2C5tjje0H7BHMCLG146BWYvObuRvT8vQrrMcHYwq-2fcJO09BSyqIiNFnKy6dHU Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_547dab22ce93445d964cff0949ebf9b0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/547dab22ce93445d964cff0949ebf9b0"}]}] Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 547dab22ce93445d964cff0949ebf9b0 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1726461658 Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 2bc86400878e478d813ada004d9aabea Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ListServersNegativeTestJSON-1726461658-project Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 8fd2515f-1836-4131-a11e-2c37104643dc could not be found. Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8fd2515f-1836-4131-a11e-2c37104643dc'} Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd2515f-1836-4131-a11e-2c37104643dc could not be found. Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd2515f-1836-4131-a11e-2c37104643dc could not be found. Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:27.089828 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:27.094309 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:27.094309 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:27.094309 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:27.094309 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:27.094309 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:27.094309 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd2515f-1836-4131-a11e-2c37104643dc could not be found. Jul 26 20:03:27.094309 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:03:27.100081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] Returning 404 to user: Instance 8fd2515f-1836-4131-a11e-2c37104643dc could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:27.101330 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-88789bad-43e3-4906-8be2-554b96b20912 tempest-ListServersNegativeTestJSON-1726461658 tempest-ListServersNegativeTestJSON-1726461658-project] 10.222.0.58 "GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc" status: 404 len: 111 microversion: 2.1 time: 0.062035 Jul 26 20:03:27.102349 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2004/4033] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:27 2022] GET /compute/v2.1/servers/8fd2515f-1836-4131-a11e-2c37104643dc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:03:27.195461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7524d860-f3eb-409a-a969-952f86ff4fc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:27.199364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7524d860-f3eb-409a-a969-952f86ff4fc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:27.216923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7524d860-f3eb-409a-a969-952f86ff4fc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:27.217396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7524d860-f3eb-409a-a969-952f86ff4fc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:27.221568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7524d860-f3eb-409a-a969-952f86ff4fc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:27.223736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7524d860-f3eb-409a-a969-952f86ff4fc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:27.356071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7524d860-f3eb-409a-a969-952f86ff4fc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:27.371970 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7524d860-f3eb-409a-a969-952f86ff4fc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1278 microversion: 2.1 time: 0.182245 Jul 26 20:03:27.374442 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2005/4034] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:27 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:27.526344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:27.542191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:27.545275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:27.547493 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ac20c2e-39ea-4803-82db-18d3a87498d9 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.778872 Jul 26 20:03:27.554587 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2030/4035] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:26 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:28.058499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e5860c26-8f54-4ba6-91ad-2381235efcfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:28.059793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e5860c26-8f54-4ba6-91ad-2381235efcfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:28.073593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5860c26-8f54-4ba6-91ad-2381235efcfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:28.074512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5860c26-8f54-4ba6-91ad-2381235efcfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:28.076574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5860c26-8f54-4ba6-91ad-2381235efcfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:28.078578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5860c26-8f54-4ba6-91ad-2381235efcfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:28.404354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-25876e92-8d4a-4c79-bd74-526d041132fd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:28.405249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-25876e92-8d4a-4c79-bd74-526d041132fd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:28.428513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25876e92-8d4a-4c79-bd74-526d041132fd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:28.432166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25876e92-8d4a-4c79-bd74-526d041132fd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:28.436949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25876e92-8d4a-4c79-bd74-526d041132fd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:28.437855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25876e92-8d4a-4c79-bd74-526d041132fd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:28.623917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e5860c26-8f54-4ba6-91ad-2381235efcfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:28.632342 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e5860c26-8f54-4ba6-91ad-2381235efcfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.577884 Jul 26 20:03:28.648469 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2006/4036] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:28 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:28.655714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:28.656593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:28.666292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:28.666987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:28.668022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:28.668616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:28.750751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:28.768928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:28.771013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:28.772441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fdab97ae-235f-4a90-b609-8c0f2dc8e05f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.122633 Jul 26 20:03:28.788970 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2007/4037] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:28 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:29.112190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-25876e92-8d4a-4c79-bd74-526d041132fd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:29.123034 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-25876e92-8d4a-4c79-bd74-526d041132fd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.731757 Jul 26 20:03:29.128275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2031/4038] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:28 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:29.662053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-be83fd02-b6d7-48d9-bc9a-8b65a56daebb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:29.664283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-be83fd02-b6d7-48d9-bc9a-8b65a56daebb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:29.693507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be83fd02-b6d7-48d9-bc9a-8b65a56daebb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:29.694676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be83fd02-b6d7-48d9-bc9a-8b65a56daebb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:29.696312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be83fd02-b6d7-48d9-bc9a-8b65a56daebb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:29.697675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be83fd02-b6d7-48d9-bc9a-8b65a56daebb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:29.802207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:29.803153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:29.824999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:29.825637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:29.826624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:29.827099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:30.140274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:30.169527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:30.183578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:30.186932 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-091da060-5e63-4ac0-9e1d-0e4552d24352 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.390057 Jul 26 20:03:30.193437 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2032/4039] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:29 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:03:30.214106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-70ccb0ca-f542-4538-ba00-275c943eebe5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:30.221446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-70ccb0ca-f542-4538-ba00-275c943eebe5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:30.252666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70ccb0ca-f542-4538-ba00-275c943eebe5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:30.253122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70ccb0ca-f542-4538-ba00-275c943eebe5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:30.254542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70ccb0ca-f542-4538-ba00-275c943eebe5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:30.255147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70ccb0ca-f542-4538-ba00-275c943eebe5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:30.367462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:30.432398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:30.625310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-be83fd02-b6d7-48d9-bc9a-8b65a56daebb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:30.640172 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-be83fd02-b6d7-48d9-bc9a-8b65a56daebb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.982503 Jul 26 20:03:30.641024 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2008/4040] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:29 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:30.687303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-74758bfd-0b82-4393-b981-2a1134a40c7f req-2c52fab0-3e4c-4772-8cb3-112475f77976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff84d0fe-f57f-493c-8d44-e35a4a0822b9", "tag": "2ad0073d-3009-46f3-9863-a228cdb73480"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:30.728675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-74758bfd-0b82-4393-b981-2a1134a40c7f req-2c52fab0-3e4c-4772-8cb3-112475f77976 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:30.730023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-74758bfd-0b82-4393-b981-2a1134a40c7f req-2c52fab0-3e4c-4772-8cb3-112475f77976 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:30.792705 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-74758bfd-0b82-4393-b981-2a1134a40c7f req-2c52fab0-3e4c-4772-8cb3-112475f77976 service nova] Creating event network-changed:2ad0073d-3009-46f3-9863-a228cdb73480 for instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 on n-h2-708768-8 Jul 26 20:03:30.802698 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-74758bfd-0b82-4393-b981-2a1134a40c7f req-2c52fab0-3e4c-4772-8cb3-112475f77976 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157945 Jul 26 20:03:30.804869 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2009/4041] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:30.878221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-70ccb0ca-f542-4538-ba00-275c943eebe5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:30.887733 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-70ccb0ca-f542-4538-ba00-275c943eebe5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.692942 Jul 26 20:03:30.905644 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2033/4042] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:30 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:31.220453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:31.221159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:31.245005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:31.248650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:31.249752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:31.263635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:31.289960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-710c282a-c6fe-4c19-b3a1-3d9fd6091876 req-35523eef-2594-46c9-a589-da1683ae1f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a14e8f8-8e9e-454c-b231-336dc0b596b0", "tag": "a1c922a1-fcd3-449b-b22b-f6746593d986"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:31.320453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-710c282a-c6fe-4c19-b3a1-3d9fd6091876 req-35523eef-2594-46c9-a589-da1683ae1f54 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:31.321709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-710c282a-c6fe-4c19-b3a1-3d9fd6091876 req-35523eef-2594-46c9-a589-da1683ae1f54 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:31.355845 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-710c282a-c6fe-4c19-b3a1-3d9fd6091876 req-35523eef-2594-46c9-a589-da1683ae1f54 service nova] Creating event network-changed:a1c922a1-fcd3-449b-b22b-f6746593d986 for instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 on n-h2-708768-8 Jul 26 20:03:31.368842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-710c282a-c6fe-4c19-b3a1-3d9fd6091876 req-35523eef-2594-46c9-a589-da1683ae1f54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087502 Jul 26 20:03:31.370027 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2034/4043] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:03:31.471449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:31.492023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:31.493557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:31.494815 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-453b47db-ef1b-411e-95a2-5e8b4c45da17 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.280354 Jul 26 20:03:31.511658 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2010/4044] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:31 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:31.664750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-01ac7065-9921-4212-9c83-7e9dfa34242e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:31.666314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-01ac7065-9921-4212-9c83-7e9dfa34242e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:31.687655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01ac7065-9921-4212-9c83-7e9dfa34242e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:31.688422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01ac7065-9921-4212-9c83-7e9dfa34242e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:31.689647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01ac7065-9921-4212-9c83-7e9dfa34242e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:31.690678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01ac7065-9921-4212-9c83-7e9dfa34242e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:31.910579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-594975da-4fd4-42b8-b1e4-59dc4a4c031f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:31.912531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-594975da-4fd4-42b8-b1e4-59dc4a4c031f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:31.928929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-594975da-4fd4-42b8-b1e4-59dc4a4c031f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:31.928929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-594975da-4fd4-42b8-b1e4-59dc4a4c031f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:31.929240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-594975da-4fd4-42b8-b1e4-59dc4a4c031f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:31.929748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-594975da-4fd4-42b8-b1e4-59dc4a4c031f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:32.373687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:32.610627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-594975da-4fd4-42b8-b1e4-59dc4a4c031f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:32.622108 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-594975da-4fd4-42b8-b1e4-59dc4a4c031f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.715572 Jul 26 20:03:32.628860 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2011/4045] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:31 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:32.637522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:32.642965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:32.673063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:32.674485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:32.675285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:32.676382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:32.826782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:32.849201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:32.851916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:32.864979 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c828de6-8959-40f0-ab07-dad9cfcb16b1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.231129 Jul 26 20:03:32.865746 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2012/4046] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:32 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:32.985364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-01ac7065-9921-4212-9c83-7e9dfa34242e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:33.008316 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-01ac7065-9921-4212-9c83-7e9dfa34242e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 1.347570 Jul 26 20:03:33.011455 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2035/4047] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:31 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:33.024524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-37821b61-35c7-4279-ab1f-7f72c9364b58 req-4d1f9626-4715-4fba-8123-a42932647b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9de37c2-47e8-4891-b2e7-e7a3ec748a73", "tag": "fce0391c-8cf1-42f2-ae34-b6e67b8bc248"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:33.068584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-37821b61-35c7-4279-ab1f-7f72c9364b58 req-4d1f9626-4715-4fba-8123-a42932647b6d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:33.072379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-37821b61-35c7-4279-ab1f-7f72c9364b58 req-4d1f9626-4715-4fba-8123-a42932647b6d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:33.098547 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-37821b61-35c7-4279-ab1f-7f72c9364b58 req-4d1f9626-4715-4fba-8123-a42932647b6d service nova] Creating event network-changed:fce0391c-8cf1-42f2-ae34-b6e67b8bc248 for instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 on n-h2-708768-8 Jul 26 20:03:33.127748 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-37821b61-35c7-4279-ab1f-7f72c9364b58 req-4d1f9626-4715-4fba-8123-a42932647b6d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108546 Jul 26 20:03:33.131971 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2013/4048] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:03:33.651366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5695cb77-2452-43ca-bf51-c675ca4c69bb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:33.652203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5695cb77-2452-43ca-bf51-c675ca4c69bb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:33.661771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5695cb77-2452-43ca-bf51-c675ca4c69bb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:33.667674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5695cb77-2452-43ca-bf51-c675ca4c69bb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:33.668724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5695cb77-2452-43ca-bf51-c675ca4c69bb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:33.669285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5695cb77-2452-43ca-bf51-c675ca4c69bb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:33.890573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=14 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:33.897153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:33.898166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:33.919110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:33.919567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:33.922296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:33.922919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:34.376904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5695cb77-2452-43ca-bf51-c675ca4c69bb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:34.394464 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5695cb77-2452-43ca-bf51-c675ca4c69bb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.748175 Jul 26 20:03:34.395077 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2036/4049] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:33 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:34.424168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a6e3237d-4468-4a96-8644-114dfd33e598 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:34.424782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a6e3237d-4468-4a96-8644-114dfd33e598 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:34.453685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6e3237d-4468-4a96-8644-114dfd33e598 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:34.454145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6e3237d-4468-4a96-8644-114dfd33e598 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:34.454931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6e3237d-4468-4a96-8644-114dfd33e598 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:34.455368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6e3237d-4468-4a96-8644-114dfd33e598 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:34.974598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:34.984121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:34.985909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:34.986824 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7862c597-8880-43b6-99fd-f7ec03d71a2f tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 1.097214 Jul 26 20:03:34.987389 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2014/4050] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:33 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:35.060273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6e3237d-4468-4a96-8644-114dfd33e598 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:35.072873 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a6e3237d-4468-4a96-8644-114dfd33e598 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.652503 Jul 26 20:03:35.075768 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2037/4051] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:34 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:35.423441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eef619b5-b8cf-4bbf-9d07-379ab6a90ec0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:35.424080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eef619b5-b8cf-4bbf-9d07-379ab6a90ec0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:35.435430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eef619b5-b8cf-4bbf-9d07-379ab6a90ec0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:35.448194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eef619b5-b8cf-4bbf-9d07-379ab6a90ec0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:35.452293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eef619b5-b8cf-4bbf-9d07-379ab6a90ec0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:35.452952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eef619b5-b8cf-4bbf-9d07-379ab6a90ec0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:36.011833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:36.011833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:36.041436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:36.041893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:36.042673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:36.043111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:36.093931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eef619b5-b8cf-4bbf-9d07-379ab6a90ec0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:36.111278 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eef619b5-b8cf-4bbf-9d07-379ab6a90ec0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.693465 Jul 26 20:03:36.112353 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2015/4052] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:35 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:36.119801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dd9290ee-c5da-44c4-9118-513d3add0c99 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:36.120701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dd9290ee-c5da-44c4-9118-513d3add0c99 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:36.138304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:36.147312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd9290ee-c5da-44c4-9118-513d3add0c99 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:36.148422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd9290ee-c5da-44c4-9118-513d3add0c99 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:36.155108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd9290ee-c5da-44c4-9118-513d3add0c99 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:36.162492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd9290ee-c5da-44c4-9118-513d3add0c99 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:36.193307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:36.205075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:36.210487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:36.213548 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38906885-e0cc-4ed6-8daa-34d8a9d1a8f2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.206811 Jul 26 20:03:36.216382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2038/4053] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:36 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:03:36.643650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dd9290ee-c5da-44c4-9118-513d3add0c99 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:36.668500 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dd9290ee-c5da-44c4-9118-513d3add0c99 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.552116 Jul 26 20:03:36.676195 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2016/4054] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:36 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:37.133521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1ec81518-41b5-4cca-ae56-49aaaf41790e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:37.135168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1ec81518-41b5-4cca-ae56-49aaaf41790e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:37.161859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ec81518-41b5-4cca-ae56-49aaaf41790e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:37.162485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ec81518-41b5-4cca-ae56-49aaaf41790e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:37.166424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ec81518-41b5-4cca-ae56-49aaaf41790e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:37.167073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ec81518-41b5-4cca-ae56-49aaaf41790e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:37.241817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:37.243198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:37.252869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:37.254722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:37.256283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:37.256911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:37.559642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:37.581297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:37.589504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da0d6a89b6cd44f1b82bdf1b738b741a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6c4fcbbcad43f08177ab50a5bd6066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:37.597736 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c01d5fd8-1374-49f1-b4dd-be9bf7e6e4a1 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 200 len: 1604 microversion: 2.32 time: 0.360924 Jul 26 20:03:37.620664 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2017/4055] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:37 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 1604 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:03:37.634862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ec81518-41b5-4cca-ae56-49aaaf41790e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:37.647802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1ec81518-41b5-4cca-ae56-49aaaf41790e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.517143 Jul 26 20:03:37.652307 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2039/4056] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:37 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:37.689122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf067fc4-ae36-403f-a7a4-9207d789d6ec tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:37.689740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf067fc4-ae36-403f-a7a4-9207d789d6ec tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:37.702827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf067fc4-ae36-403f-a7a4-9207d789d6ec tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:37.703565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf067fc4-ae36-403f-a7a4-9207d789d6ec tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:37.708625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf067fc4-ae36-403f-a7a4-9207d789d6ec tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:37.709287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf067fc4-ae36-403f-a7a4-9207d789d6ec tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:38.626567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:38.627241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:38.637198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cf067fc4-ae36-403f-a7a4-9207d789d6ec tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:38.642156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:38.642942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:38.643418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:38.643896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:38.647722 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf067fc4-ae36-403f-a7a4-9207d789d6ec tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1498 microversion: 2.1 time: 0.962607 Jul 26 20:03:38.648976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2018/4057] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:37 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1498 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:38.690135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] HTTP exception thrown: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Request method failure captured: Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 HTTP/1.1 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eb8oCzLXaaBQTg9KvBmBQBUG3F5bWYBJ924GVw4G3HXq6GlED4oUYOy6fBSkRAG4riXFA2Rdr4ES4srYQhsAh3vKUVgz6vo1ao4NyFoTzoiitAX8BHTpGXmBBwQK1tmilPbLevh-PiDsA8OoOh25XcnY4H4jdMlvgIfQi9CGD7UyVc Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: de6c4fcbbcad43f08177ab50a5bd6066 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de6c4fcbbcad43f08177ab50a5bd6066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de6c4fcbbcad43f08177ab50a5bd6066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de6c4fcbbcad43f08177ab50a5bd6066", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de6c4fcbbcad43f08177ab50a5bd6066"}]}] Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: de6c4fcbbcad43f08177ab50a5bd6066 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TaggedBootDevicesTest-1828762091-project Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: da0d6a89b6cd44f1b82bdf1b738b741a Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TaggedBootDevicesTest-1828762091-project Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7'} Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:38.692594 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Returning 404 to user: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:38.696965 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e3c3489-63c6-42e0-bd8f-78702907dda2 tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 404 len: 111 microversion: 2.32 time: 0.071401 Jul 26 20:03:38.701299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-98c0468f-f660-4c9f-901b-4bb243a005a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:38.702229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-98c0468f-f660-4c9f-901b-4bb243a005a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:38.703955 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2040/4058] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:38 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:03:38.713153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-416c28b6-1a1a-4000-8f57-bd12671da0ef tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '.version_select at 0x7f8756e32ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:38.713483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-98c0468f-f660-4c9f-901b-4bb243a005a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:38.714041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-98c0468f-f660-4c9f-901b-4bb243a005a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:38.714935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-98c0468f-f660-4c9f-901b-4bb243a005a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:38.715876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-98c0468f-f660-4c9f-901b-4bb243a005a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:38.753118 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-416c28b6-1a1a-4000-8f57-bd12671da0ef tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934864880" status: 204 len: 0 microversion: 2.32 time: 0.047899 Jul 26 20:03:38.754494 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2041/4059] 10.222.0.58 () {60 vars in 1259 bytes} [Tue Jul 26 20:03:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934864880 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:03:39.156427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-98c0468f-f660-4c9f-901b-4bb243a005a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:39.182205 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-98c0468f-f660-4c9f-901b-4bb243a005a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.483252 Jul 26 20:03:39.182938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2019/4060] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:38 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:39.673649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9b505e6-2cb8-4f67-878e-c60e687b901e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:39.674278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9b505e6-2cb8-4f67-878e-c60e687b901e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:39.692744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9b505e6-2cb8-4f67-878e-c60e687b901e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:39.693212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9b505e6-2cb8-4f67-878e-c60e687b901e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:39.694016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9b505e6-2cb8-4f67-878e-c60e687b901e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:39.694466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9b505e6-2cb8-4f67-878e-c60e687b901e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:40.010029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9b505e6-2cb8-4f67-878e-c60e687b901e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:40.028376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9b505e6-2cb8-4f67-878e-c60e687b901e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 200 len: 1475 microversion: 2.1 time: 0.358427 Jul 26 20:03:40.029187 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2042/4061] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:39 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 1475 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:40.059079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0810462-e4a4-409a-88b1-9e66726842e4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-543098790"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:40.062337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0810462-e4a4-409a-88b1-9e66726842e4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:40.080894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0810462-e4a4-409a-88b1-9e66726842e4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:40.081729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0810462-e4a4-409a-88b1-9e66726842e4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:40.082713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0810462-e4a4-409a-88b1-9e66726842e4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:40.083315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0810462-e4a4-409a-88b1-9e66726842e4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:40.149179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:40.189051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7c946d8f-1ee4-4bbc-9064-d0c315610ca3 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:40.189575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7c946d8f-1ee4-4bbc-9064-d0c315610ca3 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:40.207687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c946d8f-1ee4-4bbc-9064-d0c315610ca3 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:40.208164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c946d8f-1ee4-4bbc-9064-d0c315610ca3 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:40.208971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c946d8f-1ee4-4bbc-9064-d0c315610ca3 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:40.209418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c946d8f-1ee4-4bbc-9064-d0c315610ca3 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:40.274900 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7c946d8f-1ee4-4bbc-9064-d0c315610ca3 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/ips" status: 200 len: 151 microversion: 2.20 time: 0.097800 Jul 26 20:03:40.275831 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2043/4062] 10.222.0.58 () {60 vars in 1289 bytes} [Tue Jul 26 20:03:40 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/ips => generated 151 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:03:40.281550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af2b9110-02d8-4fa6-97d8-b6bf1bf745e9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:40.282471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-af2b9110-02d8-4fa6-97d8-b6bf1bf745e9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:40.296744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af2b9110-02d8-4fa6-97d8-b6bf1bf745e9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:40.299787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af2b9110-02d8-4fa6-97d8-b6bf1bf745e9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:40.301202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af2b9110-02d8-4fa6-97d8-b6bf1bf745e9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:40.303664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af2b9110-02d8-4fa6-97d8-b6bf1bf745e9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:40.432861 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0810462-e4a4-409a-88b1-9e66726842e4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b/action" status: 202 len: 0 microversion: 2.1 time: 0.377460 Jul 26 20:03:40.440003 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2020/4063] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:03:40 2022] POST /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 20:03:40.446648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e701f4c-7b4a-430c-bfe7-d4c8448e1cda tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875ecdcaf0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:40.521006 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e701f4c-7b4a-430c-bfe7-d4c8448e1cda tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.077549 Jul 26 20:03:40.529504 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2021/4064] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:40 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:41.104640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af2b9110-02d8-4fa6-97d8-b6bf1bf745e9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:41.119630 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-af2b9110-02d8-4fa6-97d8-b6bf1bf745e9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.842293 Jul 26 20:03:41.122309 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2044/4065] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:40 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:41.539971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68b4c7db-109e-4c7a-93c1-40b882fde964 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f876825f8b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:41.587869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fb93fb0e-810d-4ed5-afed-ec1e550f9e47 req-1f48c18f-d23d-4078-862b-3e812d90aaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff84d0fe-f57f-493c-8d44-e35a4a0822b9", "name": "network-vif-plugged", "status": "completed", "tag": "2ad0073d-3009-46f3-9863-a228cdb73480"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:41.625255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fb93fb0e-810d-4ed5-afed-ec1e550f9e47 req-1f48c18f-d23d-4078-862b-3e812d90aaaa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:41.625255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fb93fb0e-810d-4ed5-afed-ec1e550f9e47 req-1f48c18f-d23d-4078-862b-3e812d90aaaa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:41.627055 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68b4c7db-109e-4c7a-93c1-40b882fde964 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.094325 Jul 26 20:03:41.636426 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2022/4066] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:41 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:41.666007 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fb93fb0e-810d-4ed5-afed-ec1e550f9e47 req-1f48c18f-d23d-4078-862b-3e812d90aaaa service nova] Creating event network-vif-plugged:2ad0073d-3009-46f3-9863-a228cdb73480 for instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 on n-h2-708768-8 Jul 26 20:03:41.681323 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fb93fb0e-810d-4ed5-afed-ec1e550f9e47 req-1f48c18f-d23d-4078-862b-3e812d90aaaa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098317 Jul 26 20:03:41.684038 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2045/4067] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:03:42.142313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-21ae1f78-dd22-4c96-ba6e-6f6a9d0e39f5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:42.143070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-21ae1f78-dd22-4c96-ba6e-6f6a9d0e39f5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:42.154620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-21ae1f78-dd22-4c96-ba6e-6f6a9d0e39f5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:42.160314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-21ae1f78-dd22-4c96-ba6e-6f6a9d0e39f5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:42.161580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-21ae1f78-dd22-4c96-ba6e-6f6a9d0e39f5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:42.163495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-21ae1f78-dd22-4c96-ba6e-6f6a9d0e39f5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:42.642917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1c191654-ace0-47b4-97c1-8be1f4ff53dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87682d5ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:42.725574 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1c191654-ace0-47b4-97c1-8be1f4ff53dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.086664 Jul 26 20:03:42.746134 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2046/4068] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:42 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:42.914747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-21ae1f78-dd22-4c96-ba6e-6f6a9d0e39f5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:42.958349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-21ae1f78-dd22-4c96-ba6e-6f6a9d0e39f5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 0.819828 Jul 26 20:03:42.958979 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2023/4069] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:42 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:43.714118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-acb2e69c-082d-4be2-957f-587cff8f1021 req-e97315ef-dc8b-49fe-8962-2dc16b8244a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a14e8f8-8e9e-454c-b231-336dc0b596b0", "name": "network-vif-plugged", "status": "completed", "tag": "a1c922a1-fcd3-449b-b22b-f6746593d986"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:43.730433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-acb2e69c-082d-4be2-957f-587cff8f1021 req-e97315ef-dc8b-49fe-8962-2dc16b8244a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:43.730896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-acb2e69c-082d-4be2-957f-587cff8f1021 req-e97315ef-dc8b-49fe-8962-2dc16b8244a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:43.742460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eae5f8bc-0ed3-499c-a4f9-eb2cef980753 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e3fcf70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:43.767230 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-acb2e69c-082d-4be2-957f-587cff8f1021 req-e97315ef-dc8b-49fe-8962-2dc16b8244a5 service nova] Creating event network-vif-plugged:a1c922a1-fcd3-449b-b22b-f6746593d986 for instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 on n-h2-708768-8 Jul 26 20:03:43.773674 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-acb2e69c-082d-4be2-957f-587cff8f1021 req-e97315ef-dc8b-49fe-8962-2dc16b8244a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064728 Jul 26 20:03:43.774842 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2047/4070] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:43.847919 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eae5f8bc-0ed3-499c-a4f9-eb2cef980753 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.110336 Jul 26 20:03:43.858487 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2024/4071] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:43 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:43.912196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8325a5e8-5b3f-4fa6-9d2b-475948f73072 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:43.912681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8325a5e8-5b3f-4fa6-9d2b-475948f73072 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:43.935718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8325a5e8-5b3f-4fa6-9d2b-475948f73072 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:43.935946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8325a5e8-5b3f-4fa6-9d2b-475948f73072 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:43.936759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8325a5e8-5b3f-4fa6-9d2b-475948f73072 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:43.948001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8325a5e8-5b3f-4fa6-9d2b-475948f73072 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:43.952525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:43.979238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d93ebd0b-f187-4bd1-adab-72234148a62e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:43.979909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d93ebd0b-f187-4bd1-adab-72234148a62e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:43.990456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d93ebd0b-f187-4bd1-adab-72234148a62e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:43.990909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d93ebd0b-f187-4bd1-adab-72234148a62e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:43.991910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d93ebd0b-f187-4bd1-adab-72234148a62e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:43.998702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d93ebd0b-f187-4bd1-adab-72234148a62e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:44.045355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-8325a5e8-5b3f-4fa6-9d2b-475948f73072 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lazy-loading 'flavor' on Instance uuid f87df55d-ecd6-431b-8f7b-95ef5e1132eb {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:03:44.407939 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8325a5e8-5b3f-4fa6-9d2b-475948f73072 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/action" status: 202 len: 0 microversion: 2.20 time: 0.500710 Jul 26 20:03:44.425366 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2048/4072] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 20:03:43 2022] POST /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:03:44.452511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:44.454785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:44.465948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:44.471546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:44.473743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:44.475029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:44.476741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:44.955369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:44.973229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:44.976551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:44.979694 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21128d45-940c-4f01-bfcb-937a378dd0c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 0.552589 Jul 26 20:03:44.982057 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2049/4073] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:44 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:44.987579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c0113f73-3928-4ad9-9b72-af01b924c342 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87566aa790>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:45.115130 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c0113f73-3928-4ad9-9b72-af01b924c342 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.131653 Jul 26 20:03:45.115760 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2050/4074] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:44 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:45.322026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d93ebd0b-f187-4bd1-adab-72234148a62e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:45.330044 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d93ebd0b-f187-4bd1-adab-72234148a62e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1320 microversion: 2.1 time: 1.354567 Jul 26 20:03:45.351814 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2025/4075] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:43 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1320 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:46.009830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:46.010625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:46.025732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:46.026433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:46.027670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:46.028494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:46.315162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2d7e21ba-89a9-4621-b40d-7fa4620df001 req-b8ada5ee-eb54-467b-9e0b-1da9a41d9b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9de37c2-47e8-4891-b2e7-e7a3ec748a73", "name": "network-vif-plugged", "status": "completed", "tag": "fce0391c-8cf1-42f2-ae34-b6e67b8bc248"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:46.328317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2d7e21ba-89a9-4621-b40d-7fa4620df001 req-b8ada5ee-eb54-467b-9e0b-1da9a41d9b7c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:46.329099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2d7e21ba-89a9-4621-b40d-7fa4620df001 req-b8ada5ee-eb54-467b-9e0b-1da9a41d9b7c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:46.342373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2d7e21ba-89a9-4621-b40d-7fa4620df001 req-b8ada5ee-eb54-467b-9e0b-1da9a41d9b7c service nova] Creating event network-vif-plugged:fce0391c-8cf1-42f2-ae34-b6e67b8bc248 for instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 on n-h2-708768-8 Jul 26 20:03:46.350229 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2d7e21ba-89a9-4621-b40d-7fa4620df001 req-b8ada5ee-eb54-467b-9e0b-1da9a41d9b7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359491 Jul 26 20:03:46.351598 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2051/4076] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:46.374639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d18d6f31-9751-4f04-ad59-65a165741e40 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875679aa60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:46.384721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:46.401751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:46.404764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:46.407763 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cbebf25a-a3f1-4e4a-89a4-3f0e51a2e0e5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 0.402659 Jul 26 20:03:46.410522 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2026/4077] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:46 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:03:46.415697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-285d06da-8508-4cee-9171-d629d93af755 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:46.417092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-285d06da-8508-4cee-9171-d629d93af755 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:46.443365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-285d06da-8508-4cee-9171-d629d93af755 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:46.449742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-285d06da-8508-4cee-9171-d629d93af755 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:46.451588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-285d06da-8508-4cee-9171-d629d93af755 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:46.452621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-285d06da-8508-4cee-9171-d629d93af755 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:46.478583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d18d6f31-9751-4f04-ad59-65a165741e40 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.125270 Jul 26 20:03:46.479711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2052/4078] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:46 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:46.900993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-285d06da-8508-4cee-9171-d629d93af755 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:46.918301 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-285d06da-8508-4cee-9171-d629d93af755 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1511 microversion: 2.1 time: 0.506304 Jul 26 20:03:46.919577 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2027/4079] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:46 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:46.945857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-001aa8a4-8dfc-4926-890c-e668ba6b70a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:46.947034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-001aa8a4-8dfc-4926-890c-e668ba6b70a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:46.957031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-001aa8a4-8dfc-4926-890c-e668ba6b70a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:46.957838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-001aa8a4-8dfc-4926-890c-e668ba6b70a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:46.959447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-001aa8a4-8dfc-4926-890c-e668ba6b70a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:46.960153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-001aa8a4-8dfc-4926-890c-e668ba6b70a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:47.436579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:47.437989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:47.455732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:47.456879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:47.459989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:47.462588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:47.854960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-001aa8a4-8dfc-4926-890c-e668ba6b70a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:47.890133 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-001aa8a4-8dfc-4926-890c-e668ba6b70a0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1511 microversion: 2.1 time: 0.948297 Jul 26 20:03:47.891239 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2053/4080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:46 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1511 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:47.911051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afd89e58-afe0-433b-b0dd-c1066bb7f653 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87570e5c10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:47.986572 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afd89e58-afe0-433b-b0dd-c1066bb7f653 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.092216 Jul 26 20:03:47.999321 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2054/4081] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:47 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:48.006794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5faf5a62-656f-4aa4-aac6-034dcbab9eae tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:48.007886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5faf5a62-656f-4aa4-aac6-034dcbab9eae tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:48.016933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5faf5a62-656f-4aa4-aac6-034dcbab9eae tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:48.017625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5faf5a62-656f-4aa4-aac6-034dcbab9eae tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:48.018586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5faf5a62-656f-4aa4-aac6-034dcbab9eae tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:48.050705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5faf5a62-656f-4aa4-aac6-034dcbab9eae tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:48.346221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5faf5a62-656f-4aa4-aac6-034dcbab9eae tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:48.359817 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5faf5a62-656f-4aa4-aac6-034dcbab9eae tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 200 len: 1321 microversion: 2.1 time: 0.355295 Jul 26 20:03:48.361182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2055/4082] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:47 2022] GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:48.379871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c324c7b5-0b66-4359-ae79-32ea5b589bdd req-0738e331-f115-4f0d-88ce-3a9e6cea2685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f5ce3e-2965-4521-9c04-54f6b5b3836b", "name": "network-vif-plugged", "status": "completed", "tag": "fea01703-4f87-46fa-baa0-8d144d9b823c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:48.399191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c324c7b5-0b66-4359-ae79-32ea5b589bdd req-0738e331-f115-4f0d-88ce-3a9e6cea2685 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:48.400200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c324c7b5-0b66-4359-ae79-32ea5b589bdd req-0738e331-f115-4f0d-88ce-3a9e6cea2685 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:48.424541 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c324c7b5-0b66-4359-ae79-32ea5b589bdd req-0738e331-f115-4f0d-88ce-3a9e6cea2685 service nova] Creating event network-vif-plugged:fea01703-4f87-46fa-baa0-8d144d9b823c for instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b on n-h1-708768-8 Jul 26 20:03:48.436617 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c324c7b5-0b66-4359-ae79-32ea5b589bdd req-0738e331-f115-4f0d-88ce-3a9e6cea2685 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061283 Jul 26 20:03:48.438541 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2056/4083] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:03:48.700286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:48.762542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:48.771017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:48.775898 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-013ec26c-ddee-4c67-9e6c-c7411a47b965 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 1.341872 Jul 26 20:03:48.778278 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2028/4084] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:47 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:49.002939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d15c4627-ee51-4982-b03e-7b7ac00a55ed tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8768403ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:49.144812 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d15c4627-ee51-4982-b03e-7b7ac00a55ed tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.146423 Jul 26 20:03:49.145714 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2057/4085] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:48 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:49.381737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7e0de12-1ef8-4852-92e0-b045aa8cbb71 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:49.382371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c7e0de12-1ef8-4852-92e0-b045aa8cbb71 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:49.391549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7e0de12-1ef8-4852-92e0-b045aa8cbb71 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:49.397264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7e0de12-1ef8-4852-92e0-b045aa8cbb71 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:49.400826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7e0de12-1ef8-4852-92e0-b045aa8cbb71 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:49.404230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7e0de12-1ef8-4852-92e0-b045aa8cbb71 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:49.804780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:49.805770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:49.823698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:49.831253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:49.833287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:49.833923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:49.958639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c7e0de12-1ef8-4852-92e0-b045aa8cbb71 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:49.968360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c7e0de12-1ef8-4852-92e0-b045aa8cbb71 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 200 len: 1512 microversion: 2.1 time: 0.590813 Jul 26 20:03:49.968944 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2029/4086] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:49 2022] GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 1512 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:49.999108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:50.010556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:50.015503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:50.082733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:50.083981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:50.090112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:50.090874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:50.273277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:50.421036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:50.444804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:50.445767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:50.981631 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1686369-6dc1-4fcd-a1fe-e6024b057c8e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.986548 Jul 26 20:03:51.007930 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2030/4087] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Jul 26 20:03:49 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:51.016479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8f2c4e48-f427-42a5-b171-3e164e099428 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e200dc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:51.106841 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8f2c4e48-f427-42a5-b171-3e164e099428 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.097389 Jul 26 20:03:51.116245 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2031/4088] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:51 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:51.122587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:51.130246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:51.131297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-603619539', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:51.150085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:51.150940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:51.152000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:51.152589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:51.329986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:51.377588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:51.379705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:51.382337 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a60a01a0-2197-4a32-b09d-9872de1b7516 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 1.581597 Jul 26 20:03:51.386246 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2058/4089] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:49 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:51.553067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:51.553835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:51.587754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:51.591372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:51.592561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:51.598144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:51.600215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:51.657066 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] HTTP exception thrown: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Request method failure captured: Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 HTTP/1.1 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eb8oCzLXaaBQTg9KvBmBQBUG3F5bWYBJ924GVw4G3HXq6GlED4oUYOy6fBSkRAG4riXFA2Rdr4ES4srYQhsAh3vKUVgz6vo1ao4NyFoTzoiitAX8BHTpGXmBBwQK1tmilPbLevh-PiDsA8OoOh25XcnY4H4jdMlvgIfQi9CGD7UyVc Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: de6c4fcbbcad43f08177ab50a5bd6066 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de6c4fcbbcad43f08177ab50a5bd6066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de6c4fcbbcad43f08177ab50a5bd6066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de6c4fcbbcad43f08177ab50a5bd6066", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de6c4fcbbcad43f08177ab50a5bd6066"}]}] Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: de6c4fcbbcad43f08177ab50a5bd6066 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TaggedBootDevicesTest-1828762091-project Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: da0d6a89b6cd44f1b82bdf1b738b741a Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TaggedBootDevicesTest-1828762091-project Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7'} Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:51.663276 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Returning 404 to user: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:51.670800 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5d27b49c-9a77-490f-8f51-5520e58bc84d tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "DELETE /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 404 len: 111 microversion: 2.32 time: 0.118634 Jul 26 20:03:51.673735 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2059/4090] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:03:51 2022] DELETE /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:03:51.689807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:51.690470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] [instance: 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:51.711753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:51.712247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:51.715588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:51.716132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:51.759805 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] HTTP exception thrown: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Request method failure captured: Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 HTTP/1.1 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eb8oCzLXaaBQTg9KvBmBQBUG3F5bWYBJ924GVw4G3HXq6GlED4oUYOy6fBSkRAG4riXFA2Rdr4ES4srYQhsAh3vKUVgz6vo1ao4NyFoTzoiitAX8BHTpGXmBBwQK1tmilPbLevh-PiDsA8OoOh25XcnY4H4jdMlvgIfQi9CGD7UyVc Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: de6c4fcbbcad43f08177ab50a5bd6066 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de6c4fcbbcad43f08177ab50a5bd6066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de6c4fcbbcad43f08177ab50a5bd6066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de6c4fcbbcad43f08177ab50a5bd6066", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de6c4fcbbcad43f08177ab50a5bd6066"}]}] Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: de6c4fcbbcad43f08177ab50a5bd6066 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1828762091 Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TaggedBootDevicesTest-1828762091-project Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: da0d6a89b6cd44f1b82bdf1b738b741a Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TaggedBootDevicesTest-1828762091-project Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7'} Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:03:51.761600 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.766264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:03:51.766264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:03:51.766264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:03:51.766264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:03:51.766264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:03:51.766264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. Jul 26 20:03:51.766264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:03:51.770058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] Returning 404 to user: Instance 69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:03:51.774415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8fa9f96d-2653-41ec-b044-4ef58de8c40e tempest-TaggedBootDevicesTest-1828762091 tempest-TaggedBootDevicesTest-1828762091-project] 10.222.0.58 "GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7" status: 404 len: 111 microversion: 2.32 time: 0.099997 Jul 26 20:03:51.775180 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2060/4091] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:51 2022] GET /compute/v2.1/servers/69490cdb-b8c0-411e-8ac9-aab3ddd5cbe7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:03:51.805319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:51.817066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:51.818039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:52.134940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cbe8551-a78f-496c-9aa2-13940d758aac tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875679a790>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:52.247571 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cbe8551-a78f-496c-9aa2-13940d758aac tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.121042 Jul 26 20:03:52.252957 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2061/4092] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:52 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:52.417381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:52.418075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:52.437768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:52.439517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:52.440386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:52.441488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:52.850772 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-850e5b21-d4d6-4a6d-872d-2fecb3637a6f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-603619539" status: 200 len: 1514 microversion: 2.1 time: 1.732739 Jul 26 20:03:52.851380 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2032/4093] 10.222.0.58 () {58 vars in 1261 bytes} [Tue Jul 26 20:03:51 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-603619539 => generated 1514 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:52.880157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:52.904937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:52.905543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:52.906477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:52.923863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:52.934151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:52.942883 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-62e9c587-5d2c-41bc-8458-b8a0d6a9e41c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 0.532089 Jul 26 20:03:52.948908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:52.949703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:52.955799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:52.957262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:52.970135 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2062/4094] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:52 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:53.225035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:53.264856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dc0bfeac-c528-4dda-a799-48ddda027d21 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875679a280>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:53.396819 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dc0bfeac-c528-4dda-a799-48ddda027d21 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.135820 Jul 26 20:03:53.398868 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2063/4095] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:53 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:53.415961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:53.436170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:53.438003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:53.742354 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-edb662f6-420b-4e5f-9f88-a48ea69017b9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.866485 Jul 26 20:03:53.743720 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2033/4096] 10.222.0.58 () {58 vars in 1173 bytes} [Tue Jul 26 20:03:52 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:53.777546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:53.786768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:53.792159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.servers [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Removing options 'limit' from query {{(pid=125964) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 20:03:53.793401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:53.801902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:53.802673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:53.803753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:53.804520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:53.853079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:53.862489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:53.863904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:53.975676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:53.976399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:53.986061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:53.986524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:53.987320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:53.988019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:54.388501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-97730e31-93a4-4438-a868-be424b08d68c tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.602484 Jul 26 20:03:54.388501 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2064/4097] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 20:03:53 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:54.411441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:54.431930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:54.432979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:54.454506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:54.458601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:54.460618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:54.463829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:54.825800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:54.984015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:54.995059 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-97e3c1c7-f6e6-459b-b75b-16254ccfdb8d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.589200 Jul 26 20:03:55.004958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:55.006445 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2065/4098] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:03:54 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:03:55.013038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-237e4326-cc7d-4f88-a51f-83dfd75477de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8756fe8820>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:55.015317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:55.020847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-909a18d3-4a7c-4b6e-a2c3-6315699d97de tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 1.050289 Jul 26 20:03:55.036685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2034/4099] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:53 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:55.056822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:55.072329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:55.075218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.compute.servers [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Removing options 'limit' from query {{(pid=125963) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 20:03:55.076168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:55.110641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:55.114385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:55.120353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:55.123410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:55.160521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-237e4326-cc7d-4f88-a51f-83dfd75477de tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.152200 Jul 26 20:03:55.161661 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2066/4100] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:55 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:55.234629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:55.316478 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8a46bc50-e3f9-4422-8617-bd8d753057e0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.283990 Jul 26 20:03:55.327227 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2035/4101] 10.222.0.58 () {58 vars in 1150 bytes} [Tue Jul 26 20:03:55 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:55.334605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:55.340795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:55.342518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:55.358569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:55.361017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:55.362032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:55.364269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:55.421697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:55.492757 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5974eff-04e9-48b8-af8f-298e0d87e019 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.163906 Jul 26 20:03:55.493285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2067/4102] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 20:03:55 2022] GET /compute/v2.1/servers => generated 1010 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:55.508084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:55.513449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:55.523909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:55.561069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:55.561855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:55.562891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:55.563539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:55.765911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:55.875479 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-975657a8-1219-4a88-8f8d-2db053a3d440 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.372548 Jul 26 20:03:55.876314 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2036/4103] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 20:03:55 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:55.891860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:55.898669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:55.909652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.servers [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Removing options 'limit' from query {{(pid=125964) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 20:03:55.911026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:55.929092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:55.932172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:55.933231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:55.948056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:56.027909 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9b0c0d0f-98db-4e46-a7a8-86ea7ad24537 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.141800 Jul 26 20:03:56.029818 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2068/4104] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Jul 26 20:03:55 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:56.044417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:56.049733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:56.051120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-603619539', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:03:56.058584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:56.064926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:56.067310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:56.072081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:56.073600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:56.074439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:56.081817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:56.082334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:56.083175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:56.083640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:56.303476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:03:56.322627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:56.470983 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1922c851-893f-4ce8-80d6-f52afce29621 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-603619539" status: 200 len: 345 microversion: 2.1 time: 0.430920 Jul 26 20:03:56.479456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2037/4105] 10.222.0.58 () {58 vars in 1240 bytes} [Tue Jul 26 20:03:56 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-603619539 => generated 345 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:03:56.486570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4b6eb823-6577-4d50-9eaf-bc83b2ab313d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e1d7820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:56.535948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:56.551619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:56.564512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:56.568039 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d49ea2e2-678b-4444-8377-497bd00bb83a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 0.519034 Jul 26 20:03:56.571067 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2069/4106] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:56 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:56.585518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-da34a492-ca81-4bf7-8074-194fb00e314e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:03:56.591165 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4b6eb823-6577-4d50-9eaf-bc83b2ab313d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.117627 Jul 26 20:03:56.592482 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2038/4107] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:56 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:56.614612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da34a492-ca81-4bf7-8074-194fb00e314e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:56.616501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da34a492-ca81-4bf7-8074-194fb00e314e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:56.819051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-da34a492-ca81-4bf7-8074-194fb00e314e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Going to try to stop instance {{(pid=125964) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:03:56.944673 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-da34a492-ca81-4bf7-8074-194fb00e314e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "POST /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9/action" status: 202 len: 0 microversion: 2.1 time: 0.372203 Jul 26 20:03:56.957076 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2070/4108] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:03:56 2022] POST /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:03:56.965976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-280d484d-3b49-418c-81f5-1fe989aa1174 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:56.966864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-280d484d-3b49-418c-81f5-1fe989aa1174 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:56.986519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-280d484d-3b49-418c-81f5-1fe989aa1174 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:56.986978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-280d484d-3b49-418c-81f5-1fe989aa1174 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:56.988073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-280d484d-3b49-418c-81f5-1fe989aa1174 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:56.988637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-280d484d-3b49-418c-81f5-1fe989aa1174 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:57.529795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-280d484d-3b49-418c-81f5-1fe989aa1174 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:57.542928 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-280d484d-3b49-418c-81f5-1fe989aa1174 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 0.581244 Jul 26 20:03:57.543865 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2039/4109] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:56 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:57.596783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:57.598567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:57.607878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-274b73b1-d78a-45ec-91ae-3bb74a4e82e5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f876843d4c0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:57.625184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:57.625641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:57.626438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:57.626885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:57.704349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-274b73b1-d78a-45ec-91ae-3bb74a4e82e5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.100892 Jul 26 20:03:57.706069 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2040/4110] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:57 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:03:57.745274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:03:58.007538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:58.027799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:58.036220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:58.040460 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f2001b2-9600-4aa2-bbae-67f8a084aab5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 0.448056 Jul 26 20:03:58.043196 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2071/4111] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:57 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:58.566252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d34dd662-7e17-4028-85ba-c8b4951da894 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:58.566870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d34dd662-7e17-4028-85ba-c8b4951da894 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:58.594779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d34dd662-7e17-4028-85ba-c8b4951da894 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:58.596270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d34dd662-7e17-4028-85ba-c8b4951da894 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:58.597770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d34dd662-7e17-4028-85ba-c8b4951da894 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:58.599389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d34dd662-7e17-4028-85ba-c8b4951da894 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:58.721174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea7e716a-1339-4f29-b605-75806e718e53 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87684110d0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:58.840312 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea7e716a-1339-4f29-b605-75806e718e53 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.123716 Jul 26 20:03:58.844327 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2072/4112] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:58 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:03:59.074495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:59.075142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:03:59.086469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:59.087277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:59.088550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:03:59.089155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:03:59.480043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:59.498310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:59.499888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:03:59.501129 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc2f5143-74c0-4e1a-81df-57299ff08a71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 0.437264 Jul 26 20:03:59.518023 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2073/4113] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:03:59 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:03:59.855497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff25d849-0f45-40e9-8b50-893d7172e340 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87574b3af0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:03:59.929273 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff25d849-0f45-40e9-8b50-893d7172e340 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.078153 Jul 26 20:03:59.929880 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2074/4114] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:03:59 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:00.528918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:00.536636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:00.554739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d34dd662-7e17-4028-85ba-c8b4951da894 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:00.563375 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d34dd662-7e17-4028-85ba-c8b4951da894 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 2.002100 Jul 26 20:04:00.571124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:00.571852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:00.572795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:00.574041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:00.580678 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2041/4115] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:03:58 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:00.944951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fcbd6fcb-f2e2-4b22-8b5e-459082c0ad6c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8768385a60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:01.104325 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fcbd6fcb-f2e2-4b22-8b5e-459082c0ad6c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.163584 Jul 26 20:04:01.110786 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2042/4116] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:00 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:01.293905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:01.320126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:01.325814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:01.327508 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ae797cb1-c0f4-43c7-a6f8-7081a909040b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1743 microversion: 2.20 time: 0.803250 Jul 26 20:04:01.328503 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2075/4117] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:00 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1743 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:04:01.592403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc598a11-8529-4677-9942-a1f919aba515 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:01.593607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc598a11-8529-4677-9942-a1f919aba515 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:01.613603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc598a11-8529-4677-9942-a1f919aba515 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:01.614438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc598a11-8529-4677-9942-a1f919aba515 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:01.617547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc598a11-8529-4677-9942-a1f919aba515 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:01.620284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc598a11-8529-4677-9942-a1f919aba515 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:02.124298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ce68cfb-2a80-4e52-9b42-78f1621b493c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87570e5310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:02.530225 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ce68cfb-2a80-4e52-9b42-78f1621b493c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1413 microversion: 2.1 time: 0.409690 Jul 26 20:04:02.531117 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2076/4118] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:02 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1413 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:02.542861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:02.543577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:02.592482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:02.592953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:02.604158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:02.605793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:02.773156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bc598a11-8529-4677-9942-a1f919aba515 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:02.788324 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc598a11-8529-4677-9942-a1f919aba515 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 1.202229 Jul 26 20:04:02.807208 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2043/4119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:01 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:03.203445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:03.213148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:03.227454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:03.232221 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4275ff7-a83c-4801-9beb-1e9cc41748a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.700026 Jul 26 20:04:03.250233 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2077/4120] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:02 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:03.546358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-43018525-95bd-4638-9ac9-2bc6b944a5ee tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87682b6670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:03.562474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:03.831907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c879a977-f7c6-4a21-a646-c56b73b8f02a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:03.832805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c879a977-f7c6-4a21-a646-c56b73b8f02a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:03.851170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:03.861855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c879a977-f7c6-4a21-a646-c56b73b8f02a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:03.863653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c879a977-f7c6-4a21-a646-c56b73b8f02a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:03.871444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c879a977-f7c6-4a21-a646-c56b73b8f02a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:03.875698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c879a977-f7c6-4a21-a646-c56b73b8f02a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:05.214780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c879a977-f7c6-4a21-a646-c56b73b8f02a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:05.264913 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c879a977-f7c6-4a21-a646-c56b73b8f02a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 1.438543 Jul 26 20:04:05.297571 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2078/4121] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:03 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:05.305897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:05.306685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:05.314947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:05.316929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:05.318461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:05.319529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:05.579658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:05.612675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:05.620594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:05.622088 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15dbc396-8a17-4e60-8c00-fbd7bf6d9724 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.323198 Jul 26 20:04:05.625582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2079/4122] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:05 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:05.960078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:06.157203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:06.462232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef853b9a-52bb-4e7d-85d4-6add3a6f0f8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'create', calling method: .version_select at 0x7f8756f453a0>, body: {"keypair": {"name": "tempest-keypair-1651712900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm3EetIpASchjtA96H4DzjpemPGC3lI5J/pkbSB1Ppp78rljly465jq0i4sz560fBtfYTKHsrR7EmcAp3HMtdyDwWfHVavpGZA/jzI0K83WQW3P4O+5AMZIMTnTEUGrdQ=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:06.527863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ef853b9a-52bb-4e7d-85d4-6add3a6f0f8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:04:06.553976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ef853b9a-52bb-4e7d-85d4-6add3a6f0f8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for user 4418a0cb57744aa5a56a3fdcce0947cc and project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:04:06.715873 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef853b9a-52bb-4e7d-85d4-6add3a6f0f8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.079515 Jul 26 20:04:06.720987 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2080/4123] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:04:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:06.753901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22ae9635-1e88-4cc5-bae7-4cfaa9391742 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:06.764017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-22ae9635-1e88-4cc5-bae7-4cfaa9391742 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:06.799279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22ae9635-1e88-4cc5-bae7-4cfaa9391742 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:06.800334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22ae9635-1e88-4cc5-bae7-4cfaa9391742 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:06.804022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22ae9635-1e88-4cc5-bae7-4cfaa9391742 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:06.804695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22ae9635-1e88-4cc5-bae7-4cfaa9391742 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:07.618752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22ae9635-1e88-4cc5-bae7-4cfaa9391742 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:07.645315 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22ae9635-1e88-4cc5-bae7-4cfaa9391742 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 0.918845 Jul 26 20:04:07.647097 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2081/4124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:06 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:07.715280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:07.720492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:07.744410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:07.744856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:07.745661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:07.746097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:08.907405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:08.923122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:08.926373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:08.932331 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f358fc3e-c02a-4f89-884c-04e6178809c6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 1.238240 Jul 26 20:04:08.934125 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2082/4125] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:07 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:08.945560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ef6c04cd-dce6-4fd6-8240-44303cbab1c2 req-f7b2898d-45f7-401b-953f-6b798656e8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f87df55d-ecd6-431b-8f7b-95ef5e1132eb", "name": "network-vif-plugged", "status": "completed", "tag": "5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:08.969741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ef6c04cd-dce6-4fd6-8240-44303cbab1c2 req-f7b2898d-45f7-401b-953f-6b798656e8ad service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:08.971300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ef6c04cd-dce6-4fd6-8240-44303cbab1c2 req-f7b2898d-45f7-401b-953f-6b798656e8ad service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:09.011296 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ef6c04cd-dce6-4fd6-8240-44303cbab1c2 req-f7b2898d-45f7-401b-953f-6b798656e8ad service nova] Creating event network-vif-plugged:5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad for instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb on n-h1-708768-8 Jul 26 20:04:09.041634 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ef6c04cd-dce6-4fd6-8240-44303cbab1c2 req-f7b2898d-45f7-401b-953f-6b798656e8ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096717 Jul 26 20:04:09.042411 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2083/4126] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:09.065086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8344bff5-58cd-4ab3-b750-2f89f0cbcca6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:09.071139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8344bff5-58cd-4ab3-b750-2f89f0cbcca6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:09.105063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8344bff5-58cd-4ab3-b750-2f89f0cbcca6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:09.107319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8344bff5-58cd-4ab3-b750-2f89f0cbcca6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:09.108439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8344bff5-58cd-4ab3-b750-2f89f0cbcca6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:09.116455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8344bff5-58cd-4ab3-b750-2f89f0cbcca6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:09.786302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8344bff5-58cd-4ab3-b750-2f89f0cbcca6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:09.810833 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8344bff5-58cd-4ab3-b750-2f89f0cbcca6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 0.763995 Jul 26 20:04:09.826199 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2084/4127] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:09 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:09.960347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:09.961789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:09.972246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:09.975350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:09.977463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:09.982893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:10.625862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:10.639426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:10.645301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:10.659897 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f1645dc-a7d6-4662-8e8d-733698c104f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.706172 Jul 26 20:04:10.667942 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2085/4128] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:09 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:10.836513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-33d6bc86-f97e-4444-a409-2e1602bb653a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:10.838456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-33d6bc86-f97e-4444-a409-2e1602bb653a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:10.864878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33d6bc86-f97e-4444-a409-2e1602bb653a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:10.877356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33d6bc86-f97e-4444-a409-2e1602bb653a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:10.879957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33d6bc86-f97e-4444-a409-2e1602bb653a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:10.880699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33d6bc86-f97e-4444-a409-2e1602bb653a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:11.374270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-33d6bc86-f97e-4444-a409-2e1602bb653a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:11.385621 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-33d6bc86-f97e-4444-a409-2e1602bb653a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 0.552922 Jul 26 20:04:11.396217 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2086/4129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:10 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:11.612939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=51 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:11.686697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:11.687590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:11.712694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:11.719739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:11.728966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:11.735891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:12.551347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:12.574618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:12.580003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:12.585221 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9dda2a98-9cd9-4cba-a4e8-6f73dd9be87b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.902512 Jul 26 20:04:12.594977 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2087/4130] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:11 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:12.626350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5c288fc6-eef4-434a-b27a-10df300a6eeb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:12.628483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5c288fc6-eef4-434a-b27a-10df300a6eeb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:12.665383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c288fc6-eef4-434a-b27a-10df300a6eeb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:12.668729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c288fc6-eef4-434a-b27a-10df300a6eeb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:12.672834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c288fc6-eef4-434a-b27a-10df300a6eeb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:12.680436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c288fc6-eef4-434a-b27a-10df300a6eeb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:12.787686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=22 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:13.705201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c288fc6-eef4-434a-b27a-10df300a6eeb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:13.713067 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5c288fc6-eef4-434a-b27a-10df300a6eeb tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 1.116476 Jul 26 20:04:13.738766 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2088/4131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:12 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:13.751343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:13.751998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:13.771854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:13.772342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:13.773119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:13.773562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:14.422893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:14.446836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:14.448817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:14.457250 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5fbd7f48-3389-41a7-824c-24a31ce20e19 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.716628 Jul 26 20:04:14.472296 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2089/4132] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:13 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:14.500032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1772388331", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "287d382c-eec4-43bb-95a9-783a796404b9"}], "security_groups": [{"name": "tempest-securitygroup--349774792"}], "key_name": "tempest-keypair-1651712900", "user_data": "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:16.133469 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-43018525-95bd-4638-9ac9-2bc6b944a5ee tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1422 microversion: 2.1 time: 12.590785 Jul 26 20:04:16.142001 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2044/4133] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:03 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1422 bytes in 12596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:16.158248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-07e747c1-9d3b-4dc5-bc6f-43732a5fc283 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:16.158963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-07e747c1-9d3b-4dc5-bc6f-43732a5fc283 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:16.189333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07e747c1-9d3b-4dc5-bc6f-43732a5fc283 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:16.189775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07e747c1-9d3b-4dc5-bc6f-43732a5fc283 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:16.196680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07e747c1-9d3b-4dc5-bc6f-43732a5fc283 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:16.197155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07e747c1-9d3b-4dc5-bc6f-43732a5fc283 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:16.280136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] validate_networks() for [('287d382c-eec4-43bb-95a9-783a796404b9', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:04:16.592013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:16.747725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-07e747c1-9d3b-4dc5-bc6f-43732a5fc283 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:16.759118 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-07e747c1-9d3b-4dc5-bc6f-43732a5fc283 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1521 microversion: 2.1 time: 0.620538 Jul 26 20:04:16.789098 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2045/4134] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:16 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:16.796770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:16.797766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:16.807974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:16.810616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:16.813598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:16.814326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:16.996742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:17.074137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:17.093966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:17.096200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:17.098204 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5d13abd3-3e83-47c2-af9e-7d506eef1bd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.307083 Jul 26 20:04:17.100915 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2046/4135] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:16 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:17.115213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6eacb525-4bcd-48e6-b90f-55908fdc2ae7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8768346940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:17.232855 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6eacb525-4bcd-48e6-b90f-55908fdc2ae7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 200 len: 1422 microversion: 2.1 time: 0.130628 Jul 26 20:04:17.234043 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2047/4136] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:17 2022] GET /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:17.261811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ba349b0-737b-444b-89cf-56bde733d934 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e1b68b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:17.617260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:04:17.619019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:04:17.619973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:04:17.620630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:04:17.621836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:04:17.648299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:17.649309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:17.651280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:17.653347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:17.710406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:04:17.730267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for user 4418a0cb57744aa5a56a3fdcce0947cc and project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:04:17.774271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:04:17.788973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:04:17.857702 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8235f4fa-d39f-452d-b319-9539fc8218a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.371163 Jul 26 20:04:17.861030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2090/4137] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:04:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 3388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:04:17.873909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ae460ccb-9ec0-44de-91e8-d646728585c6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:17.880695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ae460ccb-9ec0-44de-91e8-d646728585c6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:17.893835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae460ccb-9ec0-44de-91e8-d646728585c6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:17.894282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae460ccb-9ec0-44de-91e8-d646728585c6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:17.898416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae460ccb-9ec0-44de-91e8-d646728585c6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:17.899107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae460ccb-9ec0-44de-91e8-d646728585c6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:18.861654 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ba349b0-737b-444b-89cf-56bde733d934 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 204 len: 0 microversion: 2.1 time: 1.610852 Jul 26 20:04:18.863815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2048/4138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:17 2022] DELETE /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 0 bytes in 1613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:04:18.871516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-44143144-3fc5-41fb-96cd-25fcfcc9e6cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:18.873788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-44143144-3fc5-41fb-96cd-25fcfcc9e6cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:18.886342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae460ccb-9ec0-44de-91e8-d646728585c6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:18.905976 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ae460ccb-9ec0-44de-91e8-d646728585c6 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1498 microversion: 2.1 time: 1.043556 Jul 26 20:04:18.923549 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2091/4139] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:17 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1498 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:18.948072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:18.949078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:18.961817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:18.962611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:18.963703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:18.964699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:19.001592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-44143144-3fc5-41fb-96cd-25fcfcc9e6cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:19.015253 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-44143144-3fc5-41fb-96cd-25fcfcc9e6cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1239 microversion: 2.1 time: 0.149648 Jul 26 20:04:19.016132 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2049/4140] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:18 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1239 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:19.041735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-871bb281-d89b-41a4-87ee-3fef3b55818f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:19.048417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-871bb281-d89b-41a4-87ee-3fef3b55818f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:19.060291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-871bb281-d89b-41a4-87ee-3fef3b55818f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:19.060930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-871bb281-d89b-41a4-87ee-3fef3b55818f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:19.062033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-871bb281-d89b-41a4-87ee-3fef3b55818f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:19.062623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-871bb281-d89b-41a4-87ee-3fef3b55818f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:19.122824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-871bb281-d89b-41a4-87ee-3fef3b55818f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:04:19.430685 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-871bb281-d89b-41a4-87ee-3fef3b55818f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 204 len: 0 microversion: 2.1 time: 0.411997 Jul 26 20:04:19.431306 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2050/4141] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:04:19 2022] DELETE /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:04:19.441857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:19.465488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:19.471059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:19.483313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:19.486682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:19.490433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:19.491124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:19.556203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:19.556541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:19.564623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:19.573013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:19.583795 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b590fffa-7303-4f4d-8440-1fa87a389022 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.654217 Jul 26 20:04:19.590701 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2092/4142] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:18 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:19.651058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f279a9c7-ebec-4aa4-a80f-517fa8d8f893 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.213455 Jul 26 20:04:19.664743 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2051/4143] 10.222.0.58 () {58 vars in 1154 bytes} [Tue Jul 26 20:04:19 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:19.668614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9bcc2386-c930-4c98-825c-123fea28061d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:19.678080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bcc2386-c930-4c98-825c-123fea28061d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:19.680592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bcc2386-c930-4c98-825c-123fea28061d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:19.743939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:19.754725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9bcc2386-c930-4c98-825c-123fea28061d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Going to try to start instance {{(pid=125964) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 20:04:19.905465 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9bcc2386-c930-4c98-825c-123fea28061d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "POST /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9/action" status: 202 len: 0 microversion: 2.1 time: 0.240497 Jul 26 20:04:19.906121 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2093/4144] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:04:19 2022] POST /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:04:19.917346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7c8049d-afcf-4171-b120-84c1b97bf98a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:19.918180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e7c8049d-afcf-4171-b120-84c1b97bf98a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:19.958835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7c8049d-afcf-4171-b120-84c1b97bf98a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:19.962040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7c8049d-afcf-4171-b120-84c1b97bf98a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:19.965493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7c8049d-afcf-4171-b120-84c1b97bf98a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:19.965955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e7c8049d-afcf-4171-b120-84c1b97bf98a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:20.042558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-53c37b7b-bec8-4b1e-bb45-591ec3426210 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:20.045305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-53c37b7b-bec8-4b1e-bb45-591ec3426210 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:20.059325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53c37b7b-bec8-4b1e-bb45-591ec3426210 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:20.059809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53c37b7b-bec8-4b1e-bb45-591ec3426210 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:20.060598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53c37b7b-bec8-4b1e-bb45-591ec3426210 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:20.061034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53c37b7b-bec8-4b1e-bb45-591ec3426210 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:20.306880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-53c37b7b-bec8-4b1e-bb45-591ec3426210 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:20.348860 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-53c37b7b-bec8-4b1e-bb45-591ec3426210 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1243 microversion: 2.1 time: 0.310319 Jul 26 20:04:20.350170 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2094/4145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:20 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1243 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:20.355178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2008843043", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7c43ed99-78c0-4e29-b511-cd8d44018d0b"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:20.535988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] validate_networks() for [('7c43ed99-78c0-4e29-b511-cd8d44018d0b', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:04:22.389021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e7c8049d-afcf-4171-b120-84c1b97bf98a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:22.426067 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7c8049d-afcf-4171-b120-84c1b97bf98a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1507 microversion: 2.1 time: 2.510246 Jul 26 20:04:22.440106 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2052/4146] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:19 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1507 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:22.447034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:22.450287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:22.475550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:22.476466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:22.479026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:22.479781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:22.619653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:04:22.620166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:04:22.620563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:04:22.620980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:04:22.621395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:04:22.647450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:22.648503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:22.649927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:22.651390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:22.725418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Getting quotas for project a715ad339a264f918507acfd8a1180f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:04:22.760398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Getting quotas for user f82c738a399d4688b1870ea46700ac71 and project a715ad339a264f918507acfd8a1180f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:04:22.805789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:04:22.810281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:04:22.971162 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cdff83da-d473-428c-876a-f9bccb4266a5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.615448 Jul 26 20:04:22.973671 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2095/4147] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:04:22.985944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-479b8427-e4c6-48e2-be14-2cb2abac1b83 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:22.986570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-479b8427-e4c6-48e2-be14-2cb2abac1b83 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:23.016849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-479b8427-e4c6-48e2-be14-2cb2abac1b83 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:23.019562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-479b8427-e4c6-48e2-be14-2cb2abac1b83 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:23.022666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-479b8427-e4c6-48e2-be14-2cb2abac1b83 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:23.023172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-479b8427-e4c6-48e2-be14-2cb2abac1b83 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:23.225357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-479b8427-e4c6-48e2-be14-2cb2abac1b83 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:23.245535 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-479b8427-e4c6-48e2-be14-2cb2abac1b83 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1297 microversion: 2.1 time: 0.265661 Jul 26 20:04:23.246693 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2096/4148] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:22 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1297 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:23.273302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a315a696-8133-4767-815f-783bf060ad13 req-79b9a6c1-4217-4009-9eea-37a78ef5ccac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f5ce3e-2965-4521-9c04-54f6b5b3836b", "name": "network-vif-unplugged", "status": "completed", "tag": "fea01703-4f87-46fa-baa0-8d144d9b823c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:23.310789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a315a696-8133-4767-815f-783bf060ad13 req-79b9a6c1-4217-4009-9eea-37a78ef5ccac service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:23.311226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a315a696-8133-4767-815f-783bf060ad13 req-79b9a6c1-4217-4009-9eea-37a78ef5ccac service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:23.359782 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a315a696-8133-4767-815f-783bf060ad13 req-79b9a6c1-4217-4009-9eea-37a78ef5ccac service nova] Creating event network-vif-unplugged:fea01703-4f87-46fa-baa0-8d144d9b823c for instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b on n-h1-708768-8 Jul 26 20:04:23.373468 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a315a696-8133-4767-815f-783bf060ad13 req-79b9a6c1-4217-4009-9eea-37a78ef5ccac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122888 Jul 26 20:04:23.374499 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2097/4149] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:23.391702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d82431b7-3fc2-42ce-87ba-2ea262761830 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:23.392858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d82431b7-3fc2-42ce-87ba-2ea262761830 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:23.701887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d82431b7-3fc2-42ce-87ba-2ea262761830 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:23.710161 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d82431b7-3fc2-42ce-87ba-2ea262761830 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1208 microversion: 2.1 time: 0.333235 Jul 26 20:04:23.710768 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2098/4150] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:23 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1208 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:23.734215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a8c832bb-4d62-4301-9f89-82af5cd0a9bf tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:23.746540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a8c832bb-4d62-4301-9f89-82af5cd0a9bf tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:23.783824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8c832bb-4d62-4301-9f89-82af5cd0a9bf tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:23.790436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8c832bb-4d62-4301-9f89-82af5cd0a9bf tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:23.796275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8c832bb-4d62-4301-9f89-82af5cd0a9bf tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:23.800177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8c832bb-4d62-4301-9f89-82af5cd0a9bf tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:24.271920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a8c832bb-4d62-4301-9f89-82af5cd0a9bf tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:24.326302 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a8c832bb-4d62-4301-9f89-82af5cd0a9bf tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1507 microversion: 2.1 time: 0.614085 Jul 26 20:04:24.342057 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2099/4151] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:23 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:24.348586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a76e643a-d105-4180-a4de-f6936b50c47a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:24.349470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a76e643a-d105-4180-a4de-f6936b50c47a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:24.357911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a76e643a-d105-4180-a4de-f6936b50c47a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:24.358569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a76e643a-d105-4180-a4de-f6936b50c47a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:24.359553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a76e643a-d105-4180-a4de-f6936b50c47a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:24.360175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a76e643a-d105-4180-a4de-f6936b50c47a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:24.451224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a76e643a-d105-4180-a4de-f6936b50c47a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:24.465539 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a76e643a-d105-4180-a4de-f6936b50c47a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1297 microversion: 2.1 time: 0.121857 Jul 26 20:04:24.481002 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2100/4152] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:24 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1297 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:24.736792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-125056ec-fb31-4528-9c12-bcdc51c7dacd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:24.741007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-125056ec-fb31-4528-9c12-bcdc51c7dacd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:24.801284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-125056ec-fb31-4528-9c12-bcdc51c7dacd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:24.801737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-125056ec-fb31-4528-9c12-bcdc51c7dacd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:24.802538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-125056ec-fb31-4528-9c12-bcdc51c7dacd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:24.802974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-125056ec-fb31-4528-9c12-bcdc51c7dacd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:25.017203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-125056ec-fb31-4528-9c12-bcdc51c7dacd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:25.030425 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-125056ec-fb31-4528-9c12-bcdc51c7dacd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1204 microversion: 2.1 time: 0.300938 Jul 26 20:04:25.051784 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2101/4153] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:24 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1204 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:25.108293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:25.130333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:25.134002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:25.149972 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15fcb0d9-7345-4586-9fa9-03117579d12b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 2.711984 Jul 26 20:04:25.156565 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2053/4154] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:22 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 2723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:25.349838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad8363fa-d7a1-4aaa-b773-351d9c4fafc0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:25.351474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad8363fa-d7a1-4aaa-b773-351d9c4fafc0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:25.371226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad8363fa-d7a1-4aaa-b773-351d9c4fafc0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:25.372542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad8363fa-d7a1-4aaa-b773-351d9c4fafc0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:25.378573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad8363fa-d7a1-4aaa-b773-351d9c4fafc0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:25.380347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad8363fa-d7a1-4aaa-b773-351d9c4fafc0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:25.491407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fde66bcb-7a26-42ff-b4fa-655636989a8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:25.492290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fde66bcb-7a26-42ff-b4fa-655636989a8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:25.520967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fde66bcb-7a26-42ff-b4fa-655636989a8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:25.524518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fde66bcb-7a26-42ff-b4fa-655636989a8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:25.525655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fde66bcb-7a26-42ff-b4fa-655636989a8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:25.526810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fde66bcb-7a26-42ff-b4fa-655636989a8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:26.230410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad8363fa-d7a1-4aaa-b773-351d9c4fafc0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:26.249351 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad8363fa-d7a1-4aaa-b773-351d9c4fafc0 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1507 microversion: 2.1 time: 0.904420 Jul 26 20:04:26.282720 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2102/4155] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:25 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1507 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:26.305083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9eeb4868-95c9-40d5-9b9c-1ee670be99e3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:26.310423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9eeb4868-95c9-40d5-9b9c-1ee670be99e3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:26.334262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9eeb4868-95c9-40d5-9b9c-1ee670be99e3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:26.338387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9eeb4868-95c9-40d5-9b9c-1ee670be99e3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:26.344693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9eeb4868-95c9-40d5-9b9c-1ee670be99e3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:26.348433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9eeb4868-95c9-40d5-9b9c-1ee670be99e3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:26.443804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fde66bcb-7a26-42ff-b4fa-655636989a8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:26.465316 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fde66bcb-7a26-42ff-b4fa-655636989a8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1297 microversion: 2.1 time: 0.979952 Jul 26 20:04:26.469932 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2054/4156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:25 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1297 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:26.484516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:26.485517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:26.507467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:26.510243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:26.515729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:26.517590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:26.585997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9eeb4868-95c9-40d5-9b9c-1ee670be99e3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:26.601338 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9eeb4868-95c9-40d5-9b9c-1ee670be99e3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1266 microversion: 2.1 time: 0.314783 Jul 26 20:04:26.604681 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2103/4157] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:26 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:27.099713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d60c6565-5ab6-4004-9d89-11bab811334b req-fc734016-24db-44ce-b50c-ec557b8d25e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f5ce3e-2965-4521-9c04-54f6b5b3836b", "name": "network-vif-deleted", "tag": "fea01703-4f87-46fa-baa0-8d144d9b823c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:27.129468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d60c6565-5ab6-4004-9d89-11bab811334b req-fc734016-24db-44ce-b50c-ec557b8d25e8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:27.129927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d60c6565-5ab6-4004-9d89-11bab811334b req-fc734016-24db-44ce-b50c-ec557b8d25e8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:27.167273 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d60c6565-5ab6-4004-9d89-11bab811334b req-fc734016-24db-44ce-b50c-ec557b8d25e8 service nova] Creating event network-vif-deleted:fea01703-4f87-46fa-baa0-8d144d9b823c for instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b on n-h1-708768-8 Jul 26 20:04:27.192293 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d60c6565-5ab6-4004-9d89-11bab811334b req-fc734016-24db-44ce-b50c-ec557b8d25e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099290 Jul 26 20:04:27.195586 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2104/4158] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:04:27.281901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7e9651dc-7bd3-40df-bf4c-d5d49d91d508 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:27.292304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7e9651dc-7bd3-40df-bf4c-d5d49d91d508 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:27.303217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e9651dc-7bd3-40df-bf4c-d5d49d91d508 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:27.305669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e9651dc-7bd3-40df-bf4c-d5d49d91d508 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:27.308546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e9651dc-7bd3-40df-bf4c-d5d49d91d508 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:27.310213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e9651dc-7bd3-40df-bf4c-d5d49d91d508 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:27.543574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:27.562969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:27.567177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:27.584615 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8b2cb95e-f763-49e6-b86c-92341c38e17d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 1.113226 Jul 26 20:04:27.588088 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2055/4159] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:26 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:27.593205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02270d80-ca1b-403c-af6f-16679ea92c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:27.608562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-02270d80-ca1b-403c-af6f-16679ea92c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:27.633131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02270d80-ca1b-403c-af6f-16679ea92c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:27.643777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02270d80-ca1b-403c-af6f-16679ea92c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:27.645786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02270d80-ca1b-403c-af6f-16679ea92c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:27.647536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02270d80-ca1b-403c-af6f-16679ea92c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:28.384203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7e9651dc-7bd3-40df-bf4c-d5d49d91d508 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:28.398121 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7e9651dc-7bd3-40df-bf4c-d5d49d91d508 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1507 microversion: 2.1 time: 1.120681 Jul 26 20:04:28.401676 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2105/4160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:27 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1507 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:28.414723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f331b9ba-2cb5-49ff-b106-e357a2098ee1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:28.415855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f331b9ba-2cb5-49ff-b106-e357a2098ee1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:28.442962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f331b9ba-2cb5-49ff-b106-e357a2098ee1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:28.446179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f331b9ba-2cb5-49ff-b106-e357a2098ee1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:28.448440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f331b9ba-2cb5-49ff-b106-e357a2098ee1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:28.452101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f331b9ba-2cb5-49ff-b106-e357a2098ee1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:28.710524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f331b9ba-2cb5-49ff-b106-e357a2098ee1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:28.724618 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f331b9ba-2cb5-49ff-b106-e357a2098ee1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1266 microversion: 2.1 time: 0.321387 Jul 26 20:04:28.743432 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2106/4161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:28 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:28.758213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:28.758213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:28.779205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:28.780102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:28.781195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:28.781869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:28.957022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02270d80-ca1b-403c-af6f-16679ea92c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:28.981476 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02270d80-ca1b-403c-af6f-16679ea92c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1297 microversion: 2.1 time: 1.391777 Jul 26 20:04:28.981958 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2056/4162] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:27 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1297 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:29.429653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-309dad7b-4321-4873-9fad-fb22ca92c08f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:29.430272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-309dad7b-4321-4873-9fad-fb22ca92c08f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:29.432806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:29.456881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-309dad7b-4321-4873-9fad-fb22ca92c08f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:29.457860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-309dad7b-4321-4873-9fad-fb22ca92c08f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:29.464067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-309dad7b-4321-4873-9fad-fb22ca92c08f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:29.465105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-309dad7b-4321-4873-9fad-fb22ca92c08f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:29.552649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:30.417538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-309dad7b-4321-4873-9fad-fb22ca92c08f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:30.439505 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-309dad7b-4321-4873-9fad-fb22ca92c08f tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1511 microversion: 2.1 time: 1.003937 Jul 26 20:04:30.442134 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2057/4163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:29 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1511 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:30.448075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09e6e082-9945-4f32-8c41-42365c910a35 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:30.449183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-09e6e082-9945-4f32-8c41-42365c910a35 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:30.475400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09e6e082-9945-4f32-8c41-42365c910a35 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:30.477516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09e6e082-9945-4f32-8c41-42365c910a35 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:30.480571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09e6e082-9945-4f32-8c41-42365c910a35 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:30.482440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09e6e082-9945-4f32-8c41-42365c910a35 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:30.742000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09e6e082-9945-4f32-8c41-42365c910a35 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:30.750324 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09e6e082-9945-4f32-8c41-42365c910a35 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1266 microversion: 2.1 time: 0.306970 Jul 26 20:04:30.758601 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2058/4164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:30 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:30.778589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-abcd9cad-7930-4ceb-9ca6-811ab5016eae tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:30.783201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-abcd9cad-7930-4ceb-9ca6-811ab5016eae tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:30.811264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abcd9cad-7930-4ceb-9ca6-811ab5016eae tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:30.812522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abcd9cad-7930-4ceb-9ca6-811ab5016eae tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:30.816711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abcd9cad-7930-4ceb-9ca6-811ab5016eae tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:30.817366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abcd9cad-7930-4ceb-9ca6-811ab5016eae tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:31.203015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:31.217396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:31.219426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:31.227623 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a981a757-0b88-4dd8-bbe6-9f67412cc2fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 2.482398 Jul 26 20:04:31.228772 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2107/4165] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:28 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:31.241503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:31.257709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:31.258574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.servers [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Removing options 'limit' from query {{(pid=125964) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 20:04:31.260531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:31.265436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:31.266030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:31.266979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:31.269522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:31.272584 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff124bac-ef23-40ec-a9c4-ed0f9b0928db tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.040906 Jul 26 20:04:31.277547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2108/4166] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Jul 26 20:04:31 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:04:31.291797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1de3a83a-df15-477e-af13-9d5ef19bb166 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:31.292592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1de3a83a-df15-477e-af13-9d5ef19bb166 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:31.314232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1de3a83a-df15-477e-af13-9d5ef19bb166 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:31.315636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1de3a83a-df15-477e-af13-9d5ef19bb166 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:31.316725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1de3a83a-df15-477e-af13-9d5ef19bb166 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:31.320560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1de3a83a-df15-477e-af13-9d5ef19bb166 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:31.853649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-abcd9cad-7930-4ceb-9ca6-811ab5016eae tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:31.862273 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-abcd9cad-7930-4ceb-9ca6-811ab5016eae tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1364 microversion: 2.1 time: 1.102282 Jul 26 20:04:31.867537 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2059/4167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:30 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1364 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:31.872560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02c4dc20-9eeb-4c6b-99a6-f7fb66363031 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:31.888662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-02c4dc20-9eeb-4c6b-99a6-f7fb66363031 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:31.903341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02c4dc20-9eeb-4c6b-99a6-f7fb66363031 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:31.908003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02c4dc20-9eeb-4c6b-99a6-f7fb66363031 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:31.909670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02c4dc20-9eeb-4c6b-99a6-f7fb66363031 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:31.914452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02c4dc20-9eeb-4c6b-99a6-f7fb66363031 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:32.129008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02c4dc20-9eeb-4c6b-99a6-f7fb66363031 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:32.141874 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02c4dc20-9eeb-4c6b-99a6-f7fb66363031 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1266 microversion: 2.1 time: 0.273035 Jul 26 20:04:32.143739 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2060/4168] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:31 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:32.253383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:32.254371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:32.264562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:32.274676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:32.277359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:32.280318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:32.676529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:32.825414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1de3a83a-df15-477e-af13-9d5ef19bb166 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:32.840584 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1de3a83a-df15-477e-af13-9d5ef19bb166 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1511 microversion: 2.1 time: 1.552737 Jul 26 20:04:32.848543 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2109/4169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:31 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1511 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:32.868851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9643a1bc-2ea0-483e-83d6-60069ec9ee50 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:32.875267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9643a1bc-2ea0-483e-83d6-60069ec9ee50 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:32.900570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9643a1bc-2ea0-483e-83d6-60069ec9ee50 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:32.901031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9643a1bc-2ea0-483e-83d6-60069ec9ee50 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:32.901833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9643a1bc-2ea0-483e-83d6-60069ec9ee50 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:32.910734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9643a1bc-2ea0-483e-83d6-60069ec9ee50 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:33.498312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9643a1bc-2ea0-483e-83d6-60069ec9ee50 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:33.510969 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9643a1bc-2ea0-483e-83d6-60069ec9ee50 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 200 len: 1512 microversion: 2.1 time: 0.646896 Jul 26 20:04:33.512408 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2110/4170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:32 2022] GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:33.518836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57057251-792f-4773-af26-702cf1b40e16 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:33.519755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-57057251-792f-4773-af26-702cf1b40e16 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:33.528825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57057251-792f-4773-af26-702cf1b40e16 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:33.530990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57057251-792f-4773-af26-702cf1b40e16 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:33.533184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57057251-792f-4773-af26-702cf1b40e16 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:33.534528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57057251-792f-4773-af26-702cf1b40e16 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:33.706642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=14 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:33.819166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:33.845273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:33.847643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:33.849104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7ad795f1-e7d7-4e6a-a4e6-de22e33ab264 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 1.599670 Jul 26 20:04:33.852555 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2061/4171] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:32 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:33.858772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ccdae306-c9f1-4e2c-8fdb-ee17c840403c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:33.873058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ccdae306-c9f1-4e2c-8fdb-ee17c840403c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:33.921998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ccdae306-c9f1-4e2c-8fdb-ee17c840403c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:33.929158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ccdae306-c9f1-4e2c-8fdb-ee17c840403c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:33.931275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ccdae306-c9f1-4e2c-8fdb-ee17c840403c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:33.935004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ccdae306-c9f1-4e2c-8fdb-ee17c840403c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:34.003349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:34.755057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-57057251-792f-4773-af26-702cf1b40e16 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:34.773817 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-57057251-792f-4773-af26-702cf1b40e16 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1364 microversion: 2.1 time: 1.259946 Jul 26 20:04:34.775388 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2111/4172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:33 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1364 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:34.801158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3241cd25-5e68-419d-9f01-057f70fc138d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:34.803946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3241cd25-5e68-419d-9f01-057f70fc138d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:34.856932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3241cd25-5e68-419d-9f01-057f70fc138d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:34.857412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3241cd25-5e68-419d-9f01-057f70fc138d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:34.874638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3241cd25-5e68-419d-9f01-057f70fc138d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:34.875133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3241cd25-5e68-419d-9f01-057f70fc138d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:34.886475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ccdae306-c9f1-4e2c-8fdb-ee17c840403c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:34.896560 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ccdae306-c9f1-4e2c-8fdb-ee17c840403c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 1.042681 Jul 26 20:04:34.904486 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2062/4173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:33 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:34.916062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a3c5aca3-09ea-423e-8056-07e632418bc4 req-93c179ec-1b49-4ae5-bef7-5f5c273927f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:34.946790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a3c5aca3-09ea-423e-8056-07e632418bc4 req-93c179ec-1b49-4ae5-bef7-5f5c273927f6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:34.955192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a3c5aca3-09ea-423e-8056-07e632418bc4 req-93c179ec-1b49-4ae5-bef7-5f5c273927f6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:34.978225 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a3c5aca3-09ea-423e-8056-07e632418bc4 req-93c179ec-1b49-4ae5-bef7-5f5c273927f6 service nova] Creating event network-changed:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:04:34.992933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a3c5aca3-09ea-423e-8056-07e632418bc4 req-93c179ec-1b49-4ae5-bef7-5f5c273927f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084404 Jul 26 20:04:34.997548 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2063/4174] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:35.007464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:35.019172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:35.044766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:35.061412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:35.070832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:35.080145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:35.384663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:35.404702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:35.406839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:35.410374 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eaf96cda-ffc4-4fb3-a877-7eccbf183a03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.411043 Jul 26 20:04:35.417045 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2064/4175] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:34 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:35.434346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3241cd25-5e68-419d-9f01-057f70fc138d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:35.443920 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3241cd25-5e68-419d-9f01-057f70fc138d tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1511 microversion: 2.1 time: 0.663655 Jul 26 20:04:35.449389 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2112/4176] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:34 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1511 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:35.476874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:35.485980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:35.488160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:35.704279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:35.704736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:35.706072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:35.706743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:35.801516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db68cece-cbd3-427f-8cdc-081b4ce5ac6e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:35.802050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-db68cece-cbd3-427f-8cdc-081b4ce5ac6e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:35.818247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db68cece-cbd3-427f-8cdc-081b4ce5ac6e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:35.818706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db68cece-cbd3-427f-8cdc-081b4ce5ac6e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:35.819512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db68cece-cbd3-427f-8cdc-081b4ce5ac6e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:35.828216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db68cece-cbd3-427f-8cdc-081b4ce5ac6e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:35.833073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:35.932879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:36.098113 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dcd69fa0-51a1-4ec4-814f-4433cf9065fa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 345 microversion: 2.1 time: 0.624907 Jul 26 20:04:36.105869 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2065/4177] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:04:35 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 345 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:36.118840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7452dcb3-121c-41e6-baec-a7863af1d10b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:36.119451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7452dcb3-121c-41e6-baec-a7863af1d10b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:36.154479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7452dcb3-121c-41e6-baec-a7863af1d10b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:36.154935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7452dcb3-121c-41e6-baec-a7863af1d10b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:36.155753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7452dcb3-121c-41e6-baec-a7863af1d10b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:36.156193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7452dcb3-121c-41e6-baec-a7863af1d10b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:36.562703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7452dcb3-121c-41e6-baec-a7863af1d10b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:36.576109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7452dcb3-121c-41e6-baec-a7863af1d10b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 0.461053 Jul 26 20:04:36.576993 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2066/4178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:36 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:36.589416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6987239a-c191-496b-946b-eb39fc05f1b2 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:36.590401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6987239a-c191-496b-946b-eb39fc05f1b2 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:36.599563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6987239a-c191-496b-946b-eb39fc05f1b2 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:36.600288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6987239a-c191-496b-946b-eb39fc05f1b2 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:36.601783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6987239a-c191-496b-946b-eb39fc05f1b2 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:36.602610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6987239a-c191-496b-946b-eb39fc05f1b2 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:36.957206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6987239a-c191-496b-946b-eb39fc05f1b2 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:36.985983 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6987239a-c191-496b-946b-eb39fc05f1b2 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1511 microversion: 2.1 time: 0.407500 Jul 26 20:04:36.991175 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2067/4179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:36 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:37.010106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:37.011772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:37.028029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:37.028506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:37.032237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:37.032714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:37.375744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-db68cece-cbd3-427f-8cdc-081b4ce5ac6e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:37.387768 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db68cece-cbd3-427f-8cdc-081b4ce5ac6e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1364 microversion: 2.1 time: 1.590677 Jul 26 20:04:37.405435 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2113/4180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:35 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1364 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:37.405435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4115ed79-3f91-430a-988e-0dbb8b0c70ba tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:37.405435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4115ed79-3f91-430a-988e-0dbb8b0c70ba tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:37.408692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4115ed79-3f91-430a-988e-0dbb8b0c70ba tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:37.409424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4115ed79-3f91-430a-988e-0dbb8b0c70ba tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:37.411042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4115ed79-3f91-430a-988e-0dbb8b0c70ba tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:37.411499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4115ed79-3f91-430a-988e-0dbb8b0c70ba tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:37.590916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:37.647423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:37.655984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:37.657730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-24bb6b13-463b-41a1-b7ec-c38951e34d03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1738 microversion: 2.20 time: 0.665374 Jul 26 20:04:37.683191 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2068/4181] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:36 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1738 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:38.032448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-32d3fd28-96bd-4f2d-816c-461a67cf6ba0 req-a723f083-2994-49a6-9433-8c9a94394217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a44418c8-1159-440a-a9a5-f6cd8c69eb61", "tag": "64140b12-3bc8-430f-9468-585c8ba48085"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:38.046792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-32d3fd28-96bd-4f2d-816c-461a67cf6ba0 req-a723f083-2994-49a6-9433-8c9a94394217 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.047516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-32d3fd28-96bd-4f2d-816c-461a67cf6ba0 req-a723f083-2994-49a6-9433-8c9a94394217 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:38.052077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4115ed79-3f91-430a-988e-0dbb8b0c70ba tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:38.060918 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4115ed79-3f91-430a-988e-0dbb8b0c70ba tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 200 len: 1512 microversion: 2.1 time: 0.666764 Jul 26 20:04:38.061517 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2114/4182] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:37 2022] GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:38.062284 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-32d3fd28-96bd-4f2d-816c-461a67cf6ba0 req-a723f083-2994-49a6-9433-8c9a94394217 service nova] Creating event network-changed:64140b12-3bc8-430f-9468-585c8ba48085 for instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 on n-h2-708768-8 Jul 26 20:04:38.069295 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-32d3fd28-96bd-4f2d-816c-461a67cf6ba0 req-a723f083-2994-49a6-9433-8c9a94394217 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384435 Jul 26 20:04:38.069911 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2069/4183] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:38.074271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c9eb17c-07ad-4ddb-a0f2-a53b5eb5a164 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:38.074902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2c9eb17c-07ad-4ddb-a0f2-a53b5eb5a164 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:38.092097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c9eb17c-07ad-4ddb-a0f2-a53b5eb5a164 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.092553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c9eb17c-07ad-4ddb-a0f2-a53b5eb5a164 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:38.093337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c9eb17c-07ad-4ddb-a0f2-a53b5eb5a164 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.093794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c9eb17c-07ad-4ddb-a0f2-a53b5eb5a164 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:38.100041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c60e7601-8491-47dc-81e1-204682232672 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:38.101265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c60e7601-8491-47dc-81e1-204682232672 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:38.114336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c60e7601-8491-47dc-81e1-204682232672 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.115366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c60e7601-8491-47dc-81e1-204682232672 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:38.116634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c60e7601-8491-47dc-81e1-204682232672 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.117239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c60e7601-8491-47dc-81e1-204682232672 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:38.378967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c9eb17c-07ad-4ddb-a0f2-a53b5eb5a164 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:38.390618 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c9eb17c-07ad-4ddb-a0f2-a53b5eb5a164 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 0.325978 Jul 26 20:04:38.391586 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2115/4184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:38 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:38.416227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a0807b5-e383-49a2-8992-b37d680abf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:38.418275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a0807b5-e383-49a2-8992-b37d680abf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:38.429576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a0807b5-e383-49a2-8992-b37d680abf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.430371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a0807b5-e383-49a2-8992-b37d680abf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:38.431498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a0807b5-e383-49a2-8992-b37d680abf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.432183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a0807b5-e383-49a2-8992-b37d680abf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:38.780660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c60e7601-8491-47dc-81e1-204682232672 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:38.792967 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c60e7601-8491-47dc-81e1-204682232672 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1511 microversion: 2.1 time: 0.710769 Jul 26 20:04:38.806753 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2070/4185] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:38 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1511 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:38.811508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:38.813624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:38.822322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.823324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:38.828441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:38.828959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:39.142483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a0807b5-e383-49a2-8992-b37d680abf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:39.152682 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a0807b5-e383-49a2-8992-b37d680abf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1364 microversion: 2.1 time: 0.742878 Jul 26 20:04:39.160615 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2116/4186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:38 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1364 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:39.168058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:39.173491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:39.174831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:39.180792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:39.181550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:39.182354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:39.182790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:39.227434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:39.271633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:39.280851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:39.282202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:39.304411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:39.313991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:39.328711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:39.330179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c30f5f53-0a94-4842-83d5-ab7bc804e456 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1720 microversion: 2.20 time: 0.535075 Jul 26 20:04:39.347537 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2071/4187] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:38 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1720 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:39.414568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2624af40-8651-4cf0-87d4-bfa0f81dc8dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:39.415203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2624af40-8651-4cf0-87d4-bfa0f81dc8dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:39.421922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2624af40-8651-4cf0-87d4-bfa0f81dc8dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:39.422368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2624af40-8651-4cf0-87d4-bfa0f81dc8dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:39.423932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2624af40-8651-4cf0-87d4-bfa0f81dc8dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:39.425103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2624af40-8651-4cf0-87d4-bfa0f81dc8dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:39.695049 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd7e4813-9f7b-4272-8069-450ffe4295bd tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.532922 Jul 26 20:04:39.697370 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2117/4188] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 20:04:39 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:39.727279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:39.733443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:39.734387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:39.837655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2624af40-8651-4cf0-87d4-bfa0f81dc8dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:39.851107 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2624af40-8651-4cf0-87d4-bfa0f81dc8dd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 0.440768 Jul 26 20:04:39.853381 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2072/4189] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:39 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:39.938282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:39.938981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:39.939984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:39.940551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.067813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:40.146583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa5594b8-206a-4cce-9c90-3251ca730100 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.424003 Jul 26 20:04:40.147553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2118/4190] 10.222.0.58 () {58 vars in 1150 bytes} [Tue Jul 26 20:04:39 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:40.161910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:40.167069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:40.167866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:40.177582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.178540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.180171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.180767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.184814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd6a2b64-4f17-4691-a4e2-22ff69dfd821 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:40.188253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd6a2b64-4f17-4691-a4e2-22ff69dfd821 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:40.195882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd6a2b64-4f17-4691-a4e2-22ff69dfd821 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.196722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd6a2b64-4f17-4691-a4e2-22ff69dfd821 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.197874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd6a2b64-4f17-4691-a4e2-22ff69dfd821 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.198472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd6a2b64-4f17-4691-a4e2-22ff69dfd821 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.341993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:40.440563 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2aaad7cb-9ab9-405b-b78d-0f2912e297d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.281669 Jul 26 20:04:40.442479 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2073/4191] 10.222.0.58 () {58 vars in 1212 bytes} [Tue Jul 26 20:04:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:40.449292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:40.450116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:40.463024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.465502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.468282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.469719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.533676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd6a2b64-4f17-4691-a4e2-22ff69dfd821 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:40.545046 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd6a2b64-4f17-4691-a4e2-22ff69dfd821 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1364 microversion: 2.1 time: 0.366967 Jul 26 20:04:40.545646 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2119/4192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:40 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:40.556451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:40.594859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:40.605230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:40.620252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.620698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.621499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.621939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.842101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:40.949294 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-700af2ac-211f-4b64-b373-63ee7e71548a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.396496 Jul 26 20:04:40.957326 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2120/4193] 10.222.0.58 () {58 vars in 1196 bytes} [Tue Jul 26 20:04:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:40.962985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-41b95bab-715b-458f-9754-70916f5d1bfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:40.964018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41b95bab-715b-458f-9754-70916f5d1bfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:40.972519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41b95bab-715b-458f-9754-70916f5d1bfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.972971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41b95bab-715b-458f-9754-70916f5d1bfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:40.974252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41b95bab-715b-458f-9754-70916f5d1bfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:40.974837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41b95bab-715b-458f-9754-70916f5d1bfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.120219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:41.133479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:41.138865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:41.140863 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b789cf1a-5376-4cbb-9d48-e12a90dc7616 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1720 microversion: 2.20 time: 0.697250 Jul 26 20:04:41.156045 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2074/4194] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:40 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1720 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:41.163167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:41.179070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:41.179999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'name': '-603619539', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:41.194383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.197578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.198849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.200550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.373984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-41b95bab-715b-458f-9754-70916f5d1bfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:41.384256 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-41b95bab-715b-458f-9754-70916f5d1bfd tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 0.425448 Jul 26 20:04:41.384954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:41.386086 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2121/4195] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:40 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:41.413418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-8afa9c99-71eb-4e1a-b001-f77b34d09439 req-0b4d044d-c707-4f4c-892e-49bcebeda56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "name": "network-vif-plugged", "status": "completed", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:41.448826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8afa9c99-71eb-4e1a-b001-f77b34d09439 req-0b4d044d-c707-4f4c-892e-49bcebeda56d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.462321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8afa9c99-71eb-4e1a-b001-f77b34d09439 req-0b4d044d-c707-4f4c-892e-49bcebeda56d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.473872 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa4e6219-9d92-4a4f-a585-ed9ed9bf4980 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?name=-603619539" status: 200 len: 345 microversion: 2.1 time: 0.322885 Jul 26 20:04:41.474649 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2075/4196] 10.222.0.58 () {58 vars in 1156 bytes} [Tue Jul 26 20:04:41 2022] GET /compute/v2.1/servers?name=-603619539 => generated 345 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:41.497228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:41.509355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-8afa9c99-71eb-4e1a-b001-f77b34d09439 req-0b4d044d-c707-4f4c-892e-49bcebeda56d service nova] Creating event network-vif-plugged:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:04:41.513839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:41.515000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:41.527376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.531166 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-8afa9c99-71eb-4e1a-b001-f77b34d09439 req-0b4d044d-c707-4f4c-892e-49bcebeda56d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129773 Jul 26 20:04:41.534743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2122/4197] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:41.542024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.545127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.546053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.567459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d4df8d61-2f15-4d8a-85d3-978fc8170e4a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:41.568345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d4df8d61-2f15-4d8a-85d3-978fc8170e4a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:41.580630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4df8d61-2f15-4d8a-85d3-978fc8170e4a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.583872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4df8d61-2f15-4d8a-85d3-978fc8170e4a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.584827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4df8d61-2f15-4d8a-85d3-978fc8170e4a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.585350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4df8d61-2f15-4d8a-85d3-978fc8170e4a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.676759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:41.783146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4c620f0-8756-459f-84ee-483a46bb3353 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.289594 Jul 26 20:04:41.785472 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2076/4198] 10.222.0.58 () {58 vars in 1154 bytes} [Tue Jul 26 20:04:41 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:41.798188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:41.804739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:41.805752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-60361953', 'deleted': False, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:04:41.810634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:41.814086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.814642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.815635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:41.816228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:41.934423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:04:42.073409 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1eabc87b-f45a-481e-b3ce-a3a7a93693b7 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-60361953" status: 200 len: 345 microversion: 2.1 time: 0.280418 Jul 26 20:04:42.082514 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2077/4199] 10.222.0.58 () {58 vars in 1226 bytes} [Tue Jul 26 20:04:41 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-60361953 => generated 345 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:42.088749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-40119cae-1cde-418d-bdc7-8295634748aa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:42.089259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40119cae-1cde-418d-bdc7-8295634748aa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:42.096124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40119cae-1cde-418d-bdc7-8295634748aa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:42.096417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40119cae-1cde-418d-bdc7-8295634748aa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:42.097216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40119cae-1cde-418d-bdc7-8295634748aa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:42.097662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40119cae-1cde-418d-bdc7-8295634748aa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:42.148304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40119cae-1cde-418d-bdc7-8295634748aa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:04:42.151419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:42.337404 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-40119cae-1cde-418d-bdc7-8295634748aa tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 204 len: 0 microversion: 2.1 time: 0.251743 Jul 26 20:04:42.337404 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2078/4200] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:04:42 2022] DELETE /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:04:42.343420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:42.349445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:42.362549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:42.363333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:42.364353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:42.364990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:42.620649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d4df8d61-2f15-4d8a-85d3-978fc8170e4a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:42.633050 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d4df8d61-2f15-4d8a-85d3-978fc8170e4a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1364 microversion: 2.1 time: 1.070338 Jul 26 20:04:42.653047 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2123/4201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:41 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1364 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:42.659139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-286c8865-d337-4dee-a006-6a16731b382b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:42.661728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-286c8865-d337-4dee-a006-6a16731b382b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:42.681937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-286c8865-d337-4dee-a006-6a16731b382b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:42.683020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-286c8865-d337-4dee-a006-6a16731b382b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:42.684754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-286c8865-d337-4dee-a006-6a16731b382b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:42.685424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-286c8865-d337-4dee-a006-6a16731b382b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:42.803346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:42.820434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:42.828460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:42.829767 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02f8b61e-1e5c-402a-b0d6-e37ac71ea4ca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1663 microversion: 2.20 time: 0.491940 Jul 26 20:04:42.839995 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2079/4202] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:42 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1663 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:42.852427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-463dc730-dd8a-4ae3-a3f8-73ff16f8a38f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:42.853051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-463dc730-dd8a-4ae3-a3f8-73ff16f8a38f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:42.871439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-463dc730-dd8a-4ae3-a3f8-73ff16f8a38f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:42.871934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-463dc730-dd8a-4ae3-a3f8-73ff16f8a38f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:42.872727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-463dc730-dd8a-4ae3-a3f8-73ff16f8a38f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:42.873160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-463dc730-dd8a-4ae3-a3f8-73ff16f8a38f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:42.996627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-286c8865-d337-4dee-a006-6a16731b382b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:43.014300 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-286c8865-d337-4dee-a006-6a16731b382b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1517 microversion: 2.1 time: 0.359628 Jul 26 20:04:43.014904 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2124/4203] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:42 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:43.048225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87ad05d5-cbfc-4bb6-ac3b-7a3e31d5ae9f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43ee3f90-9371-47ca-9f06-2bfbe913897f"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:43.051703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-87ad05d5-cbfc-4bb6-ac3b-7a3e31d5ae9f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:43.060392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87ad05d5-cbfc-4bb6-ac3b-7a3e31d5ae9f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:43.061352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87ad05d5-cbfc-4bb6-ac3b-7a3e31d5ae9f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:43.063037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87ad05d5-cbfc-4bb6-ac3b-7a3e31d5ae9f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:43.063659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87ad05d5-cbfc-4bb6-ac3b-7a3e31d5ae9f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:43.199157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-463dc730-dd8a-4ae3-a3f8-73ff16f8a38f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:43.214574 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-463dc730-dd8a-4ae3-a3f8-73ff16f8a38f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 0.368685 Jul 26 20:04:43.216392 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2080/4204] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:42 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:43.577763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d6ffaabd-ba70-440d-8bea-0a78ef7b88e4 req-1d60173f-59c0-4a85-b7e1-86f7e3a0def5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f87df55d-ecd6-431b-8f7b-95ef5e1132eb", "name": "network-vif-unplugged", "status": "completed", "tag": "5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:43.615937 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-87ad05d5-cbfc-4bb6-ac3b-7a3e31d5ae9f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.581682 Jul 26 20:04:43.617074 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2125/4205] 10.222.0.58 () {62 vars in 1364 bytes} [Tue Jul 26 20:04:43 2022] POST /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 188 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:04:43.620622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d6ffaabd-ba70-440d-8bea-0a78ef7b88e4 req-1d60173f-59c0-4a85-b7e1-86f7e3a0def5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:43.621219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d6ffaabd-ba70-440d-8bea-0a78ef7b88e4 req-1d60173f-59c0-4a85-b7e1-86f7e3a0def5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:43.648790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.compute.server_external_events [req-d6ffaabd-ba70-440d-8bea-0a78ef7b88e4 req-1d60173f-59c0-4a85-b7e1-86f7e3a0def5 service nova] Unable to find a host for instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb. Dropping event network-vif-unplugged {{(pid=125963) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 20:04:43.649885 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d6ffaabd-ba70-440d-8bea-0a78ef7b88e4 req-1d60173f-59c0-4a85-b7e1-86f7e3a0def5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.078041 Jul 26 20:04:43.655525 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2081/4206] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 20:04:43.661763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4c50121-8406-4dcf-8455-16db895c113a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:43.665417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b4c50121-8406-4dcf-8455-16db895c113a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:43.671855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:43.699939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4c50121-8406-4dcf-8455-16db895c113a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:43.699939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4c50121-8406-4dcf-8455-16db895c113a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:43.699939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4c50121-8406-4dcf-8455-16db895c113a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:43.699939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4c50121-8406-4dcf-8455-16db895c113a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:43.757301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:43.806466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1db57a2-c8bc-486d-bd44-101e930f5e1b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:43.808480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1db57a2-c8bc-486d-bd44-101e930f5e1b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:43.815764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1db57a2-c8bc-486d-bd44-101e930f5e1b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:43.816133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1db57a2-c8bc-486d-bd44-101e930f5e1b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:43.817166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1db57a2-c8bc-486d-bd44-101e930f5e1b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:43.817537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1db57a2-c8bc-486d-bd44-101e930f5e1b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:43.992757 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1db57a2-c8bc-486d-bd44-101e930f5e1b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/action" status: 202 len: 0 microversion: 2.20 time: 0.193554 Jul 26 20:04:43.994109 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2082/4207] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 20:04:43 2022] POST /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:04:44.011338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:44.012330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:44.021711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:44.022756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:44.024405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:44.025616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:44.103522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b4c50121-8406-4dcf-8455-16db895c113a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:44.115431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4c50121-8406-4dcf-8455-16db895c113a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1552 microversion: 2.1 time: 0.464744 Jul 26 20:04:44.134290 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2126/4208] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:43 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1552 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:44.140690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-92d17e4c-8f3b-40c8-af3d-0eb5771f32d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:44.146640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92d17e4c-8f3b-40c8-af3d-0eb5771f32d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:44.164375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92d17e4c-8f3b-40c8-af3d-0eb5771f32d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:44.164837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92d17e4c-8f3b-40c8-af3d-0eb5771f32d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:44.165642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92d17e4c-8f3b-40c8-af3d-0eb5771f32d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:44.166087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92d17e4c-8f3b-40c8-af3d-0eb5771f32d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:44.612549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-92d17e4c-8f3b-40c8-af3d-0eb5771f32d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:44.623137 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-92d17e4c-8f3b-40c8-af3d-0eb5771f32d9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1517 microversion: 2.1 time: 0.487316 Jul 26 20:04:44.637245 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2127/4209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:44 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1517 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:44.643723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0050fd3b-ee4f-4938-9a00-bf2a977d0f0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:44.644479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0050fd3b-ee4f-4938-9a00-bf2a977d0f0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:44.654962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0050fd3b-ee4f-4938-9a00-bf2a977d0f0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:44.657730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0050fd3b-ee4f-4938-9a00-bf2a977d0f0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:44.660463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0050fd3b-ee4f-4938-9a00-bf2a977d0f0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:44.667833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0050fd3b-ee4f-4938-9a00-bf2a977d0f0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:44.792731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:44.817489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:44.822276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:44.823901 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-76771bf4-8510-4217-8b15-2cfbf3c05714 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1749 microversion: 2.20 time: 0.824830 Jul 26 20:04:44.837636 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2083/4210] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:43 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1749 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:44.885606 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0050fd3b-ee4f-4938-9a00-bf2a977d0f0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246763 Jul 26 20:04:44.886411 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2128/4211] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:04:44 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:44.893835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2da47e1f-36d2-4b54-acf7-c00cfb20daa1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:44.894723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2da47e1f-36d2-4b54-acf7-c00cfb20daa1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:44.902265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2da47e1f-36d2-4b54-acf7-c00cfb20daa1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:44.902718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2da47e1f-36d2-4b54-acf7-c00cfb20daa1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:44.904694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2da47e1f-36d2-4b54-acf7-c00cfb20daa1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:44.905138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2da47e1f-36d2-4b54-acf7-c00cfb20daa1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:45.333937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1841430c-f10e-46bd-8902-40c76f2a2786 req-0b8bdd8d-2673-4d52-abfe-46360984b413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a14e8f8-8e9e-454c-b231-336dc0b596b0", "name": "network-vif-deleted", "tag": "a1c922a1-fcd3-449b-b22b-f6746593d986"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:45.361801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1841430c-f10e-46bd-8902-40c76f2a2786 req-0b8bdd8d-2673-4d52-abfe-46360984b413 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:45.362255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1841430c-f10e-46bd-8902-40c76f2a2786 req-0b8bdd8d-2673-4d52-abfe-46360984b413 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:45.386918 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1841430c-f10e-46bd-8902-40c76f2a2786 req-0b8bdd8d-2673-4d52-abfe-46360984b413 service nova] Creating event network-vif-deleted:a1c922a1-fcd3-449b-b22b-f6746593d986 for instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 on n-h2-708768-8 Jul 26 20:04:45.401083 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1841430c-f10e-46bd-8902-40c76f2a2786 req-0b8bdd8d-2673-4d52-abfe-46360984b413 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073189 Jul 26 20:04:45.411445 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2129/4212] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:04:45.644840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:45.645931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:45.672747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:45.673823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:45.676482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:45.680663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:45.685141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2da47e1f-36d2-4b54-acf7-c00cfb20daa1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:45.713253 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2da47e1f-36d2-4b54-acf7-c00cfb20daa1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 0.829432 Jul 26 20:04:45.728023 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2084/4213] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:44 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:45.787730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:45.788519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:45.789044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lazy-loading 'fault' on Instance uuid 3a14e8f8-8e9e-454c-b231-336dc0b596b0 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:04:45.853003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:45.853621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:45.880017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:45.883199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:45.885965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:45.886480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:45.904367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:45.920819 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f06e711-a656-47f1-9c6b-39e67879c0a5 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 200 len: 1310 microversion: 2.1 time: 0.279729 Jul 26 20:04:45.922829 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2130/4214] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:45 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:46.364892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ac78d23e-0e1e-4ae1-805f-9c56fe2ed9ad req-48d85c68-264e-4594-a6e4-d50dbb91ec9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44418c8-1159-440a-a9a5-f6cd8c69eb61", "name": "network-vif-plugged", "status": "completed", "tag": "64140b12-3bc8-430f-9468-585c8ba48085"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:46.388211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:46.392201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ac78d23e-0e1e-4ae1-805f-9c56fe2ed9ad req-48d85c68-264e-4594-a6e4-d50dbb91ec9c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:46.394804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ac78d23e-0e1e-4ae1-805f-9c56fe2ed9ad req-48d85c68-264e-4594-a6e4-d50dbb91ec9c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:46.423674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:46.429201 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ac78d23e-0e1e-4ae1-805f-9c56fe2ed9ad req-48d85c68-264e-4594-a6e4-d50dbb91ec9c service nova] Creating event network-vif-plugged:64140b12-3bc8-430f-9468-585c8ba48085 for instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 on n-h2-708768-8 Jul 26 20:04:46.432260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:46.437652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ac78d23e-0e1e-4ae1-805f-9c56fe2ed9ad req-48d85c68-264e-4594-a6e4-d50dbb91ec9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075879 Jul 26 20:04:46.438853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2131/4215] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:46.457319 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c41eb9c4-f6a4-43ff-b60a-e2ab891bdb46 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1749 microversion: 2.20 time: 0.592714 Jul 26 20:04:46.461858 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2085/4216] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:45 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1749 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:46.736343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0801de08-c38d-4a35-8dd1-f17b6fdd7ee5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:46.738344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0801de08-c38d-4a35-8dd1-f17b6fdd7ee5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:46.749919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0801de08-c38d-4a35-8dd1-f17b6fdd7ee5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:46.750374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0801de08-c38d-4a35-8dd1-f17b6fdd7ee5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:46.754028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0801de08-c38d-4a35-8dd1-f17b6fdd7ee5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:46.754489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0801de08-c38d-4a35-8dd1-f17b6fdd7ee5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:46.946001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:46.947758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: 3a14e8f8-8e9e-454c-b231-336dc0b596b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:46.962084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:46.979447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:46.981150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:46.984801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:47.039764 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] HTTP exception thrown: Instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 could not be found. Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Request method failure captured: Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 HTTP/1.1 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EiEY_iwRVXJ9CThv-pY41noA8kAVDS9Yt5EzoijJHDEO8pOLNq24_uuo-gyfBa6ZpGaeCb_PlsV8WyDl1lYUhsP--4h3Jp3FkzitRYOWJNr_iix49zP4cBKO_CyeI4WiR4DG254idOaK3Ga0aC4yH4MUJ6o1qRB8kFDEMGYqb7nBmM Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 0fe59cccd02a4327b666ecb3286d48a1 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0fe59cccd02a4327b666ecb3286d48a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0fe59cccd02a4327b666ecb3286d48a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0fe59cccd02a4327b666ecb3286d48a1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0fe59cccd02a4327b666ecb3286d48a1"}]}] Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 0fe59cccd02a4327b666ecb3286d48a1 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ListServerFiltersTestJSON-360259260-project Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f7ed53afd4d84358bc412f5039303380 Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ListServerFiltersTestJSON-360259260-project Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 could not be found. Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '3a14e8f8-8e9e-454c-b231-336dc0b596b0'} Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 could not be found. Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 could not be found. Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:04:47.048040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 could not be found. Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Returning 404 to user: Instance 3a14e8f8-8e9e-454c-b231-336dc0b596b0 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:04:47.053864 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d747dd3d-18a2-44c7-b6ea-79b6606ba347 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0" status: 404 len: 111 microversion: 2.1 time: 0.109229 Jul 26 20:04:47.055111 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2086/4217] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:46 2022] GET /compute/v2.1/servers/3a14e8f8-8e9e-454c-b231-336dc0b596b0 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:04:47.069286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-36375ae9-fc05-4ede-bec0-fccbf96ce75b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:47.069875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-36375ae9-fc05-4ede-bec0-fccbf96ce75b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:47.104857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36375ae9-fc05-4ede-bec0-fccbf96ce75b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:47.105538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36375ae9-fc05-4ede-bec0-fccbf96ce75b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:47.106683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36375ae9-fc05-4ede-bec0-fccbf96ce75b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:47.107791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36375ae9-fc05-4ede-bec0-fccbf96ce75b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:47.192931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-36375ae9-fc05-4ede-bec0-fccbf96ce75b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:04:47.265263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0801de08-c38d-4a35-8dd1-f17b6fdd7ee5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:47.274388 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0801de08-c38d-4a35-8dd1-f17b6fdd7ee5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 0.543488 Jul 26 20:04:47.279188 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2132/4218] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:46 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:47.415113 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-36375ae9-fc05-4ede-bec0-fccbf96ce75b tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 204 len: 0 microversion: 2.1 time: 0.358857 Jul 26 20:04:47.416309 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2087/4219] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:04:47 2022] DELETE /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:04:47.426179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d472f4e0-25e9-4474-8112-d0b866edcc17 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:47.427021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d472f4e0-25e9-4474-8112-d0b866edcc17 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:47.453645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d472f4e0-25e9-4474-8112-d0b866edcc17 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:47.454219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d472f4e0-25e9-4474-8112-d0b866edcc17 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:47.456129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d472f4e0-25e9-4474-8112-d0b866edcc17 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:47.461847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d472f4e0-25e9-4474-8112-d0b866edcc17 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:47.491906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:47.493649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:47.512550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:47.519705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:47.520877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:47.522620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:47.641253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d472f4e0-25e9-4474-8112-d0b866edcc17 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:47.651719 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d472f4e0-25e9-4474-8112-d0b866edcc17 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 200 len: 1518 microversion: 2.1 time: 0.230148 Jul 26 20:04:47.652550 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2133/4220] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:47 2022] GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 1518 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:47.982369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:47.991366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:47.993146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:47.994562 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-24239252-6ce4-4eff-9cff-c818987acc74 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1751 microversion: 2.20 time: 0.509269 Jul 26 20:04:47.995659 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2088/4221] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:47 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1751 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:48.304607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ab5062d-0117-4148-986d-37b76ab7f8b7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:48.307600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ab5062d-0117-4148-986d-37b76ab7f8b7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:48.317285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6eee571a-847b-45be-99bd-ad733eeabb01 req-755d8800-1159-4211-828a-29ba30f0f0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:48.320239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ab5062d-0117-4148-986d-37b76ab7f8b7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:48.320690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ab5062d-0117-4148-986d-37b76ab7f8b7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:48.327177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ab5062d-0117-4148-986d-37b76ab7f8b7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:48.328377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ab5062d-0117-4148-986d-37b76ab7f8b7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:48.333435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6eee571a-847b-45be-99bd-ad733eeabb01 req-755d8800-1159-4211-828a-29ba30f0f0b7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:48.334155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6eee571a-847b-45be-99bd-ad733eeabb01 req-755d8800-1159-4211-828a-29ba30f0f0b7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:48.349380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6eee571a-847b-45be-99bd-ad733eeabb01 req-755d8800-1159-4211-828a-29ba30f0f0b7 service nova] Creating event network-changed:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:04:48.355078 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6eee571a-847b-45be-99bd-ad733eeabb01 req-755d8800-1159-4211-828a-29ba30f0f0b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041646 Jul 26 20:04:48.361791 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2089/4222] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:04:48.620389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ab5062d-0117-4148-986d-37b76ab7f8b7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:48.644571 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ab5062d-0117-4148-986d-37b76ab7f8b7 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1308 microversion: 2.1 time: 0.335086 Jul 26 20:04:48.645479 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2134/4223] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:48 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:48.686383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-507cf031-4783-4f13-85f5-4de6f7619029 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:48.687210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-507cf031-4783-4f13-85f5-4de6f7619029 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:48.708984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-507cf031-4783-4f13-85f5-4de6f7619029 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:48.709456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-507cf031-4783-4f13-85f5-4de6f7619029 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:48.711461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-507cf031-4783-4f13-85f5-4de6f7619029 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:48.711951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-507cf031-4783-4f13-85f5-4de6f7619029 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:49.023320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:49.024362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:49.037571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:49.053553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:49.054409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:49.058609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:49.142319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-507cf031-4783-4f13-85f5-4de6f7619029 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:49.152583 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-507cf031-4783-4f13-85f5-4de6f7619029 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 200 len: 1518 microversion: 2.1 time: 0.481281 Jul 26 20:04:49.156306 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2090/4224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:48 2022] GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 1518 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:49.268185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:49.446438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:49.455970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:49.464410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:49.465841 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c468dea-55ab-420a-93e0-90109dafd3b7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1751 microversion: 2.20 time: 0.451264 Jul 26 20:04:49.470756 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2135/4225] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:49 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1751 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:49.666810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c39e57fe-ff79-4c01-ac7c-b1f2f5dd0c05 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:49.667953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c39e57fe-ff79-4c01-ac7c-b1f2f5dd0c05 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:49.680882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c39e57fe-ff79-4c01-ac7c-b1f2f5dd0c05 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:49.685014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c39e57fe-ff79-4c01-ac7c-b1f2f5dd0c05 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:49.686945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c39e57fe-ff79-4c01-ac7c-b1f2f5dd0c05 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:49.695866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c39e57fe-ff79-4c01-ac7c-b1f2f5dd0c05 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:49.945064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-27936a46-f12e-4ec4-8b3a-0b367552e312 req-34b29fe6-2b39-4299-9048-961da2e5001e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9de37c2-47e8-4891-b2e7-e7a3ec748a73", "name": "network-vif-deleted", "tag": "fce0391c-8cf1-42f2-ae34-b6e67b8bc248"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:49.963568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-27936a46-f12e-4ec4-8b3a-0b367552e312 req-34b29fe6-2b39-4299-9048-961da2e5001e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:49.965377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-27936a46-f12e-4ec4-8b3a-0b367552e312 req-34b29fe6-2b39-4299-9048-961da2e5001e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:49.994362 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-27936a46-f12e-4ec4-8b3a-0b367552e312 req-34b29fe6-2b39-4299-9048-961da2e5001e service nova] Creating event network-vif-deleted:fce0391c-8cf1-42f2-ae34-b6e67b8bc248 for instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 on n-h2-708768-8 Jul 26 20:04:50.000784 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-27936a46-f12e-4ec4-8b3a-0b367552e312 req-34b29fe6-2b39-4299-9048-961da2e5001e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059501 Jul 26 20:04:50.001993 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2136/4226] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:04:50.180228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:50.181317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:50.193790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.194516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:50.196994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.197701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:50.307237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.308166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:50.311101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lazy-loading 'fault' on Instance uuid d9de37c2-47e8-4891-b2e7-e7a3ec748a73 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:04:50.392316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:50.404223 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5657c846-bcde-4c51-b88e-d4d4770de079 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 200 len: 1311 microversion: 2.1 time: 0.229096 Jul 26 20:04:50.404962 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2137/4227] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:50 2022] GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:50.494011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:50.495322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:50.508818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.509772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:50.510585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.511082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:50.696682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c39e57fe-ff79-4c01-ac7c-b1f2f5dd0c05 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:50.747053 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c39e57fe-ff79-4c01-ac7c-b1f2f5dd0c05 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1489 microversion: 2.1 time: 1.081577 Jul 26 20:04:50.748039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2091/4228] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:49 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1489 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:50.766249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:50.775201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e2aa8ff-1ff2-4854-8471-d0f1a44aff48 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:50.779541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e2aa8ff-1ff2-4854-8471-d0f1a44aff48 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:50.790182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e2aa8ff-1ff2-4854-8471-d0f1a44aff48 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.790989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e2aa8ff-1ff2-4854-8471-d0f1a44aff48 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:50.792037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e2aa8ff-1ff2-4854-8471-d0f1a44aff48 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.792851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e2aa8ff-1ff2-4854-8471-d0f1a44aff48 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:50.837406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-4e2aa8ff-1ff2-4854-8471-d0f1a44aff48 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lazy-loading 'flavor' on Instance uuid a44418c8-1159-440a-a9a5-f6cd8c69eb61 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:04:50.852869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:50.871136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:50.874203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:50.882901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:50.890573 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34182474-5b6e-48e4-a999-627c354a37c2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1751 microversion: 2.20 time: 0.400823 Jul 26 20:04:50.892402 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2138/4229] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:50 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1751 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:04:50.958651 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e2aa8ff-1ff2-4854-8471-d0f1a44aff48 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61/action" status: 202 len: 0 microversion: 2.1 time: 0.190093 Jul 26 20:04:50.962613 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2092/4230] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:04:50 2022] POST /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:04:50.968253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2be3b354-2c9b-4a28-a43c-c63226a50341 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:50.969119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2be3b354-2c9b-4a28-a43c-c63226a50341 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:50.982415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2be3b354-2c9b-4a28-a43c-c63226a50341 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.988976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2be3b354-2c9b-4a28-a43c-c63226a50341 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:50.994683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2be3b354-2c9b-4a28-a43c-c63226a50341 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:50.995347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2be3b354-2c9b-4a28-a43c-c63226a50341 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:51.286645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2be3b354-2c9b-4a28-a43c-c63226a50341 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:51.294805 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2be3b354-2c9b-4a28-a43c-c63226a50341 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1497 microversion: 2.1 time: 0.330635 Jul 26 20:04:51.309008 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2139/4231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:50 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:51.434968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:51.435986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: d9de37c2-47e8-4891-b2e7-e7a3ec748a73] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:51.451956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:51.453388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:51.457825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:51.458415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:51.514642 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] HTTP exception thrown: Instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 could not be found. Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Request method failure captured: Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 HTTP/1.1 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EiEY_iwRVXJ9CThv-pY41noA8kAVDS9Yt5EzoijJHDEO8pOLNq24_uuo-gyfBa6ZpGaeCb_PlsV8WyDl1lYUhsP--4h3Jp3FkzitRYOWJNr_iix49zP4cBKO_CyeI4WiR4DG254idOaK3Ga0aC4yH4MUJ6o1qRB8kFDEMGYqb7nBmM Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 0fe59cccd02a4327b666ecb3286d48a1 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0fe59cccd02a4327b666ecb3286d48a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0fe59cccd02a4327b666ecb3286d48a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0fe59cccd02a4327b666ecb3286d48a1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0fe59cccd02a4327b666ecb3286d48a1"}]}] Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 0fe59cccd02a4327b666ecb3286d48a1 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ListServerFiltersTestJSON-360259260-project Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f7ed53afd4d84358bc412f5039303380 Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ListServerFiltersTestJSON-360259260-project Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 could not be found. Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'd9de37c2-47e8-4891-b2e7-e7a3ec748a73'} Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 could not be found. Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 could not be found. Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:04:51.516678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:51.521505 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:51.521505 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:04:51.521505 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:04:51.521505 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:04:51.521505 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:04:51.521505 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 could not be found. Jul 26 20:04:51.521505 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:51.523428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Returning 404 to user: Instance d9de37c2-47e8-4891-b2e7-e7a3ec748a73 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:04:51.524651 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0dcb4622-d6ae-4a9d-9fc2-4bedbf07dd03 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73" status: 404 len: 111 microversion: 2.1 time: 0.101611 Jul 26 20:04:51.529329 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2093/4232] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:51 2022] GET /compute/v2.1/servers/d9de37c2-47e8-4891-b2e7-e7a3ec748a73 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:04:51.537288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf4fe655-6fd7-467b-8da3-4cd4e53cba73 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:51.538119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf4fe655-6fd7-467b-8da3-4cd4e53cba73 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:51.556983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf4fe655-6fd7-467b-8da3-4cd4e53cba73 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:51.558019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf4fe655-6fd7-467b-8da3-4cd4e53cba73 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:51.562056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf4fe655-6fd7-467b-8da3-4cd4e53cba73 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:51.562738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf4fe655-6fd7-467b-8da3-4cd4e53cba73 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:51.640384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf4fe655-6fd7-467b-8da3-4cd4e53cba73 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:04:51.786220 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf4fe655-6fd7-467b-8da3-4cd4e53cba73 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 204 len: 0 microversion: 2.1 time: 0.254570 Jul 26 20:04:51.787823 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2140/4233] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:04:51 2022] DELETE /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:04:51.796919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bd4806db-860b-4b5b-be4f-457c7726555a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:51.797298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bd4806db-860b-4b5b-be4f-457c7726555a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:51.804294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd4806db-860b-4b5b-be4f-457c7726555a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:51.804737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd4806db-860b-4b5b-be4f-457c7726555a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:51.807140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd4806db-860b-4b5b-be4f-457c7726555a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:51.808932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bd4806db-860b-4b5b-be4f-457c7726555a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:51.874750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:51.921675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:51.922660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:51.934182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:51.935965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:51.938519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:51.939212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:52.042456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bd4806db-860b-4b5b-be4f-457c7726555a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:52.050351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bd4806db-860b-4b5b-be4f-457c7726555a tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1517 microversion: 2.1 time: 0.258345 Jul 26 20:04:52.051471 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2094/4234] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:51 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:52.281649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:52.304025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:52.309370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:52.313737 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-747f6b9a-9c27-42c1-9517-4ece9e84b963 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1751 microversion: 2.20 time: 0.396736 Jul 26 20:04:52.317943 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2141/4235] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:51 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1751 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:04:52.319816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8a2f77d7-7378-424e-9355-81d3e73c7919 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:52.320494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8a2f77d7-7378-424e-9355-81d3e73c7919 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:52.329335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a2f77d7-7378-424e-9355-81d3e73c7919 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:52.332168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a2f77d7-7378-424e-9355-81d3e73c7919 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:52.332970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a2f77d7-7378-424e-9355-81d3e73c7919 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:52.333405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a2f77d7-7378-424e-9355-81d3e73c7919 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:52.571818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a2f77d7-7378-424e-9355-81d3e73c7919 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:52.583336 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8a2f77d7-7378-424e-9355-81d3e73c7919 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 200 len: 1480 microversion: 2.1 time: 0.268545 Jul 26 20:04:52.584796 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2095/4236] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:52 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 1480 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:52.607558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec542d1e-30b0-4cae-84c8-186de891a57a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1007726326"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:52.611187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ec542d1e-30b0-4cae-84c8-186de891a57a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:52.627001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec542d1e-30b0-4cae-84c8-186de891a57a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:52.628238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec542d1e-30b0-4cae-84c8-186de891a57a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:52.629454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec542d1e-30b0-4cae-84c8-186de891a57a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:52.630525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec542d1e-30b0-4cae-84c8-186de891a57a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:52.864551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:04:52.923983 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ec542d1e-30b0-4cae-84c8-186de891a57a tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61/action" status: 202 len: 0 microversion: 2.1 time: 0.320599 Jul 26 20:04:52.926036 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2142/4237] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:04:52 2022] POST /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 20:04:52.937526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90e61f24-765b-47ad-997e-80a1df26f1bb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875f021e50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:53.000104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90e61f24-765b-47ad-997e-80a1df26f1bb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd" status: 200 len: 1440 microversion: 2.1 time: 0.067425 Jul 26 20:04:53.009373 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2096/4238] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:52 2022] GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd => generated 1440 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:53.074500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-01b393ed-d21f-421e-b0c0-d3ab9612d87e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:53.075719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-01b393ed-d21f-421e-b0c0-d3ab9612d87e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:53.094263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01b393ed-d21f-421e-b0c0-d3ab9612d87e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:53.099087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01b393ed-d21f-421e-b0c0-d3ab9612d87e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:53.102456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01b393ed-d21f-421e-b0c0-d3ab9612d87e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:53.103488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01b393ed-d21f-421e-b0c0-d3ab9612d87e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:53.345089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:53.345683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:53.355364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:53.357079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:53.357870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:53.358310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:53.400415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-01b393ed-d21f-421e-b0c0-d3ab9612d87e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:53.409878 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-01b393ed-d21f-421e-b0c0-d3ab9612d87e tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1517 microversion: 2.1 time: 0.341645 Jul 26 20:04:53.413260 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2143/4239] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:53 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1517 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:53.684462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:53.705888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:53.708517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:53.712284 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5c9f2b94-2c84-45e8-a87f-c6c12dd90854 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1751 microversion: 2.20 time: 0.371186 Jul 26 20:04:53.713206 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2097/4240] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:53 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1751 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:54.017029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85d23ba6-d5d7-41d0-a345-958696e356d4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87566513a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:54.095831 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85d23ba6-d5d7-41d0-a345-958696e356d4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd" status: 200 len: 1440 microversion: 2.1 time: 0.083662 Jul 26 20:04:54.097930 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2144/4241] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:54 2022] GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd => generated 1440 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:54.260992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-db92fa5e-2f44-4d45-85a3-c8e8dd08a90d req-83061e30-9836-4f0d-95a8-5e714dd07894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff84d0fe-f57f-493c-8d44-e35a4a0822b9", "name": "network-vif-deleted", "tag": "2ad0073d-3009-46f3-9863-a228cdb73480"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:54.280937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-db92fa5e-2f44-4d45-85a3-c8e8dd08a90d req-83061e30-9836-4f0d-95a8-5e714dd07894 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:54.281389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-db92fa5e-2f44-4d45-85a3-c8e8dd08a90d req-83061e30-9836-4f0d-95a8-5e714dd07894 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:54.312685 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-db92fa5e-2f44-4d45-85a3-c8e8dd08a90d req-83061e30-9836-4f0d-95a8-5e714dd07894 service nova] Creating event network-vif-deleted:2ad0073d-3009-46f3-9863-a228cdb73480 for instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 on n-h2-708768-8 Jul 26 20:04:54.318767 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-db92fa5e-2f44-4d45-85a3-c8e8dd08a90d req-83061e30-9836-4f0d-95a8-5e714dd07894 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063704 Jul 26 20:04:54.319598 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2098/4242] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:54.438588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:54.439276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:54.452312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:54.453425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:54.454240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:54.455176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:54.501882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:54.503262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:54.504103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lazy-loading 'fault' on Instance uuid ff84d0fe-f57f-493c-8d44-e35a4a0822b9 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:04:54.738399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:54.739129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:54.753377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:54.753815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:54.754611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:54.755051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:54.873082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ed53afd4d84358bc412f5039303380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe59cccd02a4327b666ecb3286d48a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:54.894457 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d3f1b34-9d5c-4bb8-a343-3de68eb27d06 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 200 len: 1310 microversion: 2.1 time: 0.461158 Jul 26 20:04:54.899077 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2145/4243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:54 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 1310 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:54.966048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:54.975178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:54.976694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:54.977861 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4d85566-14a0-426a-8346-6af9dfe1e6ff tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1751 microversion: 2.20 time: 0.245175 Jul 26 20:04:54.979655 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2099/4244] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:54 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1751 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:04:55.116242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-773ea7af-7553-4077-9edf-964f48fa7cb9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87566515e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:55.174994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-773ea7af-7553-4077-9edf-964f48fa7cb9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd" status: 200 len: 1440 microversion: 2.1 time: 0.065590 Jul 26 20:04:55.175864 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2146/4245] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:55 2022] GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd => generated 1440 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:04:55.925318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:55.926350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] [instance: ff84d0fe-f57f-493c-8d44-e35a4a0822b9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:55.936366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:55.936855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:55.937969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:55.942584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:55.973150 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] HTTP exception thrown: Instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 could not be found. Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Request method failure captured: Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 HTTP/1.1 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EiEY_iwRVXJ9CThv-pY41noA8kAVDS9Yt5EzoijJHDEO8pOLNq24_uuo-gyfBa6ZpGaeCb_PlsV8WyDl1lYUhsP--4h3Jp3FkzitRYOWJNr_iix49zP4cBKO_CyeI4WiR4DG254idOaK3Ga0aC4yH4MUJ6o1qRB8kFDEMGYqb7nBmM Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 0fe59cccd02a4327b666ecb3286d48a1 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0fe59cccd02a4327b666ecb3286d48a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0fe59cccd02a4327b666ecb3286d48a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0fe59cccd02a4327b666ecb3286d48a1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0fe59cccd02a4327b666ecb3286d48a1"}]}] Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 0fe59cccd02a4327b666ecb3286d48a1 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-360259260 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ListServerFiltersTestJSON-360259260-project Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f7ed53afd4d84358bc412f5039303380 Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ListServerFiltersTestJSON-360259260-project Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 could not be found. Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ff84d0fe-f57f-493c-8d44-e35a4a0822b9'} Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 could not be found. Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 could not be found. Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:04:55.976519 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:55.981063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:04:55.981063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:04:55.981063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:04:55.981063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:04:55.981063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:04:55.981063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 could not be found. Jul 26 20:04:55.981063 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:04:55.982175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] Returning 404 to user: Instance ff84d0fe-f57f-493c-8d44-e35a4a0822b9 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:04:55.983396 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cbd8f384-dc1b-44c5-8304-95ab5da01bc9 tempest-ListServerFiltersTestJSON-360259260 tempest-ListServerFiltersTestJSON-360259260-project] 10.222.0.58 "GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9" status: 404 len: 111 microversion: 2.1 time: 0.066727 Jul 26 20:04:55.984103 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2100/4246] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:04:55 2022] GET /compute/v2.1/servers/ff84d0fe-f57f-493c-8d44-e35a4a0822b9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:04:56.002885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:56.004323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:56.016667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:56.018381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:56.019538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:56.020548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:56.190363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-502e79f9-2185-4ef6-a8bd-297606651ed6 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875eef1790>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:56.262969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-502e79f9-2185-4ef6-a8bd-297606651ed6 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd" status: 200 len: 1440 microversion: 2.1 time: 0.077622 Jul 26 20:04:56.272618 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2101/4247] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:56 2022] GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd => generated 1440 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:04:56.386993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:56.401824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:56.403662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:56.405172 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ae91c1a-6f7f-43af-b4dc-857742227da6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.406848 Jul 26 20:04:56.422042 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2147/4248] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:55 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:57.280760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97c36beb-9fb5-4492-b9b9-ce9962ea27d1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875f13ddc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:57.432146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:57.433358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:57.447473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:57.448303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:57.449453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:57.450179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:57.953693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:57.967480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:57.970531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:57.977011 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-81ffa4c6-ab85-4fe5-93ec-593dbb35f7c9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.550077 Jul 26 20:04:57.978595 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2148/4249] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:57 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:04:57.987858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0efc2e52-4197-4c30-991d-7db4122bea4d req-cce17cff-fd26-465d-aca6-3283c398c628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44418c8-1159-440a-a9a5-f6cd8c69eb61", "name": "network-vif-plugged", "status": "completed", "tag": "64140b12-3bc8-430f-9468-585c8ba48085"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:04:58.019900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0efc2e52-4197-4c30-991d-7db4122bea4d req-cce17cff-fd26-465d-aca6-3283c398c628 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:58.023008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0efc2e52-4197-4c30-991d-7db4122bea4d req-cce17cff-fd26-465d-aca6-3283c398c628 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:58.054751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0efc2e52-4197-4c30-991d-7db4122bea4d req-cce17cff-fd26-465d-aca6-3283c398c628 service nova] Creating event network-vif-plugged:64140b12-3bc8-430f-9468-585c8ba48085 for instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 on n-h2-708768-8 Jul 26 20:04:58.062278 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0efc2e52-4197-4c30-991d-7db4122bea4d req-cce17cff-fd26-465d-aca6-3283c398c628 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081532 Jul 26 20:04:58.067180 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2149/4250] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:04:59.003884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:04:59.005377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:04:59.038692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:59.040923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:59.044971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:04:59.048245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:04:59.764346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:59.791747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:59.794825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:04:59.799539 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03fb773b-df23-4fab-8521-7cc9b1e9dc9e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.800788 Jul 26 20:04:59.803329 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2150/4251] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:04:58 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:00.832149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:00.835225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:00.851775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:00.861093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:00.867254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:00.881777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:01.299764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:01.386131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:01.386131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:01.386131 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eda8093f-fad1-4ef0-914c-d6c92676c649 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.512476 Jul 26 20:05:01.386131 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2151/4252] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:00 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:05:02.366283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:02.367853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:02.380625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:02.383559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:02.384466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:02.384920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:02.708660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:02.729847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:02.735104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:02.744280 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-19af4814-33c2-44d8-82b9-3f28a4a74b4a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.380336 Jul 26 20:05:02.761986 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2152/4253] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:02 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:05:03.775219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:03.776665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:03.794747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:03.800790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:03.803308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:03.804366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:04.232800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:04.251097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:04.264471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:04.268071 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8423b5b5-55df-457e-afe4-a214a1e03cec tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.494580 Jul 26 20:05:04.272664 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2153/4254] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:03 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:05.298157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:05.298945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:05.317792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:05.318356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:05.322100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:05.322100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:05.691521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:05.716945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:05.718910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:05.723642 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-414a46ae-8165-4716-87d3-e252dd9f13b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.431188 Jul 26 20:05:05.729607 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2154/4255] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:05 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:05.937322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:05.951905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:06.757859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:06.760716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:06.788981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:06.798588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:06.802581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:06.803218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:07.549446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:07.558992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:07.578063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:07.579501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34d3bd19-f10d-44bc-b996-503aebb2799f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.829408 Jul 26 20:05:07.583497 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2155/4256] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:06 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:08.605967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:08.607439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:08.622017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:08.625886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:08.627130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:08.630346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:10.234340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:10.251914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:10.254431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:10.257019 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ff60100-5313-4d08-805c-ae9db25a7ca4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 1.654747 Jul 26 20:05:10.273459 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2156/4257] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:08 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:05:11.301310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:11.302070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:11.323788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:11.324439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:11.331598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:11.332408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:12.743871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:12.766256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:12.784301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:12.786912 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf08af55-5b2d-4b25-b59d-ee4528ff4bca tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 1.485983 Jul 26 20:05:12.799641 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2157/4258] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:11 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:13.827990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:13.828697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:13.834507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:13.863534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:13.866882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:13.871593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:13.876858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:14.486499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:14.496825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:14.504114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:14.505429 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-edcd3b48-723b-4c02-ae46-99148b031025 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.682659 Jul 26 20:05:14.506023 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2158/4259] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:13 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:05:15.535175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:15.537580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:15.585666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:15.586484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:15.587383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:15.606343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:15.711904 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97c36beb-9fb5-4492-b9b9-ce9962ea27d1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd" status: 200 len: 1449 microversion: 2.1 time: 18.435957 Jul 26 20:05:15.721993 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2102/4260] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:04:57 2022] GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd => generated 1449 bytes in 18446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:15.747235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5574fc2c-a4a5-4200-a4ae-1eb113655bba tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875eef19d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:15.839063 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5574fc2c-a4a5-4200-a4ae-1eb113655bba tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd" status: 200 len: 1449 microversion: 2.1 time: 0.107064 Jul 26 20:05:15.840677 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2103/4261] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:05:15 2022] GET /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd => generated 1449 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:15.865491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3824689b-922e-4e0c-ada0-5a049823b76b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875ed34670>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:16.255302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:16.283936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:16.292515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:16.301875 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3b3cb91-5bb9-4af6-901b-abfcd6bcd906 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.772431 Jul 26 20:05:16.303989 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2159/4262] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:15 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:17.330002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:17.331520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:17.341086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:17.342430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:17.343566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:17.344409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:17.871911 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3824689b-922e-4e0c-ada0-5a049823b76b tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd" status: 204 len: 0 microversion: 2.1 time: 2.020193 Jul 26 20:05:17.873485 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2104/4263] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:15 2022] DELETE /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd => generated 0 bytes in 2022 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:05:18.092588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:18.102315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:18.111373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:18.115564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:18.118570 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3218453-40b5-434c-81dc-b09188f051a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.795316 Jul 26 20:05:18.120321 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2160/4264] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:17 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:18.138050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87d005f4-7606-4f13-918e-90fcdb1fff9c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:18.138936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-87d005f4-7606-4f13-918e-90fcdb1fff9c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:18.153808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87d005f4-7606-4f13-918e-90fcdb1fff9c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:18.154510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87d005f4-7606-4f13-918e-90fcdb1fff9c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:18.159797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87d005f4-7606-4f13-918e-90fcdb1fff9c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:18.161037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87d005f4-7606-4f13-918e-90fcdb1fff9c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:18.246174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-87d005f4-7606-4f13-918e-90fcdb1fff9c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:05:18.284989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1175355811", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:18.363734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] validate_networks() for [('5910b6fb-1696-4afd-bbde-8d3d2505231f', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:05:18.469400 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-87d005f4-7606-4f13-918e-90fcdb1fff9c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 204 len: 0 microversion: 2.1 time: 0.346585 Jul 26 20:05:18.472824 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2161/4265] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:05:18 2022] DELETE /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:05:18.674882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1920022288", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7c43ed99-78c0-4e29-b511-cd8d44018d0b"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:18.789725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] validate_networks() for [('7c43ed99-78c0-4e29-b511-cd8d44018d0b', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:05:19.588882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:05:19.590081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:05:19.591222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:05:19.591853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:05:19.592414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:05:19.621065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:19.622843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:19.624721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:19.627864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:19.662576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Getting quotas for project 79f20170367940fdb2aec0c53ccce333. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:05:19.668457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Getting quotas for user 9c88be73cf9945a0ab2158b1d86ecd86 and project 79f20170367940fdb2aec0c53ccce333. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:05:19.686941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:05:19.691386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:05:19.795875 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6aea62b9-1770-4307-ba1a-a9032171bef8 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.921058 Jul 26 20:05:19.800819 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2105/4266] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:05:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:05:19.818025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:19.818814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:19.831672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:19.835906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:19.837035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:19.839241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:20.256107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:20.268658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:20.276842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:20.278078 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4e144de-6984-4f35-b0f8-0d927447a1a6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.476089 Jul 26 20:05:20.284499 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2106/4267] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:19 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:20.293803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c71695ce-071c-4c20-835c-6ec6cb12c405 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:20.294421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c71695ce-071c-4c20-835c-6ec6cb12c405 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:20.430723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c71695ce-071c-4c20-835c-6ec6cb12c405 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:20.441558 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c71695ce-071c-4c20-835c-6ec6cb12c405 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1224 microversion: 2.1 time: 0.155315 Jul 26 20:05:20.446312 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2107/4268] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:20 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1224 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:20.747932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1f7d7bab-5663-4e00-a8d6-a420358948a1 req-84e140b1-c304-4c65-b44d-7de2c0bb6b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44418c8-1159-440a-a9a5-f6cd8c69eb61", "name": "network-vif-unplugged", "status": "completed", "tag": "64140b12-3bc8-430f-9468-585c8ba48085"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:20.770650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1f7d7bab-5663-4e00-a8d6-a420358948a1 req-84e140b1-c304-4c65-b44d-7de2c0bb6b84 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:20.771475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1f7d7bab-5663-4e00-a8d6-a420358948a1 req-84e140b1-c304-4c65-b44d-7de2c0bb6b84 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:20.875249 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1f7d7bab-5663-4e00-a8d6-a420358948a1 req-84e140b1-c304-4c65-b44d-7de2c0bb6b84 service nova] Creating event network-vif-unplugged:64140b12-3bc8-430f-9468-585c8ba48085 for instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 on n-h2-708768-8 Jul 26 20:05:20.912580 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1f7d7bab-5663-4e00-a8d6-a420358948a1 req-84e140b1-c304-4c65-b44d-7de2c0bb6b84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169114 Jul 26 20:05:20.913608 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2108/4269] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:05:21.124864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d6775817-89fd-4658-9fb7-65e868fa32b5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:21.125959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d6775817-89fd-4658-9fb7-65e868fa32b5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:21.139663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6775817-89fd-4658-9fb7-65e868fa32b5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.140749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6775817-89fd-4658-9fb7-65e868fa32b5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.146262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6775817-89fd-4658-9fb7-65e868fa32b5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.147082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6775817-89fd-4658-9fb7-65e868fa32b5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.209194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:05:21.209753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:05:21.210087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:05:21.210718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:05:21.211345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:05:21.229314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.230049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.232620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.233316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.267207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Getting quotas for project a715ad339a264f918507acfd8a1180f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:05:21.277271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Getting quotas for user f82c738a399d4688b1870ea46700ac71 and project a715ad339a264f918507acfd8a1180f5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:05:21.302184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:05:21.305115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:05:21.416571 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7a8ad24d-80c3-4238-8e6e-fb5aa1903496 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.749527 Jul 26 20:05:21.429608 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2162/4270] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:05:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:05:21.450155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:21.451287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:21.470451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.471825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.476717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.477349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.503461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d6775817-89fd-4658-9fb7-65e868fa32b5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:21.516866 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d6775817-89fd-4658-9fb7-65e868fa32b5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.396194 Jul 26 20:05:21.520225 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2109/4271] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:21 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:21.538875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bb69b1f6-cacd-4808-a883-7a482fa8af20 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:21.539898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb69b1f6-cacd-4808-a883-7a482fa8af20 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:21.632872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bb69b1f6-cacd-4808-a883-7a482fa8af20 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:21.644701 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bb69b1f6-cacd-4808-a883-7a482fa8af20 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1208 microversion: 2.1 time: 0.122917 Jul 26 20:05:21.645589 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2110/4272] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:21 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:21.651956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6471ac7d-d8fc-4b75-be98-67ff9b8c2456 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:21.652812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6471ac7d-d8fc-4b75-be98-67ff9b8c2456 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:21.663048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6471ac7d-d8fc-4b75-be98-67ff9b8c2456 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.664323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6471ac7d-d8fc-4b75-be98-67ff9b8c2456 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.665521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6471ac7d-d8fc-4b75-be98-67ff9b8c2456 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.666379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6471ac7d-d8fc-4b75-be98-67ff9b8c2456 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.840826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6471ac7d-d8fc-4b75-be98-67ff9b8c2456 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:21.850632 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6471ac7d-d8fc-4b75-be98-67ff9b8c2456 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1276 microversion: 2.1 time: 0.203065 Jul 26 20:05:21.851238 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2111/4273] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:21 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:21.864468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ff9a516-0693-4e51-b892-81679387241c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:21.888559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ff9a516-0693-4e51-b892-81679387241c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:21.909729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ff9a516-0693-4e51-b892-81679387241c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.914751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ff9a516-0693-4e51-b892-81679387241c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:21.918490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ff9a516-0693-4e51-b892-81679387241c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:21.921907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ff9a516-0693-4e51-b892-81679387241c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:22.879964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ff9a516-0693-4e51-b892-81679387241c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:22.893069 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ff9a516-0693-4e51-b892-81679387241c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 1.034197 Jul 26 20:05:22.894074 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2112/4274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:21 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:22.911996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-10707ef8-2e44-400c-83a1-018525436e89 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:22.915242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-10707ef8-2e44-400c-83a1-018525436e89 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:22.931262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10707ef8-2e44-400c-83a1-018525436e89 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:22.931985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10707ef8-2e44-400c-83a1-018525436e89 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:22.932939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10707ef8-2e44-400c-83a1-018525436e89 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:22.934754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10707ef8-2e44-400c-83a1-018525436e89 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:23.038951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:23.058517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:23.060072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:23.067480 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9d635de3-419a-41b8-ba77-af907581a4a9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 1.630645 Jul 26 20:05:23.068169 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2163/4275] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:21 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:23.087163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bebbde58-0955-4701-bea4-5b31218cae42 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:23.092234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bebbde58-0955-4701-bea4-5b31218cae42 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:23.123744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bebbde58-0955-4701-bea4-5b31218cae42 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:23.124463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bebbde58-0955-4701-bea4-5b31218cae42 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:23.125469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bebbde58-0955-4701-bea4-5b31218cae42 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:23.131537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bebbde58-0955-4701-bea4-5b31218cae42 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:23.177738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-10707ef8-2e44-400c-83a1-018525436e89 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:23.195103 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-10707ef8-2e44-400c-83a1-018525436e89 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1212 microversion: 2.1 time: 0.290564 Jul 26 20:05:23.199022 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2113/4276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:22 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1212 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:23.204137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dcf0f0f9-ca3a-4fa3-98f4-1babdc0c95fd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:23.215942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dcf0f0f9-ca3a-4fa3-98f4-1babdc0c95fd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:23.256584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcf0f0f9-ca3a-4fa3-98f4-1babdc0c95fd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:23.257501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcf0f0f9-ca3a-4fa3-98f4-1babdc0c95fd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:23.259721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcf0f0f9-ca3a-4fa3-98f4-1babdc0c95fd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:23.261389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dcf0f0f9-ca3a-4fa3-98f4-1babdc0c95fd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:23.431002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bebbde58-0955-4701-bea4-5b31218cae42 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:23.451949 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bebbde58-0955-4701-bea4-5b31218cae42 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1282 microversion: 2.1 time: 0.377952 Jul 26 20:05:23.458255 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2164/4277] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:23 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1282 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:23.523483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9ebfdaf3-33fc-4913-bed9-5e1fd68ba62b req-291b966b-fab0-4da9-8c62-701580dc5aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a44418c8-1159-440a-a9a5-f6cd8c69eb61", "name": "network-vif-deleted", "tag": "64140b12-3bc8-430f-9468-585c8ba48085"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:23.577801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9ebfdaf3-33fc-4913-bed9-5e1fd68ba62b req-291b966b-fab0-4da9-8c62-701580dc5aeb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:23.578083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9ebfdaf3-33fc-4913-bed9-5e1fd68ba62b req-291b966b-fab0-4da9-8c62-701580dc5aeb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:23.650621 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9ebfdaf3-33fc-4913-bed9-5e1fd68ba62b req-291b966b-fab0-4da9-8c62-701580dc5aeb service nova] Creating event network-vif-deleted:64140b12-3bc8-430f-9468-585c8ba48085 for instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 on n-h2-708768-8 Jul 26 20:05:23.678894 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9ebfdaf3-33fc-4913-bed9-5e1fd68ba62b req-291b966b-fab0-4da9-8c62-701580dc5aeb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159569 Jul 26 20:05:23.685157 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2165/4278] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:05:24.103936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:24.104648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:24.138907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:24.141596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:24.147578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:24.150492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:24.328466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dcf0f0f9-ca3a-4fa3-98f4-1babdc0c95fd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:24.340664 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dcf0f0f9-ca3a-4fa3-98f4-1babdc0c95fd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 1.138001 Jul 26 20:05:24.345156 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2114/4279] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:23 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:24.372187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e59955df-bbb8-4ba5-ab5e-c03ca70802cf tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:24.373072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e59955df-bbb8-4ba5-ab5e-c03ca70802cf tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:24.390071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e59955df-bbb8-4ba5-ab5e-c03ca70802cf tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:24.392449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e59955df-bbb8-4ba5-ab5e-c03ca70802cf tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:24.393551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e59955df-bbb8-4ba5-ab5e-c03ca70802cf tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:24.397178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e59955df-bbb8-4ba5-ab5e-c03ca70802cf tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:24.604941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e59955df-bbb8-4ba5-ab5e-c03ca70802cf tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:24.613627 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e59955df-bbb8-4ba5-ab5e-c03ca70802cf tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1278 microversion: 2.1 time: 0.266057 Jul 26 20:05:24.613738 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2115/4280] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:24 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1278 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:24.624744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b254285d-d0e3-4706-ad9b-a82c0eb086aa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1096478018"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:24.631715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b254285d-d0e3-4706-ad9b-a82c0eb086aa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:24.652738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b254285d-d0e3-4706-ad9b-a82c0eb086aa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:24.658948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b254285d-d0e3-4706-ad9b-a82c0eb086aa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:24.660037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b254285d-d0e3-4706-ad9b-a82c0eb086aa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:24.661398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b254285d-d0e3-4706-ad9b-a82c0eb086aa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:25.068503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:25.079444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:25.082365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:25.084032 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ea40485-3b31-4f21-a76a-3494089918a8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.991854 Jul 26 20:05:25.101270 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2166/4281] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:24 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:25.109916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-abe0a917-0b09-4c3e-8033-ca6b46403b90 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:25.112088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-abe0a917-0b09-4c3e-8033-ca6b46403b90 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:25.119266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abe0a917-0b09-4c3e-8033-ca6b46403b90 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:25.120338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abe0a917-0b09-4c3e-8033-ca6b46403b90 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:25.121687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abe0a917-0b09-4c3e-8033-ca6b46403b90 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:25.122407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abe0a917-0b09-4c3e-8033-ca6b46403b90 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:25.148531 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b254285d-d0e3-4706-ad9b-a82c0eb086aa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.533550 Jul 26 20:05:25.152494 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2116/4282] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:05:24 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 26 20:05:25.414297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-abe0a917-0b09-4c3e-8033-ca6b46403b90 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:25.433045 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-abe0a917-0b09-4c3e-8033-ca6b46403b90 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 0.329932 Jul 26 20:05:25.434666 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2167/4283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:25 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:25.645309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4170d40e-f178-4a0a-9da8-977d4ec8d6b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:25.646036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4170d40e-f178-4a0a-9da8-977d4ec8d6b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:25.676320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4170d40e-f178-4a0a-9da8-977d4ec8d6b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:25.677043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4170d40e-f178-4a0a-9da8-977d4ec8d6b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:25.677996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4170d40e-f178-4a0a-9da8-977d4ec8d6b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:25.680230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4170d40e-f178-4a0a-9da8-977d4ec8d6b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:25.792905 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:05:25.793248 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 (ip 10.222.0.58) !!! Jul 26 20:05:26.113948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:26.114583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:26.131673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:26.134655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:26.135572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:26.136057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:26.414735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4170d40e-f178-4a0a-9da8-977d4ec8d6b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:26.426201 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4170d40e-f178-4a0a-9da8-977d4ec8d6b9 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1308 microversion: 2.1 time: 0.791054 Jul 26 20:05:26.441400 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2117/4284] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:25 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1308 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:26.459442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41471f2f-b354-47dd-82c5-20e12d6a9a39 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:26.460433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41471f2f-b354-47dd-82c5-20e12d6a9a39 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:26.470500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:26.476070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41471f2f-b354-47dd-82c5-20e12d6a9a39 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:26.476870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41471f2f-b354-47dd-82c5-20e12d6a9a39 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:26.480797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:26.482370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41471f2f-b354-47dd-82c5-20e12d6a9a39 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:26.483039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41471f2f-b354-47dd-82c5-20e12d6a9a39 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:26.486741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:26.491977 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-165b2e68-0960-4f4b-8cb6-e8499e7f5cc1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.383021 Jul 26 20:05:26.492951 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2168/4285] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:26 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:27.261498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-41471f2f-b354-47dd-82c5-20e12d6a9a39 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:27.271360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41471f2f-b354-47dd-82c5-20e12d6a9a39 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 0.816438 Jul 26 20:05:27.292430 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2118/4286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:26 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:05:27.457001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e23f9d7-1e86-4dc3-9231-a16b3d99c2dc tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:27.457668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e23f9d7-1e86-4dc3-9231-a16b3d99c2dc tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:27.469836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e23f9d7-1e86-4dc3-9231-a16b3d99c2dc tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:27.470332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e23f9d7-1e86-4dc3-9231-a16b3d99c2dc tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:27.471135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e23f9d7-1e86-4dc3-9231-a16b3d99c2dc tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:27.471572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e23f9d7-1e86-4dc3-9231-a16b3d99c2dc tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:27.517498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:27.518290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:27.527139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:27.527587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:27.531828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:27.532288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:27.971248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3e23f9d7-1e86-4dc3-9231-a16b3d99c2dc tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:27.984281 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e23f9d7-1e86-4dc3-9231-a16b3d99c2dc tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1308 microversion: 2.1 time: 0.533922 Jul 26 20:05:27.999355 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2169/4287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:27 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:28.125720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-dab383e0-db8d-4f61-b857-469f95e4c4f4 req-e0316011-9a33-4cea-8f8c-955990c82d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a997151b-3a5e-4094-a8ed-dcebb2bbb135", "tag": "945e97b4-9c49-406a-aead-3a0701c2d6d6"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:28.155280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-dab383e0-db8d-4f61-b857-469f95e4c4f4 req-e0316011-9a33-4cea-8f8c-955990c82d09 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:28.156227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-dab383e0-db8d-4f61-b857-469f95e4c4f4 req-e0316011-9a33-4cea-8f8c-955990c82d09 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:28.175264 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-dab383e0-db8d-4f61-b857-469f95e4c4f4 req-e0316011-9a33-4cea-8f8c-955990c82d09 service nova] Creating event network-changed:945e97b4-9c49-406a-aead-3a0701c2d6d6 for instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 on n-h2-708768-8 Jul 26 20:05:28.182561 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-dab383e0-db8d-4f61-b857-469f95e4c4f4 req-e0316011-9a33-4cea-8f8c-955990c82d09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063447 Jul 26 20:05:28.184303 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2170/4288] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:05:28.227219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-968c8431-7a05-4a6b-a233-baf285cb2742 req-5109c21e-0e0a-4fa9-b9c7-1e49088cebab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a2f2ff-7446-4f26-a0f7-4042bd9e9b42", "tag": "f18b6412-e56c-4088-94a2-0b702e7d6cc6"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:28.255750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-968c8431-7a05-4a6b-a233-baf285cb2742 req-5109c21e-0e0a-4fa9-b9c7-1e49088cebab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:28.256475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-968c8431-7a05-4a6b-a233-baf285cb2742 req-5109c21e-0e0a-4fa9-b9c7-1e49088cebab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:28.282483 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-968c8431-7a05-4a6b-a233-baf285cb2742 req-5109c21e-0e0a-4fa9-b9c7-1e49088cebab service nova] Creating event network-changed:f18b6412-e56c-4088-94a2-0b702e7d6cc6 for instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 on n-h1-708768-8 Jul 26 20:05:28.318073 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-968c8431-7a05-4a6b-a233-baf285cb2742 req-5109c21e-0e0a-4fa9-b9c7-1e49088cebab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095322 Jul 26 20:05:28.321459 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2171/4289] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:05:28.333842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5197148d-4833-4b49-90b5-2afdac39d00f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:28.334566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5197148d-4833-4b49-90b5-2afdac39d00f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:28.343678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5197148d-4833-4b49-90b5-2afdac39d00f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:28.344396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5197148d-4833-4b49-90b5-2afdac39d00f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:28.345929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5197148d-4833-4b49-90b5-2afdac39d00f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:28.346717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5197148d-4833-4b49-90b5-2afdac39d00f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:28.435107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:28.448174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:28.457263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:28.461058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32601cc8-a8a6-446f-a7da-8d1d4e9c5a3a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.948031 Jul 26 20:05:28.463967 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2119/4290] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:27 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:28.845705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5197148d-4833-4b49-90b5-2afdac39d00f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:28.855518 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5197148d-4833-4b49-90b5-2afdac39d00f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 0.532529 Jul 26 20:05:28.860295 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2172/4291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:28 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:29.011014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de48b82d-e2e7-4fef-ae30-493ef1f4f5ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:29.013743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de48b82d-e2e7-4fef-ae30-493ef1f4f5ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:29.030119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de48b82d-e2e7-4fef-ae30-493ef1f4f5ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:29.030976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de48b82d-e2e7-4fef-ae30-493ef1f4f5ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:29.032135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de48b82d-e2e7-4fef-ae30-493ef1f4f5ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:29.035176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de48b82d-e2e7-4fef-ae30-493ef1f4f5ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:29.370951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a3e8b1a5-489c-4334-ab09-3105b03e06c6 req-337f4f6e-68a1-42f9-8492-dbf9e5511d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f87df55d-ecd6-431b-8f7b-95ef5e1132eb", "name": "network-vif-plugged", "status": "completed", "tag": "5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:29.388160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a3e8b1a5-489c-4334-ab09-3105b03e06c6 req-337f4f6e-68a1-42f9-8492-dbf9e5511d04 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:29.389093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a3e8b1a5-489c-4334-ab09-3105b03e06c6 req-337f4f6e-68a1-42f9-8492-dbf9e5511d04 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:29.405291 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a3e8b1a5-489c-4334-ab09-3105b03e06c6 req-337f4f6e-68a1-42f9-8492-dbf9e5511d04 service nova] Creating event network-vif-plugged:5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad for instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb on n-h1-708768-8 Jul 26 20:05:29.415461 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a3e8b1a5-489c-4334-ab09-3105b03e06c6 req-337f4f6e-68a1-42f9-8492-dbf9e5511d04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049289 Jul 26 20:05:29.416599 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2173/4292] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:05:29.486767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:29.488152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:29.499307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:29.500143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:29.501187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:29.502450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:29.647571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:29.727329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-de48b82d-e2e7-4fef-ae30-493ef1f4f5ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:29.741848 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de48b82d-e2e7-4fef-ae30-493ef1f4f5ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1308 microversion: 2.1 time: 0.737153 Jul 26 20:05:29.742722 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2120/4293] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:29 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1308 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:29.889341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f5708cc-b4c7-4337-8717-9023023985fb tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:29.890190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f5708cc-b4c7-4337-8717-9023023985fb tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:29.911835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f5708cc-b4c7-4337-8717-9023023985fb tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:29.912289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f5708cc-b4c7-4337-8717-9023023985fb tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:29.916499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f5708cc-b4c7-4337-8717-9023023985fb tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:29.918091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f5708cc-b4c7-4337-8717-9023023985fb tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:29.965780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:29.981659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:29.987917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:29.992491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9967f1e1-eb6c-4665-bddf-69671a1cd509 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.510395 Jul 26 20:05:29.995887 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2174/4294] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:29 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:05:30.542548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6f5708cc-b4c7-4337-8717-9023023985fb tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:30.553994 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f5708cc-b4c7-4337-8717-9023023985fb tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 0.669174 Jul 26 20:05:30.554589 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2121/4295] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:29 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:05:30.765624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2e324ef2-0736-4db4-a270-13a7427c9e42 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:30.768972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2e324ef2-0736-4db4-a270-13a7427c9e42 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:30.781846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e324ef2-0736-4db4-a270-13a7427c9e42 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:30.785276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e324ef2-0736-4db4-a270-13a7427c9e42 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:30.787568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e324ef2-0736-4db4-a270-13a7427c9e42 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:30.789026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e324ef2-0736-4db4-a270-13a7427c9e42 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:31.024994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:31.024994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:31.039019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:31.045345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:31.047765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:31.051789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:31.253756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2e324ef2-0736-4db4-a270-13a7427c9e42 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:31.256394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:31.269766 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2e324ef2-0736-4db4-a270-13a7427c9e42 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1308 microversion: 2.1 time: 0.506292 Jul 26 20:05:31.270630 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2175/4296] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:30 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:31.447238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-8eb57ce0-7232-4535-8549-5b61adfae493 req-6c9e4cde-1ebb-4ef4-b125-a495876644f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "name": "network-vif-plugged", "status": "completed", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:31.472709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:31.481049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8eb57ce0-7232-4535-8549-5b61adfae493 req-6c9e4cde-1ebb-4ef4-b125-a495876644f0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:31.481763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8eb57ce0-7232-4535-8549-5b61adfae493 req-6c9e4cde-1ebb-4ef4-b125-a495876644f0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:31.528377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:31.538434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-8eb57ce0-7232-4535-8549-5b61adfae493 req-6c9e4cde-1ebb-4ef4-b125-a495876644f0 service nova] Creating event network-vif-plugged:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:05:31.552139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:31.555565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:31.557230 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3076b8c-c855-4f0b-bfee-43c62fcf3dd6 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.541339 Jul 26 20:05:31.557844 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-8eb57ce0-7232-4535-8549-5b61adfae493 req-6c9e4cde-1ebb-4ef4-b125-a495876644f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114270 Jul 26 20:05:31.558609 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2122/4297] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:31 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:31.587108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88bdd07a-9d41-4d8d-8ef9-f4c0f3366714 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:31.590777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-88bdd07a-9d41-4d8d-8ef9-f4c0f3366714 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:31.603192 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2176/4298] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:05:31.606246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88bdd07a-9d41-4d8d-8ef9-f4c0f3366714 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:31.612626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88bdd07a-9d41-4d8d-8ef9-f4c0f3366714 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:31.613466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88bdd07a-9d41-4d8d-8ef9-f4c0f3366714 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:31.618217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88bdd07a-9d41-4d8d-8ef9-f4c0f3366714 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:31.655457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:31.669404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:32.298688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5c00928-45d6-40a3-ac7c-08fbc8f6f4b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:32.299400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5c00928-45d6-40a3-ac7c-08fbc8f6f4b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:32.317604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c00928-45d6-40a3-ac7c-08fbc8f6f4b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:32.318526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c00928-45d6-40a3-ac7c-08fbc8f6f4b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:32.321201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c00928-45d6-40a3-ac7c-08fbc8f6f4b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:32.322078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c00928-45d6-40a3-ac7c-08fbc8f6f4b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:32.592580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-88bdd07a-9d41-4d8d-8ef9-f4c0f3366714 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:32.601056 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-88bdd07a-9d41-4d8d-8ef9-f4c0f3366714 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 1.025553 Jul 26 20:05:32.606011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2123/4299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:31 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:32.612987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:32.617451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:32.634709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:32.635578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:32.636701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:32.637463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:32.855278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c5c00928-45d6-40a3-ac7c-08fbc8f6f4b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:32.865079 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5c00928-45d6-40a3-ac7c-08fbc8f6f4b3 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1308 microversion: 2.1 time: 0.571649 Jul 26 20:05:32.865676 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2177/4300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:32 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:05:33.092335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:33.118970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:33.120591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:33.127449 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2069ac29-f37e-4667-9fd5-043bb1392a5f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1807 microversion: 2.20 time: 0.515300 Jul 26 20:05:33.128590 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2124/4301] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:32 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1807 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:33.630954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d7b91105-202c-4018-aa8c-69d4b84ee735 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:33.632378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d7b91105-202c-4018-aa8c-69d4b84ee735 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:33.646368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7b91105-202c-4018-aa8c-69d4b84ee735 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:33.646824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7b91105-202c-4018-aa8c-69d4b84ee735 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:33.647634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7b91105-202c-4018-aa8c-69d4b84ee735 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:33.648071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d7b91105-202c-4018-aa8c-69d4b84ee735 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:33.886882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e47b8b1b-c62b-4f29-9320-b0ef50e7f13f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:33.887558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e47b8b1b-c62b-4f29-9320-b0ef50e7f13f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:33.904122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e47b8b1b-c62b-4f29-9320-b0ef50e7f13f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:33.905001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e47b8b1b-c62b-4f29-9320-b0ef50e7f13f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:33.909742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e47b8b1b-c62b-4f29-9320-b0ef50e7f13f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:33.910199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e47b8b1b-c62b-4f29-9320-b0ef50e7f13f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:34.115945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d7b91105-202c-4018-aa8c-69d4b84ee735 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:34.134076 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d7b91105-202c-4018-aa8c-69d4b84ee735 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 0.508851 Jul 26 20:05:34.153193 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2178/4302] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:33 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:34.165988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:34.167867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:34.179993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:34.180819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:34.182762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:34.183585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:34.501697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:34.506976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:34.541207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:34.544809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:34.548627 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d1611fa1-39b5-4739-9a51-0932218d2169 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1794 microversion: 2.20 time: 0.392312 Jul 26 20:05:34.550027 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2179/4303] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:05:34 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1794 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:05:34.565602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-04e36f5e-2dfa-461c-8669-2546b39facf9 req-1f00b255-3312-4baf-bfbe-cdd59b23cff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a997151b-3a5e-4094-a8ed-dcebb2bbb135", "name": "network-vif-plugged", "status": "completed", "tag": "945e97b4-9c49-406a-aead-3a0701c2d6d6"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:34.593708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-04e36f5e-2dfa-461c-8669-2546b39facf9 req-1f00b255-3312-4baf-bfbe-cdd59b23cff8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:34.597651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-04e36f5e-2dfa-461c-8669-2546b39facf9 req-1f00b255-3312-4baf-bfbe-cdd59b23cff8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:34.628479 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-04e36f5e-2dfa-461c-8669-2546b39facf9 req-1f00b255-3312-4baf-bfbe-cdd59b23cff8 service nova] Creating event network-vif-plugged:945e97b4-9c49-406a-aead-3a0701c2d6d6 for instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 on n-h2-708768-8 Jul 26 20:05:34.635914 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-04e36f5e-2dfa-461c-8669-2546b39facf9 req-1f00b255-3312-4baf-bfbe-cdd59b23cff8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082238 Jul 26 20:05:34.637899 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2180/4304] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:05:34.921736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e47b8b1b-c62b-4f29-9320-b0ef50e7f13f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:34.934934 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e47b8b1b-c62b-4f29-9320-b0ef50e7f13f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1308 microversion: 2.1 time: 1.052197 Jul 26 20:05:34.941708 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2125/4305] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:33 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1308 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:35.161422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5dd5057-b75f-4109-b15f-0687156dba6f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:35.162142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5dd5057-b75f-4109-b15f-0687156dba6f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:35.175064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5dd5057-b75f-4109-b15f-0687156dba6f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:35.176030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5dd5057-b75f-4109-b15f-0687156dba6f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:35.178666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5dd5057-b75f-4109-b15f-0687156dba6f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:35.180378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5dd5057-b75f-4109-b15f-0687156dba6f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:35.487586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c5dd5057-b75f-4109-b15f-0687156dba6f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:35.505878 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5dd5057-b75f-4109-b15f-0687156dba6f tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 0.342741 Jul 26 20:05:35.507712 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2181/4306] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:35 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:35.971337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dfe32900-8428-41df-afd0-cde63a0fa3df tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:35.972076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dfe32900-8428-41df-afd0-cde63a0fa3df tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:35.992507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfe32900-8428-41df-afd0-cde63a0fa3df tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:35.992979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfe32900-8428-41df-afd0-cde63a0fa3df tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:35.996532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfe32900-8428-41df-afd0-cde63a0fa3df tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:36.001273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfe32900-8428-41df-afd0-cde63a0fa3df tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:36.384987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dfe32900-8428-41df-afd0-cde63a0fa3df tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:36.396392 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dfe32900-8428-41df-afd0-cde63a0fa3df tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1308 microversion: 2.1 time: 0.430126 Jul 26 20:05:36.412248 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2126/4307] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:35 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:36.537795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e4ea2a55-8c0a-4f6e-91c1-7b0f56cc0170 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:36.539020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e4ea2a55-8c0a-4f6e-91c1-7b0f56cc0170 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:36.550984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4ea2a55-8c0a-4f6e-91c1-7b0f56cc0170 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:36.552203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4ea2a55-8c0a-4f6e-91c1-7b0f56cc0170 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:36.553460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4ea2a55-8c0a-4f6e-91c1-7b0f56cc0170 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:36.555470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4ea2a55-8c0a-4f6e-91c1-7b0f56cc0170 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:36.752125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-da35cc38-fd18-4593-86ee-cbcdb1de4ec5 req-fa3e0f8a-00af-49dd-ac3e-69095c7769e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a2f2ff-7446-4f26-a0f7-4042bd9e9b42", "name": "network-vif-plugged", "status": "completed", "tag": "f18b6412-e56c-4088-94a2-0b702e7d6cc6"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:36.772535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-da35cc38-fd18-4593-86ee-cbcdb1de4ec5 req-fa3e0f8a-00af-49dd-ac3e-69095c7769e8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:36.773155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-da35cc38-fd18-4593-86ee-cbcdb1de4ec5 req-fa3e0f8a-00af-49dd-ac3e-69095c7769e8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:36.798745 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-da35cc38-fd18-4593-86ee-cbcdb1de4ec5 req-fa3e0f8a-00af-49dd-ac3e-69095c7769e8 service nova] Creating event network-vif-plugged:f18b6412-e56c-4088-94a2-0b702e7d6cc6 for instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 on n-h1-708768-8 Jul 26 20:05:36.805891 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-da35cc38-fd18-4593-86ee-cbcdb1de4ec5 req-fa3e0f8a-00af-49dd-ac3e-69095c7769e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057526 Jul 26 20:05:36.807193 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2127/4308] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:05:36.945163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e4ea2a55-8c0a-4f6e-91c1-7b0f56cc0170 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:36.953985 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e4ea2a55-8c0a-4f6e-91c1-7b0f56cc0170 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 0.425303 Jul 26 20:05:36.957950 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2182/4309] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:36 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:37.419795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-551cbe7c-5424-423d-ae33-3106136feb26 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:37.421143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-551cbe7c-5424-423d-ae33-3106136feb26 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:37.431374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-551cbe7c-5424-423d-ae33-3106136feb26 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:37.431855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-551cbe7c-5424-423d-ae33-3106136feb26 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:37.432629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-551cbe7c-5424-423d-ae33-3106136feb26 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:37.433071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-551cbe7c-5424-423d-ae33-3106136feb26 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:37.666658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-551cbe7c-5424-423d-ae33-3106136feb26 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:37.682069 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-551cbe7c-5424-423d-ae33-3106136feb26 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1488 microversion: 2.1 time: 0.267363 Jul 26 20:05:37.682921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2128/4310] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:37 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1488 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:37.705057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cea7b012-1c39-4442-bf1f-37152510aa37 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-342477010"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:37.707713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cea7b012-1c39-4442-bf1f-37152510aa37 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:37.726577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cea7b012-1c39-4442-bf1f-37152510aa37 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:37.728378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cea7b012-1c39-4442-bf1f-37152510aa37 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:37.731388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cea7b012-1c39-4442-bf1f-37152510aa37 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:37.732063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cea7b012-1c39-4442-bf1f-37152510aa37 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:37.978522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c251034-219a-4eb2-963e-b343e70cfe23 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:37.979345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5c251034-219a-4eb2-963e-b343e70cfe23 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:37.990462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c251034-219a-4eb2-963e-b343e70cfe23 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:37.992164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c251034-219a-4eb2-963e-b343e70cfe23 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:37.995030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c251034-219a-4eb2-963e-b343e70cfe23 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:37.996188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c251034-219a-4eb2-963e-b343e70cfe23 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:38.050676 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cea7b012-1c39-4442-bf1f-37152510aa37 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "POST /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135/action" status: 202 len: 0 microversion: 2.1 time: 0.349276 Jul 26 20:05:38.052128 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2183/4311] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:05:37 2022] POST /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 20:05:38.064467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e0ac74cb-675c-422d-977e-464af4cd8b9d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87567185e0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:38.228906 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e0ac74cb-675c-422d-977e-464af4cd8b9d tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f" status: 200 len: 1413 microversion: 2.1 time: 0.165448 Jul 26 20:05:38.235905 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2184/4312] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:05:38 2022] GET /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f => generated 1413 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:38.258872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5fff8e0-7f55-4108-b719-73cf220a77ea tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875673ed30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:38.357778 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5fff8e0-7f55-4108-b719-73cf220a77ea tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f" status: 200 len: 1413 microversion: 2.1 time: 0.112391 Jul 26 20:05:38.368193 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2185/4313] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:05:38 2022] GET /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:05:38.378994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba2b0661-b390-4054-a2fd-b28c42d05730 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f8756718820>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:38.406339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5c251034-219a-4eb2-963e-b343e70cfe23 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:38.418314 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5c251034-219a-4eb2-963e-b343e70cfe23 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1324 microversion: 2.1 time: 0.444044 Jul 26 20:05:38.421548 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2129/4314] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:37 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1324 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:38.557697 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba2b0661-b390-4054-a2fd-b28c42d05730 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f" status: 204 len: 0 microversion: 2.1 time: 0.188093 Jul 26 20:05:38.558620 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2186/4315] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:38 2022] DELETE /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:05:38.570083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09380739-c435-446c-90df-0c14803d152e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e9cdc10>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:38.621304 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-09380739-c435-446c-90df-0c14803d152e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Image not found. Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09380739-c435-446c-90df-0c14803d152e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f HTTP/1.1 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ac1b326e-12cc-4bf9-9565-1d745805165f'} Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ac1b326e-12cc-4bf9-9565-1d745805165f Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 20:05:38.624057 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac1b326e-12cc-4bf9-9565-1d745805165f could not be found. Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 20:05:38.628423 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:38.635219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09380739-c435-446c-90df-0c14803d152e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:38.637955 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09380739-c435-446c-90df-0c14803d152e tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f" status: 404 len: 62 microversion: 2.1 time: 0.072951 Jul 26 20:05:38.640956 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2130/4316] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Jul 26 20:05:38 2022] GET /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:05:38.651207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1ae3c48c-8fa2-4bb3-9d2b-99dac1b53843 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:38.652299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1ae3c48c-8fa2-4bb3-9d2b-99dac1b53843 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:38.660840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ae3c48c-8fa2-4bb3-9d2b-99dac1b53843 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:38.661834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ae3c48c-8fa2-4bb3-9d2b-99dac1b53843 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:38.663835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ae3c48c-8fa2-4bb3-9d2b-99dac1b53843 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:38.664457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ae3c48c-8fa2-4bb3-9d2b-99dac1b53843 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:39.160065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ae3c48c-8fa2-4bb3-9d2b-99dac1b53843 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:39.169815 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1ae3c48c-8fa2-4bb3-9d2b-99dac1b53843 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1500 microversion: 2.1 time: 0.524489 Jul 26 20:05:39.183956 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2187/4317] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:38 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1500 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:39.445502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64de2531-85e0-4569-bace-064ee6ca6260 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:39.446289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64de2531-85e0-4569-bace-064ee6ca6260 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:39.459396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64de2531-85e0-4569-bace-064ee6ca6260 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:39.461522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64de2531-85e0-4569-bace-064ee6ca6260 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:39.463132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64de2531-85e0-4569-bace-064ee6ca6260 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:39.466102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64de2531-85e0-4569-bace-064ee6ca6260 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:39.774087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64de2531-85e0-4569-bace-064ee6ca6260 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:39.782356 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64de2531-85e0-4569-bace-064ee6ca6260 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1520 microversion: 2.1 time: 0.343619 Jul 26 20:05:39.788528 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2131/4318] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:39 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:40.004923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-457fd1c1-a803-4009-9a55-7c6aff80b542 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1767915498", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-457fd1c1-a803-4009-9a55-7c6aff80b542 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Request method failure captured: Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 243 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ej8wizCf5bZrRBYN4rDkes_BD4Wp5Wj3HiMP-d-v31isaPRWast5bYFyZs9drXDTkLw6PbUyDuJsxVQwau59gLJkaTx-6vzTBGJS0iBhdNbyXSXl09K0VfEzJhJ4yS6eH2X0-G-bYyYALdszDKnWobkOe1Q4OHmbyCtZpDxIq7KrRc Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f20170367940fdb2aec0c53ccce333", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}] Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9c88be73cf9945a0ab2158b1d86ecd86 Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1767915498", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1767915498', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5910b6fb-1696-4afd-bbde-8d3d2505231f'}]}}} Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:05:40.010722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-457fd1c1-a803-4009-9a55-7c6aff80b542 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:40.014974 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-457fd1c1-a803-4009-9a55-7c6aff80b542 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.013958 Jul 26 20:05:40.016456 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2188/4319] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:05:39 2022] POST /compute/v2.1/servers => generated 175 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:05:40.026395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ae71ea0-3606-4a1b-8aa4-9fa4c534f8a3 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:40.027967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8ae71ea0-3606-4a1b-8aa4-9fa4c534f8a3 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 64686662-d34a-44be-9040-7667577ffe8e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:40.039118 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-8ae71ea0-3606-4a1b-8aa4-9fa4c534f8a3 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] HTTP exception thrown: Instance 64686662-d34a-44be-9040-7667577ffe8e could not be found. Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ae71ea0-3606-4a1b-8aa4-9fa4c534f8a3 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Request method failure captured: Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/64686662-d34a-44be-9040-7667577ffe8e/metadata HTTP/1.1 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ej8wizCf5bZrRBYN4rDkes_BD4Wp5Wj3HiMP-d-v31isaPRWast5bYFyZs9drXDTkLw6PbUyDuJsxVQwau59gLJkaTx-6vzTBGJS0iBhdNbyXSXl09K0VfEzJhJ4yS6eH2X0-G-bYyYALdszDKnWobkOe1Q4OHmbyCtZpDxIq7KrRc Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f20170367940fdb2aec0c53ccce333", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}] Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c88be73cf9945a0ab2158b1d86ecd86 Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 64686662-d34a-44be-9040-7667577ffe8e could not be found. Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '64686662-d34a-44be-9040-7667577ffe8e'} Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64686662-d34a-44be-9040-7667577ffe8e could not be found. Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64686662-d34a-44be-9040-7667577ffe8e could not be found. Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.048081 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.055261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:40.055261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:40.055261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64686662-d34a-44be-9040-7667577ffe8e could not be found. Jul 26 20:05:40.055261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.058872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ae71ea0-3606-4a1b-8aa4-9fa4c534f8a3 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Returning 404 to user: Instance 64686662-d34a-44be-9040-7667577ffe8e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:40.060207 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8ae71ea0-3606-4a1b-8aa4-9fa4c534f8a3 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/64686662-d34a-44be-9040-7667577ffe8e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.038141 Jul 26 20:05:40.072856 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2132/4320] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 20:05:40 2022] GET /compute/v2.1/servers/64686662-d34a-44be-9040-7667577ffe8e/metadata => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:40.191746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e2625adc-9b3d-4c5a-8a7e-68660c5166b5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:40.194087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e2625adc-9b3d-4c5a-8a7e-68660c5166b5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:40.210120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e2625adc-9b3d-4c5a-8a7e-68660c5166b5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:40.212192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e2625adc-9b3d-4c5a-8a7e-68660c5166b5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:40.214865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e2625adc-9b3d-4c5a-8a7e-68660c5166b5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:40.217467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e2625adc-9b3d-4c5a-8a7e-68660c5166b5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:40.345372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9254bbb9-bf20-445c-a242-00626ae4d506 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1762803975", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9254bbb9-bf20-445c-a242-00626ae4d506 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Request method failure captured: Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 499 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ej8wizCf5bZrRBYN4rDkes_BD4Wp5Wj3HiMP-d-v31isaPRWast5bYFyZs9drXDTkLw6PbUyDuJsxVQwau59gLJkaTx-6vzTBGJS0iBhdNbyXSXl09K0VfEzJhJ4yS6eH2X0-G-bYyYALdszDKnWobkOe1Q4OHmbyCtZpDxIq7KrRc Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f20170367940fdb2aec0c53ccce333", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}] Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c88be73cf9945a0ab2158b1d86ecd86 Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1762803975", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1762803975', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5910b6fb-1696-4afd-bbde-8d3d2505231f'}]}}} Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 20:05:40.352928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9254bbb9-bf20-445c-a242-00626ae4d506 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:40.355940 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9254bbb9-bf20-445c-a242-00626ae4d506 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.014698 Jul 26 20:05:40.358233 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2133/4321] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:05:40 2022] POST /compute/v2.1/servers => generated 687 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:05:40.578985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d07531a-47ba-4534-94cb-15b190ebb566 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-241362703", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d07531a-47ba-4534-94cb-15b190ebb566 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Request method failure captured: Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 499 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ej8wizCf5bZrRBYN4rDkes_BD4Wp5Wj3HiMP-d-v31isaPRWast5bYFyZs9drXDTkLw6PbUyDuJsxVQwau59gLJkaTx-6vzTBGJS0iBhdNbyXSXl09K0VfEzJhJ4yS6eH2X0-G-bYyYALdszDKnWobkOe1Q4OHmbyCtZpDxIq7KrRc Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f20170367940fdb2aec0c53ccce333", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}] Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c88be73cf9945a0ab2158b1d86ecd86 Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-241362703", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-241362703', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5910b6fb-1696-4afd-bbde-8d3d2505231f'}]}}} Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 20:05:40.601034 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.604669 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.610036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d07531a-47ba-4534-94cb-15b190ebb566 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:40.612733 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9d07531a-47ba-4534-94cb-15b190ebb566 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.039487 Jul 26 20:05:40.614036 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2134/4322] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:05:40 2022] POST /compute/v2.1/servers => generated 689 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:05:40.670857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e2625adc-9b3d-4c5a-8a7e-68660c5166b5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:40.680711 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e2625adc-9b3d-4c5a-8a7e-68660c5166b5 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1506 microversion: 2.1 time: 0.494218 Jul 26 20:05:40.690571 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2189/4323] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:40 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:40.802017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cee03767-f1ff-40ef-b7e9-bfd7d9c43b02 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1271269342", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cee03767-f1ff-40ef-b7e9-bfd7d9c43b02 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Request method failure captured: Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 754 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ej8wizCf5bZrRBYN4rDkes_BD4Wp5Wj3HiMP-d-v31isaPRWast5bYFyZs9drXDTkLw6PbUyDuJsxVQwau59gLJkaTx-6vzTBGJS0iBhdNbyXSXl09K0VfEzJhJ4yS6eH2X0-G-bYyYALdszDKnWobkOe1Q4OHmbyCtZpDxIq7KrRc Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f20170367940fdb2aec0c53ccce333", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}] Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c88be73cf9945a0ab2158b1d86ecd86 Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1271269342", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1271269342', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5910b6fb-1696-4afd-bbde-8d3d2505231f'}]}}} Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:05:40.806660 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:05:40.810741 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:05:40.813747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:40.813747 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:40.820385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cee03767-f1ff-40ef-b7e9-bfd7d9c43b02 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:40.821645 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cee03767-f1ff-40ef-b7e9-bfd7d9c43b02 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.029198 Jul 26 20:05:40.832213 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2135/4324] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:05:40 2022] POST /compute/v2.1/servers => generated 1197 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 26 20:05:41.307777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44bf7396-1863-4726-9a85-82f2b1235115 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-626076559", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44bf7396-1863-4726-9a85-82f2b1235115 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Request method failure captured: Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 1265 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ej8wizCf5bZrRBYN4rDkes_BD4Wp5Wj3HiMP-d-v31isaPRWast5bYFyZs9drXDTkLw6PbUyDuJsxVQwau59gLJkaTx-6vzTBGJS0iBhdNbyXSXl09K0VfEzJhJ4yS6eH2X0-G-bYyYALdszDKnWobkOe1Q4OHmbyCtZpDxIq7KrRc Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f20170367940fdb2aec0c53ccce333", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}] Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9c88be73cf9945a0ab2158b1d86ecd86 Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-626076559", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5910b6fb-1696-4afd-bbde-8d3d2505231f"}]}} Jul 26 20:05:41.312462 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-626076559', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5910b6fb-1696-4afd-bbde-8d3d2505231f'}]}}} Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.315320 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:05:41.316723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:05:41.318793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 20:05:41.318793 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.318793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44bf7396-1863-4726-9a85-82f2b1235115 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:41.318793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44bf7396-1863-4726-9a85-82f2b1235115 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010518 Jul 26 20:05:41.320101 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2190/4325] 10.222.0.58 () {60 vars in 1148 bytes} [Tue Jul 26 20:05:41 2022] POST /compute/v2.1/servers => generated 2221 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 26 20:05:41.338948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c28cd06e-09e8-42c8-96f9-c3619cd7e401 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:41.340646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c28cd06e-09e8-42c8-96f9-c3619cd7e401 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 3d26e60e-cd5c-406a-9fe0-746d44fcc14c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:41.364759 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c28cd06e-09e8-42c8-96f9-c3619cd7e401 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] HTTP exception thrown: Instance 3d26e60e-cd5c-406a-9fe0-746d44fcc14c could not be found. Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c28cd06e-09e8-42c8-96f9-c3619cd7e401 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Request method failure captured: Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/3d26e60e-cd5c-406a-9fe0-746d44fcc14c/metadata/test2 HTTP/1.1 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ej8wizCf5bZrRBYN4rDkes_BD4Wp5Wj3HiMP-d-v31isaPRWast5bYFyZs9drXDTkLw6PbUyDuJsxVQwau59gLJkaTx-6vzTBGJS0iBhdNbyXSXl09K0VfEzJhJ4yS6eH2X0-G-bYyYALdszDKnWobkOe1Q4OHmbyCtZpDxIq7KrRc Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f20170367940fdb2aec0c53ccce333", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}] Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c88be73cf9945a0ab2158b1d86ecd86 Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 3d26e60e-cd5c-406a-9fe0-746d44fcc14c could not be found. Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '3d26e60e-cd5c-406a-9fe0-746d44fcc14c', 'id': 'test2'} Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d26e60e-cd5c-406a-9fe0-746d44fcc14c could not be found. Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d26e60e-cd5c-406a-9fe0-746d44fcc14c could not be found. Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:41.389793 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:41.395071 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:41.395071 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:41.395071 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d26e60e-cd5c-406a-9fe0-746d44fcc14c could not be found. Jul 26 20:05:41.395071 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:41.395071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c28cd06e-09e8-42c8-96f9-c3619cd7e401 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Returning 404 to user: Instance 3d26e60e-cd5c-406a-9fe0-746d44fcc14c could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:41.395071 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c28cd06e-09e8-42c8-96f9-c3619cd7e401 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/3d26e60e-cd5c-406a-9fe0-746d44fcc14c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.065161 Jul 26 20:05:41.395071 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2136/4326] 10.222.0.58 () {58 vars in 1281 bytes} [Tue Jul 26 20:05:41 2022] GET /compute/v2.1/servers/3d26e60e-cd5c-406a-9fe0-746d44fcc14c/metadata/test2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:41.416581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-473491bf-5c25-4fff-bd9d-7f54d510fd13 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:41.417092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-473491bf-5c25-4fff-bd9d-7f54d510fd13 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:41.441135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-473491bf-5c25-4fff-bd9d-7f54d510fd13 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:41.441601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-473491bf-5c25-4fff-bd9d-7f54d510fd13 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:41.442399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-473491bf-5c25-4fff-bd9d-7f54d510fd13 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:41.442838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-473491bf-5c25-4fff-bd9d-7f54d510fd13 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:41.510802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-473491bf-5c25-4fff-bd9d-7f54d510fd13 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:05:41.698813 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-473491bf-5c25-4fff-bd9d-7f54d510fd13 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "DELETE /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 204 len: 0 microversion: 2.1 time: 0.291174 Jul 26 20:05:41.713261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b75a04c1-f412-498b-aa67-13aad3fa8015 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:41.715004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b75a04c1-f412-498b-aa67-13aad3fa8015 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:41.719730 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2191/4327] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:05:41 2022] DELETE /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:05:41.725583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b75a04c1-f412-498b-aa67-13aad3fa8015 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:41.726035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b75a04c1-f412-498b-aa67-13aad3fa8015 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:41.726820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b75a04c1-f412-498b-aa67-13aad3fa8015 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:41.727264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b75a04c1-f412-498b-aa67-13aad3fa8015 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:41.739178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ace10db4-cd3c-47c8-951f-013be5cbad3e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:41.741250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ace10db4-cd3c-47c8-951f-013be5cbad3e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:41.760116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace10db4-cd3c-47c8-951f-013be5cbad3e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:41.760894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace10db4-cd3c-47c8-951f-013be5cbad3e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:41.764117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace10db4-cd3c-47c8-951f-013be5cbad3e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:41.765048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace10db4-cd3c-47c8-951f-013be5cbad3e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:42.022425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b75a04c1-f412-498b-aa67-13aad3fa8015 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:42.031650 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b75a04c1-f412-498b-aa67-13aad3fa8015 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1488 microversion: 2.1 time: 0.322243 Jul 26 20:05:42.054677 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2137/4328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:41 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1488 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:42.075856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-433cb888-bb09-4f1c-81e2-47b0765d1b68 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:42.076383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-433cb888-bb09-4f1c-81e2-47b0765d1b68 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:42.115796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-433cb888-bb09-4f1c-81e2-47b0765d1b68 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:42.120728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-433cb888-bb09-4f1c-81e2-47b0765d1b68 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:42.121605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-433cb888-bb09-4f1c-81e2-47b0765d1b68 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:42.122050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-433cb888-bb09-4f1c-81e2-47b0765d1b68 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:42.196480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-433cb888-bb09-4f1c-81e2-47b0765d1b68 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:05:42.458084 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-433cb888-bb09-4f1c-81e2-47b0765d1b68 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 204 len: 0 microversion: 2.1 time: 0.394666 Jul 26 20:05:42.459497 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2138/4329] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:05:42 2022] DELETE /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:05:42.468631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ace10db4-cd3c-47c8-951f-013be5cbad3e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:42.486882 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ace10db4-cd3c-47c8-951f-013be5cbad3e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1526 microversion: 2.1 time: 0.764261 Jul 26 20:05:42.493354 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2192/4330] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:41 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1526 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:42.497092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-13f475eb-251d-47f9-8429-8b6d6ef00629 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875e9e69d0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:42.535159 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-13f475eb-251d-47f9-8429-8b6d6ef00629 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Image not found. Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-13f475eb-251d-47f9-8429-8b6d6ef00629 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f HTTP/1.1 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ac1b326e-12cc-4bf9-9565-1d745805165f'} Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac1b326e-12cc-4bf9-9565-1d745805165f to delete Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac1b326e-12cc-4bf9-9565-1d745805165f could not be found. Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:42.538290 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-13f475eb-251d-47f9-8429-8b6d6ef00629 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-13f475eb-251d-47f9-8429-8b6d6ef00629 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f" status: 404 len: 62 microversion: 2.1 time: 0.065298 Jul 26 20:05:42.547070 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2139/4331] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:42 2022] DELETE /compute/v2.1/images/ac1b326e-12cc-4bf9-9565-1d745805165f => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:05:42.555110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:42.556069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:42.563389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:42.564632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:42.565697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:42.566392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:42.616486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:05:42.718335 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.compute.api [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Instance is already in deleting state, ignoring this request Jul 26 20:05:42.719497 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-95992634-1d47-41dd-8c3b-b8e2afd66e0c tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 204 len: 0 microversion: 2.1 time: 0.168727 Jul 26 20:05:42.720891 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2193/4332] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:05:42 2022] DELETE /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:05:42.732620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e04fdc9f-350a-493f-a9ed-09e370290e9f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:42.734021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e04fdc9f-350a-493f-a9ed-09e370290e9f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:42.746428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e04fdc9f-350a-493f-a9ed-09e370290e9f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:42.747193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e04fdc9f-350a-493f-a9ed-09e370290e9f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:42.748787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e04fdc9f-350a-493f-a9ed-09e370290e9f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:42.749390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e04fdc9f-350a-493f-a9ed-09e370290e9f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:43.184968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e04fdc9f-350a-493f-a9ed-09e370290e9f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:43.202753 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e04fdc9f-350a-493f-a9ed-09e370290e9f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1494 microversion: 2.1 time: 0.476749 Jul 26 20:05:43.218324 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2140/4333] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:42 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1494 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:05:43.519312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5d632436-1566-4c12-bc30-b85d8025081e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:43.520724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5d632436-1566-4c12-bc30-b85d8025081e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:43.533703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d632436-1566-4c12-bc30-b85d8025081e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:43.534587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d632436-1566-4c12-bc30-b85d8025081e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:43.535946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d632436-1566-4c12-bc30-b85d8025081e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:43.537106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d632436-1566-4c12-bc30-b85d8025081e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:43.773702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5d632436-1566-4c12-bc30-b85d8025081e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c88be73cf9945a0ab2158b1d86ecd86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f20170367940fdb2aec0c53ccce333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:43.784929 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5d632436-1566-4c12-bc30-b85d8025081e tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 200 len: 1526 microversion: 2.1 time: 0.272100 Jul 26 20:05:43.789761 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2194/4334] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:43 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 1526 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:44.061516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4e1c66f9-6a5e-410c-99f8-348fb9b39345 req-bd847a30-d014-4dce-bdbb-44f04dd710c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a2f2ff-7446-4f26-a0f7-4042bd9e9b42", "name": "network-vif-deleted", "tag": "f18b6412-e56c-4088-94a2-0b702e7d6cc6"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:44.104885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4e1c66f9-6a5e-410c-99f8-348fb9b39345 req-bd847a30-d014-4dce-bdbb-44f04dd710c4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:44.111111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4e1c66f9-6a5e-410c-99f8-348fb9b39345 req-bd847a30-d014-4dce-bdbb-44f04dd710c4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:44.160960 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-4e1c66f9-6a5e-410c-99f8-348fb9b39345 req-bd847a30-d014-4dce-bdbb-44f04dd710c4 service nova] Creating event network-vif-deleted:f18b6412-e56c-4088-94a2-0b702e7d6cc6 for instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 on n-h1-708768-8 Jul 26 20:05:44.174295 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4e1c66f9-6a5e-410c-99f8-348fb9b39345 req-bd847a30-d014-4dce-bdbb-44f04dd710c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116829 Jul 26 20:05:44.178939 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2141/4335] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:05:44.225388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1cf79c69-7480-4010-a03a-49a6ca55d65f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:44.226007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1cf79c69-7480-4010-a03a-49a6ca55d65f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:44.247117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:44.249072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cf79c69-7480-4010-a03a-49a6ca55d65f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:44.251109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cf79c69-7480-4010-a03a-49a6ca55d65f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:44.254200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cf79c69-7480-4010-a03a-49a6ca55d65f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:44.254978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1cf79c69-7480-4010-a03a-49a6ca55d65f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:44.353321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ab9ea7c6-e137-438b-9b1c-85a805c9caff req-9eb95a15-dbbe-47be-a9d9-24adc4c9174d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a997151b-3a5e-4094-a8ed-dcebb2bbb135", "name": "network-vif-plugged", "status": "completed", "tag": "945e97b4-9c49-406a-aead-3a0701c2d6d6"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:44.379706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ab9ea7c6-e137-438b-9b1c-85a805c9caff req-9eb95a15-dbbe-47be-a9d9-24adc4c9174d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:44.380105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ab9ea7c6-e137-438b-9b1c-85a805c9caff req-9eb95a15-dbbe-47be-a9d9-24adc4c9174d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:44.431892 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ab9ea7c6-e137-438b-9b1c-85a805c9caff req-9eb95a15-dbbe-47be-a9d9-24adc4c9174d service nova] Creating event network-vif-plugged:945e97b4-9c49-406a-aead-3a0701c2d6d6 for instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 on n-h2-708768-8 Jul 26 20:05:44.447365 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ab9ea7c6-e137-438b-9b1c-85a805c9caff req-9eb95a15-dbbe-47be-a9d9-24adc4c9174d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099182 Jul 26 20:05:44.448032 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2142/4336] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:05:44.813759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:44.815519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] [instance: 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:44.829792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:44.831035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:44.833906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:44.835730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:44.907654 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] HTTP exception thrown: Instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 could not be found. Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Request method failure captured: Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 HTTP/1.1 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ej8wizCf5bZrRBYN4rDkes_BD4Wp5Wj3HiMP-d-v31isaPRWast5bYFyZs9drXDTkLw6PbUyDuJsxVQwau59gLJkaTx-6vzTBGJS0iBhdNbyXSXl09K0VfEzJhJ4yS6eH2X0-G-bYyYALdszDKnWobkOe1Q4OHmbyCtZpDxIq7KrRc Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_79f20170367940fdb2aec0c53ccce333", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/79f20170367940fdb2aec0c53ccce333"}]}] Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 79f20170367940fdb2aec0c53ccce333 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-194379124 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c88be73cf9945a0ab2158b1d86ecd86 Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-194379124-project Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 could not be found. Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '81a2f2ff-7446-4f26-a0f7-4042bd9e9b42'} Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 could not be found. Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 could not be found. Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:44.912459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:44.917235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:44.917235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:44.917235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:44.917235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:44.917235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:44.917235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:44.917235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 could not be found. Jul 26 20:05:44.917235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:44.918547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] Returning 404 to user: Instance 81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:44.920673 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c0ab2d88-1796-4d47-bfae-8969e4324349 tempest-ServerMetadataNegativeTestJSON-194379124 tempest-ServerMetadataNegativeTestJSON-194379124-project] 10.222.0.58 "GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42" status: 404 len: 111 microversion: 2.1 time: 0.112809 Jul 26 20:05:44.921253 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2143/4337] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:44 2022] GET /compute/v2.1/servers/81a2f2ff-7446-4f26-a0f7-4042bd9e9b42 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:45.087423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1cf79c69-7480-4010-a03a-49a6ca55d65f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:45.104038 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1cf79c69-7480-4010-a03a-49a6ca55d65f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1494 microversion: 2.1 time: 0.882102 Jul 26 20:05:45.106353 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2195/4338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:44 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1494 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:46.130285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f7acfa9d-c2e8-4836-b928-3ff1471695e1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:46.131496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f7acfa9d-c2e8-4836-b928-3ff1471695e1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:46.147945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:46.158532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7acfa9d-c2e8-4836-b928-3ff1471695e1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:46.160556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7acfa9d-c2e8-4836-b928-3ff1471695e1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:46.162786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7acfa9d-c2e8-4836-b928-3ff1471695e1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:46.166487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7acfa9d-c2e8-4836-b928-3ff1471695e1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:46.278560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6090fc66-12d0-4b3f-a61f-3da956c41332 req-f924905f-cc84-42fd-9bf4-1eb61e7e96a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a997151b-3a5e-4094-a8ed-dcebb2bbb135", "name": "network-vif-deleted", "tag": "945e97b4-9c49-406a-aead-3a0701c2d6d6"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:46.295710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6090fc66-12d0-4b3f-a61f-3da956c41332 req-f924905f-cc84-42fd-9bf4-1eb61e7e96a9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:46.301871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6090fc66-12d0-4b3f-a61f-3da956c41332 req-f924905f-cc84-42fd-9bf4-1eb61e7e96a9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:46.342689 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6090fc66-12d0-4b3f-a61f-3da956c41332 req-f924905f-cc84-42fd-9bf4-1eb61e7e96a9 service nova] Creating event network-vif-deleted:945e97b4-9c49-406a-aead-3a0701c2d6d6 for instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 on n-h2-708768-8 Jul 26 20:05:46.368748 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6090fc66-12d0-4b3f-a61f-3da956c41332 req-f924905f-cc84-42fd-9bf4-1eb61e7e96a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095017 Jul 26 20:05:46.371282 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2196/4339] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:05:46.456785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f7acfa9d-c2e8-4836-b928-3ff1471695e1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f82c738a399d4688b1870ea46700ac71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a715ad339a264f918507acfd8a1180f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:46.478472 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f7acfa9d-c2e8-4836-b928-3ff1471695e1 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 200 len: 1452 microversion: 2.1 time: 0.352773 Jul 26 20:05:46.479983 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2144/4340] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:46 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 1452 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:47.512476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:47.513516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a997151b-3a5e-4094-a8ed-dcebb2bbb135] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:47.530056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:47.534489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:47.542775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:47.543563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:47.590123 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 could not be found. Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 HTTP/1.1 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 could not be found. Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a997151b-3a5e-4094-a8ed-dcebb2bbb135'} Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 could not be found. Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 could not be found. Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.602705 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.607378 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:47.607378 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:47.607378 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:47.607378 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:47.607378 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 could not be found. Jul 26 20:05:47.607378 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.609055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Instance a997151b-3a5e-4094-a8ed-dcebb2bbb135 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:47.614641 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-be9fcd43-8210-4fae-b8a3-bad48b3779eb tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135" status: 404 len: 111 microversion: 2.1 time: 0.107524 Jul 26 20:05:47.618838 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2197/4341] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:47 2022] GET /compute/v2.1/servers/a997151b-3a5e-4094-a8ed-dcebb2bbb135 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:47.626898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd17988d-5c58-43da-910b-0a67fe5e8e27 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f875edd6280>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:47.768916 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cd17988d-5c58-43da-910b-0a67fe5e8e27 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Image not found. Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd17988d-5c58-43da-910b-0a67fe5e8e27 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd HTTP/1.1 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '1092c9d3-58af-40ec-a7fa-9c786676c0cd'} Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1092c9d3-58af-40ec-a7fa-9c786676c0cd to delete Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1092c9d3-58af-40ec-a7fa-9c786676c0cd could not be found. Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.771144 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd17988d-5c58-43da-910b-0a67fe5e8e27 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd17988d-5c58-43da-910b-0a67fe5e8e27 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd" status: 404 len: 62 microversion: 2.1 time: 0.151639 Jul 26 20:05:47.779035 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2145/4342] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:47 2022] DELETE /compute/v2.1/images/1092c9d3-58af-40ec-a7fa-9c786676c0cd => generated 62 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:05:47.786815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:47.787462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:47.800169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:47.802826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:47.807879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:47.811076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:47.865427 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 HTTP/1.1 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'a44418c8-1159-440a-a9a5-f6cd8c69eb61'} Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:47.871311 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.876823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.881018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:47.884820 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-248fd806-2de7-4137-b1f5-d6d0dc8c85b4 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 404 len: 111 microversion: 2.1 time: 0.103167 Jul 26 20:05:47.891725 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2198/4343] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:05:47 2022] DELETE /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:47.902128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:47.903202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: a44418c8-1159-440a-a9a5-f6cd8c69eb61] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:47.912004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:47.912849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:47.913905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:47.914418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:47.935779 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 HTTP/1.1 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a44418c8-1159-440a-a9a5-f6cd8c69eb61'} Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.937795 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.942715 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:47.942715 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:47.942715 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:47.942715 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:47.942715 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. Jul 26 20:05:47.942715 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.944052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Instance a44418c8-1159-440a-a9a5-f6cd8c69eb61 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:47.945359 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5d86ef5-0e12-4cd3-bf84-890bda6294c8 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61" status: 404 len: 111 microversion: 2.1 time: 0.049422 Jul 26 20:05:47.945924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2146/4344] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:47 2022] GET /compute/v2.1/servers/a44418c8-1159-440a-a9a5-f6cd8c69eb61 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:47.960669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a7d53127-14a1-4333-ad82-20fe9d507e81 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87570e5b80>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:47.995334 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-a7d53127-14a1-4333-ad82-20fe9d507e81 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Image not found. Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a7d53127-14a1-4333-ad82-20fe9d507e81 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b HTTP/1.1 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: exception: Image not found. Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '1b5b79e1-e289-41cd-be9b-8e575092402b'} Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1b5b79e1-e289-41cd-be9b-8e575092402b to delete Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b5b79e1-e289-41cd-be9b-8e575092402b could not be found. Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:47.998369 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 20:05:48.002642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.008114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a7d53127-14a1-4333-ad82-20fe9d507e81 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Image not found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:48.009931 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a7d53127-14a1-4333-ad82-20fe9d507e81 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b" status: 404 len: 62 microversion: 2.1 time: 0.058708 Jul 26 20:05:48.011182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2199/4345] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:47 2022] DELETE /compute/v2.1/images/1b5b79e1-e289-41cd-be9b-8e575092402b => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:05:48.020151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:48.020649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:48.027043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:48.027598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:48.028407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:48.028973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:48.049783 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b HTTP/1.1 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '80f5ce3e-2965-4521-9c04-54f6b5b3836b'} Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:48.052157 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55528d70-b15e-4493-9657-beb7e3b239ab tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 404 len: 111 microversion: 2.1 time: 0.039281 Jul 26 20:05:48.058597 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2147/4346] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:05:48 2022] DELETE /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:48.065947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:48.066563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: 80f5ce3e-2965-4521-9c04-54f6b5b3836b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:48.081411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:48.081868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:48.082650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:48.083092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:48.136367 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b HTTP/1.1 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '80f5ce3e-2965-4521-9c04-54f6b5b3836b'} Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.141708 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.150148 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.150148 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.150148 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:48.150148 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:48.150148 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. Jul 26 20:05:48.150148 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.150148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Instance 80f5ce3e-2965-4521-9c04-54f6b5b3836b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:48.153979 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3af973e7-fd3c-475b-96f4-2b82e2c349ff tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b" status: 404 len: 111 microversion: 2.1 time: 0.092693 Jul 26 20:05:48.164396 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2200/4347] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:48 2022] GET /compute/v2.1/servers/80f5ce3e-2965-4521-9c04-54f6b5b3836b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:48.169559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f032401-8750-4e2b-8cf1-001aad9ba518 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '.version_select at 0x7f87683e1e50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:48.220683 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-4f032401-8750-4e2b-8cf1-001aad9ba518 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Image not found. Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f032401-8750-4e2b-8cf1-001aad9ba518 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 HTTP/1.1 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: exception: Image not found. Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8f7bc410-bf9d-488a-a014-ca2960c43cd7'} Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8f7bc410-bf9d-488a-a014-ca2960c43cd7 to delete Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f7bc410-bf9d-488a-a014-ca2960c43cd7 could not be found. Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.223154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f032401-8750-4e2b-8cf1-001aad9ba518 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Image not found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4f032401-8750-4e2b-8cf1-001aad9ba518 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7" status: 404 len: 62 microversion: 2.1 time: 0.062272 Jul 26 20:05:48.229921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2148/4348] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:48 2022] DELETE /compute/v2.1/images/8f7bc410-bf9d-488a-a014-ca2960c43cd7 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:05:48.235710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:48.236219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:48.248317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:48.248755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:48.266621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:48.268935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:48.310385 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a HTTP/1.1 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a'} Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:48.324128 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.328264 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.331400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:48.334382 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5ebf67a-8373-4043-ac5a-f97c5d31bf1f tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 404 len: 111 microversion: 2.1 time: 0.104396 Jul 26 20:05:48.342074 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2201/4349] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:05:48 2022] DELETE /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:48.360380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:48.361152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] [instance: e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:48.381677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:48.383240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:48.386157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:48.387164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:48.405507 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] HTTP exception thrown: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Request method failure captured: Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a HTTP/1.1 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EgfQCKAsQohfx2bJOvdQQf6KDNZCDAHx0iHTktKYS8dVb8I6e6LbnWa0HuiWyHULFOk9ex8yMRmYp6mbxCLV2oXHahyw9NLpYzmsTa7qRnAmd-E4v9CP_QyNrTsNyUy_XYOSTaTpwDB2Xb46qD5nqEghMjlYJpApRHgt5_zpBzMmw4 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a715ad339a264f918507acfd8a1180f5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a715ad339a264f918507acfd8a1180f5"}]}] Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a715ad339a264f918507acfd8a1180f5 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ImagesTestJSON-1468761369 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: f82c738a399d4688b1870ea46700ac71 Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ImagesTestJSON-1468761369-project Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a'} Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.407791 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:05:48.412180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:05:48.412180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:05:48.412180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:05:48.412180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:05:48.412180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. Jul 26 20:05:48.412180 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:05:48.412180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] Returning 404 to user: Instance e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:05:48.412180 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41171182-76ea-4fd8-82e6-d7ff54dd3f24 tempest-ImagesTestJSON-1468761369 tempest-ImagesTestJSON-1468761369-project] 10.222.0.58 "GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a" status: 404 len: 111 microversion: 2.1 time: 0.065504 Jul 26 20:05:48.414293 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2149/4350] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:48 2022] GET /compute/v2.1/servers/e6f33e2d-ed8c-4217-bdf9-6bc12340ff2a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:05:53.028758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-264c2d4f-00b5-4890-9dde-15df811e677a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:05:53.030273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-264c2d4f-00b5-4890-9dde-15df811e677a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:53.046226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-264c2d4f-00b5-4890-9dde-15df811e677a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:53.047037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-264c2d4f-00b5-4890-9dde-15df811e677a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:53.048199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-264c2d4f-00b5-4890-9dde-15df811e677a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:53.048987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-264c2d4f-00b5-4890-9dde-15df811e677a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:53.055102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:53.465133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-264c2d4f-00b5-4890-9dde-15df811e677a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:05:53.477534 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-264c2d4f-00b5-4890-9dde-15df811e677a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.453742 Jul 26 20:05:53.481146 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2202/4351] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:05:53 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:05:53.503720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-269e6423-db30-467e-907a-9cf406e0f27d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1200680812"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:53.506430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-269e6423-db30-467e-907a-9cf406e0f27d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:05:53.523838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-269e6423-db30-467e-907a-9cf406e0f27d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:53.524417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-269e6423-db30-467e-907a-9cf406e0f27d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:53.525497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-269e6423-db30-467e-907a-9cf406e0f27d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:53.527903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-269e6423-db30-467e-907a-9cf406e0f27d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:53.865192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:05:53.885830 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-269e6423-db30-467e-907a-9cf406e0f27d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.386261 Jul 26 20:05:53.888748 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2150/4352] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:05:53 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 26 20:05:55.277538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7269c5c5-bf2b-44d1-b4fa-889e6a21cff4 req-fcf1e9dc-739f-4f56-9f77-69dc404b6a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "name": "network-vif-unplugged", "status": "completed", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:55.299101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7269c5c5-bf2b-44d1-b4fa-889e6a21cff4 req-fcf1e9dc-739f-4f56-9f77-69dc404b6a63 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:55.304320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7269c5c5-bf2b-44d1-b4fa-889e6a21cff4 req-fcf1e9dc-739f-4f56-9f77-69dc404b6a63 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:55.331385 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7269c5c5-bf2b-44d1-b4fa-889e6a21cff4 req-fcf1e9dc-739f-4f56-9f77-69dc404b6a63 service nova] Creating event network-vif-unplugged:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:05:55.342007 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7269c5c5-bf2b-44d1-b4fa-889e6a21cff4 req-fcf1e9dc-739f-4f56-9f77-69dc404b6a63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069075 Jul 26 20:05:55.344416 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2203/4353] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:05:59.749341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a907af28-b9d1-45ae-9d9b-acfc2d045eb8 req-3c178be3-560c-49f5-80b3-3193cce96ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "name": "network-vif-plugged", "status": "completed", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:05:59.789491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a907af28-b9d1-45ae-9d9b-acfc2d045eb8 req-3c178be3-560c-49f5-80b3-3193cce96ac5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:05:59.794035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a907af28-b9d1-45ae-9d9b-acfc2d045eb8 req-3c178be3-560c-49f5-80b3-3193cce96ac5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:05:59.849635 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a907af28-b9d1-45ae-9d9b-acfc2d045eb8 req-3c178be3-560c-49f5-80b3-3193cce96ac5 service nova] Creating event network-vif-plugged:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:05:59.861350 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a907af28-b9d1-45ae-9d9b-acfc2d045eb8 req-3c178be3-560c-49f5-80b3-3193cce96ac5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122445 Jul 26 20:05:59.865365 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2151/4354] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:06:01.381684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f491726c-bb85-4625-9913-ea3b2a9156ec tempest-AZV2TestJSON-1101287268 tempest-AZV2TestJSON-1101287268-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:01.391291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f491726c-bb85-4625-9913-ea3b2a9156ec tempest-AZV2TestJSON-1101287268 tempest-AZV2TestJSON-1101287268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:01.392765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f491726c-bb85-4625-9913-ea3b2a9156ec tempest-AZV2TestJSON-1101287268 tempest-AZV2TestJSON-1101287268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:01.406360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f491726c-bb85-4625-9913-ea3b2a9156ec tempest-AZV2TestJSON-1101287268 tempest-AZV2TestJSON-1101287268-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:01.407562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f491726c-bb85-4625-9913-ea3b2a9156ec tempest-AZV2TestJSON-1101287268 tempest-AZV2TestJSON-1101287268-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:01.475094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f491726c-bb85-4625-9913-ea3b2a9156ec tempest-AZV2TestJSON-1101287268 tempest-AZV2TestJSON-1101287268-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.523318 Jul 26 20:06:01.477070 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2204/4355] 10.222.0.58 () {58 vars in 1164 bytes} [Tue Jul 26 20:06:00 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:06:07.462725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1616776150", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": "none"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:07.504314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e10335b6-be22-47ff-9123-2319ef0caf34 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:07.505761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e10335b6-be22-47ff-9123-2319ef0caf34 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:07.581293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e10335b6-be22-47ff-9123-2319ef0caf34 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:07.581293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e10335b6-be22-47ff-9123-2319ef0caf34 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:07.581293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e10335b6-be22-47ff-9123-2319ef0caf34 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:07.581293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e10335b6-be22-47ff-9123-2319ef0caf34 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:07.712813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:06:07.713175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:06:07.713848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:06:07.714262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:06:07.714682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:06:07.730826 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e10335b6-be22-47ff-9123-2319ef0caf34 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments/43ee3f90-9371-47ca-9f06-2bfbe913897f" status: 200 len: 194 microversion: 2.20 time: 0.233209 Jul 26 20:06:07.735081 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2205/4356] 10.222.0.58 () {60 vars in 1454 bytes} [Tue Jul 26 20:06:07 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments/43ee3f90-9371-47ca-9f06-2bfbe913897f => generated 194 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:06:07.739583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:07.740307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:07.741944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:07.750580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:07.796649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Getting quotas for project f07a6a2e0f1547218b71b48993f5d9c2. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:06:07.817352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Getting quotas for user 460dc752e1a24412bcabc4e5cf2f82c5 and project f07a6a2e0f1547218b71b48993f5d9c2. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:06:07.861238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:06:07.866989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:06:07.883117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96bb6bc3-5402-4726-8eca-4abcf26a7ed0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:07.884151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-96bb6bc3-5402-4726-8eca-4abcf26a7ed0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:07.902319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96bb6bc3-5402-4726-8eca-4abcf26a7ed0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:07.903034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96bb6bc3-5402-4726-8eca-4abcf26a7ed0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:07.904149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96bb6bc3-5402-4726-8eca-4abcf26a7ed0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:07.905403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96bb6bc3-5402-4726-8eca-4abcf26a7ed0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:08.047837 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00248099-3efd-4ba2-be82-543acaea58b2 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.890879 Jul 26 20:06:08.048519 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2152/4357] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 20:06:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 20:06:08.076776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6098c178-f9db-4581-ae67-644ae269459c tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:08.080849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6098c178-f9db-4581-ae67-644ae269459c tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:08.131867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-96bb6bc3-5402-4726-8eca-4abcf26a7ed0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lazy-loading 'services' on Instance uuid f87df55d-ecd6-431b-8f7b-95ef5e1132eb {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:06:08.333802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96bb6bc3-5402-4726-8eca-4abcf26a7ed0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments/43ee3f90-9371-47ca-9f06-2bfbe913897f" status: 202 len: 0 microversion: 2.20 time: 0.460188 Jul 26 20:06:08.337008 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2206/4358] 10.222.0.58 () {60 vars in 1457 bytes} [Tue Jul 26 20:06:07 2022] DELETE /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments/43ee3f90-9371-47ca-9f06-2bfbe913897f => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:06:08.358211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3b39619c-e242-4b3b-883e-e09b716e2811 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:08.371516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3b39619c-e242-4b3b-883e-e09b716e2811 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:08.386995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6098c178-f9db-4581-ae67-644ae269459c tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:08.388175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b39619c-e242-4b3b-883e-e09b716e2811 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:08.391180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b39619c-e242-4b3b-883e-e09b716e2811 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:08.393045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b39619c-e242-4b3b-883e-e09b716e2811 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:08.393680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b39619c-e242-4b3b-883e-e09b716e2811 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:08.413235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6098c178-f9db-4581-ae67-644ae269459c tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:08.426047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6098c178-f9db-4581-ae67-644ae269459c tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:08.446034 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6098c178-f9db-4581-ae67-644ae269459c tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1281 microversion: 2.47 time: 0.386129 Jul 26 20:06:08.460082 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2153/4359] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:08 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1281 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:08.481190 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3b39619c-e242-4b3b-883e-e09b716e2811 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138558 Jul 26 20:06:08.485803 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2207/4360] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:08 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:06:09.476124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:09.476748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:09.494557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f8646e4-c628-4054-a103-a698942a102a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:09.497195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f8646e4-c628-4054-a103-a698942a102a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:09.503802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:09.506991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:09.514604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f8646e4-c628-4054-a103-a698942a102a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:09.516174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:09.516915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f8646e4-c628-4054-a103-a698942a102a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:09.520047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:09.520765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f8646e4-c628-4054-a103-a698942a102a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:09.521390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f8646e4-c628-4054-a103-a698942a102a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:09.654108 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f8646e4-c628-4054-a103-a698942a102a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162771 Jul 26 20:06:09.656161 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2208/4361] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:09 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:06:09.850276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:09.880065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:09.890871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:09.903034 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5400db61-a1bf-4b7a-8a5b-60fdb79b8439 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1277 microversion: 2.47 time: 0.426094 Jul 26 20:06:09.906948 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2154/4362] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:09 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1277 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:10.670666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c3cf38e-e561-4d5b-a872-ca6e42afd6e2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:10.674253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0c3cf38e-e561-4d5b-a872-ca6e42afd6e2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:10.696147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c3cf38e-e561-4d5b-a872-ca6e42afd6e2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:10.709460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c3cf38e-e561-4d5b-a872-ca6e42afd6e2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:10.710357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c3cf38e-e561-4d5b-a872-ca6e42afd6e2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:10.710809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c3cf38e-e561-4d5b-a872-ca6e42afd6e2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:10.866655 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0c3cf38e-e561-4d5b-a872-ca6e42afd6e2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.199089 Jul 26 20:06:10.870977 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2209/4363] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:10 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:06:10.934439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:10.935053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:10.943243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:10.944083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:10.946748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:10.947411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:11.088716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:11.108325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:11.120320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:11.130978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60f6188c-f22a-4266-b6b4-629118211969 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1339 microversion: 2.47 time: 0.201221 Jul 26 20:06:11.134394 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2155/4364] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:10 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:11.433486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:11.539820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1714178564", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "a0732ca0-0b24-4753-bcca-055b8f396991"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:11.708487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] validate_networks() for [('a0732ca0-0b24-4753-bcca-055b8f396991', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:06:11.882386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-da71f922-07e4-40c7-9e9f-c35cd48fc7ae tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:11.884826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-da71f922-07e4-40c7-9e9f-c35cd48fc7ae tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:11.898600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-da71f922-07e4-40c7-9e9f-c35cd48fc7ae tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:11.899064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-da71f922-07e4-40c7-9e9f-c35cd48fc7ae tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:11.899912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-da71f922-07e4-40c7-9e9f-c35cd48fc7ae tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:11.900358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-da71f922-07e4-40c7-9e9f-c35cd48fc7ae tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:11.987429 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-da71f922-07e4-40c7-9e9f-c35cd48fc7ae tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108880 Jul 26 20:06:11.990369 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2156/4365] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:11 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:06:12.161881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:12.163035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:12.182604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:12.183525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:12.184507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:12.185223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:12.393283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:12.412773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:12.414756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:12.416124 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f980c681-3021-4632-8040-dc15341785c8 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1339 microversion: 2.47 time: 0.259617 Jul 26 20:06:12.434447 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2157/4366] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:12 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1339 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:13.002657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-61024f66-36fb-4a10-9f34-144d8cc4f3ad tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:13.004830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-61024f66-36fb-4a10-9f34-144d8cc4f3ad tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:13.028735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61024f66-36fb-4a10-9f34-144d8cc4f3ad tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:13.029184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61024f66-36fb-4a10-9f34-144d8cc4f3ad tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:13.029963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61024f66-36fb-4a10-9f34-144d8cc4f3ad tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:13.030392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61024f66-36fb-4a10-9f34-144d8cc4f3ad tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:13.161754 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-61024f66-36fb-4a10-9f34-144d8cc4f3ad tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163869 Jul 26 20:06:13.169211 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2158/4367] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:12 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:06:13.449872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:13.450481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:13.470587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:13.471096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:13.471958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:13.472398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:13.939708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:13.965448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:13.972470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:13.973776 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c2bf961-2541-489c-90a0-3d97d624e2ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1339 microversion: 2.47 time: 0.528265 Jul 26 20:06:13.974958 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2159/4368] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:13 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1339 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:14.176232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5799b9c1-b970-4b72-aa58-9fd2d40e5bd4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:14.178557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5799b9c1-b970-4b72-aa58-9fd2d40e5bd4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:14.216030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5799b9c1-b970-4b72-aa58-9fd2d40e5bd4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:14.216508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5799b9c1-b970-4b72-aa58-9fd2d40e5bd4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:14.237116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5799b9c1-b970-4b72-aa58-9fd2d40e5bd4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:14.244582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5799b9c1-b970-4b72-aa58-9fd2d40e5bd4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:14.397771 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5799b9c1-b970-4b72-aa58-9fd2d40e5bd4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.226686 Jul 26 20:06:14.411737 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2160/4369] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:14 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:06:14.553614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:06:14.554146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:06:14.554877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:06:14.555689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:06:14.557228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:06:14.559509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=32 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:14.579950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:14.580746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:14.586424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:14.607997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:14.638546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:06:14.648088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:06:14.686449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:06:14.690218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:06:14.802230 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d56b32ce-454d-4c75-9498-f03dff458acc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.657147 Jul 26 20:06:14.802884 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2210/4370] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:06:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:06:14.814976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3d25aac-d5a3-4e99-9967-317c3d6f81cf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:14.815657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e3d25aac-d5a3-4e99-9967-317c3d6f81cf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:15.008402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:15.009343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:15.019057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:15.020071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:15.021062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:15.021664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:15.104055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e3d25aac-d5a3-4e99-9967-317c3d6f81cf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:15.119637 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e3d25aac-d5a3-4e99-9967-317c3d6f81cf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1193 microversion: 2.1 time: 0.309062 Jul 26 20:06:15.138866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2161/4371] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:14 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1193 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:15.292189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:15.302460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:15.309304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:15.312137 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c19aada8-74f2-449f-92cf-791572ce576f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1360 microversion: 2.47 time: 0.308559 Jul 26 20:06:15.318276 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2211/4372] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:15 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:15.349288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4180ca7-73db-42a6-8ae1-52f2ea187c12 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1742819300"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:15.352395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4180ca7-73db-42a6-8ae1-52f2ea187c12 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:15.381009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4180ca7-73db-42a6-8ae1-52f2ea187c12 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:15.381399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4180ca7-73db-42a6-8ae1-52f2ea187c12 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:15.389962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4180ca7-73db-42a6-8ae1-52f2ea187c12 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:15.393166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4180ca7-73db-42a6-8ae1-52f2ea187c12 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:15.415626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6355db94-853c-4899-80c3-32f91e50b32b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:15.418871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6355db94-853c-4899-80c3-32f91e50b32b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:15.458314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6355db94-853c-4899-80c3-32f91e50b32b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:15.461616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6355db94-853c-4899-80c3-32f91e50b32b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:15.463037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6355db94-853c-4899-80c3-32f91e50b32b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:15.466114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6355db94-853c-4899-80c3-32f91e50b32b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:15.607270 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6355db94-853c-4899-80c3-32f91e50b32b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200557 Jul 26 20:06:15.608906 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2212/4373] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:15 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:06:16.066388 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4180ca7-73db-42a6-8ae1-52f2ea187c12 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "POST /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4/action" status: 202 len: 52 microversion: 2.47 time: 0.720657 Jul 26 20:06:16.067266 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2162/4374] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 20:06:15 2022] POST /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4/action => generated 52 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 26 20:06:16.079624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a210a839-cd5b-4f5b-9e45-b2163b107124 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:16.080150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a210a839-cd5b-4f5b-9e45-b2163b107124 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:16.097406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a210a839-cd5b-4f5b-9e45-b2163b107124 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:16.103435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a210a839-cd5b-4f5b-9e45-b2163b107124 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:16.107849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a210a839-cd5b-4f5b-9e45-b2163b107124 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:16.111776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a210a839-cd5b-4f5b-9e45-b2163b107124 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:16.148192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b0f8d92-5e3d-40ef-83bd-115c803d31fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:16.149175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b0f8d92-5e3d-40ef-83bd-115c803d31fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:16.164343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b0f8d92-5e3d-40ef-83bd-115c803d31fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:16.171008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b0f8d92-5e3d-40ef-83bd-115c803d31fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:16.177932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b0f8d92-5e3d-40ef-83bd-115c803d31fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:16.178641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b0f8d92-5e3d-40ef-83bd-115c803d31fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:16.229549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a210a839-cd5b-4f5b-9e45-b2163b107124 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:06:16.439403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6b0f8d92-5e3d-40ef-83bd-115c803d31fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:16.455892 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b0f8d92-5e3d-40ef-83bd-115c803d31fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1189 microversion: 2.1 time: 0.311889 Jul 26 20:06:16.457957 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2163/4375] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:16 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1189 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:16.496681 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a210a839-cd5b-4f5b-9e45-b2163b107124 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 204 len: 0 microversion: 2.47 time: 0.421000 Jul 26 20:06:16.497582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2213/4376] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:06:16 2022] DELETE /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:06:16.507104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:16.507755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:16.509865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:16.529276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:16.529784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:16.530519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:16.530957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:16.622400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a8e85ed9-cff1-462a-afeb-dec3d9483b00 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:16.624750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a8e85ed9-cff1-462a-afeb-dec3d9483b00 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:16.642359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8e85ed9-cff1-462a-afeb-dec3d9483b00 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:16.642796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8e85ed9-cff1-462a-afeb-dec3d9483b00 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:16.644021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8e85ed9-cff1-462a-afeb-dec3d9483b00 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:16.646542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a8e85ed9-cff1-462a-afeb-dec3d9483b00 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:16.780335 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a8e85ed9-cff1-462a-afeb-dec3d9483b00 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162158 Jul 26 20:06:16.780869 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2214/4377] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:16 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:06:16.786676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:16.799828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:16.801352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:16.802558 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31f9e390-f602-446c-9512-6b82649095ce tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1366 microversion: 2.47 time: 0.299570 Jul 26 20:06:16.803155 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2164/4378] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:16 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:17.481672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9072ce4a-b6ce-43f2-9da6-dd47a0936c4a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:17.482651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9072ce4a-b6ce-43f2-9da6-dd47a0936c4a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:17.509354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9072ce4a-b6ce-43f2-9da6-dd47a0936c4a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:17.511522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9072ce4a-b6ce-43f2-9da6-dd47a0936c4a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:17.515028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9072ce4a-b6ce-43f2-9da6-dd47a0936c4a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:17.515675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9072ce4a-b6ce-43f2-9da6-dd47a0936c4a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:17.760817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9072ce4a-b6ce-43f2-9da6-dd47a0936c4a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:17.789282 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9072ce4a-b6ce-43f2-9da6-dd47a0936c4a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1251 microversion: 2.1 time: 0.310544 Jul 26 20:06:17.794672 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2215/4379] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:17 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1251 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:17.817880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad32c507-704b-4adf-ab80-39604023c0d1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:17.821092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ad32c507-704b-4adf-ab80-39604023c0d1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:17.835147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:17.836104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:17.847349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:17.852750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:17.853619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:17.854812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:17.856187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad32c507-704b-4adf-ab80-39604023c0d1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:17.857029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:17.858354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad32c507-704b-4adf-ab80-39604023c0d1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:17.865633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad32c507-704b-4adf-ab80-39604023c0d1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:17.866099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad32c507-704b-4adf-ab80-39604023c0d1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:17.980179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ad32c507-704b-4adf-ab80-39604023c0d1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180604 Jul 26 20:06:17.986232 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2165/4380] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:17 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:06:18.020795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:18.032740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:18.035279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:18.036724 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b66098fe-fb5d-4d79-9f03-25aff6140a4f tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1366 microversion: 2.47 time: 0.206479 Jul 26 20:06:18.038042 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2216/4381] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:17 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:18.819646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c4202920-6dd0-4c33-a764-557845dc7a0d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:18.821426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c4202920-6dd0-4c33-a764-557845dc7a0d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:18.840248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c4202920-6dd0-4c33-a764-557845dc7a0d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:18.845907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c4202920-6dd0-4c33-a764-557845dc7a0d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:18.847032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c4202920-6dd0-4c33-a764-557845dc7a0d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:18.850719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c4202920-6dd0-4c33-a764-557845dc7a0d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:18.993588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4d0bdce9-44ec-4912-a6f0-c3e5420cf66a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:18.997489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4d0bdce9-44ec-4912-a6f0-c3e5420cf66a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:19.047258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0bdce9-44ec-4912-a6f0-c3e5420cf66a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:19.056963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0bdce9-44ec-4912-a6f0-c3e5420cf66a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:19.061986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0bdce9-44ec-4912-a6f0-c3e5420cf66a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:19.062748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d0bdce9-44ec-4912-a6f0-c3e5420cf66a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:19.187301 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4d0bdce9-44ec-4912-a6f0-c3e5420cf66a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198220 Jul 26 20:06:19.210680 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2217/4382] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:18 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:06:19.225213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:19.235732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:19.262025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:19.264568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:19.265619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:19.267869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:19.335405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:19.445428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c4202920-6dd0-4c33-a764-557845dc7a0d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:19.458046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:19.459000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c4202920-6dd0-4c33-a764-557845dc7a0d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.639233 Jul 26 20:06:19.461514 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2166/4383] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:18 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:19.470817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:19.474608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:19.479668 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0fb8ce83-633b-4ad9-bc13-794bb728363e tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1366 microversion: 2.47 time: 0.267626 Jul 26 20:06:19.480608 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2218/4384] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:19 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:19.913103 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:06:19.913335 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 20:06:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:06:20.218031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-04cba208-901b-4dca-aef7-45a72b7034d0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:20.222078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-04cba208-901b-4dca-aef7-45a72b7034d0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:20.252672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04cba208-901b-4dca-aef7-45a72b7034d0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:20.257344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04cba208-901b-4dca-aef7-45a72b7034d0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:20.258269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04cba208-901b-4dca-aef7-45a72b7034d0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:20.258715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04cba208-901b-4dca-aef7-45a72b7034d0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:20.382378 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-04cba208-901b-4dca-aef7-45a72b7034d0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167987 Jul 26 20:06:20.384108 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2167/4385] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:20 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:06:20.480601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d9e0388-8040-4c13-9f0c-4e67d213711d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:20.481220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d9e0388-8040-4c13-9f0c-4e67d213711d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:20.495382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d9e0388-8040-4c13-9f0c-4e67d213711d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:20.496801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d9e0388-8040-4c13-9f0c-4e67d213711d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:20.499766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d9e0388-8040-4c13-9f0c-4e67d213711d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:20.507711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d9e0388-8040-4c13-9f0c-4e67d213711d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:20.513098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:20.513857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:20.524718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:20.524718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:20.527576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:20.528079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:20.611599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:20.613553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:20.614999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lazy-loading 'fault' on Instance uuid e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:06:20.719217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:20.737088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:20.741117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '460dc752e1a24412bcabc4e5cf2f82c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a6a2e0f1547218b71b48993f5d9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:20.744972 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6304b448-225e-4eab-9f8b-46a8b6915240 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 200 len: 1371 microversion: 2.47 time: 0.236686 Jul 26 20:06:20.749642 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2168/4386] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:20 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:21.074356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6d9e0388-8040-4c13-9f0c-4e67d213711d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:21.092496 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d9e0388-8040-4c13-9f0c-4e67d213711d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.615589 Jul 26 20:06:21.093633 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2219/4387] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:20 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:21.399105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0c79839-f27b-4dc4-8b51-152d611ad091 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:21.402185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0c79839-f27b-4dc4-8b51-152d611ad091 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:21.414994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0c79839-f27b-4dc4-8b51-152d611ad091 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:21.415451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0c79839-f27b-4dc4-8b51-152d611ad091 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:21.420276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0c79839-f27b-4dc4-8b51-152d611ad091 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:21.420719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0c79839-f27b-4dc4-8b51-152d611ad091 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:21.449775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:21.484873 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0c79839-f27b-4dc4-8b51-152d611ad091 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.090333 Jul 26 20:06:21.491789 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2169/4388] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:06:21 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:21.564131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e39054c-dcfe-4199-9eef-5692cba86dbc tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:21.564743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e39054c-dcfe-4199-9eef-5692cba86dbc tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:21.576383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e39054c-dcfe-4199-9eef-5692cba86dbc tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:21.580325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e39054c-dcfe-4199-9eef-5692cba86dbc tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:21.581500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e39054c-dcfe-4199-9eef-5692cba86dbc tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:21.582351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e39054c-dcfe-4199-9eef-5692cba86dbc tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:21.653006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e39054c-dcfe-4199-9eef-5692cba86dbc tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:06:21.783744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:21.787930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] [instance: e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:21.812093 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e39054c-dcfe-4199-9eef-5692cba86dbc tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 204 len: 0 microversion: 2.20 time: 0.254373 Jul 26 20:06:21.817199 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2220/4389] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:06:21 2022] DELETE /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:06:21.823902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:21.824768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:21.827635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:21.829796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:21.832458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:21.832682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:21.848393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:21.849179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:21.850205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:21.852821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:21.877119 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] HTTP exception thrown: Instance e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 could not be found. Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Request method failure captured: Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 HTTP/1.1 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkuyQuT8_k3_eZQnBIaerVQPuh4KFMz6zo8b1q5ujzFR6YMfFThDHowmaS6MW9Ym6t6do1f4kuiukm9jdOS3jmNNd6mciNjFVw4OazhzO_r5q4ExLFtXAoAWsNqJgPTZkRI9YaadJ5kVcbtbo48lPvvOP358UlRMbz7fOCH3DHrmBI Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: f07a6a2e0f1547218b71b48993f5d9c2 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersAaction247Test-1077768001 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f07a6a2e0f1547218b71b48993f5d9c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f07a6a2e0f1547218b71b48993f5d9c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f07a6a2e0f1547218b71b48993f5d9c2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f07a6a2e0f1547218b71b48993f5d9c2"}]}] Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersAaction247Test-1077768001 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: f07a6a2e0f1547218b71b48993f5d9c2 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersAaction247Test-1077768001 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersAaction247Test-1077768001-project Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 460dc752e1a24412bcabc4e5cf2f82c5 Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersAaction247Test-1077768001-project Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 could not be found. Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4'} Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 could not be found. Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 could not be found. Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:06:21.881614 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:21.886927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:21.886927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:06:21.886927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:06:21.886927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:06:21.886927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:06:21.886927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 could not be found. Jul 26 20:06:21.886927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:21.888533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] Returning 404 to user: Instance e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:06:21.892938 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73484c36-3a71-4f73-b002-4241d7926bf1 tempest-ServersAaction247Test-1077768001 tempest-ServersAaction247Test-1077768001-project] 10.222.0.58 "GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4" status: 404 len: 111 microversion: 2.47 time: 0.120522 Jul 26 20:06:21.902004 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2170/4390] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:21 2022] GET /compute/v2.1/servers/e74ed281-55bc-4fc8-8b29-a0ff7f94a6d4 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:06:22.015824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-942e720d-c51d-495c-afe4-d825240cdbca req-73c72e54-bc75-4e4d-a00a-b42d38ad429e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7669f2d9-5341-4a3a-a80f-c17ee32eaeb7", "tag": "d55a01e3-c7a4-4b7a-a52b-ac7240b2268b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:22.039435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-942e720d-c51d-495c-afe4-d825240cdbca req-73c72e54-bc75-4e4d-a00a-b42d38ad429e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:22.045880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-942e720d-c51d-495c-afe4-d825240cdbca req-73c72e54-bc75-4e4d-a00a-b42d38ad429e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:22.073494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-942e720d-c51d-495c-afe4-d825240cdbca req-73c72e54-bc75-4e4d-a00a-b42d38ad429e service nova] Creating event network-changed:d55a01e3-c7a4-4b7a-a52b-ac7240b2268b for instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 on n-h1-708768-8 Jul 26 20:06:22.087645 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-942e720d-c51d-495c-afe4-d825240cdbca req-73c72e54-bc75-4e4d-a00a-b42d38ad429e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076237 Jul 26 20:06:22.096578 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2171/4391] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:06:22.115441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8596b6b-cdd2-42e7-92dd-d5304686f1a3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:22.117014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8596b6b-cdd2-42e7-92dd-d5304686f1a3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:22.145952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8596b6b-cdd2-42e7-92dd-d5304686f1a3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:22.152137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8596b6b-cdd2-42e7-92dd-d5304686f1a3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:22.153519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8596b6b-cdd2-42e7-92dd-d5304686f1a3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:22.158527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8596b6b-cdd2-42e7-92dd-d5304686f1a3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:22.306778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:22.326314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:22.328198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:22.330537 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-202a0141-8b88-4a99-b0ee-08b08e712ba4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 0.511700 Jul 26 20:06:22.341776 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2221/4392] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:21 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:22.493948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c8596b6b-cdd2-42e7-92dd-d5304686f1a3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:22.509271 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8596b6b-cdd2-42e7-92dd-d5304686f1a3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.396446 Jul 26 20:06:22.510075 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2172/4393] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:22 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:23.369159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:23.370507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:23.384341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:23.386423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:23.387502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:23.389340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:23.530632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8c8f474-a2fa-4493-b446-892c6d82802f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:23.532930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8c8f474-a2fa-4493-b446-892c6d82802f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:23.550121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8c8f474-a2fa-4493-b446-892c6d82802f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:23.552060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8c8f474-a2fa-4493-b446-892c6d82802f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:23.552968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8c8f474-a2fa-4493-b446-892c6d82802f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:23.554342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8c8f474-a2fa-4493-b446-892c6d82802f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:23.915548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:23.930630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:23.937970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:23.940714 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd92ff21-a74c-4671-95ed-2712f7ee77cd tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1722 microversion: 2.20 time: 0.575782 Jul 26 20:06:23.946225 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2222/4394] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:23 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1722 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:24.151096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8c8f474-a2fa-4493-b446-892c6d82802f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:24.161916 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8c8f474-a2fa-4493-b446-892c6d82802f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.635004 Jul 26 20:06:24.163124 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2173/4395] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:23 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:24.971661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:24.973355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:24.981621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:24.987956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:25.009192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:25.010564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:25.013991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:25.014397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:25.186325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7afd8a76-0f62-4b77-bd86-516e51d14bc5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:25.187205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7afd8a76-0f62-4b77-bd86-516e51d14bc5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:25.203416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:25.210235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7afd8a76-0f62-4b77-bd86-516e51d14bc5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:25.210697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7afd8a76-0f62-4b77-bd86-516e51d14bc5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:25.217504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7afd8a76-0f62-4b77-bd86-516e51d14bc5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:25.218040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7afd8a76-0f62-4b77-bd86-516e51d14bc5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:25.422697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:25.432704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:25.441363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:25.442737 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7259cbe2-b820-42e8-852e-a6af481fbb56 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1654 microversion: 2.20 time: 0.477784 Jul 26 20:06:25.445067 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2223/4396] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:24 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1654 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:25.755336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-724167454", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": "none"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:25.853076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:06:25.853432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:06:25.853907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:06:25.854531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:06:25.855117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:06:25.885957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:25.886316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:25.887266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:25.887910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:25.957275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Getting quotas for project dca6ca88f6274fcbb1dad35af2920d41. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:06:25.972167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Getting quotas for user 6ea7cb75c24d414798cb5b0775895505 and project dca6ca88f6274fcbb1dad35af2920d41. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:06:26.049064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:06:26.051748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: f50c59d6-e429-4d55-bdd2-6d03c5446a3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:06:26.125131 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d4557f85-810e-4d71-a5c4-d920f8c5144e tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.633613 Jul 26 20:06:26.127354 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2224/4397] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 20:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 20:06:26.154501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f7e0303-b4a1-486c-b0da-e8dca2498d57 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:26.155778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2f7e0303-b4a1-486c-b0da-e8dca2498d57 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: f50c59d6-e429-4d55-bdd2-6d03c5446a3f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:26.171478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7afd8a76-0f62-4b77-bd86-516e51d14bc5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:26.190861 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7afd8a76-0f62-4b77-bd86-516e51d14bc5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 1.009573 Jul 26 20:06:26.194577 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2174/4398] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:25 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:26.336066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f7e0303-b4a1-486c-b0da-e8dca2498d57 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:26.350759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f7e0303-b4a1-486c-b0da-e8dca2498d57 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:26.361089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f7e0303-b4a1-486c-b0da-e8dca2498d57 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:26.363019 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f7e0303-b4a1-486c-b0da-e8dca2498d57 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f" status: 200 len: 1277 microversion: 2.47 time: 0.225779 Jul 26 20:06:26.364517 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2225/4399] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:26 2022] GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:26.468058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:26.468846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:26.483765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:26.492834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-474967606", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": "none"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:26.498831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:26.500336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:26.505682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:26.705809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:06:26.705955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:06:26.706489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:06:26.707142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:06:26.707777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:06:26.724203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:26.724336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:26.725508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:26.726225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:26.750597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Getting quotas for project dca6ca88f6274fcbb1dad35af2920d41. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:06:26.759863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Getting quotas for user 6ea7cb75c24d414798cb5b0775895505 and project dca6ca88f6274fcbb1dad35af2920d41. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:06:26.802820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:06:26.806548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:06:26.876611 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cc9a539-f4e9-49b2-bf12-aa334975f01c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.389713 Jul 26 20:06:26.879640 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2226/4400] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 20:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 20:06:26.893559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b1932d01-a25b-4fdc-82f4-14adcfc32e32 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:26.916271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b1932d01-a25b-4fdc-82f4-14adcfc32e32 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:27.073121 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b1932d01-a25b-4fdc-82f4-14adcfc32e32 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "PUT /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 991 microversion: 2.47 time: 0.186054 Jul 26 20:06:27.074929 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2227/4401] 10.222.0.58 () {62 vars in 1297 bytes} [Tue Jul 26 20:06:26 2022] PUT /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 991 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:06:27.093348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:27.097677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a2dbab5-a40b-4806-9bd9-1050f3e12211 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:27.098413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8a2dbab5-a40b-4806-9bd9-1050f3e12211 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:27.110236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:27.116688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:27.121821 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b71b0140-6f5a-4734-a6bd-679aa68563ab tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1654 microversion: 2.20 time: 0.658023 Jul 26 20:06:27.150426 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2175/4402] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:26 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1654 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:27.215493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d0c5cb4-304f-4c78-9a63-6a956b74f5a8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:27.216272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d0c5cb4-304f-4c78-9a63-6a956b74f5a8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:27.229523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d0c5cb4-304f-4c78-9a63-6a956b74f5a8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:27.230101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d0c5cb4-304f-4c78-9a63-6a956b74f5a8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:27.231509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d0c5cb4-304f-4c78-9a63-6a956b74f5a8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:27.234107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d0c5cb4-304f-4c78-9a63-6a956b74f5a8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:27.450688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a2dbab5-a40b-4806-9bd9-1050f3e12211 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:27.462274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a2dbab5-a40b-4806-9bd9-1050f3e12211 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:27.471785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a2dbab5-a40b-4806-9bd9-1050f3e12211 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:27.476889 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a2dbab5-a40b-4806-9bd9-1050f3e12211 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1277 microversion: 2.47 time: 0.380393 Jul 26 20:06:27.480888 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2228/4403] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:27 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1277 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:27.512303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-917bf96f-b870-4fb5-a42f-014d2fd6115f req-2d4b8dc9-05e8-4471-b1ec-61bf24b84846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f87df55d-ecd6-431b-8f7b-95ef5e1132eb", "name": "network-vif-deleted", "tag": "5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:27.520588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:27.539687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-917bf96f-b870-4fb5-a42f-014d2fd6115f req-2d4b8dc9-05e8-4471-b1ec-61bf24b84846 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:27.540418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-917bf96f-b870-4fb5-a42f-014d2fd6115f req-2d4b8dc9-05e8-4471-b1ec-61bf24b84846 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:27.558974 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-917bf96f-b870-4fb5-a42f-014d2fd6115f req-2d4b8dc9-05e8-4471-b1ec-61bf24b84846 service nova] Creating event network-vif-deleted:5e07df92-b4e3-4f19-8ee2-3e3c73bf03ad for instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb on n-h1-708768-8 Jul 26 20:06:27.564554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d0c5cb4-304f-4c78-9a63-6a956b74f5a8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:27.567827 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-917bf96f-b870-4fb5-a42f-014d2fd6115f req-2d4b8dc9-05e8-4471-b1ec-61bf24b84846 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074037 Jul 26 20:06:27.569053 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2229/4404] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:06:27.580970 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d0c5cb4-304f-4c78-9a63-6a956b74f5a8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.370216 Jul 26 20:06:27.583964 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2176/4405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:27 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:27.878695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef47cdb2-b3f4-4fee-a975-9def6218d5ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:27.879829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef47cdb2-b3f4-4fee-a975-9def6218d5ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:27.888120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef47cdb2-b3f4-4fee-a975-9def6218d5ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:27.888874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef47cdb2-b3f4-4fee-a975-9def6218d5ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:27.889878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef47cdb2-b3f4-4fee-a975-9def6218d5ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:27.890546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef47cdb2-b3f4-4fee-a975-9def6218d5ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:28.150057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:28.150625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:28.170815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:28.171553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:28.174543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:28.175154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:28.181496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ef47cdb2-b3f4-4fee-a975-9def6218d5ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:28.195782 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef47cdb2-b3f4-4fee-a975-9def6218d5ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.317189 Jul 26 20:06:28.199484 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2230/4406] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:27 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:28.289969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:28.290561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:28.295505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lazy-loading 'fault' on Instance uuid f87df55d-ecd6-431b-8f7b-95ef5e1132eb {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:06:28.419167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:28.445785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:28.457530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:28.458757 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-230af122-117e-40b7-83d5-4a228268ba88 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 200 len: 1370 microversion: 2.20 time: 0.313158 Jul 26 20:06:28.481555 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2177/4407] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:28 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 1370 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:28.508517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:28.509140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:28.518978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:28.520955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:28.522417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:28.523078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:28.606285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0877e73a-5f45-4a8e-9a0a-416842726922 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:28.607033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0877e73a-5f45-4a8e-9a0a-416842726922 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:28.631430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0877e73a-5f45-4a8e-9a0a-416842726922 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:28.633491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0877e73a-5f45-4a8e-9a0a-416842726922 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:28.639267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0877e73a-5f45-4a8e-9a0a-416842726922 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:28.639683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0877e73a-5f45-4a8e-9a0a-416842726922 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:28.675626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:28.696654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:28.699210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:28.703660 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c130641c-3906-42c6-9c58-46114d785f01 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1329 microversion: 2.47 time: 0.199208 Jul 26 20:06:28.708300 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2231/4408] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:28 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1329 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:29.057504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0877e73a-5f45-4a8e-9a0a-416842726922 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:29.070076 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0877e73a-5f45-4a8e-9a0a-416842726922 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.468394 Jul 26 20:06:29.070698 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2178/4409] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:28 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:29.241678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f8832de0-e648-425f-a2d5-a99111d69ea8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:29.242985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f8832de0-e648-425f-a2d5-a99111d69ea8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:29.265567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8832de0-e648-425f-a2d5-a99111d69ea8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:29.266957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8832de0-e648-425f-a2d5-a99111d69ea8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:29.269027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8832de0-e648-425f-a2d5-a99111d69ea8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:29.270567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8832de0-e648-425f-a2d5-a99111d69ea8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:29.504437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:29.505283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:29.520728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:29.521827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:29.524005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:29.526133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:29.550787 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] HTTP exception thrown: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Request method failure captured: Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb HTTP/1.1 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EhG9EwxqYfjexnx1dTE21pukrGMHJ6c1I4jYQ13Lb1QjeUoM_5g4bisQz_fLPs-ShG7M7suaYAwVKkm9hsGt1VqMKLpon7kTt0n1ivtov6r85g2z15xsasUppjHv3qHTtTnFSNvcG6dRFS9gcBE7N--rViaWTgQE-QiWAuZUeYkYtQ Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_656858d44e9c4e0d93600f0f59e9d409", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}] Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c1dc05eec494fe6bf60bf0fc16ce47e Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f87df55d-ecd6-431b-8f7b-95ef5e1132eb'} Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:29.566769 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:06:29.571656 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:29.571656 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:29.571656 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:06:29.571656 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:06:29.571656 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:06:29.571656 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:06:29.571656 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:06:29.571656 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:29.575289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Returning 404 to user: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:06:29.576695 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45a5b402-cc39-4f00-8128-f8fd8419b55a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 404 len: 111 microversion: 2.20 time: 0.087268 Jul 26 20:06:29.578556 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2179/4410] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:29 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:06:29.605828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f8832de0-e648-425f-a2d5-a99111d69ea8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:29.607320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-89b267d5-a145-41e1-bcc5-5b41333ca6ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '.version_select at 0x7f875f13ddc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:29.620732 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f8832de0-e648-425f-a2d5-a99111d69ea8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.391322 Jul 26 20:06:29.627640 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2232/4411] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:29 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:29.653821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b57ca279-4aaf-40ca-8f9e-1e7e760973c1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1208167515"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:29.656819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b57ca279-4aaf-40ca-8f9e-1e7e760973c1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:29.684090 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-89b267d5-a145-41e1-bcc5-5b41333ca6ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43413789" status: 204 len: 0 microversion: 2.20 time: 0.086474 Jul 26 20:06:29.687692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b57ca279-4aaf-40ca-8f9e-1e7e760973c1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:29.688199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b57ca279-4aaf-40ca-8f9e-1e7e760973c1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:29.692124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b57ca279-4aaf-40ca-8f9e-1e7e760973c1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:29.694362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b57ca279-4aaf-40ca-8f9e-1e7e760973c1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:29.695433 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2180/4412] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 20:06:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43413789 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:06:29.734952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:29.735739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:29.748681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:29.749243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:29.751603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:29.754106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:30.037277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:30.051144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:30.052911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:30.054094 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-337239fd-5aec-49dd-ad41-de6ad44d2d15 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1335 microversion: 2.47 time: 0.325424 Jul 26 20:06:30.054648 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2181/4413] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:29 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1335 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:30.096049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc153efc-f2c5-4675-a228-802954e9d32c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:30.096800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc153efc-f2c5-4675-a228-802954e9d32c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:30.105844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc153efc-f2c5-4675-a228-802954e9d32c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:30.108364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc153efc-f2c5-4675-a228-802954e9d32c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:30.112124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc153efc-f2c5-4675-a228-802954e9d32c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:30.112793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc153efc-f2c5-4675-a228-802954e9d32c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:30.178501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b57ca279-4aaf-40ca-8f9e-1e7e760973c1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.528405 Jul 26 20:06:30.182574 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2233/4414] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:06:29 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 26 20:06:30.195205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f489a79d-eb52-48a4-8ec0-15c480913df9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:30.197606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f489a79d-eb52-48a4-8ec0-15c480913df9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:30.215031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f489a79d-eb52-48a4-8ec0-15c480913df9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:30.215490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f489a79d-eb52-48a4-8ec0-15c480913df9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:30.220339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f489a79d-eb52-48a4-8ec0-15c480913df9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:30.220849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f489a79d-eb52-48a4-8ec0-15c480913df9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:30.437015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc153efc-f2c5-4675-a228-802954e9d32c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:30.446487 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc153efc-f2c5-4675-a228-802954e9d32c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.357274 Jul 26 20:06:30.447095 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2182/4415] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:30 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:30.658597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f489a79d-eb52-48a4-8ec0-15c480913df9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:30.670982 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f489a79d-eb52-48a4-8ec0-15c480913df9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.486471 Jul 26 20:06:30.672086 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2234/4416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:30 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:31.082591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:31.083370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:31.097008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:31.098129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:31.099506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:31.100150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:31.255969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:31.276041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:31.283710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:31.287224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09b04282-a041-4f4c-834a-554a2e01c53f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1335 microversion: 2.47 time: 0.209935 Jul 26 20:06:31.304490 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2183/4417] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:31 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1335 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:31.377992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eaedfe8f-a4e9-4de5-aa15-93877ae08186 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'create', calling method: .version_select at 0x7f87566ddca0>, body: {"keypair": {"name": "tempest-keypair-1440079242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPj5JMHQOLcx4eellRnlOzvHwTe5B1KO75dhBazRY1V4K91uxXQEFHJ0Ibw6/ANO07Eootc4RLg4g9oxC9OTS6B5wxLxxxUNEQyrCHxxbKq6y1LlKcFpLfJohhQ1dXFew=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:31.414610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-eaedfe8f-a4e9-4de5-aa15-93877ae08186 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Getting quotas for project 656858d44e9c4e0d93600f0f59e9d409. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:06:31.421565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-eaedfe8f-a4e9-4de5-aa15-93877ae08186 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Getting quotas for user 9c1dc05eec494fe6bf60bf0fc16ce47e and project 656858d44e9c4e0d93600f0f59e9d409. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:06:31.470384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f692fd51-e920-4da4-a381-61c720302075 req-4e1b5312-eeef-48fc-b9df-d1a6bb59127c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7669f2d9-5341-4a3a-a80f-c17ee32eaeb7", "name": "network-vif-plugged", "status": "completed", "tag": "d55a01e3-c7a4-4b7a-a52b-ac7240b2268b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:31.487808 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eaedfe8f-a4e9-4de5-aa15-93877ae08186 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.113631 Jul 26 20:06:31.488828 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2235/4418] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Jul 26 20:06:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 20:06:31.497280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f692fd51-e920-4da4-a381-61c720302075 req-4e1b5312-eeef-48fc-b9df-d1a6bb59127c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:31.498208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f692fd51-e920-4da4-a381-61c720302075 req-4e1b5312-eeef-48fc-b9df-d1a6bb59127c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:31.500355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23a6b066-cf23-437b-9c33-67b2243661a1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:31.501035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-23a6b066-cf23-437b-9c33-67b2243661a1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:31.522268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23a6b066-cf23-437b-9c33-67b2243661a1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:31.522754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23a6b066-cf23-437b-9c33-67b2243661a1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:31.524000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23a6b066-cf23-437b-9c33-67b2243661a1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:31.524447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23a6b066-cf23-437b-9c33-67b2243661a1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:31.525214 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f692fd51-e920-4da4-a381-61c720302075 req-4e1b5312-eeef-48fc-b9df-d1a6bb59127c service nova] Creating event network-vif-plugged:d55a01e3-c7a4-4b7a-a52b-ac7240b2268b for instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 on n-h1-708768-8 Jul 26 20:06:31.541114 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f692fd51-e920-4da4-a381-61c720302075 req-4e1b5312-eeef-48fc-b9df-d1a6bb59127c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075114 Jul 26 20:06:31.546321 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2184/4419] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:06:31.697262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c233dd21-30ca-426c-92f3-55edea837644 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:31.698405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c233dd21-30ca-426c-92f3-55edea837644 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:31.718644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c233dd21-30ca-426c-92f3-55edea837644 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:31.719102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c233dd21-30ca-426c-92f3-55edea837644 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:31.722982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c233dd21-30ca-426c-92f3-55edea837644 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:31.723445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c233dd21-30ca-426c-92f3-55edea837644 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.001267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-23a6b066-cf23-437b-9c33-67b2243661a1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:32.051298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23a6b066-cf23-437b-9c33-67b2243661a1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.559508 Jul 26 20:06:32.052015 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2236/4420] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:31 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:32.249281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c233dd21-30ca-426c-92f3-55edea837644 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:32.260645 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c233dd21-30ca-426c-92f3-55edea837644 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1688 microversion: 2.1 time: 0.569283 Jul 26 20:06:32.261502 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2185/4421] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:31 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1688 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:32.321371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:32.322241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:32.329073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:32.329589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.330510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:32.331194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.420547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:32.429814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:32.431909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:32.433454 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f6373d07-6024-4ecf-8689-19b6944ef497 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1356 microversion: 2.47 time: 0.116790 Jul 26 20:06:32.434427 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2237/4422] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:32 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:32.458687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:32.461611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:32.468920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:32.470296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.472115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:32.472743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.581343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:06:32.582163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:06:32.583156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:06:32.583896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:06:32.584802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:06:32.671170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:32.690367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:32.690829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.691664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:32.692113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.802104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ae0300c4-a95c-404d-a605-a4d4a609d501 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "POST /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025/action" status: 202 len: 1078 microversion: 2.47 time: 0.347595 Jul 26 20:06:32.802790 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2186/4423] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 20:06:32 2022] POST /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025/action => generated 1078 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 20:06:32.826648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:32.833340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:32.845350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:32.848885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.851176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:32.852335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:32.893258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:33.073476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b0380a5-e037-4751-a69e-04b35953178e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:33.074125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b0380a5-e037-4751-a69e-04b35953178e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:33.085553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b0380a5-e037-4751-a69e-04b35953178e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:33.086144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b0380a5-e037-4751-a69e-04b35953178e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:33.092333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b0380a5-e037-4751-a69e-04b35953178e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:33.093589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b0380a5-e037-4751-a69e-04b35953178e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:33.107553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:33.351438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:33.367219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:33.372066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:33.376250 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-485e6440-fbfc-475b-8e5e-49babbf7fa61 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.553562 Jul 26 20:06:33.379151 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2238/4424] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:32 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:33.389641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-62af5321-32ad-47b1-b90c-1886dae98504 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:33.400877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-62af5321-32ad-47b1-b90c-1886dae98504 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:33.413353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62af5321-32ad-47b1-b90c-1886dae98504 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:33.414162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62af5321-32ad-47b1-b90c-1886dae98504 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:33.415407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62af5321-32ad-47b1-b90c-1886dae98504 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:33.415992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62af5321-32ad-47b1-b90c-1886dae98504 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:33.416436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6b0380a5-e037-4751-a69e-04b35953178e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:33.432037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b0380a5-e037-4751-a69e-04b35953178e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1293 microversion: 2.1 time: 0.362405 Jul 26 20:06:33.432624 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2187/4425] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:33 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1293 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:33.606994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d31adc6b-1b91-4323-9bb9-57c649070f18 req-250ac520-9462-46b8-bf19-456d049de506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "name": "network-vif-unplugged", "status": "completed", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:33.645399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d31adc6b-1b91-4323-9bb9-57c649070f18 req-250ac520-9462-46b8-bf19-456d049de506 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:33.645848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d31adc6b-1b91-4323-9bb9-57c649070f18 req-250ac520-9462-46b8-bf19-456d049de506 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:33.711719 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d31adc6b-1b91-4323-9bb9-57c649070f18 req-250ac520-9462-46b8-bf19-456d049de506 service nova] Creating event network-vif-unplugged:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:06:33.748957 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d31adc6b-1b91-4323-9bb9-57c649070f18 req-250ac520-9462-46b8-bf19-456d049de506 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145950 Jul 26 20:06:33.751707 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2188/4426] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:06:33.774212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62af5321-32ad-47b1-b90c-1886dae98504 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:33.796783 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-62af5321-32ad-47b1-b90c-1886dae98504 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1688 microversion: 2.1 time: 0.416029 Jul 26 20:06:33.797455 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2239/4427] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:33 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1688 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:34.404059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:34.404762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:34.418325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:34.418936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:34.419430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:34.422120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:34.458803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eee2aaab-91e3-4066-bd66-1ba40faf3bfb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:34.459415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eee2aaab-91e3-4066-bd66-1ba40faf3bfb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:34.476744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eee2aaab-91e3-4066-bd66-1ba40faf3bfb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:34.478726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eee2aaab-91e3-4066-bd66-1ba40faf3bfb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:34.483304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eee2aaab-91e3-4066-bd66-1ba40faf3bfb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:34.486261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eee2aaab-91e3-4066-bd66-1ba40faf3bfb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:34.687119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:34.722420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:34.723956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:34.730283 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3faec7e9-208b-4d3e-b154-7718e4748c5f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.330923 Jul 26 20:06:34.730881 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2189/4428] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:34 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:34.758860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eee2aaab-91e3-4066-bd66-1ba40faf3bfb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:34.771171 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eee2aaab-91e3-4066-bd66-1ba40faf3bfb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1475 microversion: 2.1 time: 0.317312 Jul 26 20:06:34.776393 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2240/4429] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:34 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1475 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:34.820433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d44af361-f57b-4708-a519-1c3bab808b53 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:34.821240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d44af361-f57b-4708-a519-1c3bab808b53 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:34.837440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d44af361-f57b-4708-a519-1c3bab808b53 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:34.838405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d44af361-f57b-4708-a519-1c3bab808b53 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:34.849221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d44af361-f57b-4708-a519-1c3bab808b53 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:34.854112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d44af361-f57b-4708-a519-1c3bab808b53 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:34.959882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-464266022", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:35.083752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] validate_networks() for [('a0732ca0-0b24-4753-bcca-055b8f396991', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:06:35.520161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d44af361-f57b-4708-a519-1c3bab808b53 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:35.528827 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d44af361-f57b-4708-a519-1c3bab808b53 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.712249 Jul 26 20:06:35.533776 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2190/4430] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:34 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:35.757099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:35.759805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:35.771073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:35.774000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:35.775094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:35.777111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:35.821599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:06:35.822076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:06:35.822467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:06:35.822870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:06:35.823463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:06:35.855583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:35.858185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:35.868480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:35.871381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:35.919112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:06:35.928949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:06:35.960027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:06:35.973599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:35.982563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:35.985673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ec10a302-1a05-4d99-81f7-2bb81bd40db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:06:35.987639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:35.995506 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e1e53110-116d-4ec7-89b2-e2a18443c75f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.242222 Jul 26 20:06:35.996495 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2191/4431] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:35 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:36.011373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-76950d5e-4ebd-486f-80f3-07ae7d0cee1a req-d18d61bf-5dff-41e8-8d45-2a89d71b246a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "name": "network-vif-plugged", "status": "completed", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:36.043162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-76950d5e-4ebd-486f-80f3-07ae7d0cee1a req-d18d61bf-5dff-41e8-8d45-2a89d71b246a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:36.045154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-76950d5e-4ebd-486f-80f3-07ae7d0cee1a req-d18d61bf-5dff-41e8-8d45-2a89d71b246a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:36.080896 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-76950d5e-4ebd-486f-80f3-07ae7d0cee1a req-d18d61bf-5dff-41e8-8d45-2a89d71b246a service nova] Creating event network-vif-plugged:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:06:36.106116 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-76950d5e-4ebd-486f-80f3-07ae7d0cee1a req-d18d61bf-5dff-41e8-8d45-2a89d71b246a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105983 Jul 26 20:06:36.110895 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2192/4432] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:06:36.127306 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c4f0987e-7270-4326-a775-1bb72ce855af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189142 Jul 26 20:06:36.131433 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2241/4433] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:06:36.141070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1e11121d-eee8-4d1a-bf94-c030d5f463f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:36.142190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1e11121d-eee8-4d1a-bf94-c030d5f463f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ec10a302-1a05-4d99-81f7-2bb81bd40db9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:36.187845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1e11121d-eee8-4d1a-bf94-c030d5f463f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ec10a302-1a05-4d99-81f7-2bb81bd40db9] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:06:36.564381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-497dd4d1-9ea1-4f07-838c-172fdb74ac62 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:36.571472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-497dd4d1-9ea1-4f07-838c-172fdb74ac62 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:36.619937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-497dd4d1-9ea1-4f07-838c-172fdb74ac62 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:36.620415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-497dd4d1-9ea1-4f07-838c-172fdb74ac62 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:36.631512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-497dd4d1-9ea1-4f07-838c-172fdb74ac62 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:36.632777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-497dd4d1-9ea1-4f07-838c-172fdb74ac62 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:36.638113 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1e11121d-eee8-4d1a-bf94-c030d5f463f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9" status: 204 len: 0 microversion: 2.1 time: 0.498733 Jul 26 20:06:36.643241 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2193/4434] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:06:36 2022] DELETE /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:06:36.676530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42390591-b695-41cd-8ec3-fbe4b68ff9d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:36.677166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-42390591-b695-41cd-8ec3-fbe4b68ff9d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ec10a302-1a05-4d99-81f7-2bb81bd40db9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:36.739146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-42390591-b695-41cd-8ec3-fbe4b68ff9d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42390591-b695-41cd-8ec3-fbe4b68ff9d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9 HTTP/1.1 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ec10a302-1a05-4d99-81f7-2bb81bd40db9'} Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:06:36.748589 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:06:36.753869 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:06:36.756591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42390591-b695-41cd-8ec3-fbe4b68ff9d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:06:36.761154 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-42390591-b695-41cd-8ec3-fbe4b68ff9d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9" status: 404 len: 111 microversion: 2.1 time: 0.101350 Jul 26 20:06:36.762860 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2194/4435] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:36 2022] GET /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:06:36.780597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-458387568", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46e47e89-5e7a-4dbc-a70d-bbebb8152491"}], "security_groups": [{"name": "tempest-securitygroup--345833146"}], "key_name": "tempest-keypair-1440079242", "user_data": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:37.076153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-497dd4d1-9ea1-4f07-838c-172fdb74ac62 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:37.091919 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-497dd4d1-9ea1-4f07-838c-172fdb74ac62 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.537445 Jul 26 20:06:37.095121 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2242/4436] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:36 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:37.115252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] validate_networks() for [('46e47e89-5e7a-4dbc-a70d-bbebb8152491', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:06:37.122836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-852206353", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a0732ca0-0b24-4753-bcca-055b8f396991"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:37.217737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] validate_networks() for [('a0732ca0-0b24-4753-bcca-055b8f396991', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:06:38.097207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:06:38.097842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:06:38.098102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:06:38.098511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:06:38.098974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:06:38.118553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:38.119017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:38.119942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:38.120652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:38.165069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:06:38.177339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:06:38.205955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:06:38.206526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:06:38.207245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:06:38.209022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:06:38.209219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:06:38.209768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:06:38.210196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:06:38.230548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:38.232141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:38.233739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:38.234548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:38.264365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Getting quotas for project 656858d44e9c4e0d93600f0f59e9d409. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:06:38.277917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Getting quotas for user 9c1dc05eec494fe6bf60bf0fc16ce47e and project 656858d44e9c4e0d93600f0f59e9d409. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:06:38.289761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:38.312207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:06:38.315410 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1032c275-88ca-425b-befd-b885daebed63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201263 Jul 26 20:06:38.316237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:06:38.327119 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2243/4437] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:06:38.332567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:38.345737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:38.372664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:38.377736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:38.378766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:38.380054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:38.437207 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f55a0822-9db0-4afc-8aa1-34399d77b010 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.673162 Jul 26 20:06:38.447950 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2195/4438] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 20:06:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 20:06:38.464453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b83a7908-d428-4c9a-ba8d-3d1c517e638b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:38.465569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b83a7908-d428-4c9a-ba8d-3d1c517e638b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:38.500232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b83a7908-d428-4c9a-ba8d-3d1c517e638b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:38.504181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b83a7908-d428-4c9a-ba8d-3d1c517e638b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:38.505915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b83a7908-d428-4c9a-ba8d-3d1c517e638b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:38.512698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b83a7908-d428-4c9a-ba8d-3d1c517e638b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:38.540499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:38.559225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:38.562233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:38.566401 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a8fa66e-4474-42c6-a81b-a38629c92a7f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.237782 Jul 26 20:06:38.571477 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2244/4439] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:38 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:38.603004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57066637-8c80-4fcb-8289-4e4eb274ff11 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:38.612458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-57066637-8c80-4fcb-8289-4e4eb274ff11 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:38.715389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-57066637-8c80-4fcb-8289-4e4eb274ff11 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:38.723196 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-57066637-8c80-4fcb-8289-4e4eb274ff11 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1220 microversion: 2.1 time: 0.134798 Jul 26 20:06:38.741011 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2245/4440] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:38 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:38.756791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5bd4c3e-5ba1-4073-9eb8-b167411f0888 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:38.767877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5bd4c3e-5ba1-4073-9eb8-b167411f0888 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:38.840700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5bd4c3e-5ba1-4073-9eb8-b167411f0888 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:38.851313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5bd4c3e-5ba1-4073-9eb8-b167411f0888 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:38.853956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5bd4c3e-5ba1-4073-9eb8-b167411f0888 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:38.855855 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5bd4c3e-5ba1-4073-9eb8-b167411f0888 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1281 microversion: 2.20 time: 0.113737 Jul 26 20:06:38.856616 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2246/4441] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:38 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:39.173036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b83a7908-d428-4c9a-ba8d-3d1c517e638b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:39.185004 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b83a7908-d428-4c9a-ba8d-3d1c517e638b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.735789 Jul 26 20:06:39.195920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2196/4442] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:38 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:39.595213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:39.597336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:39.636135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:39.636970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:39.656829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:39.658274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:39.751555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-009e459c-9747-4784-a28b-4e75b37a6277 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:39.752845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-009e459c-9747-4784-a28b-4e75b37a6277 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:39.782486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-009e459c-9747-4784-a28b-4e75b37a6277 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:39.786260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-009e459c-9747-4784-a28b-4e75b37a6277 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:39.787462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-009e459c-9747-4784-a28b-4e75b37a6277 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:39.792155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-009e459c-9747-4784-a28b-4e75b37a6277 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:39.838011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:39.863304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:39.869592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:39.871229 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4676e75d-e763-403d-bc51-bf6a7291a0e4 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.280801 Jul 26 20:06:39.872330 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2247/4443] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:39 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:39.898192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:39.900481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:39.915394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:39.924099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:39.926626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:39.927974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:40.023633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-009e459c-9747-4784-a28b-4e75b37a6277 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:40.050112 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-009e459c-9747-4784-a28b-4e75b37a6277 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1216 microversion: 2.1 time: 0.302944 Jul 26 20:06:40.050933 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2197/4444] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:39 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1216 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:40.091393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:40.132832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:40.138827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:40.141873 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7fa5cb1-95b2-439c-800f-b4c3c9c54080 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1333 microversion: 2.20 time: 0.251949 Jul 26 20:06:40.143707 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2248/4445] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:39 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1333 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:40.218637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5b6878cd-62d5-46c8-a915-24424f6516f2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:40.219327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5b6878cd-62d5-46c8-a915-24424f6516f2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:40.225958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b6878cd-62d5-46c8-a915-24424f6516f2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:40.226398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b6878cd-62d5-46c8-a915-24424f6516f2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:40.228571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b6878cd-62d5-46c8-a915-24424f6516f2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:40.230990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b6878cd-62d5-46c8-a915-24424f6516f2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:40.532502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5b6878cd-62d5-46c8-a915-24424f6516f2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:40.541091 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5b6878cd-62d5-46c8-a915-24424f6516f2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.326474 Jul 26 20:06:40.544623 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2198/4446] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:40 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:40.900348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:40.902273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:40.928375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:40.928958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:40.929928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:40.932269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:41.075724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d9c9874b-10b4-4319-ab26-5c33cb8dad83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:41.076332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d9c9874b-10b4-4319-ab26-5c33cb8dad83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:41.084173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9c9874b-10b4-4319-ab26-5c33cb8dad83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:41.096659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9c9874b-10b4-4319-ab26-5c33cb8dad83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:41.098071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:41.100257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9c9874b-10b4-4319-ab26-5c33cb8dad83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:41.100777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9c9874b-10b4-4319-ab26-5c33cb8dad83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:41.122559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:41.126709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:41.128150 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6897df9e-214b-4117-94ba-5fdb2bdcd30c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.235921 Jul 26 20:06:41.141552 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2249/4447] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:40 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:41.167203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:41.167720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:41.180145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:41.180605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:41.181400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:41.186438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:41.307367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d9c9874b-10b4-4319-ab26-5c33cb8dad83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:41.320179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d9c9874b-10b4-4319-ab26-5c33cb8dad83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1278 microversion: 2.1 time: 0.246117 Jul 26 20:06:41.322095 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2199/4448] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:41 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:41.358688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:41.371378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:41.374944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:41.376390 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5078f21b-b410-4a73-857e-50378726dfcf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1339 microversion: 2.20 time: 0.214061 Jul 26 20:06:41.383943 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2250/4449] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:41 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1339 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:41.575191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1119f64-4ff8-4f42-8a5c-13a5d46df6be tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:41.575858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1119f64-4ff8-4f42-8a5c-13a5d46df6be tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:41.582831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1119f64-4ff8-4f42-8a5c-13a5d46df6be tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:41.584222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1119f64-4ff8-4f42-8a5c-13a5d46df6be tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:41.587249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1119f64-4ff8-4f42-8a5c-13a5d46df6be tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:41.590520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1119f64-4ff8-4f42-8a5c-13a5d46df6be tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:42.159863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:42.161142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:42.174998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:42.175909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:42.176945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:42.177580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:42.191786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1119f64-4ff8-4f42-8a5c-13a5d46df6be tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:42.202446 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1119f64-4ff8-4f42-8a5c-13a5d46df6be tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.629334 Jul 26 20:06:42.203441 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2200/4450] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:41 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:42.342310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5cee213f-8523-4b82-9d08-e3ee7f34ee92 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:42.345772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5cee213f-8523-4b82-9d08-e3ee7f34ee92 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:42.357648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cee213f-8523-4b82-9d08-e3ee7f34ee92 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:42.358112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cee213f-8523-4b82-9d08-e3ee7f34ee92 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:42.358905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cee213f-8523-4b82-9d08-e3ee7f34ee92 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:42.359346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cee213f-8523-4b82-9d08-e3ee7f34ee92 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:42.478398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5cee213f-8523-4b82-9d08-e3ee7f34ee92 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:42.496185 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5cee213f-8523-4b82-9d08-e3ee7f34ee92 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1278 microversion: 2.1 time: 0.156925 Jul 26 20:06:42.496717 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2201/4451] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:42 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:42.505946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:42.508428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:42.525048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:42.525932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:42.526910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:42.527514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:42.550751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:42.579795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:42.582935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:42.584914 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ec2ed82-3464-43bd-be74-4366c0fe37e1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.431796 Jul 26 20:06:42.586144 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2251/4452] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:42 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:43.228644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9606fba0-0272-4c93-862b-ac161617c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:43.229455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9606fba0-0272-4c93-862b-ac161617c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:43.242268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:43.246149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9606fba0-0272-4c93-862b-ac161617c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:43.247714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9606fba0-0272-4c93-862b-ac161617c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:43.250187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9606fba0-0272-4c93-862b-ac161617c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:43.252144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9606fba0-0272-4c93-862b-ac161617c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:43.259423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:43.270474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:43.273180 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ff85b89-5e79-4d61-a0fd-1450c46af558 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1406 microversion: 2.20 time: 0.775213 Jul 26 20:06:43.278446 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2202/4453] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:42 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1406 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:43.525655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e5e0fd5b-7dac-45e6-aa4e-bad14ab5b67c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:43.526378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e5e0fd5b-7dac-45e6-aa4e-bad14ab5b67c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:43.540474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5e0fd5b-7dac-45e6-aa4e-bad14ab5b67c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:43.543081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5e0fd5b-7dac-45e6-aa4e-bad14ab5b67c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:43.544371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5e0fd5b-7dac-45e6-aa4e-bad14ab5b67c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:43.546807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5e0fd5b-7dac-45e6-aa4e-bad14ab5b67c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:43.853524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9606fba0-0272-4c93-862b-ac161617c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:43.862802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9606fba0-0272-4c93-862b-ac161617c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.640260 Jul 26 20:06:43.867693 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2252/4454] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:43 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:43.880845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:43.881647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:43.900766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:43.901514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:43.902394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:43.902917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:44.160103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:44.166834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:44.171548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:44.175725 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3dc8215-d88f-4909-a62a-12b73417ed96 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.306820 Jul 26 20:06:44.187645 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2253/4455] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:43 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:44.252803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e5e0fd5b-7dac-45e6-aa4e-bad14ab5b67c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:44.263046 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e5e0fd5b-7dac-45e6-aa4e-bad14ab5b67c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 0.748551 Jul 26 20:06:44.267179 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2203/4456] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:43 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:44.304553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:44.305110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:44.317980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:44.318439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:44.319225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:44.319686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:44.890744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8e7d53c-2cc0-4a3e-9708-4197863ef95e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:44.891938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8e7d53c-2cc0-4a3e-9708-4197863ef95e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:44.902828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8e7d53c-2cc0-4a3e-9708-4197863ef95e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:44.904774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8e7d53c-2cc0-4a3e-9708-4197863ef95e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:44.908083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8e7d53c-2cc0-4a3e-9708-4197863ef95e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:44.908824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8e7d53c-2cc0-4a3e-9708-4197863ef95e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:45.354653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:45.379380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:45.381181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:45.382376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ef5f8d8-add9-4d0f-95d7-c3c0ba3d68cf tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1406 microversion: 2.20 time: 1.082125 Jul 26 20:06:45.382930 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2254/4457] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:44 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1406 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:45.386057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c8e7d53c-2cc0-4a3e-9708-4197863ef95e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:45.404545 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8e7d53c-2cc0-4a3e-9708-4197863ef95e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.517509 Jul 26 20:06:45.405638 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2204/4458] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:44 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:45.410109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:45.410729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:45.418049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-34ddc180-894d-4cb0-9d49-db72f9f0520b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:45.418943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-34ddc180-894d-4cb0-9d49-db72f9f0520b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:45.427455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34ddc180-894d-4cb0-9d49-db72f9f0520b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:45.428028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34ddc180-894d-4cb0-9d49-db72f9f0520b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:45.429456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34ddc180-894d-4cb0-9d49-db72f9f0520b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:45.429969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34ddc180-894d-4cb0-9d49-db72f9f0520b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:45.434633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:45.435090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:45.435901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:45.436335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:45.593291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:45.607728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:45.610440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:45.612183 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56b7d760-7693-4dc7-a7b5-b6beb29db43d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.228264 Jul 26 20:06:45.632515 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2255/4459] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:45 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:46.331850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89a4d656-30c1-460e-8ba2-0495ff92d3b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698-project-admin] Calling method '.version_select at 0x7f8756192f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:46.332921 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:06:46.332921 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:06:46.335024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89a4d656-30c1-460e-8ba2-0495ff92d3b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:46.335485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89a4d656-30c1-460e-8ba2-0495ff92d3b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:46.389221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89a4d656-30c1-460e-8ba2-0495ff92d3b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:46.389822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89a4d656-30c1-460e-8ba2-0495ff92d3b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:46.409948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89a4d656-30c1-460e-8ba2-0495ff92d3b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:46.410878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89a4d656-30c1-460e-8ba2-0495ff92d3b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:46.423860 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89a4d656-30c1-460e-8ba2-0495ff92d3b4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251256698-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.613677 Jul 26 20:06:46.425216 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2256/4460] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 20:06:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:06:46.443426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c41fd25d-de60-4980-8784-902e757161ce req-6502a886-bbff-42e5-a804-2e3a66932f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c400aa-bca9-4bec-a8ef-e200c066995e", "tag": "10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:46.453301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:46.472885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c41fd25d-de60-4980-8784-902e757161ce req-6502a886-bbff-42e5-a804-2e3a66932f10 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:46.473458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c41fd25d-de60-4980-8784-902e757161ce req-6502a886-bbff-42e5-a804-2e3a66932f10 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:46.492627 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c41fd25d-de60-4980-8784-902e757161ce req-6502a886-bbff-42e5-a804-2e3a66932f10 service nova] Creating event network-changed:10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf for instance b2c400aa-bca9-4bec-a8ef-e200c066995e on n-h1-708768-8 Jul 26 20:06:46.504857 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c41fd25d-de60-4980-8784-902e757161ce req-6502a886-bbff-42e5-a804-2e3a66932f10 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078048 Jul 26 20:06:46.508402 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2257/4461] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:06:46.521350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:46.522086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:46.558818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:46.560230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:46.562133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:46.562756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:47.053710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:47.057551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:47.067968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:47.077889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:47.089915 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bbdb3522-6d1a-4bd9-894d-e456c1acce5c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1406 microversion: 2.20 time: 0.566177 Jul 26 20:06:47.091907 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2258/4462] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:46 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:47.121961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23cac250-2a82-45de-bb4c-efbdd9aa9866 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:47.124806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-23cac250-2a82-45de-bb4c-efbdd9aa9866 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:47.137687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23cac250-2a82-45de-bb4c-efbdd9aa9866 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:47.138357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23cac250-2a82-45de-bb4c-efbdd9aa9866 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:47.139814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23cac250-2a82-45de-bb4c-efbdd9aa9866 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:47.140419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23cac250-2a82-45de-bb4c-efbdd9aa9866 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:47.165922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-34ddc180-894d-4cb0-9d49-db72f9f0520b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:47.191215 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-34ddc180-894d-4cb0-9d49-db72f9f0520b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 1.783665 Jul 26 20:06:47.209580 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2205/4463] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:45 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:47.214944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:47.215883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:47.223112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:47.224215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:47.225167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:47.225789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:47.525740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:47.539080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:47.542368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:47.544257 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c7e0e75a-c666-4927-901e-7c5624e3793c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.333577 Jul 26 20:06:47.545036 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2206/4464] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:47 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:47.659780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-23cac250-2a82-45de-bb4c-efbdd9aa9866 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:47.712243 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23cac250-2a82-45de-bb4c-efbdd9aa9866 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.618171 Jul 26 20:06:47.714078 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2259/4465] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:47 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:48.128814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:48.129476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:48.145571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:48.146021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:48.149533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:48.149982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:48.217667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e818d1f3-94d0-47f3-a074-07d3013fbf63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:48.219569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e818d1f3-94d0-47f3-a074-07d3013fbf63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:48.225103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:48.232443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e818d1f3-94d0-47f3-a074-07d3013fbf63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:48.233841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e818d1f3-94d0-47f3-a074-07d3013fbf63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:48.234979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e818d1f3-94d0-47f3-a074-07d3013fbf63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:48.235716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e818d1f3-94d0-47f3-a074-07d3013fbf63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:48.583289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e818d1f3-94d0-47f3-a074-07d3013fbf63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:48.601196 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e818d1f3-94d0-47f3-a074-07d3013fbf63 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 0.389119 Jul 26 20:06:48.602645 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2260/4466] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:48 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:48.609576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:48.611430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:48.633028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:48.635226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:48.639038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:48.639934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:48.722380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:48.724614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:48.776054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:48.790989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:48.794356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:48.796934 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47f72701-f592-4bd0-bdb3-2a91b0159ba0 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.193059 Jul 26 20:06:48.801749 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2261/4467] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:48 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:48.810626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd85c8d7-c7c3-463f-9943-8ce81de80fb6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:48.813777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd85c8d7-c7c3-463f-9943-8ce81de80fb6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:48.836526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd85c8d7-c7c3-463f-9943-8ce81de80fb6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:48.839069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd85c8d7-c7c3-463f-9943-8ce81de80fb6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:48.842167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd85c8d7-c7c3-463f-9943-8ce81de80fb6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:48.847990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd85c8d7-c7c3-463f-9943-8ce81de80fb6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:48.848950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=36 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:48.947430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:48.955025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:48.963927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:48.966317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:48.967918 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-63140657-099d-4059-810e-57faad672dc8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1406 microversion: 2.20 time: 0.846528 Jul 26 20:06:48.983344 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2207/4468] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:48 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1406 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:49.051098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-dc311ff0-d837-4e17-ab8c-ec448573cdfb req-51a20468-b33c-4453-b62b-75a825509501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdf01a8-2c04-4701-bac7-10c942466b5d", "tag": "a4599da1-b5ed-447a-b675-96b1c447e156"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:49.083865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dc311ff0-d837-4e17-ab8c-ec448573cdfb req-51a20468-b33c-4453-b62b-75a825509501 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:49.087593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dc311ff0-d837-4e17-ab8c-ec448573cdfb req-51a20468-b33c-4453-b62b-75a825509501 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:49.108954 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-dc311ff0-d837-4e17-ab8c-ec448573cdfb req-51a20468-b33c-4453-b62b-75a825509501 service nova] Creating event network-changed:a4599da1-b5ed-447a-b675-96b1c447e156 for instance ecdf01a8-2c04-4701-bac7-10c942466b5d on n-h1-708768-8 Jul 26 20:06:49.124774 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-dc311ff0-d837-4e17-ab8c-ec448573cdfb req-51a20468-b33c-4453-b62b-75a825509501 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108327 Jul 26 20:06:49.127484 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2208/4469] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:06:49.269213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd85c8d7-c7c3-463f-9943-8ce81de80fb6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:49.289234 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd85c8d7-c7c3-463f-9943-8ce81de80fb6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.484425 Jul 26 20:06:49.308787 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2262/4470] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:48 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:49.628650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-180d3f49-53e7-47a1-881c-1f28336bc08e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:49.629436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-180d3f49-53e7-47a1-881c-1f28336bc08e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:49.646792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-180d3f49-53e7-47a1-881c-1f28336bc08e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:49.647936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-180d3f49-53e7-47a1-881c-1f28336bc08e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:49.649035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-180d3f49-53e7-47a1-881c-1f28336bc08e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:49.649994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-180d3f49-53e7-47a1-881c-1f28336bc08e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:49.828849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:49.831493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:49.847322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:49.847832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:49.850137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:49.850601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:49.931512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-180d3f49-53e7-47a1-881c-1f28336bc08e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:49.956743 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-180d3f49-53e7-47a1-881c-1f28336bc08e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 0.333598 Jul 26 20:06:49.972873 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2209/4471] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:49 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:49.994410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:49.995293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:50.002808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:50.003491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:50.004455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:50.005055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:50.057509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:50.071974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:50.073791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:50.077097 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-05bc03be-2ee8-460e-a2ab-e0af19fec16a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.256323 Jul 26 20:06:50.080335 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2263/4472] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:49 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:50.293236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:50.314176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d33890ae-2a55-402b-86a4-06a82731674f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:50.315040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d33890ae-2a55-402b-86a4-06a82731674f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:50.321952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:50.329795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:50.331011 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9a246019-6f31-4a1a-852f-e992d8f1e989 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1406 microversion: 2.20 time: 0.342499 Jul 26 20:06:50.344829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d33890ae-2a55-402b-86a4-06a82731674f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:50.345349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d33890ae-2a55-402b-86a4-06a82731674f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:50.349580 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2210/4473] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:49 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:50.349985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d33890ae-2a55-402b-86a4-06a82731674f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:50.350957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d33890ae-2a55-402b-86a4-06a82731674f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:50.637327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d33890ae-2a55-402b-86a4-06a82731674f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:50.650816 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d33890ae-2a55-402b-86a4-06a82731674f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.341537 Jul 26 20:06:50.651888 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2264/4474] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:50 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:50.982410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d4cdbb02-4b04-4f39-af6e-7211c549ee96 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:50.984129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4cdbb02-4b04-4f39-af6e-7211c549ee96 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:50.996301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4cdbb02-4b04-4f39-af6e-7211c549ee96 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:50.997089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4cdbb02-4b04-4f39-af6e-7211c549ee96 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:51.000714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4cdbb02-4b04-4f39-af6e-7211c549ee96 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:51.002120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4cdbb02-4b04-4f39-af6e-7211c549ee96 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:51.105478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:51.106369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:51.121021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:51.123935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:51.128269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:51.130995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:51.297121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:51.310176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:51.315325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:51.323451 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-78062a40-6278-4a3c-af19-eea1bf45adff tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.223627 Jul 26 20:06:51.327210 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2265/4475] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:51 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:51.358706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:51.362049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:51.375162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:51.377626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:51.384745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:51.385277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:51.940555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4cdbb02-4b04-4f39-af6e-7211c549ee96 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:51.948819 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d4cdbb02-4b04-4f39-af6e-7211c549ee96 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 0.970374 Jul 26 20:06:51.956403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:51.961947 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2211/4476] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:50 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:51.975064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:51.975955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26b91718-6531-441b-937e-acca3be97cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:51.981215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:51.985282 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6cae885c-217d-4684-ae21-5034bc7a7288 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1406 microversion: 2.20 time: 0.631745 Jul 26 20:06:51.988177 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2266/4477] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:51 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1406 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:52.001034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-26b91718-6531-441b-937e-acca3be97cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:52.042621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26b91718-6531-441b-937e-acca3be97cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:52.043511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26b91718-6531-441b-937e-acca3be97cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:52.048558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26b91718-6531-441b-937e-acca3be97cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:52.049322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26b91718-6531-441b-937e-acca3be97cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:52.351024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:52.352850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:52.366979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:52.368174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:52.369137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:52.372802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:52.553325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:52.562211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:52.564891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:52.566328 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77d33d49-58d5-4297-8bc2-26fe102e8558 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.219269 Jul 26 20:06:52.568009 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2267/4478] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:52 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:52.654559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-26b91718-6531-441b-937e-acca3be97cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:52.663891 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26b91718-6531-441b-937e-acca3be97cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.700260 Jul 26 20:06:52.666675 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2212/4479] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:51 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:52.978080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-52189c01-f7b3-4233-a536-ee64f9831004 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:52.978775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-52189c01-f7b3-4233-a536-ee64f9831004 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:52.987867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52189c01-f7b3-4233-a536-ee64f9831004 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:53.000261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52189c01-f7b3-4233-a536-ee64f9831004 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:53.001217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52189c01-f7b3-4233-a536-ee64f9831004 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:53.002141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52189c01-f7b3-4233-a536-ee64f9831004 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:53.013421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:53.014617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:53.043071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:53.048145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:53.049371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:53.050044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:53.234334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-52189c01-f7b3-4233-a536-ee64f9831004 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:53.244096 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-52189c01-f7b3-4233-a536-ee64f9831004 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 0.270067 Jul 26 20:06:53.256000 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2268/4480] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:52 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:53.286334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:53.297064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:53.299562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:53.301012 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ddf77683-eb31-4583-bd96-734ff6dedb7e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1406 microversion: 2.20 time: 0.291786 Jul 26 20:06:53.302186 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2213/4481] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:53 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:53.590537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:53.591160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:53.611838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:53.612847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:53.613952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:53.614611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:53.694731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ca83de0-6d29-4b2d-ac6e-e051fa10711f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:53.695749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ca83de0-6d29-4b2d-ac6e-e051fa10711f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:53.715801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ca83de0-6d29-4b2d-ac6e-e051fa10711f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:53.716610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ca83de0-6d29-4b2d-ac6e-e051fa10711f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:53.725578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ca83de0-6d29-4b2d-ac6e-e051fa10711f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:53.726317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ca83de0-6d29-4b2d-ac6e-e051fa10711f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:53.798199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:53.814682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:53.819799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:53.822385 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d7c6f4e-1483-46cf-8385-7a7127c51da5 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.235973 Jul 26 20:06:53.825881 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2269/4482] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:53 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:53.996708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1d89e1ed-9086-4196-834d-e6e399665aec req-0b6394fa-1a32-4827-86be-a47da5e49e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c400aa-bca9-4bec-a8ef-e200c066995e", "name": "network-vif-plugged", "status": "completed", "tag": "10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:54.023405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1d89e1ed-9086-4196-834d-e6e399665aec req-0b6394fa-1a32-4827-86be-a47da5e49e76 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:54.024189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1d89e1ed-9086-4196-834d-e6e399665aec req-0b6394fa-1a32-4827-86be-a47da5e49e76 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:54.054904 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1d89e1ed-9086-4196-834d-e6e399665aec req-0b6394fa-1a32-4827-86be-a47da5e49e76 service nova] Creating event network-vif-plugged:10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf for instance b2c400aa-bca9-4bec-a8ef-e200c066995e on n-h1-708768-8 Jul 26 20:06:54.065275 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1d89e1ed-9086-4196-834d-e6e399665aec req-0b6394fa-1a32-4827-86be-a47da5e49e76 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072812 Jul 26 20:06:54.068975 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2270/4483] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:06:54.104265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9ca83de0-6d29-4b2d-ac6e-e051fa10711f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:54.118177 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ca83de0-6d29-4b2d-ac6e-e051fa10711f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.428206 Jul 26 20:06:54.120743 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2214/4484] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:53 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:54.267878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e8a46da-6eba-46f3-85cb-aa5b989b7eb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:54.268692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e8a46da-6eba-46f3-85cb-aa5b989b7eb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:54.287375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e8a46da-6eba-46f3-85cb-aa5b989b7eb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:54.288805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e8a46da-6eba-46f3-85cb-aa5b989b7eb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:54.292666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e8a46da-6eba-46f3-85cb-aa5b989b7eb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:54.294734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e8a46da-6eba-46f3-85cb-aa5b989b7eb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:54.328357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:54.329873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:54.342503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:54.342935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:54.345092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:54.345718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:54.597882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e8a46da-6eba-46f3-85cb-aa5b989b7eb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:54.607870 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e8a46da-6eba-46f3-85cb-aa5b989b7eb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 0.345316 Jul 26 20:06:54.612247 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2271/4485] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:54 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:54.639973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:54.658548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:54.666759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:54.671437 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7b50177b-c5dc-498f-a301-fde4b42f1d1f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1406 microversion: 2.20 time: 0.348827 Jul 26 20:06:54.674908 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2215/4486] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:54 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:54.853403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:54.854218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:54.861476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:54.863362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:54.865471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:54.866144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:54.957887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:54.987673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:54.993502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:54.998886 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0bddb8d8-b0bc-4e04-a6bd-f2f7491e9d22 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.149962 Jul 26 20:06:55.000753 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2272/4487] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:54 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:55.143515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6ffd072a-49a4-42aa-872b-7b5d443537a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:55.144432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6ffd072a-49a4-42aa-872b-7b5d443537a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:55.161959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ffd072a-49a4-42aa-872b-7b5d443537a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:55.165459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ffd072a-49a4-42aa-872b-7b5d443537a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:55.171645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ffd072a-49a4-42aa-872b-7b5d443537a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:55.173241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6ffd072a-49a4-42aa-872b-7b5d443537a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:55.627057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6ffd072a-49a4-42aa-872b-7b5d443537a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:55.633441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-40114302-865e-4579-8fd8-687c44f5c6e4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:55.635092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40114302-865e-4579-8fd8-687c44f5c6e4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:55.647682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40114302-865e-4579-8fd8-687c44f5c6e4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:55.656150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40114302-865e-4579-8fd8-687c44f5c6e4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:55.664379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40114302-865e-4579-8fd8-687c44f5c6e4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:55.671567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40114302-865e-4579-8fd8-687c44f5c6e4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:55.675201 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6ffd072a-49a4-42aa-872b-7b5d443537a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.534083 Jul 26 20:06:55.675887 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2216/4488] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:55 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:55.725102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:55.726000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:55.743998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:55.744727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:55.745712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:55.746162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:55.934059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-40114302-865e-4579-8fd8-687c44f5c6e4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:55.947671 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-40114302-865e-4579-8fd8-687c44f5c6e4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 0.319078 Jul 26 20:06:55.952436 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2273/4489] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:55 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:56.035278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:56.035278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:56.040009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.042112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:56.044247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.044900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:56.143243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:56.166013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:56.174768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:56.176597 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ebd0ca86-f1ba-4c92-ac1f-2fb8973023fa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1598 microversion: 2.20 time: 0.459246 Jul 26 20:06:56.200098 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2217/4490] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:55 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1598 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:56.206306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bad266b1-de04-47c5-a454-8cc15d618beb req-fe98b3c6-5bd1-475f-8a61-1bf17d594431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdf01a8-2c04-4701-bac7-10c942466b5d", "name": "network-vif-plugged", "status": "completed", "tag": "a4599da1-b5ed-447a-b675-96b1c447e156"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:56.217594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bad266b1-de04-47c5-a454-8cc15d618beb req-fe98b3c6-5bd1-475f-8a61-1bf17d594431 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.218757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bad266b1-de04-47c5-a454-8cc15d618beb req-fe98b3c6-5bd1-475f-8a61-1bf17d594431 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:56.219726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:56.235374 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bad266b1-de04-47c5-a454-8cc15d618beb req-fe98b3c6-5bd1-475f-8a61-1bf17d594431 service nova] Creating event network-vif-plugged:a4599da1-b5ed-447a-b675-96b1c447e156 for instance ecdf01a8-2c04-4701-bac7-10c942466b5d on n-h1-708768-8 Jul 26 20:06:56.241824 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bad266b1-de04-47c5-a454-8cc15d618beb req-fe98b3c6-5bd1-475f-8a61-1bf17d594431 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040101 Jul 26 20:06:56.242040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:56.243478 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2218/4491] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:06:56.252412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:56.260509 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2b335092-ace5-4f0f-99b8-d772e87c086f tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.237675 Jul 26 20:06:56.261537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ed1c6311-3536-4ce5-a0a2-4194f0c78841 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:56.262326 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2274/4492] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:56 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:56.264293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ed1c6311-3536-4ce5-a0a2-4194f0c78841 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:56.298438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed1c6311-3536-4ce5-a0a2-4194f0c78841 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.306209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed1c6311-3536-4ce5-a0a2-4194f0c78841 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:56.311105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed1c6311-3536-4ce5-a0a2-4194f0c78841 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.311815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed1c6311-3536-4ce5-a0a2-4194f0c78841 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:56.499873 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ed1c6311-3536-4ce5-a0a2-4194f0c78841 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.254786 Jul 26 20:06:56.501074 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2219/4493] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Jul 26 20:06:56 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:06:56.702018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65cbf958-b05b-4c87-8905-d97f660915af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:56.702769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65cbf958-b05b-4c87-8905-d97f660915af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:56.723034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65cbf958-b05b-4c87-8905-d97f660915af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.723486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65cbf958-b05b-4c87-8905-d97f660915af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:56.724302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65cbf958-b05b-4c87-8905-d97f660915af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.724736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65cbf958-b05b-4c87-8905-d97f660915af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:56.973477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d89f50ea-1fa7-4ee9-a73f-d68df567808f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:56.974096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d89f50ea-1fa7-4ee9-a73f-d68df567808f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:56.988001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d89f50ea-1fa7-4ee9-a73f-d68df567808f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.989072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d89f50ea-1fa7-4ee9-a73f-d68df567808f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:56.989887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d89f50ea-1fa7-4ee9-a73f-d68df567808f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:56.995197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d89f50ea-1fa7-4ee9-a73f-d68df567808f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:57.666829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65cbf958-b05b-4c87-8905-d97f660915af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:57.682025 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65cbf958-b05b-4c87-8905-d97f660915af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1683 microversion: 2.1 time: 0.984548 Jul 26 20:06:57.683223 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2275/4494] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:56 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1683 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:57.700489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:57.701374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:57.710672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:57.712842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:57.714304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:57.714950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:57.772822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:06:57.875489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:57.896799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:57.900784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:57.904655 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7030a926-f919-4157-bf5a-028232904cef tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.219924 Jul 26 20:06:57.907133 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2276/4495] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:57 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:06:57.928081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d89f50ea-1fa7-4ee9-a73f-d68df567808f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:57.938920 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d89f50ea-1fa7-4ee9-a73f-d68df567808f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1320 microversion: 2.1 time: 0.969466 Jul 26 20:06:57.945789 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2220/4496] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:56 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1320 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:58.508568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9879ebc3-45d9-4ef2-bdfd-86959918ded2 req-74f8859b-cf60-4acb-82ae-aa4afb7a3a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c400aa-bca9-4bec-a8ef-e200c066995e", "tag": "10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:06:58.519496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9879ebc3-45d9-4ef2-bdfd-86959918ded2 req-74f8859b-cf60-4acb-82ae-aa4afb7a3a14 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:58.520057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9879ebc3-45d9-4ef2-bdfd-86959918ded2 req-74f8859b-cf60-4acb-82ae-aa4afb7a3a14 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:58.537768 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9879ebc3-45d9-4ef2-bdfd-86959918ded2 req-74f8859b-cf60-4acb-82ae-aa4afb7a3a14 service nova] Creating event network-changed:10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf for instance b2c400aa-bca9-4bec-a8ef-e200c066995e on n-h1-708768-8 Jul 26 20:06:58.552630 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9879ebc3-45d9-4ef2-bdfd-86959918ded2 req-74f8859b-cf60-4acb-82ae-aa4afb7a3a14 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048096 Jul 26 20:06:58.567821 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2277/4497] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:06:58.707596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-655085d7-e36b-4e4b-9acc-478a4ad8a9cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:58.708506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-655085d7-e36b-4e4b-9acc-478a4ad8a9cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:58.736107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-655085d7-e36b-4e4b-9acc-478a4ad8a9cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:58.737088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-655085d7-e36b-4e4b-9acc-478a4ad8a9cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:58.738522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-655085d7-e36b-4e4b-9acc-478a4ad8a9cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:58.740623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-655085d7-e36b-4e4b-9acc-478a4ad8a9cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:58.931023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:58.932038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:58.938777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:58.939515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:58.940489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:58.940916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.016683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:59.036291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:59.040513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:59.041750 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a743737f-206e-46f3-9e78-eed1844bb304 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.115918 Jul 26 20:06:59.044204 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2278/4498] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:06:58 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:06:59.049153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8b156813-b559-4684-9109-3af686e4a495 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:59.049896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8b156813-b559-4684-9109-3af686e4a495 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:59.057940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b156813-b559-4684-9109-3af686e4a495 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.058888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b156813-b559-4684-9109-3af686e4a495 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.059811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b156813-b559-4684-9109-3af686e4a495 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.060327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b156813-b559-4684-9109-3af686e4a495 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.213387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8b156813-b559-4684-9109-3af686e4a495 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:59.221649 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8b156813-b559-4684-9109-3af686e4a495 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1502 microversion: 2.1 time: 0.176300 Jul 26 20:06:59.222243 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2279/4499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:59 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:59.245119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4df54a56-bb90-4888-8ee9-37865da0d242 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:59.245750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4df54a56-bb90-4888-8ee9-37865da0d242 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:59.252576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4df54a56-bb90-4888-8ee9-37865da0d242 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.253314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4df54a56-bb90-4888-8ee9-37865da0d242 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.254568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4df54a56-bb90-4888-8ee9-37865da0d242 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.255316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4df54a56-bb90-4888-8ee9-37865da0d242 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.258510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-655085d7-e36b-4e4b-9acc-478a4ad8a9cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:59.267454 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-655085d7-e36b-4e4b-9acc-478a4ad8a9cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.566795 Jul 26 20:06:59.269010 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2221/4500] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:58 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:59.430207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-765f8732-da97-4eff-a813-0c4efe1eea6b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:59.430828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-765f8732-da97-4eff-a813-0c4efe1eea6b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:59.439657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-765f8732-da97-4eff-a813-0c4efe1eea6b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.440113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-765f8732-da97-4eff-a813-0c4efe1eea6b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.441087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-765f8732-da97-4eff-a813-0c4efe1eea6b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.441691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-765f8732-da97-4eff-a813-0c4efe1eea6b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.481450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4df54a56-bb90-4888-8ee9-37865da0d242 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:59.492146 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4df54a56-bb90-4888-8ee9-37865da0d242 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1502 microversion: 2.1 time: 0.252386 Jul 26 20:06:59.501090 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2280/4501] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:59 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:06:59.528822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34b94e99-2a0b-4560-829b-bd97b93084f3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:59.530426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34b94e99-2a0b-4560-829b-bd97b93084f3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:59.540819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34b94e99-2a0b-4560-829b-bd97b93084f3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.541616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34b94e99-2a0b-4560-829b-bd97b93084f3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.542721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34b94e99-2a0b-4560-829b-bd97b93084f3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.543362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34b94e99-2a0b-4560-829b-bd97b93084f3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.592149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34b94e99-2a0b-4560-829b-bd97b93084f3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:06:59.751832 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34b94e99-2a0b-4560-829b-bd97b93084f3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 204 len: 0 microversion: 2.1 time: 0.230567 Jul 26 20:06:59.754658 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2281/4502] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:06:59 2022] DELETE /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:06:59.773773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-37a770cf-6fcc-4948-a7f1-6c018b6d51bb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:06:59.774916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-37a770cf-6fcc-4948-a7f1-6c018b6d51bb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:06:59.786925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37a770cf-6fcc-4948-a7f1-6c018b6d51bb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.787567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37a770cf-6fcc-4948-a7f1-6c018b6d51bb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.789131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37a770cf-6fcc-4948-a7f1-6c018b6d51bb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:06:59.790178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37a770cf-6fcc-4948-a7f1-6c018b6d51bb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:06:59.971214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-37a770cf-6fcc-4948-a7f1-6c018b6d51bb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:59.977313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-765f8732-da97-4eff-a813-0c4efe1eea6b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:06:59.989149 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-37a770cf-6fcc-4948-a7f1-6c018b6d51bb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1508 microversion: 2.1 time: 0.227476 Jul 26 20:06:59.989999 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2282/4503] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:59 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:06:59.990880 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-765f8732-da97-4eff-a813-0c4efe1eea6b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.566317 Jul 26 20:06:59.992047 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2222/4504] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:06:59 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:00.066358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:00.067123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:00.078101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:00.079260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:00.085747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:00.086414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:00.210366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:00.220780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:00.222262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:00.223450 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4839b203-26dc-4e75-b14c-268db41f1f94 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.161034 Jul 26 20:07:00.239176 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2283/4505] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:00 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:01.012878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cce87993-aa24-4ca6-bb9d-fa144930839f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:01.013492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cce87993-aa24-4ca6-bb9d-fa144930839f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:01.030438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cce87993-aa24-4ca6-bb9d-fa144930839f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:01.030893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cce87993-aa24-4ca6-bb9d-fa144930839f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:01.032349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cce87993-aa24-4ca6-bb9d-fa144930839f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:01.032973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cce87993-aa24-4ca6-bb9d-fa144930839f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:01.247901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:01.248622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:01.263505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:01.264224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:01.265014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:01.265449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:01.435127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:01.447286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:01.449059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:01.454512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d190c1d6-24f3-4dec-996b-c40718be1736 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.210104 Jul 26 20:07:01.455270 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2284/4506] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:01 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:01.515917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cce87993-aa24-4ca6-bb9d-fa144930839f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:01.533818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cce87993-aa24-4ca6-bb9d-fa144930839f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1508 microversion: 2.1 time: 0.520863 Jul 26 20:07:01.534713 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2223/4507] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:01 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1508 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:01.864614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-943e1468-c7d8-4689-9c6d-b9a2bb173cf7 req-42486bc9-2ffb-4cd1-9a6c-3a807e82fab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "name": "network-vif-unplugged", "status": "completed", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:01.886681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-943e1468-c7d8-4689-9c6d-b9a2bb173cf7 req-42486bc9-2ffb-4cd1-9a6c-3a807e82fab1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:01.888738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-943e1468-c7d8-4689-9c6d-b9a2bb173cf7 req-42486bc9-2ffb-4cd1-9a6c-3a807e82fab1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:01.932292 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-943e1468-c7d8-4689-9c6d-b9a2bb173cf7 req-42486bc9-2ffb-4cd1-9a6c-3a807e82fab1 service nova] Creating event network-vif-unplugged:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:07:01.947512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-943e1468-c7d8-4689-9c6d-b9a2bb173cf7 req-42486bc9-2ffb-4cd1-9a6c-3a807e82fab1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087407 Jul 26 20:07:01.950710 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2285/4508] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:02.117950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-23b99895-e1a3-4c02-a4f1-cc75d2e0d039 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:02.120225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-23b99895-e1a3-4c02-a4f1-cc75d2e0d039 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:02.135462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23b99895-e1a3-4c02-a4f1-cc75d2e0d039 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.136344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23b99895-e1a3-4c02-a4f1-cc75d2e0d039 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.139415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23b99895-e1a3-4c02-a4f1-cc75d2e0d039 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.140068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23b99895-e1a3-4c02-a4f1-cc75d2e0d039 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.429484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c27f587c-edac-4c65-b743-9623ec4cee95 req-b0367c3d-6014-4923-8a75-d882d347c879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdf01a8-2c04-4701-bac7-10c942466b5d", "name": "network-vif-deleted", "tag": "a4599da1-b5ed-447a-b675-96b1c447e156"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:02.480883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c27f587c-edac-4c65-b743-9623ec4cee95 req-b0367c3d-6014-4923-8a75-d882d347c879 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.481539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c27f587c-edac-4c65-b743-9623ec4cee95 req-b0367c3d-6014-4923-8a75-d882d347c879 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.529696 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c27f587c-edac-4c65-b743-9623ec4cee95 req-b0367c3d-6014-4923-8a75-d882d347c879 service nova] Creating event network-vif-deleted:a4599da1-b5ed-447a-b675-96b1c447e156 for instance ecdf01a8-2c04-4701-bac7-10c942466b5d on n-h1-708768-8 Jul 26 20:07:02.539632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c27f587c-edac-4c65-b743-9623ec4cee95 req-b0367c3d-6014-4923-8a75-d882d347c879 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115936 Jul 26 20:07:02.540663 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2286/4509] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:07:02.549083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:02.550170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:02.557411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.559022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.560073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.560728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.634872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-23b99895-e1a3-4c02-a4f1-cc75d2e0d039 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:02.653364 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-23b99895-e1a3-4c02-a4f1-cc75d2e0d039 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.536293 Jul 26 20:07:02.658294 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2224/4510] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:02 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:02.664793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:02.669247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:02.674505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:02.683000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:02.688501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:02.691803 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7cf48b58-19f7-4ae0-a902-e8de55d55197 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.148819 Jul 26 20:07:02.695336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.695934 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2287/4511] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:02 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:02.697833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.701471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-76db3ed4-840a-425a-b5a8-78763a2084ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:02.702587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.704514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.706912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-76db3ed4-840a-425a-b5a8-78763a2084ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:02.719724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76db3ed4-840a-425a-b5a8-78763a2084ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.722983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76db3ed4-840a-425a-b5a8-78763a2084ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.724510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76db3ed4-840a-425a-b5a8-78763a2084ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.725174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76db3ed4-840a-425a-b5a8-78763a2084ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.779510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:02.780098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:02.780764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lazy-loading 'fault' on Instance uuid ecdf01a8-2c04-4701-bac7-10c942466b5d {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:07:02.852794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:02.857111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:02.864291 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-604140a5-8576-4494-bf35-a2cf4bcebae7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 200 len: 1310 microversion: 2.1 time: 0.203280 Jul 26 20:07:02.866095 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2225/4512] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:02 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 1310 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:03.050223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-76db3ed4-840a-425a-b5a8-78763a2084ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:03.062623 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-76db3ed4-840a-425a-b5a8-78763a2084ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.365263 Jul 26 20:07:03.063206 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2288/4513] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:02 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:03.085032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87d95842-ae7a-41fd-a188-d784581b22e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:03.085164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87d95842-ae7a-41fd-a188-d784581b22e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:03.099485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d95842-ae7a-41fd-a188-d784581b22e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:03.099895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d95842-ae7a-41fd-a188-d784581b22e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:03.111590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d95842-ae7a-41fd-a188-d784581b22e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:03.112359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87d95842-ae7a-41fd-a188-d784581b22e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:03.557852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-87d95842-ae7a-41fd-a188-d784581b22e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:03.575446 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87d95842-ae7a-41fd-a188-d784581b22e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.495553 Jul 26 20:07:03.596489 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2226/4514] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:03 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:03.626007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4af3940-0dd2-4577-b104-c72761dcb79a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:03.628484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4af3940-0dd2-4577-b104-c72761dcb79a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:03.655873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4af3940-0dd2-4577-b104-c72761dcb79a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:03.657104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4af3940-0dd2-4577-b104-c72761dcb79a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:03.661000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4af3940-0dd2-4577-b104-c72761dcb79a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:03.661765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4af3940-0dd2-4577-b104-c72761dcb79a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:03.726372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:03.727246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:03.737376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:03.738218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:03.739752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:03.740822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:03.862146 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4af3940-0dd2-4577-b104-c72761dcb79a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.239782 Jul 26 20:07:03.868722 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2289/4515] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:07:03 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:07:03.874859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-020e17bf-ba52-406d-af27-3649f10366f0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:03.883716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-020e17bf-ba52-406d-af27-3649f10366f0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:03.899758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-020e17bf-ba52-406d-af27-3649f10366f0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:03.902095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-020e17bf-ba52-406d-af27-3649f10366f0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:03.903056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-020e17bf-ba52-406d-af27-3649f10366f0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:03.905170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-020e17bf-ba52-406d-af27-3649f10366f0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:03.961055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:03.977268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:03.978790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:03.980011 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d4101191-49fc-428e-8b07-17aca5b69805 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1365 microversion: 2.47 time: 0.259055 Jul 26 20:07:03.996517 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2227/4516] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:03 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:04.009705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:04.014118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:04.040822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:04.041205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:04.042007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:04.042450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:04.091269 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d HTTP/1.1 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ecdf01a8-2c04-4701-bac7-10c942466b5d'} Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:04.092996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:04.097652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:07:04.097652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:07:04.097652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:07:04.097652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:07:04.097652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:07:04.097652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:04.097652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:07:04.097652 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9de2467c-29d1-4117-9b2b-9db6fe416d8d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 404 len: 111 microversion: 2.1 time: 0.094457 Jul 26 20:07:04.107743 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2228/4517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:03 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:07:04.120185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6760b966-3323-47d2-9409-ff746355af47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: .version_select at 0x7f87682f55e0>, body: {"keypair": {"name": "tempest-key-13614025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWRzMc/eOnfVKyMPhYlumP1Cow5TObKn3IqjApIKIg90n/eP+qpfJG3oSBIvMs/S2V6R7kgXFkW0Lfmghpsa0k74vwEqbZMS8SaXzv90IQEeXA19UBEWj4Su7O05lMo3A=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:04.164451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-020e17bf-ba52-406d-af27-3649f10366f0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:04.174456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6760b966-3323-47d2-9409-ff746355af47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:07:04.175315 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-020e17bf-ba52-406d-af27-3649f10366f0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1672 microversion: 2.1 time: 0.304511 Jul 26 20:07:04.191641 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2290/4518] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:03 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1672 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:04.191960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6760b966-3323-47d2-9409-ff746355af47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:07:04.240201 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6760b966-3323-47d2-9409-ff746355af47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 380 microversion: 2.1 time: 0.131184 Jul 26 20:07:04.241321 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2229/4519] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:07:04 2022] POST /compute/v2.1/os-keypairs => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:04.252784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a170aa0-4c15-4bff-b947-b09eeced9158 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '.version_select at 0x7f87561b48b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:04.257240 n-d-708768-8 devstack@n-api.service[125964]: WARNING oslo_db.sqlalchemy.utils [None req-4a170aa0-4c15-4bff-b947-b09eeced9158 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 20:07:04.272362 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a170aa0-4c15-4bff-b947-b09eeced9158 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 349 microversion: 2.1 time: 0.020581 Jul 26 20:07:04.274175 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2291/4520] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 20:07:04 2022] GET /compute/v2.1/os-keypairs => generated 349 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:04.436553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1526007365", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-key-13614025", "networks": [{"uuid": "a0732ca0-0b24-4753-bcca-055b8f396991"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:04.537765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] validate_networks() for [('a0732ca0-0b24-4753-bcca-055b8f396991', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:07:05.031257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:05.032694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:05.045798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:05.048502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:05.049505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:05.052541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:05.216099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:05.226471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:05.228144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:05.229363 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad5db0f6-1f30-4104-a3fc-bd9753277e00 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1371 microversion: 2.47 time: 0.210045 Jul 26 20:07:05.243635 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2292/4521] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:05 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:05.243635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d85cde9b-7ef9-4f57-8dd9-10bbe4763ffc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:05.243635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d85cde9b-7ef9-4f57-8dd9-10bbe4763ffc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:05.249834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d85cde9b-7ef9-4f57-8dd9-10bbe4763ffc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:05.251805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d85cde9b-7ef9-4f57-8dd9-10bbe4763ffc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:05.252604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d85cde9b-7ef9-4f57-8dd9-10bbe4763ffc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:05.253042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d85cde9b-7ef9-4f57-8dd9-10bbe4763ffc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:05.257976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:05.530578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d85cde9b-7ef9-4f57-8dd9-10bbe4763ffc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:05.543232 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d85cde9b-7ef9-4f57-8dd9-10bbe4763ffc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1672 microversion: 2.1 time: 0.311791 Jul 26 20:07:05.543880 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2293/4522] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:05 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1672 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:06.024835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:07:06.027129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:07:06.028631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:07:06.029373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:07:06.030657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:07:06.066603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:06.067758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:06.071295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:06.072083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:06.122139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:07:06.128890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:07:06.139773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:06.144539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:07:06.146826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:07:06.194927 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5b4b34fd-ca21-4bc4-b200-4bf9fb4f2e4c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.762556 Jul 26 20:07:06.195868 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2230/4523] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:07:06.208028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c5bfc22-eaef-46bf-bf12-af7309eba4df tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:06.209104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0c5bfc22-eaef-46bf-bf12-af7309eba4df tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:06.259847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:06.260990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:06.268664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:06.269421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:06.271001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:06.271668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:06.299365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0c5bfc22-eaef-46bf-bf12-af7309eba4df tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:06.307794 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0c5bfc22-eaef-46bf-bf12-af7309eba4df tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1227 microversion: 2.1 time: 0.104353 Jul 26 20:07:06.308455 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2294/4524] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:06 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1227 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:06.385968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:06.394674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:06.396536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:06.398010 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-56a77fd9-c660-4d0f-a619-c2b62659a524 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1371 microversion: 2.47 time: 0.143342 Jul 26 20:07:06.398800 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2231/4525] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:06 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:06.567151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5febd897-7c20-4aab-8883-e8f6f38ffba5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:06.568309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5febd897-7c20-4aab-8883-e8f6f38ffba5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:06.577068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5febd897-7c20-4aab-8883-e8f6f38ffba5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:06.577699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5febd897-7c20-4aab-8883-e8f6f38ffba5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:06.580028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5febd897-7c20-4aab-8883-e8f6f38ffba5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:06.581287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5febd897-7c20-4aab-8883-e8f6f38ffba5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:06.786236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5febd897-7c20-4aab-8883-e8f6f38ffba5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:06.808377 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5febd897-7c20-4aab-8883-e8f6f38ffba5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1677 microversion: 2.1 time: 0.245745 Jul 26 20:07:06.811512 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2295/4526] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:06 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:07.333870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-edefbc69-38e8-43a0-b09e-fbee2182c484 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:07.334695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-edefbc69-38e8-43a0-b09e-fbee2182c484 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:07.344208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edefbc69-38e8-43a0-b09e-fbee2182c484 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.344669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edefbc69-38e8-43a0-b09e-fbee2182c484 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.346738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edefbc69-38e8-43a0-b09e-fbee2182c484 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.349766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edefbc69-38e8-43a0-b09e-fbee2182c484 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.432626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:07.434629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:07.450737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.454167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.456035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.456706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.475798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-edefbc69-38e8-43a0-b09e-fbee2182c484 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:07.484870 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-edefbc69-38e8-43a0-b09e-fbee2182c484 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1279 microversion: 2.1 time: 0.156358 Jul 26 20:07:07.485864 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2232/4527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:07 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:07.559464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:07.571731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:07.574659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:07.576069 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02dca707-5c48-4edc-a882-099ec4af68a1 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1356 microversion: 2.47 time: 0.158303 Jul 26 20:07:07.591060 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2296/4528] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:07 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:07.610836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:07.638364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:07.639358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Searching by: {'deleted': False, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:07:07.647989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.648562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.649435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.649989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.784682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:07:07.837738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9e25b58-2025-47bc-982a-69efc8c33058 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:07.838592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9e25b58-2025-47bc-982a-69efc8c33058 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:07.851237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9e25b58-2025-47bc-982a-69efc8c33058 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.852813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9e25b58-2025-47bc-982a-69efc8c33058 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.856262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9e25b58-2025-47bc-982a-69efc8c33058 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.856990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9e25b58-2025-47bc-982a-69efc8c33058 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.884332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:07.892884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:07.893371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:07.906381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:07.908553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:08.037851 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa8f2dd5-33fc-4632-a639-2b4213b49d7a tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.435172 Jul 26 20:07:08.039023 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2233/4529] 10.222.0.58 () {60 vars in 1187 bytes} [Tue Jul 26 20:07:07 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:08.071318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b170b987-6e8d-4a41-8488-a25005c69faf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:08.072137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b170b987-6e8d-4a41-8488-a25005c69faf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:08.078369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9e25b58-2025-47bc-982a-69efc8c33058 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:08.083986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b170b987-6e8d-4a41-8488-a25005c69faf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.084477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b170b987-6e8d-4a41-8488-a25005c69faf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.085313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b170b987-6e8d-4a41-8488-a25005c69faf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.088182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b170b987-6e8d-4a41-8488-a25005c69faf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.090580 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9e25b58-2025-47bc-982a-69efc8c33058 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.256589 Jul 26 20:07:08.091289 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2297/4530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:07 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:08.117552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d38946ff-cf65-4e2f-b622-900736df8c01 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:08.121106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d38946ff-cf65-4e2f-b622-900736df8c01 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:08.127826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b170b987-6e8d-4a41-8488-a25005c69faf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:07:08.128023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d38946ff-cf65-4e2f-b622-900736df8c01 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.128325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d38946ff-cf65-4e2f-b622-900736df8c01 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.129106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d38946ff-cf65-4e2f-b622-900736df8c01 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.129540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d38946ff-cf65-4e2f-b622-900736df8c01 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.190111 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d38946ff-cf65-4e2f-b622-900736df8c01 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 200 len: 322 microversion: 2.1 time: 0.078078 Jul 26 20:07:08.192799 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2298/4531] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:07:08 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 322 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:07:08.207656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bfc5e69a-284d-4ee0-a3b6-ed1e6f71f604 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:08.209140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bfc5e69a-284d-4ee0-a3b6-ed1e6f71f604 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:08.219866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfc5e69a-284d-4ee0-a3b6-ed1e6f71f604 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.220716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfc5e69a-284d-4ee0-a3b6-ed1e6f71f604 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.221710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfc5e69a-284d-4ee0-a3b6-ed1e6f71f604 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.222148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bfc5e69a-284d-4ee0-a3b6-ed1e6f71f604 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.258034 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b170b987-6e8d-4a41-8488-a25005c69faf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 204 len: 0 microversion: 2.47 time: 0.184276 Jul 26 20:07:08.266466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2234/4532] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:07:08 2022] DELETE /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:07:08.272962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:08.273783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:08.282170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.282759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.283663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.284181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.406969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:08.416871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:08.418403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:08.420231 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0b8b7b52-8374-425f-bb71-1c38eecf8c7c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1362 microversion: 2.47 time: 0.152227 Jul 26 20:07:08.433532 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2235/4533] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:08 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:08.506844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4dbe103-6e3e-4311-b323-40468c8d4c7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:08.507461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4dbe103-6e3e-4311-b323-40468c8d4c7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:08.515071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4dbe103-6e3e-4311-b323-40468c8d4c7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.515522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4dbe103-6e3e-4311-b323-40468c8d4c7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.521479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4dbe103-6e3e-4311-b323-40468c8d4c7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.523240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4dbe103-6e3e-4311-b323-40468c8d4c7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.569815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bfc5e69a-284d-4ee0-a3b6-ed1e6f71f604 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:08.577520 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bfc5e69a-284d-4ee0-a3b6-ed1e6f71f604 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.379800 Jul 26 20:07:08.581621 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2299/4534] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:08 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:08.601255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b8a102a6-a15c-48f1-a0bc-93741762501a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:08.602420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b8a102a6-a15c-48f1-a0bc-93741762501a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:08.612162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8a102a6-a15c-48f1-a0bc-93741762501a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.613128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8a102a6-a15c-48f1-a0bc-93741762501a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.614247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8a102a6-a15c-48f1-a0bc-93741762501a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.615095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8a102a6-a15c-48f1-a0bc-93741762501a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.710685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a4dbe103-6e3e-4311-b323-40468c8d4c7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:08.724538 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4dbe103-6e3e-4311-b323-40468c8d4c7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1285 microversion: 2.1 time: 0.221243 Jul 26 20:07:08.725626 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2236/4535] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:08 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:08.772260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b8a102a6-a15c-48f1-a0bc-93741762501a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:08.781877 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b8a102a6-a15c-48f1-a0bc-93741762501a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.184392 Jul 26 20:07:08.782749 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2300/4536] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:08 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:08.804335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a26478fc-6b57-490b-9a1c-351d2e952923 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:08.805088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a26478fc-6b57-490b-9a1c-351d2e952923 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:08.818284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26478fc-6b57-490b-9a1c-351d2e952923 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.819139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26478fc-6b57-490b-9a1c-351d2e952923 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:08.820757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26478fc-6b57-490b-9a1c-351d2e952923 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:08.821501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26478fc-6b57-490b-9a1c-351d2e952923 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:09.205241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a26478fc-6b57-490b-9a1c-351d2e952923 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:09.221517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a26478fc-6b57-490b-9a1c-351d2e952923 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.421141 Jul 26 20:07:09.222400 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2237/4537] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:08 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:09.243962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15ce9abd-1e4d-4ef3-a5b6-74c01a00ef2c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:09.245954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15ce9abd-1e4d-4ef3-a5b6-74c01a00ef2c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:09.255365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15ce9abd-1e4d-4ef3-a5b6-74c01a00ef2c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:09.256193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15ce9abd-1e4d-4ef3-a5b6-74c01a00ef2c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:09.257208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15ce9abd-1e4d-4ef3-a5b6-74c01a00ef2c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:09.257803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15ce9abd-1e4d-4ef3-a5b6-74c01a00ef2c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:09.449126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:09.451389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:09.493467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:09.494149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:09.495143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:09.496548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:09.587238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15ce9abd-1e4d-4ef3-a5b6-74c01a00ef2c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:09.603271 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15ce9abd-1e4d-4ef3-a5b6-74c01a00ef2c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.357920 Jul 26 20:07:09.647661 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2301/4538] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:09 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:09.703943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:09.722378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:09.724506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:09.736224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a884504b-fc78-40b2-8770-5b5503a5b5e6 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1362 microversion: 2.47 time: 0.295236 Jul 26 20:07:09.736830 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2238/4539] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:09 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:09.748973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0e20b808-f553-479e-a5a6-d1db49187579 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:09.749658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0e20b808-f553-479e-a5a6-d1db49187579 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:09.769900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e20b808-f553-479e-a5a6-d1db49187579 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:09.772061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e20b808-f553-479e-a5a6-d1db49187579 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:09.774617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e20b808-f553-479e-a5a6-d1db49187579 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:09.775303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e20b808-f553-479e-a5a6-d1db49187579 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:09.863663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-151957262", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "287d382c-eec4-43bb-95a9-783a796404b9"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:09.965439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] validate_networks() for [('287d382c-eec4-43bb-95a9-783a796404b9', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:07:10.533039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0e20b808-f553-479e-a5a6-d1db49187579 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:10.544842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0e20b808-f553-479e-a5a6-d1db49187579 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1327 microversion: 2.1 time: 0.800947 Jul 26 20:07:10.545481 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2302/4540] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:09 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1327 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:10.764323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:10.764953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:10.770527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:10.773337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:10.773997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:10.774971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:10.775566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:10.863084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:10.863831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:10.864509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lazy-loading 'fault' on Instance uuid e9b16a44-5252-4ad4-8971-68e67b858025 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:07:10.960203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:10.974961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:10.980578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:10.982872 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-013d391b-d84e-4f06-b9c4-00fdcab4a58d tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 200 len: 1367 microversion: 2.47 time: 0.222251 Jul 26 20:07:10.984036 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2303/4541] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:10 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:11.305385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:07:11.306011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:07:11.306510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:07:11.307166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:07:11.307842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:07:11.326814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:11.330542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:11.331704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:11.332255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:11.375073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:07:11.383027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for user 4418a0cb57744aa5a56a3fdcce0947cc and project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:07:11.400407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:07:11.402711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:07:11.467704 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9b4675d1-62c1-4eb4-af69-4785b917218d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609290 Jul 26 20:07:11.475846 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2239/4542] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:07:11.480292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4aa4419c-5bda-4bf3-b0bb-e18b0a48f693 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:11.480979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4aa4419c-5bda-4bf3-b0bb-e18b0a48f693 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:11.543161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5cfc91b3-12ad-4fce-94a3-7711e7e16015 req-83c8b4a1-f117-4427-8355-bbef298b4f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "789846fe-4990-42d5-b4d2-a6e1e0bf35a0", "tag": "388c4503-d2f5-4ad4-8e86-4ac0ae287c8e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:11.566704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cfc91b3-12ad-4fce-94a3-7711e7e16015 req-83c8b4a1-f117-4427-8355-bbef298b4f13 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:11.567335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cfc91b3-12ad-4fce-94a3-7711e7e16015 req-83c8b4a1-f117-4427-8355-bbef298b4f13 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:11.586897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4aa4419c-5bda-4bf3-b0bb-e18b0a48f693 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:11.596183 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4aa4419c-5bda-4bf3-b0bb-e18b0a48f693 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1214 microversion: 2.1 time: 0.119626 Jul 26 20:07:11.599843 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5cfc91b3-12ad-4fce-94a3-7711e7e16015 req-83c8b4a1-f117-4427-8355-bbef298b4f13 service nova] Creating event network-changed:388c4503-d2f5-4ad4-8e86-4ac0ae287c8e for instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 on n-h1-708768-8 Jul 26 20:07:11.612661 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5cfc91b3-12ad-4fce-94a3-7711e7e16015 req-83c8b4a1-f117-4427-8355-bbef298b4f13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073609 Jul 26 20:07:11.613523 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2240/4543] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:07:11.614707 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2304/4544] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:11 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:11.619768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cb4e8e34-21e5-4ed8-bc4d-aadefd8f3e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:11.620683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cb4e8e34-21e5-4ed8-bc4d-aadefd8f3e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:11.630230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb4e8e34-21e5-4ed8-bc4d-aadefd8f3e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:11.631186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb4e8e34-21e5-4ed8-bc4d-aadefd8f3e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:11.632762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb4e8e34-21e5-4ed8-bc4d-aadefd8f3e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:11.633369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb4e8e34-21e5-4ed8-bc4d-aadefd8f3e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:11.969359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cb4e8e34-21e5-4ed8-bc4d-aadefd8f3e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:11.981318 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cb4e8e34-21e5-4ed8-bc4d-aadefd8f3e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1327 microversion: 2.1 time: 0.366273 Jul 26 20:07:11.982308 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2241/4545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:11 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1327 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:12.012852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:12.013461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: e9b16a44-5252-4ad4-8971-68e67b858025] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:12.032525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:12.032993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:12.033817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:12.035505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:12.059684 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] HTTP exception thrown: Instance e9b16a44-5252-4ad4-8971-68e67b858025 could not be found. Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Request method failure captured: Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 HTTP/1.1 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ElBx-NxAVZo1OuMhxS_WhW5RkfA0ol7diwUQMN2zQ14Of-Q_ix6ZaSe10fsd5Ys1FXuFVqIYDVs1TzvoaZC9_jZZBMxwi_gNA55rCdwTCJ0SdBk7QurGJzxoSFHkSk2FJAiaJcAWo8gbujCNZb7IJDTrC4C8BDjsAsrcwiq4T09gSM Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: dca6ca88f6274fcbb1dad35af2920d41 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerShowV247Test-1334737912 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dca6ca88f6274fcbb1dad35af2920d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dca6ca88f6274fcbb1dad35af2920d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dca6ca88f6274fcbb1dad35af2920d41", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dca6ca88f6274fcbb1dad35af2920d41"}]}] Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerShowV247Test-1334737912 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: dca6ca88f6274fcbb1dad35af2920d41 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerShowV247Test-1334737912 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerShowV247Test-1334737912-project Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 6ea7cb75c24d414798cb5b0775895505 Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerShowV247Test-1334737912-project Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance e9b16a44-5252-4ad4-8971-68e67b858025 could not be found. Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'e9b16a44-5252-4ad4-8971-68e67b858025'} Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b16a44-5252-4ad4-8971-68e67b858025 could not be found. Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b16a44-5252-4ad4-8971-68e67b858025 could not be found. Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:07:12.061561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:12.067439 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:12.067439 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:07:12.067439 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:07:12.067439 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:07:12.067439 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:07:12.067439 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b16a44-5252-4ad4-8971-68e67b858025 could not be found. Jul 26 20:07:12.067439 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:12.068911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Returning 404 to user: Instance e9b16a44-5252-4ad4-8971-68e67b858025 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:07:12.069983 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f91017f8-91ba-4826-9691-a26dc030b3ea tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025" status: 404 len: 111 microversion: 2.47 time: 0.061220 Jul 26 20:07:12.071142 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2305/4546] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:12 2022] GET /compute/v2.1/servers/e9b16a44-5252-4ad4-8971-68e67b858025 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:07:12.082462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-abbb0035-c4aa-466f-8a81-02118fd2d47c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:12.083667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-abbb0035-c4aa-466f-8a81-02118fd2d47c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: f50c59d6-e429-4d55-bdd2-6d03c5446a3f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:12.092902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abbb0035-c4aa-466f-8a81-02118fd2d47c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:12.093597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abbb0035-c4aa-466f-8a81-02118fd2d47c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:12.094646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abbb0035-c4aa-466f-8a81-02118fd2d47c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:12.096495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abbb0035-c4aa-466f-8a81-02118fd2d47c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:12.127166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-abbb0035-c4aa-466f-8a81-02118fd2d47c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: f50c59d6-e429-4d55-bdd2-6d03c5446a3f] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:07:12.183672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:12.247600 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-abbb0035-c4aa-466f-8a81-02118fd2d47c tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f" status: 204 len: 0 microversion: 2.47 time: 0.172259 Jul 26 20:07:12.248239 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2242/4547] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:07:12 2022] DELETE /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:07:12.257510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:12.258639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: f50c59d6-e429-4d55-bdd2-6d03c5446a3f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:12.271003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:12.271451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:12.272252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:12.272684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:12.392008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:12.401672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:12.403463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:12.404995 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6a5cae0c-bf9d-42d7-b35c-237a649449bf tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f" status: 200 len: 1362 microversion: 2.47 time: 0.151992 Jul 26 20:07:12.405889 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2306/4548] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:12 2022] GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:12.621507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab225086-7455-4636-bfd5-740acf288847 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:12.622402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab225086-7455-4636-bfd5-740acf288847 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:12.634381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab225086-7455-4636-bfd5-740acf288847 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:12.634722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab225086-7455-4636-bfd5-740acf288847 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:12.637753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab225086-7455-4636-bfd5-740acf288847 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:12.638582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab225086-7455-4636-bfd5-740acf288847 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:12.748656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab225086-7455-4636-bfd5-740acf288847 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:12.763295 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab225086-7455-4636-bfd5-740acf288847 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1266 microversion: 2.1 time: 0.143753 Jul 26 20:07:12.778586 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2243/4549] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:12 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:13.003548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c75f1b32-648b-4263-ba71-7590843f16af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:13.004608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c75f1b32-648b-4263-ba71-7590843f16af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:13.014599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c75f1b32-648b-4263-ba71-7590843f16af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:13.015199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c75f1b32-648b-4263-ba71-7590843f16af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:13.016526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c75f1b32-648b-4263-ba71-7590843f16af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:13.017042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c75f1b32-648b-4263-ba71-7590843f16af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:13.286164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c75f1b32-648b-4263-ba71-7590843f16af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:13.294918 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c75f1b32-648b-4263-ba71-7590843f16af tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1327 microversion: 2.1 time: 0.296070 Jul 26 20:07:13.295946 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2307/4550] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:12 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1327 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:13.435248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:13.436318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: f50c59d6-e429-4d55-bdd2-6d03c5446a3f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:13.458827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:13.459379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:13.460321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:13.460854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:13.576751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:13.586813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:13.588682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:13.590170 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3d07103-c6e8-43ea-a2d5-e340fd287e73 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f" status: 200 len: 1362 microversion: 2.47 time: 0.160264 Jul 26 20:07:13.590741 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2244/4551] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:13 2022] GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:13.790061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-40c2d01e-294d-4a15-96af-0a4a12b0e43b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:13.790841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40c2d01e-294d-4a15-96af-0a4a12b0e43b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:13.799918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40c2d01e-294d-4a15-96af-0a4a12b0e43b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:13.800430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40c2d01e-294d-4a15-96af-0a4a12b0e43b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:13.801560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40c2d01e-294d-4a15-96af-0a4a12b0e43b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:13.802177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40c2d01e-294d-4a15-96af-0a4a12b0e43b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:13.916462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-40c2d01e-294d-4a15-96af-0a4a12b0e43b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:13.938214 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-40c2d01e-294d-4a15-96af-0a4a12b0e43b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1284 microversion: 2.1 time: 0.152190 Jul 26 20:07:13.965271 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2308/4552] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:13 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:14.318921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24f80d6b-ed9e-4773-9b47-4f1fe53f283b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:14.319556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-24f80d6b-ed9e-4773-9b47-4f1fe53f283b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:14.332283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24f80d6b-ed9e-4773-9b47-4f1fe53f283b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:14.332733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24f80d6b-ed9e-4773-9b47-4f1fe53f283b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:14.338649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24f80d6b-ed9e-4773-9b47-4f1fe53f283b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:14.341141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24f80d6b-ed9e-4773-9b47-4f1fe53f283b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:14.614589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:14.616218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: f50c59d6-e429-4d55-bdd2-6d03c5446a3f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:14.631082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:14.643074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:14.647187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:14.648741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:14.703553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24f80d6b-ed9e-4773-9b47-4f1fe53f283b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:14.723130 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-24f80d6b-ed9e-4773-9b47-4f1fe53f283b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1327 microversion: 2.1 time: 0.404732 Jul 26 20:07:14.739594 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2245/4553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:14 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:14.755456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:14.756277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:14.756898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lazy-loading 'fault' on Instance uuid f50c59d6-e429-4d55-bdd2-6d03c5446a3f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:07:14.918542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:14.928609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:14.933281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ea7cb75c24d414798cb5b0775895505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6ca88f6274fcbb1dad35af2920d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:14.936050 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd865a81-ffdd-408e-9646-ecb1181e03f3 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f" status: 200 len: 1367 microversion: 2.47 time: 0.324376 Jul 26 20:07:14.939257 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2309/4554] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:14 2022] GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:14.974347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f8f1dc1-9543-4dc9-8602-c6d6dd9c6fc7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:14.975171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1f8f1dc1-9543-4dc9-8602-c6d6dd9c6fc7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:14.987741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f8f1dc1-9543-4dc9-8602-c6d6dd9c6fc7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:14.988896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f8f1dc1-9543-4dc9-8602-c6d6dd9c6fc7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:14.992153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f8f1dc1-9543-4dc9-8602-c6d6dd9c6fc7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:14.993007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f8f1dc1-9543-4dc9-8602-c6d6dd9c6fc7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:15.409075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1f8f1dc1-9543-4dc9-8602-c6d6dd9c6fc7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:15.425170 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1f8f1dc1-9543-4dc9-8602-c6d6dd9c6fc7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1314 microversion: 2.1 time: 0.455943 Jul 26 20:07:15.426431 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2246/4555] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:14 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:15.756528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-efae2223-dcf5-4539-b316-37f30a93cbe7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:15.758024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-efae2223-dcf5-4539-b316-37f30a93cbe7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:15.780274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efae2223-dcf5-4539-b316-37f30a93cbe7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:15.781883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efae2223-dcf5-4539-b316-37f30a93cbe7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:15.783339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efae2223-dcf5-4539-b316-37f30a93cbe7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:15.786541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-efae2223-dcf5-4539-b316-37f30a93cbe7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:15.974367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:15.976985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] [instance: f50c59d6-e429-4d55-bdd2-6d03c5446a3f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:16.004924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:16.033771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:16.044188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:16.044715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:16.077536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] HTTP exception thrown: Instance f50c59d6-e429-4d55-bdd2-6d03c5446a3f could not be found. Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Request method failure captured: Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f HTTP/1.1 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ElBx-NxAVZo1OuMhxS_WhW5RkfA0ol7diwUQMN2zQ14Of-Q_ix6ZaSe10fsd5Ys1FXuFVqIYDVs1TzvoaZC9_jZZBMxwi_gNA55rCdwTCJ0SdBk7QurGJzxoSFHkSk2FJAiaJcAWo8gbujCNZb7IJDTrC4C8BDjsAsrcwiq4T09gSM Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: dca6ca88f6274fcbb1dad35af2920d41 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerShowV247Test-1334737912 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dca6ca88f6274fcbb1dad35af2920d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dca6ca88f6274fcbb1dad35af2920d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dca6ca88f6274fcbb1dad35af2920d41", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dca6ca88f6274fcbb1dad35af2920d41"}]}] Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerShowV247Test-1334737912 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: dca6ca88f6274fcbb1dad35af2920d41 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerShowV247Test-1334737912 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerShowV247Test-1334737912-project Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6ea7cb75c24d414798cb5b0775895505 Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerShowV247Test-1334737912-project Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f50c59d6-e429-4d55-bdd2-6d03c5446a3f could not be found. Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f50c59d6-e429-4d55-bdd2-6d03c5446a3f'} Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f50c59d6-e429-4d55-bdd2-6d03c5446a3f could not be found. Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f50c59d6-e429-4d55-bdd2-6d03c5446a3f could not be found. Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:07:16.087751 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f50c59d6-e429-4d55-bdd2-6d03c5446a3f could not be found. Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] Returning 404 to user: Instance f50c59d6-e429-4d55-bdd2-6d03c5446a3f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:07:16.093640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-57e33189-a2ac-4972-be6c-1d0e108c6e27 tempest-ServerShowV247Test-1334737912 tempest-ServerShowV247Test-1334737912-project] 10.222.0.58 "GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f" status: 404 len: 111 microversion: 2.47 time: 0.121736 Jul 26 20:07:16.101319 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2247/4556] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:15 2022] GET /compute/v2.1/servers/f50c59d6-e429-4d55-bdd2-6d03c5446a3f => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:07:16.472613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-99c85bad-96df-41cc-a6b3-8c87aa856a50 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:16.473942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-99c85bad-96df-41cc-a6b3-8c87aa856a50 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:16.496186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99c85bad-96df-41cc-a6b3-8c87aa856a50 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:16.497298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99c85bad-96df-41cc-a6b3-8c87aa856a50 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:16.498391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99c85bad-96df-41cc-a6b3-8c87aa856a50 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:16.501503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99c85bad-96df-41cc-a6b3-8c87aa856a50 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:17.073622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-efae2223-dcf5-4539-b316-37f30a93cbe7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:17.100502 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-efae2223-dcf5-4539-b316-37f30a93cbe7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1327 microversion: 2.1 time: 1.346129 Jul 26 20:07:17.101770 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2310/4557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:15 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1327 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:17.118080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0395c747-edb0-43a9-895e-f2e37b2b181b req-7852e601-fc25-489b-bde5-f2f512a08de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ef8d1f-c0c1-4b1f-a908-09102859835e", "tag": "bbac3cdb-be24-4743-a2e5-f91c5e1ef660"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:17.138942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0395c747-edb0-43a9-895e-f2e37b2b181b req-7852e601-fc25-489b-bde5-f2f512a08de0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:17.145159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0395c747-edb0-43a9-895e-f2e37b2b181b req-7852e601-fc25-489b-bde5-f2f512a08de0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:17.176934 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0395c747-edb0-43a9-895e-f2e37b2b181b req-7852e601-fc25-489b-bde5-f2f512a08de0 service nova] Creating event network-changed:bbac3cdb-be24-4743-a2e5-f91c5e1ef660 for instance 17ef8d1f-c0c1-4b1f-a908-09102859835e on n-h2-708768-8 Jul 26 20:07:17.192813 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0395c747-edb0-43a9-895e-f2e37b2b181b req-7852e601-fc25-489b-bde5-f2f512a08de0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083709 Jul 26 20:07:17.195040 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2311/4558] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:17.512897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-99c85bad-96df-41cc-a6b3-8c87aa856a50 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:17.527547 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-99c85bad-96df-41cc-a6b3-8c87aa856a50 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1314 microversion: 2.1 time: 1.081574 Jul 26 20:07:17.528889 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2248/4559] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:16 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:18.115451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5c70704e-ba30-4354-9b50-bdadaa82604e req-de9f6cf7-a2fb-43e8-b41d-c8451f9486fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789846fe-4990-42d5-b4d2-a6e1e0bf35a0", "name": "network-vif-plugged", "status": "completed", "tag": "388c4503-d2f5-4ad4-8e86-4ac0ae287c8e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:18.123310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cb653c4f-6a74-4f5d-8e88-733a9ea14765 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:18.124275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cb653c4f-6a74-4f5d-8e88-733a9ea14765 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:18.137979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5c70704e-ba30-4354-9b50-bdadaa82604e req-de9f6cf7-a2fb-43e8-b41d-c8451f9486fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:18.139327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb653c4f-6a74-4f5d-8e88-733a9ea14765 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:18.140014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5c70704e-ba30-4354-9b50-bdadaa82604e req-de9f6cf7-a2fb-43e8-b41d-c8451f9486fe service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:18.140454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb653c4f-6a74-4f5d-8e88-733a9ea14765 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:18.142398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb653c4f-6a74-4f5d-8e88-733a9ea14765 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:18.144038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cb653c4f-6a74-4f5d-8e88-733a9ea14765 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:18.166462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5c70704e-ba30-4354-9b50-bdadaa82604e req-de9f6cf7-a2fb-43e8-b41d-c8451f9486fe service nova] Creating event network-vif-plugged:388c4503-d2f5-4ad4-8e86-4ac0ae287c8e for instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 on n-h1-708768-8 Jul 26 20:07:18.185008 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5c70704e-ba30-4354-9b50-bdadaa82604e req-de9f6cf7-a2fb-43e8-b41d-c8451f9486fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073796 Jul 26 20:07:18.186283 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2312/4560] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:18.550907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-737a205a-b47e-4b53-b7f9-1fa06f0df5eb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:18.551807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-737a205a-b47e-4b53-b7f9-1fa06f0df5eb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:18.580658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-737a205a-b47e-4b53-b7f9-1fa06f0df5eb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:18.581109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-737a205a-b47e-4b53-b7f9-1fa06f0df5eb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:18.581898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-737a205a-b47e-4b53-b7f9-1fa06f0df5eb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:18.592168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-737a205a-b47e-4b53-b7f9-1fa06f0df5eb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:18.645555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:18.799555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cb653c4f-6a74-4f5d-8e88-733a9ea14765 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:18.811900 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cb653c4f-6a74-4f5d-8e88-733a9ea14765 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1327 microversion: 2.1 time: 0.692621 Jul 26 20:07:18.819133 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2249/4561] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:18 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1327 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:18.944074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-737a205a-b47e-4b53-b7f9-1fa06f0df5eb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:18.951695 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-737a205a-b47e-4b53-b7f9-1fa06f0df5eb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1314 microversion: 2.1 time: 0.405015 Jul 26 20:07:18.963532 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2313/4562] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:18 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:19.841129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eff0cc3b-0761-47b4-b56e-a39bff374e33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:19.842908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eff0cc3b-0761-47b4-b56e-a39bff374e33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:19.866657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eff0cc3b-0761-47b4-b56e-a39bff374e33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:19.867300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eff0cc3b-0761-47b4-b56e-a39bff374e33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:19.869142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eff0cc3b-0761-47b4-b56e-a39bff374e33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:19.869757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eff0cc3b-0761-47b4-b56e-a39bff374e33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:20.226952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eff0cc3b-0761-47b4-b56e-a39bff374e33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:20.242856 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eff0cc3b-0761-47b4-b56e-a39bff374e33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1327 microversion: 2.1 time: 0.407242 Jul 26 20:07:20.243464 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2250/4563] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:19 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1327 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:20.254100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-729c68ca-193c-4237-987c-295c0f6ae2ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:20.254733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-729c68ca-193c-4237-987c-295c0f6ae2ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:20.256536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-193509893", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": "none"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:20.270610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-729c68ca-193c-4237-987c-295c0f6ae2ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:20.271062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-729c68ca-193c-4237-987c-295c0f6ae2ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:20.275083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-729c68ca-193c-4237-987c-295c0f6ae2ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:20.277073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-729c68ca-193c-4237-987c-295c0f6ae2ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:20.348709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:07:20.349141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:07:20.349617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:07:20.350269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:07:20.350414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:07:20.369504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:20.369958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:20.372944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:20.375001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:20.421717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Getting quotas for project 0378c24951ef4c32ad73264456f0cec8. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:07:20.430097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Getting quotas for user 7065c7efba154a1bbc0d543eb39543cc and project 0378c24951ef4c32ad73264456f0cec8. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:07:20.447325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:07:20.450816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:07:20.512292 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-051dbc26-4332-4115-9601-f4aec73d8dd1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.642230 Jul 26 20:07:20.513397 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2314/4564] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Jul 26 20:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 20:07:20.528810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee166637-70b9-41c4-94da-abb108d966bf tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:20.531084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ee166637-70b9-41c4-94da-abb108d966bf tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:20.635658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ee166637-70b9-41c4-94da-abb108d966bf tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:20.650809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ee166637-70b9-41c4-94da-abb108d966bf tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:20.653384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ee166637-70b9-41c4-94da-abb108d966bf tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:20.655191 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ee166637-70b9-41c4-94da-abb108d966bf tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1277 microversion: 2.57 time: 0.132511 Jul 26 20:07:20.667892 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2315/4565] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:20 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:20.711169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-729c68ca-193c-4237-987c-295c0f6ae2ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:20.734851 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-729c68ca-193c-4237-987c-295c0f6ae2ed tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1314 microversion: 2.1 time: 0.486824 Jul 26 20:07:20.738987 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2251/4566] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:20 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:21.265452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-306a0052-6d09-4fdb-b1cf-632676f0d55f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:21.266831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-306a0052-6d09-4fdb-b1cf-632676f0d55f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:21.284246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-306a0052-6d09-4fdb-b1cf-632676f0d55f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:21.288377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-306a0052-6d09-4fdb-b1cf-632676f0d55f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:21.289814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-306a0052-6d09-4fdb-b1cf-632676f0d55f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:21.290372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-306a0052-6d09-4fdb-b1cf-632676f0d55f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:21.508391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-306a0052-6d09-4fdb-b1cf-632676f0d55f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:21.524387 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-306a0052-6d09-4fdb-b1cf-632676f0d55f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1509 microversion: 2.1 time: 0.262580 Jul 26 20:07:21.524994 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2316/4567] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:21 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:21.551650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-36f778b2-9e09-4367-a09b-a7554e3c3de7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:21.552277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-36f778b2-9e09-4367-a09b-a7554e3c3de7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:21.556343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:21.559500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=18 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:21.582191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36f778b2-9e09-4367-a09b-a7554e3c3de7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:21.582648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36f778b2-9e09-4367-a09b-a7554e3c3de7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:21.583464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36f778b2-9e09-4367-a09b-a7554e3c3de7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:21.583972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36f778b2-9e09-4367-a09b-a7554e3c3de7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:21.690887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:21.691926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:21.723554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:21.729895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:21.730876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:21.734975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:21.877398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:21.901104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:21.904348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:21.906328 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-211447ec-17cd-4740-8dcf-202fbdb85b06 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1329 microversion: 2.57 time: 0.219701 Jul 26 20:07:21.908727 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2317/4568] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:21 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1329 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:21.919462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d33fcd8-2381-4f11-aff8-18b22af164d4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:21.922408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d33fcd8-2381-4f11-aff8-18b22af164d4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:21.943850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d33fcd8-2381-4f11-aff8-18b22af164d4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:21.944572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d33fcd8-2381-4f11-aff8-18b22af164d4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:21.946361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d33fcd8-2381-4f11-aff8-18b22af164d4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:21.946977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d33fcd8-2381-4f11-aff8-18b22af164d4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:21.989524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-36f778b2-9e09-4367-a09b-a7554e3c3de7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:22.008646 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-36f778b2-9e09-4367-a09b-a7554e3c3de7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1509 microversion: 2.1 time: 0.464906 Jul 26 20:07:22.013658 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2252/4569] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:21 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:22.036181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3edd7a9-cef1-4c50-b205-9df7d8237f76 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:22.037927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3edd7a9-cef1-4c50-b205-9df7d8237f76 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:22.051083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3edd7a9-cef1-4c50-b205-9df7d8237f76 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:22.051817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3edd7a9-cef1-4c50-b205-9df7d8237f76 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:22.052882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3edd7a9-cef1-4c50-b205-9df7d8237f76 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:22.054528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3edd7a9-cef1-4c50-b205-9df7d8237f76 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:22.102646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3edd7a9-cef1-4c50-b205-9df7d8237f76 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:07:22.318151 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3edd7a9-cef1-4c50-b205-9df7d8237f76 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 204 len: 0 microversion: 2.1 time: 0.286322 Jul 26 20:07:22.322021 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2253/4570] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:07:22 2022] DELETE /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:07:22.336348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60bec3e1-065f-4a8a-96c3-8d797425da8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:22.338933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60bec3e1-065f-4a8a-96c3-8d797425da8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:22.353277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60bec3e1-065f-4a8a-96c3-8d797425da8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:22.353911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60bec3e1-065f-4a8a-96c3-8d797425da8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:22.366396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60bec3e1-065f-4a8a-96c3-8d797425da8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:22.366927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60bec3e1-065f-4a8a-96c3-8d797425da8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:22.470636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d33fcd8-2381-4f11-aff8-18b22af164d4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:22.483336 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d33fcd8-2381-4f11-aff8-18b22af164d4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1314 microversion: 2.1 time: 0.569280 Jul 26 20:07:22.484781 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2318/4571] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:21 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:22.733679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60bec3e1-065f-4a8a-96c3-8d797425da8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:22.751284 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60bec3e1-065f-4a8a-96c3-8d797425da8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1515 microversion: 2.1 time: 0.423445 Jul 26 20:07:22.752040 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2254/4572] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:22 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1515 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:22.932344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:22.933068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:22.945497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:22.947841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:22.948730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:22.949249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:23.133263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:23.154186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:23.156803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:23.160713 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-91e428a9-c165-4be5-9744-dc9cfee5d1c5 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1335 microversion: 2.57 time: 0.232396 Jul 26 20:07:23.161302 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2319/4573] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:22 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1335 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:23.510794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-20cbd1e6-799a-438c-bc05-57124a89672a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:23.511733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-20cbd1e6-799a-438c-bc05-57124a89672a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:23.534222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20cbd1e6-799a-438c-bc05-57124a89672a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:23.543260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20cbd1e6-799a-438c-bc05-57124a89672a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:23.544310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20cbd1e6-799a-438c-bc05-57124a89672a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:23.548332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20cbd1e6-799a-438c-bc05-57124a89672a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:23.773510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5801308-52dd-4c78-ad1a-9aea23712b60 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:23.774141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5801308-52dd-4c78-ad1a-9aea23712b60 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:23.781862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5801308-52dd-4c78-ad1a-9aea23712b60 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:23.789827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5801308-52dd-4c78-ad1a-9aea23712b60 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:23.799396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5801308-52dd-4c78-ad1a-9aea23712b60 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:23.800782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5801308-52dd-4c78-ad1a-9aea23712b60 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:23.974885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-20cbd1e6-799a-438c-bc05-57124a89672a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:24.001664 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-20cbd1e6-799a-438c-bc05-57124a89672a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1314 microversion: 2.1 time: 0.499389 Jul 26 20:07:24.003697 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2255/4574] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:23 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:24.098093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d5801308-52dd-4c78-ad1a-9aea23712b60 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:24.112493 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5801308-52dd-4c78-ad1a-9aea23712b60 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1515 microversion: 2.1 time: 0.343146 Jul 26 20:07:24.113098 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2320/4575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:23 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1515 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:24.142134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e1ddf2b0-2e41-40d0-a7c7-3cd4c29c25cd req-58bc88c9-1919-4b39-b854-40e9980baa0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ef8d1f-c0c1-4b1f-a908-09102859835e", "name": "network-vif-plugged", "status": "completed", "tag": "bbac3cdb-be24-4743-a2e5-f91c5e1ef660"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:24.154079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e1ddf2b0-2e41-40d0-a7c7-3cd4c29c25cd req-58bc88c9-1919-4b39-b854-40e9980baa0f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:24.154817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e1ddf2b0-2e41-40d0-a7c7-3cd4c29c25cd req-58bc88c9-1919-4b39-b854-40e9980baa0f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:24.167935 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e1ddf2b0-2e41-40d0-a7c7-3cd4c29c25cd req-58bc88c9-1919-4b39-b854-40e9980baa0f service nova] Creating event network-vif-plugged:bbac3cdb-be24-4743-a2e5-f91c5e1ef660 for instance 17ef8d1f-c0c1-4b1f-a908-09102859835e on n-h2-708768-8 Jul 26 20:07:24.175809 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e1ddf2b0-2e41-40d0-a7c7-3cd4c29c25cd req-58bc88c9-1919-4b39-b854-40e9980baa0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039337 Jul 26 20:07:24.176517 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2256/4576] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:24.185141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:24.185795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:24.197856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:24.199883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:24.200839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:24.201358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:24.331897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:24.345288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:24.352557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:24.356024 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e8660dd2-e95b-4dbf-af8d-79744b6c3042 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1335 microversion: 2.57 time: 0.172699 Jul 26 20:07:24.357351 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2321/4577] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:24 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:25.040425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7cbfdd05-db24-4d32-8eed-1d212e36443e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:25.041710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7cbfdd05-db24-4d32-8eed-1d212e36443e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:25.060722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cbfdd05-db24-4d32-8eed-1d212e36443e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.061177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cbfdd05-db24-4d32-8eed-1d212e36443e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.061977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cbfdd05-db24-4d32-8eed-1d212e36443e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.062476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cbfdd05-db24-4d32-8eed-1d212e36443e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.135279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bff9bc3e-aa0c-4ef2-a105-b1e49c2e6e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:25.135968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bff9bc3e-aa0c-4ef2-a105-b1e49c2e6e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:25.153069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bff9bc3e-aa0c-4ef2-a105-b1e49c2e6e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.159369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bff9bc3e-aa0c-4ef2-a105-b1e49c2e6e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.161033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bff9bc3e-aa0c-4ef2-a105-b1e49c2e6e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.163479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bff9bc3e-aa0c-4ef2-a105-b1e49c2e6e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.315077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bff9bc3e-aa0c-4ef2-a105-b1e49c2e6e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:25.328876 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bff9bc3e-aa0c-4ef2-a105-b1e49c2e6e45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 200 len: 1473 microversion: 2.1 time: 0.198074 Jul 26 20:07:25.329615 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2322/4578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:25 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 1473 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:25.340302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7e5eb765-854f-453a-a24d-835aeca7631d req-0a2145c0-5c82-4129-8f8f-5e7cdf6d765a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789846fe-4990-42d5-b4d2-a6e1e0bf35a0", "name": "network-vif-deleted", "tag": "388c4503-d2f5-4ad4-8e86-4ac0ae287c8e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:25.363591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7e5eb765-854f-453a-a24d-835aeca7631d req-0a2145c0-5c82-4129-8f8f-5e7cdf6d765a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.364527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7e5eb765-854f-453a-a24d-835aeca7631d req-0a2145c0-5c82-4129-8f8f-5e7cdf6d765a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.379040 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7e5eb765-854f-453a-a24d-835aeca7631d req-0a2145c0-5c82-4129-8f8f-5e7cdf6d765a service nova] Creating event network-vif-deleted:388c4503-d2f5-4ad4-8e86-4ac0ae287c8e for instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 on n-h1-708768-8 Jul 26 20:07:25.386975 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7e5eb765-854f-453a-a24d-835aeca7631d req-0a2145c0-5c82-4129-8f8f-5e7cdf6d765a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055952 Jul 26 20:07:25.387726 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2323/4579] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:25.393811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:25.394522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:25.401485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.402356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.403316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.403988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.491021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:25.502503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:25.504087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:25.505298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1488c955-f2ab-4401-8dab-ab45929e4bb6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1356 microversion: 2.57 time: 0.116261 Jul 26 20:07:25.506469 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2324/4580] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:25 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:25.534397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:25.537808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:25.545075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.545970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.547183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.547812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.664424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:07:25.664850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:07:25.677457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:07:25.677974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:07:25.678503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:07:25.784741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:25.799545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.800049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.801773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.802739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.873183 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-578606d4-f937-48e2-9a30-e7b890d6e05e tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "POST /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019/action" status: 202 len: 1137 microversion: 2.57 time: 0.343652 Jul 26 20:07:25.880043 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2325/4581] 10.222.0.58 () {62 vars in 1320 bytes} [Tue Jul 26 20:07:25 2022] POST /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019/action => generated 1137 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 20:07:25.906296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:25.909019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:25.925933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.926403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:25.927167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:25.927604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:26.051075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:26.073445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:26.077026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:26.078715 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-edd69a88-6fbb-4d3c-8750-f84d084301b6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.179754 Jul 26 20:07:26.079980 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2326/4582] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:25 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:26.115157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7cbfdd05-db24-4d32-8eed-1d212e36443e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:26.123361 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7cbfdd05-db24-4d32-8eed-1d212e36443e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1314 microversion: 2.1 time: 1.088603 Jul 26 20:07:26.124551 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2257/4583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:25 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:26.351267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:26.352536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:26.364965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:26.365407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:26.366203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:26.369390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:26.391072 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 HTTP/1.1 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '789846fe-4990-42d5-b4d2-a6e1e0bf35a0'} Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:26.396241 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:07:26.401676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:07:26.401676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:07:26.401676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:07:26.401676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:07:26.401676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:07:26.401676 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:07:26.404556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:07:26.405639 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0c4e1c53-8d21-44b1-a9c9-8568e51e5b2d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 404 len: 111 microversion: 2.1 time: 0.058512 Jul 26 20:07:26.410036 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2327/4584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:26 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:07:26.416072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f6f653f-38c7-4667-bd6e-e536ee1db5c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '.version_select at 0x7f87682d9940>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:26.450061 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1f6f653f-38c7-4667-bd6e-e536ee1db5c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-key-13614025" status: 202 len: 0 microversion: 2.1 time: 0.038545 Jul 26 20:07:26.450973 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2258/4585] 10.222.0.58 () {58 vars in 1203 bytes} [Tue Jul 26 20:07:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-13614025 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:07:26.631250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1807887537", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "a0732ca0-0b24-4753-bcca-055b8f396991"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:26.737173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] validate_networks() for [('a0732ca0-0b24-4753-bcca-055b8f396991', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:07:27.108966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:27.119803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:27.131009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:27.131799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:27.132877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:27.133533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:27.174763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:27.334002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:27.350234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:27.354804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:27.358708 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-50214abf-db02-4328-a5b9-c27c045f3f33 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.255944 Jul 26 20:07:27.388046 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2259/4586] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:27 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:27.409278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60cb7394-f392-4763-b382-1c49058ac455 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:27.412344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60cb7394-f392-4763-b382-1c49058ac455 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:27.431731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:27.434263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60cb7394-f392-4763-b382-1c49058ac455 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:27.435447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60cb7394-f392-4763-b382-1c49058ac455 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:27.436565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60cb7394-f392-4763-b382-1c49058ac455 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:27.437196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60cb7394-f392-4763-b382-1c49058ac455 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:27.485808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:07:27.486310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:07:27.486683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:07:27.487087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:07:27.487723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:07:27.501060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:27.501393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:27.502748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:27.503562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:27.532230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:07:27.538481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:07:27.564279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:07:27.569288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:07:27.637197 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ac862ede-b30e-4df3-8017-6da4bb925e50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014646 Jul 26 20:07:27.644917 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2328/4587] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:07:27.651323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-729ecf5c-f614-4c54-9738-f96862543c45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:27.652182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-729ecf5c-f614-4c54-9738-f96862543c45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:27.765174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-729ecf5c-f614-4c54-9738-f96862543c45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:27.774305 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-729ecf5c-f614-4c54-9738-f96862543c45 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1209 microversion: 2.1 time: 0.127834 Jul 26 20:07:27.774889 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2329/4588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:27 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:27.806870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60cb7394-f392-4763-b382-1c49058ac455 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:27.827603 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60cb7394-f392-4763-b382-1c49058ac455 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1502 microversion: 2.1 time: 0.430645 Jul 26 20:07:27.840877 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2260/4589] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:27 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1502 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:27.864077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5a28b30-1f53-4004-b557-72ad9f6a1256 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:27.870547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a28b30-1f53-4004-b557-72ad9f6a1256 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:27.870997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5a28b30-1f53-4004-b557-72ad9f6a1256 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:27.917846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5a28b30-1f53-4004-b557-72ad9f6a1256 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Going to try to stop instance {{(pid=125964) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:07:27.996992 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5a28b30-1f53-4004-b557-72ad9f6a1256 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e/action" status: 202 len: 0 microversion: 2.1 time: 0.139998 Jul 26 20:07:27.997916 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2330/4590] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:07:27 2022] POST /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:07:28.007779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a2f98a1-8e12-4520-8d83-071e1a6da6f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:28.008403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a2f98a1-8e12-4520-8d83-071e1a6da6f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:28.019265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a2f98a1-8e12-4520-8d83-071e1a6da6f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:28.024802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a2f98a1-8e12-4520-8d83-071e1a6da6f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:28.025662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a2f98a1-8e12-4520-8d83-071e1a6da6f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:28.027845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a2f98a1-8e12-4520-8d83-071e1a6da6f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:28.369428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a2f98a1-8e12-4520-8d83-071e1a6da6f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:28.379185 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a2f98a1-8e12-4520-8d83-071e1a6da6f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.376643 Jul 26 20:07:28.385528 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2261/4591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:28 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:28.404607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:28.405713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:28.428717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:28.430055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:28.432500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:28.433561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:28.572068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:28.575982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:28.588521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:28.590152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:28.591359 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-265fdcb6-ddfe-4168-b412-7b720a0076d1 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.192446 Jul 26 20:07:28.591960 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2331/4592] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:28 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:28.800363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68011504-831a-4bb6-884e-38f11c4a9f33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:28.801862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68011504-831a-4bb6-884e-38f11c4a9f33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:28.835294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68011504-831a-4bb6-884e-38f11c4a9f33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:28.839071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68011504-831a-4bb6-884e-38f11c4a9f33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:28.847878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68011504-831a-4bb6-884e-38f11c4a9f33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:28.849599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68011504-831a-4bb6-884e-38f11c4a9f33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:29.023450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68011504-831a-4bb6-884e-38f11c4a9f33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:29.034527 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68011504-831a-4bb6-884e-38f11c4a9f33 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1261 microversion: 2.1 time: 0.238752 Jul 26 20:07:29.038697 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2262/4593] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:28 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:29.406438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7d53d964-86d1-4ec5-91d6-736114d72c64 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:29.407736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7d53d964-86d1-4ec5-91d6-736114d72c64 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:29.427868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:29.430157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d53d964-86d1-4ec5-91d6-736114d72c64 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:29.432251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d53d964-86d1-4ec5-91d6-736114d72c64 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:29.435042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d53d964-86d1-4ec5-91d6-736114d72c64 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:29.438106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d53d964-86d1-4ec5-91d6-736114d72c64 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:29.617058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:29.618369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:29.625632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:29.626538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:29.627400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:29.627934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:29.776748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:29.786538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:29.788195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:29.789977 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1e3903b-0a04-4ee0-884a-07c82c811cf2 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.177716 Jul 26 20:07:29.790625 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2263/4594] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:29 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:29.999691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7d53d964-86d1-4ec5-91d6-736114d72c64 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:30.011213 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7d53d964-86d1-4ec5-91d6-736114d72c64 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.609005 Jul 26 20:07:30.019667 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2332/4595] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:29 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:30.056668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-52710a35-f977-478f-be0b-ccdf4aee4e57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:30.057338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-52710a35-f977-478f-be0b-ccdf4aee4e57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:30.067906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52710a35-f977-478f-be0b-ccdf4aee4e57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:30.068576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52710a35-f977-478f-be0b-ccdf4aee4e57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:30.069672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52710a35-f977-478f-be0b-ccdf4aee4e57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:30.070266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52710a35-f977-478f-be0b-ccdf4aee4e57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:30.504892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-52710a35-f977-478f-be0b-ccdf4aee4e57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:30.520530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-52710a35-f977-478f-be0b-ccdf4aee4e57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1267 microversion: 2.1 time: 0.467906 Jul 26 20:07:30.521445 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2264/4596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:30 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1267 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:30.817398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:30.819037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:30.837275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:30.838350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:30.839349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:30.839830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:31.038889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7631c5fb-c65e-44f0-8c19-a1ba3cd6f5c5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:31.039803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7631c5fb-c65e-44f0-8c19-a1ba3cd6f5c5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:31.052997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7631c5fb-c65e-44f0-8c19-a1ba3cd6f5c5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:31.073057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7631c5fb-c65e-44f0-8c19-a1ba3cd6f5c5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:31.074494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7631c5fb-c65e-44f0-8c19-a1ba3cd6f5c5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:31.075181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7631c5fb-c65e-44f0-8c19-a1ba3cd6f5c5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:31.301869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:31.311599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:31.314455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:31.316305 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d5673651-39c9-422c-bab8-d10bed53037f tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.505777 Jul 26 20:07:31.317201 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2333/4597] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:30 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:31.542609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-289fd065-037c-4834-8163-58046f0f52ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:31.543826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-289fd065-037c-4834-8163-58046f0f52ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:31.551778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-289fd065-037c-4834-8163-58046f0f52ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:31.552543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-289fd065-037c-4834-8163-58046f0f52ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:31.553547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-289fd065-037c-4834-8163-58046f0f52ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:31.554324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-289fd065-037c-4834-8163-58046f0f52ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:31.637549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7631c5fb-c65e-44f0-8c19-a1ba3cd6f5c5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:31.659246 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7631c5fb-c65e-44f0-8c19-a1ba3cd6f5c5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.625164 Jul 26 20:07:31.660685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2265/4598] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:31 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:31.830816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-289fd065-037c-4834-8163-58046f0f52ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:31.849438 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-289fd065-037c-4834-8163-58046f0f52ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1309 microversion: 2.1 time: 0.310735 Jul 26 20:07:31.852084 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2334/4599] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:31 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:32.344090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:32.345266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:32.353635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:32.354253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:32.355570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:32.356184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:32.599036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:32.614706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:32.617826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:32.621815 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6a2ab0fd-4b2c-47c7-bb9b-12a0d847719c tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.282461 Jul 26 20:07:32.623058 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2266/4600] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:32 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:32.682310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7d472735-8c1d-4bfe-a155-1f087968e465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:32.682998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7d472735-8c1d-4bfe-a155-1f087968e465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:32.695199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d472735-8c1d-4bfe-a155-1f087968e465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:32.697119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d472735-8c1d-4bfe-a155-1f087968e465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:32.700082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d472735-8c1d-4bfe-a155-1f087968e465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:32.701307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d472735-8c1d-4bfe-a155-1f087968e465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:32.872686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d1570116-41ae-4290-b436-9bffedaa1095 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:32.873640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d1570116-41ae-4290-b436-9bffedaa1095 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:32.880191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1570116-41ae-4290-b436-9bffedaa1095 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:32.880898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1570116-41ae-4290-b436-9bffedaa1095 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:32.881816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1570116-41ae-4290-b436-9bffedaa1095 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:32.882409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1570116-41ae-4290-b436-9bffedaa1095 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:33.059429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7d472735-8c1d-4bfe-a155-1f087968e465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:33.071251 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7d472735-8c1d-4bfe-a155-1f087968e465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.391235 Jul 26 20:07:33.072207 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2335/4601] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:32 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:33.222509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-cd2f274f-b8d3-4d6e-8370-3709a615f75d req-bcbc0650-c753-4c12-b659-39f4e363a6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "768b4ba6-2004-4836-9d49-4d9d4631f51e", "tag": "658b86f4-4d61-4cb0-8934-3796ec5c18ff"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:33.232422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cd2f274f-b8d3-4d6e-8370-3709a615f75d req-bcbc0650-c753-4c12-b659-39f4e363a6d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:33.233180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-cd2f274f-b8d3-4d6e-8370-3709a615f75d req-bcbc0650-c753-4c12-b659-39f4e363a6d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:33.249023 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-cd2f274f-b8d3-4d6e-8370-3709a615f75d req-bcbc0650-c753-4c12-b659-39f4e363a6d1 service nova] Creating event network-changed:658b86f4-4d61-4cb0-8934-3796ec5c18ff for instance 768b4ba6-2004-4836-9d49-4d9d4631f51e on n-h1-708768-8 Jul 26 20:07:33.253146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d1570116-41ae-4290-b436-9bffedaa1095 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:33.264095 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-cd2f274f-b8d3-4d6e-8370-3709a615f75d req-bcbc0650-c753-4c12-b659-39f4e363a6d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041364 Jul 26 20:07:33.266240 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2336/4602] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:33.266587 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d1570116-41ae-4290-b436-9bffedaa1095 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1309 microversion: 2.1 time: 0.396917 Jul 26 20:07:33.267102 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2267/4603] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:32 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1309 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:33.659833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:33.661011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:33.670988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:33.671769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:33.673294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:33.674012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:33.772803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:33.786418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:33.790275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:33.791994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6c0b7e60-b858-4d80-9105-38f200390194 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.143162 Jul 26 20:07:33.793554 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2337/4604] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:33 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:34.102440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8915014-819e-46e4-924b-c01bf354d7cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:34.107205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8915014-819e-46e4-924b-c01bf354d7cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:34.117843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8915014-819e-46e4-924b-c01bf354d7cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:34.120679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8915014-819e-46e4-924b-c01bf354d7cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:34.122329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8915014-819e-46e4-924b-c01bf354d7cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:34.123986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8915014-819e-46e4-924b-c01bf354d7cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:34.291485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11745217-f608-42cc-966d-e13f2be59def tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:34.292632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11745217-f608-42cc-966d-e13f2be59def tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:34.306337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11745217-f608-42cc-966d-e13f2be59def tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:34.310055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11745217-f608-42cc-966d-e13f2be59def tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:34.311901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11745217-f608-42cc-966d-e13f2be59def tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:34.314100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11745217-f608-42cc-966d-e13f2be59def tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:34.462136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8915014-819e-46e4-924b-c01bf354d7cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:34.474053 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8915014-819e-46e4-924b-c01bf354d7cc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.384031 Jul 26 20:07:34.474652 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2268/4605] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:34 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:34.596356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11745217-f608-42cc-966d-e13f2be59def tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:34.604499 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11745217-f608-42cc-966d-e13f2be59def tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1309 microversion: 2.1 time: 0.319365 Jul 26 20:07:34.605078 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2338/4606] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:34 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:34.818109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:34.818739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:34.830663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:34.831419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:34.832475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:34.833075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:34.985514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:35.013657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:35.018987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:35.023003 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b3561c8a-a70f-4fb5-a216-8f1f55a105d3 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.209035 Jul 26 20:07:35.040467 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2339/4607] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:34 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:35.174402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dafe160c-ab3c-4ae7-b360-2125d03fc0f0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:35.175676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dafe160c-ab3c-4ae7-b360-2125d03fc0f0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:35.195350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dafe160c-ab3c-4ae7-b360-2125d03fc0f0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:35.196069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dafe160c-ab3c-4ae7-b360-2125d03fc0f0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:35.197624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dafe160c-ab3c-4ae7-b360-2125d03fc0f0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:35.198423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dafe160c-ab3c-4ae7-b360-2125d03fc0f0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:35.250072 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dafe160c-ab3c-4ae7-b360-2125d03fc0f0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/ips" status: 200 len: 152 microversion: 2.20 time: 0.506555 Jul 26 20:07:35.264913 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2269/4608] 10.222.0.58 () {60 vars in 1289 bytes} [Tue Jul 26 20:07:34 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/ips => generated 152 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:07:35.504848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-368fa576-37db-4abd-a233-f08423700280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:35.505461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-368fa576-37db-4abd-a233-f08423700280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:35.522924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-368fa576-37db-4abd-a233-f08423700280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:35.523551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-368fa576-37db-4abd-a233-f08423700280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:35.524720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-368fa576-37db-4abd-a233-f08423700280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:35.525310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-368fa576-37db-4abd-a233-f08423700280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:35.627678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3f24132e-0eca-44e2-bf46-f0bb7ae83a98 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:35.628534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3f24132e-0eca-44e2-bf46-f0bb7ae83a98 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:35.644773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f24132e-0eca-44e2-bf46-f0bb7ae83a98 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:35.645398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f24132e-0eca-44e2-bf46-f0bb7ae83a98 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:35.646346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f24132e-0eca-44e2-bf46-f0bb7ae83a98 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:35.647299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f24132e-0eca-44e2-bf46-f0bb7ae83a98 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:35.881321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-368fa576-37db-4abd-a233-f08423700280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:35.889727 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-368fa576-37db-4abd-a233-f08423700280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.389757 Jul 26 20:07:35.903110 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2340/4609] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:35 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:36.063858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:36.064488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:36.074652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:36.075110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:36.081656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:36.082502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:36.258458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3f24132e-0eca-44e2-bf46-f0bb7ae83a98 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:36.258912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:36.276318 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3f24132e-0eca-44e2-bf46-f0bb7ae83a98 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1309 microversion: 2.1 time: 0.649980 Jul 26 20:07:36.278196 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2270/4610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:35 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1309 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:36.282453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:36.284041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:36.287859 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22aaafae-8d34-4708-a4e0-834715f43e74 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.228689 Jul 26 20:07:36.295423 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2341/4611] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:36 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:36.912841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9177b370-5d1d-4607-b052-6f13fe35a5bb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:36.913650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9177b370-5d1d-4607-b052-6f13fe35a5bb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:36.920979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9177b370-5d1d-4607-b052-6f13fe35a5bb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:36.921434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9177b370-5d1d-4607-b052-6f13fe35a5bb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:36.922514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9177b370-5d1d-4607-b052-6f13fe35a5bb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:36.923134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9177b370-5d1d-4607-b052-6f13fe35a5bb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:37.200016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9177b370-5d1d-4607-b052-6f13fe35a5bb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:37.221823 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9177b370-5d1d-4607-b052-6f13fe35a5bb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.312117 Jul 26 20:07:37.223316 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2271/4612] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:36 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:37.299434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1fdd0eac-e941-45cb-8082-243fcffcad8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:37.300082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1fdd0eac-e941-45cb-8082-243fcffcad8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:37.309882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fdd0eac-e941-45cb-8082-243fcffcad8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:37.310342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fdd0eac-e941-45cb-8082-243fcffcad8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:37.316920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fdd0eac-e941-45cb-8082-243fcffcad8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:37.317406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fdd0eac-e941-45cb-8082-243fcffcad8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:37.320175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:37.321322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:37.330746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:37.331486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:37.332556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:37.333065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:37.505836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1fdd0eac-e941-45cb-8082-243fcffcad8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:37.515050 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1fdd0eac-e941-45cb-8082-243fcffcad8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1309 microversion: 2.1 time: 0.220281 Jul 26 20:07:37.516138 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2342/4613] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:37 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1309 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:37.534914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:37.543974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:37.546444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:37.548609 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-685080b8-81fc-4a8e-af64-1c4f10b7a8e0 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.234168 Jul 26 20:07:37.549406 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2272/4614] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:37 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:38.248794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-937a651e-44f6-4b23-afe1-c2f930bf81af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:38.250418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-937a651e-44f6-4b23-afe1-c2f930bf81af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:38.256545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:38.258196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=20 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:38.260070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-937a651e-44f6-4b23-afe1-c2f930bf81af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.260921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-937a651e-44f6-4b23-afe1-c2f930bf81af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.261758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-937a651e-44f6-4b23-afe1-c2f930bf81af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.262453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-937a651e-44f6-4b23-afe1-c2f930bf81af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.315407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b80aca31-260e-4b69-98c1-9c4f3cf5fb18 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:38.316066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b80aca31-260e-4b69-98c1-9c4f3cf5fb18 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:38.328487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b80aca31-260e-4b69-98c1-9c4f3cf5fb18 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.329230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b80aca31-260e-4b69-98c1-9c4f3cf5fb18 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.334635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b80aca31-260e-4b69-98c1-9c4f3cf5fb18 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.335090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b80aca31-260e-4b69-98c1-9c4f3cf5fb18 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.367752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-b80aca31-260e-4b69-98c1-9c4f3cf5fb18 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lazy-loading 'flavor' on Instance uuid b2c400aa-bca9-4bec-a8ef-e200c066995e {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:07:38.631381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-937a651e-44f6-4b23-afe1-c2f930bf81af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:38.645411 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-937a651e-44f6-4b23-afe1-c2f930bf81af tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.404436 Jul 26 20:07:38.661660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2343/4615] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:38 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:38.667561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-849b56ad-5f6f-42d8-85bc-7d0679d9474e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:38.668919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-849b56ad-5f6f-42d8-85bc-7d0679d9474e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:38.677408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-849b56ad-5f6f-42d8-85bc-7d0679d9474e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.677669 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b80aca31-260e-4b69-98c1-9c4f3cf5fb18 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/action" status: 202 len: 0 microversion: 2.20 time: 0.365852 Jul 26 20:07:38.678785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-849b56ad-5f6f-42d8-85bc-7d0679d9474e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.679816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-849b56ad-5f6f-42d8-85bc-7d0679d9474e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.680464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-849b56ad-5f6f-42d8-85bc-7d0679d9474e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.684135 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2273/4616] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 20:07:38 2022] POST /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:07:38.704128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:38.706500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:38.731946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.734735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.736131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.736827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.777520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:38.844578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:38.868133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:38.870238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:38.871710 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8ff8d511-5606-4b27-80ea-a153fc411805 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.185701 Jul 26 20:07:38.872463 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2274/4617] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:38 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:38.889462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:38.896500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:38.902751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.903207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:38.904023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:38.916226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:39.170879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:39.183791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:39.186306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:39.188937 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6711f4c8-3b4e-43b2-a61d-75ac63787580 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.306224 Jul 26 20:07:39.190003 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2275/4618] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:38 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:39.341430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-849b56ad-5f6f-42d8-85bc-7d0679d9474e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:39.354380 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-849b56ad-5f6f-42d8-85bc-7d0679d9474e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1309 microversion: 2.1 time: 0.691525 Jul 26 20:07:39.354955 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2344/4619] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:38 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1309 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:39.693432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97fce5f9-872d-4297-bef8-c18993cb3556 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:39.694671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97fce5f9-872d-4297-bef8-c18993cb3556 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:39.702750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97fce5f9-872d-4297-bef8-c18993cb3556 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:39.704447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97fce5f9-872d-4297-bef8-c18993cb3556 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:39.705478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97fce5f9-872d-4297-bef8-c18993cb3556 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:39.706217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97fce5f9-872d-4297-bef8-c18993cb3556 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:39.898240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:39.899545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:39.910254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:39.912581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:39.913626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:39.918672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:39.975519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97fce5f9-872d-4297-bef8-c18993cb3556 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:39.988739 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97fce5f9-872d-4297-bef8-c18993cb3556 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.299375 Jul 26 20:07:39.989335 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2276/4620] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:39 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:40.115147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:40.126764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:40.132910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:40.134502 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44827900-055c-4c36-aaec-e57e8755fcd6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.241469 Jul 26 20:07:40.141912 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2345/4621] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:39 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:40.216000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:40.216618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:40.233578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:40.234615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:40.235962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:40.236206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:40.254386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a2099ebf-9f40-4625-8b45-bb0740b91ca3 req-97dc82f4-a032-46a6-a289-9b7d8281e378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768b4ba6-2004-4836-9d49-4d9d4631f51e", "name": "network-vif-plugged", "status": "completed", "tag": "658b86f4-4d61-4cb0-8934-3796ec5c18ff"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:40.275186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a2099ebf-9f40-4625-8b45-bb0740b91ca3 req-97dc82f4-a032-46a6-a289-9b7d8281e378 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:40.280133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a2099ebf-9f40-4625-8b45-bb0740b91ca3 req-97dc82f4-a032-46a6-a289-9b7d8281e378 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:40.320937 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a2099ebf-9f40-4625-8b45-bb0740b91ca3 req-97dc82f4-a032-46a6-a289-9b7d8281e378 service nova] Creating event network-vif-plugged:658b86f4-4d61-4cb0-8934-3796ec5c18ff for instance 768b4ba6-2004-4836-9d49-4d9d4631f51e on n-h1-708768-8 Jul 26 20:07:40.326343 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a2099ebf-9f40-4625-8b45-bb0740b91ca3 req-97dc82f4-a032-46a6-a289-9b7d8281e378 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076190 Jul 26 20:07:40.331350 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2346/4622] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:40.378373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e997540f-63bb-4e0d-bb2d-0fbae85eedce tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:40.379395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e997540f-63bb-4e0d-bb2d-0fbae85eedce tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:40.401768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e997540f-63bb-4e0d-bb2d-0fbae85eedce tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:40.404720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e997540f-63bb-4e0d-bb2d-0fbae85eedce tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:40.405723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e997540f-63bb-4e0d-bb2d-0fbae85eedce tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:40.408299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e997540f-63bb-4e0d-bb2d-0fbae85eedce tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:40.654516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:40.671349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:40.673092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:40.674319 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc2bcc9e-34fb-435f-856c-a6b6c1a225f8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.462311 Jul 26 20:07:40.677163 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2277/4623] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:40 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:40.776824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e997540f-63bb-4e0d-bb2d-0fbae85eedce tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:40.821273 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e997540f-63bb-4e0d-bb2d-0fbae85eedce tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1309 microversion: 2.1 time: 0.444268 Jul 26 20:07:40.825767 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2347/4624] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:40 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1309 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:41.011014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa61f28b-256c-499f-bb7f-1d98ff2a8fda tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:41.012447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa61f28b-256c-499f-bb7f-1d98ff2a8fda tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:41.040294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa61f28b-256c-499f-bb7f-1d98ff2a8fda tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:41.041022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa61f28b-256c-499f-bb7f-1d98ff2a8fda tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:41.042037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa61f28b-256c-499f-bb7f-1d98ff2a8fda tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:41.042715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa61f28b-256c-499f-bb7f-1d98ff2a8fda tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:41.169512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:41.173792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:41.177520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:41.178332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:41.179125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:41.179849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:41.256158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:41.270385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:41.272349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:41.273641 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-631c4e25-b036-4f83-925a-b88758e7ea46 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.107967 Jul 26 20:07:41.273753 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2348/4625] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:41 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:41.408176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa61f28b-256c-499f-bb7f-1d98ff2a8fda tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:41.419351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa61f28b-256c-499f-bb7f-1d98ff2a8fda tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.412455 Jul 26 20:07:41.420033 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2278/4626] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:41 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:41.698857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:41.700021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:41.709933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:41.710715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:41.711753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:41.712443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:41.855505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b7a91cae-8b24-4b4c-9e23-18d6410794ed tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:41.856240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b7a91cae-8b24-4b4c-9e23-18d6410794ed tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:41.868269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7a91cae-8b24-4b4c-9e23-18d6410794ed tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:41.868718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7a91cae-8b24-4b4c-9e23-18d6410794ed tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:41.869497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7a91cae-8b24-4b4c-9e23-18d6410794ed tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:41.869932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7a91cae-8b24-4b4c-9e23-18d6410794ed tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:41.944722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:41.948859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:41.965120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:41.971592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:41.973142 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c83fafda-6eac-4cbe-9ee7-dd225ab26e24 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.278594 Jul 26 20:07:41.975774 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2349/4627] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:41 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:42.182505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b7a91cae-8b24-4b4c-9e23-18d6410794ed tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:42.197493 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b7a91cae-8b24-4b4c-9e23-18d6410794ed tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1309 microversion: 2.1 time: 0.346945 Jul 26 20:07:42.198284 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2279/4628] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:41 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1309 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:42.298011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:42.298623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:42.307560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:42.310929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:42.311867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:42.312418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:42.402888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:42.416821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:42.418907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:42.420556 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f32f4955-0ae9-4e4e-b254-af315fe137cb tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.126694 Jul 26 20:07:42.436058 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2350/4629] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:42 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:42.445537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7db69dcf-363a-449f-8e61-cc68b37e3eca tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:42.446728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7db69dcf-363a-449f-8e61-cc68b37e3eca tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:42.454999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7db69dcf-363a-449f-8e61-cc68b37e3eca tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:42.456233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7db69dcf-363a-449f-8e61-cc68b37e3eca tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:42.457362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7db69dcf-363a-449f-8e61-cc68b37e3eca tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:42.457808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7db69dcf-363a-449f-8e61-cc68b37e3eca tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:42.736345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7db69dcf-363a-449f-8e61-cc68b37e3eca tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:42.746811 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7db69dcf-363a-449f-8e61-cc68b37e3eca tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.305512 Jul 26 20:07:42.747806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2280/4630] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:42 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:42.998413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:42.999243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:43.007244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:43.008085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:43.009328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:43.009878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:43.189792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:43.202122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:43.204287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:43.205492 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0461bcad-b52e-486e-92c0-e5f2f5fc1fb4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.211180 Jul 26 20:07:43.206662 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2351/4631] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:42 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:43.223086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee111acc-567e-48ef-80dd-a60b91e15634 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:43.224437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ee111acc-567e-48ef-80dd-a60b91e15634 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:43.233925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee111acc-567e-48ef-80dd-a60b91e15634 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:43.237519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee111acc-567e-48ef-80dd-a60b91e15634 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:43.238433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee111acc-567e-48ef-80dd-a60b91e15634 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:43.239180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee111acc-567e-48ef-80dd-a60b91e15634 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:43.450088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:43.450655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:43.458257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:43.459645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:43.460463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:43.460873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:43.572052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:43.585474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee111acc-567e-48ef-80dd-a60b91e15634 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:43.588327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:43.596895 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ee111acc-567e-48ef-80dd-a60b91e15634 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1490 microversion: 2.1 time: 0.379391 Jul 26 20:07:43.607277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:43.607277 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34c012bb-30bc-4840-af08-bd5c3a4da064 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.159704 Jul 26 20:07:43.618234 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2281/4632] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:43 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1490 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:43.620515 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2352/4633] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:43 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:43.772337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cca0b7bd-f824-496a-903d-d31e60d4e474 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:43.773148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cca0b7bd-f824-496a-903d-d31e60d4e474 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:43.784882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cca0b7bd-f824-496a-903d-d31e60d4e474 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:43.785508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cca0b7bd-f824-496a-903d-d31e60d4e474 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:43.786409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cca0b7bd-f824-496a-903d-d31e60d4e474 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:43.794012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cca0b7bd-f824-496a-903d-d31e60d4e474 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:43.837179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1807887537", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "a0732ca0-0b24-4753-bcca-055b8f396991"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:43.919299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] validate_networks() for [('a0732ca0-0b24-4753-bcca-055b8f396991', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:07:44.065055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cca0b7bd-f824-496a-903d-d31e60d4e474 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:44.076509 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cca0b7bd-f824-496a-903d-d31e60d4e474 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.310892 Jul 26 20:07:44.077903 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2282/4634] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:43 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:44.229538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:44.231219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:44.254372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:44.255540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:44.257594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:44.258437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:44.577474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:07:44.578798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:07:44.578920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:44.582677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:07:44.583440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:07:44.584300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:07:44.596971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:44.599603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:44.601377 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a8833d2e-b309-43bf-9bf5-bee78abe57fb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.376063 Jul 26 20:07:44.605295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:44.605907 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2283/4635] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:44 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:44.606163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:44.606977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:44.607418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:44.631073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:44.631713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:44.639214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:44.639770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:44.641077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:44.641517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:44.642624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:07:44.650715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:07:44.669539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:07:44.672671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:07:44.730245 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c1bfac9-d408-4a2a-a7b6-424b58883afa tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897680 Jul 26 20:07:44.731556 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2353/4636] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:07:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:07:44.744728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cc28b353-cb77-4496-9041-7a39c741f81a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:44.745699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc28b353-cb77-4496-9041-7a39c741f81a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:44.769667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:44.779950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:44.787420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:44.788876 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3995d658-f16c-4f56-9047-84dfa9a7b80a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.161929 Jul 26 20:07:44.791759 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2284/4637] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:44 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:44.845380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cc28b353-cb77-4496-9041-7a39c741f81a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:44.852907 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cc28b353-cb77-4496-9041-7a39c741f81a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1209 microversion: 2.1 time: 0.113508 Jul 26 20:07:44.858707 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2354/4638] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:44 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:45.098218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e5859ce7-2ee7-4cae-a9cf-44ca4cf8ae97 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:45.099195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e5859ce7-2ee7-4cae-a9cf-44ca4cf8ae97 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:45.112009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5859ce7-2ee7-4cae-a9cf-44ca4cf8ae97 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:45.112723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5859ce7-2ee7-4cae-a9cf-44ca4cf8ae97 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:45.114024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5859ce7-2ee7-4cae-a9cf-44ca4cf8ae97 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:45.114466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e5859ce7-2ee7-4cae-a9cf-44ca4cf8ae97 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:45.403328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e5859ce7-2ee7-4cae-a9cf-44ca4cf8ae97 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:45.412746 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e5859ce7-2ee7-4cae-a9cf-44ca4cf8ae97 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.318430 Jul 26 20:07:45.425108 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2285/4639] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:45 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:45.632814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:45.634269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:45.642365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:45.647637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:45.649351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:45.650286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:45.805975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:45.815208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:45.817119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:45.817463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:45.818198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:45.819106 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4c7cc962-7686-4df9-8901-b0a6a8b6f2a2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.190641 Jul 26 20:07:45.819980 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2355/4640] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:45 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:45.825372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:45.825753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:45.826611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:45.827290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:45.874872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c1cee39-effe-441d-a7f0-0d43ef1aa8e6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:45.875672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2c1cee39-effe-441d-a7f0-0d43ef1aa8e6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:45.883689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c1cee39-effe-441d-a7f0-0d43ef1aa8e6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:45.886803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c1cee39-effe-441d-a7f0-0d43ef1aa8e6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:45.900004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c1cee39-effe-441d-a7f0-0d43ef1aa8e6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:45.900733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c1cee39-effe-441d-a7f0-0d43ef1aa8e6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:45.913789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:45.925037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:45.927451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:45.929143 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6e96c1f3-d7e8-433a-9b9d-0e5b830aeeaa tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.119003 Jul 26 20:07:45.929940 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2286/4641] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:45 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:45.976679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c1cee39-effe-441d-a7f0-0d43ef1aa8e6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:45.988472 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c1cee39-effe-441d-a7f0-0d43ef1aa8e6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1261 microversion: 2.1 time: 0.117502 Jul 26 20:07:45.989536 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2356/4642] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:45 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:46.440660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80e0a2ae-5545-455b-80d2-78b3f36dece4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:46.441998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80e0a2ae-5545-455b-80d2-78b3f36dece4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:46.457239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e0a2ae-5545-455b-80d2-78b3f36dece4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:46.457951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e0a2ae-5545-455b-80d2-78b3f36dece4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:46.460050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e0a2ae-5545-455b-80d2-78b3f36dece4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:46.462830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e0a2ae-5545-455b-80d2-78b3f36dece4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:46.720496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-80e0a2ae-5545-455b-80d2-78b3f36dece4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:46.728355 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80e0a2ae-5545-455b-80d2-78b3f36dece4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.292739 Jul 26 20:07:46.743978 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2287/4643] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:46 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:46.845466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:46.848468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:46.856762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:46.861332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:46.862584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:46.863255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:46.953949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:46.954669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:46.965114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:46.966023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:46.967592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:46.970174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:47.084704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:47.103280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:47.105010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:47.106301 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e1827eb-a548-4f01-bb52-345632c71871 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.157513 Jul 26 20:07:47.106977 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2288/4644] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:46 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:47.120791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e1d69dec-a202-438b-b0e0-6a111ae33f9c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:47.121496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e1d69dec-a202-438b-b0e0-6a111ae33f9c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:47.137938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1d69dec-a202-438b-b0e0-6a111ae33f9c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:47.138484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1d69dec-a202-438b-b0e0-6a111ae33f9c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:47.139348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1d69dec-a202-438b-b0e0-6a111ae33f9c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:47.139884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1d69dec-a202-438b-b0e0-6a111ae33f9c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:47.222846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:47.231482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:47.233057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:47.234854 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3f408efa-d71b-4eea-9763-e7faae7d1c76 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.394299 Jul 26 20:07:47.241032 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2357/4645] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:46 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:47.289665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e1d69dec-a202-438b-b0e0-6a111ae33f9c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:47.305122 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e1d69dec-a202-438b-b0e0-6a111ae33f9c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1267 microversion: 2.1 time: 0.188380 Jul 26 20:07:47.305717 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2289/4646] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:47 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:47.755917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad4a289d-9aba-45d9-91fb-8994af5f39b1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:47.756794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad4a289d-9aba-45d9-91fb-8994af5f39b1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:47.765984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4a289d-9aba-45d9-91fb-8994af5f39b1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:47.771689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4a289d-9aba-45d9-91fb-8994af5f39b1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:47.772542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4a289d-9aba-45d9-91fb-8994af5f39b1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:47.772985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4a289d-9aba-45d9-91fb-8994af5f39b1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:48.022512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad4a289d-9aba-45d9-91fb-8994af5f39b1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:48.045955 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad4a289d-9aba-45d9-91fb-8994af5f39b1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.292566 Jul 26 20:07:48.050076 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2358/4647] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:47 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:48.135192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:48.136985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:48.167002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:48.168797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:48.172034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:48.174231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:48.265811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:48.267709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:48.275949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:48.278523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:48.280606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:48.281553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:48.351843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:48.368661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:48.371406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:48.377751 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4cdaa1e7-012e-4a42-baee-9aa349442446 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.244108 Jul 26 20:07:48.378974 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2290/4648] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:48 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:48.394337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c79eab39-0e13-4476-b424-220326f01417 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:48.395418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c79eab39-0e13-4476-b424-220326f01417 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:48.416159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c79eab39-0e13-4476-b424-220326f01417 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:48.417344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c79eab39-0e13-4476-b424-220326f01417 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:48.418553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c79eab39-0e13-4476-b424-220326f01417 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:48.427369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c79eab39-0e13-4476-b424-220326f01417 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:48.448770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:48.729075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:48.743312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:48.751074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:48.757057 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-803b3935-1301-427b-91bc-5ee130a409c5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.495879 Jul 26 20:07:48.758258 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2359/4649] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:48 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:48.832221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c79eab39-0e13-4476-b424-220326f01417 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:48.843360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c79eab39-0e13-4476-b424-220326f01417 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1309 microversion: 2.1 time: 0.459519 Jul 26 20:07:48.858617 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2291/4650] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:48 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1309 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:49.004763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-97484001-9e43-4202-ad9d-86ff56827547 req-b0cfff19-9836-42ae-a713-39faa214e176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee82c1bd-f76d-4b07-b0f7-e05a78450c6b", "tag": "342e082d-c657-4ed1-bc89-6c042c5ccc30"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:49.057526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-97484001-9e43-4202-ad9d-86ff56827547 req-b0cfff19-9836-42ae-a713-39faa214e176 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.058164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-97484001-9e43-4202-ad9d-86ff56827547 req-b0cfff19-9836-42ae-a713-39faa214e176 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:49.071155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9fbb6b34-2aa1-48e5-aefd-0b90f40747a4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:49.072725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9fbb6b34-2aa1-48e5-aefd-0b90f40747a4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:49.083107 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-97484001-9e43-4202-ad9d-86ff56827547 req-b0cfff19-9836-42ae-a713-39faa214e176 service nova] Creating event network-changed:342e082d-c657-4ed1-bc89-6c042c5ccc30 for instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b on n-h1-708768-8 Jul 26 20:07:49.087651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9fbb6b34-2aa1-48e5-aefd-0b90f40747a4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.088236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9fbb6b34-2aa1-48e5-aefd-0b90f40747a4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:49.090429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9fbb6b34-2aa1-48e5-aefd-0b90f40747a4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.092396 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-97484001-9e43-4202-ad9d-86ff56827547 req-b0cfff19-9836-42ae-a713-39faa214e176 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098255 Jul 26 20:07:49.095311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9fbb6b34-2aa1-48e5-aefd-0b90f40747a4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:49.096830 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2360/4651] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:49.409048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:49.410181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:49.424320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.425346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:49.426491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.427215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:49.442196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9fbb6b34-2aa1-48e5-aefd-0b90f40747a4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:49.452044 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9fbb6b34-2aa1-48e5-aefd-0b90f40747a4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.385513 Jul 26 20:07:49.452702 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2292/4652] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:49 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:49.566548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:49.579456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:49.581487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:49.582969 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-040798e9-415f-4ef5-a2e2-256b2efbf647 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.182939 Jul 26 20:07:49.584082 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2361/4653] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:49 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:49.784425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:49.787077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:49.801253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.802877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:49.802877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.803098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:49.866363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8ed408b7-41ae-4aa4-93c0-4f4a7d6ebd17 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:49.866988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8ed408b7-41ae-4aa4-93c0-4f4a7d6ebd17 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:49.879889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ed408b7-41ae-4aa4-93c0-4f4a7d6ebd17 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.880380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ed408b7-41ae-4aa4-93c0-4f4a7d6ebd17 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:49.882347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ed408b7-41ae-4aa4-93c0-4f4a7d6ebd17 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:49.884631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ed408b7-41ae-4aa4-93c0-4f4a7d6ebd17 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:50.047392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:50.056485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:50.058420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:50.060103 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-701787eb-70ef-4bd8-a87a-e9acccc00de8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.282017 Jul 26 20:07:50.061266 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2293/4654] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:49 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:50.475898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f061a26f-8b00-4635-bed5-aebb7c11ecc9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:50.476565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f061a26f-8b00-4635-bed5-aebb7c11ecc9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:50.494526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f061a26f-8b00-4635-bed5-aebb7c11ecc9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:50.494987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f061a26f-8b00-4635-bed5-aebb7c11ecc9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:50.495815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f061a26f-8b00-4635-bed5-aebb7c11ecc9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:50.496255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f061a26f-8b00-4635-bed5-aebb7c11ecc9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:50.527911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8ed408b7-41ae-4aa4-93c0-4f4a7d6ebd17 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:50.545788 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8ed408b7-41ae-4aa4-93c0-4f4a7d6ebd17 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1309 microversion: 2.1 time: 0.678644 Jul 26 20:07:50.582953 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2362/4655] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:49 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1309 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:50.610094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:50.611771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:50.621314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:50.626042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:50.628895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:50.630519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:50.739889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:50.753996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:50.756478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:50.758252 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f4500fb9-1ce1-47a7-a671-d4eb5bb041bd tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.152680 Jul 26 20:07:50.769202 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2363/4656] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:50 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:50.839084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f061a26f-8b00-4635-bed5-aebb7c11ecc9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:50.849171 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f061a26f-8b00-4635-bed5-aebb7c11ecc9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.378234 Jul 26 20:07:50.850786 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2294/4657] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:50 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:51.084973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:51.085536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:51.094358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:51.094816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:51.095630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:51.108350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:51.551665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:51.563204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:51.569643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-117477a4-e339-4447-8cb0-28354d8babf6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:51.570843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-117477a4-e339-4447-8cb0-28354d8babf6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:51.575173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:51.576833 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-587bb7f1-a461-4c66-9f94-9e0213f25be7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.495727 Jul 26 20:07:51.577727 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2364/4658] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:51 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:51.584588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-117477a4-e339-4447-8cb0-28354d8babf6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:51.585046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-117477a4-e339-4447-8cb0-28354d8babf6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:51.585842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-117477a4-e339-4447-8cb0-28354d8babf6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:51.586281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-117477a4-e339-4447-8cb0-28354d8babf6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:51.786224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:51.788447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:51.814857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:51.815486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:51.817366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:51.818010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:51.883508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-117477a4-e339-4447-8cb0-28354d8babf6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:51.892695 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-117477a4-e339-4447-8cb0-28354d8babf6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1309 microversion: 2.1 time: 0.328226 Jul 26 20:07:51.893683 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2295/4659] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:51 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1309 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:51.899290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a12132b4-1706-43ed-bf42-88c31f6d5403 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:51.899918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a12132b4-1706-43ed-bf42-88c31f6d5403 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:51.907174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a12132b4-1706-43ed-bf42-88c31f6d5403 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:51.907174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a12132b4-1706-43ed-bf42-88c31f6d5403 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:51.908011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a12132b4-1706-43ed-bf42-88c31f6d5403 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:51.908525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a12132b4-1706-43ed-bf42-88c31f6d5403 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:51.965089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:51.979671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:51.981476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:51.983189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6aea7f42-7680-40e3-a418-1822e5718dde tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1365 microversion: 2.57 time: 0.203692 Jul 26 20:07:51.997000 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2365/4660] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:51 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:52.071018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a12132b4-1706-43ed-bf42-88c31f6d5403 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:52.082777 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a12132b4-1706-43ed-bf42-88c31f6d5403 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.187680 Jul 26 20:07:52.095150 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2296/4661] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:51 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:52.601951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:52.602568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:52.610282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:52.610730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:52.611512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:52.611987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:52.835006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:52.843316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:52.844899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:52.846110 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-421bb5a6-7dd6-4ea4-a4bf-a9ea9d036def tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.248289 Jul 26 20:07:52.852000 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2366/4662] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:52 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:52.916571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8125fc38-2a97-42fa-8352-282432e90cb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:52.917294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8125fc38-2a97-42fa-8352-282432e90cb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:52.925823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8125fc38-2a97-42fa-8352-282432e90cb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:52.926549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8125fc38-2a97-42fa-8352-282432e90cb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:52.927478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8125fc38-2a97-42fa-8352-282432e90cb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:52.928082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8125fc38-2a97-42fa-8352-282432e90cb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:53.033923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:53.034719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:53.042677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:53.043251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:53.044420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:53.044971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:53.169427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8125fc38-2a97-42fa-8352-282432e90cb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:53.184858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:53.188252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8125fc38-2a97-42fa-8352-282432e90cb1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1309 microversion: 2.1 time: 0.276718 Jul 26 20:07:53.189919 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2297/4663] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:52 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:53.194827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:53.196797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:53.198440 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bed854ca-a9b7-4392-acf1-0ec948787ff6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1371 microversion: 2.57 time: 0.181167 Jul 26 20:07:53.208922 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2367/4664] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:53 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:53.209179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-acc72949-1eee-49d3-a6df-f8eafbbfe78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:53.209790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-acc72949-1eee-49d3-a6df-f8eafbbfe78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:53.220377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acc72949-1eee-49d3-a6df-f8eafbbfe78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:53.220832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acc72949-1eee-49d3-a6df-f8eafbbfe78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:53.223569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acc72949-1eee-49d3-a6df-f8eafbbfe78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:53.224216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acc72949-1eee-49d3-a6df-f8eafbbfe78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:53.438511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-acc72949-1eee-49d3-a6df-f8eafbbfe78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:53.446974 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-acc72949-1eee-49d3-a6df-f8eafbbfe78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1512 microversion: 2.1 time: 0.255807 Jul 26 20:07:53.459976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2298/4665] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:53 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:53.876165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:53.876951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:53.886192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:53.887199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:53.888776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:53.889399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.175951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:54.180004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:54.194294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:54.195997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:54.201516 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-881e96f9-db29-4475-aeac-7cd6b255ce15 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.333993 Jul 26 20:07:54.220155 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2368/4666] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:53 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:54.225645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4338ea11-10af-4c34-933e-9db957f129a6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:54.227444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4338ea11-10af-4c34-933e-9db957f129a6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:54.237450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4338ea11-10af-4c34-933e-9db957f129a6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.242450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4338ea11-10af-4c34-933e-9db957f129a6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.243223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:54.243739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4338ea11-10af-4c34-933e-9db957f129a6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.244138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:54.244520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4338ea11-10af-4c34-933e-9db957f129a6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.257606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.258088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.260892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.262092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.456987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:54.473819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:54.475803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:54.478337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4338ea11-10af-4c34-933e-9db957f129a6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:54.480113 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cf81e800-f860-4373-8a37-a408a0e79795 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1371 microversion: 2.57 time: 0.243171 Jul 26 20:07:54.488382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2369/4667] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:54 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:54.494612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5da227ab-1c4c-4322-a207-d49b0faa9c75 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:54.497155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5da227ab-1c4c-4322-a207-d49b0faa9c75 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:54.503537 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4338ea11-10af-4c34-933e-9db957f129a6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1309 microversion: 2.1 time: 0.297151 Jul 26 20:07:54.504232 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2299/4668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:54 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:54.513619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5da227ab-1c4c-4322-a207-d49b0faa9c75 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.514981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5da227ab-1c4c-4322-a207-d49b0faa9c75 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.518182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5da227ab-1c4c-4322-a207-d49b0faa9c75 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.519365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5da227ab-1c4c-4322-a207-d49b0faa9c75 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.618738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:54.796853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5da227ab-1c4c-4322-a207-d49b0faa9c75 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:54.805350 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5da227ab-1c4c-4322-a207-d49b0faa9c75 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1489 microversion: 2.1 time: 0.315096 Jul 26 20:07:54.806960 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2370/4669] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:54 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1489 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:54.834880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7478434d-e211-4754-bd23-e6704ef413ad tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:54.838756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7478434d-e211-4754-bd23-e6704ef413ad tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:54.849565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7478434d-e211-4754-bd23-e6704ef413ad tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.850440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7478434d-e211-4754-bd23-e6704ef413ad tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.851634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7478434d-e211-4754-bd23-e6704ef413ad tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.852474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7478434d-e211-4754-bd23-e6704ef413ad tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.924349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7478434d-e211-4754-bd23-e6704ef413ad tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 200 len: 133 microversion: 2.1 time: 0.097504 Jul 26 20:07:54.925009 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2300/4670] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:07:54 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 133 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:07:54.935839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1233ca03-3155-4041-b4e8-e7ed61d236dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:54.938114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1233ca03-3155-4041-b4e8-e7ed61d236dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:54.948227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:54.953622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1233ca03-3155-4041-b4e8-e7ed61d236dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.954570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1233ca03-3155-4041-b4e8-e7ed61d236dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:54.956374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1233ca03-3155-4041-b4e8-e7ed61d236dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:54.957560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1233ca03-3155-4041-b4e8-e7ed61d236dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.156468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1233ca03-3155-4041-b4e8-e7ed61d236dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.165804 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1233ca03-3155-4041-b4e8-e7ed61d236dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.234915 Jul 26 20:07:55.166888 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2371/4671] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:54 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:55.193566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-490b3708-d2ac-4e3e-92c8-c2370fc319d3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:55.198840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-490b3708-d2ac-4e3e-92c8-c2370fc319d3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:55.213548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-490b3708-d2ac-4e3e-92c8-c2370fc319d3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.214162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-490b3708-d2ac-4e3e-92c8-c2370fc319d3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.215514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-490b3708-d2ac-4e3e-92c8-c2370fc319d3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.216661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-490b3708-d2ac-4e3e-92c8-c2370fc319d3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.231204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:55.232124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:55.248839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.249303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.250635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.252879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.457463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.482857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.488119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.489904 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e00b052-04b3-4413-8d63-80781fdc7109 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1744 microversion: 2.20 time: 0.264093 Jul 26 20:07:55.491052 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2372/4672] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:55 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1744 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:55.493058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-490b3708-d2ac-4e3e-92c8-c2370fc319d3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.508242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:55.512364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:55.513254 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-490b3708-d2ac-4e3e-92c8-c2370fc319d3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.324431 Jul 26 20:07:55.513938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2301/4673] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:55 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:55.522921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.524887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.525674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.526109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.536248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a619ba69-ba02-4a29-a36a-e5ba5723332e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:55.537337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a619ba69-ba02-4a29-a36a-e5ba5723332e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:55.544781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a619ba69-ba02-4a29-a36a-e5ba5723332e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.545510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a619ba69-ba02-4a29-a36a-e5ba5723332e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.546520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a619ba69-ba02-4a29-a36a-e5ba5723332e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.547134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a619ba69-ba02-4a29-a36a-e5ba5723332e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.628847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.645177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.646948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.648517 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5c6b29dc-0700-4618-be39-b26f0cb0a250 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1356 microversion: 2.57 time: 0.144476 Jul 26 20:07:55.649092 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2373/4674] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:55 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1356 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:55.653852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1b5e908-ad0f-4b5f-a2dc-6405ea63c89e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:55.654796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f1b5e908-ad0f-4b5f-a2dc-6405ea63c89e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:55.661127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:55.662752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1b5e908-ad0f-4b5f-a2dc-6405ea63c89e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.666002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1b5e908-ad0f-4b5f-a2dc-6405ea63c89e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.675190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1b5e908-ad0f-4b5f-a2dc-6405ea63c89e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.676100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1b5e908-ad0f-4b5f-a2dc-6405ea63c89e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.774919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a619ba69-ba02-4a29-a36a-e5ba5723332e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.790468 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a619ba69-ba02-4a29-a36a-e5ba5723332e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1309 microversion: 2.1 time: 0.259141 Jul 26 20:07:55.792209 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2302/4675] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:55 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:55.799897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e93456d6-a7ef-4ce1-a224-44193a95962a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:55.801504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e93456d6-a7ef-4ce1-a224-44193a95962a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:55.810010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e93456d6-a7ef-4ce1-a224-44193a95962a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.810795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e93456d6-a7ef-4ce1-a224-44193a95962a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.812210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e93456d6-a7ef-4ce1-a224-44193a95962a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.812771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e93456d6-a7ef-4ce1-a224-44193a95962a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.849569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e93456d6-a7ef-4ce1-a224-44193a95962a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:07:55.853339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f1b5e908-ad0f-4b5f-a2dc-6405ea63c89e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:55.863409 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f1b5e908-ad0f-4b5f-a2dc-6405ea63c89e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.213173 Jul 26 20:07:55.864029 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2374/4676] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:55 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:55.884229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f875292b-06bf-412c-be88-a78a6149cea2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:55.884850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f875292b-06bf-412c-be88-a78a6149cea2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:55.892386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f875292b-06bf-412c-be88-a78a6149cea2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.893132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f875292b-06bf-412c-be88-a78a6149cea2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:55.894128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f875292b-06bf-412c-be88-a78a6149cea2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:55.894798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f875292b-06bf-412c-be88-a78a6149cea2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:56.013602 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e93456d6-a7ef-4ce1-a224-44193a95962a tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 204 len: 0 microversion: 2.57 time: 0.219838 Jul 26 20:07:56.017189 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2303/4677] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:07:55 2022] DELETE /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:07:56.044146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:56.047891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:56.062782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:56.063476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:56.065104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:56.065702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:56.205546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f875292b-06bf-412c-be88-a78a6149cea2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:56.214416 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f875292b-06bf-412c-be88-a78a6149cea2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.333997 Jul 26 20:07:56.223241 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2375/4678] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:55 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:07:56.293185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:56.308443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:56.311990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:56.314316 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8c46c54-b53c-4182-813f-3145af587807 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1362 microversion: 2.57 time: 0.288794 Jul 26 20:07:56.331223 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2304/4679] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:56 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:56.391482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1541590705", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "287d382c-eec4-43bb-95a9-783a796404b9"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:56.484247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] validate_networks() for [('287d382c-eec4-43bb-95a9-783a796404b9', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:07:56.515971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:56.518019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:56.528034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:56.528904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:56.530216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:56.531746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:57.132803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:57.181227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:57.183145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:57.214069 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-625bbfe7-e032-4650-9a94-304be782221d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.673948 Jul 26 20:07:57.219833 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2305/4680] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:56 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:07:57.225151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-2cf61312-68df-4ede-bf9a-67420bdd6b0e req-6d6b72b1-c48e-4ba8-bffd-cf6b2328da6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee82c1bd-f76d-4b07-b0f7-e05a78450c6b", "name": "network-vif-plugged", "status": "completed", "tag": "342e082d-c657-4ed1-bc89-6c042c5ccc30"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:57.271460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2cf61312-68df-4ede-bf9a-67420bdd6b0e req-6d6b72b1-c48e-4ba8-bffd-cf6b2328da6e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:57.271932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2cf61312-68df-4ede-bf9a-67420bdd6b0e req-6d6b72b1-c48e-4ba8-bffd-cf6b2328da6e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:57.286728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2cf61312-68df-4ede-bf9a-67420bdd6b0e req-6d6b72b1-c48e-4ba8-bffd-cf6b2328da6e service nova] Creating event network-vif-plugged:342e082d-c657-4ed1-bc89-6c042c5ccc30 for instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b on n-h1-708768-8 Jul 26 20:07:57.307459 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-2cf61312-68df-4ede-bf9a-67420bdd6b0e req-6d6b72b1-c48e-4ba8-bffd-cf6b2328da6e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086297 Jul 26 20:07:57.309601 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2306/4681] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:57.320674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc6628c9-5ae6-4ce3-86c4-8c490839c4b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:57.323457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc6628c9-5ae6-4ce3-86c4-8c490839c4b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:57.331473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:57.341676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc6628c9-5ae6-4ce3-86c4-8c490839c4b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:57.342040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc6628c9-5ae6-4ce3-86c4-8c490839c4b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:57.345900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc6628c9-5ae6-4ce3-86c4-8c490839c4b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:57.349621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc6628c9-5ae6-4ce3-86c4-8c490839c4b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:57.358082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:07:57.434805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:07:57.435434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:07:57.435706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:07:57.436113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:07:57.436719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:07:57.448980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:57.449631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:57.456953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:57.457541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:57.488803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:07:57.495622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for user 4418a0cb57744aa5a56a3fdcce0947cc and project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:07:57.512854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:07:57.515677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:07:57.584399 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e5a54f7-910b-409f-98e5-d670cac61e34 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201912 Jul 26 20:07:57.585728 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2376/4682] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:07:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:07:57.591103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:57.592029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:57.602503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:57.606596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:57.610340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:57.611262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:57.730086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:57.742492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:57.746429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:57.750733 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8f3a34fa-8d40-444c-a651-ffd923e75923 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1362 microversion: 2.57 time: 0.163822 Jul 26 20:07:57.759924 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2377/4683] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:57 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:57.769418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39386788-8ec7-4653-9fb9-ae3b87bb9982 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:57.770205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39386788-8ec7-4653-9fb9-ae3b87bb9982 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:57.801705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bc6628c9-5ae6-4ce3-86c4-8c490839c4b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:57.812236 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc6628c9-5ae6-4ce3-86c4-8c490839c4b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1309 microversion: 2.1 time: 0.501167 Jul 26 20:07:57.813703 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2307/4684] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:57 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1309 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:57.979574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-39386788-8ec7-4653-9fb9-ae3b87bb9982 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:57.989811 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39386788-8ec7-4653-9fb9-ae3b87bb9982 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1215 microversion: 2.1 time: 0.234673 Jul 26 20:07:57.994735 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2378/4685] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:57 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:58.243436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:58.244489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:58.272909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:58.274238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:58.277891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:58.279636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:58.634713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:58.647167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:58.648950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:58.650339 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68c2c73c-c82d-4a4d-b8db-1e12b4c71735 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.413898 Jul 26 20:07:58.651781 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2308/4686] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:58 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:58.782162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:58.794156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:58.825489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:58.827136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:58.828197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:58.828739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:58.837123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dbe0d172-98f1-4b02-9cc7-b3b4a6a7eb4b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:58.837794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dbe0d172-98f1-4b02-9cc7-b3b4a6a7eb4b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:58.855584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbe0d172-98f1-4b02-9cc7-b3b4a6a7eb4b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:58.856267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbe0d172-98f1-4b02-9cc7-b3b4a6a7eb4b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:58.862507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbe0d172-98f1-4b02-9cc7-b3b4a6a7eb4b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:58.865782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbe0d172-98f1-4b02-9cc7-b3b4a6a7eb4b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:59.017538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:59.019106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:59.028486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lazy-loading 'fault' on Instance uuid 8efbf8a8-5b15-4614-b3bf-6ab3eb847019 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:07:59.137071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:59.148888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:59.150967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7065c7efba154a1bbc0d543eb39543cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0378c24951ef4c32ad73264456f0cec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:59.152969 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11f39945-ab10-4fb1-b151-b8977801826d tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 200 len: 1367 microversion: 2.57 time: 0.380563 Jul 26 20:07:59.170863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2379/4687] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:58 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:07:59.181165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5d983a5d-93a6-4c0b-b10d-26fb2fd5b280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:59.182102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5d983a5d-93a6-4c0b-b10d-26fb2fd5b280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:59.194946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d983a5d-93a6-4c0b-b10d-26fb2fd5b280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:59.195686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d983a5d-93a6-4c0b-b10d-26fb2fd5b280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:59.196693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d983a5d-93a6-4c0b-b10d-26fb2fd5b280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:59.197298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d983a5d-93a6-4c0b-b10d-26fb2fd5b280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:59.318745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5d983a5d-93a6-4c0b-b10d-26fb2fd5b280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:59.335844 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5d983a5d-93a6-4c0b-b10d-26fb2fd5b280 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1211 microversion: 2.1 time: 0.163058 Jul 26 20:07:59.338168 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2380/4688] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:59 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1211 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:59.365074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c53ef817-f777-4c08-992f-c543aae253c3 req-7a71184f-1130-4edb-9f74-7421e7ba507e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c400aa-bca9-4bec-a8ef-e200c066995e", "name": "network-vif-plugged", "status": "completed", "tag": "10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:07:59.386087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c53ef817-f777-4c08-992f-c543aae253c3 req-7a71184f-1130-4edb-9f74-7421e7ba507e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:59.386778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c53ef817-f777-4c08-992f-c543aae253c3 req-7a71184f-1130-4edb-9f74-7421e7ba507e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:59.406620 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c53ef817-f777-4c08-992f-c543aae253c3 req-7a71184f-1130-4edb-9f74-7421e7ba507e service nova] Creating event network-vif-plugged:10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf for instance b2c400aa-bca9-4bec-a8ef-e200c066995e on n-h1-708768-8 Jul 26 20:07:59.412919 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c53ef817-f777-4c08-992f-c543aae253c3 req-7a71184f-1130-4edb-9f74-7421e7ba507e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073026 Jul 26 20:07:59.413903 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2381/4689] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:07:59.489995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dbe0d172-98f1-4b02-9cc7-b3b4a6a7eb4b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:07:59.498952 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dbe0d172-98f1-4b02-9cc7-b3b4a6a7eb4b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1309 microversion: 2.1 time: 0.666264 Jul 26 20:07:59.502674 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2309/4690] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:07:58 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1309 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:07:59.678115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:07:59.678930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:07:59.692199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:59.701725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:07:59.706357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:07:59.710025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:00.014848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:00.032657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:00.045532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:00.048998 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afcd8e26-d0fe-4b6e-a9cd-a0b6005bc86c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.375854 Jul 26 20:08:00.067908 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2382/4691] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:07:59 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:00.183096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:00.184669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] [instance: 8efbf8a8-5b15-4614-b3bf-6ab3eb847019] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:00.206901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:00.208379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:00.210274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:00.211102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:00.259855 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] HTTP exception thrown: Instance 8efbf8a8-5b15-4614-b3bf-6ab3eb847019 could not be found. Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Request method failure captured: Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 HTTP/1.1 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4El3kTdkPRVD9-eYkCkFklqFmn1oPtENWlA4Qk6Wda861hdkuPQCF7p1hWJpG8l1EFc7D7CjMz5JWyqgUAo_-ufuqlBYyQxj8u_Ez_7FpQxplX6Q4v4UcS5QnyeYJQkexvviwgO7sj3fFzxn5v4pTc20A137f0xWngNjUc2tuvb7RkE Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.57 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 0378c24951ef4c32ad73264456f0cec8 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerShowV257Test-712187638 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0378c24951ef4c32ad73264456f0cec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0378c24951ef4c32ad73264456f0cec8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0378c24951ef4c32ad73264456f0cec8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0378c24951ef4c32ad73264456f0cec8"}]}] Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerShowV257Test-712187638 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 0378c24951ef4c32ad73264456f0cec8 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerShowV257Test-712187638 Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerShowV257Test-712187638-project Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7065c7efba154a1bbc0d543eb39543cc Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerShowV257Test-712187638-project Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 8efbf8a8-5b15-4614-b3bf-6ab3eb847019 could not be found. Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8efbf8a8-5b15-4614-b3bf-6ab3eb847019'} Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8efbf8a8-5b15-4614-b3bf-6ab3eb847019 could not be found. Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8efbf8a8-5b15-4614-b3bf-6ab3eb847019 could not be found. Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:00.265426 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8efbf8a8-5b15-4614-b3bf-6ab3eb847019 could not be found. Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] Returning 404 to user: Instance 8efbf8a8-5b15-4614-b3bf-6ab3eb847019 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:08:00.271087 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ad3efe7-42bd-40f5-a5be-73ac064d33e6 tempest-ServerShowV257Test-712187638 tempest-ServerShowV257Test-712187638-project] 10.222.0.58 "GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019" status: 404 len: 111 microversion: 2.57 time: 0.090053 Jul 26 20:08:00.274414 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2310/4692] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:00 2022] GET /compute/v2.1/servers/8efbf8a8-5b15-4614-b3bf-6ab3eb847019 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:08:00.364495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17a397e8-9909-403b-8c48-a69fed8182f6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:00.365473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-17a397e8-9909-403b-8c48-a69fed8182f6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:00.371824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17a397e8-9909-403b-8c48-a69fed8182f6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:00.378382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17a397e8-9909-403b-8c48-a69fed8182f6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:00.384875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17a397e8-9909-403b-8c48-a69fed8182f6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:00.385461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17a397e8-9909-403b-8c48-a69fed8182f6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:00.524319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b72d755-f6a9-496c-b959-8f0ee3be9f5b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:00.525625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b72d755-f6a9-496c-b959-8f0ee3be9f5b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:00.538853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b72d755-f6a9-496c-b959-8f0ee3be9f5b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:00.540974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b72d755-f6a9-496c-b959-8f0ee3be9f5b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:00.542525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b72d755-f6a9-496c-b959-8f0ee3be9f5b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:00.545011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b72d755-f6a9-496c-b959-8f0ee3be9f5b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:00.611463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-17a397e8-9909-403b-8c48-a69fed8182f6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:00.623207 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-17a397e8-9909-403b-8c48-a69fed8182f6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1273 microversion: 2.1 time: 0.262470 Jul 26 20:08:00.630833 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2383/4693] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:00 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:01.076239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:01.076892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:01.087816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:01.088269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:01.089056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:01.100488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:01.210776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6b72d755-f6a9-496c-b959-8f0ee3be9f5b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:01.221539 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b72d755-f6a9-496c-b959-8f0ee3be9f5b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1490 microversion: 2.1 time: 0.701835 Jul 26 20:08:01.233005 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2311/4694] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:00 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1490 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:01.244735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9c030839-4682-4f0d-9af3-a5a39fdffb34 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:01.246312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9c030839-4682-4f0d-9af3-a5a39fdffb34 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:01.254421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c030839-4682-4f0d-9af3-a5a39fdffb34 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:01.255411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c030839-4682-4f0d-9af3-a5a39fdffb34 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:01.256395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c030839-4682-4f0d-9af3-a5a39fdffb34 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:01.256987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c030839-4682-4f0d-9af3-a5a39fdffb34 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:01.724133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9c030839-4682-4f0d-9af3-a5a39fdffb34 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:01.746741 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9c030839-4682-4f0d-9af3-a5a39fdffb34 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1490 microversion: 2.1 time: 0.503270 Jul 26 20:08:01.747495 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2312/4695] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:01 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1490 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:01.758989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1d3e2a1-7647-4846-8fd0-bf4e99da59f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:01.759730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1d3e2a1-7647-4846-8fd0-bf4e99da59f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:01.782644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1d3e2a1-7647-4846-8fd0-bf4e99da59f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:01.783373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1d3e2a1-7647-4846-8fd0-bf4e99da59f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:01.785890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1d3e2a1-7647-4846-8fd0-bf4e99da59f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:01.795005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1d3e2a1-7647-4846-8fd0-bf4e99da59f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:02.033644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c1d3e2a1-7647-4846-8fd0-bf4e99da59f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:02.063801 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1d3e2a1-7647-4846-8fd0-bf4e99da59f9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1273 microversion: 2.1 time: 0.314971 Jul 26 20:08:02.067687 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2313/4696] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:01 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1273 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:02.095481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9252473c-3176-4e26-b7db-2d78fbd76f2a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:02.097853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9252473c-3176-4e26-b7db-2d78fbd76f2a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:02.134584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9252473c-3176-4e26-b7db-2d78fbd76f2a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:02.135520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9252473c-3176-4e26-b7db-2d78fbd76f2a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:02.138332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9252473c-3176-4e26-b7db-2d78fbd76f2a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:02.139032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9252473c-3176-4e26-b7db-2d78fbd76f2a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:02.371019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:02.391100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:02.392885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:02.403155 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-acf14cbe-9427-42cf-9089-2083da3e5b4c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 1.322434 Jul 26 20:08:02.403856 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2384/4697] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:01 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:08:02.894738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9252473c-3176-4e26-b7db-2d78fbd76f2a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:02.908111 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9252473c-3176-4e26-b7db-2d78fbd76f2a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1490 microversion: 2.1 time: 0.836022 Jul 26 20:08:02.928455 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2314/4698] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:02 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1490 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:02.939194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-856fa928-aa4f-4cda-983c-e7e92c5f8911 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:02.941953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-856fa928-aa4f-4cda-983c-e7e92c5f8911 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:02.961562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-856fa928-aa4f-4cda-983c-e7e92c5f8911 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:02.962430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-856fa928-aa4f-4cda-983c-e7e92c5f8911 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:02.963773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-856fa928-aa4f-4cda-983c-e7e92c5f8911 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:02.968688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-856fa928-aa4f-4cda-983c-e7e92c5f8911 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:03.089665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7e3653a7-46e0-43cf-9760-543d6e07d99d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:03.090499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7e3653a7-46e0-43cf-9760-543d6e07d99d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:03.100981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7e3653a7-46e0-43cf-9760-543d6e07d99d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:03.105140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7e3653a7-46e0-43cf-9760-543d6e07d99d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:03.106207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7e3653a7-46e0-43cf-9760-543d6e07d99d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:03.107219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7e3653a7-46e0-43cf-9760-543d6e07d99d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:03.127457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-856fa928-aa4f-4cda-983c-e7e92c5f8911 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:08:03.402301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:03.472793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-856fa928-aa4f-4cda-983c-e7e92c5f8911 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 204 len: 0 microversion: 2.1 time: 0.543289 Jul 26 20:08:03.473944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2385/4699] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:08:02 2022] DELETE /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:08:03.480959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:03.491198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:03.507500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:03.508084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:03.508954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:03.509404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:03.891527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7e3653a7-46e0-43cf-9760-543d6e07d99d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:03.904024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7e3653a7-46e0-43cf-9760-543d6e07d99d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 0.819023 Jul 26 20:08:03.910158 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2315/4700] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:03 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:03.915759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8b33e53-b5ac-4bac-9595-661786fe2ef4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:03.922297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8b33e53-b5ac-4bac-9595-661786fe2ef4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:03.935046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8b33e53-b5ac-4bac-9595-661786fe2ef4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:03.935952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8b33e53-b5ac-4bac-9595-661786fe2ef4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:03.938477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8b33e53-b5ac-4bac-9595-661786fe2ef4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:03.941609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8b33e53-b5ac-4bac-9595-661786fe2ef4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:04.196388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:04.211843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:04.221020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:04.222841 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e1ecfcad-4734-4b9a-901d-101eb2b7e245 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.747548 Jul 26 20:08:04.223729 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2386/4701] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:03 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:04.413127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c8b33e53-b5ac-4bac-9595-661786fe2ef4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:04.428758 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8b33e53-b5ac-4bac-9595-661786fe2ef4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1496 microversion: 2.1 time: 0.517101 Jul 26 20:08:04.430962 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2316/4702] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:03 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1496 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:04.934504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-75725b7a-d5c5-4005-a041-55270d13956a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:04.935084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-75725b7a-d5c5-4005-a041-55270d13956a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:04.942983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75725b7a-d5c5-4005-a041-55270d13956a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:04.958453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75725b7a-d5c5-4005-a041-55270d13956a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:04.962614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75725b7a-d5c5-4005-a041-55270d13956a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:04.963370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75725b7a-d5c5-4005-a041-55270d13956a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:05.248812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:05.249780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:05.263417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:05.280056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:05.281562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:05.282004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:06.668670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-75725b7a-d5c5-4005-a041-55270d13956a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:06.686020 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-75725b7a-d5c5-4005-a041-55270d13956a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 1.755482 Jul 26 20:08:06.688112 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2387/4703] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:04 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:06.694642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-342e813f-f105-4503-bfb5-45fb00d4499a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:06.695540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-342e813f-f105-4503-bfb5-45fb00d4499a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:06.703889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-342e813f-f105-4503-bfb5-45fb00d4499a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:06.704650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-342e813f-f105-4503-bfb5-45fb00d4499a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:06.705672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-342e813f-f105-4503-bfb5-45fb00d4499a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:06.706309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-342e813f-f105-4503-bfb5-45fb00d4499a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:07.116201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-342e813f-f105-4503-bfb5-45fb00d4499a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:07.131404 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-342e813f-f105-4503-bfb5-45fb00d4499a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1496 microversion: 2.1 time: 0.441565 Jul 26 20:08:07.151600 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2388/4704] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:06 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1496 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:07.476836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:07.611696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2fb26b33-5587-406b-a1ee-2723bea6a186 tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] Calling method '.version_select at 0x7f8756ddcdc0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:07.710539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:07.743012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:07.756532 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2fb26b33-5587-406b-a1ee-2723bea6a186 tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418/defaults" status: 200 len: 371 microversion: 2.1 time: 0.603399 Jul 26 20:08:07.760568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:07.765327 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2389/4705] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 20:08:07 2022] GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418/defaults => generated 371 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:07.770615 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bbebd354-2db3-4daf-a951-5199c66c77c7 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 2.525847 Jul 26 20:08:07.771635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2317/4706] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:05 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 2530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:07.794466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3b0c561f-9312-4625-9ad0-dfd56405dee0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:07.795089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3b0c561f-9312-4625-9ad0-dfd56405dee0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:07.804896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b0c561f-9312-4625-9ad0-dfd56405dee0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:07.805454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e60883f9-aae0-4d3f-aed7-2123f61e7430 tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] Calling method '.version_select at 0x7f875eef14c0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:07.808179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b0c561f-9312-4625-9ad0-dfd56405dee0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:07.809280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b0c561f-9312-4625-9ad0-dfd56405dee0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:07.818823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b0c561f-9312-4625-9ad0-dfd56405dee0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:07.985026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:08.040627 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e60883f9-aae0-4d3f-aed7-2123f61e7430 tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418" status: 200 len: 371 microversion: 2.1 time: 0.266097 Jul 26 20:08:08.041233 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2318/4707] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 20:08:07 2022] GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418 => generated 371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:08.094887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b267d57c-11a0-45b8-9638-d3a3b6c4d749 tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] Calling method '.version_select at 0x7f8768346af0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:08.246656 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b267d57c-11a0-45b8-9638-d3a3b6c4d749 tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418/defaults" status: 200 len: 371 microversion: 2.1 time: 0.177994 Jul 26 20:08:08.247265 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2319/4708] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 20:08:08 2022] GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418/defaults => generated 371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:08.277614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-846f6830-6543-4624-a63f-e37f2e7a0ecf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:08.278244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-846f6830-6543-4624-a63f-e37f2e7a0ecf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:08.307229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-846f6830-6543-4624-a63f-e37f2e7a0ecf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:08.312365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-846f6830-6543-4624-a63f-e37f2e7a0ecf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:08.319656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-846f6830-6543-4624-a63f-e37f2e7a0ecf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:08.320284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-846f6830-6543-4624-a63f-e37f2e7a0ecf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:08.633913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3b0c561f-9312-4625-9ad0-dfd56405dee0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:08.667284 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3b0c561f-9312-4625-9ad0-dfd56405dee0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 0.900312 Jul 26 20:08:08.668652 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2390/4709] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:07 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:08.675395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d47ab582-a64f-4715-b00a-f8ff0b63660a tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] Calling method '.version_select at 0x7f8756d84d30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:08.729960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-846f6830-6543-4624-a63f-e37f2e7a0ecf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:08.752491 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-846f6830-6543-4624-a63f-e37f2e7a0ecf tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1496 microversion: 2.1 time: 0.500047 Jul 26 20:08:08.759260 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2320/4710] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:08 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1496 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:08.780488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f1bf3be9-7792-46ec-82bc-e722376d1739 req-e15e0bad-925f-4766-a12d-90a32d7a3881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4664633c-ca21-4d0e-afed-261a7443c79c", "tag": "4b0496bc-aa5b-4cd7-908b-084af6a3acbb"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:08.813122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f1bf3be9-7792-46ec-82bc-e722376d1739 req-e15e0bad-925f-4766-a12d-90a32d7a3881 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:08.816955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f1bf3be9-7792-46ec-82bc-e722376d1739 req-e15e0bad-925f-4766-a12d-90a32d7a3881 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:08.858548 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f1bf3be9-7792-46ec-82bc-e722376d1739 req-e15e0bad-925f-4766-a12d-90a32d7a3881 service nova] Creating event network-changed:4b0496bc-aa5b-4cd7-908b-084af6a3acbb for instance 4664633c-ca21-4d0e-afed-261a7443c79c on n-h2-708768-8 Jul 26 20:08:08.880672 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f1bf3be9-7792-46ec-82bc-e722376d1739 req-e15e0bad-925f-4766-a12d-90a32d7a3881 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116811 Jul 26 20:08:08.881337 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2321/4711] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:08.887457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:08.895192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:08.899402 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d47ab582-a64f-4715-b00a-f8ff0b63660a tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418" status: 200 len: 371 microversion: 2.1 time: 0.229046 Jul 26 20:08:08.908530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2391/4712] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 20:08:08 2022] GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418 => generated 371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:08.914294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:08.914675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:08.915802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:08.916249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:08.920902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2fd5d4c1-6b3a-401a-aefe-89400348ef88 tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] Calling method '.version_select at 0x7f87682dbd30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:09.205793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2fd5d4c1-6b3a-401a-aefe-89400348ef88 tempest-QuotasTestJSON-153292466 tempest-QuotasTestJSON-153292466-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418?user_id=8abdb4301af94639ab6dd5f981d621a0" status: 200 len: 371 microversion: 2.1 time: 0.294559 Jul 26 20:08:09.215894 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2392/4713] 10.222.0.58 () {58 vars in 1323 bytes} [Tue Jul 26 20:08:08 2022] GET /compute/v2.1/os-quota-sets/480ed99baaae45bca2d5bedb40392418?user_id=8abdb4301af94639ab6dd5f981d621a0 => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:09.618033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:09.644986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:09.646988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:09.659412 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-738e75db-b51c-415e-a370-9655e2be8ca1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.773014 Jul 26 20:08:09.660290 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2322/4714] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:08 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:09.692175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2b5aad26-02ee-4a75-9cd6-9483829841c7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:09.693086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2b5aad26-02ee-4a75-9cd6-9483829841c7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:09.706441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b5aad26-02ee-4a75-9cd6-9483829841c7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:09.707741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b5aad26-02ee-4a75-9cd6-9483829841c7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:09.708555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b5aad26-02ee-4a75-9cd6-9483829841c7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:09.713233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b5aad26-02ee-4a75-9cd6-9483829841c7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:09.793047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:09.798175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:09.829933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:09.832664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:09.838490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:09.841767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:10.022030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:10.032256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:10.034262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lazy-loading 'fault' on Instance uuid ee82c1bd-f76d-4b07-b0f7-e05a78450c6b {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:08:10.187955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:10.198245 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c261f99c-65ed-4ad1-b903-85e4dcdbd820 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 200 len: 1299 microversion: 2.1 time: 0.414981 Jul 26 20:08:10.201784 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2323/4715] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:09 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 1299 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:10.398205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b5aad26-02ee-4a75-9cd6-9483829841c7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:10.411203 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2b5aad26-02ee-4a75-9cd6-9483829841c7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 0.724063 Jul 26 20:08:10.424823 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2393/4716] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:09 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:10.684750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:10.685375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:10.708338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:10.708844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:10.709712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:10.710195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:10.998274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:11.012762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c7da0be6-4cd4-484c-9af6-5660e5337d95 req-7c2bba22-a99b-4be9-a7cd-db8f7d9cb7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee82c1bd-f76d-4b07-b0f7-e05a78450c6b", "name": "network-vif-deleted", "tag": "342e082d-c657-4ed1-bc89-6c042c5ccc30"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:11.043070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c7da0be6-4cd4-484c-9af6-5660e5337d95 req-7c2bba22-a99b-4be9-a7cd-db8f7d9cb7a6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.043536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c7da0be6-4cd4-484c-9af6-5660e5337d95 req-7c2bba22-a99b-4be9-a7cd-db8f7d9cb7a6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:11.048449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:11.050097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:11.051328 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2befd17f-abd6-4f54-aded-50abb2e3dee8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.371297 Jul 26 20:08:11.051946 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2324/4717] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:10 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:11.082946 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c7da0be6-4cd4-484c-9af6-5660e5337d95 req-7c2bba22-a99b-4be9-a7cd-db8f7d9cb7a6 service nova] Creating event network-vif-deleted:342e082d-c657-4ed1-bc89-6c042c5ccc30 for instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b on n-h1-708768-8 Jul 26 20:08:11.095176 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c7da0be6-4cd4-484c-9af6-5660e5337d95 req-7c2bba22-a99b-4be9-a7cd-db8f7d9cb7a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086192 Jul 26 20:08:11.096740 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2394/4718] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:11.228241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:11.229451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:11.240829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.241287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:11.246586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.247089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:11.308952 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b HTTP/1.1 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ee82c1bd-f76d-4b07-b0f7-e05a78450c6b'} Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:11.311541 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:11.316719 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:11.316719 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:11.316719 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:08:11.316719 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:08:11.316719 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:08:11.316719 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:08:11.318687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:08:11.319819 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf7dc56b-b51e-48ec-a13e-8ab59ccc3561 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 404 len: 111 microversion: 2.1 time: 0.096660 Jul 26 20:08:11.320918 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2325/4719] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:11 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:08:11.387222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-119711b9-9ea4-4da9-81eb-f1afbadc5e26 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:11.389461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-119711b9-9ea4-4da9-81eb-f1afbadc5e26 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:11.425084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-119711b9-9ea4-4da9-81eb-f1afbadc5e26 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.426966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-119711b9-9ea4-4da9-81eb-f1afbadc5e26 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:11.431531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-119711b9-9ea4-4da9-81eb-f1afbadc5e26 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.433525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-119711b9-9ea4-4da9-81eb-f1afbadc5e26 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:11.436935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bacbf03e-fdae-40be-988a-12f093512b06 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:11.437888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bacbf03e-fdae-40be-988a-12f093512b06 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:11.458218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bacbf03e-fdae-40be-988a-12f093512b06 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.458680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bacbf03e-fdae-40be-988a-12f093512b06 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:11.459477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bacbf03e-fdae-40be-988a-12f093512b06 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.459949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bacbf03e-fdae-40be-988a-12f093512b06 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:11.499134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-119711b9-9ea4-4da9-81eb-f1afbadc5e26 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:08:11.848351 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-119711b9-9ea4-4da9-81eb-f1afbadc5e26 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 204 len: 0 microversion: 2.1 time: 0.518733 Jul 26 20:08:11.849065 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2395/4720] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:08:11 2022] DELETE /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:08:11.858417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11640d35-b354-4fff-a73e-7ec8a1bb8eb8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:11.859556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11640d35-b354-4fff-a73e-7ec8a1bb8eb8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:11.898532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11640d35-b354-4fff-a73e-7ec8a1bb8eb8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.898998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11640d35-b354-4fff-a73e-7ec8a1bb8eb8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:11.914629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11640d35-b354-4fff-a73e-7ec8a1bb8eb8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:11.915544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11640d35-b354-4fff-a73e-7ec8a1bb8eb8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:12.213553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bacbf03e-fdae-40be-988a-12f093512b06 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:12.222573 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bacbf03e-fdae-40be-988a-12f093512b06 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 0.789594 Jul 26 20:08:12.232391 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2326/4721] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:11 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:12.237551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:12.257426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:12.287848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:12.287848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:12.307452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:12.307948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:12.404775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:12.725625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:12.737156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:12.738688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:12.746185 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6305756f-842d-4603-a4e9-d5fd2ca541d4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.512398 Jul 26 20:08:12.746819 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2327/4722] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:12 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:13.257010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f4db8991-2b11-42d5-b6f6-7545a92fb9d1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:13.257638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f4db8991-2b11-42d5-b6f6-7545a92fb9d1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:13.274691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4db8991-2b11-42d5-b6f6-7545a92fb9d1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:13.275155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4db8991-2b11-42d5-b6f6-7545a92fb9d1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:13.282687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4db8991-2b11-42d5-b6f6-7545a92fb9d1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:13.283151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4db8991-2b11-42d5-b6f6-7545a92fb9d1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:13.377307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11640d35-b354-4fff-a73e-7ec8a1bb8eb8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:13.403047 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11640d35-b354-4fff-a73e-7ec8a1bb8eb8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1496 microversion: 2.1 time: 1.548628 Jul 26 20:08:13.421230 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2396/4723] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:11 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1496 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:13.774779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:13.775748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:13.786943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:13.794103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:13.795777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:13.799203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:13.930883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f4db8991-2b11-42d5-b6f6-7545a92fb9d1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:13.948108 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f4db8991-2b11-42d5-b6f6-7545a92fb9d1 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 0.693400 Jul 26 20:08:13.949179 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2328/4724] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:13 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:14.393473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:14.418574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:14.433406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab871abb-b7c8-433d-8657-75ad9ecc07c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:14.435603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab871abb-b7c8-433d-8657-75ad9ecc07c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:14.453989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:14.455460 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b311986-f7ad-450c-bc9f-3087b0b61ea2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.684954 Jul 26 20:08:14.461285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2397/4725] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:13 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:08:14.462765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab871abb-b7c8-433d-8657-75ad9ecc07c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:14.466637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab871abb-b7c8-433d-8657-75ad9ecc07c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:14.467886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab871abb-b7c8-433d-8657-75ad9ecc07c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:14.471893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab871abb-b7c8-433d-8657-75ad9ecc07c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:14.968933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab871abb-b7c8-433d-8657-75ad9ecc07c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:14.972972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-32d3b221-85e2-462e-b67c-921c5709421e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:14.987913 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab871abb-b7c8-433d-8657-75ad9ecc07c8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1496 microversion: 2.1 time: 0.562455 Jul 26 20:08:14.997486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-32d3b221-85e2-462e-b67c-921c5709421e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:15.017277 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2329/4726] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:14 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1496 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:15.020461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32d3b221-85e2-462e-b67c-921c5709421e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:15.021763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32d3b221-85e2-462e-b67c-921c5709421e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:15.025520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32d3b221-85e2-462e-b67c-921c5709421e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:15.026320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32d3b221-85e2-462e-b67c-921c5709421e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:15.448095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-32d3b221-85e2-462e-b67c-921c5709421e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:15.458472 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-32d3b221-85e2-462e-b67c-921c5709421e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 0.489393 Jul 26 20:08:15.462944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2398/4727] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:14 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:15.486223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:15.487679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:15.500867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:15.501567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:15.502551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:15.506452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:15.745110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-7eb17e76-bc38-499a-8b08-c10ae927f54c req-bbb23403-54bc-4b24-a09d-9deb41f0df82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768b4ba6-2004-4836-9d49-4d9d4631f51e", "name": "network-vif-deleted", "tag": "658b86f4-4d61-4cb0-8934-3796ec5c18ff"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:15.795317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7eb17e76-bc38-499a-8b08-c10ae927f54c req-bbb23403-54bc-4b24-a09d-9deb41f0df82 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:15.795810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-7eb17e76-bc38-499a-8b08-c10ae927f54c req-bbb23403-54bc-4b24-a09d-9deb41f0df82 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:15.843501 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-7eb17e76-bc38-499a-8b08-c10ae927f54c req-bbb23403-54bc-4b24-a09d-9deb41f0df82 service nova] Creating event network-vif-deleted:658b86f4-4d61-4cb0-8934-3796ec5c18ff for instance 768b4ba6-2004-4836-9d49-4d9d4631f51e on n-h1-708768-8 Jul 26 20:08:15.851859 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-7eb17e76-bc38-499a-8b08-c10ae927f54c req-bbb23403-54bc-4b24-a09d-9deb41f0df82 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111947 Jul 26 20:08:15.853518 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2399/4728] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:16.019645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:16.024698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:16.049985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:16.050660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:16.053932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:16.056541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:16.132998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:16.143124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:16.158160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:16.159467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:16.163942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lazy-loading 'fault' on Instance uuid 768b4ba6-2004-4836-9d49-4d9d4631f51e {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:08:16.169496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:16.171698 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d11a255b-240e-4543-a20c-6a40a52b2c03 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.689547 Jul 26 20:08:16.180826 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2330/4729] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:15 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:16.430886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:16.448572 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b965cbe-f993-4b5c-8ee2-0e83f325a143 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 200 len: 1299 microversion: 2.1 time: 0.431051 Jul 26 20:08:16.453353 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2400/4730] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:16 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 1299 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:16.486398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a496018-64bb-4c7d-88c2-02bb79311b94 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:16.489497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a496018-64bb-4c7d-88c2-02bb79311b94 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:16.508314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a496018-64bb-4c7d-88c2-02bb79311b94 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:16.515571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a496018-64bb-4c7d-88c2-02bb79311b94 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:16.520901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a496018-64bb-4c7d-88c2-02bb79311b94 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:16.521731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a496018-64bb-4c7d-88c2-02bb79311b94 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:16.758611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d27a8654-6360-42bf-8223-9c50445a3da1 req-f4cb632e-d58b-4fec-b7a7-72f785ef54bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4664633c-ca21-4d0e-afed-261a7443c79c", "name": "network-vif-plugged", "status": "completed", "tag": "4b0496bc-aa5b-4cd7-908b-084af6a3acbb"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:16.782800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d27a8654-6360-42bf-8223-9c50445a3da1 req-f4cb632e-d58b-4fec-b7a7-72f785ef54bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:16.784027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d27a8654-6360-42bf-8223-9c50445a3da1 req-f4cb632e-d58b-4fec-b7a7-72f785ef54bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:16.817601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a496018-64bb-4c7d-88c2-02bb79311b94 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:16.830653 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d27a8654-6360-42bf-8223-9c50445a3da1 req-f4cb632e-d58b-4fec-b7a7-72f785ef54bb service nova] Creating event network-vif-plugged:4b0496bc-aa5b-4cd7-908b-084af6a3acbb for instance 4664633c-ca21-4d0e-afed-261a7443c79c on n-h2-708768-8 Jul 26 20:08:16.833164 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a496018-64bb-4c7d-88c2-02bb79311b94 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 0.349406 Jul 26 20:08:16.833774 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2331/4731] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:16 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:16.841200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d27a8654-6360-42bf-8223-9c50445a3da1 req-f4cb632e-d58b-4fec-b7a7-72f785ef54bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096578 Jul 26 20:08:16.842594 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2401/4732] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:17.212149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:17.212830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:17.229828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:17.233861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:17.234941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:17.236117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:17.488611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:17.489569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:17.506673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:17.512300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:17.513395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:17.514026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:17.558389 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e HTTP/1.1 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '768b4ba6-2004-4836-9d49-4d9d4631f51e'} Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:17.560153 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:17.566349 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:17.566349 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:17.566349 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:08:17.566349 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:08:17.566349 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:08:17.566349 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:17.566349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:08:17.566349 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b218378-4b37-4d8b-9ba7-56dee2383bf9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 404 len: 111 microversion: 2.1 time: 0.087173 Jul 26 20:08:17.579696 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2402/4733] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:17 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:08:17.617844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:17.642033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:17.647461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:17.649668 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9b99878f-4f20-4ebb-bc11-a1f77a643c37 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.442892 Jul 26 20:08:17.679714 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2332/4734] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:17 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:17.820545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-725065047", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "a0732ca0-0b24-4753-bcca-055b8f396991"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:17.859361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ddeb907-513e-4707-8fcc-f590cd62cf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:17.860461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ddeb907-513e-4707-8fcc-f590cd62cf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:17.877669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ddeb907-513e-4707-8fcc-f590cd62cf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:17.879050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ddeb907-513e-4707-8fcc-f590cd62cf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:17.881683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ddeb907-513e-4707-8fcc-f590cd62cf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:17.882758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ddeb907-513e-4707-8fcc-f590cd62cf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:17.914345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] validate_networks() for [('a0732ca0-0b24-4753-bcca-055b8f396991', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:08:18.015422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:18.354314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ddeb907-513e-4707-8fcc-f590cd62cf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:18.364051 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ddeb907-513e-4707-8fcc-f590cd62cf21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1315 microversion: 2.1 time: 0.509842 Jul 26 20:08:18.370527 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2333/4735] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:17 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:18.685169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:18.685870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:18.700307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:18.700755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:18.705868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:18.706582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:19.147742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:19.163226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:08:19.164246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:08:19.165452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:08:19.166432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:08:19.167950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:08:19.194279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:19.196189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:19.203124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:19.203957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:19.246581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:19.263249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:08:19.277586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:08:19.312581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:19.312819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:08:19.318416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:08:19.329438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:19.339019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:19.343678 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7f3a7be8-5771-4a2e-8607-adb397d0613a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.663171 Jul 26 20:08:19.347276 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2334/4736] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:18 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:08:19.385758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ae5fe51-5802-48f5-8bb3-c724b0064913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:19.386389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ae5fe51-5802-48f5-8bb3-c724b0064913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:19.402549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ae5fe51-5802-48f5-8bb3-c724b0064913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:19.403163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ae5fe51-5802-48f5-8bb3-c724b0064913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:19.404108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ae5fe51-5802-48f5-8bb3-c724b0064913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:19.404557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ae5fe51-5802-48f5-8bb3-c724b0064913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:19.448424 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed7738e3-42ca-4726-9a99-ea83430c44a4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631704 Jul 26 20:08:19.450204 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2403/4737] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:08:19.462717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6bcad1f2-8598-427e-89d1-c26018d20dea tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:19.463782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6bcad1f2-8598-427e-89d1-c26018d20dea tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:19.629151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6bcad1f2-8598-427e-89d1-c26018d20dea tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:19.642091 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6bcad1f2-8598-427e-89d1-c26018d20dea tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1208 microversion: 2.1 time: 0.184134 Jul 26 20:08:19.643019 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2404/4738] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:19 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1208 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:20.044435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ae5fe51-5802-48f5-8bb3-c724b0064913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:20.066084 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ae5fe51-5802-48f5-8bb3-c724b0064913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1502 microversion: 2.1 time: 0.684912 Jul 26 20:08:20.068512 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2335/4739] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:19 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1502 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:20.091367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1974f3a-810e-444f-ba33-d91c0f5c1f4e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:20.091896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a1974f3a-810e-444f-ba33-d91c0f5c1f4e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:20.106677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1974f3a-810e-444f-ba33-d91c0f5c1f4e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:20.110276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1974f3a-810e-444f-ba33-d91c0f5c1f4e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:20.111589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1974f3a-810e-444f-ba33-d91c0f5c1f4e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:20.114544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1974f3a-810e-444f-ba33-d91c0f5c1f4e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:20.199015 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1974f3a-810e-444f-ba33-d91c0f5c1f4e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.114443 Jul 26 20:08:20.200731 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2405/4740] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:20 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:08:20.371860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:20.372543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:20.393665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:20.394203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:20.404211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:20.404500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:20.664655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d735a4f6-a6fa-407d-afca-5674f6d76c8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:20.665638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d735a4f6-a6fa-407d-afca-5674f6d76c8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:20.701383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d735a4f6-a6fa-407d-afca-5674f6d76c8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:20.701856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d735a4f6-a6fa-407d-afca-5674f6d76c8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:20.703032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d735a4f6-a6fa-407d-afca-5674f6d76c8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:20.703489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d735a4f6-a6fa-407d-afca-5674f6d76c8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:20.820572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:20.833834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:20.844576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:20.846114 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00f3c13e-6d07-499f-be42-5a3570bb3f32 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.479145 Jul 26 20:08:20.854306 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2336/4741] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:20 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:20.941411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d735a4f6-a6fa-407d-afca-5674f6d76c8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:20.961939 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d735a4f6-a6fa-407d-afca-5674f6d76c8b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1204 microversion: 2.1 time: 0.301717 Jul 26 20:08:20.963711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2406/4742] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:20 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1204 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:21.213644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-499301db-5518-4c6a-ba8e-8ed472fac35d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:21.216952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-499301db-5518-4c6a-ba8e-8ed472fac35d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:21.241747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-499301db-5518-4c6a-ba8e-8ed472fac35d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:21.242892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-499301db-5518-4c6a-ba8e-8ed472fac35d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:21.246001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-499301db-5518-4c6a-ba8e-8ed472fac35d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:21.248120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-499301db-5518-4c6a-ba8e-8ed472fac35d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:21.342632 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-499301db-5518-4c6a-ba8e-8ed472fac35d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.133845 Jul 26 20:08:21.347168 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2337/4743] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:21 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:08:21.870714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:21.871569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:21.896189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:21.898081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:21.901806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:21.904144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:21.986012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca8cf34f-dff3-406b-baa2-347673786fe6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:21.987488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca8cf34f-dff3-406b-baa2-347673786fe6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:22.003024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8cf34f-dff3-406b-baa2-347673786fe6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:22.008422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8cf34f-dff3-406b-baa2-347673786fe6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:22.013202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8cf34f-dff3-406b-baa2-347673786fe6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:22.016768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8cf34f-dff3-406b-baa2-347673786fe6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:22.308452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ca8cf34f-dff3-406b-baa2-347673786fe6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:22.323555 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ca8cf34f-dff3-406b-baa2-347673786fe6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1266 microversion: 2.1 time: 0.342415 Jul 26 20:08:22.330390 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2338/4744] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:21 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:22.355180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-07636d0f-13ce-4d1d-b1e3-bbf15e53a174 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:22.357465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-07636d0f-13ce-4d1d-b1e3-bbf15e53a174 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:22.378923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07636d0f-13ce-4d1d-b1e3-bbf15e53a174 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:22.382818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07636d0f-13ce-4d1d-b1e3-bbf15e53a174 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:22.383904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07636d0f-13ce-4d1d-b1e3-bbf15e53a174 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:22.388291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07636d0f-13ce-4d1d-b1e3-bbf15e53a174 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:22.476846 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-07636d0f-13ce-4d1d-b1e3-bbf15e53a174 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.125593 Jul 26 20:08:22.477509 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2339/4745] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:22 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:08:22.709655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:22.727851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:22.729707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:22.730969 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-af5ca621-37d3-48df-ba89-f746547d9b5a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 0.864223 Jul 26 20:08:22.735961 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2407/4746] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:21 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:23.349560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32f0a775-aa23-4ebb-9623-be435a3d26a7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:23.350276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32f0a775-aa23-4ebb-9623-be435a3d26a7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:23.362335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32f0a775-aa23-4ebb-9623-be435a3d26a7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:23.362794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32f0a775-aa23-4ebb-9623-be435a3d26a7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:23.363582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32f0a775-aa23-4ebb-9623-be435a3d26a7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:23.364048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32f0a775-aa23-4ebb-9623-be435a3d26a7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:23.488482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-303d82f5-f06c-407b-bf7d-bdd49335caec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:23.490850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-303d82f5-f06c-407b-bf7d-bdd49335caec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:23.506454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-303d82f5-f06c-407b-bf7d-bdd49335caec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:23.506921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-303d82f5-f06c-407b-bf7d-bdd49335caec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:23.507749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-303d82f5-f06c-407b-bf7d-bdd49335caec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:23.508204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-303d82f5-f06c-407b-bf7d-bdd49335caec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:23.619716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:23.694247 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-303d82f5-f06c-407b-bf7d-bdd49335caec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.208904 Jul 26 20:08:23.716083 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2408/4747] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:23 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:08:23.761754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:23.762870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:23.803519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:23.804314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:23.816776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:23.818090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:23.965645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-32f0a775-aa23-4ebb-9623-be435a3d26a7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:23.973947 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32f0a775-aa23-4ebb-9623-be435a3d26a7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.629328 Jul 26 20:08:23.974542 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2340/4748] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:23 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:24.724350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b7b50f77-9458-4603-9052-45d56ffc5b7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:24.726480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b7b50f77-9458-4603-9052-45d56ffc5b7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:24.777689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7b50f77-9458-4603-9052-45d56ffc5b7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:24.778268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7b50f77-9458-4603-9052-45d56ffc5b7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:24.785787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7b50f77-9458-4603-9052-45d56ffc5b7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:24.787716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7b50f77-9458-4603-9052-45d56ffc5b7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:24.809659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:24.828921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:24.831561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:24.837427 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-868f7809-8096-4d64-a9a8-b83c7fd3df8d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 1.081216 Jul 26 20:08:24.838070 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2409/4749] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:23 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:08:24.903137 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b7b50f77-9458-4603-9052-45d56ffc5b7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.184553 Jul 26 20:08:24.904458 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2341/4750] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:24 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:08:24.998007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9c651da-cdd1-4d3f-ab1c-3835dff2da7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:24.998783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9c651da-cdd1-4d3f-ab1c-3835dff2da7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:25.029711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9c651da-cdd1-4d3f-ab1c-3835dff2da7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:25.029711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9c651da-cdd1-4d3f-ab1c-3835dff2da7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:25.029711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9c651da-cdd1-4d3f-ab1c-3835dff2da7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:25.029711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9c651da-cdd1-4d3f-ab1c-3835dff2da7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:25.870197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:25.870990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:25.910942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:25.916246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:25.917231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:25.917686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:25.956436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9c651da-cdd1-4d3f-ab1c-3835dff2da7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:25.972138 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9c651da-cdd1-4d3f-ab1c-3835dff2da7f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.977891 Jul 26 20:08:25.987472 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2410/4751] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:24 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:26.001773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16ae7610-0d00-4ce3-9ee0-ca66a8d7bf8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:26.009619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-16ae7610-0d00-4ce3-9ee0-ca66a8d7bf8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:26.032921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16ae7610-0d00-4ce3-9ee0-ca66a8d7bf8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:26.070913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16ae7610-0d00-4ce3-9ee0-ca66a8d7bf8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:26.073825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16ae7610-0d00-4ce3-9ee0-ca66a8d7bf8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:26.076410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16ae7610-0d00-4ce3-9ee0-ca66a8d7bf8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:26.196957 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16ae7610-0d00-4ce3-9ee0-ca66a8d7bf8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.207718 Jul 26 20:08:26.201076 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2411/4752] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:25 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:08:26.583502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-87294cae-0c53-4581-adfe-28e688d9aab5 req-b344f512-2c0e-4fab-901f-cf82e4e604e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0dccb7-be62-47f4-b233-c17fb1dc8856", "tag": "6fe5347a-c436-4c1e-a63c-254b26fa32aa"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:26.604821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-87294cae-0c53-4581-adfe-28e688d9aab5 req-b344f512-2c0e-4fab-901f-cf82e4e604e8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:26.606135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-87294cae-0c53-4581-adfe-28e688d9aab5 req-b344f512-2c0e-4fab-901f-cf82e4e604e8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:26.637705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-87294cae-0c53-4581-adfe-28e688d9aab5 req-b344f512-2c0e-4fab-901f-cf82e4e604e8 service nova] Creating event network-changed:6fe5347a-c436-4c1e-a63c-254b26fa32aa for instance db0dccb7-be62-47f4-b233-c17fb1dc8856 on n-h1-708768-8 Jul 26 20:08:26.661494 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-87294cae-0c53-4581-adfe-28e688d9aab5 req-b344f512-2c0e-4fab-901f-cf82e4e604e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.442473 Jul 26 20:08:26.662925 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2412/4753] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:26.997591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-537bc2bd-feb9-4747-afb1-fefb3c195dd9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:26.998305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-537bc2bd-feb9-4747-afb1-fefb3c195dd9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:27.055863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-537bc2bd-feb9-4747-afb1-fefb3c195dd9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:27.057682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-537bc2bd-feb9-4747-afb1-fefb3c195dd9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:27.059735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-537bc2bd-feb9-4747-afb1-fefb3c195dd9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:27.061213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-537bc2bd-feb9-4747-afb1-fefb3c195dd9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:27.410139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-537bc2bd-feb9-4747-afb1-fefb3c195dd9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:27.422693 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-537bc2bd-feb9-4747-afb1-fefb3c195dd9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.430047 Jul 26 20:08:27.438211 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2413/4754] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:26 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:27.450716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d34f4b1b-4ab8-401f-88f6-28efdbed2d1b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:27.457442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d34f4b1b-4ab8-401f-88f6-28efdbed2d1b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:27.471161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d34f4b1b-4ab8-401f-88f6-28efdbed2d1b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:27.474873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d34f4b1b-4ab8-401f-88f6-28efdbed2d1b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:27.475962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d34f4b1b-4ab8-401f-88f6-28efdbed2d1b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:27.479945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d34f4b1b-4ab8-401f-88f6-28efdbed2d1b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:27.550860 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d34f4b1b-4ab8-401f-88f6-28efdbed2d1b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.108469 Jul 26 20:08:27.550860 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2414/4755] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:27 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:08:27.628974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:27.643559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:27.645892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:27.647676 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a66cc048-acf5-4c17-8809-a82bfef955f5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1739 microversion: 2.20 time: 1.782920 Jul 26 20:08:27.648874 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2342/4756] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:25 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1739 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:28.200956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1ff7da07-86ca-4e84-a6dc-e50bf819bc14 req-444765d5-2442-4f28-9237-36126f0565e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c400aa-bca9-4bec-a8ef-e200c066995e", "name": "network-vif-unplugged", "status": "completed", "tag": "10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:28.226129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1ff7da07-86ca-4e84-a6dc-e50bf819bc14 req-444765d5-2442-4f28-9237-36126f0565e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:28.226966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1ff7da07-86ca-4e84-a6dc-e50bf819bc14 req-444765d5-2442-4f28-9237-36126f0565e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:28.256767 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1ff7da07-86ca-4e84-a6dc-e50bf819bc14 req-444765d5-2442-4f28-9237-36126f0565e2 service nova] Creating event network-vif-unplugged:10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf for instance b2c400aa-bca9-4bec-a8ef-e200c066995e on n-h1-708768-8 Jul 26 20:08:28.266088 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1ff7da07-86ca-4e84-a6dc-e50bf819bc14 req-444765d5-2442-4f28-9237-36126f0565e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069134 Jul 26 20:08:28.267498 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2415/4757] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:28.447496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e8c1ba4-7585-4d4c-bf52-7b66e229ee24 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:28.448151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9e8c1ba4-7585-4d4c-bf52-7b66e229ee24 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:28.451033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=75 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:28.472562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8c1ba4-7585-4d4c-bf52-7b66e229ee24 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:28.473012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8c1ba4-7585-4d4c-bf52-7b66e229ee24 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:28.473787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8c1ba4-7585-4d4c-bf52-7b66e229ee24 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:28.474222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8c1ba4-7585-4d4c-bf52-7b66e229ee24 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:28.563168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1cfb354-a9f8-45b5-823e-e020755de543 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:28.566338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f1cfb354-a9f8-45b5-823e-e020755de543 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:28.581701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1cfb354-a9f8-45b5-823e-e020755de543 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:28.587368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1cfb354-a9f8-45b5-823e-e020755de543 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:28.588418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1cfb354-a9f8-45b5-823e-e020755de543 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:28.589107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1cfb354-a9f8-45b5-823e-e020755de543 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:28.677174 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f1cfb354-a9f8-45b5-823e-e020755de543 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.119248 Jul 26 20:08:28.678567 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2416/4758] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:28 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:08:28.684209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:28.685260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:28.704514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:28.706870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:28.708087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:28.710378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:28.819112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e8c1ba4-7585-4d4c-bf52-7b66e229ee24 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:28.829715 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e8c1ba4-7585-4d4c-bf52-7b66e229ee24 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.386967 Jul 26 20:08:28.830767 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2343/4759] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:28 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:29.143836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:29.153166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:29.156171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:29.157583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fde5d79a-5e2f-433d-9ec8-c25f48ce6dfb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1721 microversion: 2.20 time: 0.477577 Jul 26 20:08:29.158164 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2417/4760] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:28 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1721 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:29.697523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d47c2026-9ab5-4201-af28-e3b7d00c3aa5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:29.699791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d47c2026-9ab5-4201-af28-e3b7d00c3aa5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:29.713832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d47c2026-9ab5-4201-af28-e3b7d00c3aa5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:29.715041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d47c2026-9ab5-4201-af28-e3b7d00c3aa5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:29.715874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d47c2026-9ab5-4201-af28-e3b7d00c3aa5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:29.717023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d47c2026-9ab5-4201-af28-e3b7d00c3aa5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:29.814797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d47c2026-9ab5-4201-af28-e3b7d00c3aa5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 14 microversion: 2.1 time: 0.129549 Jul 26 20:08:29.815757 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2344/4761] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:29 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:08:29.853524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7468de92-661f-4359-899a-74af4dea03d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:29.854880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7468de92-661f-4359-899a-74af4dea03d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:29.865329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:29.867185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:29.869125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7468de92-661f-4359-899a-74af4dea03d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:29.869747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7468de92-661f-4359-899a-74af4dea03d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:29.870796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7468de92-661f-4359-899a-74af4dea03d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:29.871396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7468de92-661f-4359-899a-74af4dea03d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:30.183221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:30.184124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:30.204150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:30.204596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:30.205379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:30.205811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:30.254381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:30.342694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7468de92-661f-4359-899a-74af4dea03d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:30.357874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7468de92-661f-4359-899a-74af4dea03d7 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.506703 Jul 26 20:08:30.363492 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2418/4762] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:29 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:30.701389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:30.725482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:30.743551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:30.751904 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ac0ebe8-4cb9-4387-a73f-44d7faa6e3df tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1721 microversion: 2.20 time: 0.573007 Jul 26 20:08:30.754122 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2345/4763] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:30 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1721 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:30.826456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-81f7476a-83c2-49d0-9705-16204a9b8c0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:30.829866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-81f7476a-83c2-49d0-9705-16204a9b8c0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:30.864172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81f7476a-83c2-49d0-9705-16204a9b8c0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:30.866709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81f7476a-83c2-49d0-9705-16204a9b8c0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:30.868569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81f7476a-83c2-49d0-9705-16204a9b8c0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:30.869631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81f7476a-83c2-49d0-9705-16204a9b8c0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:30.936395 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-81f7476a-83c2-49d0-9705-16204a9b8c0e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action" status: 200 len: 8205 microversion: 2.1 time: 0.114061 Jul 26 20:08:30.943651 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2419/4764] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:30 2022] POST /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c/action => generated 8205 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:30.948545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3996374-fe3c-4e7e-b98d-5d4b5cf47e5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:30.949357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e3996374-fe3c-4e7e-b98d-5d4b5cf47e5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:30.967652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3996374-fe3c-4e7e-b98d-5d4b5cf47e5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:30.968803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3996374-fe3c-4e7e-b98d-5d4b5cf47e5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:30.969706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3996374-fe3c-4e7e-b98d-5d4b5cf47e5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:30.970242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3996374-fe3c-4e7e-b98d-5d4b5cf47e5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:31.380682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e007d1c4-2270-415c-8531-5208c260d3bc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:31.381764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e007d1c4-2270-415c-8531-5208c260d3bc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:31.409561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e007d1c4-2270-415c-8531-5208c260d3bc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:31.410579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e007d1c4-2270-415c-8531-5208c260d3bc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:31.411875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e3996374-fe3c-4e7e-b98d-5d4b5cf47e5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:31.412466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e007d1c4-2270-415c-8531-5208c260d3bc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:31.412942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e007d1c4-2270-415c-8531-5208c260d3bc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:31.423367 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e3996374-fe3c-4e7e-b98d-5d4b5cf47e5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.479003 Jul 26 20:08:31.428752 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2346/4765] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:30 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:31.459183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8f92312c-b9db-4447-89ef-1e51201d0899 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:31.460025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8f92312c-b9db-4447-89ef-1e51201d0899 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:31.470735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f92312c-b9db-4447-89ef-1e51201d0899 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:31.473132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f92312c-b9db-4447-89ef-1e51201d0899 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:31.478672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f92312c-b9db-4447-89ef-1e51201d0899 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:31.479371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f92312c-b9db-4447-89ef-1e51201d0899 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:31.786948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8f92312c-b9db-4447-89ef-1e51201d0899 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:31.804884 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8f92312c-b9db-4447-89ef-1e51201d0899 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.350099 Jul 26 20:08:31.820019 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2347/4766] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:31 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:31.827689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6dc07445-b2a0-4f05-8f22-0b9194e3b259 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'create', calling method: .version_select at 0x7f875ecfe280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-870306802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfDjngzqgR5xx1ycZzdjhc8+JXDPywiY1fk6bL0ybxQ97fYqSUFPHBMZdMEDpfaYyVNV9JhGD4OanetvMDvxZ1D5gBDT5DBHgw7HRciC6onViIbwErnlSH65p7mecNz+Q=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:31.848725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6dc07445-b2a0-4f05-8f22-0b9194e3b259 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for project d237549546cf478aa27cf8759a57d4b4. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:08:31.855208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6dc07445-b2a0-4f05-8f22-0b9194e3b259 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for user 84e081d584b34009a7bbfbc2a6c14436 and project d237549546cf478aa27cf8759a57d4b4. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:08:31.931394 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6dc07445-b2a0-4f05-8f22-0b9194e3b259 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.090277 Jul 26 20:08:31.934041 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2348/4767] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:08:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:31.953348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:31.955282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:31.975017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:31.975752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:31.977110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:31.977898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:32.086200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e007d1c4-2270-415c-8531-5208c260d3bc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:32.096184 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e007d1c4-2270-415c-8531-5208c260d3bc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.719974 Jul 26 20:08:32.096791 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2420/4768] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:31 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:32.119475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a284f8d2-c104-44d3-9053-500914519ce6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:32.120236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a284f8d2-c104-44d3-9053-500914519ce6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:32.145710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a284f8d2-c104-44d3-9053-500914519ce6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:32.146673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a284f8d2-c104-44d3-9053-500914519ce6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:32.147718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a284f8d2-c104-44d3-9053-500914519ce6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:32.168669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a284f8d2-c104-44d3-9053-500914519ce6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:32.446568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:32.470207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:32.483474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:32.484931 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55a0e545-252d-43b8-9b9c-36400e1ab03b tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1664 microversion: 2.20 time: 0.547032 Jul 26 20:08:32.485513 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2349/4769] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:31 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1664 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:32.513295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-091bfa43-0ef9-4d6b-98a2-015ccf7361c0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32bee690-225e-4996-99f0-4c567e34a8b9"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:32.516541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-091bfa43-0ef9-4d6b-98a2-015ccf7361c0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:32.555456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-091bfa43-0ef9-4d6b-98a2-015ccf7361c0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:32.558493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-091bfa43-0ef9-4d6b-98a2-015ccf7361c0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:32.564634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-091bfa43-0ef9-4d6b-98a2-015ccf7361c0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:32.565829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-091bfa43-0ef9-4d6b-98a2-015ccf7361c0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:33.236375 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-091bfa43-0ef9-4d6b-98a2-015ccf7361c0 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.728229 Jul 26 20:08:33.238449 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2350/4770] 10.222.0.58 () {62 vars in 1364 bytes} [Tue Jul 26 20:08:32 2022] POST /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/os-volume_attachments => generated 188 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:08:33.269117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0a60b04-2c5f-450f-8026-fe6bc27957a2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:33.274595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0a60b04-2c5f-450f-8026-fe6bc27957a2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:33.317245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0a60b04-2c5f-450f-8026-fe6bc27957a2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:33.319242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0a60b04-2c5f-450f-8026-fe6bc27957a2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:33.324411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0a60b04-2c5f-450f-8026-fe6bc27957a2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:33.325126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0a60b04-2c5f-450f-8026-fe6bc27957a2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:33.411020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a284f8d2-c104-44d3-9053-500914519ce6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:33.433286 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a284f8d2-c104-44d3-9053-500914519ce6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 1.335429 Jul 26 20:08:33.433899 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2421/4771] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:32 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:33.460027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-52f9a29c-169f-4197-bd7f-5f3785b52028 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:33.460550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-52f9a29c-169f-4197-bd7f-5f3785b52028 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:33.478079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52f9a29c-169f-4197-bd7f-5f3785b52028 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:33.478794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52f9a29c-169f-4197-bd7f-5f3785b52028 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:33.479831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52f9a29c-169f-4197-bd7f-5f3785b52028 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:33.484828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52f9a29c-169f-4197-bd7f-5f3785b52028 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:33.651142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0a60b04-2c5f-450f-8026-fe6bc27957a2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:33.673736 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0a60b04-2c5f-450f-8026-fe6bc27957a2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.432127 Jul 26 20:08:33.693178 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2351/4772] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:33 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:33.718723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0bd4fdc-dd8c-4b27-ac7f-31ac489e5418 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:33.720512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0bd4fdc-dd8c-4b27-ac7f-31ac489e5418 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:33.739344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0bd4fdc-dd8c-4b27-ac7f-31ac489e5418 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:33.739986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0bd4fdc-dd8c-4b27-ac7f-31ac489e5418 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:33.742340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0bd4fdc-dd8c-4b27-ac7f-31ac489e5418 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:33.745754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0bd4fdc-dd8c-4b27-ac7f-31ac489e5418 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:33.980963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-52f9a29c-169f-4197-bd7f-5f3785b52028 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:33.993775 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-52f9a29c-169f-4197-bd7f-5f3785b52028 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.538327 Jul 26 20:08:33.997365 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2422/4773] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:33 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:34.049946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11104d55-1c56-4af2-92f3-fa3ae7ea0cdf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:34.056613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11104d55-1c56-4af2-92f3-fa3ae7ea0cdf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:34.078349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11104d55-1c56-4af2-92f3-fa3ae7ea0cdf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:34.078815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11104d55-1c56-4af2-92f3-fa3ae7ea0cdf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:34.079647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11104d55-1c56-4af2-92f3-fa3ae7ea0cdf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:34.080180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11104d55-1c56-4af2-92f3-fa3ae7ea0cdf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:34.175283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11104d55-1c56-4af2-92f3-fa3ae7ea0cdf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Locking {{(pid=125964) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 26 20:08:34.301170 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0bd4fdc-dd8c-4b27-ac7f-31ac489e5418 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/os-volume_attachments/32bee690-225e-4996-99f0-4c567e34a8b9" status: 202 len: 0 microversion: 2.20 time: 0.606482 Jul 26 20:08:34.307842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11104d55-1c56-4af2-92f3-fa3ae7ea0cdf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.289578 Jul 26 20:08:34.308398 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2352/4774] 10.222.0.58 () {60 vars in 1457 bytes} [Tue Jul 26 20:08:33 2022] DELETE /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/os-volume_attachments/32bee690-225e-4996-99f0-4c567e34a8b9 => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:08:34.310685 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2423/4775] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:34 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:08:34.336834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87f4fe4d-c41f-4362-afc4-cd0eb7c8d374 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:34.337870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87f4fe4d-c41f-4362-afc4-cd0eb7c8d374 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:34.348303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87f4fe4d-c41f-4362-afc4-cd0eb7c8d374 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:34.351406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87f4fe4d-c41f-4362-afc4-cd0eb7c8d374 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:34.353290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87f4fe4d-c41f-4362-afc4-cd0eb7c8d374 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:34.357747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87f4fe4d-c41f-4362-afc4-cd0eb7c8d374 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:34.444527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4b7da141-0ba5-4674-9ba2-3de4a0f04643 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:34.445191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4b7da141-0ba5-4674-9ba2-3de4a0f04643 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:34.458172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b7da141-0ba5-4674-9ba2-3de4a0f04643 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:34.458634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b7da141-0ba5-4674-9ba2-3de4a0f04643 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:34.464985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b7da141-0ba5-4674-9ba2-3de4a0f04643 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:34.466594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b7da141-0ba5-4674-9ba2-3de4a0f04643 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:34.665232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:34.726382 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4b7da141-0ba5-4674-9ba2-3de4a0f04643 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "POST /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/action" status: 202 len: 0 microversion: 2.20 time: 0.285880 Jul 26 20:08:34.732683 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2424/4776] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Jul 26 20:08:34 2022] POST /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:08:34.746927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2598bc9-9248-41cb-a4d5-dab87e8d5160 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:34.747584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c2598bc9-9248-41cb-a4d5-dab87e8d5160 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:34.764751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2598bc9-9248-41cb-a4d5-dab87e8d5160 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:34.765210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2598bc9-9248-41cb-a4d5-dab87e8d5160 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:34.765998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2598bc9-9248-41cb-a4d5-dab87e8d5160 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:34.775900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2598bc9-9248-41cb-a4d5-dab87e8d5160 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:35.441168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c2598bc9-9248-41cb-a4d5-dab87e8d5160 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:35.451870 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c2598bc9-9248-41cb-a4d5-dab87e8d5160 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.716524 Jul 26 20:08:35.460786 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2425/4777] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:34 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:35.476643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:35.477285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:35.501473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:35.502212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:35.503278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:35.503908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:35.911879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:35.921068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:35.925962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:35.929139 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3b60779f-f871-4c07-809f-8c119d27c1e4 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1672 microversion: 2.20 time: 0.467518 Jul 26 20:08:35.932179 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2426/4778] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:35 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1672 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:35.948076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-69abde12-5873-4e99-aa76-a2fbaf42d778 req-ec953d36-30cf-42a7-a5bb-f5a19e23cb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0dccb7-be62-47f4-b233-c17fb1dc8856", "name": "network-vif-plugged", "status": "completed", "tag": "6fe5347a-c436-4c1e-a63c-254b26fa32aa"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:35.969181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-69abde12-5873-4e99-aa76-a2fbaf42d778 req-ec953d36-30cf-42a7-a5bb-f5a19e23cb69 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:35.969963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-69abde12-5873-4e99-aa76-a2fbaf42d778 req-ec953d36-30cf-42a7-a5bb-f5a19e23cb69 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:36.034147 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-69abde12-5873-4e99-aa76-a2fbaf42d778 req-ec953d36-30cf-42a7-a5bb-f5a19e23cb69 service nova] Creating event network-vif-plugged:6fe5347a-c436-4c1e-a63c-254b26fa32aa for instance db0dccb7-be62-47f4-b233-c17fb1dc8856 on n-h1-708768-8 Jul 26 20:08:36.047674 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-69abde12-5873-4e99-aa76-a2fbaf42d778 req-ec953d36-30cf-42a7-a5bb-f5a19e23cb69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113479 Jul 26 20:08:36.048592 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2427/4779] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:36.064497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-87f4fe4d-c41f-4362-afc4-cd0eb7c8d374 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:36.087497 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87f4fe4d-c41f-4362-afc4-cd0eb7c8d374 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 1.756802 Jul 26 20:08:36.104330 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2353/4780] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:34 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:36.116627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4cff65d-198f-48d0-a927-3c2b90720f63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:36.131332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4cff65d-198f-48d0-a927-3c2b90720f63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:36.132136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4cff65d-198f-48d0-a927-3c2b90720f63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:36.193113 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b4cff65d-198f-48d0-a927-3c2b90720f63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] HTTP exception thrown: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a is locked Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4cff65d-198f-48d0-a927-3c2b90720f63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Request method failure captured: Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action HTTP/1.1 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 15 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ei0QX_lJ8whTwO9WSGuiAKHKrflLExw0BSW7z4oUba8si0AL2Ukxspb6VFnyhS6LCg0a8Dfdmuil90NN0QlrzOLQohElw745l5qLZNpFRC-CNaLF83G4OKB8E5U_7j0S5oTAasWoFwhJLV87nQ-FWOWeY6iqAS6y45nrPh2fHmcF9I Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7570797c1a94fbd94a4b7ee2796f526", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}] Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-927498204 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4418a0cb57744aa5a56a3fdcce0947cc Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: {"os-stop": {}} Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a is locked Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '3b78c879-17f2-46ef-a51b-c03307f19a5a', 'body': {'os-stop': {}}} Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a is locked Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a is locked Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a is locked Jul 26 20:08:36.195853 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:36.204583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4cff65d-198f-48d0-a927-3c2b90720f63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Returning 409 to user: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a is locked {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:08:36.205740 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4cff65d-198f-48d0-a927-3c2b90720f63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 409 len: 107 microversion: 2.1 time: 0.095843 Jul 26 20:08:36.206918 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2428/4781] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:36 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 107 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:08:36.219696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8089e46-d520-4aa7-a780-4d367c74a709 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:36.220257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8089e46-d520-4aa7-a780-4d367c74a709 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:36.236588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8089e46-d520-4aa7-a780-4d367c74a709 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:36.239911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8089e46-d520-4aa7-a780-4d367c74a709 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:36.240781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8089e46-d520-4aa7-a780-4d367c74a709 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:36.241225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8089e46-d520-4aa7-a780-4d367c74a709 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:36.309301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-673011775", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "b3f2d0a4-b403-4ea4-91ab-ddd7f74cde87"}], "key_name": "tempest-TestNetworkBasicOps-870306802", "security_groups": [{"name": "tempest-secgroup-smoke-1480564388"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:36.345150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8089e46-d520-4aa7-a780-4d367c74a709 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Unlocking {{(pid=125963) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 26 20:08:36.477441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8089e46-d520-4aa7-a780-4d367c74a709 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.265688 Jul 26 20:08:36.478255 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2354/4782] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:36 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:08:36.484420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91bb8f0e-1102-425b-8c82-b911698cd388 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:36.485379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-91bb8f0e-1102-425b-8c82-b911698cd388 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:36.493079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91bb8f0e-1102-425b-8c82-b911698cd388 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:36.493933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91bb8f0e-1102-425b-8c82-b911698cd388 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:36.495178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91bb8f0e-1102-425b-8c82-b911698cd388 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:36.496775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91bb8f0e-1102-425b-8c82-b911698cd388 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:36.527187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=7,nova_cell1:UPDATE=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:36.612620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] validate_networks() for [('b3f2d0a4-b403-4ea4-91ab-ddd7f74cde87', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:08:36.798792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-91bb8f0e-1102-425b-8c82-b911698cd388 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:36.811710 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91bb8f0e-1102-425b-8c82-b911698cd388 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1308 microversion: 2.1 time: 0.331933 Jul 26 20:08:36.813233 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2355/4783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:36 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:36.821433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de56079e-5e4f-44dc-ab39-268b8a984c63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:36.839017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de56079e-5e4f-44dc-ab39-268b8a984c63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:36.840115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de56079e-5e4f-44dc-ab39-268b8a984c63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:36.888311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de56079e-5e4f-44dc-ab39-268b8a984c63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Going to try to stop instance {{(pid=125963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:08:36.956691 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de56079e-5e4f-44dc-ab39-268b8a984c63 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.141523 Jul 26 20:08:36.957691 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2356/4784] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:36 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:08:36.964644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:36.965926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:36.974803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:36.975783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:36.977284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:36.977935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:37.195939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:08:37.196646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:08:37.197494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:08:37.198190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:08:37.198778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:08:37.217742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:37.218548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:37.219843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:37.220655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:37.229737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:37.251861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:37.253883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for project d237549546cf478aa27cf8759a57d4b4. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:08:37.254524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:37.255898 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1b213593-7f4f-4799-b2d7-dbc718aabc33 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1672 microversion: 2.20 time: 0.296171 Jul 26 20:08:37.256756 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2357/4785] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:36 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1672 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:37.261577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-986ca13b-6854-46b7-aaf9-eb11db189010 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:37.261753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for user 84e081d584b34009a7bbfbc2a6c14436 and project d237549546cf478aa27cf8759a57d4b4. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:08:37.262788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-986ca13b-6854-46b7-aaf9-eb11db189010 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:37.270705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-986ca13b-6854-46b7-aaf9-eb11db189010 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:37.271436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-986ca13b-6854-46b7-aaf9-eb11db189010 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:37.272635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-986ca13b-6854-46b7-aaf9-eb11db189010 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:37.273773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-986ca13b-6854-46b7-aaf9-eb11db189010 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:37.275632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:08:37.278442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:08:37.368574 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85d236f5-fa9d-4b4c-aa0e-f62fa637cb9a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.065065 Jul 26 20:08:37.370796 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2429/4786] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:08:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:08:37.381432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afcfba75-e352-4f54-b23d-ce7bd9fc1025 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:37.385497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-afcfba75-e352-4f54-b23d-ce7bd9fc1025 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:37.516646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-986ca13b-6854-46b7-aaf9-eb11db189010 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:37.531990 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-986ca13b-6854-46b7-aaf9-eb11db189010 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.273867 Jul 26 20:08:37.533670 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2358/4787] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:37 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:37.538796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afcfba75-e352-4f54-b23d-ce7bd9fc1025 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:37.547928 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afcfba75-e352-4f54-b23d-ce7bd9fc1025 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1247 microversion: 2.1 time: 0.169599 Jul 26 20:08:37.552970 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2430/4788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:37 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1247 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:37.838351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d938ac14-a504-47dc-9722-1e567e377f04 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:37.839048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d938ac14-a504-47dc-9722-1e567e377f04 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:37.853092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d938ac14-a504-47dc-9722-1e567e377f04 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:37.853513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d938ac14-a504-47dc-9722-1e567e377f04 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:37.854426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d938ac14-a504-47dc-9722-1e567e377f04 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:37.854754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d938ac14-a504-47dc-9722-1e567e377f04 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.094935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d938ac14-a504-47dc-9722-1e567e377f04 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:38.104380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d938ac14-a504-47dc-9722-1e567e377f04 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1489 microversion: 2.1 time: 0.270191 Jul 26 20:08:38.105747 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2359/4789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:37 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1489 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:38.128544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49a223a0-7293-42d1-9e57-b54c79c311a9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:38.131353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-49a223a0-7293-42d1-9e57-b54c79c311a9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:38.138771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49a223a0-7293-42d1-9e57-b54c79c311a9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.139306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49a223a0-7293-42d1-9e57-b54c79c311a9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.140595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49a223a0-7293-42d1-9e57-b54c79c311a9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.141478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49a223a0-7293-42d1-9e57-b54c79c311a9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.259872 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-49a223a0-7293-42d1-9e57-b54c79c311a9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "PUT /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1084 microversion: 2.1 time: 0.135964 Jul 26 20:08:38.261168 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2431/4790] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 20:08:38 2022] PUT /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1084 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:38.287504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-86ca6c3e-fb97-4a40-bd67-75bfc59d754d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:38.289211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-86ca6c3e-fb97-4a40-bd67-75bfc59d754d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:38.300062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:38.301105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:38.302717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86ca6c3e-fb97-4a40-bd67-75bfc59d754d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.303427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86ca6c3e-fb97-4a40-bd67-75bfc59d754d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.304454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86ca6c3e-fb97-4a40-bd67-75bfc59d754d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.305143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86ca6c3e-fb97-4a40-bd67-75bfc59d754d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.334413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.335492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.338951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.339400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.632467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-86ca6c3e-fb97-4a40-bd67-75bfc59d754d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:38.652784 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-86ca6c3e-fb97-4a40-bd67-75bfc59d754d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1510 microversion: 2.1 time: 0.377289 Jul 26 20:08:38.654579 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2360/4791] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:38 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:38.664014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7d23c7be-741c-4012-b843-d095350f3ef3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:38.664014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7d23c7be-741c-4012-b843-d095350f3ef3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:38.687158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7d23c7be-741c-4012-b843-d095350f3ef3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.687399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:38.687642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7d23c7be-741c-4012-b843-d095350f3ef3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.687642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7d23c7be-741c-4012-b843-d095350f3ef3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.687642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7d23c7be-741c-4012-b843-d095350f3ef3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.706271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:38.709140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:38.711415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd604632-a3c4-43b2-a62c-6413a2d81657 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1674 microversion: 2.20 time: 0.433134 Jul 26 20:08:38.714062 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2432/4792] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:38 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1674 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:38.721089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d3cdcf6-6f30-48d5-a1c4-abfe72a604f8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:38.721802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0d3cdcf6-6f30-48d5-a1c4-abfe72a604f8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:38.728141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d3cdcf6-6f30-48d5-a1c4-abfe72a604f8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.729940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d3cdcf6-6f30-48d5-a1c4-abfe72a604f8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.731901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d3cdcf6-6f30-48d5-a1c4-abfe72a604f8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.732432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d3cdcf6-6f30-48d5-a1c4-abfe72a604f8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.831374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0d3cdcf6-6f30-48d5-a1c4-abfe72a604f8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:38.839714 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d3cdcf6-6f30-48d5-a1c4-abfe72a604f8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1299 microversion: 2.1 time: 0.124190 Jul 26 20:08:38.846516 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2433/4793] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:38 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:38.851427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b267a723-664a-4b49-a67d-56d24cef14b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:38.852085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b267a723-664a-4b49-a67d-56d24cef14b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:38.858490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b267a723-664a-4b49-a67d-56d24cef14b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.859164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b267a723-664a-4b49-a67d-56d24cef14b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.860163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b267a723-664a-4b49-a67d-56d24cef14b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:38.860825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b267a723-664a-4b49-a67d-56d24cef14b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:38.911231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7d23c7be-741c-4012-b843-d095350f3ef3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:38.920535 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7d23c7be-741c-4012-b843-d095350f3ef3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.264828 Jul 26 20:08:38.921698 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2361/4794] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:38 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:39.045004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b267a723-664a-4b49-a67d-56d24cef14b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:39.054339 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b267a723-664a-4b49-a67d-56d24cef14b2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1510 microversion: 2.1 time: 0.206777 Jul 26 20:08:39.055428 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2434/4795] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:38 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:39.074751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a6512ef-2e95-4f01-908c-933ecca13b95 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:39.075604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3a6512ef-2e95-4f01-908c-933ecca13b95 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:39.082500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a6512ef-2e95-4f01-908c-933ecca13b95 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:39.083061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a6512ef-2e95-4f01-908c-933ecca13b95 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:39.083935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a6512ef-2e95-4f01-908c-933ecca13b95 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:39.084438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a6512ef-2e95-4f01-908c-933ecca13b95 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:39.115017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3a6512ef-2e95-4f01-908c-933ecca13b95 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:08:39.267662 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a6512ef-2e95-4f01-908c-933ecca13b95 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 204 len: 0 microversion: 2.1 time: 0.196545 Jul 26 20:08:39.270283 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2362/4796] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:08:39 2022] DELETE /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:08:39.284360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca348101-11e8-4ece-ac09-09aeda6de0e9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:39.285487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca348101-11e8-4ece-ac09-09aeda6de0e9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:39.299591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca348101-11e8-4ece-ac09-09aeda6de0e9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:39.300428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca348101-11e8-4ece-ac09-09aeda6de0e9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:39.301302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca348101-11e8-4ece-ac09-09aeda6de0e9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:39.301853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca348101-11e8-4ece-ac09-09aeda6de0e9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:39.654531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca348101-11e8-4ece-ac09-09aeda6de0e9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:39.664056 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca348101-11e8-4ece-ac09-09aeda6de0e9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1516 microversion: 2.1 time: 0.388707 Jul 26 20:08:39.664653 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2435/4797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:39 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:39.737393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:39.739023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:39.748699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:39.750288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:39.751437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:39.752131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:39.868308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f43a52a9-48e9-45b5-9656-e28a64022d2b tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:39.869613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f43a52a9-48e9-45b5-9656-e28a64022d2b tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:39.883691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f43a52a9-48e9-45b5-9656-e28a64022d2b tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:39.885494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f43a52a9-48e9-45b5-9656-e28a64022d2b tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:39.886535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f43a52a9-48e9-45b5-9656-e28a64022d2b tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:39.888129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f43a52a9-48e9-45b5-9656-e28a64022d2b tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:40.046590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f43a52a9-48e9-45b5-9656-e28a64022d2b tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:40.062555 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f43a52a9-48e9-45b5-9656-e28a64022d2b tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1305 microversion: 2.1 time: 0.194017 Jul 26 20:08:40.068291 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2436/4798] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:39 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1305 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:40.074825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1a9fe43-10d1-4126-9ad3-ef827b8367a5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:40.077773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c1a9fe43-10d1-4126-9ad3-ef827b8367a5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:40.092218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:40.096606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1a9fe43-10d1-4126-9ad3-ef827b8367a5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:40.097318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1a9fe43-10d1-4126-9ad3-ef827b8367a5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:40.098096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1a9fe43-10d1-4126-9ad3-ef827b8367a5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:40.098536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c1a9fe43-10d1-4126-9ad3-ef827b8367a5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:40.170642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:40.189839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:40.193695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:40.198527 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-865497d3-8e48-4047-b735-b13a2dbb93ce tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.462959 Jul 26 20:08:40.202648 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2363/4799] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:39 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:40.572520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c1a9fe43-10d1-4126-9ad3-ef827b8367a5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:40.582968 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1a9fe43-10d1-4126-9ad3-ef827b8367a5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.513195 Jul 26 20:08:40.586290 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2437/4800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:40 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:40.685848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3fe3a559-be51-4462-ada0-caff69faea51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:40.686792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3fe3a559-be51-4462-ada0-caff69faea51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:40.698917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fe3a559-be51-4462-ada0-caff69faea51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:40.700123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fe3a559-be51-4462-ada0-caff69faea51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:40.702852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fe3a559-be51-4462-ada0-caff69faea51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:40.705138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fe3a559-be51-4462-ada0-caff69faea51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:41.087107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fb48009b-cdc3-4bdd-9c56-07a8624dc67a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:41.088782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fb48009b-cdc3-4bdd-9c56-07a8624dc67a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:41.098505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fb48009b-cdc3-4bdd-9c56-07a8624dc67a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:41.099430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fb48009b-cdc3-4bdd-9c56-07a8624dc67a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:41.101080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fb48009b-cdc3-4bdd-9c56-07a8624dc67a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:41.101825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fb48009b-cdc3-4bdd-9c56-07a8624dc67a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:41.410038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3fe3a559-be51-4462-ada0-caff69faea51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:41.420920 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3fe3a559-be51-4462-ada0-caff69faea51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1516 microversion: 2.1 time: 0.738823 Jul 26 20:08:41.422569 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2364/4801] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:40 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1516 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:41.434245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:41.435165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:41.450401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:41.453147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:41.461546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:41.462209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:41.667226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fb48009b-cdc3-4bdd-9c56-07a8624dc67a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:41.678956 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fb48009b-cdc3-4bdd-9c56-07a8624dc67a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 0.597322 Jul 26 20:08:41.679563 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2438/4802] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:41 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:41.692920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b8eb9485-cde8-4b3f-891e-5d513199ca6c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:41.693545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b8eb9485-cde8-4b3f-891e-5d513199ca6c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:41.706023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8eb9485-cde8-4b3f-891e-5d513199ca6c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:41.706484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8eb9485-cde8-4b3f-891e-5d513199ca6c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:41.707278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8eb9485-cde8-4b3f-891e-5d513199ca6c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:41.707745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b8eb9485-cde8-4b3f-891e-5d513199ca6c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:41.865494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:42.150330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b8eb9485-cde8-4b3f-891e-5d513199ca6c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:42.163884 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b8eb9485-cde8-4b3f-891e-5d513199ca6c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.474976 Jul 26 20:08:42.166800 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2439/4803] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:41 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:42.184024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f24eecff-50d1-44b0-8911-66e0ef6968f1 req-a11c6e94-a25a-4de4-970f-604a273cc4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c400aa-bca9-4bec-a8ef-e200c066995e", "tag": "10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:42.217674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f24eecff-50d1-44b0-8911-66e0ef6968f1 req-a11c6e94-a25a-4de4-970f-604a273cc4f8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:42.233803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f24eecff-50d1-44b0-8911-66e0ef6968f1 req-a11c6e94-a25a-4de4-970f-604a273cc4f8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:42.256519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:42.282237 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f24eecff-50d1-44b0-8911-66e0ef6968f1 req-a11c6e94-a25a-4de4-970f-604a273cc4f8 service nova] Creating event network-changed:10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf for instance b2c400aa-bca9-4bec-a8ef-e200c066995e on n-h2-708768-8 Jul 26 20:08:42.289943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:42.298212 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f24eecff-50d1-44b0-8911-66e0ef6968f1 req-a11c6e94-a25a-4de4-970f-604a273cc4f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126153 Jul 26 20:08:42.303248 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2440/4804] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:42.303498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:42.304936 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-88e2650d-668f-4e2d-937b-538dac915539 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.880132 Jul 26 20:08:42.305557 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2365/4805] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:41 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:42.464500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61bd2384-ea5e-4d66-816f-5d74c36c9ec2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:42.465217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61bd2384-ea5e-4d66-816f-5d74c36c9ec2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:42.485489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61bd2384-ea5e-4d66-816f-5d74c36c9ec2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:42.487164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61bd2384-ea5e-4d66-816f-5d74c36c9ec2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:42.490040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61bd2384-ea5e-4d66-816f-5d74c36c9ec2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:42.490687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61bd2384-ea5e-4d66-816f-5d74c36c9ec2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:42.499392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-afc1483e-171a-4589-bc5e-f81b9e0b7456 req-ec06a59c-a078-436c-9db2-c9764735774d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0dccb7-be62-47f4-b233-c17fb1dc8856", "name": "network-vif-deleted", "tag": "6fe5347a-c436-4c1e-a63c-254b26fa32aa"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:42.525695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-afc1483e-171a-4589-bc5e-f81b9e0b7456 req-ec06a59c-a078-436c-9db2-c9764735774d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:42.526455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-afc1483e-171a-4589-bc5e-f81b9e0b7456 req-ec06a59c-a078-436c-9db2-c9764735774d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:42.596052 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-afc1483e-171a-4589-bc5e-f81b9e0b7456 req-ec06a59c-a078-436c-9db2-c9764735774d service nova] Creating event network-vif-deleted:6fe5347a-c436-4c1e-a63c-254b26fa32aa for instance db0dccb7-be62-47f4-b233-c17fb1dc8856 on n-h1-708768-8 Jul 26 20:08:42.628703 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-afc1483e-171a-4589-bc5e-f81b9e0b7456 req-ec06a59c-a078-436c-9db2-c9764735774d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133478 Jul 26 20:08:42.636221 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2366/4806] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:08:42.704010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-582c2ce1-9813-4506-9e04-254e4e4fda9d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:42.705248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-582c2ce1-9813-4506-9e04-254e4e4fda9d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:42.718102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-582c2ce1-9813-4506-9e04-254e4e4fda9d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:42.720349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-582c2ce1-9813-4506-9e04-254e4e4fda9d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:42.721460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-582c2ce1-9813-4506-9e04-254e4e4fda9d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:42.723088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-582c2ce1-9813-4506-9e04-254e4e4fda9d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:42.747076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61bd2384-ea5e-4d66-816f-5d74c36c9ec2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:42.779008 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61bd2384-ea5e-4d66-816f-5d74c36c9ec2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 200 len: 1474 microversion: 2.1 time: 0.318645 Jul 26 20:08:42.780375 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2441/4807] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:42 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:43.193011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df58366c-f7ff-4d3d-bc97-7b18fcddd0f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:43.193634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df58366c-f7ff-4d3d-bc97-7b18fcddd0f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:43.201528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df58366c-f7ff-4d3d-bc97-7b18fcddd0f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:43.202623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df58366c-f7ff-4d3d-bc97-7b18fcddd0f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:43.203643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df58366c-f7ff-4d3d-bc97-7b18fcddd0f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:43.204319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df58366c-f7ff-4d3d-bc97-7b18fcddd0f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:43.396598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-582c2ce1-9813-4506-9e04-254e4e4fda9d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:43.408520 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-582c2ce1-9813-4506-9e04-254e4e4fda9d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 0.709778 Jul 26 20:08:43.425116 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2367/4808] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:42 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:43.431833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:43.432833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:43.442773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:43.443561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:43.445267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:43.446020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:43.678291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-df58366c-f7ff-4d3d-bc97-7b18fcddd0f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:43.695849 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df58366c-f7ff-4d3d-bc97-7b18fcddd0f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.503458 Jul 26 20:08:43.696655 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2442/4809] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:43 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:43.803471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:43.804251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:43.815633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:43.816092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:43.816890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:43.817333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:43.870966 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 HTTP/1.1 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'db0dccb7-be62-47f4-b233-c17fb1dc8856'} Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:43.872701 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:08:43.880132 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:08:43.880132 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:08:43.880132 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:08:43.880132 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:08:43.880132 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:08:43.880132 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:08:43.880132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:08:43.880132 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-75e9d0f3-d0c3-4b68-9a1f-03baa57daab9 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 404 len: 111 microversion: 2.1 time: 0.076116 Jul 26 20:08:43.884288 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2443/4810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:43 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:08:44.078875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:44.094280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:44.112670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:44.115803 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e96ee95c-898a-4823-8bb4-43dd0595fd6f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.689040 Jul 26 20:08:44.118367 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2368/4811] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:43 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:44.135489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-306403792", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "a0732ca0-0b24-4753-bcca-055b8f396991"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:44.265776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] validate_networks() for [('a0732ca0-0b24-4753-bcca-055b8f396991', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:08:44.430873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ee22626-f4af-434a-b961-11eb778dbb9f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:44.432820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ee22626-f4af-434a-b961-11eb778dbb9f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:44.442518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ee22626-f4af-434a-b961-11eb778dbb9f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:44.445806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ee22626-f4af-434a-b961-11eb778dbb9f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:44.446997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ee22626-f4af-434a-b961-11eb778dbb9f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:44.447842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ee22626-f4af-434a-b961-11eb778dbb9f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:45.089532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:08:45.090037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:08:45.090426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:08:45.090834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:08:45.091245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:08:45.106302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:45.106941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:45.107886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:45.108388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:45.143406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:08:45.158170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Getting quotas for user bf2066a945044e9990628ed8b31ee98d and project a937e17979c449a49e54fd33c0ae64a0. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:08:45.187747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:08:45.190238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:08:45.327975 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-51c2e91e-d4ed-4604-a586-f69d60af7dd6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194785 Jul 26 20:08:45.328878 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2444/4812] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:08:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:08:45.338136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e526221-a140-453e-adf0-bf54f4eaa9b9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:45.356937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e526221-a140-453e-adf0-bf54f4eaa9b9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:45.381812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e526221-a140-453e-adf0-bf54f4eaa9b9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:45.384092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e526221-a140-453e-adf0-bf54f4eaa9b9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:45.385065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e526221-a140-453e-adf0-bf54f4eaa9b9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:45.388142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e526221-a140-453e-adf0-bf54f4eaa9b9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:45.393897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:45.834659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9ee22626-f4af-434a-b961-11eb778dbb9f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:45.843381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e526221-a140-453e-adf0-bf54f4eaa9b9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:45.843632 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ee22626-f4af-434a-b961-11eb778dbb9f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 1.416752 Jul 26 20:08:45.853721 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e526221-a140-453e-adf0-bf54f4eaa9b9 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.523493 Jul 26 20:08:45.860442 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2445/4813] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:45 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:45.866208 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2369/4814] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:44 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:45.871127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1b195105-4613-438c-afde-1ce9313f96bd req-a616a6fe-3c0e-4770-bbe5-631e88fef076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b4e55b-fc78-441b-a391-3b43c1fece44", "tag": "d5e92c8a-52b5-4209-95a1-521bff02e238"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:45.882305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:45.882925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:45.898734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1b195105-4613-438c-afde-1ce9313f96bd req-a616a6fe-3c0e-4770-bbe5-631e88fef076 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:45.902133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1b195105-4613-438c-afde-1ce9313f96bd req-a616a6fe-3c0e-4770-bbe5-631e88fef076 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:45.903899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:45.904448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:45.908676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:45.909270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:45.959431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1b195105-4613-438c-afde-1ce9313f96bd req-a616a6fe-3c0e-4770-bbe5-631e88fef076 service nova] Creating event network-changed:d5e92c8a-52b5-4209-95a1-521bff02e238 for instance f3b4e55b-fc78-441b-a391-3b43c1fece44 on n-h2-708768-8 Jul 26 20:08:45.982340 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1b195105-4613-438c-afde-1ce9313f96bd req-a616a6fe-3c0e-4770-bbe5-631e88fef076 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119496 Jul 26 20:08:45.985541 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2446/4815] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:46.001236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:46.016160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74f93743-6e1b-45ba-af24-e962ecd3a11a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:46.048639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74f93743-6e1b-45ba-af24-e962ecd3a11a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:46.289857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-74f93743-6e1b-45ba-af24-e962ecd3a11a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:46.307420 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74f93743-6e1b-45ba-af24-e962ecd3a11a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1208 microversion: 2.1 time: 0.318963 Jul 26 20:08:46.311783 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2447/4816] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:45 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1208 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:46.904565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8cbe0323-8608-4eb1-a813-d6846a8d28ca tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:46.909262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8cbe0323-8608-4eb1-a813-d6846a8d28ca tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:46.958749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8cbe0323-8608-4eb1-a813-d6846a8d28ca tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:46.960561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8cbe0323-8608-4eb1-a813-d6846a8d28ca tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:46.979283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8cbe0323-8608-4eb1-a813-d6846a8d28ca tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:46.981265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8cbe0323-8608-4eb1-a813-d6846a8d28ca tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:47.061036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:47.083789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:47.096139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:47.101181 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dabb0ef4-c462-4337-a099-9695ff04bcb1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 1.232343 Jul 26 20:08:47.102865 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2370/4817] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:45 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:47.128364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54d263a9-73da-4912-91ef-7e3bed2076c2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:47.151385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54d263a9-73da-4912-91ef-7e3bed2076c2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:47.172310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54d263a9-73da-4912-91ef-7e3bed2076c2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:47.172685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54d263a9-73da-4912-91ef-7e3bed2076c2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:47.176583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54d263a9-73da-4912-91ef-7e3bed2076c2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:47.177086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54d263a9-73da-4912-91ef-7e3bed2076c2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:47.633456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8cbe0323-8608-4eb1-a813-d6846a8d28ca tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:47.653629 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8cbe0323-8608-4eb1-a813-d6846a8d28ca tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 0.786011 Jul 26 20:08:47.659355 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2448/4818] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:46 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:47.674976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-025dc23a-4546-473d-a608-0fa4be3b4f83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:47.677418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-025dc23a-4546-473d-a608-0fa4be3b4f83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:47.724581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-025dc23a-4546-473d-a608-0fa4be3b4f83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:47.727324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-025dc23a-4546-473d-a608-0fa4be3b4f83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:47.741491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-025dc23a-4546-473d-a608-0fa4be3b4f83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:47.744240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-025dc23a-4546-473d-a608-0fa4be3b4f83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:47.925178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-025dc23a-4546-473d-a608-0fa4be3b4f83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:47.937358 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-025dc23a-4546-473d-a608-0fa4be3b4f83 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1266 microversion: 2.1 time: 0.276560 Jul 26 20:08:47.939461 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2449/4819] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:47 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:48.058337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-54d263a9-73da-4912-91ef-7e3bed2076c2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:48.069706 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54d263a9-73da-4912-91ef-7e3bed2076c2 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.963552 Jul 26 20:08:48.075527 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2371/4820] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:47 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:48.127492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:48.128192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:48.152278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:48.152740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:48.153545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:48.153990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:48.685355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c9f85ce5-6b58-4f3c-9a94-3dc9e14a6343 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:48.685978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c9f85ce5-6b58-4f3c-9a94-3dc9e14a6343 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:48.705848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c9f85ce5-6b58-4f3c-9a94-3dc9e14a6343 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:48.706466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c9f85ce5-6b58-4f3c-9a94-3dc9e14a6343 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:48.707334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c9f85ce5-6b58-4f3c-9a94-3dc9e14a6343 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:48.707821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c9f85ce5-6b58-4f3c-9a94-3dc9e14a6343 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:48.950986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:48.984301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:48.991925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:48.997869 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca7e7985-3075-44f1-8884-17c43063b4cb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.875330 Jul 26 20:08:49.003307 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2450/4821] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:48 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:49.049429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56dce0f4-350c-42c2-9c3e-14b458c586cb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:49.050449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56dce0f4-350c-42c2-9c3e-14b458c586cb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:49.057771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56dce0f4-350c-42c2-9c3e-14b458c586cb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:49.058474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56dce0f4-350c-42c2-9c3e-14b458c586cb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:49.059637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56dce0f4-350c-42c2-9c3e-14b458c586cb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:49.061901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56dce0f4-350c-42c2-9c3e-14b458c586cb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:49.237103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c9f85ce5-6b58-4f3c-9a94-3dc9e14a6343 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:49.252344 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c9f85ce5-6b58-4f3c-9a94-3dc9e14a6343 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 0.569232 Jul 26 20:08:49.253443 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2372/4822] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:48 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:49.269872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1b812cc6-d39b-4000-9bae-c93fca3f4ed7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:49.271027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1b812cc6-d39b-4000-9bae-c93fca3f4ed7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:49.299231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b812cc6-d39b-4000-9bae-c93fca3f4ed7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:49.303815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b812cc6-d39b-4000-9bae-c93fca3f4ed7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:49.304779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b812cc6-d39b-4000-9bae-c93fca3f4ed7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:49.305234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b812cc6-d39b-4000-9bae-c93fca3f4ed7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:49.338344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56dce0f4-350c-42c2-9c3e-14b458c586cb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:49.356481 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56dce0f4-350c-42c2-9c3e-14b458c586cb tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1266 microversion: 2.1 time: 0.318677 Jul 26 20:08:49.358077 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2451/4823] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:49 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:49.826519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1b812cc6-d39b-4000-9bae-c93fca3f4ed7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:49.841200 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1b812cc6-d39b-4000-9bae-c93fca3f4ed7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1657 microversion: 2.1 time: 0.584322 Jul 26 20:08:49.848930 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2373/4824] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:49 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1657 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:49.872105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34c9e06e-a9a5-4d8e-8033-974d95bb8060 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:49.889457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c9e06e-a9a5-4d8e-8033-974d95bb8060 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:49.890436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c9e06e-a9a5-4d8e-8033-974d95bb8060 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:50.040857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34c9e06e-a9a5-4d8e-8033-974d95bb8060 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Going to try to start instance {{(pid=125964) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 20:08:50.044282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:50.045452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:50.085523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:50.088830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:50.094677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:50.096340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:50.225010 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34c9e06e-a9a5-4d8e-8033-974d95bb8060 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.354010 Jul 26 20:08:50.226972 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2452/4825] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:49 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:08:50.250878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-835c9428-c756-4448-b94d-aeb2cbd29bcb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:50.254842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-835c9428-c756-4448-b94d-aeb2cbd29bcb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:50.271788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-835c9428-c756-4448-b94d-aeb2cbd29bcb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:50.274493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-835c9428-c756-4448-b94d-aeb2cbd29bcb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:50.275798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-835c9428-c756-4448-b94d-aeb2cbd29bcb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:50.279685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-835c9428-c756-4448-b94d-aeb2cbd29bcb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:50.719586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-835c9428-c756-4448-b94d-aeb2cbd29bcb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:50.731747 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-835c9428-c756-4448-b94d-aeb2cbd29bcb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1666 microversion: 2.1 time: 0.500154 Jul 26 20:08:50.753045 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2453/4826] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:50 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1666 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:50.768866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5c8a075-42b9-460f-9504-e052c5c9807c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:50.769568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5c8a075-42b9-460f-9504-e052c5c9807c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:50.787796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c8a075-42b9-460f-9504-e052c5c9807c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:50.793180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c8a075-42b9-460f-9504-e052c5c9807c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:50.794230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c8a075-42b9-460f-9504-e052c5c9807c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:50.794856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5c8a075-42b9-460f-9504-e052c5c9807c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:51.092384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:51.119539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:51.130108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:51.147436 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a818f82-54b6-411b-8d7b-6fc1fb467a91 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 1.114980 Jul 26 20:08:51.171848 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2374/4827] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:50 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:08:51.177749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-937abb3a-eaba-4593-b84d-3d0d18816c51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:51.180597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-937abb3a-eaba-4593-b84d-3d0d18816c51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:51.191129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-937abb3a-eaba-4593-b84d-3d0d18816c51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:51.195705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-937abb3a-eaba-4593-b84d-3d0d18816c51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:51.197095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-937abb3a-eaba-4593-b84d-3d0d18816c51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:51.199141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-937abb3a-eaba-4593-b84d-3d0d18816c51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:51.948054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c5c8a075-42b9-460f-9504-e052c5c9807c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:51.957891 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5c8a075-42b9-460f-9504-e052c5c9807c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 1.203297 Jul 26 20:08:51.963170 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2454/4828] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:50 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:51.976230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6311d705-0dbe-404e-93de-e0d4f0a55051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:51.977087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6311d705-0dbe-404e-93de-e0d4f0a55051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:52.034937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6311d705-0dbe-404e-93de-e0d4f0a55051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:52.035588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6311d705-0dbe-404e-93de-e0d4f0a55051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:52.036615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6311d705-0dbe-404e-93de-e0d4f0a55051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:52.037424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6311d705-0dbe-404e-93de-e0d4f0a55051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:52.928007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-937abb3a-eaba-4593-b84d-3d0d18816c51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:52.939232 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-937abb3a-eaba-4593-b84d-3d0d18816c51 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 1.765941 Jul 26 20:08:52.940423 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2375/4829] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:51 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:52.954938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:52.962931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:52.981815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:52.985027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:52.987376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:52.989987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:53.080319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6311d705-0dbe-404e-93de-e0d4f0a55051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:53.106524 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6311d705-0dbe-404e-93de-e0d4f0a55051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1666 microversion: 2.1 time: 1.140994 Jul 26 20:08:53.111693 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2455/4830] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:51 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1666 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:53.156971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba8b93d1-47f9-4247-9822-ce2cc22d05a6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:53.166840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba8b93d1-47f9-4247-9822-ce2cc22d05a6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:53.185300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba8b93d1-47f9-4247-9822-ce2cc22d05a6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:53.189712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba8b93d1-47f9-4247-9822-ce2cc22d05a6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:53.194470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba8b93d1-47f9-4247-9822-ce2cc22d05a6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:53.196157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba8b93d1-47f9-4247-9822-ce2cc22d05a6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:53.694772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:53.706318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:53.710968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:53.712315 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97dd1ee7-d00b-443c-a93c-a976353f9f09 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.768951 Jul 26 20:08:53.731442 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2376/4831] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:52 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:53.756047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba8b93d1-47f9-4247-9822-ce2cc22d05a6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:53.769197 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba8b93d1-47f9-4247-9822-ce2cc22d05a6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 0.655999 Jul 26 20:08:53.772595 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2456/4832] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:53 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:53.961456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af3b926b-7a77-42a9-b118-dce6dce34cee tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:53.962086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-af3b926b-7a77-42a9-b118-dce6dce34cee tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:53.988111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af3b926b-7a77-42a9-b118-dce6dce34cee tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:53.988574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af3b926b-7a77-42a9-b118-dce6dce34cee tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:53.989365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af3b926b-7a77-42a9-b118-dce6dce34cee tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:53.989870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af3b926b-7a77-42a9-b118-dce6dce34cee tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:54.060038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0e5c5665-8c42-47f4-b0ba-72b5abece11e req-85ff8be3-5021-47b9-8c17-2582469d95f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b4e55b-fc78-441b-a391-3b43c1fece44", "name": "network-vif-plugged", "status": "completed", "tag": "d5e92c8a-52b5-4209-95a1-521bff02e238"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:54.097355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0e5c5665-8c42-47f4-b0ba-72b5abece11e req-85ff8be3-5021-47b9-8c17-2582469d95f8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:54.098080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0e5c5665-8c42-47f4-b0ba-72b5abece11e req-85ff8be3-5021-47b9-8c17-2582469d95f8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:54.133643 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0e5c5665-8c42-47f4-b0ba-72b5abece11e req-85ff8be3-5021-47b9-8c17-2582469d95f8 service nova] Creating event network-vif-plugged:d5e92c8a-52b5-4209-95a1-521bff02e238 for instance f3b4e55b-fc78-441b-a391-3b43c1fece44 on n-h2-708768-8 Jul 26 20:08:54.158570 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0e5c5665-8c42-47f4-b0ba-72b5abece11e req-85ff8be3-5021-47b9-8c17-2582469d95f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.424291 Jul 26 20:08:54.161467 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2377/4833] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:54.176087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8aaded96-6915-46cf-9f2f-01a948279775 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:54.177569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8aaded96-6915-46cf-9f2f-01a948279775 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:54.190999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8aaded96-6915-46cf-9f2f-01a948279775 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:54.192129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8aaded96-6915-46cf-9f2f-01a948279775 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:54.193163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8aaded96-6915-46cf-9f2f-01a948279775 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:54.193764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8aaded96-6915-46cf-9f2f-01a948279775 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:54.538073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af3b926b-7a77-42a9-b118-dce6dce34cee tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:54.553691 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-af3b926b-7a77-42a9-b118-dce6dce34cee tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 0.595886 Jul 26 20:08:54.554964 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2457/4834] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:53 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:54.743895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:54.746975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:54.762412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:54.764601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:54.769245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:54.771270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.104110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8aaded96-6915-46cf-9f2f-01a948279775 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:55.119422 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8aaded96-6915-46cf-9f2f-01a948279775 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.956428 Jul 26 20:08:55.138248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:55.149384 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2378/4835] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:54 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:55.173052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae9c85f7-2290-4ed0-bb1a-f22d1e0e0334 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:55.173743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ae9c85f7-2290-4ed0-bb1a-f22d1e0e0334 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:55.177258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:55.189582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae9c85f7-2290-4ed0-bb1a-f22d1e0e0334 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.189818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:55.191348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:55.192527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae9c85f7-2290-4ed0-bb1a-f22d1e0e0334 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.193444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae9c85f7-2290-4ed0-bb1a-f22d1e0e0334 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.195501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae9c85f7-2290-4ed0-bb1a-f22d1e0e0334 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.200883 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dfbd5f64-9601-4372-b00b-1ecc87e1077f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.462078 Jul 26 20:08:55.204196 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2458/4836] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:54 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:55.224695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f80d351b-b1a4-4b38-8144-3c70430e10c1 req-1b3826f2-0eb7-4f89-b921-4efc16f1646e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5", "tag": "3ccadc61-7969-4e4b-a634-50b29de26607"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:55.275432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f80d351b-b1a4-4b38-8144-3c70430e10c1 req-1b3826f2-0eb7-4f89-b921-4efc16f1646e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.275927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f80d351b-b1a4-4b38-8144-3c70430e10c1 req-1b3826f2-0eb7-4f89-b921-4efc16f1646e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.302284 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f80d351b-b1a4-4b38-8144-3c70430e10c1 req-1b3826f2-0eb7-4f89-b921-4efc16f1646e service nova] Creating event network-changed:3ccadc61-7969-4e4b-a634-50b29de26607 for instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 on n-h1-708768-8 Jul 26 20:08:55.327816 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f80d351b-b1a4-4b38-8144-3c70430e10c1 req-1b3826f2-0eb7-4f89-b921-4efc16f1646e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120197 Jul 26 20:08:55.328743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2459/4837] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:08:55.353712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fddbea5f-7d4e-45c7-b8fd-47c368800ea5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:55.355185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fddbea5f-7d4e-45c7-b8fd-47c368800ea5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:55.374911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fddbea5f-7d4e-45c7-b8fd-47c368800ea5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.375754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fddbea5f-7d4e-45c7-b8fd-47c368800ea5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.376829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fddbea5f-7d4e-45c7-b8fd-47c368800ea5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.377475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fddbea5f-7d4e-45c7-b8fd-47c368800ea5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.701025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fddbea5f-7d4e-45c7-b8fd-47c368800ea5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:55.716498 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fddbea5f-7d4e-45c7-b8fd-47c368800ea5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.386097 Jul 26 20:08:55.731234 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2460/4838] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:55 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:55.739974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-00a56c05-f1fc-492c-a3b5-197b337d79ae tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:55.740802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-00a56c05-f1fc-492c-a3b5-197b337d79ae tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:55.749521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00a56c05-f1fc-492c-a3b5-197b337d79ae tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.750268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00a56c05-f1fc-492c-a3b5-197b337d79ae tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.751964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00a56c05-f1fc-492c-a3b5-197b337d79ae tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.752583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00a56c05-f1fc-492c-a3b5-197b337d79ae tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.825730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ae9c85f7-2290-4ed0-bb1a-f22d1e0e0334 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:55.847020 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ae9c85f7-2290-4ed0-bb1a-f22d1e0e0334 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 0.695907 Jul 26 20:08:55.857854 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2379/4839] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:55 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:55.871433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a027e77c-5b33-4306-862a-1d04fa1117e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:55.872467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a027e77c-5b33-4306-862a-1d04fa1117e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:55.889759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a027e77c-5b33-4306-862a-1d04fa1117e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.890457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a027e77c-5b33-4306-862a-1d04fa1117e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:55.891356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a027e77c-5b33-4306-862a-1d04fa1117e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:55.892330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a027e77c-5b33-4306-862a-1d04fa1117e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:56.020553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a027e77c-5b33-4306-862a-1d04fa1117e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Unlocking {{(pid=125963) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 26 20:08:56.176522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-00a56c05-f1fc-492c-a3b5-197b337d79ae tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:56.187588 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a027e77c-5b33-4306-862a-1d04fa1117e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.328130 Jul 26 20:08:56.188309 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2380/4840] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:55 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:08:56.203842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-00a56c05-f1fc-492c-a3b5-197b337d79ae tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 0.469291 Jul 26 20:08:56.206678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7655d4f5-2241-4eef-a374-b34859823724 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:56.207476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7655d4f5-2241-4eef-a374-b34859823724 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:56.208611 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2461/4841] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:55 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:56.225718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7655d4f5-2241-4eef-a374-b34859823724 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:56.226172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7655d4f5-2241-4eef-a374-b34859823724 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:56.230542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:56.231593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:56.236357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7655d4f5-2241-4eef-a374-b34859823724 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:56.236818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7655d4f5-2241-4eef-a374-b34859823724 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:56.264267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:56.265621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:56.269014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:56.271989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:56.315637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=16 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:56.602825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:56.623267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:56.625530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:56.626777 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b024fe5a-9361-4cb2-97d3-9888dc90f647 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.404275 Jul 26 20:08:56.633939 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2462/4842] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:56 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:08:56.878818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c81f8a16-454a-4055-af26-a0dff95a7438 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:56.879560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c81f8a16-454a-4055-af26-a0dff95a7438 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:56.914058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c81f8a16-454a-4055-af26-a0dff95a7438 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:56.916779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c81f8a16-454a-4055-af26-a0dff95a7438 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:56.919523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c81f8a16-454a-4055-af26-a0dff95a7438 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:56.927037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c81f8a16-454a-4055-af26-a0dff95a7438 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:56.932257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:57.044827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7655d4f5-2241-4eef-a374-b34859823724 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:57.059261 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7655d4f5-2241-4eef-a374-b34859823724 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.863366 Jul 26 20:08:57.060251 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2381/4843] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:56 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:57.082220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8bcae226-9087-475a-bbf9-991a414e28ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:57.084880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8bcae226-9087-475a-bbf9-991a414e28ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:57.096096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bcae226-9087-475a-bbf9-991a414e28ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:57.098109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bcae226-9087-475a-bbf9-991a414e28ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:57.099101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bcae226-9087-475a-bbf9-991a414e28ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:57.099745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bcae226-9087-475a-bbf9-991a414e28ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:57.499751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c81f8a16-454a-4055-af26-a0dff95a7438 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:57.510522 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c81f8a16-454a-4055-af26-a0dff95a7438 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1373 microversion: 2.1 time: 0.635953 Jul 26 20:08:57.528307 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2463/4844] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:56 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1373 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:57.536987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7cda1c9f-8590-4ae1-bbe2-499f48764264 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:57.538562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7cda1c9f-8590-4ae1-bbe2-499f48764264 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:57.546993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cda1c9f-8590-4ae1-bbe2-499f48764264 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:57.548240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cda1c9f-8590-4ae1-bbe2-499f48764264 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:57.549681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cda1c9f-8590-4ae1-bbe2-499f48764264 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:57.550602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7cda1c9f-8590-4ae1-bbe2-499f48764264 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:57.652437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8bcae226-9087-475a-bbf9-991a414e28ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:57.665385 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8bcae226-9087-475a-bbf9-991a414e28ec tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.587848 Jul 26 20:08:57.689234 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2382/4845] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:57 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:08:57.697819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:57.698700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:57.706701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:57.707525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:57.708562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:57.709235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:57.846856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7cda1c9f-8590-4ae1-bbe2-499f48764264 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:57.864516 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7cda1c9f-8590-4ae1-bbe2-499f48764264 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 0.334203 Jul 26 20:08:57.865585 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2464/4846] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:57 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:57.874763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4d83fa78-8c83-4bad-a1bf-030ebcde2dc3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:57.882054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4d83fa78-8c83-4bad-a1bf-030ebcde2dc3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:57.897721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d83fa78-8c83-4bad-a1bf-030ebcde2dc3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:57.898375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d83fa78-8c83-4bad-a1bf-030ebcde2dc3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:57.899366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d83fa78-8c83-4bad-a1bf-030ebcde2dc3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:57.902103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d83fa78-8c83-4bad-a1bf-030ebcde2dc3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:58.354094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4d83fa78-8c83-4bad-a1bf-030ebcde2dc3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:58.364133 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4d83fa78-8c83-4bad-a1bf-030ebcde2dc3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.497017 Jul 26 20:08:58.368321 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2465/4847] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:57 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:58.391575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cc5d7354-6795-4fa5-ba0c-a12d1861899c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:08:58.392315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc5d7354-6795-4fa5-ba0c-a12d1861899c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:58.408644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc5d7354-6795-4fa5-ba0c-a12d1861899c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:58.410775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc5d7354-6795-4fa5-ba0c-a12d1861899c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:58.413965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc5d7354-6795-4fa5-ba0c-a12d1861899c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:58.415489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc5d7354-6795-4fa5-ba0c-a12d1861899c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:58.573998 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cc5d7354-6795-4fa5-ba0c-a12d1861899c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.182427 Jul 26 20:08:58.588424 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2466/4848] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:08:58 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:08:58.600853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1be8e77b-06e9-4512-b528-cbed199d0fd5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:58.605079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1be8e77b-06e9-4512-b528-cbed199d0fd5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:58.628104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be8e77b-06e9-4512-b528-cbed199d0fd5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:58.628559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be8e77b-06e9-4512-b528-cbed199d0fd5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:58.637728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be8e77b-06e9-4512-b528-cbed199d0fd5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:58.638466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be8e77b-06e9-4512-b528-cbed199d0fd5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:58.834905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:58.868014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:58.868014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:58.868014 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d26505bb-f91b-4b3d-8893-f6f6eb3600eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 1.162444 Jul 26 20:08:58.868014 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2383/4849] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:57 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:08:58.868014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30854616-c54c-410d-b973-2ec523df8caa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:58.868014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30854616-c54c-410d-b973-2ec523df8caa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:58.868014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:58.868842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30854616-c54c-410d-b973-2ec523df8caa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:58.869599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30854616-c54c-410d-b973-2ec523df8caa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:58.870560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30854616-c54c-410d-b973-2ec523df8caa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:58.871158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30854616-c54c-410d-b973-2ec523df8caa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:58.942747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1be8e77b-06e9-4512-b528-cbed199d0fd5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:58.971344 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1be8e77b-06e9-4512-b528-cbed199d0fd5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1546 microversion: 2.1 time: 0.374588 Jul 26 20:08:58.972191 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2467/4850] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:58 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1546 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:58.986112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2117f0fe-968f-4bf5-88ac-b3f00d8eeb1d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:58.987117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2117f0fe-968f-4bf5-88ac-b3f00d8eeb1d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:59.003505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2117f0fe-968f-4bf5-88ac-b3f00d8eeb1d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:59.009997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2117f0fe-968f-4bf5-88ac-b3f00d8eeb1d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:59.011847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2117f0fe-968f-4bf5-88ac-b3f00d8eeb1d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:59.012464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2117f0fe-968f-4bf5-88ac-b3f00d8eeb1d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:59.205736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-30854616-c54c-410d-b973-2ec523df8caa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:59.217025 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-30854616-c54c-410d-b973-2ec523df8caa tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1675 microversion: 2.1 time: 0.361995 Jul 26 20:08:59.219129 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2384/4851] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:58 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1675 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:59.225427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2f5f3e28-6e26-472a-8c00-98714f0f20d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:59.226296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2f5f3e28-6e26-472a-8c00-98714f0f20d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:59.234794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f5f3e28-6e26-472a-8c00-98714f0f20d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:59.235594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f5f3e28-6e26-472a-8c00-98714f0f20d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:59.236584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f5f3e28-6e26-472a-8c00-98714f0f20d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:59.237183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f5f3e28-6e26-472a-8c00-98714f0f20d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:59.243355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:08:59.316581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2117f0fe-968f-4bf5-88ac-b3f00d8eeb1d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:59.324748 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2117f0fe-968f-4bf5-88ac-b3f00d8eeb1d tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 0.351182 Jul 26 20:08:59.325535 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2468/4852] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:58 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:59.629416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2f5f3e28-6e26-472a-8c00-98714f0f20d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:08:59.637222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2f5f3e28-6e26-472a-8c00-98714f0f20d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1546 microversion: 2.1 time: 0.416424 Jul 26 20:08:59.638370 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2385/4853] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:08:59 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1546 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:08:59.883548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:08:59.884221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:08:59.893862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:59.894338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:08:59.895104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:08:59.895543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:00.218482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:00.228990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:00.233338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:00.237532 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b59c89e-3cbe-4db7-b43c-483a52993235 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.359088 Jul 26 20:09:00.239524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a374b096-3a56-41b8-9972-0af732dece7e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:00.240176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a374b096-3a56-41b8-9972-0af732dece7e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:00.240956 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2469/4854] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:08:59 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:00.260256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a374b096-3a56-41b8-9972-0af732dece7e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:00.260702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a374b096-3a56-41b8-9972-0af732dece7e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:00.261483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a374b096-3a56-41b8-9972-0af732dece7e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:00.261916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a374b096-3a56-41b8-9972-0af732dece7e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:00.348268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1be7426a-4c00-486d-8876-169919236d57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:00.349959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1be7426a-4c00-486d-8876-169919236d57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:00.358085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be7426a-4c00-486d-8876-169919236d57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:00.358609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be7426a-4c00-486d-8876-169919236d57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:00.359572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be7426a-4c00-486d-8876-169919236d57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:00.360507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be7426a-4c00-486d-8876-169919236d57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:00.645983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1be7426a-4c00-486d-8876-169919236d57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:00.667011 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1be7426a-4c00-486d-8876-169919236d57 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 0.324392 Jul 26 20:09:00.667647 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2470/4855] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:00 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:00.860794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a374b096-3a56-41b8-9972-0af732dece7e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:00.869424 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a374b096-3a56-41b8-9972-0af732dece7e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1655 microversion: 2.1 time: 0.633799 Jul 26 20:09:00.870593 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2386/4856] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:00 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1655 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:00.893379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2720b4c6-b636-43b4-9528-7e9aad7f9368 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:00.894126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2720b4c6-b636-43b4-9528-7e9aad7f9368 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:00.913764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2720b4c6-b636-43b4-9528-7e9aad7f9368 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:00.922088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2720b4c6-b636-43b4-9528-7e9aad7f9368 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:00.923555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2720b4c6-b636-43b4-9528-7e9aad7f9368 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:00.924128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2720b4c6-b636-43b4-9528-7e9aad7f9368 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:01.085204 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2720b4c6-b636-43b4-9528-7e9aad7f9368 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.196864 Jul 26 20:09:01.086868 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2471/4857] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:09:00 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:09:01.100350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0da7241-d462-4d94-a8e5-569c0bd2c07e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:01.100991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0da7241-d462-4d94-a8e5-569c0bd2c07e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:01.107759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0da7241-d462-4d94-a8e5-569c0bd2c07e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:01.108667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0da7241-d462-4d94-a8e5-569c0bd2c07e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:01.109494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0da7241-d462-4d94-a8e5-569c0bd2c07e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:01.110101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0da7241-d462-4d94-a8e5-569c0bd2c07e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:01.266125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:01.267664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:01.280511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:01.286325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:01.287367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:01.288199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:01.401790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b0da7241-d462-4d94-a8e5-569c0bd2c07e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:01.414889 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0da7241-d462-4d94-a8e5-569c0bd2c07e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1662 microversion: 2.1 time: 0.322356 Jul 26 20:09:01.415715 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2387/4858] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:01 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1662 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:01.642315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:01.655664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:01.657366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:01.665257 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-14877095-a7a9-4b0d-9a61-7b002241cb9c tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.404288 Jul 26 20:09:01.680103 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2472/4859] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:01 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:01.696975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8965ee3c-fdc9-424a-8596-3f069c74eab6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:01.697836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8965ee3c-fdc9-424a-8596-3f069c74eab6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:01.706700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8965ee3c-fdc9-424a-8596-3f069c74eab6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:01.709537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8965ee3c-fdc9-424a-8596-3f069c74eab6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:01.710428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8965ee3c-fdc9-424a-8596-3f069c74eab6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:01.710948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8965ee3c-fdc9-424a-8596-3f069c74eab6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:02.011774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8965ee3c-fdc9-424a-8596-3f069c74eab6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:02.019452 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8965ee3c-fdc9-424a-8596-3f069c74eab6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 0.326069 Jul 26 20:09:02.050365 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2388/4860] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:01 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:02.441588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4a6e511-25f4-4853-8dee-389b3070133f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:02.442392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4a6e511-25f4-4853-8dee-389b3070133f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:02.453827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4a6e511-25f4-4853-8dee-389b3070133f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:02.454583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4a6e511-25f4-4853-8dee-389b3070133f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:02.457272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4a6e511-25f4-4853-8dee-389b3070133f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:02.457949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4a6e511-25f4-4853-8dee-389b3070133f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:02.701771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:02.707914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:02.729879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:02.731080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:02.734305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:02.739076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:03.241575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:03.250663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:03.252212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:03.253414 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd91882e-2c6c-4f38-96b5-0119c500bed5 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.557992 Jul 26 20:09:03.269488 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2389/4861] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:02 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:03.269488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d83c9123-99e3-4f11-bc95-d0369ae0feca tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:03.269488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d83c9123-99e3-4f11-bc95-d0369ae0feca tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:03.273133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d83c9123-99e3-4f11-bc95-d0369ae0feca tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:03.273585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d83c9123-99e3-4f11-bc95-d0369ae0feca tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:03.274363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d83c9123-99e3-4f11-bc95-d0369ae0feca tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:03.274959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d83c9123-99e3-4f11-bc95-d0369ae0feca tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:03.360244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4a6e511-25f4-4853-8dee-389b3070133f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:03.371397 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4a6e511-25f4-4853-8dee-389b3070133f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.933655 Jul 26 20:09:03.375357 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2473/4862] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:02 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:03.384265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f0761e78-dcf3-4e6c-8ad8-398c09fadb71 req-1d4aa542-8efc-4c59-b2bb-28fb3592b0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5", "name": "network-vif-plugged", "status": "completed", "tag": "3ccadc61-7969-4e4b-a634-50b29de26607"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:03.400386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f0761e78-dcf3-4e6c-8ad8-398c09fadb71 req-1d4aa542-8efc-4c59-b2bb-28fb3592b0d9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:03.401100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f0761e78-dcf3-4e6c-8ad8-398c09fadb71 req-1d4aa542-8efc-4c59-b2bb-28fb3592b0d9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:03.432392 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f0761e78-dcf3-4e6c-8ad8-398c09fadb71 req-1d4aa542-8efc-4c59-b2bb-28fb3592b0d9 service nova] Creating event network-vif-plugged:3ccadc61-7969-4e4b-a634-50b29de26607 for instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 on n-h1-708768-8 Jul 26 20:09:03.453425 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f0761e78-dcf3-4e6c-8ad8-398c09fadb71 req-1d4aa542-8efc-4c59-b2bb-28fb3592b0d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074179 Jul 26 20:09:03.455783 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2474/4863] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:09:03.462169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aee75148-cd49-43ba-bed2-43d35c5f84a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:03.463719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aee75148-cd49-43ba-bed2-43d35c5f84a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:03.484314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aee75148-cd49-43ba-bed2-43d35c5f84a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:03.485180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aee75148-cd49-43ba-bed2-43d35c5f84a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:03.486877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aee75148-cd49-43ba-bed2-43d35c5f84a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:03.487498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aee75148-cd49-43ba-bed2-43d35c5f84a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:03.752926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d83c9123-99e3-4f11-bc95-d0369ae0feca tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:03.767951 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d83c9123-99e3-4f11-bc95-d0369ae0feca tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 0.505653 Jul 26 20:09:03.787911 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2390/4864] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:03 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:03.794265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-2b14978d-9ccb-4586-a7eb-d24775231b12 req-c50917d9-4a6f-4148-be42-540e3885476f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b4e55b-fc78-441b-a391-3b43c1fece44", "tag": "d5e92c8a-52b5-4209-95a1-521bff02e238"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:03.822047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2b14978d-9ccb-4586-a7eb-d24775231b12 req-c50917d9-4a6f-4148-be42-540e3885476f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:03.822496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2b14978d-9ccb-4586-a7eb-d24775231b12 req-c50917d9-4a6f-4148-be42-540e3885476f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:03.841391 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2b14978d-9ccb-4586-a7eb-d24775231b12 req-c50917d9-4a6f-4148-be42-540e3885476f service nova] Creating event network-changed:d5e92c8a-52b5-4209-95a1-521bff02e238 for instance f3b4e55b-fc78-441b-a391-3b43c1fece44 on n-h2-708768-8 Jul 26 20:09:03.849032 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-2b14978d-9ccb-4586-a7eb-d24775231b12 req-c50917d9-4a6f-4148-be42-540e3885476f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059341 Jul 26 20:09:03.851242 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2391/4865] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:09:03.954257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-aee75148-cd49-43ba-bed2-43d35c5f84a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:03.963753 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aee75148-cd49-43ba-bed2-43d35c5f84a7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.506472 Jul 26 20:09:03.964892 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2475/4866] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:03 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:03.992846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-967abf7d-1807-406a-a846-a9d413530f44 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:03.993899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-967abf7d-1807-406a-a846-a9d413530f44 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:04.003069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-967abf7d-1807-406a-a846-a9d413530f44 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.003811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-967abf7d-1807-406a-a846-a9d413530f44 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.004763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-967abf7d-1807-406a-a846-a9d413530f44 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.005371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-967abf7d-1807-406a-a846-a9d413530f44 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.277846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:04.278642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:04.294724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.296008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.297848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.298744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.348356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-967abf7d-1807-406a-a846-a9d413530f44 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:04.402979 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-967abf7d-1807-406a-a846-a9d413530f44 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.415449 Jul 26 20:09:04.406207 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2392/4867] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:03 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:04.428067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-304e4e26-8c33-463b-89fb-104b07d1a90f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:04.429444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-304e4e26-8c33-463b-89fb-104b07d1a90f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:04.441076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-304e4e26-8c33-463b-89fb-104b07d1a90f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.441838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-304e4e26-8c33-463b-89fb-104b07d1a90f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.443086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-304e4e26-8c33-463b-89fb-104b07d1a90f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.443865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-304e4e26-8c33-463b-89fb-104b07d1a90f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.593257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:04.602965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:04.611268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:04.612553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f66ef59-acdc-47e9-b520-77bc659ce4d8 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.339966 Jul 26 20:09:04.613333 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2476/4868] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:04 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:09:04.790442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82d3474e-16fb-4ce3-818b-928517188541 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:04.791073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82d3474e-16fb-4ce3-818b-928517188541 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:04.804185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82d3474e-16fb-4ce3-818b-928517188541 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.804665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82d3474e-16fb-4ce3-818b-928517188541 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.825081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82d3474e-16fb-4ce3-818b-928517188541 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.826711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82d3474e-16fb-4ce3-818b-928517188541 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.897259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-304e4e26-8c33-463b-89fb-104b07d1a90f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:04.922233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-304e4e26-8c33-463b-89fb-104b07d1a90f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.497047 Jul 26 20:09:04.940353 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2393/4869] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:04 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:04.947520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31cab79b-bc97-4858-bcb3-1cd34137b3df tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:04.948588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-31cab79b-bc97-4858-bcb3-1cd34137b3df tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:04.956114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31cab79b-bc97-4858-bcb3-1cd34137b3df tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.956958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31cab79b-bc97-4858-bcb3-1cd34137b3df tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:04.957975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31cab79b-bc97-4858-bcb3-1cd34137b3df tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:04.958680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31cab79b-bc97-4858-bcb3-1cd34137b3df tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:05.400820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82d3474e-16fb-4ce3-818b-928517188541 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:05.415868 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82d3474e-16fb-4ce3-818b-928517188541 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1308 microversion: 2.1 time: 0.629175 Jul 26 20:09:05.418931 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2477/4870] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:04 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1308 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:09:05.543068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-31cab79b-bc97-4858-bcb3-1cd34137b3df tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:05.562456 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31cab79b-bc97-4858-bcb3-1cd34137b3df tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.619041 Jul 26 20:09:05.571710 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2394/4871] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:04 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:09:05.591990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-cc46bde7-63ce-4802-865f-f6e577ffc589 req-2020e11d-b8ac-4bcb-a6fa-94fedbbe5b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c400aa-bca9-4bec-a8ef-e200c066995e", "name": "network-vif-plugged", "status": "completed", "tag": "10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:05.595673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4abbdba7-1974-418f-a0c7-8093271b8486 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:05.598577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4abbdba7-1974-418f-a0c7-8093271b8486 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:05.607591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cc46bde7-63ce-4802-865f-f6e577ffc589 req-2020e11d-b8ac-4bcb-a6fa-94fedbbe5b26 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:05.608821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cc46bde7-63ce-4802-865f-f6e577ffc589 req-2020e11d-b8ac-4bcb-a6fa-94fedbbe5b26 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:05.623104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-cc46bde7-63ce-4802-865f-f6e577ffc589 req-2020e11d-b8ac-4bcb-a6fa-94fedbbe5b26 service nova] Creating event network-vif-plugged:10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf for instance b2c400aa-bca9-4bec-a8ef-e200c066995e on n-h2-708768-8 Jul 26 20:09:05.625928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4abbdba7-1974-418f-a0c7-8093271b8486 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:05.628770 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-cc46bde7-63ce-4802-865f-f6e577ffc589 req-2020e11d-b8ac-4bcb-a6fa-94fedbbe5b26 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040794 Jul 26 20:09:05.629656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4abbdba7-1974-418f-a0c7-8093271b8486 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:05.630208 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2395/4872] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:09:05.632580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4abbdba7-1974-418f-a0c7-8093271b8486 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:05.635739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4abbdba7-1974-418f-a0c7-8093271b8486 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:05.640389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:05.643053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:05.650731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:05.651722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:05.652904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:05.653520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:05.721742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:06.055149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:06.071142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:06.072997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:06.074228 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-817eb284-dcc4-4e73-bdff-8f01e895ad11 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.439415 Jul 26 20:09:06.077904 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2396/4873] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:05 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:06.438613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c0b5a5d-612d-43b1-901a-583340e7d7c2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:06.439227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c0b5a5d-612d-43b1-901a-583340e7d7c2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:06.449083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c0b5a5d-612d-43b1-901a-583340e7d7c2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:06.453321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c0b5a5d-612d-43b1-901a-583340e7d7c2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:06.454375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c0b5a5d-612d-43b1-901a-583340e7d7c2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:06.454999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c0b5a5d-612d-43b1-901a-583340e7d7c2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:06.544422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4abbdba7-1974-418f-a0c7-8093271b8486 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:06.557379 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4abbdba7-1974-418f-a0c7-8093271b8486 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.973477 Jul 26 20:09:06.560821 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2478/4874] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:05 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:06.786277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c0b5a5d-612d-43b1-901a-583340e7d7c2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:06.796233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c0b5a5d-612d-43b1-901a-583340e7d7c2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1489 microversion: 2.1 time: 0.361095 Jul 26 20:09:06.812160 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2397/4875] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:06 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1489 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:09:06.822235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a412fcd-da7d-4ab9-b5e9-478cf52f7572 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-829455189"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:06.834455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a412fcd-da7d-4ab9-b5e9-478cf52f7572 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:06.874382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:06.892576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a412fcd-da7d-4ab9-b5e9-478cf52f7572 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:06.893352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a412fcd-da7d-4ab9-b5e9-478cf52f7572 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:06.901188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a412fcd-da7d-4ab9-b5e9-478cf52f7572 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:06.902055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a412fcd-da7d-4ab9-b5e9-478cf52f7572 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:07.054751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a412fcd-da7d-4ab9-b5e9-478cf52f7572 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "PUT /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1074 microversion: 2.1 time: 0.236400 Jul 26 20:09:07.071654 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2479/4876] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 20:09:06 2022] PUT /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1074 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:07.075296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f58b299b-85c5-41b3-89e6-6654a057cb72 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:07.078496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f58b299b-85c5-41b3-89e6-6654a057cb72 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:07.087241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f58b299b-85c5-41b3-89e6-6654a057cb72 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:07.087999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f58b299b-85c5-41b3-89e6-6654a057cb72 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:07.090046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f58b299b-85c5-41b3-89e6-6654a057cb72 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:07.090684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f58b299b-85c5-41b3-89e6-6654a057cb72 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:07.098663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:07.099289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:07.129462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:07.136578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:07.142416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:07.142927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:07.844760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:07.857293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f58b299b-85c5-41b3-89e6-6654a057cb72 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:07.865648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:07.867175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:07.872740 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f58b299b-85c5-41b3-89e6-6654a057cb72 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1500 microversion: 2.1 time: 0.803060 Jul 26 20:09:07.873373 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2398/4877] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:07 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1500 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:07.875159 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4fa7560c-a1ad-4554-ab3e-ba5eb054574f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1730 microversion: 2.20 time: 0.780629 Jul 26 20:09:07.877060 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2480/4878] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:07 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1730 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:09:07.894900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5b4870e6-b71f-4702-94e2-fe437f0d77fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:07.895540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5b4870e6-b71f-4702-94e2-fe437f0d77fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:07.910454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4870e6-b71f-4702-94e2-fe437f0d77fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:07.910911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4870e6-b71f-4702-94e2-fe437f0d77fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:07.911736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4870e6-b71f-4702-94e2-fe437f0d77fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:07.912177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5b4870e6-b71f-4702-94e2-fe437f0d77fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:08.347117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5b4870e6-b71f-4702-94e2-fe437f0d77fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:08.355944 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5b4870e6-b71f-4702-94e2-fe437f0d77fc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1500 microversion: 2.1 time: 0.465217 Jul 26 20:09:08.357077 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2399/4879] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:07 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1500 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:08.378434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff1e0461-074c-4b4c-8c65-e5f7072607f2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:08.392759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff1e0461-074c-4b4c-8c65-e5f7072607f2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:08.392759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff1e0461-074c-4b4c-8c65-e5f7072607f2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:08.490669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff1e0461-074c-4b4c-8c65-e5f7072607f2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Going to try to stop instance {{(pid=125964) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:09:08.633782 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff1e0461-074c-4b4c-8c65-e5f7072607f2 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "POST /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5/action" status: 202 len: 0 microversion: 2.1 time: 0.260445 Jul 26 20:09:08.655339 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2481/4880] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:09:08 2022] POST /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:09:08.661049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0eee5462-6fa5-400a-b481-40e14d7dfad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:08.661853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0eee5462-6fa5-400a-b481-40e14d7dfad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:08.671074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0eee5462-6fa5-400a-b481-40e14d7dfad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:08.680914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0eee5462-6fa5-400a-b481-40e14d7dfad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:08.688894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0eee5462-6fa5-400a-b481-40e14d7dfad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:08.698839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0eee5462-6fa5-400a-b481-40e14d7dfad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:08.901160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:08.901875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:08.919906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:08.920344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:08.921930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:08.922630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:09.340306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:09.353603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:09.360941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:09.362491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-724ee5e2-d349-4d77-890e-3722ba880db2 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1717 microversion: 2.20 time: 0.466100 Jul 26 20:09:09.365026 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2482/4881] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:08 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1717 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 20:09:09.377126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0eee5462-6fa5-400a-b481-40e14d7dfad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:09.414353 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0eee5462-6fa5-400a-b481-40e14d7dfad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.756127 Jul 26 20:09:09.426135 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2400/4882] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:08 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:10.438297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-da097a97-4268-4ef0-8266-8a4a3e235236 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:10.438972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-da097a97-4268-4ef0-8266-8a4a3e235236 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:10.455979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da097a97-4268-4ef0-8266-8a4a3e235236 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:10.456433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da097a97-4268-4ef0-8266-8a4a3e235236 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:10.457213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da097a97-4268-4ef0-8266-8a4a3e235236 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:10.461677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da097a97-4268-4ef0-8266-8a4a3e235236 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:11.097752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-da097a97-4268-4ef0-8266-8a4a3e235236 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:11.108877 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-da097a97-4268-4ef0-8266-8a4a3e235236 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.675211 Jul 26 20:09:11.113684 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2483/4883] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:10 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:12.140358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7cfbfa46-7ce0-4392-b62b-31f7f0ccc5c6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:12.141375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7cfbfa46-7ce0-4392-b62b-31f7f0ccc5c6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:12.159770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cfbfa46-7ce0-4392-b62b-31f7f0ccc5c6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:12.162007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cfbfa46-7ce0-4392-b62b-31f7f0ccc5c6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:12.174640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cfbfa46-7ce0-4392-b62b-31f7f0ccc5c6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:12.183562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7cfbfa46-7ce0-4392-b62b-31f7f0ccc5c6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:12.484702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7cfbfa46-7ce0-4392-b62b-31f7f0ccc5c6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:12.501203 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7cfbfa46-7ce0-4392-b62b-31f7f0ccc5c6 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.366612 Jul 26 20:09:12.501817 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2401/4884] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:12 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:13.522649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a98a74c-5d86-4500-833b-e7374396c0ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:13.523281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8a98a74c-5d86-4500-833b-e7374396c0ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:13.531563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a98a74c-5d86-4500-833b-e7374396c0ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:13.532037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a98a74c-5d86-4500-833b-e7374396c0ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:13.533040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a98a74c-5d86-4500-833b-e7374396c0ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:13.533732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a98a74c-5d86-4500-833b-e7374396c0ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:13.787025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a98a74c-5d86-4500-833b-e7374396c0ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:13.796342 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a98a74c-5d86-4500-833b-e7374396c0ef tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.277666 Jul 26 20:09:13.796931 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2484/4885] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:13 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:14.818160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c032561-1fd3-4f9f-b7a7-a9d92616e81c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:14.818753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c032561-1fd3-4f9f-b7a7-a9d92616e81c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:14.830568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c032561-1fd3-4f9f-b7a7-a9d92616e81c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:14.833000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c032561-1fd3-4f9f-b7a7-a9d92616e81c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:14.834005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c032561-1fd3-4f9f-b7a7-a9d92616e81c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:14.835335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c032561-1fd3-4f9f-b7a7-a9d92616e81c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:15.027168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c032561-1fd3-4f9f-b7a7-a9d92616e81c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:15.036432 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c032561-1fd3-4f9f-b7a7-a9d92616e81c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.222470 Jul 26 20:09:15.037481 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2402/4886] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:14 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:16.060536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8ead4988-707b-4101-91a1-ab93e6dc9610 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:16.061608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8ead4988-707b-4101-91a1-ab93e6dc9610 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:16.072048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ead4988-707b-4101-91a1-ab93e6dc9610 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:16.073642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ead4988-707b-4101-91a1-ab93e6dc9610 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:16.075169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ead4988-707b-4101-91a1-ab93e6dc9610 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:16.076033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ead4988-707b-4101-91a1-ab93e6dc9610 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:16.314887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8ead4988-707b-4101-91a1-ab93e6dc9610 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:16.332882 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8ead4988-707b-4101-91a1-ab93e6dc9610 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.277876 Jul 26 20:09:16.337496 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2485/4887] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:16 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:17.356576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ff044888-6583-4205-afb1-08926b7e67b0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:17.358445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ff044888-6583-4205-afb1-08926b7e67b0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:17.367088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff044888-6583-4205-afb1-08926b7e67b0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:17.367598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff044888-6583-4205-afb1-08926b7e67b0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:17.368496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff044888-6583-4205-afb1-08926b7e67b0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:17.369012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff044888-6583-4205-afb1-08926b7e67b0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:17.374456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:17.601972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ff044888-6583-4205-afb1-08926b7e67b0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:17.611939 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ff044888-6583-4205-afb1-08926b7e67b0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.259863 Jul 26 20:09:17.624808 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2403/4888] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:17 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:18.633404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-94692baa-2cd8-4964-9485-c54168da91d0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:18.634022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-94692baa-2cd8-4964-9485-c54168da91d0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:18.642657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94692baa-2cd8-4964-9485-c54168da91d0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:18.643375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94692baa-2cd8-4964-9485-c54168da91d0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:18.644346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94692baa-2cd8-4964-9485-c54168da91d0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:18.644949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94692baa-2cd8-4964-9485-c54168da91d0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:18.851532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-94692baa-2cd8-4964-9485-c54168da91d0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:18.863299 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-94692baa-2cd8-4964-9485-c54168da91d0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.233822 Jul 26 20:09:18.881832 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2486/4889] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:18 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:19.893453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1098f6de-2d4e-4ccf-ac91-5433efdf0bda tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:19.894081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1098f6de-2d4e-4ccf-ac91-5433efdf0bda tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:19.903965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1098f6de-2d4e-4ccf-ac91-5433efdf0bda tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:19.905227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1098f6de-2d4e-4ccf-ac91-5433efdf0bda tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:19.906223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1098f6de-2d4e-4ccf-ac91-5433efdf0bda tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:19.906919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1098f6de-2d4e-4ccf-ac91-5433efdf0bda tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:20.086871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1098f6de-2d4e-4ccf-ac91-5433efdf0bda tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:20.095251 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1098f6de-2d4e-4ccf-ac91-5433efdf0bda tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.207944 Jul 26 20:09:20.096706 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2404/4890] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:19 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:21.123117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b552266e-4b6d-4484-9bbc-7fa2bd16a37e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:21.128514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b552266e-4b6d-4484-9bbc-7fa2bd16a37e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:21.145296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b552266e-4b6d-4484-9bbc-7fa2bd16a37e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:21.146045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b552266e-4b6d-4484-9bbc-7fa2bd16a37e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:21.149838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b552266e-4b6d-4484-9bbc-7fa2bd16a37e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:21.150524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b552266e-4b6d-4484-9bbc-7fa2bd16a37e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:21.339308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b552266e-4b6d-4484-9bbc-7fa2bd16a37e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:21.347373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b552266e-4b6d-4484-9bbc-7fa2bd16a37e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.233607 Jul 26 20:09:21.348004 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2487/4891] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:21 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:22.370581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c73815f-e64e-4b58-a729-73f05f0c3e47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:22.371950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c73815f-e64e-4b58-a729-73f05f0c3e47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:22.382594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c73815f-e64e-4b58-a729-73f05f0c3e47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:22.383271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c73815f-e64e-4b58-a729-73f05f0c3e47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:22.384356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c73815f-e64e-4b58-a729-73f05f0c3e47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:22.385261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c73815f-e64e-4b58-a729-73f05f0c3e47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:22.749597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c73815f-e64e-4b58-a729-73f05f0c3e47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:22.758645 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c73815f-e64e-4b58-a729-73f05f0c3e47 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.393095 Jul 26 20:09:22.759318 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2405/4892] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:22 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:23.784551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a259134d-b41b-450b-81b2-a691fff033d8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:23.786030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a259134d-b41b-450b-81b2-a691fff033d8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:23.797302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a259134d-b41b-450b-81b2-a691fff033d8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:23.798257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a259134d-b41b-450b-81b2-a691fff033d8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:23.799388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a259134d-b41b-450b-81b2-a691fff033d8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:23.800392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a259134d-b41b-450b-81b2-a691fff033d8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:24.020689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a259134d-b41b-450b-81b2-a691fff033d8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:24.034257 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a259134d-b41b-450b-81b2-a691fff033d8 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.257914 Jul 26 20:09:24.049039 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2488/4893] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:23 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:24.493398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0161855-4787-4ec8-83c0-d616dfb8d8bc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:24.506776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0161855-4787-4ec8-83c0-d616dfb8d8bc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:24.553642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0161855-4787-4ec8-83c0-d616dfb8d8bc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:24.554379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0161855-4787-4ec8-83c0-d616dfb8d8bc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:24.555481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0161855-4787-4ec8-83c0-d616dfb8d8bc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:24.573304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0161855-4787-4ec8-83c0-d616dfb8d8bc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:24.690563 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0161855-4787-4ec8-83c0-d616dfb8d8bc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44/action" status: 200 len: 24562 microversion: 2.1 time: 0.205200 Jul 26 20:09:24.695804 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2406/4894] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:09:24 2022] POST /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44/action => generated 24562 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:09:25.061184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7a3a4fd-1c4c-4ff2-921f-92892dad0828 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:25.061854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7a3a4fd-1c4c-4ff2-921f-92892dad0828 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:25.075395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7a3a4fd-1c4c-4ff2-921f-92892dad0828 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:25.076741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7a3a4fd-1c4c-4ff2-921f-92892dad0828 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:25.077766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7a3a4fd-1c4c-4ff2-921f-92892dad0828 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:25.078315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7a3a4fd-1c4c-4ff2-921f-92892dad0828 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:25.534854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7a3a4fd-1c4c-4ff2-921f-92892dad0828 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:25.543593 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7a3a4fd-1c4c-4ff2-921f-92892dad0828 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.488143 Jul 26 20:09:25.544363 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2489/4895] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:25 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:26.567539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-16d5a714-4d3c-4401-a0f8-326ed00b9eff tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:26.569974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-16d5a714-4d3c-4401-a0f8-326ed00b9eff tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:26.600184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16d5a714-4d3c-4401-a0f8-326ed00b9eff tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:26.602405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16d5a714-4d3c-4401-a0f8-326ed00b9eff tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:26.603225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16d5a714-4d3c-4401-a0f8-326ed00b9eff tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:26.604853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16d5a714-4d3c-4401-a0f8-326ed00b9eff tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:27.112551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-16d5a714-4d3c-4401-a0f8-326ed00b9eff tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:27.121131 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-16d5a714-4d3c-4401-a0f8-326ed00b9eff tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.560412 Jul 26 20:09:27.128377 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2407/4896] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:26 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:28.155342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-770d4b03-fae0-45c5-b1b2-d231de949746 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:28.156238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-770d4b03-fae0-45c5-b1b2-d231de949746 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:28.163601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-770d4b03-fae0-45c5-b1b2-d231de949746 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:28.164226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-770d4b03-fae0-45c5-b1b2-d231de949746 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:28.165584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-770d4b03-fae0-45c5-b1b2-d231de949746 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:28.166163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-770d4b03-fae0-45c5-b1b2-d231de949746 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:28.522655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-770d4b03-fae0-45c5-b1b2-d231de949746 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:28.532963 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-770d4b03-fae0-45c5-b1b2-d231de949746 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.385137 Jul 26 20:09:28.533667 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2490/4897] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:28 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:29.518367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a664bc24-771c-4231-886c-9eec3a7fed48 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:29.521224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a664bc24-771c-4231-886c-9eec3a7fed48 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:29.525714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=48 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:29.532004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a664bc24-771c-4231-886c-9eec3a7fed48 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:29.532674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a664bc24-771c-4231-886c-9eec3a7fed48 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:29.533549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a664bc24-771c-4231-886c-9eec3a7fed48 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:29.534129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a664bc24-771c-4231-886c-9eec3a7fed48 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:29.556600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7c921df-d7ad-4f06-a765-048bdc6bc594 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:29.558151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7c921df-d7ad-4f06-a765-048bdc6bc594 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:29.572709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7c921df-d7ad-4f06-a765-048bdc6bc594 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:29.573613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7c921df-d7ad-4f06-a765-048bdc6bc594 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:29.574918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7c921df-d7ad-4f06-a765-048bdc6bc594 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:29.576668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7c921df-d7ad-4f06-a765-048bdc6bc594 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:29.664574 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a664bc24-771c-4231-886c-9eec3a7fed48 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.151079 Jul 26 20:09:29.666321 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2408/4898] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:09:29 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:09:29.707194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-db06214b-858b-4fce-aea0-417a4f1c674b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:29.708791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-db06214b-858b-4fce-aea0-417a4f1c674b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:29.739768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db06214b-858b-4fce-aea0-417a4f1c674b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:29.742296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db06214b-858b-4fce-aea0-417a4f1c674b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:29.744261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db06214b-858b-4fce-aea0-417a4f1c674b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:29.744991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db06214b-858b-4fce-aea0-417a4f1c674b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:30.011211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7c921df-d7ad-4f06-a765-048bdc6bc594 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:30.023065 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7c921df-d7ad-4f06-a765-048bdc6bc594 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.471302 Jul 26 20:09:30.024867 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2491/4899] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:29 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:09:30.222016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-db06214b-858b-4fce-aea0-417a4f1c674b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:30.238459 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-db06214b-858b-4fce-aea0-417a4f1c674b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1672 microversion: 2.1 time: 0.559352 Jul 26 20:09:30.251635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2409/4900] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:29 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1672 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:31.046486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-60a06c1e-c96f-4430-ab09-83a469cf9b50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:31.047367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-60a06c1e-c96f-4430-ab09-83a469cf9b50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:31.054681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60a06c1e-c96f-4430-ab09-83a469cf9b50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:31.056363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60a06c1e-c96f-4430-ab09-83a469cf9b50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:31.057598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60a06c1e-c96f-4430-ab09-83a469cf9b50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:31.058143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60a06c1e-c96f-4430-ab09-83a469cf9b50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:31.227212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-60a06c1e-c96f-4430-ab09-83a469cf9b50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:31.239512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-60a06c1e-c96f-4430-ab09-83a469cf9b50 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.197505 Jul 26 20:09:31.240569 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2492/4901] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:31 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:31.276244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-086c6abf-82ba-4da2-8f30-22ed55335914 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:31.277731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-086c6abf-82ba-4da2-8f30-22ed55335914 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:31.290124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-086c6abf-82ba-4da2-8f30-22ed55335914 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:31.290778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-086c6abf-82ba-4da2-8f30-22ed55335914 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:31.294071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-086c6abf-82ba-4da2-8f30-22ed55335914 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:31.294888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-086c6abf-82ba-4da2-8f30-22ed55335914 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:31.497558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-086c6abf-82ba-4da2-8f30-22ed55335914 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:31.510509 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-086c6abf-82ba-4da2-8f30-22ed55335914 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1672 microversion: 2.1 time: 0.247004 Jul 26 20:09:31.510509 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2410/4902] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:31 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:32.267753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-143cb217-bbf7-4809-9e9d-f2adc07a0f44 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:32.269763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-143cb217-bbf7-4809-9e9d-f2adc07a0f44 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:32.278952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-143cb217-bbf7-4809-9e9d-f2adc07a0f44 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:32.280701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-143cb217-bbf7-4809-9e9d-f2adc07a0f44 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:32.281751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-143cb217-bbf7-4809-9e9d-f2adc07a0f44 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:32.282508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-143cb217-bbf7-4809-9e9d-f2adc07a0f44 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:32.348070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:32.531407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ef4fa7dd-2420-4807-bf62-8b7c8b75fb95 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:32.532669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ef4fa7dd-2420-4807-bf62-8b7c8b75fb95 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:32.541958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef4fa7dd-2420-4807-bf62-8b7c8b75fb95 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:32.542971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef4fa7dd-2420-4807-bf62-8b7c8b75fb95 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:32.544589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef4fa7dd-2420-4807-bf62-8b7c8b75fb95 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:32.545885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef4fa7dd-2420-4807-bf62-8b7c8b75fb95 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:32.585638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-143cb217-bbf7-4809-9e9d-f2adc07a0f44 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:32.600326 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-143cb217-bbf7-4809-9e9d-f2adc07a0f44 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.343240 Jul 26 20:09:32.603929 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2493/4903] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:32 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:32.835218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ef4fa7dd-2420-4807-bf62-8b7c8b75fb95 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:32.854750 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ef4fa7dd-2420-4807-bf62-8b7c8b75fb95 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.327074 Jul 26 20:09:32.855751 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2411/4904] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:32 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:09:33.623414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d8a5cca-ffdd-48a8-abc7-64aff21cda13 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:33.624676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d8a5cca-ffdd-48a8-abc7-64aff21cda13 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:33.637025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d8a5cca-ffdd-48a8-abc7-64aff21cda13 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:33.637730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d8a5cca-ffdd-48a8-abc7-64aff21cda13 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:33.638697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d8a5cca-ffdd-48a8-abc7-64aff21cda13 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:33.641646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d8a5cca-ffdd-48a8-abc7-64aff21cda13 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:33.865398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d8a5cca-ffdd-48a8-abc7-64aff21cda13 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:33.878848 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d8a5cca-ffdd-48a8-abc7-64aff21cda13 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1510 microversion: 2.1 time: 0.259863 Jul 26 20:09:33.882480 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2494/4905] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:33 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:34.900241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-514a3552-a1ed-464d-a083-b3a9d8d2613b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:34.901477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-514a3552-a1ed-464d-a083-b3a9d8d2613b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:34.910378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-514a3552-a1ed-464d-a083-b3a9d8d2613b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:34.911127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-514a3552-a1ed-464d-a083-b3a9d8d2613b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:34.913054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-514a3552-a1ed-464d-a083-b3a9d8d2613b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:34.913664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-514a3552-a1ed-464d-a083-b3a9d8d2613b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:35.137115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-514a3552-a1ed-464d-a083-b3a9d8d2613b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:35.148587 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-514a3552-a1ed-464d-a083-b3a9d8d2613b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1487 microversion: 2.1 time: 0.252341 Jul 26 20:09:35.149386 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2412/4906] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:34 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1487 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:35.183903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef976418-c1f0-4141-ad16-3410f39f0699 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1363834582"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:35.187911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef976418-c1f0-4141-ad16-3410f39f0699 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:35.200963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef976418-c1f0-4141-ad16-3410f39f0699 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:35.202030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef976418-c1f0-4141-ad16-3410f39f0699 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:35.203258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef976418-c1f0-4141-ad16-3410f39f0699 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:35.203757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef976418-c1f0-4141-ad16-3410f39f0699 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:35.299689 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef976418-c1f0-4141-ad16-3410f39f0699 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "PUT /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1061 microversion: 2.1 time: 0.130495 Jul 26 20:09:35.313889 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2495/4907] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 20:09:35 2022] PUT /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1061 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:35.318432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9487520a-68ef-4ea6-bf82-45e44246ec8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:35.319657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9487520a-68ef-4ea6-bf82-45e44246ec8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:35.330277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9487520a-68ef-4ea6-bf82-45e44246ec8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:35.330577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9487520a-68ef-4ea6-bf82-45e44246ec8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:35.331491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9487520a-68ef-4ea6-bf82-45e44246ec8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:35.337463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9487520a-68ef-4ea6-bf82-45e44246ec8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:35.563035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9487520a-68ef-4ea6-bf82-45e44246ec8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:35.578745 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9487520a-68ef-4ea6-bf82-45e44246ec8c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1488 microversion: 2.1 time: 0.262871 Jul 26 20:09:35.579753 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2413/4908] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:35 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1488 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:35.601460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-00de33d5-9241-421a-b617-240e2d3233f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:35.603393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-00de33d5-9241-421a-b617-240e2d3233f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:35.612172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00de33d5-9241-421a-b617-240e2d3233f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:35.612907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00de33d5-9241-421a-b617-240e2d3233f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:35.628105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00de33d5-9241-421a-b617-240e2d3233f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:35.628967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00de33d5-9241-421a-b617-240e2d3233f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:36.373608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-00de33d5-9241-421a-b617-240e2d3233f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:36.388839 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-00de33d5-9241-421a-b617-240e2d3233f1 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1488 microversion: 2.1 time: 0.792730 Jul 26 20:09:36.404173 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2496/4909] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:35 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1488 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:36.410446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-78c4969d-19d4-4b83-b931-be225da5864e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:36.410956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-78c4969d-19d4-4b83-b931-be225da5864e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:36.422515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78c4969d-19d4-4b83-b931-be225da5864e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:36.422970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78c4969d-19d4-4b83-b931-be225da5864e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:36.423829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78c4969d-19d4-4b83-b931-be225da5864e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:36.424262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78c4969d-19d4-4b83-b931-be225da5864e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:36.469326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-78c4969d-19d4-4b83-b931-be225da5864e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:09:36.593469 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-78c4969d-19d4-4b83-b931-be225da5864e tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 204 len: 0 microversion: 2.1 time: 0.169683 Jul 26 20:09:36.599078 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2414/4910] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:36 2022] DELETE /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:09:36.609390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b00386c4-b022-44a9-a42c-4a3f3498dcb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:36.610018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b00386c4-b022-44a9-a42c-4a3f3498dcb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:36.621332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b00386c4-b022-44a9-a42c-4a3f3498dcb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:36.621799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b00386c4-b022-44a9-a42c-4a3f3498dcb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:36.622610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b00386c4-b022-44a9-a42c-4a3f3498dcb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:36.626920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b00386c4-b022-44a9-a42c-4a3f3498dcb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:36.898422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b00386c4-b022-44a9-a42c-4a3f3498dcb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:36.909678 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b00386c4-b022-44a9-a42c-4a3f3498dcb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1494 microversion: 2.1 time: 0.304949 Jul 26 20:09:36.911432 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2497/4911] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:36 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1494 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:37.935860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ee1a6c1b-5c32-4659-8a18-6806e772d8dc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:37.937639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ee1a6c1b-5c32-4659-8a18-6806e772d8dc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:37.955152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee1a6c1b-5c32-4659-8a18-6806e772d8dc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:37.956204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee1a6c1b-5c32-4659-8a18-6806e772d8dc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:37.957196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee1a6c1b-5c32-4659-8a18-6806e772d8dc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:37.957806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ee1a6c1b-5c32-4659-8a18-6806e772d8dc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:38.288046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ee1a6c1b-5c32-4659-8a18-6806e772d8dc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:38.298471 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ee1a6c1b-5c32-4659-8a18-6806e772d8dc tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 200 len: 1494 microversion: 2.1 time: 0.366650 Jul 26 20:09:38.302942 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2415/4912] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:37 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 1494 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:38.794098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-261df5bb-67c3-479d-a283-0d6045393841 req-aa1d7844-e803-47dd-a0cd-97e5b798a7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5", "name": "network-vif-deleted", "tag": "3ccadc61-7969-4e4b-a634-50b29de26607"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:38.821433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=38 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:38.828895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-261df5bb-67c3-479d-a283-0d6045393841 req-aa1d7844-e803-47dd-a0cd-97e5b798a7a2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:38.834067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-261df5bb-67c3-479d-a283-0d6045393841 req-aa1d7844-e803-47dd-a0cd-97e5b798a7a2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:38.876146 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-261df5bb-67c3-479d-a283-0d6045393841 req-aa1d7844-e803-47dd-a0cd-97e5b798a7a2 service nova] Creating event network-vif-deleted:3ccadc61-7969-4e4b-a634-50b29de26607 for instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 on n-h1-708768-8 Jul 26 20:09:38.894521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-261df5bb-67c3-479d-a283-0d6045393841 req-aa1d7844-e803-47dd-a0cd-97e5b798a7a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102893 Jul 26 20:09:38.895673 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2498/4913] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:09:39.326779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.327864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.352360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.352765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.357293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.358930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.375694 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 HTTP/1.1 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5'} Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.377726 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.388362 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.388362 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.388362 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.388362 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.388362 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.388362 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.388362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.388362 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-623e7fe3-0880-45b3-afcf-1d99d45fff64 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 404 len: 111 microversion: 2.1 time: 0.059096 Jul 26 20:09:39.399776 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2416/4914] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:39 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.401228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.401827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.409591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.410304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.411273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.411907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.428506 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 HTTP/1.1 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5'} Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.430186 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.435374 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.442109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.442109 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-485e7845-3fdc-431c-8021-3d125d0c9e3c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 404 len: 111 microversion: 2.1 time: 0.042109 Jul 26 20:09:39.442109 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2499/4915] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:39 2022] DELETE /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.448921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.449521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.456479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.456925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.457857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.458302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.474529 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 HTTP/1.1 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5'} Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.476135 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a1ce196-24b0-49c1-af4a-715922aabaf5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5" status: 404 len: 111 microversion: 2.1 time: 0.032793 Jul 26 20:09:39.485187 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2417/4916] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:39 2022] GET /compute/v2.1/servers/8c2d1b6b-c6b1-40ee-8dc0-ff73ca685cc5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.492231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.492231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.498348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.498924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.500008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.500723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.520715 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 HTTP/1.1 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'db0dccb7-be62-47f4-b233-c17fb1dc8856'} Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.522371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.527686 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d98bb6ce-d088-4e2d-904a-0cc13a049ad0 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 404 len: 111 microversion: 2.1 time: 0.040291 Jul 26 20:09:39.536033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.536520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: db0dccb7-be62-47f4-b233-c17fb1dc8856] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.539856 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2500/4917] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:39 2022] DELETE /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.543895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.544445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.545405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.545945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.563274 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 HTTP/1.1 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'db0dccb7-be62-47f4-b233-c17fb1dc8856'} Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.565178 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.570773 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.570773 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.570773 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.570773 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.570773 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. Jul 26 20:09:39.570773 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.570773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance db0dccb7-be62-47f4-b233-c17fb1dc8856 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.572058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-93103d4a-87d2-48db-b9a3-00916f8c2ae4 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856" status: 404 len: 111 microversion: 2.1 time: 0.039553 Jul 26 20:09:39.575588 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2418/4918] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:39 2022] GET /compute/v2.1/servers/db0dccb7-be62-47f4-b233-c17fb1dc8856 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.582303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.582452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.590337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.590798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.591780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.592804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.610765 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b HTTP/1.1 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ee82c1bd-f76d-4b07-b0f7-e05a78450c6b'} Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.616383 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ce59b15-f7fc-448f-843f-d381e22cb246 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 404 len: 111 microversion: 2.1 time: 0.038463 Jul 26 20:09:39.621776 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2501/4919] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:39 2022] DELETE /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.627365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.629001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ee82c1bd-f76d-4b07-b0f7-e05a78450c6b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.646157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.646606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.648542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.651425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.687774 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b HTTP/1.1 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ee82c1bd-f76d-4b07-b0f7-e05a78450c6b'} Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.689982 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.694712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.694712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.694712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.694712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.694712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. Jul 26 20:09:39.694712 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.696791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ee82c1bd-f76d-4b07-b0f7-e05a78450c6b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.697907 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e30a36ef-5447-4e8d-bb84-d762fa30a379 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b" status: 404 len: 111 microversion: 2.1 time: 0.078192 Jul 26 20:09:39.699151 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2419/4920] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:39 2022] GET /compute/v2.1/servers/ee82c1bd-f76d-4b07-b0f7-e05a78450c6b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.707383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.708017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.715675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.716489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.718096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.718871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.734719 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e HTTP/1.1 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '768b4ba6-2004-4836-9d49-4d9d4631f51e'} Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.736687 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.741193 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.743413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.744535 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d684275-be35-4a81-810d-0fbb2c0ac42b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 404 len: 111 microversion: 2.1 time: 0.040986 Jul 26 20:09:39.745334 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2502/4921] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:39 2022] DELETE /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:09:39.754034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.754639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 768b4ba6-2004-4836-9d49-4d9d4631f51e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.761748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.762181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.763203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.764373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.770692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:39.793115 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e HTTP/1.1 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '768b4ba6-2004-4836-9d49-4d9d4631f51e'} Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.800688 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.807282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.807282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.807282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.807282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.807282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. Jul 26 20:09:39.807282 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.810610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 768b4ba6-2004-4836-9d49-4d9d4631f51e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.813107 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1f1809f3-8c1c-4e6e-bf29-45b66940feb5 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e" status: 404 len: 111 microversion: 2.1 time: 0.062814 Jul 26 20:09:39.814659 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2420/4922] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:39 2022] GET /compute/v2.1/servers/768b4ba6-2004-4836-9d49-4d9d4631f51e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.822531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.823115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.831647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.832342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.833322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.833957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.852308 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 HTTP/1.1 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '789846fe-4990-42d5-b4d2-a6e1e0bf35a0'} Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.854230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.858795 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.862066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.863158 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-54d9b9c6-76ab-4342-8d8e-05c5668d1650 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 404 len: 111 microversion: 2.1 time: 0.044943 Jul 26 20:09:39.872484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.873932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 789846fe-4990-42d5-b4d2-a6e1e0bf35a0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.877274 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2503/4923] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:39 2022] DELETE /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.884731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.886920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.887806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.890621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.926335 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:09:39.926601 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 20:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:09:39.936281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 HTTP/1.1 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '789846fe-4990-42d5-b4d2-a6e1e0bf35a0'} Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.944391 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:39.948986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:39.948986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:39.948986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:39.948986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:39.948986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. Jul 26 20:09:39.948986 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:39.951304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 789846fe-4990-42d5-b4d2-a6e1e0bf35a0 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:39.953132 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-30174d0f-bbfd-43f1-baa9-cb6b4975c24f tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0" status: 404 len: 111 microversion: 2.1 time: 0.085068 Jul 26 20:09:39.967362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:39.968297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:39.973344 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2421/4924] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:39 2022] GET /compute/v2.1/servers/789846fe-4990-42d5-b4d2-a6e1e0bf35a0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:39.975062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.975660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:39.976692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:39.977350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:40.004462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d HTTP/1.1 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ecdf01a8-2c04-4701-bac7-10c942466b5d'} Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:40.007056 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.012371 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.014673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:40.016031 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f7ce5cd-c096-43b8-81a2-65d076261d93 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 404 len: 111 microversion: 2.1 time: 0.052476 Jul 26 20:09:40.017328 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2504/4925] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:39 2022] DELETE /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:40.024944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:40.025657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ecdf01a8-2c04-4701-bac7-10c942466b5d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:40.032606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:40.039151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:40.040076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:40.040548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:40.059110 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d HTTP/1.1 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ecdf01a8-2c04-4701-bac7-10c942466b5d'} Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.061421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ecdf01a8-2c04-4701-bac7-10c942466b5d could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-054d77fa-672a-40e7-9c28-d7e5b9c4ab66 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d" status: 404 len: 111 microversion: 2.1 time: 0.043121 Jul 26 20:09:40.067252 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2422/4926] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:40 2022] GET /compute/v2.1/servers/ecdf01a8-2c04-4701-bac7-10c942466b5d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:40.074216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b0cbb1d-6348-4cd1-8074-2053abcdb34b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:40.074936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0b0cbb1d-6348-4cd1-8074-2053abcdb34b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ec10a302-1a05-4d99-81f7-2bb81bd40db9] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:40.081540 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-0b0cbb1d-6348-4cd1-8074-2053abcdb34b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b0cbb1d-6348-4cd1-8074-2053abcdb34b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9 HTTP/1.1 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ec10a302-1a05-4d99-81f7-2bb81bd40db9'} Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:40.083339 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.088787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.088787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:40.088787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:40.088787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:40.088787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:40.088787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.088787 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.090196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b0cbb1d-6348-4cd1-8074-2053abcdb34b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:40.091326 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0b0cbb1d-6348-4cd1-8074-2053abcdb34b tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9" status: 404 len: 111 microversion: 2.1 time: 0.021000 Jul 26 20:09:40.100851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-83a1c307-7d85-4339-bad0-9716e3b05dc3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:40.102317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-83a1c307-7d85-4339-bad0-9716e3b05dc3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: ec10a302-1a05-4d99-81f7-2bb81bd40db9] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:40.104713 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2505/4927] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:40 2022] DELETE /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:40.110548 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-83a1c307-7d85-4339-bad0-9716e3b05dc3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-83a1c307-7d85-4339-bad0-9716e3b05dc3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9 HTTP/1.1 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ec10a302-1a05-4d99-81f7-2bb81bd40db9'} Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:40.112566 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:40.119014 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:40.119014 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:40.119014 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. Jul 26 20:09:40.119014 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:40.119014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-83a1c307-7d85-4339-bad0-9716e3b05dc3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance ec10a302-1a05-4d99-81f7-2bb81bd40db9 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:40.119014 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-83a1c307-7d85-4339-bad0-9716e3b05dc3 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9" status: 404 len: 111 microversion: 2.1 time: 0.017954 Jul 26 20:09:40.123728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5830287-a48f-4f68-ab69-fd903351e52a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:40.124244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5830287-a48f-4f68-ab69-fd903351e52a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:40.129765 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2423/4928] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:40 2022] GET /compute/v2.1/servers/ec10a302-1a05-4d99-81f7-2bb81bd40db9 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:40.131599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5830287-a48f-4f68-ab69-fd903351e52a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:40.132088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5830287-a48f-4f68-ab69-fd903351e52a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:40.132869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5830287-a48f-4f68-ab69-fd903351e52a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:40.133325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5830287-a48f-4f68-ab69-fd903351e52a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:40.163166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5830287-a48f-4f68-ab69-fd903351e52a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:09:40.297411 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5830287-a48f-4f68-ab69-fd903351e52a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 204 len: 0 microversion: 2.1 time: 0.177974 Jul 26 20:09:40.299429 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2506/4929] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:09:40 2022] DELETE /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:09:40.310769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c72c600f-4933-4262-b45f-b7ef4775427a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:40.311398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c72c600f-4933-4262-b45f-b7ef4775427a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:40.320426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c72c600f-4933-4262-b45f-b7ef4775427a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:40.320792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c72c600f-4933-4262-b45f-b7ef4775427a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:40.321755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c72c600f-4933-4262-b45f-b7ef4775427a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:40.322055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c72c600f-4933-4262-b45f-b7ef4775427a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:40.708705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c72c600f-4933-4262-b45f-b7ef4775427a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:40.718802 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c72c600f-4933-4262-b45f-b7ef4775427a tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1481 microversion: 2.1 time: 0.415150 Jul 26 20:09:40.734118 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2424/4930] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:40 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1481 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:40.811729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8237950b-08d8-42c0-9ca0-2c182ad7cff8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'create', calling method: .version_select at 0x7f8768393280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-19312781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJheX0ZCyjr6Hp2NtSvvwyXt/Je//Ogr11EFhLy5CertfmYuAGg/Jnna6zxwyat0ZB5A04llZXqZR1hGXlCyOx20L9+shYl9gVkbz7g4vRoXa2oA8ySoZ1VXZaIDutxJaA=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:40.829348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8237950b-08d8-42c0-9ca0-2c182ad7cff8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for project d237549546cf478aa27cf8759a57d4b4. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:09:40.838254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-8237950b-08d8-42c0-9ca0-2c182ad7cff8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for user 84e081d584b34009a7bbfbc2a6c14436 and project d237549546cf478aa27cf8759a57d4b4. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:09:40.874729 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8237950b-08d8-42c0-9ca0-2c182ad7cff8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.069079 Jul 26 20:09:40.875719 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2507/4931] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:09:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:09:41.743222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de1a99bb-c7d3-4c8d-ab7b-3854ef6d1485 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:41.743875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de1a99bb-c7d3-4c8d-ab7b-3854ef6d1485 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:41.760411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de1a99bb-c7d3-4c8d-ab7b-3854ef6d1485 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:41.762792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de1a99bb-c7d3-4c8d-ab7b-3854ef6d1485 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:41.768190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de1a99bb-c7d3-4c8d-ab7b-3854ef6d1485 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:41.769362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de1a99bb-c7d3-4c8d-ab7b-3854ef6d1485 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:42.232551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-de1a99bb-c7d3-4c8d-ab7b-3854ef6d1485 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2066a945044e9990628ed8b31ee98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937e17979c449a49e54fd33c0ae64a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:42.244487 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de1a99bb-c7d3-4c8d-ab7b-3854ef6d1485 tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 200 len: 1481 microversion: 2.1 time: 0.503098 Jul 26 20:09:42.246691 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2425/4932] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:41 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 1481 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:42.626332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9ad51987-5cd7-44d7-897e-e1385a924707 req-1c542b9c-ca70-4036-9c03-d3e458f186bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7669f2d9-5341-4a3a-a80f-c17ee32eaeb7", "name": "network-vif-deleted", "tag": "d55a01e3-c7a4-4b7a-a52b-ac7240b2268b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:42.641768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9ad51987-5cd7-44d7-897e-e1385a924707 req-1c542b9c-ca70-4036-9c03-d3e458f186bf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:42.643218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9ad51987-5cd7-44d7-897e-e1385a924707 req-1c542b9c-ca70-4036-9c03-d3e458f186bf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:42.666334 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9ad51987-5cd7-44d7-897e-e1385a924707 req-1c542b9c-ca70-4036-9c03-d3e458f186bf service nova] Creating event network-vif-deleted:d55a01e3-c7a4-4b7a-a52b-ac7240b2268b for instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 on n-h1-708768-8 Jul 26 20:09:42.672620 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9ad51987-5cd7-44d7-897e-e1385a924707 req-1c542b9c-ca70-4036-9c03-d3e458f186bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052053 Jul 26 20:09:42.674541 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2508/4933] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:09:42.802802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8437681e-d28b-4e88-9d6b-dd83fb686aeb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:42.807229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8437681e-d28b-4e88-9d6b-dd83fb686aeb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:42.835165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8437681e-d28b-4e88-9d6b-dd83fb686aeb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:42.835765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8437681e-d28b-4e88-9d6b-dd83fb686aeb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:42.836618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8437681e-d28b-4e88-9d6b-dd83fb686aeb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:42.837057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8437681e-d28b-4e88-9d6b-dd83fb686aeb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:42.902124 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8437681e-d28b-4e88-9d6b-dd83fb686aeb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.116239 Jul 26 20:09:42.904604 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2426/4934] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Jul 26 20:09:42 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:43.027201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6452e7c-1098-496c-9e9f-a4a12c1efaaa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:43.029794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b6452e7c-1098-496c-9e9f-a4a12c1efaaa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:43.036587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6452e7c-1098-496c-9e9f-a4a12c1efaaa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:43.037033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6452e7c-1098-496c-9e9f-a4a12c1efaaa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:43.038794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6452e7c-1098-496c-9e9f-a4a12c1efaaa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:43.048453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6452e7c-1098-496c-9e9f-a4a12c1efaaa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:43.118862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b6452e7c-1098-496c-9e9f-a4a12c1efaaa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:09:43.268230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:43.269580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] [instance: 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:43.300659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:43.302676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:43.305724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:43.306984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:43.367742 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] HTTP exception thrown: Instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 could not be found. Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Request method failure captured: Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 HTTP/1.1 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EkyPn0xJh-2qbVCzXHyaRSUR1ovyiO_ncRHeU76n1p7nseCQ3fgPSfK1_RZ7oM6mXh85sD4PA0DSloMaoTSzhQyglCn_yIDidIG2ZJGxzvY81gg21yDVIi5k5hnsglLltIShIJNYYDoP98ramfE1PbST4V7U_eJav012sFYqwZr0X0 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a937e17979c449a49e54fd33c0ae64a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a937e17979c449a49e54fd33c0ae64a0"}]}] Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersTestJSON-1278706448 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a937e17979c449a49e54fd33c0ae64a0 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersTestJSON-1278706448 Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: bf2066a945044e9990628ed8b31ee98d Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersTestJSON-1278706448-project Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 could not be found. Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7669f2d9-5341-4a3a-a80f-c17ee32eaeb7'} Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 could not be found. Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 could not be found. Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:43.377169 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:43.382798 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:43.382798 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:43.382798 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:43.382798 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:43.382798 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 could not be found. Jul 26 20:09:43.382798 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:43.384233 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b6452e7c-1098-496c-9e9f-a4a12c1efaaa tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 204 len: 0 microversion: 2.20 time: 0.358449 Jul 26 20:09:43.385150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] Returning 404 to user: Instance 7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:43.387365 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2509/4935] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:09:43 2022] DELETE /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 20:09:43.388236 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a82fe34d-b075-46b6-a3f1-253a0af0882c tempest-ServersTestJSON-1278706448 tempest-ServersTestJSON-1278706448-project] 10.222.0.58 "GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7" status: 404 len: 111 microversion: 2.1 time: 0.124503 Jul 26 20:09:43.395259 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2427/4936] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:43 2022] GET /compute/v2.1/servers/7669f2d9-5341-4a3a-a80f-c17ee32eaeb7 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:09:43.405004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:43.407178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:43.433512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:43.434373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:43.437663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:43.438353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:43.499997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-410155775", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7f1b8366-b249-47fc-ad65-8bf56452eb9f"}], "key_name": "tempest-TestNetworkBasicOps-19312781", "security_groups": [{"name": "tempest-secgroup-smoke-1049174804"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:43.774802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] validate_networks() for [('7f1b8366-b249-47fc-ad65-8bf56452eb9f', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:09:43.809170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:43.821084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:43.822632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:43.823895 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ae67a81e-d43d-476f-b395-40ecb7d260b9 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.429753 Jul 26 20:09:43.834705 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2510/4937] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:43 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:44.852969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:44.853596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:44.866962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:44.867420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:44.868247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:44.868686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:45.666338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:09:45.667415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:09:45.668341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:09:45.669423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:09:45.670082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:09:45.688235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:45.688987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:45.689985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:45.690595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:45.735366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for project d237549546cf478aa27cf8759a57d4b4. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:09:45.754641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for user 84e081d584b34009a7bbfbc2a6c14436 and project d237549546cf478aa27cf8759a57d4b4. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:09:45.817297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:09:45.820105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:09:45.952444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:45.974536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26ba8477-b9bc-467d-a00c-7e1b13dab4fd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.480383 Jul 26 20:09:45.975185 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2428/4938] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:09:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:09:45.985187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:45.987188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:45.993488 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8249721a-2d71-4ba1-b110-09253e8af308 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 1.145090 Jul 26 20:09:46.002371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a0ef7c9-489b-4171-ad6e-bc557f09416e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:46.007758 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2511/4939] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:44 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:46.008805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a0ef7c9-489b-4171-ad6e-bc557f09416e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:46.471251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1a0ef7c9-489b-4171-ad6e-bc557f09416e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:46.500232 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a0ef7c9-489b-4171-ad6e-bc557f09416e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1246 microversion: 2.1 time: 0.506365 Jul 26 20:09:46.515089 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2429/4940] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:45 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1246 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:47.023818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:47.024437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:47.042261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:47.042994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:47.043838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:47.044286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:47.522826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ccde7477-18b4-4908-bd0d-5255e2906a87 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:47.523444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ccde7477-18b4-4908-bd0d-5255e2906a87 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:47.728007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:47.767411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:47.769150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:47.783195 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea7b315f-1804-47c0-b72e-99f2ba8e042f tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1723 microversion: 2.20 time: 0.763348 Jul 26 20:09:47.788307 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2512/4941] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:47 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1723 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:48.253968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ccde7477-18b4-4908-bd0d-5255e2906a87 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:48.268859 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ccde7477-18b4-4908-bd0d-5255e2906a87 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1246 microversion: 2.1 time: 0.749771 Jul 26 20:09:48.283789 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2430/4942] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:47 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1246 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:48.817445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:48.818688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:48.830823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:48.831571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:48.832624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:48.833090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:48.853738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:48.970945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:48.985728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:48.987818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:48.989408 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8f047bbd-9553-4e6f-9bc4-e63d0d9ec64a tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1656 microversion: 2.20 time: 0.178932 Jul 26 20:09:48.990577 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2513/4943] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:48 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1656 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:49.291529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-51649507-3038-4649-9d16-1d8bfda8bc77 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:49.292168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-51649507-3038-4649-9d16-1d8bfda8bc77 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:49.305785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51649507-3038-4649-9d16-1d8bfda8bc77 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:49.306247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51649507-3038-4649-9d16-1d8bfda8bc77 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:49.310394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51649507-3038-4649-9d16-1d8bfda8bc77 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:49.310394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51649507-3038-4649-9d16-1d8bfda8bc77 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:49.490015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-51649507-3038-4649-9d16-1d8bfda8bc77 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:49.507156 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-51649507-3038-4649-9d16-1d8bfda8bc77 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1304 microversion: 2.1 time: 0.219013 Jul 26 20:09:49.509002 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2431/4944] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:49 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1304 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:50.016245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:50.017578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:50.042830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:50.046744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:50.048554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:50.053816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:50.154204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ed653c11-6924-427e-9ed5-5e4d1bb61ada req-e28f4138-05f7-4652-9c40-06bdef2c031d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c400aa-bca9-4bec-a8ef-e200c066995e", "name": "network-vif-deleted", "tag": "10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:50.179397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ed653c11-6924-427e-9ed5-5e4d1bb61ada req-e28f4138-05f7-4652-9c40-06bdef2c031d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:50.180045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ed653c11-6924-427e-9ed5-5e4d1bb61ada req-e28f4138-05f7-4652-9c40-06bdef2c031d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:50.200283 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ed653c11-6924-427e-9ed5-5e4d1bb61ada req-e28f4138-05f7-4652-9c40-06bdef2c031d service nova] Creating event network-vif-deleted:10f9c9ad-aa7c-4e0b-afab-2fe03a8f3dbf for instance b2c400aa-bca9-4bec-a8ef-e200c066995e on n-h2-708768-8 Jul 26 20:09:50.238808 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ed653c11-6924-427e-9ed5-5e4d1bb61ada req-e28f4138-05f7-4652-9c40-06bdef2c031d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098212 Jul 26 20:09:50.241038 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2432/4945] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:09:50.337916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:50.355454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:50.361876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c1dc05eec494fe6bf60bf0fc16ce47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656858d44e9c4e0d93600f0f59e9d409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:50.365847 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-20abd74a-302a-4d94-ba7c-71bd854bdb63 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 200 len: 1656 microversion: 2.20 time: 0.356352 Jul 26 20:09:50.379637 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2514/4946] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:50 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 1656 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 20:09:50.531635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08a635d8-b7e5-4637-aa94-78af6afca5d9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:50.532991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08a635d8-b7e5-4637-aa94-78af6afca5d9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:50.557053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08a635d8-b7e5-4637-aa94-78af6afca5d9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:50.558453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08a635d8-b7e5-4637-aa94-78af6afca5d9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:50.562596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08a635d8-b7e5-4637-aa94-78af6afca5d9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:50.563813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08a635d8-b7e5-4637-aa94-78af6afca5d9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:50.744939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-08a635d8-b7e5-4637-aa94-78af6afca5d9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:50.766875 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08a635d8-b7e5-4637-aa94-78af6afca5d9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1304 microversion: 2.1 time: 0.234113 Jul 26 20:09:50.767633 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2433/4947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:50 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:51.391781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:51.397904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:51.399228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:51.413123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:51.413978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:51.416510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:51.417265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:51.549021 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] HTTP exception thrown: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Request method failure captured: Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e HTTP/1.1 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EhG9EwxqYfjexnx1dTE21pukrGMHJ6c1I4jYQ13Lb1QjeUoM_5g4bisQz_fLPs-ShG7M7suaYAwVKkm9hsGt1VqMKLpon7kTt0n1ivtov6r85g2z15xsasUppjHv3qHTtTnFSNvcG6dRFS9gcBE7N--rViaWTgQE-QiWAuZUeYkYtQ Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_656858d44e9c4e0d93600f0f59e9d409", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}] Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9c1dc05eec494fe6bf60bf0fc16ce47e Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'b2c400aa-bca9-4bec-a8ef-e200c066995e'} Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:51.563603 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:51.570184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:51.570184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:51.570184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:51.570184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:51.570184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:51.570184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:51.570184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:51.570184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:09:51.574491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Returning 404 to user: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:51.577113 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e8f2e4aa-b7ef-481c-93bc-4fa0e76cb3eb tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 404 len: 111 microversion: 2.20 time: 0.186199 Jul 26 20:09:51.589909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bcb50602-2141-4b9d-ab1d-0dcfb58295a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '.version_select at 0x7f875ec6bee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:51.594916 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2515/4948] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:51 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:09:51.654204 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bcb50602-2141-4b9d-ab1d-0dcfb58295a1 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440079242" status: 204 len: 0 microversion: 2.20 time: 0.071489 Jul 26 20:09:51.655422 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2434/4949] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Jul 26 20:09:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440079242 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 20:09:51.789318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0ad64abe-0742-458d-9a19-07e76de27b2d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:51.790654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0ad64abe-0742-458d-9a19-07e76de27b2d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:51.801312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ad64abe-0742-458d-9a19-07e76de27b2d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:51.804597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ad64abe-0742-458d-9a19-07e76de27b2d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:51.808645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ad64abe-0742-458d-9a19-07e76de27b2d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:51.809344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0ad64abe-0742-458d-9a19-07e76de27b2d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:52.183927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0ad64abe-0742-458d-9a19-07e76de27b2d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:52.195333 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0ad64abe-0742-458d-9a19-07e76de27b2d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 0.410616 Jul 26 20:09:52.195959 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2516/4950] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:51 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:53.217366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-99898d62-b976-4862-b939-3f92d91a6c55 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:53.218258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-99898d62-b976-4862-b939-3f92d91a6c55 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:53.236017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99898d62-b976-4862-b939-3f92d91a6c55 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:53.238511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99898d62-b976-4862-b939-3f92d91a6c55 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:53.240682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99898d62-b976-4862-b939-3f92d91a6c55 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:53.241569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-99898d62-b976-4862-b939-3f92d91a6c55 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:53.513914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bc46e0cb-cd13-4f30-8fd9-0aa36fdfc0c3 req-e0121d0c-ba39-4f42-91e8-b9c6b0f6f291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68af0560-ba8a-4fc5-8d54-969471887394", "tag": "7ff22b3c-704c-4fd1-bd1c-d10e325af0f5"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:09:53.550700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bc46e0cb-cd13-4f30-8fd9-0aa36fdfc0c3 req-e0121d0c-ba39-4f42-91e8-b9c6b0f6f291 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:53.555123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bc46e0cb-cd13-4f30-8fd9-0aa36fdfc0c3 req-e0121d0c-ba39-4f42-91e8-b9c6b0f6f291 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:53.602798 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bc46e0cb-cd13-4f30-8fd9-0aa36fdfc0c3 req-e0121d0c-ba39-4f42-91e8-b9c6b0f6f291 service nova] Creating event network-changed:7ff22b3c-704c-4fd1-bd1c-d10e325af0f5 for instance 68af0560-ba8a-4fc5-8d54-969471887394 on n-h1-708768-8 Jul 26 20:09:53.615653 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bc46e0cb-cd13-4f30-8fd9-0aa36fdfc0c3 req-e0121d0c-ba39-4f42-91e8-b9c6b0f6f291 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113610 Jul 26 20:09:53.616882 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2517/4951] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:09:53.971179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-99898d62-b976-4862-b939-3f92d91a6c55 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:53.985879 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-99898d62-b976-4862-b939-3f92d91a6c55 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 0.772313 Jul 26 20:09:54.010843 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2435/4952] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:53 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:55.011895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-80a11d77-a936-4bb9-87b8-08ba62ca1d8f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:55.014107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-80a11d77-a936-4bb9-87b8-08ba62ca1d8f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:55.047278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80a11d77-a936-4bb9-87b8-08ba62ca1d8f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:55.055671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80a11d77-a936-4bb9-87b8-08ba62ca1d8f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:55.056876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80a11d77-a936-4bb9-87b8-08ba62ca1d8f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:55.061226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80a11d77-a936-4bb9-87b8-08ba62ca1d8f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:55.515132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-80a11d77-a936-4bb9-87b8-08ba62ca1d8f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:55.537024 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-80a11d77-a936-4bb9-87b8-08ba62ca1d8f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 0.531517 Jul 26 20:09:55.549855 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2518/4953] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:55 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:56.567637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9aab5a1a-6d58-4127-8307-bf50ed232ed4 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:56.569249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9aab5a1a-6d58-4127-8307-bf50ed232ed4 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:56.580338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:56.582613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9aab5a1a-6d58-4127-8307-bf50ed232ed4 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:56.583316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9aab5a1a-6d58-4127-8307-bf50ed232ed4 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:56.584644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9aab5a1a-6d58-4127-8307-bf50ed232ed4 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:56.585322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9aab5a1a-6d58-4127-8307-bf50ed232ed4 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:57.556152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9aab5a1a-6d58-4127-8307-bf50ed232ed4 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:57.556152 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9aab5a1a-6d58-4127-8307-bf50ed232ed4 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 0.973688 Jul 26 20:09:57.558453 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2436/4954] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:56 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:09:58.574446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-868cacd2-38f0-4e34-8529-cefc4c0d1f88 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:58.575659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-868cacd2-38f0-4e34-8529-cefc4c0d1f88 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:58.589031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868cacd2-38f0-4e34-8529-cefc4c0d1f88 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:58.593302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868cacd2-38f0-4e34-8529-cefc4c0d1f88 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:58.594334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868cacd2-38f0-4e34-8529-cefc4c0d1f88 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:58.594908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868cacd2-38f0-4e34-8529-cefc4c0d1f88 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:58.785384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:58.786003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:58.799168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:09:58.808143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:58.809742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:58.813524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:58.815541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:58.860266 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] HTTP exception thrown: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Request method failure captured: Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e HTTP/1.1 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EhG9EwxqYfjexnx1dTE21pukrGMHJ6c1I4jYQ13Lb1QjeUoM_5g4bisQz_fLPs-ShG7M7suaYAwVKkm9hsGt1VqMKLpon7kTt0n1ivtov6r85g2z15xsasUppjHv3qHTtTnFSNvcG6dRFS9gcBE7N--rViaWTgQE-QiWAuZUeYkYtQ Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_656858d44e9c4e0d93600f0f59e9d409", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}] Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c1dc05eec494fe6bf60bf0fc16ce47e Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'b2c400aa-bca9-4bec-a8ef-e200c066995e'} Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:58.866235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Returning 404 to user: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:58.869523 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e0edda4-21e8-448e-aab1-a7f6e68dd233 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 404 len: 111 microversion: 2.20 time: 0.088587 Jul 26 20:09:58.875824 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2437/4955] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:09:58 2022] DELETE /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:09:58.889390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:09:58.892647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: b2c400aa-bca9-4bec-a8ef-e200c066995e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:09:58.914648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:58.916268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:58.920492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:09:58.921559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:09:58.959522 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] HTTP exception thrown: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Request method failure captured: Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e HTTP/1.1 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EhG9EwxqYfjexnx1dTE21pukrGMHJ6c1I4jYQ13Lb1QjeUoM_5g4bisQz_fLPs-ShG7M7suaYAwVKkm9hsGt1VqMKLpon7kTt0n1ivtov6r85g2z15xsasUppjHv3qHTtTnFSNvcG6dRFS9gcBE7N--rViaWTgQE-QiWAuZUeYkYtQ Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_656858d44e9c4e0d93600f0f59e9d409", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}] Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c1dc05eec494fe6bf60bf0fc16ce47e Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'b2c400aa-bca9-4bec-a8ef-e200c066995e'} Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.962185 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:09:58.965927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Returning 404 to user: Instance b2c400aa-bca9-4bec-a8ef-e200c066995e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:09:58.976087 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0232917-fcf4-4cdb-b9f3-ee4d7b24b74d tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e" status: 404 len: 111 microversion: 2.20 time: 0.095327 Jul 26 20:09:58.976702 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2438/4956] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:09:58 2022] GET /compute/v2.1/servers/b2c400aa-bca9-4bec-a8ef-e200c066995e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:09:59.054738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-868cacd2-38f0-4e34-8529-cefc4c0d1f88 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:09:59.066416 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-868cacd2-38f0-4e34-8529-cefc4c0d1f88 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 0.496275 Jul 26 20:09:59.067025 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2519/4957] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:09:58 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:00.086263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9c722cf4-b854-4350-948a-f74accaf5b18 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:00.086880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9c722cf4-b854-4350-948a-f74accaf5b18 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:00.097716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:00.104980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c722cf4-b854-4350-948a-f74accaf5b18 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:00.105435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c722cf4-b854-4350-948a-f74accaf5b18 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:00.106248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c722cf4-b854-4350-948a-f74accaf5b18 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:00.106693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c722cf4-b854-4350-948a-f74accaf5b18 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:00.850144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9c722cf4-b854-4350-948a-f74accaf5b18 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:00.858622 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9c722cf4-b854-4350-948a-f74accaf5b18 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 0.776065 Jul 26 20:10:00.862775 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2439/4958] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:00 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:01.883791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9a3cc63-2285-43ad-835c-485849c06b36 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:01.884971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9a3cc63-2285-43ad-835c-485849c06b36 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:01.900031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc63-2285-43ad-835c-485849c06b36 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:01.900750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc63-2285-43ad-835c-485849c06b36 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:01.901749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc63-2285-43ad-835c-485849c06b36 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:01.904542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9a3cc63-2285-43ad-835c-485849c06b36 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:02.425652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9a3cc63-2285-43ad-835c-485849c06b36 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:02.439429 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9a3cc63-2285-43ad-835c-485849c06b36 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 0.559410 Jul 26 20:10:02.452061 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2520/4959] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:01 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:03.312096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3f9605fc-d2d8-48d2-9e83-a02e155285eb req-053574b8-4166-49a3-b959-11042d191c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68af0560-ba8a-4fc5-8d54-969471887394", "name": "network-vif-plugged", "status": "completed", "tag": "7ff22b3c-704c-4fd1-bd1c-d10e325af0f5"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:03.352759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3f9605fc-d2d8-48d2-9e83-a02e155285eb req-053574b8-4166-49a3-b959-11042d191c71 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:03.353833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3f9605fc-d2d8-48d2-9e83-a02e155285eb req-053574b8-4166-49a3-b959-11042d191c71 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:03.400886 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3f9605fc-d2d8-48d2-9e83-a02e155285eb req-053574b8-4166-49a3-b959-11042d191c71 service nova] Creating event network-vif-plugged:7ff22b3c-704c-4fd1-bd1c-d10e325af0f5 for instance 68af0560-ba8a-4fc5-8d54-969471887394 on n-h1-708768-8 Jul 26 20:10:03.438921 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3f9605fc-d2d8-48d2-9e83-a02e155285eb req-053574b8-4166-49a3-b959-11042d191c71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130629 Jul 26 20:10:03.442737 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2440/4960] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:10:03.462271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb24eb47-a686-462e-827b-2b7aaba49dd0 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:03.463831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eb24eb47-a686-462e-827b-2b7aaba49dd0 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:03.493759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb24eb47-a686-462e-827b-2b7aaba49dd0 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:03.502534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb24eb47-a686-462e-827b-2b7aaba49dd0 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:03.503734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb24eb47-a686-462e-827b-2b7aaba49dd0 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:03.504436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb24eb47-a686-462e-827b-2b7aaba49dd0 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:03.988079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eb24eb47-a686-462e-827b-2b7aaba49dd0 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:04.005542 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb24eb47-a686-462e-827b-2b7aaba49dd0 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 0.542250 Jul 26 20:10:04.021880 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2521/4961] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:03 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:04.795651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:04.796252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:04.808148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:04.819060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:04.820288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:04.820746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:04.895595 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] HTTP exception thrown: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Request method failure captured: Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb HTTP/1.1 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EhG9EwxqYfjexnx1dTE21pukrGMHJ6c1I4jYQ13Lb1QjeUoM_5g4bisQz_fLPs-ShG7M7suaYAwVKkm9hsGt1VqMKLpon7kTt0n1ivtov6r85g2z15xsasUppjHv3qHTtTnFSNvcG6dRFS9gcBE7N--rViaWTgQE-QiWAuZUeYkYtQ Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_656858d44e9c4e0d93600f0f59e9d409", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}] Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 9c1dc05eec494fe6bf60bf0fc16ce47e Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f87df55d-ecd6-431b-8f7b-95ef5e1132eb'} Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:10:04.900842 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.903984 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.913337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Returning 404 to user: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:10:04.914793 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-caf2a7f8-fc94-4270-920f-d8fa56bac82e tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 404 len: 111 microversion: 2.20 time: 0.125041 Jul 26 20:10:04.915559 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2441/4962] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Jul 26 20:10:04 2022] DELETE /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:10:04.924967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:04.926222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] [instance: f87df55d-ecd6-431b-8f7b-95ef5e1132eb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:04.941594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:04.942290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:04.946724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:04.948560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:04.979953 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] HTTP exception thrown: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Request method failure captured: Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb HTTP/1.1 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EhG9EwxqYfjexnx1dTE21pukrGMHJ6c1I4jYQ13Lb1QjeUoM_5g4bisQz_fLPs-ShG7M7suaYAwVKkm9hsGt1VqMKLpon7kTt0n1ivtov6r85g2z15xsasUppjHv3qHTtTnFSNvcG6dRFS9gcBE7N--rViaWTgQE-QiWAuZUeYkYtQ Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_656858d44e9c4e0d93600f0f59e9d409", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/656858d44e9c4e0d93600f0f59e9d409"}]}] Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 656858d44e9c4e0d93600f0f59e9d409 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943098364 Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 9c1dc05eec494fe6bf60bf0fc16ce47e Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943098364-project Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f87df55d-ecd6-431b-8f7b-95ef5e1132eb'} Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.990509 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] Returning 404 to user: Instance f87df55d-ecd6-431b-8f7b-95ef5e1132eb could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-706ed666-c832-42c8-a05f-2a22a1e51f71 tempest-AttachVolumeShelveTestJSON-943098364 tempest-AttachVolumeShelveTestJSON-943098364-project] 10.222.0.58 "GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb" status: 404 len: 111 microversion: 2.20 time: 0.071686 Jul 26 20:10:04.993621 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2522/4963] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Jul 26 20:10:04 2022] GET /compute/v2.1/servers/f87df55d-ecd6-431b-8f7b-95ef5e1132eb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:10:05.037988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f4f78428-5623-4f5e-9a30-4223a79bb5d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:05.048859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f4f78428-5623-4f5e-9a30-4223a79bb5d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:05.050021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6964da3e-453c-42c7-a0cf-ba2092083d98 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:05.053458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6964da3e-453c-42c7-a0cf-ba2092083d98 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:05.080724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4f78428-5623-4f5e-9a30-4223a79bb5d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:05.081121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4f78428-5623-4f5e-9a30-4223a79bb5d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:05.086800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6964da3e-453c-42c7-a0cf-ba2092083d98 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:05.088322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4f78428-5623-4f5e-9a30-4223a79bb5d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:05.088826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4f78428-5623-4f5e-9a30-4223a79bb5d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:05.093790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6964da3e-453c-42c7-a0cf-ba2092083d98 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:05.096515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6964da3e-453c-42c7-a0cf-ba2092083d98 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:05.099763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6964da3e-453c-42c7-a0cf-ba2092083d98 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:05.628977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6964da3e-453c-42c7-a0cf-ba2092083d98 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:05.638979 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6964da3e-453c-42c7-a0cf-ba2092083d98 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.609563 Jul 26 20:10:05.647661 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2523/4964] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:05 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:05.677062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8317fbf6-6e0b-4627-90e3-120b6dc29130 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:05.679825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8317fbf6-6e0b-4627-90e3-120b6dc29130 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:05.696144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8317fbf6-6e0b-4627-90e3-120b6dc29130 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:05.696861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8317fbf6-6e0b-4627-90e3-120b6dc29130 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:05.698144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8317fbf6-6e0b-4627-90e3-120b6dc29130 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:05.698820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8317fbf6-6e0b-4627-90e3-120b6dc29130 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:06.144301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8317fbf6-6e0b-4627-90e3-120b6dc29130 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:06.153236 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8317fbf6-6e0b-4627-90e3-120b6dc29130 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.480047 Jul 26 20:10:06.169881 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2524/4965] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:05 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:06.177116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34ff2f64-5a43-4db5-b8aa-54486e975cb7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:06.179906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34ff2f64-5a43-4db5-b8aa-54486e975cb7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:06.187089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34ff2f64-5a43-4db5-b8aa-54486e975cb7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:06.187865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34ff2f64-5a43-4db5-b8aa-54486e975cb7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:06.188903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34ff2f64-5a43-4db5-b8aa-54486e975cb7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:06.189492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34ff2f64-5a43-4db5-b8aa-54486e975cb7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:06.513154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f4f78428-5623-4f5e-9a30-4223a79bb5d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:06.525709 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f4f78428-5623-4f5e-9a30-4223a79bb5d1 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1372 microversion: 2.1 time: 1.498610 Jul 26 20:10:06.530946 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2442/4966] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:05 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1372 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:07.073996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34ff2f64-5a43-4db5-b8aa-54486e975cb7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:07.090170 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34ff2f64-5a43-4db5-b8aa-54486e975cb7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.918737 Jul 26 20:10:07.094686 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2525/4967] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:06 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:07.119470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0803127c-8a92-47e5-9198-f12f6d80641c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:07.120530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0803127c-8a92-47e5-9198-f12f6d80641c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:07.131798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0803127c-8a92-47e5-9198-f12f6d80641c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:07.139423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0803127c-8a92-47e5-9198-f12f6d80641c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:07.140530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0803127c-8a92-47e5-9198-f12f6d80641c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:07.141129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0803127c-8a92-47e5-9198-f12f6d80641c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:07.548570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e255c12-6e1d-4d13-8c83-fa381461f932 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:07.549199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e255c12-6e1d-4d13-8c83-fa381461f932 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:07.561271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e255c12-6e1d-4d13-8c83-fa381461f932 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:07.561742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e255c12-6e1d-4d13-8c83-fa381461f932 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:07.562551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e255c12-6e1d-4d13-8c83-fa381461f932 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:07.562994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e255c12-6e1d-4d13-8c83-fa381461f932 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:07.697243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0803127c-8a92-47e5-9198-f12f6d80641c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:07.705700 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0803127c-8a92-47e5-9198-f12f6d80641c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.590730 Jul 26 20:10:07.711993 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2443/4968] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:07 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:07.961790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1441403582", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "287d382c-eec4-43bb-95a9-783a796404b9"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:08.054374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] validate_networks() for [('287d382c-eec4-43bb-95a9-783a796404b9', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:10:08.777842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3e255c12-6e1d-4d13-8c83-fa381461f932 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:08.788394 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e255c12-6e1d-4d13-8c83-fa381461f932 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1545 microversion: 2.1 time: 1.245071 Jul 26 20:10:08.790219 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2526/4969] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:07 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1545 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:08.816577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6be29e58-e479-4557-8390-8f20a355ac9c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:08.817207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6be29e58-e479-4557-8390-8f20a355ac9c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:08.830435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6be29e58-e479-4557-8390-8f20a355ac9c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:08.830900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6be29e58-e479-4557-8390-8f20a355ac9c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:08.831741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6be29e58-e479-4557-8390-8f20a355ac9c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:08.832191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6be29e58-e479-4557-8390-8f20a355ac9c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:09.189000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:10:09.189480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:10:09.190050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:10:09.190538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:10:09.191144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:10:09.223557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:09.227270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:09.231441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:09.233071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:09.292095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:10:09.300720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for user 4418a0cb57744aa5a56a3fdcce0947cc and project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:10:09.316472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:10:09.321576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:10:09.393062 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6bfa0518-1689-4aea-b37c-da4ed1a75dbd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439136 Jul 26 20:10:09.394518 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2444/4970] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:10:09.409975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0de32ec5-b61b-4189-a3ad-8e538e4bcb92 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:09.430108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0de32ec5-b61b-4189-a3ad-8e538e4bcb92 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:09.585220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0de32ec5-b61b-4189-a3ad-8e538e4bcb92 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:09.622564 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0de32ec5-b61b-4189-a3ad-8e538e4bcb92 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1215 microversion: 2.1 time: 0.220672 Jul 26 20:10:09.634526 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2445/4971] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:09 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:09.856510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6be29e58-e479-4557-8390-8f20a355ac9c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:09.866249 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6be29e58-e479-4557-8390-8f20a355ac9c tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1545 microversion: 2.1 time: 1.056219 Jul 26 20:10:09.866841 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2527/4972] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:08 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1545 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:10.131821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1835577663", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:10.254925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] validate_networks() for [('7cda145a-7c15-4529-b4ae-fda552c43889', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:10:10.655699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4924040-4a1f-4e7b-9138-0f62c50d2a7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:10.656563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4924040-4a1f-4e7b-9138-0f62c50d2a7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:10.677317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:10.678921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4924040-4a1f-4e7b-9138-0f62c50d2a7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:10.689451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4924040-4a1f-4e7b-9138-0f62c50d2a7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:10.690562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4924040-4a1f-4e7b-9138-0f62c50d2a7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:10.692127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4924040-4a1f-4e7b-9138-0f62c50d2a7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:10.843575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4924040-4a1f-4e7b-9138-0f62c50d2a7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:10.860352 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4924040-4a1f-4e7b-9138-0f62c50d2a7a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1219 microversion: 2.1 time: 0.202756 Jul 26 20:10:10.861673 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2528/4973] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:10 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:11.886946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c80be2e-3e30-4fe5-a782-a733dd42c08f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:11.889030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0c80be2e-3e30-4fe5-a782-a733dd42c08f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:11.904409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c80be2e-3e30-4fe5-a782-a733dd42c08f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:11.908532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c80be2e-3e30-4fe5-a782-a733dd42c08f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:11.911535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c80be2e-3e30-4fe5-a782-a733dd42c08f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:11.912176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c80be2e-3e30-4fe5-a782-a733dd42c08f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:12.188395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0c80be2e-3e30-4fe5-a782-a733dd42c08f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:12.213380 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0c80be2e-3e30-4fe5-a782-a733dd42c08f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1285 microversion: 2.1 time: 0.332050 Jul 26 20:10:12.218056 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2529/4974] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:11 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1285 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:13.238860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cfe3abc2-7736-481b-9b20-cbe638389a8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:13.240396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cfe3abc2-7736-481b-9b20-cbe638389a8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:13.259814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfe3abc2-7736-481b-9b20-cbe638389a8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:13.260269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfe3abc2-7736-481b-9b20-cbe638389a8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:13.266017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfe3abc2-7736-481b-9b20-cbe638389a8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:13.267909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfe3abc2-7736-481b-9b20-cbe638389a8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:13.631285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cfe3abc2-7736-481b-9b20-cbe638389a8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:13.644343 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cfe3abc2-7736-481b-9b20-cbe638389a8d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1273 microversion: 2.1 time: 0.409216 Jul 26 20:10:13.646401 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2530/4975] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:13 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:13.734686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:10:13.737933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:10:13.739443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:10:13.741226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:10:13.741655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:10:13.753003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:13.753733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:13.754823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:13.755442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:13.764716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=82 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:13.790659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Getting quotas for project 14657ed655d94ec08a847a22ec8d96d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:10:13.808449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Getting quotas for user c5db253037f7490cb99f9108c72010fc and project 14657ed655d94ec08a847a22ec8d96d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:10:13.847556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:10:13.850131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:10:13.941950 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-50439900-0446-4c4b-9906-8adf04edb78b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.101542 Jul 26 20:10:13.943115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2446/4976] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:10:13.955304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c8ba1561-eaac-4bf5-b280-a28f2420834f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:13.958174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c8ba1561-eaac-4bf5-b280-a28f2420834f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:14.191963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c8ba1561-eaac-4bf5-b280-a28f2420834f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:14.203871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c8ba1561-eaac-4bf5-b280-a28f2420834f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1217 microversion: 2.1 time: 0.252245 Jul 26 20:10:14.218973 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2531/4977] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:13 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:14.670457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3f736d4e-9d0b-41b7-8117-86402a25f7a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:14.671177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3f736d4e-9d0b-41b7-8117-86402a25f7a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:14.709820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f736d4e-9d0b-41b7-8117-86402a25f7a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:14.714392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f736d4e-9d0b-41b7-8117-86402a25f7a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:14.717931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f736d4e-9d0b-41b7-8117-86402a25f7a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:14.730619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f736d4e-9d0b-41b7-8117-86402a25f7a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:15.238733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b84c351a-670f-4cbb-a1a3-9092830765e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:15.244513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b84c351a-670f-4cbb-a1a3-9092830765e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:15.350892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b84c351a-670f-4cbb-a1a3-9092830765e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:15.352048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b84c351a-670f-4cbb-a1a3-9092830765e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:15.359962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b84c351a-670f-4cbb-a1a3-9092830765e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:15.364586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b84c351a-670f-4cbb-a1a3-9092830765e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:15.983640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b84c351a-670f-4cbb-a1a3-9092830765e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:16.019055 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b84c351a-670f-4cbb-a1a3-9092830765e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1221 microversion: 2.1 time: 0.794213 Jul 26 20:10:16.025134 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2532/4978] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:15 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1221 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:16.182671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3f736d4e-9d0b-41b7-8117-86402a25f7a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:16.194280 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3f736d4e-9d0b-41b7-8117-86402a25f7a3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 1.529462 Jul 26 20:10:16.209986 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2447/4979] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:14 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:17.055845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ffe531c7-bd39-493a-a105-bdbc4e07acb9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:17.058222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ffe531c7-bd39-493a-a105-bdbc4e07acb9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:17.086906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffe531c7-bd39-493a-a105-bdbc4e07acb9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:17.095067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffe531c7-bd39-493a-a105-bdbc4e07acb9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:17.098429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffe531c7-bd39-493a-a105-bdbc4e07acb9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:17.098890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffe531c7-bd39-493a-a105-bdbc4e07acb9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:17.230563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-04b1b1b5-313d-4991-8c60-82512dca6281 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:17.231187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-04b1b1b5-313d-4991-8c60-82512dca6281 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:17.240467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04b1b1b5-313d-4991-8c60-82512dca6281 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:17.240758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04b1b1b5-313d-4991-8c60-82512dca6281 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:17.241558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04b1b1b5-313d-4991-8c60-82512dca6281 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:17.241998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04b1b1b5-313d-4991-8c60-82512dca6281 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:17.272869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:17.955255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ffe531c7-bd39-493a-a105-bdbc4e07acb9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:17.962509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-04b1b1b5-313d-4991-8c60-82512dca6281 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:17.971444 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ffe531c7-bd39-493a-a105-bdbc4e07acb9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1275 microversion: 2.1 time: 0.924693 Jul 26 20:10:17.974038 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2533/4980] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:17 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1275 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:17.978386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-04b1b1b5-313d-4991-8c60-82512dca6281 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 0.748638 Jul 26 20:10:17.979358 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2448/4981] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:17 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:18.995703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89275ab9-c070-40c6-a56c-d98bbc717785 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:18.996549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89275ab9-c070-40c6-a56c-d98bbc717785 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:19.010402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1be33c0-bf16-4b93-92f6-2221c06935cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:19.011983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1be33c0-bf16-4b93-92f6-2221c06935cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:19.013224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89275ab9-c070-40c6-a56c-d98bbc717785 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:19.023495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89275ab9-c070-40c6-a56c-d98bbc717785 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:19.024773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89275ab9-c070-40c6-a56c-d98bbc717785 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:19.025360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89275ab9-c070-40c6-a56c-d98bbc717785 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:19.050139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1be33c0-bf16-4b93-92f6-2221c06935cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:19.053996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1be33c0-bf16-4b93-92f6-2221c06935cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:19.055101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1be33c0-bf16-4b93-92f6-2221c06935cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:19.058991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1be33c0-bf16-4b93-92f6-2221c06935cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:19.298865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-89275ab9-c070-40c6-a56c-d98bbc717785 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:19.326106 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89275ab9-c070-40c6-a56c-d98bbc717785 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1275 microversion: 2.1 time: 0.334817 Jul 26 20:10:19.327061 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2534/4982] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:18 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1275 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:20.011786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1be33c0-bf16-4b93-92f6-2221c06935cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:20.054702 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1be33c0-bf16-4b93-92f6-2221c06935cf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 1.050011 Jul 26 20:10:20.057852 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2449/4983] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:19 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:20.350011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd22e299-1c7c-415b-b82a-4e32c8c727b8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:20.351143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd22e299-1c7c-415b-b82a-4e32c8c727b8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:20.367010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd22e299-1c7c-415b-b82a-4e32c8c727b8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:20.370916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd22e299-1c7c-415b-b82a-4e32c8c727b8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:20.372033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd22e299-1c7c-415b-b82a-4e32c8c727b8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:20.372484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd22e299-1c7c-415b-b82a-4e32c8c727b8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:20.535012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd22e299-1c7c-415b-b82a-4e32c8c727b8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:20.551467 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd22e299-1c7c-415b-b82a-4e32c8c727b8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1275 microversion: 2.1 time: 0.203998 Jul 26 20:10:20.552419 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2535/4984] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:20 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:21.024743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-8132c674-21f4-4c3a-ac4f-11c85fad812d req-24d54aad-d3d5-42ac-8e2d-50f861510b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6e47f0-457a-4d22-853f-24116a603d3b", "tag": "a99efec3-a193-4fd8-8b20-17e9fa87314c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:21.070157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8132c674-21f4-4c3a-ac4f-11c85fad812d req-24d54aad-d3d5-42ac-8e2d-50f861510b36 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:21.070640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8132c674-21f4-4c3a-ac4f-11c85fad812d req-24d54aad-d3d5-42ac-8e2d-50f861510b36 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:21.080812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c4675d2-b790-4a6e-994d-78b95825f913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:21.081704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3c4675d2-b790-4a6e-994d-78b95825f913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:21.111962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c4675d2-b790-4a6e-994d-78b95825f913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:21.115895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c4675d2-b790-4a6e-994d-78b95825f913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:21.117570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c4675d2-b790-4a6e-994d-78b95825f913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:21.118173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c4675d2-b790-4a6e-994d-78b95825f913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:21.130179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-8132c674-21f4-4c3a-ac4f-11c85fad812d req-24d54aad-d3d5-42ac-8e2d-50f861510b36 service nova] Creating event network-changed:a99efec3-a193-4fd8-8b20-17e9fa87314c for instance 4a6e47f0-457a-4d22-853f-24116a603d3b on n-h1-708768-8 Jul 26 20:10:21.162291 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-8132c674-21f4-4c3a-ac4f-11c85fad812d req-24d54aad-d3d5-42ac-8e2d-50f861510b36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142177 Jul 26 20:10:21.165543 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2450/4985] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:10:21.586577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0371d3e7-9233-4d4f-be98-8e8d1ca36e84 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:21.588502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0371d3e7-9233-4d4f-be98-8e8d1ca36e84 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:21.600691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0371d3e7-9233-4d4f-be98-8e8d1ca36e84 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:21.601818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0371d3e7-9233-4d4f-be98-8e8d1ca36e84 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:21.603245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0371d3e7-9233-4d4f-be98-8e8d1ca36e84 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:21.604057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0371d3e7-9233-4d4f-be98-8e8d1ca36e84 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:21.635040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c4675d2-b790-4a6e-994d-78b95825f913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:21.656778 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c4675d2-b790-4a6e-994d-78b95825f913 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 0.577539 Jul 26 20:10:21.659670 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2536/4986] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:21 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:22.479311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0371d3e7-9233-4d4f-be98-8e8d1ca36e84 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:22.497824 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0371d3e7-9233-4d4f-be98-8e8d1ca36e84 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 0.916945 Jul 26 20:10:22.499103 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2451/4987] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:21 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:22.693438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38f89694-a6b6-44bb-b6f8-4085699c7825 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:22.694210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38f89694-a6b6-44bb-b6f8-4085699c7825 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:22.730407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f89694-a6b6-44bb-b6f8-4085699c7825 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:22.731460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f89694-a6b6-44bb-b6f8-4085699c7825 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:22.736607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f89694-a6b6-44bb-b6f8-4085699c7825 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:22.740132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38f89694-a6b6-44bb-b6f8-4085699c7825 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:23.497043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38f89694-a6b6-44bb-b6f8-4085699c7825 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:23.511432 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38f89694-a6b6-44bb-b6f8-4085699c7825 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 0.821014 Jul 26 20:10:23.526696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dbdd8d1c-934e-4db4-b879-c6b43aaa0f72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:23.527307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dbdd8d1c-934e-4db4-b879-c6b43aaa0f72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:23.530449 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2537/4988] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:22 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:23.536891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbdd8d1c-934e-4db4-b879-c6b43aaa0f72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:23.537343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbdd8d1c-934e-4db4-b879-c6b43aaa0f72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:23.550862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbdd8d1c-934e-4db4-b879-c6b43aaa0f72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:23.551436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbdd8d1c-934e-4db4-b879-c6b43aaa0f72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:23.765408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:23.834550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=14 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:24.085722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dbdd8d1c-934e-4db4-b879-c6b43aaa0f72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:24.101389 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dbdd8d1c-934e-4db4-b879-c6b43aaa0f72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 0.578383 Jul 26 20:10:24.120006 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2452/4989] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:23 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:24.539504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4aefad8d-17fe-4232-89e9-e8c437480b4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:24.540199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4aefad8d-17fe-4232-89e9-e8c437480b4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:24.559408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:24.588211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4aefad8d-17fe-4232-89e9-e8c437480b4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:24.591005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4aefad8d-17fe-4232-89e9-e8c437480b4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:24.592425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4aefad8d-17fe-4232-89e9-e8c437480b4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:24.594019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4aefad8d-17fe-4232-89e9-e8c437480b4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:24.885290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4a12f80c-d9f2-47b0-9f64-ba893285b7a9 req-1f6fe2d3-52fc-4dd3-8fc4-ff816e43261e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f", "tag": "2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:25.018208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4a12f80c-d9f2-47b0-9f64-ba893285b7a9 req-1f6fe2d3-52fc-4dd3-8fc4-ff816e43261e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:25.021424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4a12f80c-d9f2-47b0-9f64-ba893285b7a9 req-1f6fe2d3-52fc-4dd3-8fc4-ff816e43261e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:25.092238 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-4a12f80c-d9f2-47b0-9f64-ba893285b7a9 req-1f6fe2d3-52fc-4dd3-8fc4-ff816e43261e service nova] Creating event network-changed:2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c for instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f on n-h2-708768-8 Jul 26 20:10:25.119861 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4a12f80c-d9f2-47b0-9f64-ba893285b7a9 req-1f6fe2d3-52fc-4dd3-8fc4-ff816e43261e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243427 Jul 26 20:10:25.123324 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2453/4990] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:10:25.174970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2387de40-8025-4558-9e73-5aba16707016 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:25.180339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2387de40-8025-4558-9e73-5aba16707016 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:25.200981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2387de40-8025-4558-9e73-5aba16707016 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:25.201765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2387de40-8025-4558-9e73-5aba16707016 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:25.218352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2387de40-8025-4558-9e73-5aba16707016 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:25.219492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2387de40-8025-4558-9e73-5aba16707016 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:25.592577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4aefad8d-17fe-4232-89e9-e8c437480b4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:25.610312 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4aefad8d-17fe-4232-89e9-e8c437480b4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 1.073172 Jul 26 20:10:25.633283 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2538/4991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:24 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:26.419911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2387de40-8025-4558-9e73-5aba16707016 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:26.434897 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2387de40-8025-4558-9e73-5aba16707016 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 1.304506 Jul 26 20:10:26.441466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2454/4992] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:25 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:26.641885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56fb4b28-5265-4362-b9d1-d34c1705393a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:26.643088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56fb4b28-5265-4362-b9d1-d34c1705393a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:26.658269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56fb4b28-5265-4362-b9d1-d34c1705393a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:26.661699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56fb4b28-5265-4362-b9d1-d34c1705393a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:26.662940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56fb4b28-5265-4362-b9d1-d34c1705393a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:26.670604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56fb4b28-5265-4362-b9d1-d34c1705393a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:27.178168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56fb4b28-5265-4362-b9d1-d34c1705393a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:27.187346 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56fb4b28-5265-4362-b9d1-d34c1705393a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 0.550089 Jul 26 20:10:27.201743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2539/4993] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:26 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:27.466089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-514a1eb7-be4a-4e3f-9d23-9e9f4b64079b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:27.468061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-514a1eb7-be4a-4e3f-9d23-9e9f4b64079b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:27.478029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-514a1eb7-be4a-4e3f-9d23-9e9f4b64079b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:27.486777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-514a1eb7-be4a-4e3f-9d23-9e9f4b64079b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:27.493432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-514a1eb7-be4a-4e3f-9d23-9e9f4b64079b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:27.494027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-514a1eb7-be4a-4e3f-9d23-9e9f4b64079b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:27.830541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-514a1eb7-be4a-4e3f-9d23-9e9f4b64079b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:27.846217 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-514a1eb7-be4a-4e3f-9d23-9e9f4b64079b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 0.382707 Jul 26 20:10:27.846910 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2455/4994] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:27 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:28.209164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2558ef2b-59c1-4ab1-b1b8-0e67aa6266e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:28.210460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2558ef2b-59c1-4ab1-b1b8-0e67aa6266e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:28.230609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2558ef2b-59c1-4ab1-b1b8-0e67aa6266e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:28.231427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2558ef2b-59c1-4ab1-b1b8-0e67aa6266e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:28.233581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2558ef2b-59c1-4ab1-b1b8-0e67aa6266e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:28.236912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2558ef2b-59c1-4ab1-b1b8-0e67aa6266e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:28.789848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2558ef2b-59c1-4ab1-b1b8-0e67aa6266e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:28.805021 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2558ef2b-59c1-4ab1-b1b8-0e67aa6266e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 0.599930 Jul 26 20:10:28.807725 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2540/4995] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:28 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:28.874867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-955323bd-b7f5-425e-b194-f8f78b14eaab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:28.876264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-955323bd-b7f5-425e-b194-f8f78b14eaab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:28.887119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-955323bd-b7f5-425e-b194-f8f78b14eaab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:28.892668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-955323bd-b7f5-425e-b194-f8f78b14eaab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:28.894456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-955323bd-b7f5-425e-b194-f8f78b14eaab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:28.897836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-955323bd-b7f5-425e-b194-f8f78b14eaab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:29.826952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c26395d-190f-4a8a-b698-822aa86aa151 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:29.828210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c26395d-190f-4a8a-b698-822aa86aa151 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:29.838087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c26395d-190f-4a8a-b698-822aa86aa151 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:29.838873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c26395d-190f-4a8a-b698-822aa86aa151 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:29.839317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c26395d-190f-4a8a-b698-822aa86aa151 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:29.839794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c26395d-190f-4a8a-b698-822aa86aa151 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:30.293538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-955323bd-b7f5-425e-b194-f8f78b14eaab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:30.312188 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-955323bd-b7f5-425e-b194-f8f78b14eaab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 1.434857 Jul 26 20:10:30.312881 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2456/4996] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:28 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:30.616843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9c26395d-190f-4a8a-b698-822aa86aa151 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:30.631996 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c26395d-190f-4a8a-b698-822aa86aa151 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 0.809334 Jul 26 20:10:30.633996 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2541/4997] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:29 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:31.345573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60b0dd27-6a83-4a47-adc6-2725b54eee82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:31.346780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60b0dd27-6a83-4a47-adc6-2725b54eee82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:31.369874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:31.390698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60b0dd27-6a83-4a47-adc6-2725b54eee82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:31.397142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60b0dd27-6a83-4a47-adc6-2725b54eee82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:31.403032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60b0dd27-6a83-4a47-adc6-2725b54eee82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:31.404348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60b0dd27-6a83-4a47-adc6-2725b54eee82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:31.655537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4455271b-3130-4136-aa50-3c4f8ed96c15 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:31.656799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4455271b-3130-4136-aa50-3c4f8ed96c15 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:31.673912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4455271b-3130-4136-aa50-3c4f8ed96c15 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:31.674467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4455271b-3130-4136-aa50-3c4f8ed96c15 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:31.675694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4455271b-3130-4136-aa50-3c4f8ed96c15 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:31.676673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4455271b-3130-4136-aa50-3c4f8ed96c15 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:32.011990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4455271b-3130-4136-aa50-3c4f8ed96c15 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:32.045376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4455271b-3130-4136-aa50-3c4f8ed96c15 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 0.389256 Jul 26 20:10:32.046197 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2542/4998] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:31 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:32.319109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60b0dd27-6a83-4a47-adc6-2725b54eee82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:32.341928 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60b0dd27-6a83-4a47-adc6-2725b54eee82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 0.989948 Jul 26 20:10:32.342878 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2457/4999] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:31 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:33.072158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a6d7124a-ceb3-49fd-8b9b-41e4cf2befbe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:33.072642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a6d7124a-ceb3-49fd-8b9b-41e4cf2befbe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:33.082320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6d7124a-ceb3-49fd-8b9b-41e4cf2befbe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:33.082771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6d7124a-ceb3-49fd-8b9b-41e4cf2befbe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:33.083548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6d7124a-ceb3-49fd-8b9b-41e4cf2befbe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:33.084017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6d7124a-ceb3-49fd-8b9b-41e4cf2befbe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:33.380102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-056880f3-6fd2-4159-9e47-9b90af56e769 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:33.380772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-056880f3-6fd2-4159-9e47-9b90af56e769 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:33.400924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-056880f3-6fd2-4159-9e47-9b90af56e769 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:33.403255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-056880f3-6fd2-4159-9e47-9b90af56e769 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:33.406138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-056880f3-6fd2-4159-9e47-9b90af56e769 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:33.407089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-056880f3-6fd2-4159-9e47-9b90af56e769 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:33.786556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-056880f3-6fd2-4159-9e47-9b90af56e769 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:33.802665 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-056880f3-6fd2-4159-9e47-9b90af56e769 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 0.434537 Jul 26 20:10:33.804250 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2458/5000] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:33 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:33.873281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3bd2994c-5e6c-4a25-9ff6-32fd48e469a8 req-556106e5-c966-47ba-9468-e15ae813bbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6e47f0-457a-4d22-853f-24116a603d3b", "name": "network-vif-plugged", "status": "completed", "tag": "a99efec3-a193-4fd8-8b20-17e9fa87314c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:33.897129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3bd2994c-5e6c-4a25-9ff6-32fd48e469a8 req-556106e5-c966-47ba-9468-e15ae813bbb8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:33.902212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3bd2994c-5e6c-4a25-9ff6-32fd48e469a8 req-556106e5-c966-47ba-9468-e15ae813bbb8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:33.929444 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3bd2994c-5e6c-4a25-9ff6-32fd48e469a8 req-556106e5-c966-47ba-9468-e15ae813bbb8 service nova] Creating event network-vif-plugged:a99efec3-a193-4fd8-8b20-17e9fa87314c for instance 4a6e47f0-457a-4d22-853f-24116a603d3b on n-h1-708768-8 Jul 26 20:10:33.944709 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3bd2994c-5e6c-4a25-9ff6-32fd48e469a8 req-556106e5-c966-47ba-9468-e15ae813bbb8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078376 Jul 26 20:10:33.945599 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2459/5001] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:10:34.075242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6d7124a-ceb3-49fd-8b9b-41e4cf2befbe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:34.096327 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a6d7124a-ceb3-49fd-8b9b-41e4cf2befbe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 1.023130 Jul 26 20:10:34.097366 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2543/5002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:33 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:34.827160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e9c0b8b-9956-4df9-ba1c-cdee5a456ab3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:34.827974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e9c0b8b-9956-4df9-ba1c-cdee5a456ab3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:34.854564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e9c0b8b-9956-4df9-ba1c-cdee5a456ab3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:34.855472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e9c0b8b-9956-4df9-ba1c-cdee5a456ab3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:34.856591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e9c0b8b-9956-4df9-ba1c-cdee5a456ab3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:34.858701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e9c0b8b-9956-4df9-ba1c-cdee5a456ab3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:35.119356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8dd24a90-3714-4c21-a960-060b96d61642 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:35.120064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8dd24a90-3714-4c21-a960-060b96d61642 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:35.141091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8dd24a90-3714-4c21-a960-060b96d61642 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:35.149235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8dd24a90-3714-4c21-a960-060b96d61642 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:35.152511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8dd24a90-3714-4c21-a960-060b96d61642 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:35.156282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8dd24a90-3714-4c21-a960-060b96d61642 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:35.233994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e9c0b8b-9956-4df9-ba1c-cdee5a456ab3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:35.241996 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e9c0b8b-9956-4df9-ba1c-cdee5a456ab3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 0.420742 Jul 26 20:10:35.247043 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2460/5003] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:34 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:35.663060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8dd24a90-3714-4c21-a960-060b96d61642 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:35.675576 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8dd24a90-3714-4c21-a960-060b96d61642 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1315 microversion: 2.1 time: 0.560134 Jul 26 20:10:35.676241 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2544/5004] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:35 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:35.995489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0ec399bb-6fac-4bed-bc1f-1afe1bd26c58 req-dd026c87-b176-4617-8526-65bbbe4cc39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f", "name": "network-vif-plugged", "status": "completed", "tag": "2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:36.045990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0ec399bb-6fac-4bed-bc1f-1afe1bd26c58 req-dd026c87-b176-4617-8526-65bbbe4cc39e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:36.046747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0ec399bb-6fac-4bed-bc1f-1afe1bd26c58 req-dd026c87-b176-4617-8526-65bbbe4cc39e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:36.097659 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0ec399bb-6fac-4bed-bc1f-1afe1bd26c58 req-dd026c87-b176-4617-8526-65bbbe4cc39e service nova] Creating event network-vif-plugged:2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c for instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f on n-h2-708768-8 Jul 26 20:10:36.110818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0ec399bb-6fac-4bed-bc1f-1afe1bd26c58 req-dd026c87-b176-4617-8526-65bbbe4cc39e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119980 Jul 26 20:10:36.120372 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2461/5005] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:10:36.268120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1c2a3d2d-eaf6-4b50-9cd1-823edc5bf04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:36.268680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1c2a3d2d-eaf6-4b50-9cd1-823edc5bf04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:36.294759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c2a3d2d-eaf6-4b50-9cd1-823edc5bf04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:36.301359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c2a3d2d-eaf6-4b50-9cd1-823edc5bf04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:36.304440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c2a3d2d-eaf6-4b50-9cd1-823edc5bf04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:36.307668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c2a3d2d-eaf6-4b50-9cd1-823edc5bf04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:36.716709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b47d67a5-7db7-46ed-b4ef-b51fa253d06f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:36.717739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b47d67a5-7db7-46ed-b4ef-b51fa253d06f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:36.728033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b47d67a5-7db7-46ed-b4ef-b51fa253d06f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:36.728483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b47d67a5-7db7-46ed-b4ef-b51fa253d06f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:36.729265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b47d67a5-7db7-46ed-b4ef-b51fa253d06f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:36.729706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b47d67a5-7db7-46ed-b4ef-b51fa253d06f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:36.899336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1c2a3d2d-eaf6-4b50-9cd1-823edc5bf04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:36.907466 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1c2a3d2d-eaf6-4b50-9cd1-823edc5bf04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1317 microversion: 2.1 time: 0.644211 Jul 26 20:10:36.911362 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2545/5006] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:36 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:37.826275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b47d67a5-7db7-46ed-b4ef-b51fa253d06f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:37.842046 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b47d67a5-7db7-46ed-b4ef-b51fa253d06f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1502 microversion: 2.1 time: 1.133252 Jul 26 20:10:37.845420 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2462/5007] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:36 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1502 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:37.874625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aae8d241-1e3c-476a-bd94-4c75f70e45dd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:37.875183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aae8d241-1e3c-476a-bd94-4c75f70e45dd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:37.909033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aae8d241-1e3c-476a-bd94-4c75f70e45dd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:37.911598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aae8d241-1e3c-476a-bd94-4c75f70e45dd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:37.914600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aae8d241-1e3c-476a-bd94-4c75f70e45dd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:37.915436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aae8d241-1e3c-476a-bd94-4c75f70e45dd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:37.929562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f2b0882f-5a0e-40b1-824b-913af3ce8e82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:37.930387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f2b0882f-5a0e-40b1-824b-913af3ce8e82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:37.946217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2b0882f-5a0e-40b1-824b-913af3ce8e82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:37.946617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2b0882f-5a0e-40b1-824b-913af3ce8e82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:37.947667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2b0882f-5a0e-40b1-824b-913af3ce8e82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:37.948445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2b0882f-5a0e-40b1-824b-913af3ce8e82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:38.289582 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.network.security_group_api [None req-aae8d241-1e3c-476a-bd94-4c75f70e45dd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Removing security group 54065e1a-ebf8-4806-a948-aff1d8122131 from port a99efec3-a193-4fd8-8b20-17e9fa87314c Jul 26 20:10:38.588986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f2b0882f-5a0e-40b1-824b-913af3ce8e82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:38.608578 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f2b0882f-5a0e-40b1-824b-913af3ce8e82 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.681053 Jul 26 20:10:38.623652 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2463/5008] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:37 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:38.844032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1529300268", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:38.860126 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aae8d241-1e3c-476a-bd94-4c75f70e45dd tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b/action" status: 202 len: 0 microversion: 2.1 time: 0.995978 Jul 26 20:10:38.860270 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2546/5009] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:10:37 2022] POST /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b/action => generated 0 bytes in 998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:10:38.867882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d562d4a-a4db-4577-8ff3-dcca2bc63853 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:38.868505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d562d4a-a4db-4577-8ff3-dcca2bc63853 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:38.877169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d562d4a-a4db-4577-8ff3-dcca2bc63853 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:38.877768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d562d4a-a4db-4577-8ff3-dcca2bc63853 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:38.878390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d562d4a-a4db-4577-8ff3-dcca2bc63853 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:38.878827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d562d4a-a4db-4577-8ff3-dcca2bc63853 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:38.972014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] validate_networks() for [('7cda145a-7c15-4529-b4ae-fda552c43889', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:10:39.130119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6d562d4a-a4db-4577-8ff3-dcca2bc63853 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:39.146804 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d562d4a-a4db-4577-8ff3-dcca2bc63853 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1460 microversion: 2.1 time: 0.276357 Jul 26 20:10:39.160303 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2547/5010] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:38 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1460 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:39.734541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a59b783b-5fb6-4ce8-b84d-a1d5cc86fbbb req-e82b6b33-bbdc-40e1-886f-0f1b492cd1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6e47f0-457a-4d22-853f-24116a603d3b", "tag": "a99efec3-a193-4fd8-8b20-17e9fa87314c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:39.756880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a59b783b-5fb6-4ce8-b84d-a1d5cc86fbbb req-e82b6b33-bbdc-40e1-886f-0f1b492cd1ef service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:39.759867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a59b783b-5fb6-4ce8-b84d-a1d5cc86fbbb req-e82b6b33-bbdc-40e1-886f-0f1b492cd1ef service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:39.786553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a59b783b-5fb6-4ce8-b84d-a1d5cc86fbbb req-e82b6b33-bbdc-40e1-886f-0f1b492cd1ef service nova] Creating event network-changed:a99efec3-a193-4fd8-8b20-17e9fa87314c for instance 4a6e47f0-457a-4d22-853f-24116a603d3b on n-h1-708768-8 Jul 26 20:10:39.797731 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a59b783b-5fb6-4ce8-b84d-a1d5cc86fbbb req-e82b6b33-bbdc-40e1-886f-0f1b492cd1ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.630239 Jul 26 20:10:39.802891 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2548/5011] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:10:39.819700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-691d8bf1-d6db-479a-aa44-0a0f26ba69dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:39.821988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-691d8bf1-d6db-479a-aa44-0a0f26ba69dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:39.834342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-691d8bf1-d6db-479a-aa44-0a0f26ba69dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:39.839902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-691d8bf1-d6db-479a-aa44-0a0f26ba69dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:39.840920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-691d8bf1-d6db-479a-aa44-0a0f26ba69dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:39.842415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-691d8bf1-d6db-479a-aa44-0a0f26ba69dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.159869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-691d8bf1-d6db-479a-aa44-0a0f26ba69dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:40.174899 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-691d8bf1-d6db-479a-aa44-0a0f26ba69dc tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.370498 Jul 26 20:10:40.192547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2549/5012] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:39 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:40.210816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c126fb2e-3e1f-4314-999a-58e9ccc11690 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:40.211580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c126fb2e-3e1f-4314-999a-58e9ccc11690 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:40.219341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c126fb2e-3e1f-4314-999a-58e9ccc11690 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.221138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c126fb2e-3e1f-4314-999a-58e9ccc11690 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.222148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c126fb2e-3e1f-4314-999a-58e9ccc11690 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.222786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c126fb2e-3e1f-4314-999a-58e9ccc11690 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.254131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c126fb2e-3e1f-4314-999a-58e9ccc11690 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:10:40.261571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:40.393882 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c126fb2e-3e1f-4314-999a-58e9ccc11690 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "DELETE /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 204 len: 0 microversion: 2.1 time: 0.199687 Jul 26 20:10:40.394768 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2550/5013] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:10:40 2022] DELETE /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:10:40.403232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c04342ec-ae21-439a-b9f4-5534614660d0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:40.405076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c04342ec-ae21-439a-b9f4-5534614660d0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:40.420312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c04342ec-ae21-439a-b9f4-5534614660d0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.421112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c04342ec-ae21-439a-b9f4-5534614660d0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.423805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c04342ec-ae21-439a-b9f4-5534614660d0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.424261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c04342ec-ae21-439a-b9f4-5534614660d0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.681623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c04342ec-ae21-439a-b9f4-5534614660d0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:40.690835 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c04342ec-ae21-439a-b9f4-5534614660d0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.294587 Jul 26 20:10:40.691437 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2551/5014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:40 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:40.698816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5864b5fb-c640-4e7a-8e52-45fba5f37123 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:40.699453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5864b5fb-c640-4e7a-8e52-45fba5f37123 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:40.706285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5864b5fb-c640-4e7a-8e52-45fba5f37123 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.706752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5864b5fb-c640-4e7a-8e52-45fba5f37123 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.707523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5864b5fb-c640-4e7a-8e52-45fba5f37123 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.707988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5864b5fb-c640-4e7a-8e52-45fba5f37123 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.862118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:10:40.862584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:10:40.862994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:10:40.863414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:10:40.864397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:10:40.884690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5864b5fb-c640-4e7a-8e52-45fba5f37123 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:40.894595 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5864b5fb-c640-4e7a-8e52-45fba5f37123 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1551 microversion: 2.1 time: 0.202081 Jul 26 20:10:40.895198 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2552/5015] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:40 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1551 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:40.900263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65bbdba4-189f-4c80-9d6e-cc1eece71ba3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:40.900874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65bbdba4-189f-4c80-9d6e-cc1eece71ba3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:40.906834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:40.908844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65bbdba4-189f-4c80-9d6e-cc1eece71ba3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.909576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.909985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65bbdba4-189f-4c80-9d6e-cc1eece71ba3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.910638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.911090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65bbdba4-189f-4c80-9d6e-cc1eece71ba3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.911879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65bbdba4-189f-4c80-9d6e-cc1eece71ba3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.916382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:40.916836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:40.975388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Getting quotas for project 14657ed655d94ec08a847a22ec8d96d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:10:40.988348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Getting quotas for user c5db253037f7490cb99f9108c72010fc and project 14657ed655d94ec08a847a22ec8d96d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:10:41.026330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:10:41.034563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:10:41.153838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65bbdba4-189f-4c80-9d6e-cc1eece71ba3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:41.164852 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65bbdba4-189f-4c80-9d6e-cc1eece71ba3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.268431 Jul 26 20:10:41.168116 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2553/5016] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:40 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:41.188410 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0ac9dbf-4887-4675-b9f7-0e80fdd2c44f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.351495 Jul 26 20:10:41.189733 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2464/5017] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:10:41.191984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c52d0653-5aed-464f-8149-b324e1194bf6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:41.192816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c52d0653-5aed-464f-8149-b324e1194bf6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:41.206633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c52d0653-5aed-464f-8149-b324e1194bf6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:41.207343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c52d0653-5aed-464f-8149-b324e1194bf6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:41.210936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f4d01053-70e5-491c-ab43-d0ee8b46fbc3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:41.212086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c52d0653-5aed-464f-8149-b324e1194bf6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:41.212730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c52d0653-5aed-464f-8149-b324e1194bf6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:41.216419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f4d01053-70e5-491c-ab43-d0ee8b46fbc3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:41.468750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f4d01053-70e5-491c-ab43-d0ee8b46fbc3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:41.493443 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f4d01053-70e5-491c-ab43-d0ee8b46fbc3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1217 microversion: 2.1 time: 0.289614 Jul 26 20:10:41.499652 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2465/5018] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:41 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:41.557417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c52d0653-5aed-464f-8149-b324e1194bf6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:41.567550 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c52d0653-5aed-464f-8149-b324e1194bf6 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.380460 Jul 26 20:10:41.583452 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2554/5019] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:41 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:41.918033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-528bf2d7-7191-4e94-8085-edb27886aaa6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:41.920235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-528bf2d7-7191-4e94-8085-edb27886aaa6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:41.939036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528bf2d7-7191-4e94-8085-edb27886aaa6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:41.939955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528bf2d7-7191-4e94-8085-edb27886aaa6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:41.942619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528bf2d7-7191-4e94-8085-edb27886aaa6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:41.946278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528bf2d7-7191-4e94-8085-edb27886aaa6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:41.977946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1146450966", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "287d382c-eec4-43bb-95a9-783a796404b9"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:42.158352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] validate_networks() for [('287d382c-eec4-43bb-95a9-783a796404b9', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:10:42.898964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-528bf2d7-7191-4e94-8085-edb27886aaa6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:42.912582 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-528bf2d7-7191-4e94-8085-edb27886aaa6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1551 microversion: 2.1 time: 0.998921 Jul 26 20:10:42.916694 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2466/5020] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:41 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1551 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:42.935651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-47162f53-301e-4456-bd2d-f2d71832f7d4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:42.936279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-47162f53-301e-4456-bd2d-f2d71832f7d4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:42.961179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47162f53-301e-4456-bd2d-f2d71832f7d4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:42.971997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47162f53-301e-4456-bd2d-f2d71832f7d4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:42.973076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47162f53-301e-4456-bd2d-f2d71832f7d4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:42.973680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47162f53-301e-4456-bd2d-f2d71832f7d4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:43.291471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-47162f53-301e-4456-bd2d-f2d71832f7d4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:43.298600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:43.309591 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-47162f53-301e-4456-bd2d-f2d71832f7d4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1269 microversion: 2.1 time: 0.388912 Jul 26 20:10:43.319577 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2467/5021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:42 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1269 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:43.943074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-924cd12d-6a3b-46c3-b898-d8ae8d5af28d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:43.943715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-924cd12d-6a3b-46c3-b898-d8ae8d5af28d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:43.972853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-924cd12d-6a3b-46c3-b898-d8ae8d5af28d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:43.973886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-924cd12d-6a3b-46c3-b898-d8ae8d5af28d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:43.974691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-924cd12d-6a3b-46c3-b898-d8ae8d5af28d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:43.975127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-924cd12d-6a3b-46c3-b898-d8ae8d5af28d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:44.013628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:10:44.014476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:10:44.015266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:10:44.015832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:10:44.016316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:10:44.037130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:44.040355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:44.041433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:44.043786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:44.109748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:10:44.134537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Getting quotas for user 4418a0cb57744aa5a56a3fdcce0947cc and project a7570797c1a94fbd94a4b7ee2796f526. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:10:44.193039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:10:44.201658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:10:44.231696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-924cd12d-6a3b-46c3-b898-d8ae8d5af28d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:44.256516 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-924cd12d-6a3b-46c3-b898-d8ae8d5af28d tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 200 len: 1483 microversion: 2.1 time: 0.317845 Jul 26 20:10:44.257115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2468/5022] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:43 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 1483 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:44.262438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f32e47d7-bfef-4fa6-bcdf-baffa953e9c2 req-db4d73e9-d091-4e3b-83d3-fe42e8b14fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68af0560-ba8a-4fc5-8d54-969471887394", "name": "network-vif-deleted", "tag": "7ff22b3c-704c-4fd1-bd1c-d10e325af0f5"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:44.308468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f32e47d7-bfef-4fa6-bcdf-baffa953e9c2 req-db4d73e9-d091-4e3b-83d3-fe42e8b14fe2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:44.311228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f32e47d7-bfef-4fa6-bcdf-baffa953e9c2 req-db4d73e9-d091-4e3b-83d3-fe42e8b14fe2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:44.341441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f32e47d7-bfef-4fa6-bcdf-baffa953e9c2 req-db4d73e9-d091-4e3b-83d3-fe42e8b14fe2 service nova] Creating event network-vif-deleted:7ff22b3c-704c-4fd1-bd1c-d10e325af0f5 for instance 68af0560-ba8a-4fc5-8d54-969471887394 on n-h1-708768-8 Jul 26 20:10:44.343982 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0b1fe48-8173-4fdd-a4d8-fce598a7c8e3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.374867 Jul 26 20:10:44.344672 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2555/5023] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:10:44.347685 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f32e47d7-bfef-4fa6-bcdf-baffa953e9c2 req-db4d73e9-d091-4e3b-83d3-fe42e8b14fe2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088691 Jul 26 20:10:44.348815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2469/5024] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:10:44.355695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-945114e5-1924-4e2b-a919-30a6ce7e1b21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:44.356322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-945114e5-1924-4e2b-a919-30a6ce7e1b21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:44.363848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d766d950-3709-4759-bdea-dfde4ed4dc55 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:44.364897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d766d950-3709-4759-bdea-dfde4ed4dc55 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:44.395934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d766d950-3709-4759-bdea-dfde4ed4dc55 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:44.401288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d766d950-3709-4759-bdea-dfde4ed4dc55 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:44.410600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d766d950-3709-4759-bdea-dfde4ed4dc55 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:44.411425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d766d950-3709-4759-bdea-dfde4ed4dc55 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:44.567371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-945114e5-1924-4e2b-a919-30a6ce7e1b21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:44.580964 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-945114e5-1924-4e2b-a919-30a6ce7e1b21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1215 microversion: 2.1 time: 0.229184 Jul 26 20:10:44.581625 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2556/5025] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:44 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1215 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:44.665371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d766d950-3709-4759-bdea-dfde4ed4dc55 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:44.689562 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d766d950-3709-4759-bdea-dfde4ed4dc55 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1275 microversion: 2.1 time: 0.338500 Jul 26 20:10:44.690566 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2470/5026] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:44 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1275 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:45.282477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:45.283075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: 68af0560-ba8a-4fc5-8d54-969471887394] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:45.296811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:45.301804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:45.302927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:45.303491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:45.368717 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] HTTP exception thrown: Instance 68af0560-ba8a-4fc5-8d54-969471887394 could not be found. Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Request method failure captured: Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 HTTP/1.1 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Emra4GorQ8XvMv1A1pbnI72q_Ba80k85Zd9_0bn15lWzhF2H4OWu3t7tjlR147aCswDQkYFlZiSO_S_OF90eXEgbT_FlfOPQscfID6Wbvl6M5-nTxfaJcADbN2d-6orndZkkSfQsd5gLaiFpOC3xwgx_Xv1iIE66EhrEP7PdZVS8Qs Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: d237549546cf478aa27cf8759a57d4b4 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d237549546cf478aa27cf8759a57d4b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d237549546cf478aa27cf8759a57d4b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d237549546cf478aa27cf8759a57d4b4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d237549546cf478aa27cf8759a57d4b4"}]}] Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: d237549546cf478aa27cf8759a57d4b4 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestNetworkBasicOps-2048669919-project Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 84e081d584b34009a7bbfbc2a6c14436 Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestNetworkBasicOps-2048669919-project Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 68af0560-ba8a-4fc5-8d54-969471887394 could not be found. Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '68af0560-ba8a-4fc5-8d54-969471887394'} Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68af0560-ba8a-4fc5-8d54-969471887394 could not be found. Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68af0560-ba8a-4fc5-8d54-969471887394 could not be found. Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:10:45.373652 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68af0560-ba8a-4fc5-8d54-969471887394 could not be found. Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Returning 404 to user: Instance 68af0560-ba8a-4fc5-8d54-969471887394 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:10:45.382545 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f888404-1a0c-4883-a2db-8bf7cf7b50e6 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394" status: 404 len: 111 microversion: 2.1 time: 0.101792 Jul 26 20:10:45.383937 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2557/5027] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:45 2022] GET /compute/v2.1/servers/68af0560-ba8a-4fc5-8d54-969471887394 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:10:45.606090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32e1171d-5bc1-4280-b5c5-ea11e446460a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:45.606632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32e1171d-5bc1-4280-b5c5-ea11e446460a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:45.622779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32e1171d-5bc1-4280-b5c5-ea11e446460a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:45.623466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32e1171d-5bc1-4280-b5c5-ea11e446460a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:45.624424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32e1171d-5bc1-4280-b5c5-ea11e446460a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:45.625037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32e1171d-5bc1-4280-b5c5-ea11e446460a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:45.705590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-589e0f1a-5a54-4255-ab8d-ba0640f6a711 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '.version_select at 0x7f875652a4c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:45.752072 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-589e0f1a-5a54-4255-ab8d-ba0640f6a711 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-19312781" status: 202 len: 0 microversion: 2.1 time: 0.051290 Jul 26 20:10:45.756273 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2558/5028] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 20:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-19312781 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:10:45.762837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66c0cfae-aaa9-4cd3-898e-281a76d43706 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:45.764281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66c0cfae-aaa9-4cd3-898e-281a76d43706 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:45.785189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66c0cfae-aaa9-4cd3-898e-281a76d43706 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:45.797813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66c0cfae-aaa9-4cd3-898e-281a76d43706 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:45.802730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66c0cfae-aaa9-4cd3-898e-281a76d43706 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:45.806290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66c0cfae-aaa9-4cd3-898e-281a76d43706 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:45.860227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-32e1171d-5bc1-4280-b5c5-ea11e446460a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:45.921331 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32e1171d-5bc1-4280-b5c5-ea11e446460a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1267 microversion: 2.1 time: 0.319233 Jul 26 20:10:45.946221 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2471/5029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:45 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:46.033159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-66c0cfae-aaa9-4cd3-898e-281a76d43706 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:46.043037 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66c0cfae-aaa9-4cd3-898e-281a76d43706 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1275 microversion: 2.1 time: 0.284828 Jul 26 20:10:46.047756 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2559/5030] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:45 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1275 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:46.954444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0f5ad41-b163-4691-82c5-73709fff2f51 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:46.955068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0f5ad41-b163-4691-82c5-73709fff2f51 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:46.994294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad41-b163-4691-82c5-73709fff2f51 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:46.998549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad41-b163-4691-82c5-73709fff2f51 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:46.999633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad41-b163-4691-82c5-73709fff2f51 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:47.003515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad41-b163-4691-82c5-73709fff2f51 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:47.068858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f9e01cc-4934-4c80-b251-2f4b3e065dcd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:47.069686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f9e01cc-4934-4c80-b251-2f4b3e065dcd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:47.080759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f9e01cc-4934-4c80-b251-2f4b3e065dcd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:47.092587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f9e01cc-4934-4c80-b251-2f4b3e065dcd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:47.097873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f9e01cc-4934-4c80-b251-2f4b3e065dcd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:47.098591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f9e01cc-4934-4c80-b251-2f4b3e065dcd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:48.244834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f9e01cc-4934-4c80-b251-2f4b3e065dcd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:48.261504 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f9e01cc-4934-4c80-b251-2f4b3e065dcd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1317 microversion: 2.1 time: 1.196683 Jul 26 20:10:48.262308 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2560/5031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:47 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1317 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:48.417943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0f5ad41-b163-4691-82c5-73709fff2f51 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:48.428330 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0f5ad41-b163-4691-82c5-73709fff2f51 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1273 microversion: 2.1 time: 1.481724 Jul 26 20:10:48.428917 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2472/5032] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:46 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1273 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:48.799864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b31961d7-ddca-4fce-8e54-e09894a23caf req-c95746cc-c12f-42e1-b808-7ade39e9f025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3", "tag": "b023a523-17a7-4375-acf8-ab173a9b7b2b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:48.823183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b31961d7-ddca-4fce-8e54-e09894a23caf req-c95746cc-c12f-42e1-b808-7ade39e9f025 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:48.823955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b31961d7-ddca-4fce-8e54-e09894a23caf req-c95746cc-c12f-42e1-b808-7ade39e9f025 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:48.854634 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b31961d7-ddca-4fce-8e54-e09894a23caf req-c95746cc-c12f-42e1-b808-7ade39e9f025 service nova] Creating event network-changed:b023a523-17a7-4375-acf8-ab173a9b7b2b for instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 on n-h1-708768-8 Jul 26 20:10:48.861541 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b31961d7-ddca-4fce-8e54-e09894a23caf req-c95746cc-c12f-42e1-b808-7ade39e9f025 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069414 Jul 26 20:10:48.863523 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2561/5033] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:10:49.286484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0318e9f5-6540-42b0-854b-eb2e4af29518 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:49.287106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0318e9f5-6540-42b0-854b-eb2e4af29518 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:49.306569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0318e9f5-6540-42b0-854b-eb2e4af29518 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:49.318298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0318e9f5-6540-42b0-854b-eb2e4af29518 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:49.319462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0318e9f5-6540-42b0-854b-eb2e4af29518 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:49.321252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0318e9f5-6540-42b0-854b-eb2e4af29518 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:49.454975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0e60d799-a0b7-45cb-85a1-fe275c49a78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:49.467821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0e60d799-a0b7-45cb-85a1-fe275c49a78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:49.490801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e60d799-a0b7-45cb-85a1-fe275c49a78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:49.492115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e60d799-a0b7-45cb-85a1-fe275c49a78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:49.493163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e60d799-a0b7-45cb-85a1-fe275c49a78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:49.493784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e60d799-a0b7-45cb-85a1-fe275c49a78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:49.655178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0e60d799-a0b7-45cb-85a1-fe275c49a78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:49.676060 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0e60d799-a0b7-45cb-85a1-fe275c49a78d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1273 microversion: 2.1 time: 0.229642 Jul 26 20:10:49.677063 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2562/5034] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:49 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:10:49.714557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0318e9f5-6540-42b0-854b-eb2e4af29518 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:49.726727 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0318e9f5-6540-42b0-854b-eb2e4af29518 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1317 microversion: 2.1 time: 0.444422 Jul 26 20:10:49.740610 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2473/5035] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:49 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:50.699641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89edc909-888e-4ff0-9df8-c78369ef6d0d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:50.700265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89edc909-888e-4ff0-9df8-c78369ef6d0d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:50.726105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89edc909-888e-4ff0-9df8-c78369ef6d0d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:50.728036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89edc909-888e-4ff0-9df8-c78369ef6d0d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:50.729073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89edc909-888e-4ff0-9df8-c78369ef6d0d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:50.729672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89edc909-888e-4ff0-9df8-c78369ef6d0d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:50.752604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37d855c9-f339-4d00-a8a0-dd4a919953ce tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:50.753342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37d855c9-f339-4d00-a8a0-dd4a919953ce tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:50.777838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d855c9-f339-4d00-a8a0-dd4a919953ce tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:50.778328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d855c9-f339-4d00-a8a0-dd4a919953ce tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:50.784038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d855c9-f339-4d00-a8a0-dd4a919953ce tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:50.784499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d855c9-f339-4d00-a8a0-dd4a919953ce tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:50.945830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:51.270486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-89edc909-888e-4ff0-9df8-c78369ef6d0d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:51.278084 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89edc909-888e-4ff0-9df8-c78369ef6d0d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1315 microversion: 2.1 time: 0.583548 Jul 26 20:10:51.279250 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2563/5036] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:50 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:51.362934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-37d855c9-f339-4d00-a8a0-dd4a919953ce tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:51.375497 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37d855c9-f339-4d00-a8a0-dd4a919953ce tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1317 microversion: 2.1 time: 0.626823 Jul 26 20:10:51.376401 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2474/5037] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:50 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:52.304898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f49c419a-61a5-4c36-a1e5-226c867cacc8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:52.305513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f49c419a-61a5-4c36-a1e5-226c867cacc8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:52.322472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f49c419a-61a5-4c36-a1e5-226c867cacc8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:52.325220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f49c419a-61a5-4c36-a1e5-226c867cacc8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:52.327815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f49c419a-61a5-4c36-a1e5-226c867cacc8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:52.328518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f49c419a-61a5-4c36-a1e5-226c867cacc8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:52.394400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:52.401608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-136eb7e9-f6b8-4933-bc5c-221a521aa8c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:52.402225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-136eb7e9-f6b8-4933-bc5c-221a521aa8c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:52.433326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-136eb7e9-f6b8-4933-bc5c-221a521aa8c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:52.433625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-136eb7e9-f6b8-4933-bc5c-221a521aa8c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:52.436144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-136eb7e9-f6b8-4933-bc5c-221a521aa8c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:52.436927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-136eb7e9-f6b8-4933-bc5c-221a521aa8c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:52.884922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-136eb7e9-f6b8-4933-bc5c-221a521aa8c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:52.930504 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-136eb7e9-f6b8-4933-bc5c-221a521aa8c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1317 microversion: 2.1 time: 0.536716 Jul 26 20:10:52.931117 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2475/5038] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:52 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:52.964774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-2ae90017-3f3c-4bf9-b072-651c5e7cb7f4 req-d0078ce1-23c4-40d9-be4f-e0357cf564ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5886ca74-cf72-4313-99c4-606f6d979ee0", "tag": "332ee2fe-ce87-4b9b-8b45-c4f260acd0a0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:53.008842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2ae90017-3f3c-4bf9-b072-651c5e7cb7f4 req-d0078ce1-23c4-40d9-be4f-e0357cf564ff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:53.009638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2ae90017-3f3c-4bf9-b072-651c5e7cb7f4 req-d0078ce1-23c4-40d9-be4f-e0357cf564ff service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:53.034536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2ae90017-3f3c-4bf9-b072-651c5e7cb7f4 req-d0078ce1-23c4-40d9-be4f-e0357cf564ff service nova] Creating event network-changed:332ee2fe-ce87-4b9b-8b45-c4f260acd0a0 for instance 5886ca74-cf72-4313-99c4-606f6d979ee0 on n-h2-708768-8 Jul 26 20:10:53.040957 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-2ae90017-3f3c-4bf9-b072-651c5e7cb7f4 req-d0078ce1-23c4-40d9-be4f-e0357cf564ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091825 Jul 26 20:10:53.042242 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2476/5039] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:10:53.541074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f49c419a-61a5-4c36-a1e5-226c867cacc8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:53.566587 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f49c419a-61a5-4c36-a1e5-226c867cacc8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1315 microversion: 2.1 time: 1.265397 Jul 26 20:10:53.567191 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2564/5040] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:52 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1315 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:53.878803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-746975cc-33c0-480d-ab67-94fb0cb23e2e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:53.880046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-746975cc-33c0-480d-ab67-94fb0cb23e2e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:53.894484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-51c51142-8c68-4c8d-a29e-b19594e9218e req-f7581dff-4007-4d48-a83d-1a3e20efaef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b4e55b-fc78-441b-a391-3b43c1fece44", "tag": "d5e92c8a-52b5-4209-95a1-521bff02e238"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:53.903846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-746975cc-33c0-480d-ab67-94fb0cb23e2e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:53.906605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-746975cc-33c0-480d-ab67-94fb0cb23e2e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:53.907586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-746975cc-33c0-480d-ab67-94fb0cb23e2e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:53.908583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-746975cc-33c0-480d-ab67-94fb0cb23e2e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:53.910742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-51c51142-8c68-4c8d-a29e-b19594e9218e req-f7581dff-4007-4d48-a83d-1a3e20efaef8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:53.915883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-51c51142-8c68-4c8d-a29e-b19594e9218e req-f7581dff-4007-4d48-a83d-1a3e20efaef8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:53.943945 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-51c51142-8c68-4c8d-a29e-b19594e9218e req-f7581dff-4007-4d48-a83d-1a3e20efaef8 service nova] Creating event network-changed:d5e92c8a-52b5-4209-95a1-521bff02e238 for instance f3b4e55b-fc78-441b-a391-3b43c1fece44 on n-h2-708768-8 Jul 26 20:10:53.959092 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-51c51142-8c68-4c8d-a29e-b19594e9218e req-f7581dff-4007-4d48-a83d-1a3e20efaef8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070085 Jul 26 20:10:53.970084 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2565/5041] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 20:10:53.975434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f8b11ff-c7c3-40a3-8ee2-f7b2721a8f48 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:53.977222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f8b11ff-c7c3-40a3-8ee2-f7b2721a8f48 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:53.977896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-746975cc-33c0-480d-ab67-94fb0cb23e2e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:10:53.992208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f8b11ff-c7c3-40a3-8ee2-f7b2721a8f48 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:53.994387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f8b11ff-c7c3-40a3-8ee2-f7b2721a8f48 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:53.997198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f8b11ff-c7c3-40a3-8ee2-f7b2721a8f48 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:54.000857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f8b11ff-c7c3-40a3-8ee2-f7b2721a8f48 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:54.086308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:54.174774 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-746975cc-33c0-480d-ab67-94fb0cb23e2e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 204 len: 0 microversion: 2.1 time: 0.301943 Jul 26 20:10:54.178395 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2477/5042] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:10:53 2022] DELETE /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:10:54.191673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1c4d4146-a245-4cf4-9020-419c340097dd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:54.192380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1c4d4146-a245-4cf4-9020-419c340097dd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:54.219819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c4d4146-a245-4cf4-9020-419c340097dd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:54.220392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c4d4146-a245-4cf4-9020-419c340097dd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:54.228282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c4d4146-a245-4cf4-9020-419c340097dd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:54.228882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c4d4146-a245-4cf4-9020-419c340097dd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:54.361185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f8b11ff-c7c3-40a3-8ee2-f7b2721a8f48 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:54.385738 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f8b11ff-c7c3-40a3-8ee2-f7b2721a8f48 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1317 microversion: 2.1 time: 0.413467 Jul 26 20:10:54.386366 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2566/5043] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:53 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:54.591315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7948ea7e-dab4-4ca3-a5ad-60cd215f0c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:54.592267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1c4d4146-a245-4cf4-9020-419c340097dd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:54.593259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7948ea7e-dab4-4ca3-a5ad-60cd215f0c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:54.603956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1c4d4146-a245-4cf4-9020-419c340097dd tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1671 microversion: 2.1 time: 0.422544 Jul 26 20:10:54.604373 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2478/5044] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:54 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1671 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:54.629375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:54.634504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7948ea7e-dab4-4ca3-a5ad-60cd215f0c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:54.635159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7948ea7e-dab4-4ca3-a5ad-60cd215f0c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:54.637220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7948ea7e-dab4-4ca3-a5ad-60cd215f0c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:54.638971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7948ea7e-dab4-4ca3-a5ad-60cd215f0c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:55.058464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7948ea7e-dab4-4ca3-a5ad-60cd215f0c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:55.073638 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7948ea7e-dab4-4ca3-a5ad-60cd215f0c1c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1315 microversion: 2.1 time: 0.488044 Jul 26 20:10:55.074230 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2567/5045] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:54 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:55.412271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-941240c2-c5bd-45db-8064-eac951940208 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:55.413044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-941240c2-c5bd-45db-8064-eac951940208 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:55.425143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-941240c2-c5bd-45db-8064-eac951940208 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:55.425737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-941240c2-c5bd-45db-8064-eac951940208 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:55.426621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-941240c2-c5bd-45db-8064-eac951940208 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:55.428376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-941240c2-c5bd-45db-8064-eac951940208 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:55.627407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f66a2213-773c-4133-9eac-082888ee3ef7 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:55.628862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f66a2213-773c-4133-9eac-082888ee3ef7 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:55.644037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f66a2213-773c-4133-9eac-082888ee3ef7 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:55.645584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f66a2213-773c-4133-9eac-082888ee3ef7 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:55.651020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f66a2213-773c-4133-9eac-082888ee3ef7 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:55.655398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f66a2213-773c-4133-9eac-082888ee3ef7 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:55.859903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-941240c2-c5bd-45db-8064-eac951940208 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:55.876800 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-941240c2-c5bd-45db-8064-eac951940208 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1317 microversion: 2.1 time: 0.466317 Jul 26 20:10:55.888005 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2479/5046] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:55 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:56.039969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f66a2213-773c-4133-9eac-082888ee3ef7 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:56.056351 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f66a2213-773c-4133-9eac-082888ee3ef7 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1671 microversion: 2.1 time: 0.428126 Jul 26 20:10:56.071047 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2568/5047] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:55 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1671 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:56.094962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1e2c4f5-444e-4623-9144-3f8d293a647e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:56.095575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1e2c4f5-444e-4623-9144-3f8d293a647e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:56.111210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1e2c4f5-444e-4623-9144-3f8d293a647e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:56.111688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1e2c4f5-444e-4623-9144-3f8d293a647e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:56.112467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1e2c4f5-444e-4623-9144-3f8d293a647e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:56.112902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1e2c4f5-444e-4623-9144-3f8d293a647e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:56.456624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a9c0782c-3e69-4c36-b9b4-b4eb0c29a654 req-5ebd590d-255e-41e5-b706-dd1f2b17171e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3", "name": "network-vif-plugged", "status": "completed", "tag": "b023a523-17a7-4375-acf8-ab173a9b7b2b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:56.480579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a9c0782c-3e69-4c36-b9b4-b4eb0c29a654 req-5ebd590d-255e-41e5-b706-dd1f2b17171e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:56.481025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a9c0782c-3e69-4c36-b9b4-b4eb0c29a654 req-5ebd590d-255e-41e5-b706-dd1f2b17171e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:56.498140 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a9c0782c-3e69-4c36-b9b4-b4eb0c29a654 req-5ebd590d-255e-41e5-b706-dd1f2b17171e service nova] Creating event network-vif-plugged:b023a523-17a7-4375-acf8-ab173a9b7b2b for instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 on n-h1-708768-8 Jul 26 20:10:56.513195 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a9c0782c-3e69-4c36-b9b4-b4eb0c29a654 req-5ebd590d-255e-41e5-b706-dd1f2b17171e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061301 Jul 26 20:10:56.514072 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2569/5048] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:10:56.906751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1e2c4f5-444e-4623-9144-3f8d293a647e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:56.912528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-832c5df4-ebf6-4f13-a158-2b4421e0c97d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:56.915354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-832c5df4-ebf6-4f13-a158-2b4421e0c97d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:56.926915 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1e2c4f5-444e-4623-9144-3f8d293a647e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1315 microversion: 2.1 time: 0.836281 Jul 26 20:10:56.936595 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2480/5049] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:56 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:56.938477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-832c5df4-ebf6-4f13-a158-2b4421e0c97d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:56.942391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-832c5df4-ebf6-4f13-a158-2b4421e0c97d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:56.943401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-832c5df4-ebf6-4f13-a158-2b4421e0c97d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:56.944043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-832c5df4-ebf6-4f13-a158-2b4421e0c97d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:57.088618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ea6882d1-4a22-4b5a-879e-0676a18f7478 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:57.089727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ea6882d1-4a22-4b5a-879e-0676a18f7478 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:57.131665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ea6882d1-4a22-4b5a-879e-0676a18f7478 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:57.132135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ea6882d1-4a22-4b5a-879e-0676a18f7478 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:57.132936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ea6882d1-4a22-4b5a-879e-0676a18f7478 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:57.133378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ea6882d1-4a22-4b5a-879e-0676a18f7478 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:57.686728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ea6882d1-4a22-4b5a-879e-0676a18f7478 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:57.704146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ea6882d1-4a22-4b5a-879e-0676a18f7478 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 200 len: 1552 microversion: 2.1 time: 0.619185 Jul 26 20:10:57.705014 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2481/5050] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:57 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 1552 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:57.802700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-832c5df4-ebf6-4f13-a158-2b4421e0c97d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:57.816606 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-832c5df4-ebf6-4f13-a158-2b4421e0c97d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1317 microversion: 2.1 time: 0.916244 Jul 26 20:10:57.818709 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2570/5051] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:56 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:57.959357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3231e65d-0362-4263-a543-932f9065527c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:57.960668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3231e65d-0362-4263-a543-932f9065527c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:57.969986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3231e65d-0362-4263-a543-932f9065527c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:57.972888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3231e65d-0362-4263-a543-932f9065527c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:57.973899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3231e65d-0362-4263-a543-932f9065527c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:57.979009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3231e65d-0362-4263-a543-932f9065527c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:58.022061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fcc7dc72-5352-4b09-bd30-dfdb8b8fbf9f req-6db20525-d7cf-4537-972d-7f4c0f5c376a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b4e55b-fc78-441b-a391-3b43c1fece44", "name": "network-vif-deleted", "tag": "d5e92c8a-52b5-4209-95a1-521bff02e238"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:58.051412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fcc7dc72-5352-4b09-bd30-dfdb8b8fbf9f req-6db20525-d7cf-4537-972d-7f4c0f5c376a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:58.051890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fcc7dc72-5352-4b09-bd30-dfdb8b8fbf9f req-6db20525-d7cf-4537-972d-7f4c0f5c376a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:58.072547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:58.120307 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fcc7dc72-5352-4b09-bd30-dfdb8b8fbf9f req-6db20525-d7cf-4537-972d-7f4c0f5c376a service nova] Creating event network-vif-deleted:d5e92c8a-52b5-4209-95a1-521bff02e238 for instance f3b4e55b-fc78-441b-a391-3b43c1fece44 on n-h2-708768-8 Jul 26 20:10:58.144081 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fcc7dc72-5352-4b09-bd30-dfdb8b8fbf9f req-6db20525-d7cf-4537-972d-7f4c0f5c376a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126483 Jul 26 20:10:58.154416 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2571/5052] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:10:58.733526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:58.734181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f3b4e55b-fc78-441b-a391-3b43c1fece44] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:58.779039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:58.781174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:58.782029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:58.788033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:58.816655 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] HTTP exception thrown: Instance f3b4e55b-fc78-441b-a391-3b43c1fece44 could not be found. Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Request method failure captured: Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 HTTP/1.1 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Emra4GorQ8XvMv1A1pbnI72q_Ba80k85Zd9_0bn15lWzhF2H4OWu3t7tjlR147aCswDQkYFlZiSO_S_OF90eXEgbT_FlfOPQscfID6Wbvl6M5-nTxfaJcADbN2d-6orndZkkSfQsd5gLaiFpOC3xwgx_Xv1iIE66EhrEP7PdZVS8Qs Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: d237549546cf478aa27cf8759a57d4b4 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d237549546cf478aa27cf8759a57d4b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d237549546cf478aa27cf8759a57d4b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d237549546cf478aa27cf8759a57d4b4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d237549546cf478aa27cf8759a57d4b4"}]}] Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: d237549546cf478aa27cf8759a57d4b4 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestNetworkBasicOps-2048669919-project Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 84e081d584b34009a7bbfbc2a6c14436 Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestNetworkBasicOps-2048669919-project Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f3b4e55b-fc78-441b-a391-3b43c1fece44 could not be found. Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f3b4e55b-fc78-441b-a391-3b43c1fece44'} Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b4e55b-fc78-441b-a391-3b43c1fece44 could not be found. Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b4e55b-fc78-441b-a391-3b43c1fece44 could not be found. Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:10:58.820627 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b4e55b-fc78-441b-a391-3b43c1fece44 could not be found. Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Returning 404 to user: Instance f3b4e55b-fc78-441b-a391-3b43c1fece44 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:10:58.824984 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f8652471-0389-4607-98cb-e08e66923f00 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44" status: 404 len: 111 microversion: 2.1 time: 0.100124 Jul 26 20:10:58.826359 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2572/5053] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:58 2022] GET /compute/v2.1/servers/f3b4e55b-fc78-441b-a391-3b43c1fece44 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:10:58.838449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02a71655-a383-40f3-9283-39716e9223aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:58.839085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02a71655-a383-40f3-9283-39716e9223aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:58.850403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a71655-a383-40f3-9283-39716e9223aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:58.850868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a71655-a383-40f3-9283-39716e9223aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:58.854509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a71655-a383-40f3-9283-39716e9223aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:58.854985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02a71655-a383-40f3-9283-39716e9223aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:58.986512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3231e65d-0362-4263-a543-932f9065527c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:59.015269 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3231e65d-0362-4263-a543-932f9065527c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1315 microversion: 2.1 time: 1.051231 Jul 26 20:10:59.016558 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2482/5054] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:57 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1315 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:59.094869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02a71655-a383-40f3-9283-39716e9223aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:59.105904 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02a71655-a383-40f3-9283-39716e9223aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1505 microversion: 2.1 time: 0.270809 Jul 26 20:10:59.129307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bbcb6653-d0ba-4e2b-aeae-67a87db0c14a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:59.129910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bbcb6653-d0ba-4e2b-aeae-67a87db0c14a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:59.135678 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2573/5055] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:58 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:59.136871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbcb6653-d0ba-4e2b-aeae-67a87db0c14a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:59.137488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbcb6653-d0ba-4e2b-aeae-67a87db0c14a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:59.139647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbcb6653-d0ba-4e2b-aeae-67a87db0c14a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:59.140229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbcb6653-d0ba-4e2b-aeae-67a87db0c14a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:59.173788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bbcb6653-d0ba-4e2b-aeae-67a87db0c14a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:10:59.191986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:10:59.282485 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bbcb6653-d0ba-4e2b-aeae-67a87db0c14a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 204 len: 0 microversion: 2.1 time: 0.157366 Jul 26 20:10:59.288815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2483/5056] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:10:59 2022] DELETE /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:10:59.299778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4987f6b5-ee76-4905-af73-491be430f774 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:59.300530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4987f6b5-ee76-4905-af73-491be430f774 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:10:59.320405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4987f6b5-ee76-4905-af73-491be430f774 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:59.320892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4987f6b5-ee76-4905-af73-491be430f774 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:59.322919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4987f6b5-ee76-4905-af73-491be430f774 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:59.325886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4987f6b5-ee76-4905-af73-491be430f774 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:59.391553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-23b6879c-538e-40af-8148-979ab7c1886e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '.version_select at 0x7f875da368b0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:10:59.469907 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-23b6879c-538e-40af-8148-979ab7c1886e tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-870306802" status: 202 len: 0 microversion: 2.1 time: 0.082674 Jul 26 20:10:59.488905 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2484/5057] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Jul 26 20:10:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-870306802 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:10:59.589818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4987f6b5-ee76-4905-af73-491be430f774 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:10:59.598773 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4987f6b5-ee76-4905-af73-491be430f774 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1511 microversion: 2.1 time: 0.305268 Jul 26 20:10:59.599966 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2574/5058] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:10:59 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:10:59.931824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-148119f6-bb4a-47a3-b2db-20dbd9db7a02 req-00bf2046-08ef-426b-be40-5d5ae1e12b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5886ca74-cf72-4313-99c4-606f6d979ee0", "name": "network-vif-plugged", "status": "completed", "tag": "332ee2fe-ce87-4b9b-8b45-c4f260acd0a0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:10:59.954711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-148119f6-bb4a-47a3-b2db-20dbd9db7a02 req-00bf2046-08ef-426b-be40-5d5ae1e12b6b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:10:59.955338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-148119f6-bb4a-47a3-b2db-20dbd9db7a02 req-00bf2046-08ef-426b-be40-5d5ae1e12b6b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:10:59.972699 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-148119f6-bb4a-47a3-b2db-20dbd9db7a02 req-00bf2046-08ef-426b-be40-5d5ae1e12b6b service nova] Creating event network-vif-plugged:332ee2fe-ce87-4b9b-8b45-c4f260acd0a0 for instance 5886ca74-cf72-4313-99c4-606f6d979ee0 on n-h2-708768-8 Jul 26 20:10:59.991009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-148119f6-bb4a-47a3-b2db-20dbd9db7a02 req-00bf2046-08ef-426b-be40-5d5ae1e12b6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064412 Jul 26 20:10:59.993335 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2485/5059] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:11:00.065955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5582fdd-7158-41c5-ab59-5f82ca9b5a9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:00.067845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5582fdd-7158-41c5-ab59-5f82ca9b5a9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:00.110671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5582fdd-7158-41c5-ab59-5f82ca9b5a9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:00.111314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5582fdd-7158-41c5-ab59-5f82ca9b5a9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:00.111959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5582fdd-7158-41c5-ab59-5f82ca9b5a9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:00.112409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5582fdd-7158-41c5-ab59-5f82ca9b5a9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:00.346533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5582fdd-7158-41c5-ab59-5f82ca9b5a9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:00.359339 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5582fdd-7158-41c5-ab59-5f82ca9b5a9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1315 microversion: 2.1 time: 0.313209 Jul 26 20:11:00.360325 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2575/5060] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:00 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:00.632526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d3754482-af9c-4e46-9ca1-3f524200caab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:00.633247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d3754482-af9c-4e46-9ca1-3f524200caab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:00.650341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3754482-af9c-4e46-9ca1-3f524200caab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:00.651475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3754482-af9c-4e46-9ca1-3f524200caab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:00.652309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3754482-af9c-4e46-9ca1-3f524200caab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:00.655303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3754482-af9c-4e46-9ca1-3f524200caab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:01.055441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d3754482-af9c-4e46-9ca1-3f524200caab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:01.074488 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d3754482-af9c-4e46-9ca1-3f524200caab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1511 microversion: 2.1 time: 0.444242 Jul 26 20:11:01.076976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2486/5061] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:00 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:01.381971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9ddae6d1-df7c-48ad-bb8e-543af707c9f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:01.383217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9ddae6d1-df7c-48ad-bb8e-543af707c9f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:01.396724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ddae6d1-df7c-48ad-bb8e-543af707c9f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:01.400871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ddae6d1-df7c-48ad-bb8e-543af707c9f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:01.402156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ddae6d1-df7c-48ad-bb8e-543af707c9f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:01.406130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ddae6d1-df7c-48ad-bb8e-543af707c9f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:01.999539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9ddae6d1-df7c-48ad-bb8e-543af707c9f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:02.012086 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9ddae6d1-df7c-48ad-bb8e-543af707c9f7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1315 microversion: 2.1 time: 0.634867 Jul 26 20:11:02.038887 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2576/5062] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:01 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:02.100181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24f10553-0b31-4f3a-b176-a7cedc570a61 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:02.101019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-24f10553-0b31-4f3a-b176-a7cedc570a61 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:02.112580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:02.122509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24f10553-0b31-4f3a-b176-a7cedc570a61 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:02.123548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24f10553-0b31-4f3a-b176-a7cedc570a61 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:02.125882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24f10553-0b31-4f3a-b176-a7cedc570a61 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:02.128074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24f10553-0b31-4f3a-b176-a7cedc570a61 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:02.143396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-074e04a0-c4d9-4fc0-9336-9885c36aa8b4 req-8d84f75d-997f-4a80-a321-0b5411c06c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3", "name": "network-vif-deleted", "tag": "b023a523-17a7-4375-acf8-ab173a9b7b2b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:02.194791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-074e04a0-c4d9-4fc0-9336-9885c36aa8b4 req-8d84f75d-997f-4a80-a321-0b5411c06c35 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:02.195246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-074e04a0-c4d9-4fc0-9336-9885c36aa8b4 req-8d84f75d-997f-4a80-a321-0b5411c06c35 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:02.237558 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-074e04a0-c4d9-4fc0-9336-9885c36aa8b4 req-8d84f75d-997f-4a80-a321-0b5411c06c35 service nova] Creating event network-vif-deleted:b023a523-17a7-4375-acf8-ab173a9b7b2b for instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 on n-h1-708768-8 Jul 26 20:11:02.261103 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-074e04a0-c4d9-4fc0-9336-9885c36aa8b4 req-8d84f75d-997f-4a80-a321-0b5411c06c35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122364 Jul 26 20:11:02.271968 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2577/5063] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:11:02.412451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24f10553-0b31-4f3a-b176-a7cedc570a61 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:02.424624 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-24f10553-0b31-4f3a-b176-a7cedc570a61 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 200 len: 1302 microversion: 2.1 time: 0.330273 Jul 26 20:11:02.456604 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2487/5064] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:02 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 1302 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:03.065584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6b4148c8-0a06-43e0-a79d-81bb6f78c2b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:03.067225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6b4148c8-0a06-43e0-a79d-81bb6f78c2b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:03.079282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b4148c8-0a06-43e0-a79d-81bb6f78c2b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.080326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b4148c8-0a06-43e0-a79d-81bb6f78c2b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.084583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b4148c8-0a06-43e0-a79d-81bb6f78c2b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.085828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6b4148c8-0a06-43e0-a79d-81bb6f78c2b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.447240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:03.447952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:03.464494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.466596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.467912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.469057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.505797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 HTTP/1.1 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3'} Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:03.511927 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:03.516371 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:03.516371 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:03.516371 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:03.516371 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:03.516371 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:03.516371 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:03.516371 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:03.520526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:03.523233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e9db14b-8709-4ae9-a4cb-472492767b0a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 404 len: 111 microversion: 2.1 time: 0.080932 Jul 26 20:11:03.530889 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2488/5065] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:03 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:03.543820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e61b1a55-783c-42f5-aef1-15a6ffed4841 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:03.546846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e61b1a55-783c-42f5-aef1-15a6ffed4841 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:03.558531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e61b1a55-783c-42f5-aef1-15a6ffed4841 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.562229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e61b1a55-783c-42f5-aef1-15a6ffed4841 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.563369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e61b1a55-783c-42f5-aef1-15a6ffed4841 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.565330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e61b1a55-783c-42f5-aef1-15a6ffed4841 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.619568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6b4148c8-0a06-43e0-a79d-81bb6f78c2b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:03.631941 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6b4148c8-0a06-43e0-a79d-81bb6f78c2b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1502 microversion: 2.1 time: 0.571415 Jul 26 20:11:03.634806 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2578/5066] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:03 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1502 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:03.675684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db6058bc-3195-4636-af25-0e9ab4f07c23 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:03.685587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-db6058bc-3195-4636-af25-0e9ab4f07c23 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:03.714033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db6058bc-3195-4636-af25-0e9ab4f07c23 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.715765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db6058bc-3195-4636-af25-0e9ab4f07c23 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.718423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db6058bc-3195-4636-af25-0e9ab4f07c23 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.721282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db6058bc-3195-4636-af25-0e9ab4f07c23 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.854436 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db6058bc-3195-4636-af25-0e9ab4f07c23 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0/action" status: 202 len: 0 microversion: 2.1 time: 0.196641 Jul 26 20:11:03.861320 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2579/5067] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:03 2022] POST /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:11:03.881645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-767a3c68-0bde-47ef-bd1c-0a833a3b7727 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:03.883298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-767a3c68-0bde-47ef-bd1c-0a833a3b7727 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:03.895464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-767a3c68-0bde-47ef-bd1c-0a833a3b7727 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.896020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-767a3c68-0bde-47ef-bd1c-0a833a3b7727 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:03.897010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-767a3c68-0bde-47ef-bd1c-0a833a3b7727 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:03.897721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-767a3c68-0bde-47ef-bd1c-0a833a3b7727 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:04.254997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-767a3c68-0bde-47ef-bd1c-0a833a3b7727 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:04.267919 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-767a3c68-0bde-47ef-bd1c-0a833a3b7727 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1507 microversion: 2.1 time: 0.401724 Jul 26 20:11:04.268652 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2580/5068] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:03 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:04.333248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e61b1a55-783c-42f5-aef1-15a6ffed4841 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:04.374838 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e61b1a55-783c-42f5-aef1-15a6ffed4841 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.821946 Jul 26 20:11:04.374838 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2489/5069] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:03 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:04.626779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9020dfa-9501-40bb-ab27-b46db1dd5b50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9020dfa-9501-40bb-ab27-b46db1dd5b50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 163 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": 12345, "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 12345 Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:11:04.630845 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 20:11:04.634872 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:04.645777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9020dfa-9501-40bb-ab27-b46db1dd5b50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:04.650613 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9020dfa-9501-40bb-ab27-b46db1dd5b50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.025493 Jul 26 20:11:04.652373 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2581/5070] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:04 2022] POST /compute/v2.1/servers => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:11:04.660765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4a488074-11bb-4289-8b2e-881854bfe547 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:04.661585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4a488074-11bb-4289-8b2e-881854bfe547 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:04.672834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a488074-11bb-4289-8b2e-881854bfe547 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:04.673401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a488074-11bb-4289-8b2e-881854bfe547 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:04.674814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a488074-11bb-4289-8b2e-881854bfe547 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:04.675489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4a488074-11bb-4289-8b2e-881854bfe547 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:04.940752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4a488074-11bb-4289-8b2e-881854bfe547 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:04.951858 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4a488074-11bb-4289-8b2e-881854bfe547 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.295410 Jul 26 20:11:04.953570 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2490/5071] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:04 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:04.978180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-25487f0c-2c90-4ac3-af43-759e05c73483 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:04.979553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-25487f0c-2c90-4ac3-af43-759e05c73483 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:04.994807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25487f0c-2c90-4ac3-af43-759e05c73483 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:04.995491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25487f0c-2c90-4ac3-af43-759e05c73483 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:05.000924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25487f0c-2c90-4ac3-af43-759e05c73483 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:05.002192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25487f0c-2c90-4ac3-af43-759e05c73483 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:05.291378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2454d76a-1e40-4111-bff1-b1c071da2f9e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:05.292485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2454d76a-1e40-4111-bff1-b1c071da2f9e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:05.306447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2454d76a-1e40-4111-bff1-b1c071da2f9e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:05.307338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2454d76a-1e40-4111-bff1-b1c071da2f9e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:05.313477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2454d76a-1e40-4111-bff1-b1c071da2f9e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:05.314482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2454d76a-1e40-4111-bff1-b1c071da2f9e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:05.425497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-25487f0c-2c90-4ac3-af43-759e05c73483 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:05.438595 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-25487f0c-2c90-4ac3-af43-759e05c73483 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.463067 Jul 26 20:11:05.462356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2582/5072] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:04 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:05.880975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2454d76a-1e40-4111-bff1-b1c071da2f9e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:05.898200 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2454d76a-1e40-4111-bff1-b1c071da2f9e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1487 microversion: 2.1 time: 0.609232 Jul 26 20:11:05.921609 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2491/5073] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:05 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1487 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:05.926979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4b387477-7ecc-431c-acd9-57bbacd772ac tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:05.927781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4b387477-7ecc-431c-acd9-57bbacd772ac tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:05.947195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b387477-7ecc-431c-acd9-57bbacd772ac tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:05.948918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b387477-7ecc-431c-acd9-57bbacd772ac tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:05.951213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b387477-7ecc-431c-acd9-57bbacd772ac tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:05.951923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4b387477-7ecc-431c-acd9-57bbacd772ac tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:06.042192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-4b387477-7ecc-431c-acd9-57bbacd772ac tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lazy-loading 'flavor' on Instance uuid 5886ca74-cf72-4313-99c4-606f6d979ee0 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:11:06.536777 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4b387477-7ecc-431c-acd9-57bbacd772ac tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0/action" status: 202 len: 0 microversion: 2.1 time: 0.614585 Jul 26 20:11:06.539062 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2583/5074] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:05 2022] POST /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:11:06.549422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e13f5f2-2f8f-482e-bb0c-62ceadb4872d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:06.550958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5e13f5f2-2f8f-482e-bb0c-62ceadb4872d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:06.573025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e13f5f2-2f8f-482e-bb0c-62ceadb4872d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:06.573606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e13f5f2-2f8f-482e-bb0c-62ceadb4872d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:06.578828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e13f5f2-2f8f-482e-bb0c-62ceadb4872d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:06.579217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e13f5f2-2f8f-482e-bb0c-62ceadb4872d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:07.742429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5e13f5f2-2f8f-482e-bb0c-62ceadb4872d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:07.758045 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5e13f5f2-2f8f-482e-bb0c-62ceadb4872d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1493 microversion: 2.1 time: 1.212639 Jul 26 20:11:07.760622 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2492/5075] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:06 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1493 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:08.789782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-760f6f0d-360b-4de0-b7de-afa3ed564b9d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:08.789782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-760f6f0d-360b-4de0-b7de-afa3ed564b9d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:08.805953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-760f6f0d-360b-4de0-b7de-afa3ed564b9d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:08.817558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-760f6f0d-360b-4de0-b7de-afa3ed564b9d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:08.818533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-760f6f0d-360b-4de0-b7de-afa3ed564b9d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:08.818988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-760f6f0d-360b-4de0-b7de-afa3ed564b9d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:08.948921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-84c9c0c6-fb33-4289-a70f-09b4c752441b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1063722613", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7c48529e-258a-4ab3-9252-c86e3ac95759", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:09.108880 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-84c9c0c6-fb33-4289-a70f-09b4c752441b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Block Device 7c48529e-258a-4ab3-9252-c86e3ac95759 is not bootable. Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-84c9c0c6-fb33-4289-a70f-09b4c752441b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 358 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1063722613", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7c48529e-258a-4ab3-9252-c86e3ac95759", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: exception: Block Device 7c48529e-258a-4ab3-9252-c86e3ac95759 is not bootable. Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1063722613', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '7c48529e-258a-4ab3-9252-c86e3ac95759'}], 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 7c48529e-258a-4ab3-9252-c86e3ac95759 is not bootable. Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:09.117647 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 7c48529e-258a-4ab3-9252-c86e3ac95759 is not bootable. Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 7c48529e-258a-4ab3-9252-c86e3ac95759 is not bootable. Jul 26 20:11:09.121473 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:09.123766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-84c9c0c6-fb33-4289-a70f-09b4c752441b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Block Device 7c48529e-258a-4ab3-9252-c86e3ac95759 is not bootable. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:09.125626 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-84c9c0c6-fb33-4289-a70f-09b4c752441b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.179861 Jul 26 20:11:09.150665 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2493/5076] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:08 2022] POST /compute/v2.1/servers => generated 110 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:11:09.160972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3cf8a0a7-c77a-4884-ab51-4e9dad5d3813 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:09.163190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3cf8a0a7-c77a-4884-ab51-4e9dad5d3813 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:09.175272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cf8a0a7-c77a-4884-ab51-4e9dad5d3813 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:09.176003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cf8a0a7-c77a-4884-ab51-4e9dad5d3813 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:09.177034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cf8a0a7-c77a-4884-ab51-4e9dad5d3813 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:09.177542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cf8a0a7-c77a-4884-ab51-4e9dad5d3813 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:09.270529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-760f6f0d-360b-4de0-b7de-afa3ed564b9d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:09.279736 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-760f6f0d-360b-4de0-b7de-afa3ed564b9d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1514 microversion: 2.1 time: 0.501159 Jul 26 20:11:09.282339 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2584/5077] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:08 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1514 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:10.167058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3cf8a0a7-c77a-4884-ab51-4e9dad5d3813 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:10.190702 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3cf8a0a7-c77a-4884-ab51-4e9dad5d3813 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 1.033231 Jul 26 20:11:10.195039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2494/5078] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:09 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:10.220016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77be3ab0-2b8b-4a03-9bb6-8933b96c36b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:10.221674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77be3ab0-2b8b-4a03-9bb6-8933b96c36b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:10.286674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77be3ab0-2b8b-4a03-9bb6-8933b96c36b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:10.286674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77be3ab0-2b8b-4a03-9bb6-8933b96c36b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:10.290235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77be3ab0-2b8b-4a03-9bb6-8933b96c36b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:10.290721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77be3ab0-2b8b-4a03-9bb6-8933b96c36b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:10.303526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a497189-e54c-40f8-9e1c-f4477a6cb8b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:10.304185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a497189-e54c-40f8-9e1c-f4477a6cb8b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:10.337524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a497189-e54c-40f8-9e1c-f4477a6cb8b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:10.339359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a497189-e54c-40f8-9e1c-f4477a6cb8b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:10.344078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a497189-e54c-40f8-9e1c-f4477a6cb8b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:10.346262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a497189-e54c-40f8-9e1c-f4477a6cb8b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:10.821397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77be3ab0-2b8b-4a03-9bb6-8933b96c36b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:10.833737 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77be3ab0-2b8b-4a03-9bb6-8933b96c36b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.618624 Jul 26 20:11:10.834560 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2585/5079] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:10 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:11.694955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1a497189-e54c-40f8-9e1c-f4477a6cb8b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:11.708743 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a497189-e54c-40f8-9e1c-f4477a6cb8b4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 1.410199 Jul 26 20:11:11.728294 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2495/5080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:10 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:12.193515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0a414fa2-6044-4dcc-ac6e-fa54e3f140c4 req-82cf5dca-d53e-4c02-9660-5eecda41e00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5886ca74-cf72-4313-99c4-606f6d979ee0", "name": "network-vif-plugged", "status": "completed", "tag": "332ee2fe-ce87-4b9b-8b45-c4f260acd0a0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:12.213049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:12.228178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0a414fa2-6044-4dcc-ac6e-fa54e3f140c4 req-82cf5dca-d53e-4c02-9660-5eecda41e00c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:12.229127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0a414fa2-6044-4dcc-ac6e-fa54e3f140c4 req-82cf5dca-d53e-4c02-9660-5eecda41e00c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:12.259513 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0a414fa2-6044-4dcc-ac6e-fa54e3f140c4 req-82cf5dca-d53e-4c02-9660-5eecda41e00c service nova] Creating event network-vif-plugged:332ee2fe-ce87-4b9b-8b45-c4f260acd0a0 for instance 5886ca74-cf72-4313-99c4-606f6d979ee0 on n-h2-708768-8 Jul 26 20:11:12.280051 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0a414fa2-6044-4dcc-ac6e-fa54e3f140c4 req-82cf5dca-d53e-4c02-9660-5eecda41e00c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089813 Jul 26 20:11:12.300688 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2586/5081] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:11:12.737973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6a94c651-8ae7-4543-ad9d-624094d0b088 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:12.738665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6a94c651-8ae7-4543-ad9d-624094d0b088 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:12.757293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a94c651-8ae7-4543-ad9d-624094d0b088 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:12.759836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a94c651-8ae7-4543-ad9d-624094d0b088 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:12.760714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a94c651-8ae7-4543-ad9d-624094d0b088 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:12.762589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a94c651-8ae7-4543-ad9d-624094d0b088 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:13.928995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6a94c651-8ae7-4543-ad9d-624094d0b088 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:13.973278 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6a94c651-8ae7-4543-ad9d-624094d0b088 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 1.238406 Jul 26 20:11:13.974969 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2496/5082] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:12 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:14.996967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-349f4e0d-edf5-4e6e-8fe7-3264c3bb4b9f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:14.998630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-349f4e0d-edf5-4e6e-8fe7-3264c3bb4b9f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:15.013708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-349f4e0d-edf5-4e6e-8fe7-3264c3bb4b9f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:15.013978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-349f4e0d-edf5-4e6e-8fe7-3264c3bb4b9f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:15.014939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-349f4e0d-edf5-4e6e-8fe7-3264c3bb4b9f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:15.018844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-349f4e0d-edf5-4e6e-8fe7-3264c3bb4b9f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:15.135571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9be253da-d06c-490e-814f-2f4fcfea40ac tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-833340154", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "destination_type": "local"}, {"source_type": "volume", "uuid": "697f482c-fa66-4f04-a251-fa7f07ef441c", "destination_type": "invalid"}], "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9be253da-d06c-490e-814f-2f4fcfea40ac tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 494 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-833340154", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "destination_type": "local"}, {"source_type": "volume", "uuid": "697f482c-fa66-4f04-a251-fa7f07ef441c", "destination_type": "invalid"}], "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-833340154', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '697f482c-fa66-4f04-a251-fa7f07ef441c', 'destination_type': 'invalid'}], 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:15.146209 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9be253da-d06c-490e-814f-2f4fcfea40ac tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9be253da-d06c-490e-814f-2f4fcfea40ac tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.016282 Jul 26 20:11:15.153252 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2497/5083] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:15 2022] POST /compute/v2.1/servers => generated 155 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:11:15.161484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d1cd75f3-f3d0-4ea8-b5f9-6af8eaa5ff6b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:15.162106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d1cd75f3-f3d0-4ea8-b5f9-6af8eaa5ff6b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:15.185985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1cd75f3-f3d0-4ea8-b5f9-6af8eaa5ff6b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:15.186450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1cd75f3-f3d0-4ea8-b5f9-6af8eaa5ff6b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:15.190875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1cd75f3-f3d0-4ea8-b5f9-6af8eaa5ff6b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:15.191332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d1cd75f3-f3d0-4ea8-b5f9-6af8eaa5ff6b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:15.467852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-349f4e0d-edf5-4e6e-8fe7-3264c3bb4b9f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:15.479589 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-349f4e0d-edf5-4e6e-8fe7-3264c3bb4b9f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.484858 Jul 26 20:11:15.500307 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2587/5084] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:14 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:15.883634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d1cd75f3-f3d0-4ea8-b5f9-6af8eaa5ff6b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:15.891550 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d1cd75f3-f3d0-4ea8-b5f9-6af8eaa5ff6b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.734465 Jul 26 20:11:15.892175 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2498/5085] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:15 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:15.918213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-84af19de-613d-482e-8ef2-5cf6a38429c0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:15.925208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-84af19de-613d-482e-8ef2-5cf6a38429c0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:15.945838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84af19de-613d-482e-8ef2-5cf6a38429c0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:15.946296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84af19de-613d-482e-8ef2-5cf6a38429c0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:15.947092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84af19de-613d-482e-8ef2-5cf6a38429c0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:15.947535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84af19de-613d-482e-8ef2-5cf6a38429c0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:16.088832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:16.511420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2abdb9cd-bff9-4282-903f-ca622fe12cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:16.512666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2abdb9cd-bff9-4282-903f-ca622fe12cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:16.546817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2abdb9cd-bff9-4282-903f-ca622fe12cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:16.547572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2abdb9cd-bff9-4282-903f-ca622fe12cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:16.548441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2abdb9cd-bff9-4282-903f-ca622fe12cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:16.551254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2abdb9cd-bff9-4282-903f-ca622fe12cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:16.821128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-84af19de-613d-482e-8ef2-5cf6a38429c0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:16.848511 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-84af19de-613d-482e-8ef2-5cf6a38429c0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.934552 Jul 26 20:11:16.854946 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2588/5086] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:15 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:17.129890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2abdb9cd-bff9-4282-903f-ca622fe12cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:17.145042 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2abdb9cd-bff9-4282-903f-ca622fe12cf5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.637314 Jul 26 20:11:17.160941 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2499/5087] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:16 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:17.179247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1c6994a-2900-430b-8aba-b9972d326b19 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1384663265", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1c6994a-2900-430b-8aba-b9972d326b19 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 492 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1384663265", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1384663265', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:17.183979 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 20:11:17.188632 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:17.191633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c1c6994a-2900-430b-8aba-b9972d326b19 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:17.192857 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c1c6994a-2900-430b-8aba-b9972d326b19 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.018450 Jul 26 20:11:17.205095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d97e02bb-09fb-4fab-b030-936ca5f15682 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:17.211940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d97e02bb-09fb-4fab-b030-936ca5f15682 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:17.217266 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2589/5088] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:17 2022] POST /compute/v2.1/servers => generated 624 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:11:17.223969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d97e02bb-09fb-4fab-b030-936ca5f15682 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:17.228248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d97e02bb-09fb-4fab-b030-936ca5f15682 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:17.229330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d97e02bb-09fb-4fab-b030-936ca5f15682 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:17.230010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d97e02bb-09fb-4fab-b030-936ca5f15682 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:17.836143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d97e02bb-09fb-4fab-b030-936ca5f15682 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:17.853804 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d97e02bb-09fb-4fab-b030-936ca5f15682 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.653193 Jul 26 20:11:17.864210 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2500/5089] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:17 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:17.892483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7fe3822e-1146-48e3-a953-4bf85d7941af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:17.893468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7fe3822e-1146-48e3-a953-4bf85d7941af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:17.924476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fe3822e-1146-48e3-a953-4bf85d7941af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:17.942466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fe3822e-1146-48e3-a953-4bf85d7941af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:17.943707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fe3822e-1146-48e3-a953-4bf85d7941af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:17.944387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fe3822e-1146-48e3-a953-4bf85d7941af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:18.172078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0996da01-348d-43e1-8b78-6c4e6a90b538 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:18.173040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0996da01-348d-43e1-8b78-6c4e6a90b538 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:18.187696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0996da01-348d-43e1-8b78-6c4e6a90b538 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:18.189889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0996da01-348d-43e1-8b78-6c4e6a90b538 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:18.204075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0996da01-348d-43e1-8b78-6c4e6a90b538 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:18.205156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0996da01-348d-43e1-8b78-6c4e6a90b538 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:18.304965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7fe3822e-1146-48e3-a953-4bf85d7941af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:18.330988 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7fe3822e-1146-48e3-a953-4bf85d7941af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.445226 Jul 26 20:11:18.342496 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2590/5090] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:17 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:18.446175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7735327-1798-423f-b787-d51160bc3c17 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7735327-1798-423f-b787-d51160bc3c17 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 416 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:18.454201 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 20:11:18.457524 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:18.465584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7735327-1798-423f-b787-d51160bc3c17 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:18.483843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c7735327-1798-423f-b787-d51160bc3c17 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.038914 Jul 26 20:11:18.486112 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2591/5091] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:18 2022] POST /compute/v2.1/servers => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:11:18.514489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22efb62c-6d01-4305-a54b-4dcb097a7f41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:18.516835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-22efb62c-6d01-4305-a54b-4dcb097a7f41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:18.577575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22efb62c-6d01-4305-a54b-4dcb097a7f41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:18.579471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22efb62c-6d01-4305-a54b-4dcb097a7f41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:18.588067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22efb62c-6d01-4305-a54b-4dcb097a7f41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:18.593780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22efb62c-6d01-4305-a54b-4dcb097a7f41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:18.796005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0996da01-348d-43e1-8b78-6c4e6a90b538 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:18.808844 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0996da01-348d-43e1-8b78-6c4e6a90b538 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.642210 Jul 26 20:11:18.816808 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2501/5092] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:18 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:19.318807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22efb62c-6d01-4305-a54b-4dcb097a7f41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:19.337643 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22efb62c-6d01-4305-a54b-4dcb097a7f41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.843290 Jul 26 20:11:19.348008 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2592/5093] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:18 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:19.378761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11892666-86ea-4059-be3f-a5ef03882689 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:19.379414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11892666-86ea-4059-be3f-a5ef03882689 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:19.396566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11892666-86ea-4059-be3f-a5ef03882689 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:19.403439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11892666-86ea-4059-be3f-a5ef03882689 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:19.409209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11892666-86ea-4059-be3f-a5ef03882689 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:19.411381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11892666-86ea-4059-be3f-a5ef03882689 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:19.835324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10e1b3be-acf5-4c2a-ab15-32865414c261 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:19.835994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-10e1b3be-acf5-4c2a-ab15-32865414c261 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:19.864284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10e1b3be-acf5-4c2a-ab15-32865414c261 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:19.869472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10e1b3be-acf5-4c2a-ab15-32865414c261 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:19.870864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10e1b3be-acf5-4c2a-ab15-32865414c261 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:19.894803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10e1b3be-acf5-4c2a-ab15-32865414c261 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:20.632495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-11892666-86ea-4059-be3f-a5ef03882689 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:20.644585 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11892666-86ea-4059-be3f-a5ef03882689 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 1.280800 Jul 26 20:11:20.659291 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2502/5094] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:19 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:20.813715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10e1b3be-acf5-4c2a-ab15-32865414c261 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:20.831310 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-10e1b3be-acf5-4c2a-ab15-32865414c261 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 1.004141 Jul 26 20:11:20.845025 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2593/5095] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:19 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:20.984800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5295b75f-a161-474e-9d1a-5a89e936d0c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1129063221", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": -1, "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:21.032913 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-5295b75f-a161-474e-9d1a-5a89e936d0c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Flavor -1 could not be found. Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5295b75f-a161-474e-9d1a-5a89e936d0c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 206 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1129063221", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": -1, "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: exception: Flavor -1 could not be found. Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1129063221', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': -1, 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:21.042154 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 26 20:11:21.047504 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:21.066236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5295b75f-a161-474e-9d1a-5a89e936d0c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:21.070283 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5295b75f-a161-474e-9d1a-5a89e936d0c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.090741 Jul 26 20:11:21.080420 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2503/5096] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:20 2022] POST /compute/v2.1/servers => generated 73 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 20:11:21.089241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-76ae03ee-f6dd-4afb-8dc3-44a6e91eddb0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:21.089872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-76ae03ee-f6dd-4afb-8dc3-44a6e91eddb0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:21.108572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76ae03ee-f6dd-4afb-8dc3-44a6e91eddb0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:21.109034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76ae03ee-f6dd-4afb-8dc3-44a6e91eddb0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:21.114972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76ae03ee-f6dd-4afb-8dc3-44a6e91eddb0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:21.115429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76ae03ee-f6dd-4afb-8dc3-44a6e91eddb0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:21.634495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-76ae03ee-f6dd-4afb-8dc3-44a6e91eddb0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:21.644451 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-76ae03ee-f6dd-4afb-8dc3-44a6e91eddb0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.559544 Jul 26 20:11:21.656967 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2594/5097] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:21 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:21.671002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-284a7816-4076-4644-ae65-c52cfef1d04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:21.673886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-284a7816-4076-4644-ae65-c52cfef1d04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:21.707438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-284a7816-4076-4644-ae65-c52cfef1d04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:21.709937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-284a7816-4076-4644-ae65-c52cfef1d04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:21.711021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-284a7816-4076-4644-ae65-c52cfef1d04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:21.713366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-284a7816-4076-4644-ae65-c52cfef1d04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:21.809279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:21.860057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ee5e5fa9-dda6-4090-b6c8-c40e91eba2e7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:21.860686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ee5e5fa9-dda6-4090-b6c8-c40e91eba2e7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:21.872491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee5e5fa9-dda6-4090-b6c8-c40e91eba2e7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:21.878699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee5e5fa9-dda6-4090-b6c8-c40e91eba2e7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:21.886125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee5e5fa9-dda6-4090-b6c8-c40e91eba2e7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:21.891903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ee5e5fa9-dda6-4090-b6c8-c40e91eba2e7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:22.461861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-284a7816-4076-4644-ae65-c52cfef1d04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:22.477749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-284a7816-4076-4644-ae65-c52cfef1d04d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.809388 Jul 26 20:11:22.484835 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2504/5098] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:21 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:22.671593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ee5e5fa9-dda6-4090-b6c8-c40e91eba2e7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:22.687737 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ee5e5fa9-dda6-4090-b6c8-c40e91eba2e7 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.832114 Jul 26 20:11:22.692132 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2595/5099] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:21 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:22.848319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8143b192-83b9-4024-aec3-4b0b699bc6ac tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2122819377", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8143b192-83b9-4024-aec3-4b0b699bc6ac tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 173 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2122819377", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2122819377', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi -1 Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:11:22.853040 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:22.857183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8143b192-83b9-4024-aec3-4b0b699bc6ac tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:22.868595 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8143b192-83b9-4024-aec3-4b0b699bc6ac tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010038 Jul 26 20:11:22.869256 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2505/5100] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:22 2022] POST /compute/v2.1/servers => generated 145 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:11:22.877806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-416d34ec-6cfa-4d16-9d65-aafd001630c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:22.879967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-416d34ec-6cfa-4d16-9d65-aafd001630c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:22.888126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-416d34ec-6cfa-4d16-9d65-aafd001630c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:22.900868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-416d34ec-6cfa-4d16-9d65-aafd001630c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:22.902487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-416d34ec-6cfa-4d16-9d65-aafd001630c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:22.902939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-416d34ec-6cfa-4d16-9d65-aafd001630c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:23.463659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-416d34ec-6cfa-4d16-9d65-aafd001630c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:23.490602 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-416d34ec-6cfa-4d16-9d65-aafd001630c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.616538 Jul 26 20:11:23.500383 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2596/5101] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:22 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:23.524431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-54dca17e-79eb-49f1-bd77-e1ee8e5dbf8e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:23.527131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-54dca17e-79eb-49f1-bd77-e1ee8e5dbf8e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:23.570397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54dca17e-79eb-49f1-bd77-e1ee8e5dbf8e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:23.571056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54dca17e-79eb-49f1-bd77-e1ee8e5dbf8e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:23.573314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54dca17e-79eb-49f1-bd77-e1ee8e5dbf8e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:23.573757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-54dca17e-79eb-49f1-bd77-e1ee8e5dbf8e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:23.716884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-30623632-bb05-4226-8423-1caa4ee0cf74 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:23.717689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-30623632-bb05-4226-8423-1caa4ee0cf74 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:23.730253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30623632-bb05-4226-8423-1caa4ee0cf74 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:23.730707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30623632-bb05-4226-8423-1caa4ee0cf74 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:23.731541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30623632-bb05-4226-8423-1caa4ee0cf74 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:23.736624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30623632-bb05-4226-8423-1caa4ee0cf74 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:24.128263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-54dca17e-79eb-49f1-bd77-e1ee8e5dbf8e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:24.137391 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-54dca17e-79eb-49f1-bd77-e1ee8e5dbf8e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.617938 Jul 26 20:11:24.150791 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2506/5102] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:23 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:24.166200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-30623632-bb05-4226-8423-1caa4ee0cf74 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:24.187217 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-30623632-bb05-4226-8423-1caa4ee0cf74 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.474085 Jul 26 20:11:24.216876 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2597/5103] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:23 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:24.363907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e3d06dc-be42-4a7a-8429-f0b1829af9c6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1655805349", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:24.368810 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0e3d06dc-be42-4a7a-8429-f0b1829af9c6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e3d06dc-be42-4a7a-8429-f0b1829af9c6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 216 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1655805349", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1655805349', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:24.381481 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:24.384833 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:24.384833 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:24.384833 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:24.384833 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:24.384833 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:24.384833 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 20:11:24.384833 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:24.393630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e3d06dc-be42-4a7a-8429-f0b1829af9c6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:24.399938 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e3d06dc-be42-4a7a-8429-f0b1829af9c6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.040154 Jul 26 20:11:24.405406 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2507/5104] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:24 2022] POST /compute/v2.1/servers => generated 123 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:11:24.413293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d3c04f7-9a28-4d5d-b710-e7ef8732faaa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:24.413907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0d3c04f7-9a28-4d5d-b710-e7ef8732faaa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:24.422440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d3c04f7-9a28-4d5d-b710-e7ef8732faaa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:24.422890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d3c04f7-9a28-4d5d-b710-e7ef8732faaa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:24.423699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d3c04f7-9a28-4d5d-b710-e7ef8732faaa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:24.424137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d3c04f7-9a28-4d5d-b710-e7ef8732faaa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:24.755744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0d3c04f7-9a28-4d5d-b710-e7ef8732faaa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:24.766822 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d3c04f7-9a28-4d5d-b710-e7ef8732faaa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.357104 Jul 26 20:11:24.767771 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2598/5105] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:24 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:24.792756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-56c4903c-e27e-4e11-97e2-e05b40183b22 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:24.794877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-56c4903c-e27e-4e11-97e2-e05b40183b22 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:24.809641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56c4903c-e27e-4e11-97e2-e05b40183b22 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:24.810477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56c4903c-e27e-4e11-97e2-e05b40183b22 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:24.811494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56c4903c-e27e-4e11-97e2-e05b40183b22 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:24.812157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56c4903c-e27e-4e11-97e2-e05b40183b22 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:25.130563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-56c4903c-e27e-4e11-97e2-e05b40183b22 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:25.161438 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-56c4903c-e27e-4e11-97e2-e05b40183b22 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.375243 Jul 26 20:11:25.162095 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2508/5106] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:24 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:25.211135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-69b80458-f39c-4a39-9b6c-9ebc193568ff tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:25.212352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-69b80458-f39c-4a39-9b6c-9ebc193568ff tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:25.227200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69b80458-f39c-4a39-9b6c-9ebc193568ff tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:25.243805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69b80458-f39c-4a39-9b6c-9ebc193568ff tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:25.246368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69b80458-f39c-4a39-9b6c-9ebc193568ff tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:25.249205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69b80458-f39c-4a39-9b6c-9ebc193568ff tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:25.539854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9329820d-5b95-4f15-ba5c-8f136f150105 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-805842384", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-key-1839853534", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:25.717661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-9329820d-5b95-4f15-ba5c-8f136f150105 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] validate_networks() for [('7cda145a-7c15-4529-b4ae-fda552c43889', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:11:25.918242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-69b80458-f39c-4a39-9b6c-9ebc193568ff tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:25.933827 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-69b80458-f39c-4a39-9b6c-9ebc193568ff tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.727352 Jul 26 20:11:25.936916 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2599/5107] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:25 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:26.750410 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9329820d-5b95-4f15-ba5c-8f136f150105 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Invalid key_name provided. Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9329820d-5b95-4f15-ba5c-8f136f150105 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 246 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-805842384", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-key-1839853534", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid key_name provided. Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-805842384', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'key_name': 'tempest-key-1839853534', 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1839853534 not found for user c5db253037f7490cb99f9108c72010fc Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:26.752252 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9329820d-5b95-4f15-ba5c-8f136f150105 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid key_name provided. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9329820d-5b95-4f15-ba5c-8f136f150105 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.218555 Jul 26 20:11:26.759727 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2509/5108] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:25 2022] POST /compute/v2.1/servers => generated 70 bytes in 1223 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 20:11:26.769840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-443215b1-a7de-4d56-b8ec-dcbe8c5fcf25 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:26.770869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-443215b1-a7de-4d56-b8ec-dcbe8c5fcf25 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:26.787508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-443215b1-a7de-4d56-b8ec-dcbe8c5fcf25 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:26.788975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-443215b1-a7de-4d56-b8ec-dcbe8c5fcf25 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:26.790723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-443215b1-a7de-4d56-b8ec-dcbe8c5fcf25 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:26.791418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-443215b1-a7de-4d56-b8ec-dcbe8c5fcf25 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:26.958900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ed8c4ac2-5e77-4212-b845-8c76b5d9576b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:26.959526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ed8c4ac2-5e77-4212-b845-8c76b5d9576b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:26.992638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed8c4ac2-5e77-4212-b845-8c76b5d9576b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:26.993332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed8c4ac2-5e77-4212-b845-8c76b5d9576b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:26.994281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed8c4ac2-5e77-4212-b845-8c76b5d9576b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:26.996390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ed8c4ac2-5e77-4212-b845-8c76b5d9576b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:27.032978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-443215b1-a7de-4d56-b8ec-dcbe8c5fcf25 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:27.046075 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-443215b1-a7de-4d56-b8ec-dcbe8c5fcf25 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.282721 Jul 26 20:11:27.066613 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2600/5109] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:26 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:27.078211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef8674f2-2a84-43d8-a082-b55734e1dee9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:27.079007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef8674f2-2a84-43d8-a082-b55734e1dee9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:27.091472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef8674f2-2a84-43d8-a082-b55734e1dee9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:27.096272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef8674f2-2a84-43d8-a082-b55734e1dee9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:27.097907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef8674f2-2a84-43d8-a082-b55734e1dee9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:27.098522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef8674f2-2a84-43d8-a082-b55734e1dee9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:27.680976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ef8674f2-2a84-43d8-a082-b55734e1dee9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:27.689460 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef8674f2-2a84-43d8-a082-b55734e1dee9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.620340 Jul 26 20:11:27.704432 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2601/5110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:27 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:27.724427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ed8c4ac2-5e77-4212-b845-8c76b5d9576b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:27.738593 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ed8c4ac2-5e77-4212-b845-8c76b5d9576b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.783480 Jul 26 20:11:27.747295 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2510/5111] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:26 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:27.991082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b2af10f-5d76-46cb-b76e-5ebe89152e69 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2136104440", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:28.244313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.security_group_api [None req-0b2af10f-5d76-46cb-b76e-5ebe89152e69 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Neutron security group does_not_exist not found {{(pid=125964) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 26 20:11:28.245397 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-0b2af10f-5d76-46cb-b76e-5ebe89152e69 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b2af10f-5d76-46cb-b76e-5ebe89152e69 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 258 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2136104440", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2136104440', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 26 20:11:28.266230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:28.273945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b2af10f-5d76-46cb-b76e-5ebe89152e69 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:28.279976 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0b2af10f-5d76-46cb-b76e-5ebe89152e69 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.286090 Jul 26 20:11:28.279976 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2602/5112] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:27 2022] POST /compute/v2.1/servers => generated 106 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:11:28.281764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3cbe8dfc-d249-40a4-b3f0-82b7131d4b20 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:28.281764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3cbe8dfc-d249-40a4-b3f0-82b7131d4b20 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:28.301815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cbe8dfc-d249-40a4-b3f0-82b7131d4b20 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:28.302291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cbe8dfc-d249-40a4-b3f0-82b7131d4b20 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:28.303067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cbe8dfc-d249-40a4-b3f0-82b7131d4b20 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:28.303507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cbe8dfc-d249-40a4-b3f0-82b7131d4b20 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:28.705815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3cbe8dfc-d249-40a4-b3f0-82b7131d4b20 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:28.713673 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3cbe8dfc-d249-40a4-b3f0-82b7131d4b20 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.438468 Jul 26 20:11:28.719093 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2511/5113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:28 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:28.750868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22188080-ff33-4947-96ed-2314eaebce38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:28.751939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-22188080-ff33-4947-96ed-2314eaebce38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:28.759149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-808641d5-f888-4629-9799-ef37009e1a21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:28.760028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-808641d5-f888-4629-9799-ef37009e1a21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:28.778417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-808641d5-f888-4629-9799-ef37009e1a21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:28.783035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-808641d5-f888-4629-9799-ef37009e1a21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:28.784211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-808641d5-f888-4629-9799-ef37009e1a21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:28.789316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-808641d5-f888-4629-9799-ef37009e1a21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:28.803734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22188080-ff33-4947-96ed-2314eaebce38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:28.804482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22188080-ff33-4947-96ed-2314eaebce38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:28.807269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22188080-ff33-4947-96ed-2314eaebce38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:28.809104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22188080-ff33-4947-96ed-2314eaebce38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:29.338527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-808641d5-f888-4629-9799-ef37009e1a21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:29.352111 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-808641d5-f888-4629-9799-ef37009e1a21 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.597268 Jul 26 20:11:29.352898 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2512/5114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:28 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:29.503297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22188080-ff33-4947-96ed-2314eaebce38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:29.519831 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22188080-ff33-4947-96ed-2314eaebce38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.774919 Jul 26 20:11:29.520746 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2603/5115] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:28 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:29.544535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-61269a15-5bd7-4e44-8b8c-716fd06b6c5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:29.545634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-61269a15-5bd7-4e44-8b8c-716fd06b6c5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:29.569107 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-61269a15-5bd7-4e44-8b8c-716fd06b6c5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb could not be found. Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-61269a15-5bd7-4e44-8b8c-716fd06b6c5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb HTTP/1.1 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb could not be found. Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb'} Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb could not be found. Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb could not be found. Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:29.570953 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:29.576559 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:29.576559 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:29.576559 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:29.576559 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:29.576559 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:29.576559 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:29.576559 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb could not be found. Jul 26 20:11:29.576559 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:29.578334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-61269a15-5bd7-4e44-8b8c-716fd06b6c5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:29.579427 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-61269a15-5bd7-4e44-8b8c-716fd06b6c5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb" status: 404 len: 111 microversion: 2.1 time: 0.039089 Jul 26 20:11:29.580257 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2513/5116] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:11:29 2022] DELETE /compute/v2.1/servers/3007bcbb-f7d4-42f2-bc5d-db9c2e7830cb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:29.591450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f18fa911-1ebd-4237-858f-b9a113a238dd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:29.595349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f18fa911-1ebd-4237-858f-b9a113a238dd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:29.602201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f18fa911-1ebd-4237-858f-b9a113a238dd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:29.611813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f18fa911-1ebd-4237-858f-b9a113a238dd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:29.612670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f18fa911-1ebd-4237-858f-b9a113a238dd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:29.613161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f18fa911-1ebd-4237-858f-b9a113a238dd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:30.293639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f18fa911-1ebd-4237-858f-b9a113a238dd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:30.307635 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f18fa911-1ebd-4237-858f-b9a113a238dd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.722771 Jul 26 20:11:30.317461 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2604/5117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:29 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:30.342763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-423c2b4b-dfe6-4256-8992-6836148668ab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:30.343382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-423c2b4b-dfe6-4256-8992-6836148668ab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:30.370727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-423c2b4b-dfe6-4256-8992-6836148668ab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:30.372497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-423c2b4b-dfe6-4256-8992-6836148668ab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:30.373474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-423c2b4b-dfe6-4256-8992-6836148668ab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:30.375257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed3a2cc1-3832-41c4-9b9b-7aaeb2b9f52e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:30.376088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed3a2cc1-3832-41c4-9b9b-7aaeb2b9f52e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:30.376659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-423c2b4b-dfe6-4256-8992-6836148668ab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:30.392123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed3a2cc1-3832-41c4-9b9b-7aaeb2b9f52e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:30.401941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed3a2cc1-3832-41c4-9b9b-7aaeb2b9f52e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:30.412609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed3a2cc1-3832-41c4-9b9b-7aaeb2b9f52e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:30.414075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed3a2cc1-3832-41c4-9b9b-7aaeb2b9f52e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:30.940346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ed3a2cc1-3832-41c4-9b9b-7aaeb2b9f52e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:30.960714 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed3a2cc1-3832-41c4-9b9b-7aaeb2b9f52e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.578709 Jul 26 20:11:30.967685 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2605/5118] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:30 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:30.983507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85bdc3e6-8750-4377-b711-69ea213319e9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'create', calling method: .version_select at 0x7f8756766820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-288808652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRNqWRHi2L+/2k5v1Sm4LQ3lTItVosLR77xt1LTPPsGO6+6uH+sfeN3Zk16uV+vHkNQgCxyjHP2dSJvfHbbg/4vTJZu2EzgkLM7qdciecGe89j4zdVQhRiVPSMcRERbuQ=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:31.066510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-85bdc3e6-8750-4377-b711-69ea213319e9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for project d237549546cf478aa27cf8759a57d4b4. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:11:31.087468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-85bdc3e6-8750-4377-b711-69ea213319e9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for user 84e081d584b34009a7bbfbc2a6c14436 and project d237549546cf478aa27cf8759a57d4b4. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:11:31.134666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-423c2b4b-dfe6-4256-8992-6836148668ab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:31.146571 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85bdc3e6-8750-4377-b711-69ea213319e9 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.177567 Jul 26 20:11:31.147377 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2606/5119] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:11:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:11:31.151468 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-423c2b4b-dfe6-4256-8992-6836148668ab tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.813112 Jul 26 20:11:31.153015 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2514/5120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:30 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:31.178452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5c37f35-b59d-4b55-8428-a3873564efa6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:31.179574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5c37f35-b59d-4b55-8428-a3873564efa6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Failed to fetch instance by id 9223372036854775808 {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 20:11:31.180282 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c5c37f35-b59d-4b55-8428-a3873564efa6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5c37f35-b59d-4b55-8428-a3873564efa6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 9223372036854775808 could not be found. Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '9223372036854775808'} Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:31.183885 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:31.189330 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:31.189330 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:31.189330 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:31.189330 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 26 20:11:31.189330 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:31.191182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5c37f35-b59d-4b55-8428-a3873564efa6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:31.193915 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5c37f35-b59d-4b55-8428-a3873564efa6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.018554 Jul 26 20:11:31.199530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2607/5121] 10.222.0.58 () {58 vars in 1188 bytes} [Tue Jul 26 20:11:31 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:11:31.206623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-290b6517-0f1f-46c6-9de3-b14b48aec7a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:31.207537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-290b6517-0f1f-46c6-9de3-b14b48aec7a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:31.229846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-290b6517-0f1f-46c6-9de3-b14b48aec7a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:31.231338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-290b6517-0f1f-46c6-9de3-b14b48aec7a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:31.233891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-290b6517-0f1f-46c6-9de3-b14b48aec7a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:31.234340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-290b6517-0f1f-46c6-9de3-b14b48aec7a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:31.616012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-290b6517-0f1f-46c6-9de3-b14b48aec7a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:31.628026 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-290b6517-0f1f-46c6-9de3-b14b48aec7a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.428077 Jul 26 20:11:31.632227 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2515/5122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:31 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:31.667478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b072dea3-c70e-4564-aad9-a10f62ea4505 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:31.668158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b072dea3-c70e-4564-aad9-a10f62ea4505 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:31.686350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b072dea3-c70e-4564-aad9-a10f62ea4505 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:31.688501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b072dea3-c70e-4564-aad9-a10f62ea4505 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:31.694120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b072dea3-c70e-4564-aad9-a10f62ea4505 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:31.695427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b072dea3-c70e-4564-aad9-a10f62ea4505 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:31.987954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3ba73b6-d26a-4db9-905e-b9dc01386102 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:31.989096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a3ba73b6-d26a-4db9-905e-b9dc01386102 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:32.010249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3ba73b6-d26a-4db9-905e-b9dc01386102 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:32.012446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3ba73b6-d26a-4db9-905e-b9dc01386102 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:32.027908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3ba73b6-d26a-4db9-905e-b9dc01386102 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:32.034416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3ba73b6-d26a-4db9-905e-b9dc01386102 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:32.355308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3ba73b6-d26a-4db9-905e-b9dc01386102 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:32.367038 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3ba73b6-d26a-4db9-905e-b9dc01386102 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.386068 Jul 26 20:11:32.371385 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2516/5123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:31 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:32.511818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b072dea3-c70e-4564-aad9-a10f62ea4505 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:32.522601 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b072dea3-c70e-4564-aad9-a10f62ea4505 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.861240 Jul 26 20:11:32.523904 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2608/5124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:31 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:32.549859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a8b2086e-cd3b-4a80-9a57-a7bebe695f28 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:32.550348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a8b2086e-cd3b-4a80-9a57-a7bebe695f28 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Failed to fetch instance by id -1 {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 20:11:32.550856 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-a8b2086e-cd3b-4a80-9a57-a7bebe695f28 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance -1 could not be found. Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a8b2086e-cd3b-4a80-9a57-a7bebe695f28 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance -1 could not be found. Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '-1'} Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:32.552556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:32.556535 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:32.556535 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:32.556535 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 26 20:11:32.556535 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:32.556535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a8b2086e-cd3b-4a80-9a57-a7bebe695f28 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance -1 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:32.556535 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a8b2086e-cd3b-4a80-9a57-a7bebe695f28 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008952 Jul 26 20:11:32.556535 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2517/5125] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Jul 26 20:11:32 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:11:32.563557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-074eb39f-237b-48bd-993c-c6d469fb1e38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:32.564204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-074eb39f-237b-48bd-993c-c6d469fb1e38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:32.571257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-074eb39f-237b-48bd-993c-c6d469fb1e38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:32.571751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-074eb39f-237b-48bd-993c-c6d469fb1e38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:32.574211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-074eb39f-237b-48bd-993c-c6d469fb1e38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:32.574649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-074eb39f-237b-48bd-993c-c6d469fb1e38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:33.291147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-074eb39f-237b-48bd-993c-c6d469fb1e38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:33.301597 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-074eb39f-237b-48bd-993c-c6d469fb1e38 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.742861 Jul 26 20:11:33.315461 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2609/5126] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:32 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:33.341854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80e5f879-95e8-4874-a16b-740e007a5571 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:33.342550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80e5f879-95e8-4874-a16b-740e007a5571 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:33.369160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=56 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:33.375411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e5f879-95e8-4874-a16b-740e007a5571 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:33.385802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e5f879-95e8-4874-a16b-740e007a5571 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:33.389420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5a67db11-8311-4b6a-9e2d-ee85ce55c258 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:33.390045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a67db11-8311-4b6a-9e2d-ee85ce55c258 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:33.391967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e5f879-95e8-4874-a16b-740e007a5571 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:33.397811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80e5f879-95e8-4874-a16b-740e007a5571 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:33.407797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a67db11-8311-4b6a-9e2d-ee85ce55c258 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:33.408252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a67db11-8311-4b6a-9e2d-ee85ce55c258 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:33.409033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a67db11-8311-4b6a-9e2d-ee85ce55c258 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:33.409471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a67db11-8311-4b6a-9e2d-ee85ce55c258 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:33.500296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:33.955184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-80e5f879-95e8-4874-a16b-740e007a5571 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:33.977749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80e5f879-95e8-4874-a16b-740e007a5571 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.640412 Jul 26 20:11:33.979162 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2518/5127] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:33 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:34.011247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-340692ee-a3c9-4536-8220-2b547cd1d914 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:34.013648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-340692ee-a3c9-4536-8220-2b547cd1d914 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: f1650acf-01b1-425e-a18d-83d4670f371a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:34.035315 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-340692ee-a3c9-4536-8220-2b547cd1d914 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance f1650acf-01b1-425e-a18d-83d4670f371a could not be found. Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-340692ee-a3c9-4536-8220-2b547cd1d914 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/f1650acf-01b1-425e-a18d-83d4670f371a/action HTTP/1.1 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 19 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: {"forceDelete": {}} Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f1650acf-01b1-425e-a18d-83d4670f371a could not be found. Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f1650acf-01b1-425e-a18d-83d4670f371a', 'body': {'forceDelete': {}}} Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1650acf-01b1-425e-a18d-83d4670f371a could not be found. Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1650acf-01b1-425e-a18d-83d4670f371a could not be found. Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:34.058125 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:34.062581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:34.062581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:34.062581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1650acf-01b1-425e-a18d-83d4670f371a could not be found. Jul 26 20:11:34.062581 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.067249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-340692ee-a3c9-4536-8220-2b547cd1d914 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance f1650acf-01b1-425e-a18d-83d4670f371a could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:34.080942 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-340692ee-a3c9-4536-8220-2b547cd1d914 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/f1650acf-01b1-425e-a18d-83d4670f371a/action" status: 404 len: 111 microversion: 2.1 time: 0.081244 Jul 26 20:11:34.084444 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2519/5128] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:33 2022] POST /compute/v2.1/servers/f1650acf-01b1-425e-a18d-83d4670f371a/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:34.102586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-686d38dd-107e-4ae9-890e-f6a2fad20836 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:34.105457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-686d38dd-107e-4ae9-890e-f6a2fad20836 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:34.122679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-686d38dd-107e-4ae9-890e-f6a2fad20836 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:34.123992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-686d38dd-107e-4ae9-890e-f6a2fad20836 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:34.125494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-686d38dd-107e-4ae9-890e-f6a2fad20836 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:34.126602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-686d38dd-107e-4ae9-890e-f6a2fad20836 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:34.131705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5a67db11-8311-4b6a-9e2d-ee85ce55c258 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:34.142763 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5a67db11-8311-4b6a-9e2d-ee85ce55c258 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.757669 Jul 26 20:11:34.144826 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2610/5129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:33 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:34.541174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-686d38dd-107e-4ae9-890e-f6a2fad20836 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:34.555545 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-686d38dd-107e-4ae9-890e-f6a2fad20836 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.460768 Jul 26 20:11:34.560629 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2520/5130] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:34 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:34.586166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b16db0b8-d8b5-40b5-b849-633c31562e43 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:34.586850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b16db0b8-d8b5-40b5-b849-633c31562e43 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:34.596881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b16db0b8-d8b5-40b5-b849-633c31562e43 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:34.597319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b16db0b8-d8b5-40b5-b849-633c31562e43 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:34.598237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b16db0b8-d8b5-40b5-b849-633c31562e43 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:34.598818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b16db0b8-d8b5-40b5-b849-633c31562e43 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:34.902098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b16db0b8-d8b5-40b5-b849-633c31562e43 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:34.915193 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b16db0b8-d8b5-40b5-b849-633c31562e43 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.331048 Jul 26 20:11:34.915846 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2611/5131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:34 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:34.942664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c039836-ee14-4a7d-9b5d-3d8dd6da57dc tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:34.945576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5c039836-ee14-4a7d-9b5d-3d8dd6da57dc tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:34.956985 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-5c039836-ee14-4a7d-9b5d-3d8dd6da57dc tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f could not be found. Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c039836-ee14-4a7d-9b5d-3d8dd6da57dc tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f/action HTTP/1.1 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 39 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: {"os-getConsoleOutput": {"length": 10}} Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f could not be found. Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f could not be found. Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f could not be found. Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.965941 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:34.970812 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:34.970812 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:34.970812 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:34.970812 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:34.970812 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f could not be found. Jul 26 20:11:34.970812 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:34.972569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c039836-ee14-4a7d-9b5d-3d8dd6da57dc tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:34.974120 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5c039836-ee14-4a7d-9b5d-3d8dd6da57dc tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f/action" status: 404 len: 111 microversion: 2.1 time: 0.035568 Jul 26 20:11:34.985562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9532495d-5539-4ae4-bbcd-7c83e3f640be tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:34.986500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9532495d-5539-4ae4-bbcd-7c83e3f640be tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:34.989425 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2521/5132] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:34 2022] POST /compute/v2.1/servers/7fdc06f3-0b64-4f4e-bcd3-0e9c4d4a756f/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:35.002684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9532495d-5539-4ae4-bbcd-7c83e3f640be tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:35.004277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9532495d-5539-4ae4-bbcd-7c83e3f640be tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:35.007940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9532495d-5539-4ae4-bbcd-7c83e3f640be tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:35.008964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9532495d-5539-4ae4-bbcd-7c83e3f640be tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:35.169863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-682d3c8d-45aa-40db-ab39-5aa278261e55 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:35.171298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-682d3c8d-45aa-40db-ab39-5aa278261e55 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:35.195010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-682d3c8d-45aa-40db-ab39-5aa278261e55 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:35.203585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-682d3c8d-45aa-40db-ab39-5aa278261e55 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:35.207772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-682d3c8d-45aa-40db-ab39-5aa278261e55 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:35.211652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-682d3c8d-45aa-40db-ab39-5aa278261e55 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:35.428060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9532495d-5539-4ae4-bbcd-7c83e3f640be tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:35.462332 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9532495d-5539-4ae4-bbcd-7c83e3f640be tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.482571 Jul 26 20:11:35.470311 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2612/5133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:34 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:35.501735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f549dfd-5743-45ca-b6e0-311da22264f0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:35.503366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7f549dfd-5743-45ca-b6e0-311da22264f0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:35.526475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f549dfd-5743-45ca-b6e0-311da22264f0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:35.536079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f549dfd-5743-45ca-b6e0-311da22264f0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:35.536817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f549dfd-5743-45ca-b6e0-311da22264f0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:35.541750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f549dfd-5743-45ca-b6e0-311da22264f0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:35.882008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-682d3c8d-45aa-40db-ab39-5aa278261e55 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:35.890870 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-682d3c8d-45aa-40db-ab39-5aa278261e55 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.725514 Jul 26 20:11:35.904832 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2522/5134] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:35 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:36.112683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7f549dfd-5743-45ca-b6e0-311da22264f0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:36.127781 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f549dfd-5743-45ca-b6e0-311da22264f0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.628601 Jul 26 20:11:36.149565 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2613/5135] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:35 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:36.155887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ef276b4b-8d83-4996-bf9b-1f26a0523b1d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:36.155887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ef276b4b-8d83-4996-bf9b-1f26a0523b1d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: f44f6684-6900-4f82-8124-a2ef0e4f8246] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:36.165294 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ef276b4b-8d83-4996-bf9b-1f26a0523b1d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance f44f6684-6900-4f82-8124-a2ef0e4f8246 could not be found. Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ef276b4b-8d83-4996-bf9b-1f26a0523b1d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/f44f6684-6900-4f82-8124-a2ef0e4f8246 HTTP/1.1 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f44f6684-6900-4f82-8124-a2ef0e4f8246 could not be found. Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f44f6684-6900-4f82-8124-a2ef0e4f8246'} Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44f6684-6900-4f82-8124-a2ef0e4f8246 could not be found. Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44f6684-6900-4f82-8124-a2ef0e4f8246 could not be found. Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:36.166877 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:36.176453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:36.176453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:36.176453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:36.176453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44f6684-6900-4f82-8124-a2ef0e4f8246 could not be found. Jul 26 20:11:36.176453 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:36.176453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ef276b4b-8d83-4996-bf9b-1f26a0523b1d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance f44f6684-6900-4f82-8124-a2ef0e4f8246 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:36.176453 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ef276b4b-8d83-4996-bf9b-1f26a0523b1d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/f44f6684-6900-4f82-8124-a2ef0e4f8246" status: 404 len: 111 microversion: 2.1 time: 0.019313 Jul 26 20:11:36.176453 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2523/5136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:36 2022] GET /compute/v2.1/servers/f44f6684-6900-4f82-8124-a2ef0e4f8246 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:36.179378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-41170906-018d-432c-9465-0f1e2ecd901e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:36.180315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41170906-018d-432c-9465-0f1e2ecd901e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:36.205365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41170906-018d-432c-9465-0f1e2ecd901e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:36.210169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41170906-018d-432c-9465-0f1e2ecd901e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:36.218827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41170906-018d-432c-9465-0f1e2ecd901e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:36.220304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41170906-018d-432c-9465-0f1e2ecd901e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:36.693539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-41170906-018d-432c-9465-0f1e2ecd901e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:36.708822 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-41170906-018d-432c-9465-0f1e2ecd901e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.533086 Jul 26 20:11:36.711671 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2614/5137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:36 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:36.740435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f6fd0d6-07ba-4cff-9485-cbb81c92cb07 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:36.741181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f6fd0d6-07ba-4cff-9485-cbb81c92cb07 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:36.758151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f6fd0d6-07ba-4cff-9485-cbb81c92cb07 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:36.758871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f6fd0d6-07ba-4cff-9485-cbb81c92cb07 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:36.762362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f6fd0d6-07ba-4cff-9485-cbb81c92cb07 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:36.763774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f6fd0d6-07ba-4cff-9485-cbb81c92cb07 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:36.890440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-635410036", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "86abe0be-bf0c-4f2a-8383-4c5cd5d428bb"}], "key_name": "tempest-TestNetworkBasicOps-288808652", "security_groups": [{"name": "tempest-secgroup-smoke-763394073"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:37.140454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] validate_networks() for [('86abe0be-bf0c-4f2a-8383-4c5cd5d428bb', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:11:37.144839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6f6fd0d6-07ba-4cff-9485-cbb81c92cb07 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:37.178486 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f6fd0d6-07ba-4cff-9485-cbb81c92cb07 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.436414 Jul 26 20:11:37.198013 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2524/5138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:36 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:37.217835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf818f7e-d032-472c-a642-6f3dd9f103b3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:37.219452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf818f7e-d032-472c-a642-6f3dd9f103b3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:37.243381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf818f7e-d032-472c-a642-6f3dd9f103b3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:37.244440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf818f7e-d032-472c-a642-6f3dd9f103b3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:37.245637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf818f7e-d032-472c-a642-6f3dd9f103b3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:37.246453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf818f7e-d032-472c-a642-6f3dd9f103b3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:37.551046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cf818f7e-d032-472c-a642-6f3dd9f103b3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:37.562823 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf818f7e-d032-472c-a642-6f3dd9f103b3 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.358756 Jul 26 20:11:37.564067 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2525/5139] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:37 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:37.681209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e60caa46-9f90-4b06-a25f-5f43b5f70109 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1737288899", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e60caa46-9f90-4b06-a25f-5f43b5f70109 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 238 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1737288899", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1737288899', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.703353 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 20:11:37.708022 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:37.710684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e60caa46-9f90-4b06-a25f-5f43b5f70109 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:37.711808 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e60caa46-9f90-4b06-a25f-5f43b5f70109 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034492 Jul 26 20:11:37.715099 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2526/5140] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:11:37.725255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eac437dd-2d18-4a71-93f4-ea7c4c3fc76b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:37.726229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eac437dd-2d18-4a71-93f4-ea7c4c3fc76b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:37.742365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eac437dd-2d18-4a71-93f4-ea7c4c3fc76b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:37.745466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eac437dd-2d18-4a71-93f4-ea7c4c3fc76b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:37.746806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eac437dd-2d18-4a71-93f4-ea7c4c3fc76b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:37.748379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eac437dd-2d18-4a71-93f4-ea7c4c3fc76b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:37.850130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:11:37.850722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:11:37.851027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:11:37.851443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:11:37.851885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:11:37.862749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:37.863419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:37.864602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:37.865203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:37.895858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for project d237549546cf478aa27cf8759a57d4b4. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:11:37.904241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Getting quotas for user 84e081d584b34009a7bbfbc2a6c14436 and project d237549546cf478aa27cf8759a57d4b4. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:11:37.919905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:11:37.923631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:11:38.029972 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a2920986-761a-40ed-acff-7d69deda3ac3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.144644 Jul 26 20:11:38.031205 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2615/5141] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:11:38.047123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e688315-8b81-4c10-a0c7-e9991fb079eb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:38.049807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e688315-8b81-4c10-a0c7-e9991fb079eb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:38.195824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eac437dd-2d18-4a71-93f4-ea7c4c3fc76b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:38.208050 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eac437dd-2d18-4a71-93f4-ea7c4c3fc76b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.486988 Jul 26 20:11:38.208644 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2527/5142] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:37 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:38.242007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0fccd5e-7eae-4f45-a778-90e91036a48f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:38.242662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0fccd5e-7eae-4f45-a778-90e91036a48f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:38.243797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e688315-8b81-4c10-a0c7-e9991fb079eb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:38.252557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e688315-8b81-4c10-a0c7-e9991fb079eb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1247 microversion: 2.1 time: 0.213838 Jul 26 20:11:38.255115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0fccd5e-7eae-4f45-a778-90e91036a48f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:38.255586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0fccd5e-7eae-4f45-a778-90e91036a48f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:38.256624 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2616/5143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:38 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1247 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:38.261955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0fccd5e-7eae-4f45-a778-90e91036a48f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:38.262669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0fccd5e-7eae-4f45-a778-90e91036a48f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:38.585454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0fccd5e-7eae-4f45-a778-90e91036a48f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:38.586897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec580eb6-9edf-42e7-bfc4-8a2265b78c65 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:38.587750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ec580eb6-9edf-42e7-bfc4-8a2265b78c65 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:38.595431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec580eb6-9edf-42e7-bfc4-8a2265b78c65 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:38.595842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec580eb6-9edf-42e7-bfc4-8a2265b78c65 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:38.596633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec580eb6-9edf-42e7-bfc4-8a2265b78c65 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:38.597074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec580eb6-9edf-42e7-bfc4-8a2265b78c65 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:38.601467 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0fccd5e-7eae-4f45-a778-90e91036a48f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.369726 Jul 26 20:11:38.615670 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2528/5144] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:38 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:38.901198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ec580eb6-9edf-42e7-bfc4-8a2265b78c65 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:38.908682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30236375-5b7d-4d1b-ad04-d5320b7e5f75 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-718316564", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30236375-5b7d-4d1b-ad04-d5320b7e5f75 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 234 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-718316564", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-718316564', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.915189 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 20:11:38.920062 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:38.925792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30236375-5b7d-4d1b-ad04-d5320b7e5f75 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:38.926173 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ec580eb6-9edf-42e7-bfc4-8a2265b78c65 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.342977 Jul 26 20:11:38.927812 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-30236375-5b7d-4d1b-ad04-d5320b7e5f75 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025194 Jul 26 20:11:38.929354 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2529/5145] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:38 2022] POST /compute/v2.1/servers => generated 133 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:11:38.935577 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2617/5146] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:38 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:38.980366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00fd69c0-832f-4cf8-8ae3-9d6b0193e18f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:38.980996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00fd69c0-832f-4cf8-8ae3-9d6b0193e18f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:39.014029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00fd69c0-832f-4cf8-8ae3-9d6b0193e18f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.014756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00fd69c0-832f-4cf8-8ae3-9d6b0193e18f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.016533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00fd69c0-832f-4cf8-8ae3-9d6b0193e18f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.019479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00fd69c0-832f-4cf8-8ae3-9d6b0193e18f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.284416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00fd69c0-832f-4cf8-8ae3-9d6b0193e18f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:39.292073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8ecccd3a-9aac-4087-9262-f3e55750838f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:39.292710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8ecccd3a-9aac-4087-9262-f3e55750838f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:39.300281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00fd69c0-832f-4cf8-8ae3-9d6b0193e18f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.351479 Jul 26 20:11:39.301126 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2530/5147] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:38 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:39.323561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26eb9ede-3db4-4d9e-97e8-3dfad69433e1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:39.324465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-26eb9ede-3db4-4d9e-97e8-3dfad69433e1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:39.325014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ecccd3a-9aac-4087-9262-f3e55750838f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.338357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26eb9ede-3db4-4d9e-97e8-3dfad69433e1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.339946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26eb9ede-3db4-4d9e-97e8-3dfad69433e1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.341076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26eb9ede-3db4-4d9e-97e8-3dfad69433e1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.341295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ecccd3a-9aac-4087-9262-f3e55750838f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.342111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26eb9ede-3db4-4d9e-97e8-3dfad69433e1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.342233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ecccd3a-9aac-4087-9262-f3e55750838f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.342638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ecccd3a-9aac-4087-9262-f3e55750838f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.345618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:39.513051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8ecccd3a-9aac-4087-9262-f3e55750838f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:39.529843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8ecccd3a-9aac-4087-9262-f3e55750838f tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1243 microversion: 2.1 time: 0.252212 Jul 26 20:11:39.531075 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2618/5148] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:39 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1243 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:39.573596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-26eb9ede-3db4-4d9e-97e8-3dfad69433e1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:39.582956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26eb9ede-3db4-4d9e-97e8-3dfad69433e1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.263502 Jul 26 20:11:39.586007 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2531/5149] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:39 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:39.607864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dcefd19b-0321-4f09-acb9-e2b5543f95b5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:39.608647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dcefd19b-0321-4f09-acb9-e2b5543f95b5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 45a070ec-dbe8-43cb-8607-c53c6cb5a5be] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:39.619262 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-dcefd19b-0321-4f09-acb9-e2b5543f95b5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 45a070ec-dbe8-43cb-8607-c53c6cb5a5be could not be found. Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dcefd19b-0321-4f09-acb9-e2b5543f95b5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/45a070ec-dbe8-43cb-8607-c53c6cb5a5be/action HTTP/1.1 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 13 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: {"pause": {}} Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 45a070ec-dbe8-43cb-8607-c53c6cb5a5be could not be found. Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '45a070ec-dbe8-43cb-8607-c53c6cb5a5be', 'body': {'pause': {}}} Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a070ec-dbe8-43cb-8607-c53c6cb5a5be could not be found. Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a070ec-dbe8-43cb-8607-c53c6cb5a5be could not be found. Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:39.628145 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:39.632562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:39.632562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:39.632562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a070ec-dbe8-43cb-8607-c53c6cb5a5be could not be found. Jul 26 20:11:39.632562 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:39.632562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dcefd19b-0321-4f09-acb9-e2b5543f95b5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 45a070ec-dbe8-43cb-8607-c53c6cb5a5be could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:39.632562 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dcefd19b-0321-4f09-acb9-e2b5543f95b5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/45a070ec-dbe8-43cb-8607-c53c6cb5a5be/action" status: 404 len: 111 microversion: 2.1 time: 0.027597 Jul 26 20:11:39.634351 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2619/5150] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:39 2022] POST /compute/v2.1/servers/45a070ec-dbe8-43cb-8607-c53c6cb5a5be/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:39.640500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b1272570-6fab-46a1-aa37-8684e29d8e42 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:39.641702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b1272570-6fab-46a1-aa37-8684e29d8e42 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:39.649199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b1272570-6fab-46a1-aa37-8684e29d8e42 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.649647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b1272570-6fab-46a1-aa37-8684e29d8e42 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.651243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b1272570-6fab-46a1-aa37-8684e29d8e42 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.651992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b1272570-6fab-46a1-aa37-8684e29d8e42 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.943998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b1272570-6fab-46a1-aa37-8684e29d8e42 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:39.953373 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b1272570-6fab-46a1-aa37-8684e29d8e42 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.317929 Jul 26 20:11:39.954769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e2574e8-11a5-419b-9cb0-41d7f131318f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:39.955403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e2574e8-11a5-419b-9cb0-41d7f131318f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:39.959074 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2532/5151] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:39 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:39.980702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e2574e8-11a5-419b-9cb0-41d7f131318f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.981164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e2574e8-11a5-419b-9cb0-41d7f131318f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:39.985049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-04e04a1c-b5aa-442b-88fb-4d17a61493a9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:39.985879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-04e04a1c-b5aa-442b-88fb-4d17a61493a9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:39.995415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e2574e8-11a5-419b-9cb0-41d7f131318f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:39.995917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e2574e8-11a5-419b-9cb0-41d7f131318f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.001809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04e04a1c-b5aa-442b-88fb-4d17a61493a9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:40.003076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04e04a1c-b5aa-442b-88fb-4d17a61493a9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.006213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04e04a1c-b5aa-442b-88fb-4d17a61493a9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:40.007263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04e04a1c-b5aa-442b-88fb-4d17a61493a9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.434522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-04e04a1c-b5aa-442b-88fb-4d17a61493a9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:40.451513 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-04e04a1c-b5aa-442b-88fb-4d17a61493a9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.471575 Jul 26 20:11:40.460031 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2533/5152] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:39 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:40.477780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-307e7572-aa6f-48c5-8314-17adf09c9670 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:40.478320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-307e7572-aa6f-48c5-8314-17adf09c9670 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:40.492452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-307e7572-aa6f-48c5-8314-17adf09c9670 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:40.492899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-307e7572-aa6f-48c5-8314-17adf09c9670 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.493678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-307e7572-aa6f-48c5-8314-17adf09c9670 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:40.494109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-307e7572-aa6f-48c5-8314-17adf09c9670 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.546101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e2574e8-11a5-419b-9cb0-41d7f131318f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:40.554594 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e2574e8-11a5-419b-9cb0-41d7f131318f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1509 microversion: 2.1 time: 0.604187 Jul 26 20:11:40.555104 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2620/5153] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:39 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1509 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:40.582243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-658a6f66-722b-4416-954c-279f2937e6ab tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:40.584336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-658a6f66-722b-4416-954c-279f2937e6ab tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:40.601068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-658a6f66-722b-4416-954c-279f2937e6ab tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:40.601863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-658a6f66-722b-4416-954c-279f2937e6ab tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.603078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-658a6f66-722b-4416-954c-279f2937e6ab tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:40.603720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-658a6f66-722b-4416-954c-279f2937e6ab tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.628850 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-307e7572-aa6f-48c5-8314-17adf09c9670 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 202 len: 0 microversion: 2.1 time: 0.159316 Jul 26 20:11:40.632523 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2534/5154] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:40 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:11:40.664604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dbdc8fe9-d5da-408a-8c44-dce98ba0d63e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:40.665351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dbdc8fe9-d5da-408a-8c44-dce98ba0d63e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:40.692827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbdc8fe9-d5da-408a-8c44-dce98ba0d63e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:40.693288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbdc8fe9-d5da-408a-8c44-dce98ba0d63e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.694082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbdc8fe9-d5da-408a-8c44-dce98ba0d63e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:40.694519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbdc8fe9-d5da-408a-8c44-dce98ba0d63e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:40.716922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-658a6f66-722b-4416-954c-279f2937e6ab tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:40.743044 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-658a6f66-722b-4416-954c-279f2937e6ab tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1305 microversion: 2.1 time: 0.166183 Jul 26 20:11:40.750946 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2621/5155] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:40 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1305 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:41.249954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dbdc8fe9-d5da-408a-8c44-dce98ba0d63e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:41.259081 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dbdc8fe9-d5da-408a-8c44-dce98ba0d63e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1511 microversion: 2.1 time: 0.624303 Jul 26 20:11:41.264474 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2535/5156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:40 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1511 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:41.578346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-86251f14-8048-4063-9a01-ac733e4e8be0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:41.578968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-86251f14-8048-4063-9a01-ac733e4e8be0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:41.592256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86251f14-8048-4063-9a01-ac733e4e8be0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:41.592682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86251f14-8048-4063-9a01-ac733e4e8be0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:41.596161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86251f14-8048-4063-9a01-ac733e4e8be0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:41.598574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-86251f14-8048-4063-9a01-ac733e4e8be0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:41.775808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e6d326d5-a220-4165-ade9-e39db007c481 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:41.776972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e6d326d5-a220-4165-ade9-e39db007c481 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:41.787116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6d326d5-a220-4165-ade9-e39db007c481 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:41.788547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6d326d5-a220-4165-ade9-e39db007c481 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:41.790594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6d326d5-a220-4165-ade9-e39db007c481 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:41.792099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6d326d5-a220-4165-ade9-e39db007c481 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:42.117400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-86251f14-8048-4063-9a01-ac733e4e8be0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:42.131895 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-86251f14-8048-4063-9a01-ac733e4e8be0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1506 microversion: 2.1 time: 0.553187 Jul 26 20:11:42.135042 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2622/5157] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:41 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:42.267987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e6d326d5-a220-4165-ade9-e39db007c481 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:42.281000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e6d326d5-a220-4165-ade9-e39db007c481 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.509172 Jul 26 20:11:42.286390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2765b0f2-6578-40c9-8809-089ce7927156 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:42.287186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2765b0f2-6578-40c9-8809-089ce7927156 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:42.299240 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2536/5158] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:41 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:42.312293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2765b0f2-6578-40c9-8809-089ce7927156 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:42.313029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2765b0f2-6578-40c9-8809-089ce7927156 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:42.314014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2765b0f2-6578-40c9-8809-089ce7927156 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:42.314643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2765b0f2-6578-40c9-8809-089ce7927156 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:42.697228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2765b0f2-6578-40c9-8809-089ce7927156 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:42.707148 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2765b0f2-6578-40c9-8809-089ce7927156 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1491 microversion: 2.1 time: 0.425844 Jul 26 20:11:42.721776 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2623/5159] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:42 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1491 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:42.729735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:42.730604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:42.740700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:42.741615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:42.742594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:42.743239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:42.779527 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Cannot 'pause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state paused Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action HTTP/1.1 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 13 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: {"pause": {}} Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: exception: Cannot 'pause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state paused Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'pause': {}}} Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f in vm_state paused. Cannot pause while the instance is in this state. Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state paused Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:42.782459 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:42.786770 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:42.786770 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:42.786770 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:42.786770 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state paused Jul 26 20:11:42.786770 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:42.787682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 409 to user: Cannot 'pause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state paused {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:42.788518 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3d823aa-853a-46a7-9af2-04a982ce59fd tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 409 len: 143 microversion: 2.1 time: 0.063807 Jul 26 20:11:42.789516 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2537/5160] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:42 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 143 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:11:42.799667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b39cad5c-d10a-4e52-be06-86761036ba33 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:42.811191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b39cad5c-d10a-4e52-be06-86761036ba33 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:42.824796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b39cad5c-d10a-4e52-be06-86761036ba33 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:42.826325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b39cad5c-d10a-4e52-be06-86761036ba33 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:42.827447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b39cad5c-d10a-4e52-be06-86761036ba33 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:42.828402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b39cad5c-d10a-4e52-be06-86761036ba33 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:42.923391 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b39cad5c-d10a-4e52-be06-86761036ba33 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 202 len: 0 microversion: 2.1 time: 0.128433 Jul 26 20:11:42.925598 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2624/5161] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:42 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:11:42.933233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-890070e5-6ec6-4769-8af6-874339e53d04 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:42.934049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-890070e5-6ec6-4769-8af6-874339e53d04 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:42.941118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-890070e5-6ec6-4769-8af6-874339e53d04 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:42.941781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-890070e5-6ec6-4769-8af6-874339e53d04 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:42.942710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-890070e5-6ec6-4769-8af6-874339e53d04 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:42.943300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-890070e5-6ec6-4769-8af6-874339e53d04 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:43.134871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-890070e5-6ec6-4769-8af6-874339e53d04 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:43.153418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98a9998e-08ac-4e8a-84af-1c5eff594051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:43.154142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-98a9998e-08ac-4e8a-84af-1c5eff594051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:43.171558 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-890070e5-6ec6-4769-8af6-874339e53d04 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1498 microversion: 2.1 time: 0.234740 Jul 26 20:11:43.175246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:43.192392 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2538/5162] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:42 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1498 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:43.196189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98a9998e-08ac-4e8a-84af-1c5eff594051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:43.197042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98a9998e-08ac-4e8a-84af-1c5eff594051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:43.197916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98a9998e-08ac-4e8a-84af-1c5eff594051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:43.198390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98a9998e-08ac-4e8a-84af-1c5eff594051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:43.315119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97406986-86e8-47e9-a4dc-b61a5d0441a8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:43.315764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97406986-86e8-47e9-a4dc-b61a5d0441a8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:43.328742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97406986-86e8-47e9-a4dc-b61a5d0441a8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:43.329192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97406986-86e8-47e9-a4dc-b61a5d0441a8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:43.329969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97406986-86e8-47e9-a4dc-b61a5d0441a8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:43.330397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97406986-86e8-47e9-a4dc-b61a5d0441a8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:43.692077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97406986-86e8-47e9-a4dc-b61a5d0441a8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:43.701662 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97406986-86e8-47e9-a4dc-b61a5d0441a8 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.390106 Jul 26 20:11:43.716631 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2539/5163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:43 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:44.101321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-98a9998e-08ac-4e8a-84af-1c5eff594051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:44.112197 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98a9998e-08ac-4e8a-84af-1c5eff594051 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1506 microversion: 2.1 time: 0.963287 Jul 26 20:11:44.113273 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2625/5164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:43 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1506 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:44.174512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-326ebe38-a6b1-4255-809f-3e39dc11770c req-8ccf6440-421a-4d68-aef2-8f1e8b301134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5886ca74-cf72-4313-99c4-606f6d979ee0", "name": "network-vif-unplugged", "status": "completed", "tag": "332ee2fe-ce87-4b9b-8b45-c4f260acd0a0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:44.198354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e1e50709-e937-4bf4-951e-ad6baa8497e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:44.199154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e1e50709-e937-4bf4-951e-ad6baa8497e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:44.204759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-326ebe38-a6b1-4255-809f-3e39dc11770c req-8ccf6440-421a-4d68-aef2-8f1e8b301134 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:44.209566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-326ebe38-a6b1-4255-809f-3e39dc11770c req-8ccf6440-421a-4d68-aef2-8f1e8b301134 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:44.216016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1e50709-e937-4bf4-951e-ad6baa8497e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:44.218556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1e50709-e937-4bf4-951e-ad6baa8497e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:44.219703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1e50709-e937-4bf4-951e-ad6baa8497e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:44.221488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1e50709-e937-4bf4-951e-ad6baa8497e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:44.248584 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-326ebe38-a6b1-4255-809f-3e39dc11770c req-8ccf6440-421a-4d68-aef2-8f1e8b301134 service nova] Creating event network-vif-unplugged:332ee2fe-ce87-4b9b-8b45-c4f260acd0a0 for instance 5886ca74-cf72-4313-99c4-606f6d979ee0 on n-h2-708768-8 Jul 26 20:11:44.265925 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-326ebe38-a6b1-4255-809f-3e39dc11770c req-8ccf6440-421a-4d68-aef2-8f1e8b301134 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097113 Jul 26 20:11:44.266570 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2540/5165] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:11:44.282526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f0d23d8d-9b5e-4f12-9b53-0a8adf28c842 req-641741f0-afea-4a60-aa83-80ac9fea90fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84f3bbc-d80c-4e30-9f17-398e456677b6", "tag": "ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:44.323514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f0d23d8d-9b5e-4f12-9b53-0a8adf28c842 req-641741f0-afea-4a60-aa83-80ac9fea90fb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:44.339390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f0d23d8d-9b5e-4f12-9b53-0a8adf28c842 req-641741f0-afea-4a60-aa83-80ac9fea90fb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:44.375352 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f0d23d8d-9b5e-4f12-9b53-0a8adf28c842 req-641741f0-afea-4a60-aa83-80ac9fea90fb service nova] Creating event network-changed:ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8 for instance f84f3bbc-d80c-4e30-9f17-398e456677b6 on n-h1-708768-8 Jul 26 20:11:44.383890 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f0d23d8d-9b5e-4f12-9b53-0a8adf28c842 req-641741f0-afea-4a60-aa83-80ac9fea90fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107402 Jul 26 20:11:44.384669 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2541/5166] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:11:44.726824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00428afd-0468-4b81-8156-2f3457ef3cfc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:44.727827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00428afd-0468-4b81-8156-2f3457ef3cfc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:44.742736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00428afd-0468-4b81-8156-2f3457ef3cfc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:44.743428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00428afd-0468-4b81-8156-2f3457ef3cfc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:44.744251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00428afd-0468-4b81-8156-2f3457ef3cfc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:44.744723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00428afd-0468-4b81-8156-2f3457ef3cfc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:44.804672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1e50709-e937-4bf4-951e-ad6baa8497e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:44.816862 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e1e50709-e937-4bf4-951e-ad6baa8497e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.622456 Jul 26 20:11:44.821550 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2626/5167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:44 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:44.850083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-766c66b0-e9b5-4c52-810b-a82fefb2ec74 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:44.851543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-766c66b0-e9b5-4c52-810b-a82fefb2ec74 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:44.888368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-766c66b0-e9b5-4c52-810b-a82fefb2ec74 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:44.892147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-766c66b0-e9b5-4c52-810b-a82fefb2ec74 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:44.895983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-766c66b0-e9b5-4c52-810b-a82fefb2ec74 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:44.898194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-766c66b0-e9b5-4c52-810b-a82fefb2ec74 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.035681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00428afd-0468-4b81-8156-2f3457ef3cfc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:45.048306 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00428afd-0468-4b81-8156-2f3457ef3cfc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.326611 Jul 26 20:11:45.049275 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2542/5168] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:44 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:45.139359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a160ef0a-4b3f-478a-a624-144a98b5a18e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:45.140081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a160ef0a-4b3f-478a-a624-144a98b5a18e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:45.150988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a160ef0a-4b3f-478a-a624-144a98b5a18e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.151949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a160ef0a-4b3f-478a-a624-144a98b5a18e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.157603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a160ef0a-4b3f-478a-a624-144a98b5a18e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.158102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a160ef0a-4b3f-478a-a624-144a98b5a18e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.296268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-766c66b0-e9b5-4c52-810b-a82fefb2ec74 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:45.330196 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-766c66b0-e9b5-4c52-810b-a82fefb2ec74 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.485475 Jul 26 20:11:45.332948 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2627/5169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:44 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:45.358958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:45.361923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:45.378103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.378866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.380386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.382115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.426367 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3/action HTTP/1.1 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 28 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: {"reboot": {"type": "SOFT"}} Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3', 'body': {'reboot': {'type': 'SOFT'}}} Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:45.432223 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47e8e891-0997-4a97-bf0c-46db395ce26a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3/action" status: 404 len: 111 microversion: 2.1 time: 0.080555 Jul 26 20:11:45.438404 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2628/5170] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:45 2022] POST /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:45.455046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0eb31d8-7b7c-4d4f-ac95-8075fff55d72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:45.455046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0eb31d8-7b7c-4d4f-ac95-8075fff55d72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:45.475658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0eb31d8-7b7c-4d4f-ac95-8075fff55d72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.476128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0eb31d8-7b7c-4d4f-ac95-8075fff55d72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.476929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0eb31d8-7b7c-4d4f-ac95-8075fff55d72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.477376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0eb31d8-7b7c-4d4f-ac95-8075fff55d72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.480300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:45.555996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a160ef0a-4b3f-478a-a624-144a98b5a18e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:45.565507 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a160ef0a-4b3f-478a-a624-144a98b5a18e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 200 len: 1449 microversion: 2.1 time: 0.433055 Jul 26 20:11:45.570482 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2543/5171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:45 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 1449 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:45.591180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bba0419f-6088-45d6-9c32-443a76bee04f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:45.591821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bba0419f-6088-45d6-9c32-443a76bee04f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:45.612514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bba0419f-6088-45d6-9c32-443a76bee04f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.613208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bba0419f-6088-45d6-9c32-443a76bee04f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.614270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bba0419f-6088-45d6-9c32-443a76bee04f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.615187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bba0419f-6088-45d6-9c32-443a76bee04f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.758689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0eb31d8-7b7c-4d4f-ac95-8075fff55d72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:45.767919 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0eb31d8-7b7c-4d4f-ac95-8075fff55d72 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.328148 Jul 26 20:11:45.785340 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2629/5172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:45 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:45.792340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bba0419f-6088-45d6-9c32-443a76bee04f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:45.796800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-53c23e5a-b026-4d04-8250-8ab2aed05763 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:45.798423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-53c23e5a-b026-4d04-8250-8ab2aed05763 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:45.806364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53c23e5a-b026-4d04-8250-8ab2aed05763 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.807086 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bba0419f-6088-45d6-9c32-443a76bee04f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.219801 Jul 26 20:11:45.807486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53c23e5a-b026-4d04-8250-8ab2aed05763 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.808821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53c23e5a-b026-4d04-8250-8ab2aed05763 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.810235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53c23e5a-b026-4d04-8250-8ab2aed05763 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.822930 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2544/5173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:45 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:45.838115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fcbc18ba-f284-4abc-9d41-8cb63f08dba4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:45.839342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fcbc18ba-f284-4abc-9d41-8cb63f08dba4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:45.858348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcbc18ba-f284-4abc-9d41-8cb63f08dba4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.858790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcbc18ba-f284-4abc-9d41-8cb63f08dba4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:45.859580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcbc18ba-f284-4abc-9d41-8cb63f08dba4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:45.860040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcbc18ba-f284-4abc-9d41-8cb63f08dba4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.048735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-53c23e5a-b026-4d04-8250-8ab2aed05763 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:46.059004 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-53c23e5a-b026-4d04-8250-8ab2aed05763 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.267096 Jul 26 20:11:46.060183 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2630/5174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:45 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:46.076246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de35c969-fd75-41e6-a4c9-ecfe22ba0f3a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:46.076858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de35c969-fd75-41e6-a4c9-ecfe22ba0f3a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:46.096382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de35c969-fd75-41e6-a4c9-ecfe22ba0f3a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.096845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de35c969-fd75-41e6-a4c9-ecfe22ba0f3a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.097647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de35c969-fd75-41e6-a4c9-ecfe22ba0f3a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.098091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de35c969-fd75-41e6-a4c9-ecfe22ba0f3a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.109988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fcbc18ba-f284-4abc-9d41-8cb63f08dba4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:46.126471 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fcbc18ba-f284-4abc-9d41-8cb63f08dba4 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.292555 Jul 26 20:11:46.139636 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2545/5175] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:45 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:46.139636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d8ee7e1-8c09-41d1-9074-7b1d9a0b368f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:46.143230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9d8ee7e1-8c09-41d1-9074-7b1d9a0b368f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:46.150517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9d8ee7e1-8c09-41d1-9074-7b1d9a0b368f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53 could not be found. Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d8ee7e1-8c09-41d1-9074-7b1d9a0b368f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53/action HTTP/1.1 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 28 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: {"reboot": {"type": "SOFT"}} Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53 could not be found. Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53', 'body': {'reboot': {'type': 'SOFT'}}} Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53 could not be found. Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53 could not be found. Jul 26 20:11:46.152235 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53 could not be found. Jul 26 20:11:46.158231 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:46.159837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9d8ee7e1-8c09-41d1-9074-7b1d9a0b368f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:46.160897 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9d8ee7e1-8c09-41d1-9074-7b1d9a0b368f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53/action" status: 404 len: 111 microversion: 2.1 time: 0.031464 Jul 26 20:11:46.162009 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2546/5176] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:46 2022] POST /compute/v2.1/servers/1d9e5fb7-e6d2-4a4c-a519-ccb86e97de53/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:46.166878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5704183-6e68-4d38-849d-eb57f654b167 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:46.167773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5704183-6e68-4d38-849d-eb57f654b167 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:46.198338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5704183-6e68-4d38-849d-eb57f654b167 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.199301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5704183-6e68-4d38-849d-eb57f654b167 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.203026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5704183-6e68-4d38-849d-eb57f654b167 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.203478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5704183-6e68-4d38-849d-eb57f654b167 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.561458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f5704183-6e68-4d38-849d-eb57f654b167 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:46.572703 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5704183-6e68-4d38-849d-eb57f654b167 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.409326 Jul 26 20:11:46.573176 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2547/5177] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:46 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:46.589761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6bce60cb-1a4f-4812-a972-076faab282d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:46.591338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6bce60cb-1a4f-4812-a972-076faab282d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:46.608830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6bce60cb-1a4f-4812-a972-076faab282d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.609277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6bce60cb-1a4f-4812-a972-076faab282d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.610057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6bce60cb-1a4f-4812-a972-076faab282d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.610491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6bce60cb-1a4f-4812-a972-076faab282d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.626515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-de35c969-fd75-41e6-a4c9-ecfe22ba0f3a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:46.635870 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de35c969-fd75-41e6-a4c9-ecfe22ba0f3a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.563475 Jul 26 20:11:46.636459 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2631/5178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:46 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:46.651532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3b2d144a-4681-4f74-9d5b-55bddea5f146 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:46.658713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3b2d144a-4681-4f74-9d5b-55bddea5f146 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:46.670606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b2d144a-4681-4f74-9d5b-55bddea5f146 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.671322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b2d144a-4681-4f74-9d5b-55bddea5f146 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.672138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b2d144a-4681-4f74-9d5b-55bddea5f146 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.672598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b2d144a-4681-4f74-9d5b-55bddea5f146 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.876089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6bce60cb-1a4f-4812-a972-076faab282d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:46.884841 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6bce60cb-1a4f-4812-a972-076faab282d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.303053 Jul 26 20:11:46.885924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2548/5179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:46 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:46.908562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e3481e1-e343-459b-be35-6fd71fd6d75f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:46.909569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9e3481e1-e343-459b-be35-6fd71fd6d75f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:46.916754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e3481e1-e343-459b-be35-6fd71fd6d75f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.917561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e3481e1-e343-459b-be35-6fd71fd6d75f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.920525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e3481e1-e343-459b-be35-6fd71fd6d75f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:46.921243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e3481e1-e343-459b-be35-6fd71fd6d75f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:46.943185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:47.218207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3b2d144a-4681-4f74-9d5b-55bddea5f146 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:47.219090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e3481e1-e343-459b-be35-6fd71fd6d75f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:47.227911 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e3481e1-e343-459b-be35-6fd71fd6d75f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.324432 Jul 26 20:11:47.230827 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3b2d144a-4681-4f74-9d5b-55bddea5f146 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.588574 Jul 26 20:11:47.232553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2632/5180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:46 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:47.244582 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2549/5181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:46 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:47.254668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:47.257497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a92a634f-8f55-4329-b681-78ad2fe3d609 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:47.258155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:47.267969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a92a634f-8f55-4329-b681-78ad2fe3d609 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.268420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a92a634f-8f55-4329-b681-78ad2fe3d609 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.269171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.271195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.272400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.273244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.298808 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:47.299905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a92a634f-8f55-4329-b681-78ad2fe3d609 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Going to try to stop instance {{(pid=125963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3/action HTTP/1.1 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 65 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3', 'body': {'rebuild': {'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa'}}} Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 20:11:47.301999 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:11:47.306222 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:47.314093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:47.315235 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8fb49d57-dfff-4bb4-afec-6972a787b792 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3/action" status: 404 len: 111 microversion: 2.1 time: 0.069443 Jul 26 20:11:47.315571 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2633/5182] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:47 2022] POST /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:47.324077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cf41d0a8-34bf-4955-95b2-bebcd82cbbc6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:47.324605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cf41d0a8-34bf-4955-95b2-bebcd82cbbc6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:47.334040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf41d0a8-34bf-4955-95b2-bebcd82cbbc6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.334786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf41d0a8-34bf-4955-95b2-bebcd82cbbc6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.335865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf41d0a8-34bf-4955-95b2-bebcd82cbbc6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.336187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf41d0a8-34bf-4955-95b2-bebcd82cbbc6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.362965 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a92a634f-8f55-4329-b681-78ad2fe3d609 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.109846 Jul 26 20:11:47.366625 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2550/5183] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:47 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:11:47.375885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f566d322-61b4-484d-b79b-f6b9525270c0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:47.379057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f566d322-61b4-484d-b79b-f6b9525270c0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:47.386941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f566d322-61b4-484d-b79b-f6b9525270c0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.387643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f566d322-61b4-484d-b79b-f6b9525270c0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.389352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f566d322-61b4-484d-b79b-f6b9525270c0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.390331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f566d322-61b4-484d-b79b-f6b9525270c0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.594187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cf41d0a8-34bf-4955-95b2-bebcd82cbbc6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:47.602771 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cf41d0a8-34bf-4955-95b2-bebcd82cbbc6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.282551 Jul 26 20:11:47.615676 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2634/5184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:47 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:47.635511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cc16e817-b11a-4a10-919b-f0c5d567c97c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:47.636356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc16e817-b11a-4a10-919b-f0c5d567c97c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:47.643574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc16e817-b11a-4a10-919b-f0c5d567c97c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.644047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc16e817-b11a-4a10-919b-f0c5d567c97c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.644830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc16e817-b11a-4a10-919b-f0c5d567c97c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.657724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc16e817-b11a-4a10-919b-f0c5d567c97c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.678941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f566d322-61b4-484d-b79b-f6b9525270c0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:47.689942 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f566d322-61b4-484d-b79b-f6b9525270c0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.319136 Jul 26 20:11:47.692482 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2551/5185] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:47 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:47.708613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bdd9307f-e212-499d-840f-87aa791ddceb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:47.709806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bdd9307f-e212-499d-840f-87aa791ddceb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:47.729372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdd9307f-e212-499d-840f-87aa791ddceb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.735272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdd9307f-e212-499d-840f-87aa791ddceb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.736323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdd9307f-e212-499d-840f-87aa791ddceb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:47.736945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdd9307f-e212-499d-840f-87aa791ddceb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:47.877306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:48.016395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cc16e817-b11a-4a10-919b-f0c5d567c97c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:48.029226 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cc16e817-b11a-4a10-919b-f0c5d567c97c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.399642 Jul 26 20:11:48.036513 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2635/5186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:47 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:48.054384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98a06098-9ea5-4fb9-97a0-b6104774d1a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:48.057448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-98a06098-9ea5-4fb9-97a0-b6104774d1a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 46402e17-b311-459d-9372-95e9930aa898] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:48.077914 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-98a06098-9ea5-4fb9-97a0-b6104774d1a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 46402e17-b311-459d-9372-95e9930aa898 could not be found. Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98a06098-9ea5-4fb9-97a0-b6104774d1a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/46402e17-b311-459d-9372-95e9930aa898/action HTTP/1.1 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 65 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 46402e17-b311-459d-9372-95e9930aa898 could not be found. Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '46402e17-b311-459d-9372-95e9930aa898', 'body': {'rebuild': {'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa'}}} Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46402e17-b311-459d-9372-95e9930aa898 could not be found. Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 20:11:48.079949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46402e17-b311-459d-9372-95e9930aa898 could not be found. Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46402e17-b311-459d-9372-95e9930aa898 could not be found. Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.085453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98a06098-9ea5-4fb9-97a0-b6104774d1a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 46402e17-b311-459d-9372-95e9930aa898 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:48.092885 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98a06098-9ea5-4fb9-97a0-b6104774d1a6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/46402e17-b311-459d-9372-95e9930aa898/action" status: 404 len: 111 microversion: 2.1 time: 0.040516 Jul 26 20:11:48.093670 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2636/5187] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:48 2022] POST /compute/v2.1/servers/46402e17-b311-459d-9372-95e9930aa898/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:11:48.105665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99e05a6f-4f0b-4560-9bf1-401df01d7da9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:48.109210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-99e05a6f-4f0b-4560-9bf1-401df01d7da9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:48.116020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bdd9307f-e212-499d-840f-87aa791ddceb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:48.121641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99e05a6f-4f0b-4560-9bf1-401df01d7da9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:48.122885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99e05a6f-4f0b-4560-9bf1-401df01d7da9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:48.123997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99e05a6f-4f0b-4560-9bf1-401df01d7da9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:48.124652 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bdd9307f-e212-499d-840f-87aa791ddceb tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.431104 Jul 26 20:11:48.124891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99e05a6f-4f0b-4560-9bf1-401df01d7da9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:48.125380 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2552/5188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:47 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:48.250654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=12 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:48.470788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-99e05a6f-4f0b-4560-9bf1-401df01d7da9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:48.482443 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-99e05a6f-4f0b-4560-9bf1-401df01d7da9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.380312 Jul 26 20:11:48.483446 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2637/5189] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:48 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:48.509952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42eaf9f1-b732-410d-b473-e3555c7ffef7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:48.511653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-42eaf9f1-b732-410d-b473-e3555c7ffef7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:48.520595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42eaf9f1-b732-410d-b473-e3555c7ffef7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:48.521223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42eaf9f1-b732-410d-b473-e3555c7ffef7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:48.522161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42eaf9f1-b732-410d-b473-e3555c7ffef7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:48.522754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42eaf9f1-b732-410d-b473-e3555c7ffef7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:48.715052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c95b5a2-c55c-40fd-b7e4-6205bb9fff5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:48.717298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3c95b5a2-c55c-40fd-b7e4-6205bb9fff5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:48.733150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c95b5a2-c55c-40fd-b7e4-6205bb9fff5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:48.738475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c95b5a2-c55c-40fd-b7e4-6205bb9fff5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:48.741044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c95b5a2-c55c-40fd-b7e4-6205bb9fff5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:48.741648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c95b5a2-c55c-40fd-b7e4-6205bb9fff5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:48.833389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-42eaf9f1-b732-410d-b473-e3555c7ffef7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:48.846510 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-42eaf9f1-b732-410d-b473-e3555c7ffef7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.343680 Jul 26 20:11:48.869477 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2553/5190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:48 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:48.897550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-700416bc-f2c5-4a92-a83e-134318231dd0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:48.898150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-700416bc-f2c5-4a92-a83e-134318231dd0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: a07fd8b7-bd53-40d8-84a7-9569eb0b053c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:48.904659 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-700416bc-f2c5-4a92-a83e-134318231dd0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance a07fd8b7-bd53-40d8-84a7-9569eb0b053c could not be found. Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-700416bc-f2c5-4a92-a83e-134318231dd0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/a07fd8b7-bd53-40d8-84a7-9569eb0b053c/action HTTP/1.1 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 15 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: {"restore": {}} Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance a07fd8b7-bd53-40d8-84a7-9569eb0b053c could not be found. Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a07fd8b7-bd53-40d8-84a7-9569eb0b053c', 'body': {'restore': {}}} Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07fd8b7-bd53-40d8-84a7-9569eb0b053c could not be found. Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07fd8b7-bd53-40d8-84a7-9569eb0b053c could not be found. Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:48.906479 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:48.910907 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:48.910907 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:48.910907 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07fd8b7-bd53-40d8-84a7-9569eb0b053c could not be found. Jul 26 20:11:48.910907 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:48.915085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-700416bc-f2c5-4a92-a83e-134318231dd0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance a07fd8b7-bd53-40d8-84a7-9569eb0b053c could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:48.916000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-700416bc-f2c5-4a92-a83e-134318231dd0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/a07fd8b7-bd53-40d8-84a7-9569eb0b053c/action" status: 404 len: 111 microversion: 2.1 time: 0.029565 Jul 26 20:11:48.919298 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2554/5191] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:48 2022] POST /compute/v2.1/servers/a07fd8b7-bd53-40d8-84a7-9569eb0b053c/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:48.944106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0227cbb-9568-4b02-a0b7-4f79f6fee97f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:48.944722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a0227cbb-9568-4b02-a0b7-4f79f6fee97f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:48.963474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0227cbb-9568-4b02-a0b7-4f79f6fee97f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:48.963973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0227cbb-9568-4b02-a0b7-4f79f6fee97f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:48.964749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0227cbb-9568-4b02-a0b7-4f79f6fee97f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:48.965184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0227cbb-9568-4b02-a0b7-4f79f6fee97f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.111153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a0227cbb-9568-4b02-a0b7-4f79f6fee97f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:49.119638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0227cbb-9568-4b02-a0b7-4f79f6fee97f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.191581 Jul 26 20:11:49.123659 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2555/5192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:48 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:49.145880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-17073f26-4b46-4d25-8f64-9609005f6a50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:49.148612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-17073f26-4b46-4d25-8f64-9609005f6a50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:49.168750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c95b5a2-c55c-40fd-b7e4-6205bb9fff5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:49.181757 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c95b5a2-c55c-40fd-b7e4-6205bb9fff5e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.469907 Jul 26 20:11:49.182553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2638/5193] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:48 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:49.196126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17073f26-4b46-4d25-8f64-9609005f6a50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:49.196575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17073f26-4b46-4d25-8f64-9609005f6a50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.197353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17073f26-4b46-4d25-8f64-9609005f6a50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:49.197777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17073f26-4b46-4d25-8f64-9609005f6a50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.199575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02e979be-1352-4d8b-afbd-7b61fb77e8b3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:49.201109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02e979be-1352-4d8b-afbd-7b61fb77e8b3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:49.222422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02e979be-1352-4d8b-afbd-7b61fb77e8b3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:49.222768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02e979be-1352-4d8b-afbd-7b61fb77e8b3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.223583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02e979be-1352-4d8b-afbd-7b61fb77e8b3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:49.224048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02e979be-1352-4d8b-afbd-7b61fb77e8b3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.503084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-17073f26-4b46-4d25-8f64-9609005f6a50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:49.514737 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-17073f26-4b46-4d25-8f64-9609005f6a50 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.374623 Jul 26 20:11:49.515926 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2556/5194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:49 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:49.572206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:49.574395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:49.578886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02e979be-1352-4d8b-afbd-7b61fb77e8b3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:49.590340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:49.592252 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02e979be-1352-4d8b-afbd-7b61fb77e8b3 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.405779 Jul 26 20:11:49.592856 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2639/5195] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:49 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:49.600719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.603902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:49.605664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.666914 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Cannot 'restore' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action HTTP/1.1 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 15 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: {"restore": {}} Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: exception: Cannot 'restore' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'restore': {}}} Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f in vm_state active. Cannot restore while the instance is in this state. Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:49.668490 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:49.676491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:49.676491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:49.676491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:49.676491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:11:49.676491 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:49.676491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 409 to user: Cannot 'restore' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:49.676491 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-46e5096d-76fd-47ce-b51b-4c02b6f744de tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 409 len: 145 microversion: 2.1 time: 0.133344 Jul 26 20:11:49.682525 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2557/5196] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:49 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 145 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:11:49.686203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1dd1fef5-92e3-4cfe-91d1-42a2ac1d71d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:49.686843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1dd1fef5-92e3-4cfe-91d1-42a2ac1d71d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:49.698275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dd1fef5-92e3-4cfe-91d1-42a2ac1d71d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:49.698739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dd1fef5-92e3-4cfe-91d1-42a2ac1d71d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.699543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dd1fef5-92e3-4cfe-91d1-42a2ac1d71d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:49.700023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dd1fef5-92e3-4cfe-91d1-42a2ac1d71d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:49.960593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1dd1fef5-92e3-4cfe-91d1-42a2ac1d71d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:49.982546 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1dd1fef5-92e3-4cfe-91d1-42a2ac1d71d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.300415 Jul 26 20:11:49.984152 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2640/5197] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:49 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:50.008031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-04c5e357-ea20-4a1d-8faa-d86dc268d82a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:50.008686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-04c5e357-ea20-4a1d-8faa-d86dc268d82a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:50.019749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04c5e357-ea20-4a1d-8faa-d86dc268d82a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.020334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04c5e357-ea20-4a1d-8faa-d86dc268d82a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.023698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04c5e357-ea20-4a1d-8faa-d86dc268d82a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.028890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04c5e357-ea20-4a1d-8faa-d86dc268d82a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.220860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c895b6f-496a-489c-94a3-b98d902f6747 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:50.222572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c895b6f-496a-489c-94a3-b98d902f6747 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:50.238836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c895b6f-496a-489c-94a3-b98d902f6747 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.242307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c895b6f-496a-489c-94a3-b98d902f6747 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.244707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c895b6f-496a-489c-94a3-b98d902f6747 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.246218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c895b6f-496a-489c-94a3-b98d902f6747 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.411595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-04c5e357-ea20-4a1d-8faa-d86dc268d82a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:50.425372 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-04c5e357-ea20-4a1d-8faa-d86dc268d82a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.421199 Jul 26 20:11:50.428627 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2558/5198] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:50 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:50.447763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0fb18bc-ab03-4f64-a682-3b0b05580a30 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:50.448374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c0fb18bc-ab03-4f64-a682-3b0b05580a30 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 3f0705c6-14a4-414e-8e44-801de0c24177] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:50.476106 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c0fb18bc-ab03-4f64-a682-3b0b05580a30 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 3f0705c6-14a4-414e-8e44-801de0c24177 could not be found. Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0fb18bc-ab03-4f64-a682-3b0b05580a30 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/3f0705c6-14a4-414e-8e44-801de0c24177/action HTTP/1.1 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 14 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: {"resume": {}} Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 3f0705c6-14a4-414e-8e44-801de0c24177 could not be found. Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '3f0705c6-14a4-414e-8e44-801de0c24177', 'body': {'resume': {}}} Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0705c6-14a4-414e-8e44-801de0c24177 could not be found. Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0705c6-14a4-414e-8e44-801de0c24177 could not be found. Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:50.482934 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:50.490278 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:50.490278 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:50.490278 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0705c6-14a4-414e-8e44-801de0c24177 could not be found. Jul 26 20:11:50.490278 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:50.490278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0fb18bc-ab03-4f64-a682-3b0b05580a30 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 3f0705c6-14a4-414e-8e44-801de0c24177 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:50.490278 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c0fb18bc-ab03-4f64-a682-3b0b05580a30 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/3f0705c6-14a4-414e-8e44-801de0c24177/action" status: 404 len: 111 microversion: 2.1 time: 0.040698 Jul 26 20:11:50.492466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2559/5199] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:50 2022] POST /compute/v2.1/servers/3f0705c6-14a4-414e-8e44-801de0c24177/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:50.501925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-078ce717-b611-4483-99a8-35143203fec3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:50.502535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-078ce717-b611-4483-99a8-35143203fec3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:50.529871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-078ce717-b611-4483-99a8-35143203fec3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.531525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-078ce717-b611-4483-99a8-35143203fec3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.537482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-078ce717-b611-4483-99a8-35143203fec3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.537936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-078ce717-b611-4483-99a8-35143203fec3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.553332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9c895b6f-496a-489c-94a3-b98d902f6747 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:50.565528 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c895b6f-496a-489c-94a3-b98d902f6747 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.360020 Jul 26 20:11:50.569200 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2641/5200] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:50 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:50.615755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce908881-4889-4afd-8ee2-c012395cc994 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:50.616671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ce908881-4889-4afd-8ee2-c012395cc994 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:50.629693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce908881-4889-4afd-8ee2-c012395cc994 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.630148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce908881-4889-4afd-8ee2-c012395cc994 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.630962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce908881-4889-4afd-8ee2-c012395cc994 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.631396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce908881-4889-4afd-8ee2-c012395cc994 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.851725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-078ce717-b611-4483-99a8-35143203fec3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:50.862654 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-078ce717-b611-4483-99a8-35143203fec3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.369047 Jul 26 20:11:50.873074 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2560/5201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:50 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:50.889778 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b5116442-b13d-4374-a26a-f88fd76e42d6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:50.890753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b5116442-b13d-4374-a26a-f88fd76e42d6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:50.896317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ce908881-4889-4afd-8ee2-c012395cc994 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:50.906567 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce908881-4889-4afd-8ee2-c012395cc994 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.296161 Jul 26 20:11:50.907234 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2642/5202] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:50 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:50.909473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5116442-b13d-4374-a26a-f88fd76e42d6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.911123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5116442-b13d-4374-a26a-f88fd76e42d6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:50.913512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5116442-b13d-4374-a26a-f88fd76e42d6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:50.914523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5116442-b13d-4374-a26a-f88fd76e42d6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.104916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5116442-b13d-4374-a26a-f88fd76e42d6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:51.113800 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b5116442-b13d-4374-a26a-f88fd76e42d6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.230714 Jul 26 20:11:51.114690 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2561/5203] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:50 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:51.136213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:51.137303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:51.155969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.156540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.157377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.157828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.189177 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Cannot 'resume' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action HTTP/1.1 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 14 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: {"resume": {}} Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'resume' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'resume': {}}} Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f in vm_state active. Cannot resume while the instance is in this state. Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:51.191109 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:51.195654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:51.195654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:51.195654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:51.195654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:11:51.195654 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:11:51.197613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 409 to user: Cannot 'resume' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:51.198914 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c88ae3be-307a-4492-8638-3c364f561275 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 409 len: 144 microversion: 2.1 time: 0.066785 Jul 26 20:11:51.203174 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2643/5204] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:51 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 144 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:11:51.210538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d6106c6e-55c4-4542-8635-afc4c8f228b6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:51.211553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d6106c6e-55c4-4542-8635-afc4c8f228b6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:51.226909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6106c6e-55c4-4542-8635-afc4c8f228b6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.227632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6106c6e-55c4-4542-8635-afc4c8f228b6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.229029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6106c6e-55c4-4542-8635-afc4c8f228b6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.229764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d6106c6e-55c4-4542-8635-afc4c8f228b6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.411088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d6106c6e-55c4-4542-8635-afc4c8f228b6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:51.419197 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d6106c6e-55c4-4542-8635-afc4c8f228b6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.214576 Jul 26 20:11:51.423752 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2562/5205] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:51 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:51.442056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c621fb3c-f221-480c-8edb-e68a67037960 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:51.442635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c621fb3c-f221-480c-8edb-e68a67037960 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:51.467156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c621fb3c-f221-480c-8edb-e68a67037960 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.467836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c621fb3c-f221-480c-8edb-e68a67037960 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.470215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c621fb3c-f221-480c-8edb-e68a67037960 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.474307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c621fb3c-f221-480c-8edb-e68a67037960 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.598913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08b5f346-2f5c-4098-9098-cce25b588e4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:51.599686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08b5f346-2f5c-4098-9098-cce25b588e4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:51.615510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08b5f346-2f5c-4098-9098-cce25b588e4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.618998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08b5f346-2f5c-4098-9098-cce25b588e4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.620067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08b5f346-2f5c-4098-9098-cce25b588e4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.620531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08b5f346-2f5c-4098-9098-cce25b588e4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.845526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c621fb3c-f221-480c-8edb-e68a67037960 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:51.876387 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c621fb3c-f221-480c-8edb-e68a67037960 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.439094 Jul 26 20:11:51.880661 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2644/5206] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:51 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:51.930215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ccdccb6-cd83-472c-8ac4-8dc3aa84a609 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:51.932228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ccdccb6-cd83-472c-8ac4-8dc3aa84a609 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:51.948364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ccdccb6-cd83-472c-8ac4-8dc3aa84a609 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.949083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ccdccb6-cd83-472c-8ac4-8dc3aa84a609 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:51.955859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ccdccb6-cd83-472c-8ac4-8dc3aa84a609 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:51.957679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ccdccb6-cd83-472c-8ac4-8dc3aa84a609 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:52.005550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-08b5f346-2f5c-4098-9098-cce25b588e4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:52.025214 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08b5f346-2f5c-4098-9098-cce25b588e4c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.428559 Jul 26 20:11:52.031962 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2563/5207] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:51 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:52.051755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3e54a898-e4d7-487a-a86a-02686b9a0a38 req-0b525ff4-ca76-4f89-970c-05cb2368e408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84f3bbc-d80c-4e30-9f17-398e456677b6", "name": "network-vif-plugged", "status": "completed", "tag": "ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:52.097181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3e54a898-e4d7-487a-a86a-02686b9a0a38 req-0b525ff4-ca76-4f89-970c-05cb2368e408 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:52.098662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3e54a898-e4d7-487a-a86a-02686b9a0a38 req-0b525ff4-ca76-4f89-970c-05cb2368e408 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:52.134048 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3e54a898-e4d7-487a-a86a-02686b9a0a38 req-0b525ff4-ca76-4f89-970c-05cb2368e408 service nova] Creating event network-vif-plugged:ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8 for instance f84f3bbc-d80c-4e30-9f17-398e456677b6 on n-h1-708768-8 Jul 26 20:11:52.150222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3e54a898-e4d7-487a-a86a-02686b9a0a38 req-0b525ff4-ca76-4f89-970c-05cb2368e408 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113453 Jul 26 20:11:52.176391 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2564/5208] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:11:52.227451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d523acf4-bc53-47d8-a130-fa2a91cbb1e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d523acf4-bc53-47d8-a130-fa2a91cbb1e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 160 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: {"server": {"name": "", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "7cda145a-7c15-4529-b4ae-fda552c43889"}]}} Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd3881918-9bf6-46c2-abd0-edc31f73f7fa', 'flavorRef': '452', 'networks': [{'uuid': '7cda145a-7c15-4529-b4ae-fda552c43889'}]}}} Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi '' Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:11:52.240814 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d523acf4-bc53-47d8-a130-fa2a91cbb1e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d523acf4-bc53-47d8-a130-fa2a91cbb1e9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.020701 Jul 26 20:11:52.246126 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2565/5209] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:11:52 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:11:52.253723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-079351d9-eaf7-4bc9-a8fe-582f13f6d9d2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:52.255952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-079351d9-eaf7-4bc9-a8fe-582f13f6d9d2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:52.264073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-079351d9-eaf7-4bc9-a8fe-582f13f6d9d2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:52.264842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-079351d9-eaf7-4bc9-a8fe-582f13f6d9d2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:52.265852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-079351d9-eaf7-4bc9-a8fe-582f13f6d9d2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:52.266515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-079351d9-eaf7-4bc9-a8fe-582f13f6d9d2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:52.406055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ccdccb6-cd83-472c-8ac4-8dc3aa84a609 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:52.418377 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ccdccb6-cd83-472c-8ac4-8dc3aa84a609 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.491886 Jul 26 20:11:52.432376 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2645/5210] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:51 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:52.488529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-079351d9-eaf7-4bc9-a8fe-582f13f6d9d2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:52.500976 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-079351d9-eaf7-4bc9-a8fe-582f13f6d9d2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.248585 Jul 26 20:11:52.501608 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2566/5211] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:52 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:52.530406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9f1fb94-424f-4336-95f1-35a6fe4000f2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:52.537409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9f1fb94-424f-4336-95f1-35a6fe4000f2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:52.551704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9f1fb94-424f-4336-95f1-35a6fe4000f2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:52.553230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9f1fb94-424f-4336-95f1-35a6fe4000f2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:52.555739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9f1fb94-424f-4336-95f1-35a6fe4000f2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:52.557425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9f1fb94-424f-4336-95f1-35a6fe4000f2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:52.832176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9f1fb94-424f-4336-95f1-35a6fe4000f2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:52.843971 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9f1fb94-424f-4336-95f1-35a6fe4000f2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.320722 Jul 26 20:11:52.847724 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2646/5212] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:52 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:52.870500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b34a36b-73bd-4f33-8ff5-9b6a0e3aa22d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:52.871190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b34a36b-73bd-4f33-8ff5-9b6a0e3aa22d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 24dfd957-2520-427d-937b-7408bc3f9cca] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:52.878978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2b34a36b-73bd-4f33-8ff5-9b6a0e3aa22d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 24dfd957-2520-427d-937b-7408bc3f9cca could not be found. Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b34a36b-73bd-4f33-8ff5-9b6a0e3aa22d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/24dfd957-2520-427d-937b-7408bc3f9cca/action HTTP/1.1 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 14 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: {"shelve": {}} Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 24dfd957-2520-427d-937b-7408bc3f9cca could not be found. Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '24dfd957-2520-427d-937b-7408bc3f9cca', 'body': {'shelve': {}}} Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24dfd957-2520-427d-937b-7408bc3f9cca could not be found. Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24dfd957-2520-427d-937b-7408bc3f9cca could not be found. Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:11:52.881605 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:11:52.886114 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:11:52.886114 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:11:52.886114 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24dfd957-2520-427d-937b-7408bc3f9cca could not be found. Jul 26 20:11:52.886114 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:11:52.886114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b34a36b-73bd-4f33-8ff5-9b6a0e3aa22d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 24dfd957-2520-427d-937b-7408bc3f9cca could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:11:52.886114 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b34a36b-73bd-4f33-8ff5-9b6a0e3aa22d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/24dfd957-2520-427d-937b-7408bc3f9cca/action" status: 404 len: 111 microversion: 2.1 time: 0.019434 Jul 26 20:11:52.896152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23828b73-f908-43dd-bb8f-301b465b3790 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:52.896705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-23828b73-f908-43dd-bb8f-301b465b3790 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:52.904450 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2567/5213] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:52 2022] POST /compute/v2.1/servers/24dfd957-2520-427d-937b-7408bc3f9cca/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:11:52.908438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23828b73-f908-43dd-bb8f-301b465b3790 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:52.908894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23828b73-f908-43dd-bb8f-301b465b3790 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:52.909688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23828b73-f908-43dd-bb8f-301b465b3790 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:52.910183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23828b73-f908-43dd-bb8f-301b465b3790 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.055515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c01437a-4c12-42b4-9871-4ba8db09f93c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:53.056169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6c01437a-4c12-42b4-9871-4ba8db09f93c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:53.069377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c01437a-4c12-42b4-9871-4ba8db09f93c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:53.070077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c01437a-4c12-42b4-9871-4ba8db09f93c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.071023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c01437a-4c12-42b4-9871-4ba8db09f93c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:53.072922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c01437a-4c12-42b4-9871-4ba8db09f93c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.133329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-23828b73-f908-43dd-bb8f-301b465b3790 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:53.144830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:53.148143 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23828b73-f908-43dd-bb8f-301b465b3790 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.256360 Jul 26 20:11:53.167795 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2647/5214] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:52 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:53.175978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df7f8b70-0728-4d1e-bc30-9e623e4fdd01 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:53.176829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df7f8b70-0728-4d1e-bc30-9e623e4fdd01 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:53.187195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df7f8b70-0728-4d1e-bc30-9e623e4fdd01 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:53.188577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df7f8b70-0728-4d1e-bc30-9e623e4fdd01 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.189907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df7f8b70-0728-4d1e-bc30-9e623e4fdd01 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:53.190502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df7f8b70-0728-4d1e-bc30-9e623e4fdd01 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.312198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c01437a-4c12-42b4-9871-4ba8db09f93c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:53.322407 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c01437a-4c12-42b4-9871-4ba8db09f93c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.270916 Jul 26 20:11:53.323637 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2568/5215] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:53 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:53.450687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82e33db7-4f1d-4b34-895b-3a9c29b2cc59 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:53.451595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-82e33db7-4f1d-4b34-895b-3a9c29b2cc59 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:53.457981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82e33db7-4f1d-4b34-895b-3a9c29b2cc59 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:53.458677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82e33db7-4f1d-4b34-895b-3a9c29b2cc59 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.459696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82e33db7-4f1d-4b34-895b-3a9c29b2cc59 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:53.460421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82e33db7-4f1d-4b34-895b-3a9c29b2cc59 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.516383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-df7f8b70-0728-4d1e-bc30-9e623e4fdd01 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:53.534294 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df7f8b70-0728-4d1e-bc30-9e623e4fdd01 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.363894 Jul 26 20:11:53.534984 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2648/5216] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:53 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:53.558159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38d639e0-838c-4ed3-ad3e-b3bbef38541e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:53.559400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38d639e0-838c-4ed3-ad3e-b3bbef38541e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:53.566602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38d639e0-838c-4ed3-ad3e-b3bbef38541e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:53.567548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38d639e0-838c-4ed3-ad3e-b3bbef38541e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.568614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38d639e0-838c-4ed3-ad3e-b3bbef38541e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:53.569408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38d639e0-838c-4ed3-ad3e-b3bbef38541e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:53.639844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-38d639e0-838c-4ed3-ad3e-b3bbef38541e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lazy-loading 'flavor' on Instance uuid 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:11:53.823361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-82e33db7-4f1d-4b34-895b-3a9c29b2cc59 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:53.836791 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-82e33db7-4f1d-4b34-895b-3a9c29b2cc59 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1372 microversion: 2.1 time: 0.395526 Jul 26 20:11:53.852183 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2569/5217] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:53 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1372 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:54.040917 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38d639e0-838c-4ed3-ad3e-b3bbef38541e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 202 len: 0 microversion: 2.1 time: 0.486545 Jul 26 20:11:54.044463 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2649/5218] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:53 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:11:54.056415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fb83ea90-af63-46f7-adee-03789a0bc20c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:54.060193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fb83ea90-af63-46f7-adee-03789a0bc20c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:54.073308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb83ea90-af63-46f7-adee-03789a0bc20c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:54.074200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb83ea90-af63-46f7-adee-03789a0bc20c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:54.075847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb83ea90-af63-46f7-adee-03789a0bc20c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:54.076551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fb83ea90-af63-46f7-adee-03789a0bc20c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:54.081617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:54.263798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fb83ea90-af63-46f7-adee-03789a0bc20c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:54.272345 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fb83ea90-af63-46f7-adee-03789a0bc20c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 0.223098 Jul 26 20:11:54.273635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2570/5219] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:54 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:54.347216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f421b54e-77d0-4c79-bcb6-cb34211ff53b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:54.347977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f421b54e-77d0-4c79-bcb6-cb34211ff53b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:54.358900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f421b54e-77d0-4c79-bcb6-cb34211ff53b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:54.359353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f421b54e-77d0-4c79-bcb6-cb34211ff53b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:54.360168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f421b54e-77d0-4c79-bcb6-cb34211ff53b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:54.360918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f421b54e-77d0-4c79-bcb6-cb34211ff53b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:54.600648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f421b54e-77d0-4c79-bcb6-cb34211ff53b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:54.609225 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f421b54e-77d0-4c79-bcb6-cb34211ff53b tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.266667 Jul 26 20:11:54.623537 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2650/5220] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:54 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:54.863510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e08cb84-9600-4124-8f42-8ace6076ee33 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:54.864260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e08cb84-9600-4124-8f42-8ace6076ee33 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:54.868135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:11:54.886482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e08cb84-9600-4124-8f42-8ace6076ee33 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:54.886949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e08cb84-9600-4124-8f42-8ace6076ee33 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:54.888584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e08cb84-9600-4124-8f42-8ace6076ee33 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:54.889090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e08cb84-9600-4124-8f42-8ace6076ee33 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:55.065165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e08cb84-9600-4124-8f42-8ace6076ee33 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:55.084366 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e08cb84-9600-4124-8f42-8ace6076ee33 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1543 microversion: 2.1 time: 0.217857 Jul 26 20:11:55.085039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2571/5221] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:54 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1543 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:55.105339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1dcd8798-ec0b-409c-930f-fb4d49c45249 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:55.105954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1dcd8798-ec0b-409c-930f-fb4d49c45249 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:55.128114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dcd8798-ec0b-409c-930f-fb4d49c45249 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:55.128571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dcd8798-ec0b-409c-930f-fb4d49c45249 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:55.129365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dcd8798-ec0b-409c-930f-fb4d49c45249 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:55.129803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dcd8798-ec0b-409c-930f-fb4d49c45249 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:55.294796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad6a7a84-6081-4739-8829-c28ac6814900 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:55.295554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ad6a7a84-6081-4739-8829-c28ac6814900 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:55.305729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad6a7a84-6081-4739-8829-c28ac6814900 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:55.308713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad6a7a84-6081-4739-8829-c28ac6814900 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:55.312666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad6a7a84-6081-4739-8829-c28ac6814900 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:55.313469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad6a7a84-6081-4739-8829-c28ac6814900 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:55.347331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1dcd8798-ec0b-409c-930f-fb4d49c45249 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:55.356227 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1dcd8798-ec0b-409c-930f-fb4d49c45249 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1543 microversion: 2.1 time: 0.254895 Jul 26 20:11:55.358257 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2651/5222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:55 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1543 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:55.585695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ad6a7a84-6081-4739-8829-c28ac6814900 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:55.597731 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ad6a7a84-6081-4739-8829-c28ac6814900 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 0.307404 Jul 26 20:11:55.598960 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2572/5223] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:55 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:55.630830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-868e93ce-6031-4f81-982c-380d51d5aa9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:55.632204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-868e93ce-6031-4f81-982c-380d51d5aa9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:55.646030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868e93ce-6031-4f81-982c-380d51d5aa9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:55.647051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868e93ce-6031-4f81-982c-380d51d5aa9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:55.650267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868e93ce-6031-4f81-982c-380d51d5aa9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:55.650870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-868e93ce-6031-4f81-982c-380d51d5aa9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:55.972460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-868e93ce-6031-4f81-982c-380d51d5aa9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:55.983157 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-868e93ce-6031-4f81-982c-380d51d5aa9a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.356349 Jul 26 20:11:55.984334 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2652/5224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:55 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:56.623732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45367e84-4a84-4a12-84ce-d740a2c8f85c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:56.624523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-45367e84-4a84-4a12-84ce-d740a2c8f85c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:56.640628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45367e84-4a84-4a12-84ce-d740a2c8f85c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:56.641259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45367e84-4a84-4a12-84ce-d740a2c8f85c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:56.642197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45367e84-4a84-4a12-84ce-d740a2c8f85c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:56.643884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45367e84-4a84-4a12-84ce-d740a2c8f85c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:57.005762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-45367e84-4a84-4a12-84ce-d740a2c8f85c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:57.008251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba71d167-60a5-440c-bf4d-d7b9bccb3f60 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:57.009787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba71d167-60a5-440c-bf4d-d7b9bccb3f60 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:57.032056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba71d167-60a5-440c-bf4d-d7b9bccb3f60 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:57.033588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba71d167-60a5-440c-bf4d-d7b9bccb3f60 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:57.034663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba71d167-60a5-440c-bf4d-d7b9bccb3f60 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:57.035462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba71d167-60a5-440c-bf4d-d7b9bccb3f60 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:57.046614 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45367e84-4a84-4a12-84ce-d740a2c8f85c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 0.428030 Jul 26 20:11:57.048828 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2573/5225] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:56 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:57.624825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba71d167-60a5-440c-bf4d-d7b9bccb3f60 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:57.633553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba71d167-60a5-440c-bf4d-d7b9bccb3f60 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1680 microversion: 2.1 time: 0.631729 Jul 26 20:11:57.635820 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2653/5226] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:57 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1680 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:58.072184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e9bc58c-f940-4a7a-ac4d-b615135e0495 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:58.072968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2e9bc58c-f940-4a7a-ac4d-b615135e0495 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:58.096314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e9bc58c-f940-4a7a-ac4d-b615135e0495 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:58.096908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e9bc58c-f940-4a7a-ac4d-b615135e0495 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:58.098992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e9bc58c-f940-4a7a-ac4d-b615135e0495 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:58.099565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e9bc58c-f940-4a7a-ac4d-b615135e0495 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:58.559578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e9bc58c-f940-4a7a-ac4d-b615135e0495 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:58.567756 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e9bc58c-f940-4a7a-ac4d-b615135e0495 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 0.501145 Jul 26 20:11:58.580017 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2574/5227] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:58 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:11:58.602120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9aa82572-2bdf-4613-9b53-06afc5f5c3a9 req-5a5286ff-8b4a-40db-8842-5263062e5654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84f3bbc-d80c-4e30-9f17-398e456677b6", "tag": "ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:58.632224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9aa82572-2bdf-4613-9b53-06afc5f5c3a9 req-5a5286ff-8b4a-40db-8842-5263062e5654 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:58.634155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9aa82572-2bdf-4613-9b53-06afc5f5c3a9 req-5a5286ff-8b4a-40db-8842-5263062e5654 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:58.657965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3f4bd9ec-3bbe-476e-ad8e-df02bab09004 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:58.658718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3f4bd9ec-3bbe-476e-ad8e-df02bab09004 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:58.670303 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9aa82572-2bdf-4613-9b53-06afc5f5c3a9 req-5a5286ff-8b4a-40db-8842-5263062e5654 service nova] Creating event network-changed:ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8 for instance f84f3bbc-d80c-4e30-9f17-398e456677b6 on n-h1-708768-8 Jul 26 20:11:58.685044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f4bd9ec-3bbe-476e-ad8e-df02bab09004 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:58.685964 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9aa82572-2bdf-4613-9b53-06afc5f5c3a9 req-5a5286ff-8b4a-40db-8842-5263062e5654 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084517 Jul 26 20:11:58.689372 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2654/5228] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:11:58.692354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f4bd9ec-3bbe-476e-ad8e-df02bab09004 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:58.694677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f4bd9ec-3bbe-476e-ad8e-df02bab09004 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:58.697283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f4bd9ec-3bbe-476e-ad8e-df02bab09004 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:59.170005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3f4bd9ec-3bbe-476e-ad8e-df02bab09004 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:11:59.186517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3f4bd9ec-3bbe-476e-ad8e-df02bab09004 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1657 microversion: 2.1 time: 0.533707 Jul 26 20:11:59.191243 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2575/5229] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:58 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1657 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:11:59.212717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9bf2dd57-7e85-43b4-b20b-fe454c272e5f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:11:59.235924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bf2dd57-7e85-43b4-b20b-fe454c272e5f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:59.238160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bf2dd57-7e85-43b4-b20b-fe454c272e5f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:59.321164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9bf2dd57-7e85-43b4-b20b-fe454c272e5f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Going to try to start instance {{(pid=125964) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 20:11:59.434033 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9bf2dd57-7e85-43b4-b20b-fe454c272e5f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.221523 Jul 26 20:11:59.434744 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2655/5230] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:11:59 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:11:59.443351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4b007ee-f4e6-477f-87db-bf7a18e381db tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:59.444024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b4b007ee-f4e6-477f-87db-bf7a18e381db tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:59.461413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4b007ee-f4e6-477f-87db-bf7a18e381db tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:59.470557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4b007ee-f4e6-477f-87db-bf7a18e381db tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:59.471453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4b007ee-f4e6-477f-87db-bf7a18e381db tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:59.471937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4b007ee-f4e6-477f-87db-bf7a18e381db tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:59.596541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-852c5567-b8f0-416a-b125-e3bf79103c0b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:11:59.597290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-852c5567-b8f0-416a-b125-e3bf79103c0b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:11:59.619709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-852c5567-b8f0-416a-b125-e3bf79103c0b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:59.622134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-852c5567-b8f0-416a-b125-e3bf79103c0b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:11:59.625085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-852c5567-b8f0-416a-b125-e3bf79103c0b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:11:59.636719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-852c5567-b8f0-416a-b125-e3bf79103c0b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:00.695361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4b007ee-f4e6-477f-87db-bf7a18e381db tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:00.707888 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4b007ee-f4e6-477f-87db-bf7a18e381db tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1666 microversion: 2.1 time: 1.268727 Jul 26 20:12:00.732373 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2576/5231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:59 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1666 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:01.324083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-852c5567-b8f0-416a-b125-e3bf79103c0b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:01.350235 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-852c5567-b8f0-416a-b125-e3bf79103c0b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 1.760092 Jul 26 20:12:01.351573 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2656/5232] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:11:59 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:01.747302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2bd53020-e734-4f6e-a435-320ac9238134 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:01.748155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2bd53020-e734-4f6e-a435-320ac9238134 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:01.759926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bd53020-e734-4f6e-a435-320ac9238134 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:01.760246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bd53020-e734-4f6e-a435-320ac9238134 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:01.761038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bd53020-e734-4f6e-a435-320ac9238134 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:01.761476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bd53020-e734-4f6e-a435-320ac9238134 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:02.070656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2bd53020-e734-4f6e-a435-320ac9238134 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:02.079196 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2bd53020-e734-4f6e-a435-320ac9238134 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1666 microversion: 2.1 time: 0.342260 Jul 26 20:12:02.094970 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2577/5233] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:01 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1666 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:02.382575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1120d2bd-6f46-4e78-94bc-80f7cc5bd8aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:02.384628 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1120d2bd-6f46-4e78-94bc-80f7cc5bd8aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:02.396833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1120d2bd-6f46-4e78-94bc-80f7cc5bd8aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:02.397937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1120d2bd-6f46-4e78-94bc-80f7cc5bd8aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:02.401961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1120d2bd-6f46-4e78-94bc-80f7cc5bd8aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:02.402655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1120d2bd-6f46-4e78-94bc-80f7cc5bd8aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:02.581730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1120d2bd-6f46-4e78-94bc-80f7cc5bd8aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:02.598082 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1120d2bd-6f46-4e78-94bc-80f7cc5bd8aa tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 0.226876 Jul 26 20:12:02.599544 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2657/5234] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:02 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:03.100970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0dbad6a5-bebc-4f0b-b287-42299712ca27 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:03.101590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0dbad6a5-bebc-4f0b-b287-42299712ca27 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:03.129722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dbad6a5-bebc-4f0b-b287-42299712ca27 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:03.130181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dbad6a5-bebc-4f0b-b287-42299712ca27 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:03.130979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dbad6a5-bebc-4f0b-b287-42299712ca27 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:03.131425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dbad6a5-bebc-4f0b-b287-42299712ca27 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:03.402734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0dbad6a5-bebc-4f0b-b287-42299712ca27 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:03.410955 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0dbad6a5-bebc-4f0b-b287-42299712ca27 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.313769 Jul 26 20:12:03.414424 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2578/5235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:03 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:03.436186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ad57ed7-6390-4434-89fa-1c05e9512043 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:03.436832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ad57ed7-6390-4434-89fa-1c05e9512043 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:03.454545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ad57ed7-6390-4434-89fa-1c05e9512043 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:03.455008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ad57ed7-6390-4434-89fa-1c05e9512043 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:03.455846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ad57ed7-6390-4434-89fa-1c05e9512043 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:03.456292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ad57ed7-6390-4434-89fa-1c05e9512043 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:03.621045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68f26a2a-68df-4855-8719-2df126cbc3c7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:03.622289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68f26a2a-68df-4855-8719-2df126cbc3c7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:03.631523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68f26a2a-68df-4855-8719-2df126cbc3c7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:03.637734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68f26a2a-68df-4855-8719-2df126cbc3c7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:03.639135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68f26a2a-68df-4855-8719-2df126cbc3c7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:03.639781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68f26a2a-68df-4855-8719-2df126cbc3c7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:03.733330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ad57ed7-6390-4434-89fa-1c05e9512043 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:03.743565 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ad57ed7-6390-4434-89fa-1c05e9512043 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.311888 Jul 26 20:12:03.749001 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2658/5236] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:03 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:03.770245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-501d467a-2d5d-40d3-a382-5b2bca6cb482 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:03.771500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-501d467a-2d5d-40d3-a382-5b2bca6cb482 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:03.778011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-501d467a-2d5d-40d3-a382-5b2bca6cb482 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:03.778722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-501d467a-2d5d-40d3-a382-5b2bca6cb482 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:03.779245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-501d467a-2d5d-40d3-a382-5b2bca6cb482 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:03.780339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-501d467a-2d5d-40d3-a382-5b2bca6cb482 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:04.015724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68f26a2a-68df-4855-8719-2df126cbc3c7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:04.030749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68f26a2a-68df-4855-8719-2df126cbc3c7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 0.413586 Jul 26 20:12:04.046090 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2579/5237] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:03 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:04.145403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-501d467a-2d5d-40d3-a382-5b2bca6cb482 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:04.154116 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-501d467a-2d5d-40d3-a382-5b2bca6cb482 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.387615 Jul 26 20:12:04.162680 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2659/5238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:03 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:04.187188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18eeda04-f531-4179-97a4-393298148885 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:04.188044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18eeda04-f531-4179-97a4-393298148885 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:04.203434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18eeda04-f531-4179-97a4-393298148885 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:04.206694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18eeda04-f531-4179-97a4-393298148885 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:04.207770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18eeda04-f531-4179-97a4-393298148885 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:04.208382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18eeda04-f531-4179-97a4-393298148885 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:04.536169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18eeda04-f531-4179-97a4-393298148885 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:04.549332 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18eeda04-f531-4179-97a4-393298148885 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.366463 Jul 26 20:12:04.570534 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2580/5239] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:04 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:04.575223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5cc20e88-48bf-4db8-8ea8-e1a783111c2e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:04.576408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5cc20e88-48bf-4db8-8ea8-e1a783111c2e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:04.589142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cc20e88-48bf-4db8-8ea8-e1a783111c2e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:04.592806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cc20e88-48bf-4db8-8ea8-e1a783111c2e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:04.593995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cc20e88-48bf-4db8-8ea8-e1a783111c2e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:04.594595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cc20e88-48bf-4db8-8ea8-e1a783111c2e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:04.907254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5cc20e88-48bf-4db8-8ea8-e1a783111c2e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:04.922938 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5cc20e88-48bf-4db8-8ea8-e1a783111c2e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.352514 Jul 26 20:12:04.938772 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2660/5240] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:04 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:04.945243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6047cd59-f965-481f-b66c-9e62ab74c202 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:04.945813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6047cd59-f965-481f-b66c-9e62ab74c202 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:04.953670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6047cd59-f965-481f-b66c-9e62ab74c202 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:04.960265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6047cd59-f965-481f-b66c-9e62ab74c202 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:04.961397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6047cd59-f965-481f-b66c-9e62ab74c202 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:04.962086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6047cd59-f965-481f-b66c-9e62ab74c202 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:05.000652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-6047cd59-f965-481f-b66c-9e62ab74c202 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lazy-loading 'flavor' on Instance uuid 3b78c879-17f2-46ef-a51b-c03307f19a5a {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:12:05.059202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21a0e752-36fb-4e5b-9412-cba890a1ee68 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:05.061288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21a0e752-36fb-4e5b-9412-cba890a1ee68 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:05.086429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21a0e752-36fb-4e5b-9412-cba890a1ee68 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:05.087315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21a0e752-36fb-4e5b-9412-cba890a1ee68 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:05.088262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21a0e752-36fb-4e5b-9412-cba890a1ee68 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:05.088721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21a0e752-36fb-4e5b-9412-cba890a1ee68 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:05.168107 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6047cd59-f965-481f-b66c-9e62ab74c202 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.227300 Jul 26 20:12:05.175819 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2581/5241] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:12:04 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:12:05.183085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2fad042-f8db-4680-95af-e88337db63d8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:05.189080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d2fad042-f8db-4680-95af-e88337db63d8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:05.216471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2fad042-f8db-4680-95af-e88337db63d8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:05.217021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2fad042-f8db-4680-95af-e88337db63d8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:05.217823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2fad042-f8db-4680-95af-e88337db63d8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:05.218264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2fad042-f8db-4680-95af-e88337db63d8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:05.411883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21a0e752-36fb-4e5b-9412-cba890a1ee68 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:05.424297 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21a0e752-36fb-4e5b-9412-cba890a1ee68 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1533 microversion: 2.1 time: 0.369293 Jul 26 20:12:05.427660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2661/5242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:05 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1533 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:05.480571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2fad042-f8db-4680-95af-e88337db63d8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:05.504004 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2fad042-f8db-4680-95af-e88337db63d8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1678 microversion: 2.1 time: 0.324635 Jul 26 20:12:05.504645 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2582/5243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:05 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1678 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:06.459945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0207d2ff-1e29-4750-a061-2cc71368a233 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:06.460589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0207d2ff-1e29-4750-a061-2cc71368a233 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:06.487334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0207d2ff-1e29-4750-a061-2cc71368a233 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:06.490413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0207d2ff-1e29-4750-a061-2cc71368a233 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:06.497561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0207d2ff-1e29-4750-a061-2cc71368a233 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:06.497894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0207d2ff-1e29-4750-a061-2cc71368a233 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:06.512745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:06.533278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-67e29ff6-a699-4178-8f52-579a83e5326f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:06.534098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-67e29ff6-a699-4178-8f52-579a83e5326f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:06.569289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67e29ff6-a699-4178-8f52-579a83e5326f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:06.569749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67e29ff6-a699-4178-8f52-579a83e5326f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:06.570550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67e29ff6-a699-4178-8f52-579a83e5326f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:06.570993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67e29ff6-a699-4178-8f52-579a83e5326f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:06.895562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0207d2ff-1e29-4750-a061-2cc71368a233 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:06.909654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0207d2ff-1e29-4750-a061-2cc71368a233 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1533 microversion: 2.1 time: 0.463887 Jul 26 20:12:06.913589 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2662/5244] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:06 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1533 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:07.022503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-67e29ff6-a699-4178-8f52-579a83e5326f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:07.034010 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-67e29ff6-a699-4178-8f52-579a83e5326f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1661 microversion: 2.1 time: 0.504730 Jul 26 20:12:07.034786 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2583/5245] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:06 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1661 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:07.069053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd0b1b1d-de44-4683-a4fa-4812b5987072 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:07.069822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd0b1b1d-de44-4683-a4fa-4812b5987072 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:07.089375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0b1b1d-de44-4683-a4fa-4812b5987072 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:07.089843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0b1b1d-de44-4683-a4fa-4812b5987072 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:07.090901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0b1b1d-de44-4683-a4fa-4812b5987072 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:07.095768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0b1b1d-de44-4683-a4fa-4812b5987072 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:07.286771 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd0b1b1d-de44-4683-a4fa-4812b5987072 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.222473 Jul 26 20:12:07.287436 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2663/5246] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:12:07 2022] POST /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:12:07.298916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-beede3a1-66d8-42e1-9131-06b6bcbfb154 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:07.304261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-beede3a1-66d8-42e1-9131-06b6bcbfb154 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:07.313954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-beede3a1-66d8-42e1-9131-06b6bcbfb154 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:07.314735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-beede3a1-66d8-42e1-9131-06b6bcbfb154 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:07.316021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-beede3a1-66d8-42e1-9131-06b6bcbfb154 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:07.317138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-beede3a1-66d8-42e1-9131-06b6bcbfb154 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:07.728553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-beede3a1-66d8-42e1-9131-06b6bcbfb154 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:07.741278 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-beede3a1-66d8-42e1-9131-06b6bcbfb154 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1667 microversion: 2.1 time: 0.449497 Jul 26 20:12:07.743924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2584/5247] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:07 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1667 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:07.935555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef30f53a-04a8-4672-b779-feb524c90a16 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:07.936895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef30f53a-04a8-4672-b779-feb524c90a16 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:07.946796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef30f53a-04a8-4672-b779-feb524c90a16 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:07.964377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef30f53a-04a8-4672-b779-feb524c90a16 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:07.966150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef30f53a-04a8-4672-b779-feb524c90a16 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:07.966741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef30f53a-04a8-4672-b779-feb524c90a16 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:08.406240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ef30f53a-04a8-4672-b779-feb524c90a16 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:08.418528 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef30f53a-04a8-4672-b779-feb524c90a16 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.487966 Jul 26 20:12:08.420285 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2664/5248] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:07 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:08.472298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-72a5fa1e-ad54-4d5a-8ce8-d6d3f5f04241 req-4755cdd7-dd07-4784-818c-3ea05ae02204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f", "name": "network-vif-plugged", "status": "completed", "tag": "2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:08.512120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-72a5fa1e-ad54-4d5a-8ce8-d6d3f5f04241 req-4755cdd7-dd07-4784-818c-3ea05ae02204 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:08.514255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-72a5fa1e-ad54-4d5a-8ce8-d6d3f5f04241 req-4755cdd7-dd07-4784-818c-3ea05ae02204 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:08.561173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:08.570072 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-72a5fa1e-ad54-4d5a-8ce8-d6d3f5f04241 req-4755cdd7-dd07-4784-818c-3ea05ae02204 service nova] Creating event network-vif-plugged:2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c for instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f on n-h2-708768-8 Jul 26 20:12:08.597745 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-72a5fa1e-ad54-4d5a-8ce8-d6d3f5f04241 req-4755cdd7-dd07-4784-818c-3ea05ae02204 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129128 Jul 26 20:12:08.605407 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2585/5249] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:12:08.768569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-33e340c7-c272-4074-b82a-07c95088f24e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:08.769286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-33e340c7-c272-4074-b82a-07c95088f24e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:08.783772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33e340c7-c272-4074-b82a-07c95088f24e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:08.785030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33e340c7-c272-4074-b82a-07c95088f24e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:08.788227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33e340c7-c272-4074-b82a-07c95088f24e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:08.789528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-33e340c7-c272-4074-b82a-07c95088f24e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:09.096099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-33e340c7-c272-4074-b82a-07c95088f24e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:09.116095 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-33e340c7-c272-4074-b82a-07c95088f24e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1667 microversion: 2.1 time: 0.349807 Jul 26 20:12:09.119593 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2665/5250] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:08 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1667 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:09.448862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e09af549-114b-4bb5-af72-c3319529bd41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:09.452055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e09af549-114b-4bb5-af72-c3319529bd41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:09.485338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e09af549-114b-4bb5-af72-c3319529bd41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:09.486043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e09af549-114b-4bb5-af72-c3319529bd41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:09.490423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e09af549-114b-4bb5-af72-c3319529bd41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:09.492091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e09af549-114b-4bb5-af72-c3319529bd41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:09.785797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e09af549-114b-4bb5-af72-c3319529bd41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:09.801554 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e09af549-114b-4bb5-af72-c3319529bd41 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.357567 Jul 26 20:12:09.811730 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2586/5251] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:09 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:10.142834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5df94c89-1ef6-4aaa-966e-169702e73c77 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:10.144181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5df94c89-1ef6-4aaa-966e-169702e73c77 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:10.169151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5df94c89-1ef6-4aaa-966e-169702e73c77 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:10.170021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5df94c89-1ef6-4aaa-966e-169702e73c77 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:10.171147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5df94c89-1ef6-4aaa-966e-169702e73c77 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:10.172584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5df94c89-1ef6-4aaa-966e-169702e73c77 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:10.592299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5df94c89-1ef6-4aaa-966e-169702e73c77 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:10.612434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5df94c89-1ef6-4aaa-966e-169702e73c77 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.475236 Jul 26 20:12:10.613841 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2666/5252] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:10 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:10.638679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-10c59f64-283a-4e25-9757-cee32ced0e56 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:10.639322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-10c59f64-283a-4e25-9757-cee32ced0e56 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:10.663326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10c59f64-283a-4e25-9757-cee32ced0e56 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:10.664444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10c59f64-283a-4e25-9757-cee32ced0e56 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:10.666483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10c59f64-283a-4e25-9757-cee32ced0e56 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:10.668208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10c59f64-283a-4e25-9757-cee32ced0e56 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:10.832831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7fd35499-b12b-4b11-be6e-5f8fd02d3ea5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:10.835974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7fd35499-b12b-4b11-be6e-5f8fd02d3ea5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:10.866119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fd35499-b12b-4b11-be6e-5f8fd02d3ea5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:10.867125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fd35499-b12b-4b11-be6e-5f8fd02d3ea5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:10.868112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fd35499-b12b-4b11-be6e-5f8fd02d3ea5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:10.868556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fd35499-b12b-4b11-be6e-5f8fd02d3ea5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:11.179418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7fd35499-b12b-4b11-be6e-5f8fd02d3ea5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:11.189711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-10c59f64-283a-4e25-9757-cee32ced0e56 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:11.192164 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7fd35499-b12b-4b11-be6e-5f8fd02d3ea5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.369374 Jul 26 20:12:11.198179 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2667/5253] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:10 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:11.203297 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-10c59f64-283a-4e25-9757-cee32ced0e56 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1670 microversion: 2.1 time: 0.568776 Jul 26 20:12:11.207350 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2587/5254] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:10 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1670 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:11.242635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:11.243324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:11.258604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:11.259335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:11.262524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:11.264942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:11.306058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:12:11.328953 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.compute.api [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Working on deleting snapshot 1ca1bd72-c3e5-4213-8d00-c604e3ceef3a from shelved instance... Jul 26 20:12:12.230534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-96c0c1d9-544f-4b02-ad8b-ac1bbb206819 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:12.231806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-96c0c1d9-544f-4b02-ad8b-ac1bbb206819 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:12.251360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96c0c1d9-544f-4b02-ad8b-ac1bbb206819 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:12.252430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96c0c1d9-544f-4b02-ad8b-ac1bbb206819 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:12.255546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96c0c1d9-544f-4b02-ad8b-ac1bbb206819 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:12.257840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96c0c1d9-544f-4b02-ad8b-ac1bbb206819 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:12.498780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-96c0c1d9-544f-4b02-ad8b-ac1bbb206819 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:12.510009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-96c0c1d9-544f-4b02-ad8b-ac1bbb206819 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.284962 Jul 26 20:12:12.511084 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2588/5255] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:12 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:13.013563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Doing local delete in cell 0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) {{(pid=125964) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 26 20:12:13.016970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:13.019313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:13.024552 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.compute.api [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 26 20:12:13.038150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] deallocate_for_instance() {{(pid=125964) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 26 20:12:13.534119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-06f28a12-79ed-4563-ac26-fbf467e84234 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:13.534851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-06f28a12-79ed-4563-ac26-fbf467e84234 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:13.545403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06f28a12-79ed-4563-ac26-fbf467e84234 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:13.547888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06f28a12-79ed-4563-ac26-fbf467e84234 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:13.549180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06f28a12-79ed-4563-ac26-fbf467e84234 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:13.552306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06f28a12-79ed-4563-ac26-fbf467e84234 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:14.472663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Updating instance_info_cache with network_info: [] {{(pid=125964) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 20:12:14.676996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-06f28a12-79ed-4563-ac26-fbf467e84234 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:14.695045 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-06f28a12-79ed-4563-ac26-fbf467e84234 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 1.165307 Jul 26 20:12:14.706196 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2589/5256] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:13 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:14.723766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-39847e26-097e-422c-9b65-78f62c8a4328 req-bd8d06de-54eb-4868-9297-0ad6ac7876bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5886ca74-cf72-4313-99c4-606f6d979ee0", "name": "network-vif-deleted", "tag": "332ee2fe-ce87-4b9b-8b45-c4f260acd0a0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:14.769381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-39847e26-097e-422c-9b65-78f62c8a4328 req-bd8d06de-54eb-4868-9297-0ad6ac7876bd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:14.770954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-39847e26-097e-422c-9b65-78f62c8a4328 req-bd8d06de-54eb-4868-9297-0ad6ac7876bd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:14.845951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.compute.server_external_events [req-39847e26-097e-422c-9b65-78f62c8a4328 req-bd8d06de-54eb-4868-9297-0ad6ac7876bd service nova] Unable to find a host for instance 5886ca74-cf72-4313-99c4-606f6d979ee0. Dropping event network-vif-deleted {{(pid=125963) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 20:12:14.850317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-39847e26-097e-422c-9b65-78f62c8a4328 req-bd8d06de-54eb-4868-9297-0ad6ac7876bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.142656 Jul 26 20:12:14.871865 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2590/5257] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 161 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 20:12:15.338124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=90 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:15.732332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e398ff31-8782-45d1-8599-f1685d0ea5a8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:15.733573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e398ff31-8782-45d1-8599-f1685d0ea5a8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:15.743323 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39bfa008-913c-46de-a764-95da0e684188 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 204 len: 0 microversion: 2.1 time: 4.507296 Jul 26 20:12:15.754988 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2668/5258] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:12:11 2022] DELETE /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 0 bytes in 4520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:12:15.755932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e398ff31-8782-45d1-8599-f1685d0ea5a8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:15.756562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e398ff31-8782-45d1-8599-f1685d0ea5a8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:15.761129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e398ff31-8782-45d1-8599-f1685d0ea5a8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:15.761596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e398ff31-8782-45d1-8599-f1685d0ea5a8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:15.771740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:15.776657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 5886ca74-cf72-4313-99c4-606f6d979ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:15.801759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:15.802580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:15.805292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:15.806107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:15.897045 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] HTTP exception thrown: Instance 5886ca74-cf72-4313-99c4-606f6d979ee0 could not be found. Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Request method failure captured: Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 HTTP/1.1 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ei0QX_lJ8whTwO9WSGuiAKHKrflLExw0BSW7z4oUba8si0AL2Ukxspb6VFnyhS6LCg0a8Dfdmuil90NN0QlrzOLQohElw745l5qLZNpFRC-CNaLF83G4OKB8E5U_7j0S5oTAasWoFwhJLV87nQ-FWOWeY6iqAS6y45nrPh2fHmcF9I Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7570797c1a94fbd94a4b7ee2796f526", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}] Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4418a0cb57744aa5a56a3fdcce0947cc Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 5886ca74-cf72-4313-99c4-606f6d979ee0 could not be found. Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5886ca74-cf72-4313-99c4-606f6d979ee0'} Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5886ca74-cf72-4313-99c4-606f6d979ee0 could not be found. Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5886ca74-cf72-4313-99c4-606f6d979ee0 could not be found. Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:15.899823 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5886ca74-cf72-4313-99c4-606f6d979ee0 could not be found. Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Returning 404 to user: Instance 5886ca74-cf72-4313-99c4-606f6d979ee0 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d2fce060-0a2c-4be4-ba70-90bc579cc5c8 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0" status: 404 len: 111 microversion: 2.1 time: 0.135877 Jul 26 20:12:15.904420 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2669/5259] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:15 2022] GET /compute/v2.1/servers/5886ca74-cf72-4313-99c4-606f6d979ee0 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:12:15.910715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-59fb5045-0571-4cab-9b0a-a51f3967dc03 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:15.911230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-59fb5045-0571-4cab-9b0a-a51f3967dc03 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:15.926034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59fb5045-0571-4cab-9b0a-a51f3967dc03 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:15.926511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59fb5045-0571-4cab-9b0a-a51f3967dc03 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:15.927324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59fb5045-0571-4cab-9b0a-a51f3967dc03 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:15.927783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59fb5045-0571-4cab-9b0a-a51f3967dc03 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:15.990899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-59fb5045-0571-4cab-9b0a-a51f3967dc03 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:12:16.088090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:16.096141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e398ff31-8782-45d1-8599-f1685d0ea5a8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:16.109775 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e398ff31-8782-45d1-8599-f1685d0ea5a8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.381189 Jul 26 20:12:16.112208 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2591/5260] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:15 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:16.195801 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-59fb5045-0571-4cab-9b0a-a51f3967dc03 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 204 len: 0 microversion: 2.1 time: 0.287210 Jul 26 20:12:16.198790 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2670/5261] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:12:15 2022] DELETE /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:12:16.209200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa9cac1a-ee3f-4426-a980-ac3580878ebb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:16.210370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa9cac1a-ee3f-4426-a980-ac3580878ebb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:16.218774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa9cac1a-ee3f-4426-a980-ac3580878ebb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:16.232779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa9cac1a-ee3f-4426-a980-ac3580878ebb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:16.232779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa9cac1a-ee3f-4426-a980-ac3580878ebb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:16.232779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa9cac1a-ee3f-4426-a980-ac3580878ebb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:16.398275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa9cac1a-ee3f-4426-a980-ac3580878ebb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:16.410681 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa9cac1a-ee3f-4426-a980-ac3580878ebb tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1466 microversion: 2.1 time: 0.207000 Jul 26 20:12:16.411363 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2592/5262] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:16 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1466 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:17.134298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2b78a669-fd05-424f-824c-d8864c126ec1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:17.134990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2b78a669-fd05-424f-824c-d8864c126ec1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:17.150869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b78a669-fd05-424f-824c-d8864c126ec1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:17.151433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b78a669-fd05-424f-824c-d8864c126ec1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:17.152541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b78a669-fd05-424f-824c-d8864c126ec1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:17.154738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2b78a669-fd05-424f-824c-d8864c126ec1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:17.444675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-76f81b7d-0fb8-4b82-9e4d-77178922f7bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:17.448719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-76f81b7d-0fb8-4b82-9e4d-77178922f7bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:17.489974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76f81b7d-0fb8-4b82-9e4d-77178922f7bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:17.490435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76f81b7d-0fb8-4b82-9e4d-77178922f7bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:17.491245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76f81b7d-0fb8-4b82-9e4d-77178922f7bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:17.498648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76f81b7d-0fb8-4b82-9e4d-77178922f7bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:17.663118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2b78a669-fd05-424f-824c-d8864c126ec1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:17.713090 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2b78a669-fd05-424f-824c-d8864c126ec1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.570399 Jul 26 20:12:17.713786 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2671/5263] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:17 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:17.964705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-76f81b7d-0fb8-4b82-9e4d-77178922f7bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:17.974514 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-76f81b7d-0fb8-4b82-9e4d-77178922f7bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1466 microversion: 2.1 time: 0.535441 Jul 26 20:12:17.978400 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2593/5264] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:17 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1466 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:18.547935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f70045da-7573-4def-aa95-e292d2d2d1ad req-455d53a7-1e2a-4589-b9cd-483e5440d977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6e47f0-457a-4d22-853f-24116a603d3b", "name": "network-vif-deleted", "tag": "a99efec3-a193-4fd8-8b20-17e9fa87314c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:18.569441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f70045da-7573-4def-aa95-e292d2d2d1ad req-455d53a7-1e2a-4589-b9cd-483e5440d977 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:18.571277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f70045da-7573-4def-aa95-e292d2d2d1ad req-455d53a7-1e2a-4589-b9cd-483e5440d977 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:18.587271 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f70045da-7573-4def-aa95-e292d2d2d1ad req-455d53a7-1e2a-4589-b9cd-483e5440d977 service nova] Creating event network-vif-deleted:a99efec3-a193-4fd8-8b20-17e9fa87314c for instance 4a6e47f0-457a-4d22-853f-24116a603d3b on n-h1-708768-8 Jul 26 20:12:18.598872 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f70045da-7573-4def-aa95-e292d2d2d1ad req-455d53a7-1e2a-4589-b9cd-483e5440d977 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066182 Jul 26 20:12:18.607369 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2672/5265] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:12:18.744727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6443394d-3e78-4bd9-bfdb-658bbd304f66 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:18.745629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6443394d-3e78-4bd9-bfdb-658bbd304f66 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:18.769408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6443394d-3e78-4bd9-bfdb-658bbd304f66 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:18.771430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6443394d-3e78-4bd9-bfdb-658bbd304f66 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:18.777024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6443394d-3e78-4bd9-bfdb-658bbd304f66 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:18.778204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6443394d-3e78-4bd9-bfdb-658bbd304f66 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:18.999032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:18.999763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:19.016656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:19.017492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:19.018849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:19.019451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:19.122978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6443394d-3e78-4bd9-bfdb-658bbd304f66 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:19.139299 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6443394d-3e78-4bd9-bfdb-658bbd304f66 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.400700 Jul 26 20:12:19.140323 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2594/5266] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:18 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:19.141176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:19.141878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:19.142543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lazy-loading 'fault' on Instance uuid 4a6e47f0-457a-4d22-853f-24116a603d3b {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:12:19.268494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:19.281643 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98b74496-1aa4-4a30-a523-e5eb08ac08bf tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 200 len: 1305 microversion: 2.1 time: 0.286939 Jul 26 20:12:19.284307 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2673/5267] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:18 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 1305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:20.164858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4799b9e3-dc1c-4388-9a67-73f61469fae2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:20.165969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4799b9e3-dc1c-4388-9a67-73f61469fae2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:20.193131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4799b9e3-dc1c-4388-9a67-73f61469fae2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.196080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4799b9e3-dc1c-4388-9a67-73f61469fae2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.198584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4799b9e3-dc1c-4388-9a67-73f61469fae2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.199280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4799b9e3-dc1c-4388-9a67-73f61469fae2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.308024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:20.312640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4a6e47f0-457a-4d22-853f-24116a603d3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:20.330915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.331977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.333437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.334397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.371673 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] HTTP exception thrown: Instance 4a6e47f0-457a-4d22-853f-24116a603d3b could not be found. Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Request method failure captured: Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b HTTP/1.1 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ei0QX_lJ8whTwO9WSGuiAKHKrflLExw0BSW7z4oUba8si0AL2Ukxspb6VFnyhS6LCg0a8Dfdmuil90NN0QlrzOLQohElw745l5qLZNpFRC-CNaLF83G4OKB8E5U_7j0S5oTAasWoFwhJLV87nQ-FWOWeY6iqAS6y45nrPh2fHmcF9I Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7570797c1a94fbd94a4b7ee2796f526", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}] Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4418a0cb57744aa5a56a3fdcce0947cc Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 4a6e47f0-457a-4d22-853f-24116a603d3b could not be found. Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '4a6e47f0-457a-4d22-853f-24116a603d3b'} Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6e47f0-457a-4d22-853f-24116a603d3b could not be found. Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6e47f0-457a-4d22-853f-24116a603d3b could not be found. Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:20.376754 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:20.380837 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:20.380837 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:20.380837 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:20.380837 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:12:20.380837 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:12:20.380837 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6e47f0-457a-4d22-853f-24116a603d3b could not be found. Jul 26 20:12:20.380837 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:20.391808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Returning 404 to user: Instance 4a6e47f0-457a-4d22-853f-24116a603d3b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:12:20.392808 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f1dc0329-ad1d-4b42-bc93-fe99e9ab204d tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b" status: 404 len: 111 microversion: 2.1 time: 0.089850 Jul 26 20:12:20.393589 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2674/5268] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:20 2022] GET /compute/v2.1/servers/4a6e47f0-457a-4d22-853f-24116a603d3b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:12:20.406543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4ea3f76-6313-4caa-9051-e31cf9de3a37 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:20.407044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4ea3f76-6313-4caa-9051-e31cf9de3a37 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:20.420055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4ea3f76-6313-4caa-9051-e31cf9de3a37 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.422497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4ea3f76-6313-4caa-9051-e31cf9de3a37 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.423391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4ea3f76-6313-4caa-9051-e31cf9de3a37 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.426825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4ea3f76-6313-4caa-9051-e31cf9de3a37 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.502568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4799b9e3-dc1c-4388-9a67-73f61469fae2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:20.514432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4ea3f76-6313-4caa-9051-e31cf9de3a37 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:12:20.524009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4799b9e3-dc1c-4388-9a67-73f61469fae2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.362999 Jul 26 20:12:20.525602 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2595/5269] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:20 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:20.535569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-94648f62-7ca6-47b2-a61d-35b6efd7bcbc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:20.542436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-94648f62-7ca6-47b2-a61d-35b6efd7bcbc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:20.586931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94648f62-7ca6-47b2-a61d-35b6efd7bcbc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.588663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94648f62-7ca6-47b2-a61d-35b6efd7bcbc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.605123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94648f62-7ca6-47b2-a61d-35b6efd7bcbc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.608027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94648f62-7ca6-47b2-a61d-35b6efd7bcbc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.725714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-94648f62-7ca6-47b2-a61d-35b6efd7bcbc tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6/action" status: 200 len: 24572 microversion: 2.1 time: 0.192821 Jul 26 20:12:20.727773 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2596/5270] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:12:20 2022] POST /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6/action => generated 24572 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:12:20.886145 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4ea3f76-6313-4caa-9051-e31cf9de3a37 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 204 len: 0 microversion: 2.1 time: 0.488114 Jul 26 20:12:20.886745 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2675/5271] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:12:20 2022] DELETE /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:12:20.895744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d9b15be4-80b1-414b-b2b9-eb7139f8420f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:20.899239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d9b15be4-80b1-414b-b2b9-eb7139f8420f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:20.907909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9b15be4-80b1-414b-b2b9-eb7139f8420f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.908852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9b15be4-80b1-414b-b2b9-eb7139f8420f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:20.909840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9b15be4-80b1-414b-b2b9-eb7139f8420f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:20.916846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d9b15be4-80b1-414b-b2b9-eb7139f8420f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:21.297519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d9b15be4-80b1-414b-b2b9-eb7139f8420f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:21.315281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d9b15be4-80b1-414b-b2b9-eb7139f8420f tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1508 microversion: 2.1 time: 0.423764 Jul 26 20:12:21.318530 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2597/5272] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:20 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:21.554179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99f59365-5160-4e62-a081-ae7790f3925c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:21.555580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-99f59365-5160-4e62-a081-ae7790f3925c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:21.573746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99f59365-5160-4e62-a081-ae7790f3925c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:21.576254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99f59365-5160-4e62-a081-ae7790f3925c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:21.577400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99f59365-5160-4e62-a081-ae7790f3925c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:21.578105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99f59365-5160-4e62-a081-ae7790f3925c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:21.995929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-99f59365-5160-4e62-a081-ae7790f3925c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:22.023178 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-99f59365-5160-4e62-a081-ae7790f3925c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.473294 Jul 26 20:12:22.041722 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2676/5273] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:21 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:22.348828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a26b7106-1f7c-4065-ac45-1bee2b16ca8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:22.350150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a26b7106-1f7c-4065-ac45-1bee2b16ca8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:22.368254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26b7106-1f7c-4065-ac45-1bee2b16ca8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:22.376240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26b7106-1f7c-4065-ac45-1bee2b16ca8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:22.377583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26b7106-1f7c-4065-ac45-1bee2b16ca8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:22.378873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26b7106-1f7c-4065-ac45-1bee2b16ca8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:22.807939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a26b7106-1f7c-4065-ac45-1bee2b16ca8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:22.836319 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a26b7106-1f7c-4065-ac45-1bee2b16ca8c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1508 microversion: 2.1 time: 0.491444 Jul 26 20:12:22.851032 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2598/5274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:22 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:23.052016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c03153c1-6836-4c3c-8c16-9a967776d30a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:23.053304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c03153c1-6836-4c3c-8c16-9a967776d30a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:23.064532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c03153c1-6836-4c3c-8c16-9a967776d30a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:23.065320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c03153c1-6836-4c3c-8c16-9a967776d30a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:23.066308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c03153c1-6836-4c3c-8c16-9a967776d30a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:23.066982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c03153c1-6836-4c3c-8c16-9a967776d30a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:23.357890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c03153c1-6836-4c3c-8c16-9a967776d30a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:23.368146 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c03153c1-6836-4c3c-8c16-9a967776d30a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.322301 Jul 26 20:12:23.383952 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2677/5275] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:23 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:23.655376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-802a3bb8-c451-455d-b0f3-0b3b23900150 req-764f8609-0aed-44b0-b8ee-8a2a67bc35de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4664633c-ca21-4d0e-afed-261a7443c79c", "name": "network-vif-deleted", "tag": "4b0496bc-aa5b-4cd7-908b-084af6a3acbb"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:23.695805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-802a3bb8-c451-455d-b0f3-0b3b23900150 req-764f8609-0aed-44b0-b8ee-8a2a67bc35de service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:23.698188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-802a3bb8-c451-455d-b0f3-0b3b23900150 req-764f8609-0aed-44b0-b8ee-8a2a67bc35de service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:23.760108 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-802a3bb8-c451-455d-b0f3-0b3b23900150 req-764f8609-0aed-44b0-b8ee-8a2a67bc35de service nova] Creating event network-vif-deleted:4b0496bc-aa5b-4cd7-908b-084af6a3acbb for instance 4664633c-ca21-4d0e-afed-261a7443c79c on n-h2-708768-8 Jul 26 20:12:23.779153 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-802a3bb8-c451-455d-b0f3-0b3b23900150 req-764f8609-0aed-44b0-b8ee-8a2a67bc35de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125964 Jul 26 20:12:23.781759 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2599/5276] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:12:23.859292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:23.860350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:23.885376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:23.900442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:23.901299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:23.901742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:24.064465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:24.065377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:24.066000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lazy-loading 'fault' on Instance uuid 4664633c-ca21-4d0e-afed-261a7443c79c {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:12:24.242663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:24.254749 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad4d67e7-e422-4087-b56c-e588720b255c tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 200 len: 1305 microversion: 2.1 time: 0.400159 Jul 26 20:12:24.254983 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2678/5277] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:23 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 1305 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:24.394864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-843caf71-817c-4e7e-8211-021ab2a3e3ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:24.395711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-843caf71-817c-4e7e-8211-021ab2a3e3ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:24.413168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-843caf71-817c-4e7e-8211-021ab2a3e3ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:24.413609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-843caf71-817c-4e7e-8211-021ab2a3e3ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:24.423277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-843caf71-817c-4e7e-8211-021ab2a3e3ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:24.423775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-843caf71-817c-4e7e-8211-021ab2a3e3ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:24.717469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-843caf71-817c-4e7e-8211-021ab2a3e3ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:24.728669 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-843caf71-817c-4e7e-8211-021ab2a3e3ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.341925 Jul 26 20:12:24.729272 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2600/5278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:24 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:25.276769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:25.277197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 4664633c-ca21-4d0e-afed-261a7443c79c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:25.303104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:25.305731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:25.310551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:25.315353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:25.349021 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] HTTP exception thrown: Instance 4664633c-ca21-4d0e-afed-261a7443c79c could not be found. Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Request method failure captured: Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c HTTP/1.1 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ei0QX_lJ8whTwO9WSGuiAKHKrflLExw0BSW7z4oUba8si0AL2Ukxspb6VFnyhS6LCg0a8Dfdmuil90NN0QlrzOLQohElw745l5qLZNpFRC-CNaLF83G4OKB8E5U_7j0S5oTAasWoFwhJLV87nQ-FWOWeY6iqAS6y45nrPh2fHmcF9I Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7570797c1a94fbd94a4b7ee2796f526", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}] Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 4418a0cb57744aa5a56a3fdcce0947cc Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 4664633c-ca21-4d0e-afed-261a7443c79c could not be found. Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '4664633c-ca21-4d0e-afed-261a7443c79c'} Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4664633c-ca21-4d0e-afed-261a7443c79c could not be found. Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4664633c-ca21-4d0e-afed-261a7443c79c could not be found. Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:25.350723 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:25.355587 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:25.355587 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:25.355587 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:25.355587 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:12:25.355587 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:12:25.355587 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4664633c-ca21-4d0e-afed-261a7443c79c could not be found. Jul 26 20:12:25.355587 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:25.355587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Returning 404 to user: Instance 4664633c-ca21-4d0e-afed-261a7443c79c could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:12:25.364578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df1a0943-81a6-42d6-bb4c-922b57bf79d5 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c" status: 404 len: 111 microversion: 2.1 time: 0.092856 Jul 26 20:12:25.365565 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2679/5279] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:25 2022] GET /compute/v2.1/servers/4664633c-ca21-4d0e-afed-261a7443c79c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:12:25.377720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e643adb-c269-484d-bf3c-42ac57bbf440 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:25.378748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e643adb-c269-484d-bf3c-42ac57bbf440 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:25.386205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=60 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:25.388410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e643adb-c269-484d-bf3c-42ac57bbf440 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:25.389053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e643adb-c269-484d-bf3c-42ac57bbf440 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:25.391992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e643adb-c269-484d-bf3c-42ac57bbf440 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:25.392847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e643adb-c269-484d-bf3c-42ac57bbf440 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:25.461426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e643adb-c269-484d-bf3c-42ac57bbf440 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:12:25.678959 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e643adb-c269-484d-bf3c-42ac57bbf440 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "DELETE /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 204 len: 0 microversion: 2.1 time: 0.307573 Jul 26 20:12:25.680142 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2601/5280] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:12:25 2022] DELETE /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:12:25.689078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08c22ce8-b160-4e78-9994-154d39435bd0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:25.689707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-08c22ce8-b160-4e78-9994-154d39435bd0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:25.696177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08c22ce8-b160-4e78-9994-154d39435bd0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:25.709495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08c22ce8-b160-4e78-9994-154d39435bd0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:25.710528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08c22ce8-b160-4e78-9994-154d39435bd0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:25.710977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08c22ce8-b160-4e78-9994-154d39435bd0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:25.754272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c5197a3-be6e-46ad-aa93-7eef26b57f29 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:25.755691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c5197a3-be6e-46ad-aa93-7eef26b57f29 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:25.770811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c5197a3-be6e-46ad-aa93-7eef26b57f29 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:25.771712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c5197a3-be6e-46ad-aa93-7eef26b57f29 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:25.773037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c5197a3-be6e-46ad-aa93-7eef26b57f29 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:25.775398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c5197a3-be6e-46ad-aa93-7eef26b57f29 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:25.827558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:25.975716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-08c22ce8-b160-4e78-9994-154d39435bd0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:25.984474 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-08c22ce8-b160-4e78-9994-154d39435bd0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1495 microversion: 2.1 time: 0.300189 Jul 26 20:12:25.989336 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2680/5281] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:25 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1495 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:26.134746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c5197a3-be6e-46ad-aa93-7eef26b57f29 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:26.149420 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c5197a3-be6e-46ad-aa93-7eef26b57f29 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.399694 Jul 26 20:12:26.162317 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2602/5282] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:25 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:26.815247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f395af97-3ba3-4e7d-9e8d-e8f790045db1 req-076fa632-e1b7-4401-aa65-ae03511ca5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ef8d1f-c0c1-4b1f-a908-09102859835e", "name": "network-vif-deleted", "tag": "bbac3cdb-be24-4743-a2e5-f91c5e1ef660"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:26.864687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f395af97-3ba3-4e7d-9e8d-e8f790045db1 req-076fa632-e1b7-4401-aa65-ae03511ca5c7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:26.865157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f395af97-3ba3-4e7d-9e8d-e8f790045db1 req-076fa632-e1b7-4401-aa65-ae03511ca5c7 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:26.909194 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f395af97-3ba3-4e7d-9e8d-e8f790045db1 req-076fa632-e1b7-4401-aa65-ae03511ca5c7 service nova] Creating event network-vif-deleted:bbac3cdb-be24-4743-a2e5-f91c5e1ef660 for instance 17ef8d1f-c0c1-4b1f-a908-09102859835e on n-h2-708768-8 Jul 26 20:12:26.923814 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f395af97-3ba3-4e7d-9e8d-e8f790045db1 req-076fa632-e1b7-4401-aa65-ae03511ca5c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107793 Jul 26 20:12:26.932870 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2681/5283] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:12:27.011623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:27.013240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:27.037292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:27.039317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:27.050160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:27.051927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:27.166354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:27.169939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:27.171098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lazy-loading 'fault' on Instance uuid 17ef8d1f-c0c1-4b1f-a908-09102859835e {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:12:27.177614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e2afdb9b-1eb9-42fb-9bf9-6bbbc05897d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:27.178334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e2afdb9b-1eb9-42fb-9bf9-6bbbc05897d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:27.200888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e2afdb9b-1eb9-42fb-9bf9-6bbbc05897d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:27.201106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e2afdb9b-1eb9-42fb-9bf9-6bbbc05897d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:27.226033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e2afdb9b-1eb9-42fb-9bf9-6bbbc05897d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:27.234449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e2afdb9b-1eb9-42fb-9bf9-6bbbc05897d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:27.370695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:27.394810 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2cf44527-d549-4623-91c3-744db89ad437 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 200 len: 1304 microversion: 2.1 time: 0.378152 Jul 26 20:12:27.408898 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2603/5284] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:27 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 1304 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:27.408898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b71f760c-7ed8-4716-9c9e-109ca60593da tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:27.410821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b71f760c-7ed8-4716-9c9e-109ca60593da tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:27.432457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b71f760c-7ed8-4716-9c9e-109ca60593da tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:27.433020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b71f760c-7ed8-4716-9c9e-109ca60593da tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:27.434349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b71f760c-7ed8-4716-9c9e-109ca60593da tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:27.437673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b71f760c-7ed8-4716-9c9e-109ca60593da tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:27.552282 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b71f760c-7ed8-4716-9c9e-109ca60593da tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "POST /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6/action" status: 200 len: 32632 microversion: 2.1 time: 0.152807 Jul 26 20:12:27.565092 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2604/5285] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:12:27 2022] POST /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6/action => generated 32632 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:12:27.772302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e2afdb9b-1eb9-42fb-9bf9-6bbbc05897d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:27.792145 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e2afdb9b-1eb9-42fb-9bf9-6bbbc05897d1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.619591 Jul 26 20:12:27.796583 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2682/5286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:27 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:28.417756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:28.419316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 17ef8d1f-c0c1-4b1f-a908-09102859835e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:28.433068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:28.434773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:28.447531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:28.448050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:28.498669 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] HTTP exception thrown: Instance 17ef8d1f-c0c1-4b1f-a908-09102859835e could not be found. Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Request method failure captured: Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e HTTP/1.1 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ei0QX_lJ8whTwO9WSGuiAKHKrflLExw0BSW7z4oUba8si0AL2Ukxspb6VFnyhS6LCg0a8Dfdmuil90NN0QlrzOLQohElw745l5qLZNpFRC-CNaLF83G4OKB8E5U_7j0S5oTAasWoFwhJLV87nQ-FWOWeY6iqAS6y45nrPh2fHmcF9I Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7570797c1a94fbd94a4b7ee2796f526", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}] Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4418a0cb57744aa5a56a3fdcce0947cc Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 17ef8d1f-c0c1-4b1f-a908-09102859835e could not be found. Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '17ef8d1f-c0c1-4b1f-a908-09102859835e'} Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ef8d1f-c0c1-4b1f-a908-09102859835e could not be found. Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ef8d1f-c0c1-4b1f-a908-09102859835e could not be found. Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:28.502707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:28.507145 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:28.507145 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:28.507145 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:28.507145 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:12:28.507145 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:12:28.507145 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ef8d1f-c0c1-4b1f-a908-09102859835e could not be found. Jul 26 20:12:28.507145 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:28.509957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Returning 404 to user: Instance 17ef8d1f-c0c1-4b1f-a908-09102859835e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:12:28.511054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b63a12a-602e-4b12-8b86-4636abd78209 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e" status: 404 len: 111 microversion: 2.1 time: 0.098215 Jul 26 20:12:28.512731 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2605/5287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:28 2022] GET /compute/v2.1/servers/17ef8d1f-c0c1-4b1f-a908-09102859835e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:12:28.520849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-92437f4f-2e26-4d49-8330-268db5e44f58 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:28.521425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92437f4f-2e26-4d49-8330-268db5e44f58 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:28.538868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92437f4f-2e26-4d49-8330-268db5e44f58 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:28.539433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92437f4f-2e26-4d49-8330-268db5e44f58 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:28.547705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92437f4f-2e26-4d49-8330-268db5e44f58 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:28.550546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92437f4f-2e26-4d49-8330-268db5e44f58 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:28.626786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92437f4f-2e26-4d49-8330-268db5e44f58 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:12:28.818765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-992ecbb9-7bef-49cd-bb40-25ff1aa368cb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:28.819497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-992ecbb9-7bef-49cd-bb40-25ff1aa368cb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:28.835058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-992ecbb9-7bef-49cd-bb40-25ff1aa368cb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:28.836515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-992ecbb9-7bef-49cd-bb40-25ff1aa368cb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:28.838517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-992ecbb9-7bef-49cd-bb40-25ff1aa368cb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:28.839683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-992ecbb9-7bef-49cd-bb40-25ff1aa368cb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:28.853187 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-92437f4f-2e26-4d49-8330-268db5e44f58 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 204 len: 0 microversion: 2.1 time: 0.329678 Jul 26 20:12:28.853860 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2683/5288] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:12:28 2022] DELETE /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:12:28.880678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ac739bc3-3092-4d67-b49d-12c13ec7de00 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:28.889490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ac739bc3-3092-4d67-b49d-12c13ec7de00 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:28.914574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac739bc3-3092-4d67-b49d-12c13ec7de00 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:28.915723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac739bc3-3092-4d67-b49d-12c13ec7de00 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:28.919179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac739bc3-3092-4d67-b49d-12c13ec7de00 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:28.924248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac739bc3-3092-4d67-b49d-12c13ec7de00 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:29.301125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-992ecbb9-7bef-49cd-bb40-25ff1aa368cb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:29.317029 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-992ecbb9-7bef-49cd-bb40-25ff1aa368cb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.502290 Jul 26 20:12:29.320270 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2606/5289] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:28 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:29.823904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ac739bc3-3092-4d67-b49d-12c13ec7de00 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:29.834219 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ac739bc3-3092-4d67-b49d-12c13ec7de00 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1676 microversion: 2.1 time: 0.969163 Jul 26 20:12:29.862124 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2684/5290] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:28 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1676 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:30.340302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c2d96f94-74fe-4c88-9f96-264f2b99a526 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:30.341117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c2d96f94-74fe-4c88-9f96-264f2b99a526 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:30.351197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2d96f94-74fe-4c88-9f96-264f2b99a526 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:30.351561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2d96f94-74fe-4c88-9f96-264f2b99a526 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:30.352364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2d96f94-74fe-4c88-9f96-264f2b99a526 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:30.352800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2d96f94-74fe-4c88-9f96-264f2b99a526 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:30.763815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-636c007f-457d-405c-9666-ffb645f74fd2 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:30.764434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-636c007f-457d-405c-9666-ffb645f74fd2 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:30.781811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-636c007f-457d-405c-9666-ffb645f74fd2 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:30.790472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-636c007f-457d-405c-9666-ffb645f74fd2 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:30.792550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-636c007f-457d-405c-9666-ffb645f74fd2 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:30.806556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-636c007f-457d-405c-9666-ffb645f74fd2 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:30.914368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-636c007f-457d-405c-9666-ffb645f74fd2 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:12:30.931315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:31.112420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c2d96f94-74fe-4c88-9f96-264f2b99a526 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:31.123682 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c2d96f94-74fe-4c88-9f96-264f2b99a526 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.787980 Jul 26 20:12:31.125742 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2607/5291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:30 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:31.183071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-467b3fec-1d61-4958-9135-95fc0699ebed req-f069d667-feeb-409d-a6c0-63ff64472c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84f3bbc-d80c-4e30-9f17-398e456677b6", "tag": "ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:31.208757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-467b3fec-1d61-4958-9135-95fc0699ebed req-f069d667-feeb-409d-a6c0-63ff64472c2d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:31.209562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-467b3fec-1d61-4958-9135-95fc0699ebed req-f069d667-feeb-409d-a6c0-63ff64472c2d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:31.248659 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-467b3fec-1d61-4958-9135-95fc0699ebed req-f069d667-feeb-409d-a6c0-63ff64472c2d service nova] Creating event network-changed:ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8 for instance f84f3bbc-d80c-4e30-9f17-398e456677b6 on n-h1-708768-8 Jul 26 20:12:31.249325 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-636c007f-457d-405c-9666-ffb645f74fd2 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 204 len: 0 microversion: 2.1 time: 0.484914 Jul 26 20:12:31.256486 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2685/5292] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:12:30 2022] DELETE /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:12:31.270110 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-467b3fec-1d61-4958-9135-95fc0699ebed req-f069d667-feeb-409d-a6c0-63ff64472c2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111819 Jul 26 20:12:31.273800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d800cbb-1482-4ab8-8299-9176e9c9c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:31.274635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2608/5293] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:12:31.274756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d800cbb-1482-4ab8-8299-9176e9c9c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:31.290153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d800cbb-1482-4ab8-8299-9176e9c9c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:31.293801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d800cbb-1482-4ab8-8299-9176e9c9c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:31.297375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d41400af-83f3-4972-a3a7-965b8237da1a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:31.302329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d800cbb-1482-4ab8-8299-9176e9c9c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:31.304206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d800cbb-1482-4ab8-8299-9176e9c9c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:31.306383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d41400af-83f3-4972-a3a7-965b8237da1a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:31.321606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d41400af-83f3-4972-a3a7-965b8237da1a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:31.322053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d41400af-83f3-4972-a3a7-965b8237da1a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:31.322837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d41400af-83f3-4972-a3a7-965b8237da1a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:31.323273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d41400af-83f3-4972-a3a7-965b8237da1a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:31.890180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d800cbb-1482-4ab8-8299-9176e9c9c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:31.899732 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d800cbb-1482-4ab8-8299-9176e9c9c14a tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1676 microversion: 2.1 time: 0.641956 Jul 26 20:12:31.901582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2686/5294] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:31 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1676 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:32.152596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d4a05f08-73e1-44e1-941d-1f68cc57b3e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:32.154434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d4a05f08-73e1-44e1-941d-1f68cc57b3e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:32.169994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4a05f08-73e1-44e1-941d-1f68cc57b3e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:32.180457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4a05f08-73e1-44e1-941d-1f68cc57b3e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:32.181661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4a05f08-73e1-44e1-941d-1f68cc57b3e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:32.182359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4a05f08-73e1-44e1-941d-1f68cc57b3e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:33.008501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d4a05f08-73e1-44e1-941d-1f68cc57b3e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:33.022326 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d4a05f08-73e1-44e1-941d-1f68cc57b3e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 0.870063 Jul 26 20:12:33.028316 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2687/5295] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:32 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:33.045924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-73f81c32-5da5-4236-9864-7d49242aa035 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:33.051751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-73f81c32-5da5-4236-9864-7d49242aa035 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:33.069058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f81c32-5da5-4236-9864-7d49242aa035 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:33.072391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f81c32-5da5-4236-9864-7d49242aa035 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:33.073963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f81c32-5da5-4236-9864-7d49242aa035 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:33.075914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73f81c32-5da5-4236-9864-7d49242aa035 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:33.526112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-73f81c32-5da5-4236-9864-7d49242aa035 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:33.554161 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-73f81c32-5da5-4236-9864-7d49242aa035 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1676 microversion: 2.1 time: 0.517147 Jul 26 20:12:33.557802 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2688/5296] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:33 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1676 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:33.576301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d41400af-83f3-4972-a3a7-965b8237da1a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:33.588858 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d41400af-83f3-4972-a3a7-965b8237da1a tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1668 microversion: 2.1 time: 2.305668 Jul 26 20:12:33.598220 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2609/5297] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:31 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1668 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:34.059401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a32f549-872f-47e0-a000-c8af570c602c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:34.060396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a32f549-872f-47e0-a000-c8af570c602c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:34.072748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a32f549-872f-47e0-a000-c8af570c602c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:34.073445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a32f549-872f-47e0-a000-c8af570c602c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:34.088862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a32f549-872f-47e0-a000-c8af570c602c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:34.091744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a32f549-872f-47e0-a000-c8af570c602c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:34.581448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eab8485b-e37f-4533-9c10-641deeb0bc42 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:34.582681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eab8485b-e37f-4533-9c10-641deeb0bc42 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:34.594156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eab8485b-e37f-4533-9c10-641deeb0bc42 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:34.596176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eab8485b-e37f-4533-9c10-641deeb0bc42 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:34.597290 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eab8485b-e37f-4533-9c10-641deeb0bc42 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:34.600485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eab8485b-e37f-4533-9c10-641deeb0bc42 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:35.109285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4a32f549-872f-47e0-a000-c8af570c602c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:35.120018 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a32f549-872f-47e0-a000-c8af570c602c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 1.064724 Jul 26 20:12:35.120381 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2689/5298] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:34 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:35.133265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc42377d-67ff-43ab-9145-d5b11b011425 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:35.135968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bc42377d-67ff-43ab-9145-d5b11b011425 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:35.179091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc42377d-67ff-43ab-9145-d5b11b011425 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:35.179556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc42377d-67ff-43ab-9145-d5b11b011425 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:35.180406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc42377d-67ff-43ab-9145-d5b11b011425 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:35.180848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc42377d-67ff-43ab-9145-d5b11b011425 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:35.294885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eab8485b-e37f-4533-9c10-641deeb0bc42 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:35.306564 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eab8485b-e37f-4533-9c10-641deeb0bc42 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1676 microversion: 2.1 time: 0.729108 Jul 26 20:12:35.321062 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2610/5299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:34 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1676 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:36.144523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-529a9bb5-2c99-4b4e-94f0-35f7a6835378 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:36.145136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-529a9bb5-2c99-4b4e-94f0-35f7a6835378 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:36.182093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-529a9bb5-2c99-4b4e-94f0-35f7a6835378 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:36.183146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-529a9bb5-2c99-4b4e-94f0-35f7a6835378 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:36.188298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-529a9bb5-2c99-4b4e-94f0-35f7a6835378 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:36.193965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-529a9bb5-2c99-4b4e-94f0-35f7a6835378 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:36.238028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc42377d-67ff-43ab-9145-d5b11b011425 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e081d584b34009a7bbfbc2a6c14436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd237549546cf478aa27cf8759a57d4b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:36.248451 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc42377d-67ff-43ab-9145-d5b11b011425 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 200 len: 1549 microversion: 2.1 time: 1.118966 Jul 26 20:12:36.255286 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2690/5300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:35 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 1549 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:36.280735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-be5c431c-4b19-4ca1-b41f-0c7124973676 req-905ec762-c923-4b0c-acf9-4ef45f385dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84f3bbc-d80c-4e30-9f17-398e456677b6", "name": "network-vif-deleted", "tag": "ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:36.341572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-be5c431c-4b19-4ca1-b41f-0c7124973676 req-905ec762-c923-4b0c-acf9-4ef45f385dfa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:36.342493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-be5c431c-4b19-4ca1-b41f-0c7124973676 req-905ec762-c923-4b0c-acf9-4ef45f385dfa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:36.419778 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-be5c431c-4b19-4ca1-b41f-0c7124973676 req-905ec762-c923-4b0c-acf9-4ef45f385dfa service nova] Creating event network-vif-deleted:ec55d2ce-d0e9-4891-a4c0-b3a80d0f14d8 for instance f84f3bbc-d80c-4e30-9f17-398e456677b6 on n-h1-708768-8 Jul 26 20:12:36.450263 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-be5c431c-4b19-4ca1-b41f-0c7124973676 req-905ec762-c923-4b0c-acf9-4ef45f385dfa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190398 Jul 26 20:12:36.471706 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2691/5301] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:12:36.498749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-827ba64b-0d0f-4b3d-aa47-f457ab6b82fe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:36.509080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-827ba64b-0d0f-4b3d-aa47-f457ab6b82fe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:36.546598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-827ba64b-0d0f-4b3d-aa47-f457ab6b82fe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:36.556933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-827ba64b-0d0f-4b3d-aa47-f457ab6b82fe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:36.558088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-827ba64b-0d0f-4b3d-aa47-f457ab6b82fe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:36.567375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-827ba64b-0d0f-4b3d-aa47-f457ab6b82fe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:37.173822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-827ba64b-0d0f-4b3d-aa47-f457ab6b82fe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:37.187458 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-827ba64b-0d0f-4b3d-aa47-f457ab6b82fe tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1609 microversion: 2.1 time: 0.712534 Jul 26 20:12:37.189132 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2692/5302] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:36 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1609 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:37.294883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:37.295515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] [instance: f84f3bbc-d80c-4e30-9f17-398e456677b6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:37.315865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:37.325472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:37.326896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:37.328152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:37.375861 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] HTTP exception thrown: Instance f84f3bbc-d80c-4e30-9f17-398e456677b6 could not be found. Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Request method failure captured: Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 HTTP/1.1 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Emra4GorQ8XvMv1A1pbnI72q_Ba80k85Zd9_0bn15lWzhF2H4OWu3t7tjlR147aCswDQkYFlZiSO_S_OF90eXEgbT_FlfOPQscfID6Wbvl6M5-nTxfaJcADbN2d-6orndZkkSfQsd5gLaiFpOC3xwgx_Xv1iIE66EhrEP7PdZVS8Qs Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: d237549546cf478aa27cf8759a57d4b4 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d237549546cf478aa27cf8759a57d4b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d237549546cf478aa27cf8759a57d4b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d237549546cf478aa27cf8759a57d4b4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d237549546cf478aa27cf8759a57d4b4"}]}] Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: d237549546cf478aa27cf8759a57d4b4 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestNetworkBasicOps-2048669919 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestNetworkBasicOps-2048669919-project Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 84e081d584b34009a7bbfbc2a6c14436 Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestNetworkBasicOps-2048669919-project Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f84f3bbc-d80c-4e30-9f17-398e456677b6 could not be found. Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f84f3bbc-d80c-4e30-9f17-398e456677b6'} Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84f3bbc-d80c-4e30-9f17-398e456677b6 could not be found. Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84f3bbc-d80c-4e30-9f17-398e456677b6 could not be found. Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:37.381809 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:37.386639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:37.386639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:37.386639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:37.386639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:12:37.386639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:12:37.386639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84f3bbc-d80c-4e30-9f17-398e456677b6 could not be found. Jul 26 20:12:37.386639 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:37.392181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Returning 404 to user: Instance f84f3bbc-d80c-4e30-9f17-398e456677b6 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:12:37.396653 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1eff5675-b0b0-405d-9b80-1ed454f8dc42 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6" status: 404 len: 111 microversion: 2.1 time: 0.107008 Jul 26 20:12:37.399703 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2693/5303] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:37 2022] GET /compute/v2.1/servers/f84f3bbc-d80c-4e30-9f17-398e456677b6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:12:37.734170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-529a9bb5-2c99-4b4e-94f0-35f7a6835378 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:37.749946 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-529a9bb5-2c99-4b4e-94f0-35f7a6835378 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1528 microversion: 2.1 time: 1.603380 Jul 26 20:12:37.776556 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2611/5304] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:36 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1528 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:38.123636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c05bb02f-bff5-4cec-8ab3-39cd4aee46b5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] Calling method '.version_select at 0x7f87560ebc10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:38.196877 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c05bb02f-bff5-4cec-8ab3-39cd4aee46b5 tempest-TestNetworkBasicOps-2048669919 tempest-TestNetworkBasicOps-2048669919-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-288808652" status: 202 len: 0 microversion: 2.1 time: 0.080204 Jul 26 20:12:38.201874 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2694/5305] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Jul 26 20:12:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-288808652 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:12:38.212171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:38.213065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:38.229931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:38.230590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:38.236023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:38.240508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:38.374938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:38.375395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:38.379379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lazy-loading 'fault' on Instance uuid 3b78c879-17f2-46ef-a51b-c03307f19a5a {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:12:38.482000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418a0cb57744aa5a56a3fdcce0947cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7570797c1a94fbd94a4b7ee2796f526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:38.491887 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ad5d278f-1da6-47fa-8f56-4d126300245e tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 200 len: 1329 microversion: 2.1 time: 0.284685 Jul 26 20:12:38.496368 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2612/5306] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:38 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 1329 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:38.778407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-32b9248d-1b60-4886-a745-94322a4390f9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:38.779738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-32b9248d-1b60-4886-a745-94322a4390f9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:38.791023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32b9248d-1b60-4886-a745-94322a4390f9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:38.796017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32b9248d-1b60-4886-a745-94322a4390f9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:38.802024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32b9248d-1b60-4886-a745-94322a4390f9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:38.802800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-32b9248d-1b60-4886-a745-94322a4390f9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:38.879677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-072aca2a-6bab-46b5-877e-22609d5fcbf4 req-7e3d7c99-4f8b-45ad-a61e-af8765022b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b78c879-17f2-46ef-a51b-c03307f19a5a", "name": "network-vif-deleted", "tag": "716c767f-9c13-41d3-8b77-f94a01011e50"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:38.900554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-072aca2a-6bab-46b5-877e-22609d5fcbf4 req-7e3d7c99-4f8b-45ad-a61e-af8765022b3d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:38.901124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-072aca2a-6bab-46b5-877e-22609d5fcbf4 req-7e3d7c99-4f8b-45ad-a61e-af8765022b3d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:38.941871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-072aca2a-6bab-46b5-877e-22609d5fcbf4 req-7e3d7c99-4f8b-45ad-a61e-af8765022b3d service nova] Creating event network-vif-deleted:716c767f-9c13-41d3-8b77-f94a01011e50 for instance 3b78c879-17f2-46ef-a51b-c03307f19a5a on n-h1-708768-8 Jul 26 20:12:38.950982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-072aca2a-6bab-46b5-877e-22609d5fcbf4 req-7e3d7c99-4f8b-45ad-a61e-af8765022b3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074834 Jul 26 20:12:38.952290 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2613/5307] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:12:39.332125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-32b9248d-1b60-4886-a745-94322a4390f9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:39.340666 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-32b9248d-1b60-4886-a745-94322a4390f9 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1510 microversion: 2.1 time: 0.567180 Jul 26 20:12:39.346027 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2695/5308] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:38 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1510 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:39.531909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:39.532874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] [instance: 3b78c879-17f2-46ef-a51b-c03307f19a5a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:39.554429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:39.556035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:39.556907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:39.558184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:39.585350 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] HTTP exception thrown: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a could not be found. Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Request method failure captured: Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a HTTP/1.1 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ei0QX_lJ8whTwO9WSGuiAKHKrflLExw0BSW7z4oUba8si0AL2Ukxspb6VFnyhS6LCg0a8Dfdmuil90NN0QlrzOLQohElw745l5qLZNpFRC-CNaLF83G4OKB8E5U_7j0S5oTAasWoFwhJLV87nQ-FWOWeY6iqAS6y45nrPh2fHmcF9I Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7570797c1a94fbd94a4b7ee2796f526", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7570797c1a94fbd94a4b7ee2796f526"}]}] Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a7570797c1a94fbd94a4b7ee2796f526 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-927498204 Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 4418a0cb57744aa5a56a3fdcce0947cc Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-927498204-project Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a could not be found. Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '3b78c879-17f2-46ef-a51b-c03307f19a5a'} Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a could not be found. Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a could not be found. Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:39.591878 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:39.596448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:39.596448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:39.596448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:39.596448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:12:39.596448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:12:39.596448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a could not be found. Jul 26 20:12:39.596448 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:12:39.610490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Returning 404 to user: Instance 3b78c879-17f2-46ef-a51b-c03307f19a5a could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:12:39.611828 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ec2be4d-5c2d-453f-8adf-1ed4dde56465 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a" status: 404 len: 111 microversion: 2.1 time: 0.096908 Jul 26 20:12:39.612493 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2614/5309] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:39 2022] GET /compute/v2.1/servers/3b78c879-17f2-46ef-a51b-c03307f19a5a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:12:39.620802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9d2e17bc-6a28-4ce0-b244-5f0d59db5fc0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] Calling method '.version_select at 0x7f8756070040>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:39.667579 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9d2e17bc-6a28-4ce0-b244-5f0d59db5fc0 tempest-ServerActionsTestJSON-927498204 tempest-ServerActionsTestJSON-927498204-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651712900" status: 202 len: 0 microversion: 2.1 time: 0.050511 Jul 26 20:12:39.669262 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2696/5310] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 20:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651712900 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:12:40.374663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4c70331e-9ff2-404e-941a-11ebe6c4e83d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:40.375167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4c70331e-9ff2-404e-941a-11ebe6c4e83d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:40.388962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c70331e-9ff2-404e-941a-11ebe6c4e83d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:40.392039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c70331e-9ff2-404e-941a-11ebe6c4e83d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:40.397002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c70331e-9ff2-404e-941a-11ebe6c4e83d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:40.397499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c70331e-9ff2-404e-941a-11ebe6c4e83d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:40.894865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4c70331e-9ff2-404e-941a-11ebe6c4e83d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:40.906580 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4c70331e-9ff2-404e-941a-11ebe6c4e83d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1510 microversion: 2.1 time: 0.537261 Jul 26 20:12:40.909782 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2615/5311] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:40 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1510 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:41.931265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1c7cee8e-ee6b-49c9-abe5-222b7fb5021a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:41.941058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1c7cee8e-ee6b-49c9-abe5-222b7fb5021a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:41.964408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c7cee8e-ee6b-49c9-abe5-222b7fb5021a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:41.964850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c7cee8e-ee6b-49c9-abe5-222b7fb5021a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:41.966235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c7cee8e-ee6b-49c9-abe5-222b7fb5021a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:41.981386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c7cee8e-ee6b-49c9-abe5-222b7fb5021a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:42.461802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1c7cee8e-ee6b-49c9-abe5-222b7fb5021a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:42.485415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1c7cee8e-ee6b-49c9-abe5-222b7fb5021a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1510 microversion: 2.1 time: 0.557861 Jul 26 20:12:42.490784 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2697/5312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:41 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1510 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:42.692145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4dd0a37f-1bc6-4237-bc50-775caa85c313 req-78b5d349-fdb5-4df0-acf5-f60d31bc127b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f", "name": "network-vif-unplugged", "status": "completed", "tag": "2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:42.714622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4dd0a37f-1bc6-4237-bc50-775caa85c313 req-78b5d349-fdb5-4df0-acf5-f60d31bc127b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:42.715358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4dd0a37f-1bc6-4237-bc50-775caa85c313 req-78b5d349-fdb5-4df0-acf5-f60d31bc127b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:42.745865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.compute.server_external_events [req-4dd0a37f-1bc6-4237-bc50-775caa85c313 req-78b5d349-fdb5-4df0-acf5-f60d31bc127b service nova] Unable to find a host for instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f. Dropping event network-vif-unplugged {{(pid=125963) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 20:12:42.747666 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4dd0a37f-1bc6-4237-bc50-775caa85c313 req-78b5d349-fdb5-4df0-acf5-f60d31bc127b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060438 Jul 26 20:12:42.748375 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2616/5313] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 20:12:43.515465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c0545cf-968a-465b-9655-7eb55b271cea tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:43.516123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c0545cf-968a-465b-9655-7eb55b271cea tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:43.532696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c0545cf-968a-465b-9655-7eb55b271cea tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:43.533180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c0545cf-968a-465b-9655-7eb55b271cea tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:43.533974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c0545cf-968a-465b-9655-7eb55b271cea tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:43.534416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c0545cf-968a-465b-9655-7eb55b271cea tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:44.163941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c0545cf-968a-465b-9655-7eb55b271cea tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:44.182371 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c0545cf-968a-465b-9655-7eb55b271cea tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1453 microversion: 2.1 time: 0.671219 Jul 26 20:12:44.191429 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2698/5314] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:43 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1453 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:44.212614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f49dd50c-a06f-42f9-b0c2-3bb49bb19122 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:44.213751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f49dd50c-a06f-42f9-b0c2-3bb49bb19122 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:44.235506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f49dd50c-a06f-42f9-b0c2-3bb49bb19122 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:44.236214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f49dd50c-a06f-42f9-b0c2-3bb49bb19122 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:44.237543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f49dd50c-a06f-42f9-b0c2-3bb49bb19122 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:44.238412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f49dd50c-a06f-42f9-b0c2-3bb49bb19122 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:44.852132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f49dd50c-a06f-42f9-b0c2-3bb49bb19122 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:44.874406 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f49dd50c-a06f-42f9-b0c2-3bb49bb19122 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1453 microversion: 2.1 time: 0.669627 Jul 26 20:12:44.883810 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2617/5315] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:44 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1453 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:44.951436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:44.952059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:44.973112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:44.973647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:44.974868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:44.985295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:45.023900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lazy-loading 'flavor' on Instance uuid 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:12:45.052102 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Cannot 'shelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state shelved_offloaded Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action HTTP/1.1 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 14 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: {"shelve": {}} Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'shelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state shelved_offloaded Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'shelve': {}}} Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 26 20:12:45.059810 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state shelved_offloaded Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state shelved_offloaded Jul 26 20:12:45.070055 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:12:45.077363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 409 to user: Cannot 'shelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state shelved_offloaded {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:12:45.078510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d0deaf28-5d3c-4446-a760-6c9f9a5ef15d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 409 len: 155 microversion: 2.1 time: 0.131716 Jul 26 20:12:45.079583 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2699/5316] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:12:44 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 155 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 20:12:45.088357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c52aaa1f-558c-424b-a5de-10fce017869f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:45.089078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c52aaa1f-558c-424b-a5de-10fce017869f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:45.099091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c52aaa1f-558c-424b-a5de-10fce017869f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:45.104181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c52aaa1f-558c-424b-a5de-10fce017869f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:45.105162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c52aaa1f-558c-424b-a5de-10fce017869f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:45.112041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c52aaa1f-558c-424b-a5de-10fce017869f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:45.345973 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c52aaa1f-558c-424b-a5de-10fce017869f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 202 len: 0 microversion: 2.1 time: 0.261432 Jul 26 20:12:45.350545 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2618/5317] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:12:45 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:12:45.359854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0eec7603-e877-4dc7-8c93-4e2027ad504b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:45.360961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0eec7603-e877-4dc7-8c93-4e2027ad504b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:45.365842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=5,nova_api:DELETE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:45.389780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0eec7603-e877-4dc7-8c93-4e2027ad504b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:45.390240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0eec7603-e877-4dc7-8c93-4e2027ad504b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:45.401801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0eec7603-e877-4dc7-8c93-4e2027ad504b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:45.402315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0eec7603-e877-4dc7-8c93-4e2027ad504b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:46.354674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0eec7603-e877-4dc7-8c93-4e2027ad504b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:46.373866 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0eec7603-e877-4dc7-8c93-4e2027ad504b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1461 microversion: 2.1 time: 1.017786 Jul 26 20:12:46.376433 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2700/5318] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:45 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1461 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:47.403261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df694e86-6abc-4d61-b929-bbb1dbd4acf2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:47.404060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-df694e86-6abc-4d61-b929-bbb1dbd4acf2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:47.422309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df694e86-6abc-4d61-b929-bbb1dbd4acf2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:47.423033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df694e86-6abc-4d61-b929-bbb1dbd4acf2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:47.432734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df694e86-6abc-4d61-b929-bbb1dbd4acf2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:47.433250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df694e86-6abc-4d61-b929-bbb1dbd4acf2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:48.186425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-df694e86-6abc-4d61-b929-bbb1dbd4acf2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:48.195768 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df694e86-6abc-4d61-b929-bbb1dbd4acf2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1461 microversion: 2.1 time: 0.798335 Jul 26 20:12:48.202124 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2619/5319] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:47 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1461 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:49.229514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79c5daa7-78ba-4b51-9ed8-e07d309a8c96 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:49.232381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-79c5daa7-78ba-4b51-9ed8-e07d309a8c96 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:49.248272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79c5daa7-78ba-4b51-9ed8-e07d309a8c96 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:49.252578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79c5daa7-78ba-4b51-9ed8-e07d309a8c96 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:49.254873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79c5daa7-78ba-4b51-9ed8-e07d309a8c96 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:49.256656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79c5daa7-78ba-4b51-9ed8-e07d309a8c96 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:50.002916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79c5daa7-78ba-4b51-9ed8-e07d309a8c96 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:50.015485 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79c5daa7-78ba-4b51-9ed8-e07d309a8c96 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.792845 Jul 26 20:12:50.018382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2701/5320] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:49 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:51.051248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-94dbb5fd-01cb-41f5-ac50-7cf953c865d7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:51.052897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-94dbb5fd-01cb-41f5-ac50-7cf953c865d7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:51.067713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94dbb5fd-01cb-41f5-ac50-7cf953c865d7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:51.068481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94dbb5fd-01cb-41f5-ac50-7cf953c865d7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:51.072001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94dbb5fd-01cb-41f5-ac50-7cf953c865d7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:51.073643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-94dbb5fd-01cb-41f5-ac50-7cf953c865d7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:51.536257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-89dd9dc7-bfef-4ec8-a675-1c7ff4b861af req-1670d9da-27a1-4353-87fa-b4499aa8ca0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f", "tag": "2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:12:51.553944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-89dd9dc7-bfef-4ec8-a675-1c7ff4b861af req-1670d9da-27a1-4353-87fa-b4499aa8ca0f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:51.554760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-89dd9dc7-bfef-4ec8-a675-1c7ff4b861af req-1670d9da-27a1-4353-87fa-b4499aa8ca0f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:51.581717 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-89dd9dc7-bfef-4ec8-a675-1c7ff4b861af req-1670d9da-27a1-4353-87fa-b4499aa8ca0f service nova] Creating event network-changed:2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c for instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f on n-h1-708768-8 Jul 26 20:12:51.591132 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-89dd9dc7-bfef-4ec8-a675-1c7ff4b861af req-1670d9da-27a1-4353-87fa-b4499aa8ca0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067841 Jul 26 20:12:51.592967 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2702/5321] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:12:51.875750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-94dbb5fd-01cb-41f5-ac50-7cf953c865d7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:51.883421 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-94dbb5fd-01cb-41f5-ac50-7cf953c865d7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.843660 Jul 26 20:12:51.884040 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2620/5322] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:51 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:52.914233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dad4e7f5-f17c-4f9b-9251-774f3f47d887 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:52.915541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dad4e7f5-f17c-4f9b-9251-774f3f47d887 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:52.944723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dad4e7f5-f17c-4f9b-9251-774f3f47d887 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:52.946978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dad4e7f5-f17c-4f9b-9251-774f3f47d887 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:52.950609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dad4e7f5-f17c-4f9b-9251-774f3f47d887 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:52.953780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dad4e7f5-f17c-4f9b-9251-774f3f47d887 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:53.439637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dad4e7f5-f17c-4f9b-9251-774f3f47d887 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:53.452839 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dad4e7f5-f17c-4f9b-9251-774f3f47d887 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.539822 Jul 26 20:12:53.453650 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2703/5323] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:52 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:54.474985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0915ac2-7725-4ead-a072-46cb32e1e545 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:54.476231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0915ac2-7725-4ead-a072-46cb32e1e545 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:54.497325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0915ac2-7725-4ead-a072-46cb32e1e545 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:54.498631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0915ac2-7725-4ead-a072-46cb32e1e545 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:54.500488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0915ac2-7725-4ead-a072-46cb32e1e545 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:54.502098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0915ac2-7725-4ead-a072-46cb32e1e545 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:54.546431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:54.752538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e0915ac2-7725-4ead-a072-46cb32e1e545 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:54.763671 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0915ac2-7725-4ead-a072-46cb32e1e545 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.292937 Jul 26 20:12:54.764527 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2621/5324] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:54 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:12:55.794190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0cf4d5f4-07ed-44d0-a5f9-43b63c4e459a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:55.795453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0cf4d5f4-07ed-44d0-a5f9-43b63c4e459a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:55.823498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cf4d5f4-07ed-44d0-a5f9-43b63c4e459a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:55.825007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cf4d5f4-07ed-44d0-a5f9-43b63c4e459a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:55.829415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cf4d5f4-07ed-44d0-a5f9-43b63c4e459a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:55.834618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cf4d5f4-07ed-44d0-a5f9-43b63c4e459a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:56.193330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0cf4d5f4-07ed-44d0-a5f9-43b63c4e459a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:56.208138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:56.212267 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0cf4d5f4-07ed-44d0-a5f9-43b63c4e459a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.426397 Jul 26 20:12:56.214395 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2704/5325] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:55 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:57.247012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-325a281f-9d91-481b-b7d6-4a649216e6f1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:57.248497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-325a281f-9d91-481b-b7d6-4a649216e6f1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:57.254028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:12:57.274177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-325a281f-9d91-481b-b7d6-4a649216e6f1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:57.274977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-325a281f-9d91-481b-b7d6-4a649216e6f1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:57.279676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-325a281f-9d91-481b-b7d6-4a649216e6f1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:57.281707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-325a281f-9d91-481b-b7d6-4a649216e6f1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:57.734982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-325a281f-9d91-481b-b7d6-4a649216e6f1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:57.745988 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-325a281f-9d91-481b-b7d6-4a649216e6f1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.506489 Jul 26 20:12:57.764433 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2622/5326] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:57 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:12:58.769353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7dd4fa03-5262-476d-9617-a80331220c53 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:12:58.771172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7dd4fa03-5262-476d-9617-a80331220c53 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:12:58.787977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dd4fa03-5262-476d-9617-a80331220c53 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:58.788685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dd4fa03-5262-476d-9617-a80331220c53 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:58.789652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dd4fa03-5262-476d-9617-a80331220c53 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:12:58.790242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dd4fa03-5262-476d-9617-a80331220c53 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:12:59.482340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7dd4fa03-5262-476d-9617-a80331220c53 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:12:59.490533 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7dd4fa03-5262-476d-9617-a80331220c53 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.724956 Jul 26 20:12:59.493862 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2705/5327] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:12:58 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:00.530069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eede5ee7-bc91-4ce0-87ff-2d6242b43a7c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:00.531386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eede5ee7-bc91-4ce0-87ff-2d6242b43a7c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:00.544203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eede5ee7-bc91-4ce0-87ff-2d6242b43a7c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:00.547266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eede5ee7-bc91-4ce0-87ff-2d6242b43a7c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:00.551405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eede5ee7-bc91-4ce0-87ff-2d6242b43a7c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:00.552195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eede5ee7-bc91-4ce0-87ff-2d6242b43a7c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:01.257729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eede5ee7-bc91-4ce0-87ff-2d6242b43a7c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:01.278623 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eede5ee7-bc91-4ce0-87ff-2d6242b43a7c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.758160 Jul 26 20:13:01.284200 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2623/5328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:00 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:02.312688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2f41080-2fcd-4103-ae0b-4a3ffad808ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:02.313581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f2f41080-2fcd-4103-ae0b-4a3ffad808ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:02.335002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f41080-2fcd-4103-ae0b-4a3ffad808ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:02.335974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f41080-2fcd-4103-ae0b-4a3ffad808ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:02.340392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f41080-2fcd-4103-ae0b-4a3ffad808ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:02.345992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f41080-2fcd-4103-ae0b-4a3ffad808ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:02.799006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f2f41080-2fcd-4103-ae0b-4a3ffad808ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:02.816942 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f2f41080-2fcd-4103-ae0b-4a3ffad808ff tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.509597 Jul 26 20:13:02.820175 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2706/5329] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:02 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:03.842578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-06283f83-3f9d-448d-ad3c-bd2e033c24c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:03.843222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-06283f83-3f9d-448d-ad3c-bd2e033c24c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:03.867802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06283f83-3f9d-448d-ad3c-bd2e033c24c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:03.868292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06283f83-3f9d-448d-ad3c-bd2e033c24c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:03.881655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06283f83-3f9d-448d-ad3c-bd2e033c24c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:03.883432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06283f83-3f9d-448d-ad3c-bd2e033c24c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:04.912669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-06283f83-3f9d-448d-ad3c-bd2e033c24c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:04.925841 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-06283f83-3f9d-448d-ad3c-bd2e033c24c8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 1.087991 Jul 26 20:13:04.926688 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2624/5330] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:03 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:05.950457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-31b81ad1-c581-4022-86f3-12e0b5f4f9e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:05.951780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-31b81ad1-c581-4022-86f3-12e0b5f4f9e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:05.966547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31b81ad1-c581-4022-86f3-12e0b5f4f9e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:05.969486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31b81ad1-c581-4022-86f3-12e0b5f4f9e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:05.973676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31b81ad1-c581-4022-86f3-12e0b5f4f9e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:05.974342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31b81ad1-c581-4022-86f3-12e0b5f4f9e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:06.190915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1682596513", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:06.894910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:13:07.934558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:13:07.935258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:13:07.935570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:13:07.936069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:13:07.936553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:13:07.956606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:07.957889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:07.961333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:07.964641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:08.060523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Getting quotas for project 0903a9d69c6841f589a47fecec113c2b. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:13:08.084815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Getting quotas for user a8ab9438322a4b68ad4e7177405d5e31 and project 0903a9d69c6841f589a47fecec113c2b. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:13:08.134143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:13:08.142610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:13:08.273109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cfca8bff-7660-4e09-b644-6ea3d9fc09fd tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.085867 Jul 26 20:13:08.279133 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2625/5331] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:13:08.289744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e5097b02-d263-48f7-8de3-bfe03fdaa83e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:08.294924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e5097b02-d263-48f7-8de3-bfe03fdaa83e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:08.424311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e5097b02-d263-48f7-8de3-bfe03fdaa83e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:08.435573 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e5097b02-d263-48f7-8de3-bfe03fdaa83e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1215 microversion: 2.1 time: 0.149630 Jul 26 20:13:08.439945 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2626/5332] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:08 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:08.474231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-31b81ad1-c581-4022-86f3-12e0b5f4f9e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:08.483191 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-31b81ad1-c581-4022-86f3-12e0b5f4f9e6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 2.536608 Jul 26 20:13:08.488672 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2707/5333] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:05 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:09.470803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2339c52c-a87e-47ff-a5b4-1b924735601e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:09.473572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2339c52c-a87e-47ff-a5b4-1b924735601e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:09.511193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fccaea16-35ae-4c98-9556-951a6811ecd1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:09.512111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fccaea16-35ae-4c98-9556-951a6811ecd1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:09.530828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2339c52c-a87e-47ff-a5b4-1b924735601e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:09.534557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fccaea16-35ae-4c98-9556-951a6811ecd1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:09.535199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2339c52c-a87e-47ff-a5b4-1b924735601e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:09.544207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fccaea16-35ae-4c98-9556-951a6811ecd1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:09.544771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2339c52c-a87e-47ff-a5b4-1b924735601e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:09.545693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fccaea16-35ae-4c98-9556-951a6811ecd1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:09.546888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2339c52c-a87e-47ff-a5b4-1b924735601e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:09.550535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fccaea16-35ae-4c98-9556-951a6811ecd1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:09.838084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2339c52c-a87e-47ff-a5b4-1b924735601e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:09.871192 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2339c52c-a87e-47ff-a5b4-1b924735601e tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1219 microversion: 2.1 time: 0.407203 Jul 26 20:13:09.900869 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2627/5334] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:09 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1219 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:10.917326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-839f31c1-9969-417c-a1b6-0b55c304bb62 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:10.918196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-839f31c1-9969-417c-a1b6-0b55c304bb62 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:10.927571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-839f31c1-9969-417c-a1b6-0b55c304bb62 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:10.928391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-839f31c1-9969-417c-a1b6-0b55c304bb62 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:10.937149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-839f31c1-9969-417c-a1b6-0b55c304bb62 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:10.937692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-839f31c1-9969-417c-a1b6-0b55c304bb62 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:11.078151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fccaea16-35ae-4c98-9556-951a6811ecd1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:11.086869 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fccaea16-35ae-4c98-9556-951a6811ecd1 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 1.581922 Jul 26 20:13:11.089755 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2708/5335] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:09 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:11.136335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-839f31c1-9969-417c-a1b6-0b55c304bb62 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:11.149330 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-839f31c1-9969-417c-a1b6-0b55c304bb62 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1285 microversion: 2.1 time: 0.236119 Jul 26 20:13:11.153999 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2628/5336] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:10 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:12.112080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ed20491-3700-41b2-ac84-78869eb529ed tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:12.113376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ed20491-3700-41b2-ac84-78869eb529ed tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:12.139981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed20491-3700-41b2-ac84-78869eb529ed tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:12.140551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed20491-3700-41b2-ac84-78869eb529ed tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:12.141482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed20491-3700-41b2-ac84-78869eb529ed tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:12.142500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed20491-3700-41b2-ac84-78869eb529ed tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:12.176128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a189071b-5f6b-4d03-859f-25c466dab4cc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:12.177050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a189071b-5f6b-4d03-859f-25c466dab4cc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:12.189434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a189071b-5f6b-4d03-859f-25c466dab4cc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:12.197559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a189071b-5f6b-4d03-859f-25c466dab4cc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:12.200665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a189071b-5f6b-4d03-859f-25c466dab4cc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:12.201376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a189071b-5f6b-4d03-859f-25c466dab4cc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:12.393199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a189071b-5f6b-4d03-859f-25c466dab4cc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:12.412193 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a189071b-5f6b-4d03-859f-25c466dab4cc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1273 microversion: 2.1 time: 0.240168 Jul 26 20:13:12.414842 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2629/5337] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:12 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:12.764146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ed20491-3700-41b2-ac84-78869eb529ed tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:12.777785 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ed20491-3700-41b2-ac84-78869eb529ed tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.669555 Jul 26 20:13:12.781225 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2709/5338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:12 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:12.991066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1782198924", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "89078e91-32b4-4b91-a44c-c36191f6f156"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:13.085350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] validate_networks() for [('89078e91-32b4-4b91-a44c-c36191f6f156', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:13:13.441037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-532ffd51-ebf4-4150-8a8d-8f63b2581845 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:13.442519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-532ffd51-ebf4-4150-8a8d-8f63b2581845 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:13.467312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-532ffd51-ebf4-4150-8a8d-8f63b2581845 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:13.468173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-532ffd51-ebf4-4150-8a8d-8f63b2581845 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:13.469329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-532ffd51-ebf4-4150-8a8d-8f63b2581845 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:13.469984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-532ffd51-ebf4-4150-8a8d-8f63b2581845 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:13.860025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-532ffd51-ebf4-4150-8a8d-8f63b2581845 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:13.872342 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-532ffd51-ebf4-4150-8a8d-8f63b2581845 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.437502 Jul 26 20:13:13.894088 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2710/5339] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:13 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:13.906428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56d23839-899c-4d76-b69b-8d0e8c2b51f5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:13.906979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56d23839-899c-4d76-b69b-8d0e8c2b51f5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:13.941948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56d23839-899c-4d76-b69b-8d0e8c2b51f5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:13.950267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56d23839-899c-4d76-b69b-8d0e8c2b51f5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:13.952403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56d23839-899c-4d76-b69b-8d0e8c2b51f5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:13.957242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56d23839-899c-4d76-b69b-8d0e8c2b51f5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:14.673737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56d23839-899c-4d76-b69b-8d0e8c2b51f5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:14.684628 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56d23839-899c-4d76-b69b-8d0e8c2b51f5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.789279 Jul 26 20:13:14.685770 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2711/5340] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:13 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:14.785416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1171230997", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "faa6e876-93f3-4914-bf9a-60c7a88b9eec"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:14.869143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] validate_networks() for [('faa6e876-93f3-4914-bf9a-60c7a88b9eec', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:13:15.596510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:13:15.597196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:13:15.597633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:13:15.598240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:13:15.599490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:13:15.604035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=26 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:15.612387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:15.613466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:15.614487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:15.615171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:15.646359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Getting quotas for project 7d49a0ff8af1479580076bccd62001ac. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:13:15.662483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Getting quotas for user 6aa0c11b139d459799360eec098cabb4 and project 7d49a0ff8af1479580076bccd62001ac. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:13:15.680239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:13:15.683393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:13:15.763581 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dba5adc5-3c15-4898-adfb-f2d0a332be72 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073500 Jul 26 20:13:15.765431 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2712/5341] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:13:15.767774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:13:15.768276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:13:15.768982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:13:15.769635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:13:15.770266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:13:15.794724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:15.799201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-141a04e7-548f-49a3-862e-938cdecfa3ce tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:15.800420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-141a04e7-548f-49a3-862e-938cdecfa3ce tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:15.810560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:15.814330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:15.816139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:15.818004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-141a04e7-548f-49a3-862e-938cdecfa3ce tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:15.818619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-141a04e7-548f-49a3-862e-938cdecfa3ce tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:15.821537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-141a04e7-548f-49a3-862e-938cdecfa3ce tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:15.822453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-141a04e7-548f-49a3-862e-938cdecfa3ce tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:15.864405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Getting quotas for project 2642dbdbd38441c29901c098bebaecb2. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:13:15.870432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Getting quotas for user 763138aad438422995f86c67ac9504f6 and project 2642dbdbd38441c29901c098bebaecb2. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:13:15.886239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:13:15.888922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:13:15.980076 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90c39a78-aa5a-4091-ae1e-7ad550434fef tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.244109 Jul 26 20:13:15.983648 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2630/5342] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:13:15.997049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d43de97-2833-470f-ae17-ea69a96e72e0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:15.998124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d43de97-2833-470f-ae17-ea69a96e72e0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:16.018557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d43de97-2833-470f-ae17-ea69a96e72e0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:16.019562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d43de97-2833-470f-ae17-ea69a96e72e0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:16.022505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d43de97-2833-470f-ae17-ea69a96e72e0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:16.024306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d43de97-2833-470f-ae17-ea69a96e72e0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:16.197809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-141a04e7-548f-49a3-862e-938cdecfa3ce tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:16.207446 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-141a04e7-548f-49a3-862e-938cdecfa3ce tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.417771 Jul 26 20:13:16.213819 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2713/5343] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:15 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:16.228794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45405ec9-f6ff-40d9-9a95-bc997ccddba0 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:16.229839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45405ec9-f6ff-40d9-9a95-bc997ccddba0 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:16.351193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45405ec9-f6ff-40d9-9a95-bc997ccddba0 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:16.372077 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45405ec9-f6ff-40d9-9a95-bc997ccddba0 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1214 microversion: 2.1 time: 0.145435 Jul 26 20:13:16.372696 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2714/5344] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:16 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:16.390814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7507da02-fb39-4108-9b76-cee2ab08d116 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:16.393754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7507da02-fb39-4108-9b76-cee2ab08d116 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:16.544571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7507da02-fb39-4108-9b76-cee2ab08d116 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:16.579596 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7507da02-fb39-4108-9b76-cee2ab08d116 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1217 microversion: 2.1 time: 0.184945 Jul 26 20:13:16.597031 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2715/5345] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:16 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1217 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:17.071463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2026620867", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "fbabf6cd-fa37-49c6-aea6-affe8c85dfb8"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:17.078349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d43de97-2833-470f-ae17-ea69a96e72e0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:17.098978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d43de97-2833-470f-ae17-ea69a96e72e0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 1.113531 Jul 26 20:13:17.125292 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2631/5346] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:15 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:17.201883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] validate_networks() for [('fbabf6cd-fa37-49c6-aea6-affe8c85dfb8', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:13:17.236901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-62c95ce2-7e25-4f8d-8f6a-1b3662fdf4c4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:17.238121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-62c95ce2-7e25-4f8d-8f6a-1b3662fdf4c4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:17.250507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62c95ce2-7e25-4f8d-8f6a-1b3662fdf4c4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:17.263938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62c95ce2-7e25-4f8d-8f6a-1b3662fdf4c4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:17.265697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62c95ce2-7e25-4f8d-8f6a-1b3662fdf4c4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:17.268929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62c95ce2-7e25-4f8d-8f6a-1b3662fdf4c4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:17.688822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-62c95ce2-7e25-4f8d-8f6a-1b3662fdf4c4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:17.699734 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-62c95ce2-7e25-4f8d-8f6a-1b3662fdf4c4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.468907 Jul 26 20:13:17.702892 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2632/5347] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:17 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:17.718988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c35d5d6-e066-494f-b985-3a94483ae9c5 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:17.720222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c35d5d6-e066-494f-b985-3a94483ae9c5 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:17.735410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c35d5d6-e066-494f-b985-3a94483ae9c5 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:17.735872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c35d5d6-e066-494f-b985-3a94483ae9c5 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:17.736656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c35d5d6-e066-494f-b985-3a94483ae9c5 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:17.737089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c35d5d6-e066-494f-b985-3a94483ae9c5 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:17.885731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c35d5d6-e066-494f-b985-3a94483ae9c5 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:17.897874 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c35d5d6-e066-494f-b985-3a94483ae9c5 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1266 microversion: 2.1 time: 0.193429 Jul 26 20:13:17.898874 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2633/5348] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:17 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:17.936943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b6e83589-7c0c-466a-b20e-12bd75adeace req-4812c401-b4fe-4f33-9d4d-97e6e54058d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f", "name": "network-vif-plugged", "status": "completed", "tag": "2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:17.971019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b6e83589-7c0c-466a-b20e-12bd75adeace req-4812c401-b4fe-4f33-9d4d-97e6e54058d2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:17.973814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b6e83589-7c0c-466a-b20e-12bd75adeace req-4812c401-b4fe-4f33-9d4d-97e6e54058d2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:17.998034 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b6e83589-7c0c-466a-b20e-12bd75adeace req-4812c401-b4fe-4f33-9d4d-97e6e54058d2 service nova] Creating event network-vif-plugged:2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c for instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f on n-h1-708768-8 Jul 26 20:13:18.010994 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b6e83589-7c0c-466a-b20e-12bd75adeace req-4812c401-b4fe-4f33-9d4d-97e6e54058d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096592 Jul 26 20:13:18.012829 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2634/5349] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:18.026620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-277e6d00-af26-46da-8c1e-5f3fb21749e8 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:18.029285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-277e6d00-af26-46da-8c1e-5f3fb21749e8 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:18.045371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-277e6d00-af26-46da-8c1e-5f3fb21749e8 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.046319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-277e6d00-af26-46da-8c1e-5f3fb21749e8 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:18.049271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-277e6d00-af26-46da-8c1e-5f3fb21749e8 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.049965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-277e6d00-af26-46da-8c1e-5f3fb21749e8 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:18.354978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-277e6d00-af26-46da-8c1e-5f3fb21749e8 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:18.390610 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-277e6d00-af26-46da-8c1e-5f3fb21749e8 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1277 microversion: 2.1 time: 0.374804 Jul 26 20:13:18.391448 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2635/5350] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:18 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1277 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:18.400683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-baaa1619-85d2-483a-8675-b8f5344173d0 req-fbc35258-1755-480f-bc54-00fcbbf45d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e8d96b-ad68-4918-b50c-63775a17cead", "tag": "e80d999c-8515-45a3-ab1d-634fa7e33baf"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:18.429063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-baaa1619-85d2-483a-8675-b8f5344173d0 req-fbc35258-1755-480f-bc54-00fcbbf45d6e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.430447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-baaa1619-85d2-483a-8675-b8f5344173d0 req-fbc35258-1755-480f-bc54-00fcbbf45d6e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:18.457407 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-baaa1619-85d2-483a-8675-b8f5344173d0 req-fbc35258-1755-480f-bc54-00fcbbf45d6e service nova] Creating event network-changed:e80d999c-8515-45a3-ab1d-634fa7e33baf for instance 25e8d96b-ad68-4918-b50c-63775a17cead on n-h2-708768-8 Jul 26 20:13:18.459072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:13:18.459552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:13:18.460204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:13:18.460738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:13:18.462791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:13:18.465434 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-baaa1619-85d2-483a-8675-b8f5344173d0 req-fbc35258-1755-480f-bc54-00fcbbf45d6e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071833 Jul 26 20:13:18.466610 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2636/5351] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:18.477171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc443169-3ae5-418a-95d0-434def969de3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:18.478191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc443169-3ae5-418a-95d0-434def969de3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:18.482377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.482947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:18.484909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc443169-3ae5-418a-95d0-434def969de3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.485497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.485983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc443169-3ae5-418a-95d0-434def969de3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:18.487330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc443169-3ae5-418a-95d0-434def969de3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.487485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:18.487822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc443169-3ae5-418a-95d0-434def969de3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:18.533910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Getting quotas for project b7e44aa18a2d491eac66171ec892b99c. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:13:18.546428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Getting quotas for user 2b4a000a62184f3bbde21b85bdb0a3fa and project b7e44aa18a2d491eac66171ec892b99c. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:13:18.576300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:13:18.599855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:13:18.672742 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-505ceb6d-1b60-48a3-9bc6-009ddff22d04 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.794088 Jul 26 20:13:18.680688 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2716/5352] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:13:18.686702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-76f9001d-8824-47c7-8694-b9a9dd6bb898 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:18.687599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-76f9001d-8824-47c7-8694-b9a9dd6bb898 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:18.880799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-76f9001d-8824-47c7-8694-b9a9dd6bb898 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:18.889332 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-76f9001d-8824-47c7-8694-b9a9dd6bb898 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1215 microversion: 2.1 time: 0.206978 Jul 26 20:13:18.904148 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2717/5353] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:18 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:18.937714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11fd5f5e-7b56-4895-95f7-ff670ae38103 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:18.938344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11fd5f5e-7b56-4895-95f7-ff670ae38103 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:18.962961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11fd5f5e-7b56-4895-95f7-ff670ae38103 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.966602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11fd5f5e-7b56-4895-95f7-ff670ae38103 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:18.968568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11fd5f5e-7b56-4895-95f7-ff670ae38103 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:18.970640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11fd5f5e-7b56-4895-95f7-ff670ae38103 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:19.372786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fc443169-3ae5-418a-95d0-434def969de3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:19.381445 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc443169-3ae5-418a-95d0-434def969de3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.913419 Jul 26 20:13:19.383304 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2637/5354] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:18 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:19.409086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-40aed10d-404a-4e0d-aee1-6d275d38b687 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:19.412578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40aed10d-404a-4e0d-aee1-6d275d38b687 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:19.430020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40aed10d-404a-4e0d-aee1-6d275d38b687 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:19.435969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40aed10d-404a-4e0d-aee1-6d275d38b687 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:19.442104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40aed10d-404a-4e0d-aee1-6d275d38b687 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:19.442763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40aed10d-404a-4e0d-aee1-6d275d38b687 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:19.444361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11fd5f5e-7b56-4895-95f7-ff670ae38103 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:19.456730 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11fd5f5e-7b56-4895-95f7-ff670ae38103 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.549906 Jul 26 20:13:19.457332 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2718/5355] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:18 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:19.466657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-18325ec8-af54-4740-bd20-d51a32a033f9 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:19.467333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-18325ec8-af54-4740-bd20-d51a32a033f9 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:19.498319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18325ec8-af54-4740-bd20-d51a32a033f9 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:19.498876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18325ec8-af54-4740-bd20-d51a32a033f9 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:19.500426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18325ec8-af54-4740-bd20-d51a32a033f9 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:19.501505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-18325ec8-af54-4740-bd20-d51a32a033f9 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:19.595254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-18325ec8-af54-4740-bd20-d51a32a033f9 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:19.605638 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-18325ec8-af54-4740-bd20-d51a32a033f9 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1275 microversion: 2.1 time: 0.146339 Jul 26 20:13:19.606947 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2719/5356] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:19 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:19.912488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-04c9db44-3b3d-4764-b1ae-49977aa44169 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:19.913114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-04c9db44-3b3d-4764-b1ae-49977aa44169 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:19.923364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04c9db44-3b3d-4764-b1ae-49977aa44169 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:19.932475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04c9db44-3b3d-4764-b1ae-49977aa44169 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:19.944676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04c9db44-3b3d-4764-b1ae-49977aa44169 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:19.946267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04c9db44-3b3d-4764-b1ae-49977aa44169 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:20.010043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-40aed10d-404a-4e0d-aee1-6d275d38b687 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:20.040253 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-40aed10d-404a-4e0d-aee1-6d275d38b687 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1272 microversion: 2.1 time: 0.628814 Jul 26 20:13:20.051129 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2638/5357] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:19 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1272 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:20.076764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-04c9db44-3b3d-4764-b1ae-49977aa44169 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:20.091003 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-04c9db44-3b3d-4764-b1ae-49977aa44169 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1267 microversion: 2.1 time: 0.181154 Jul 26 20:13:20.105898 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2720/5358] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:19 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:20.406944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-53d2f660-ebd2-4d1b-ab1b-297e4feb501b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:20.407560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-53d2f660-ebd2-4d1b-ab1b-297e4feb501b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:20.422562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53d2f660-ebd2-4d1b-ab1b-297e4feb501b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:20.423017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53d2f660-ebd2-4d1b-ab1b-297e4feb501b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:20.424104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53d2f660-ebd2-4d1b-ab1b-297e4feb501b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:20.424543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53d2f660-ebd2-4d1b-ab1b-297e4feb501b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:20.482218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0046974e-5957-4f1d-bb2b-75bdfc7e481c tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:20.483061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0046974e-5957-4f1d-bb2b-75bdfc7e481c tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:20.495822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0046974e-5957-4f1d-bb2b-75bdfc7e481c tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:20.496725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0046974e-5957-4f1d-bb2b-75bdfc7e481c tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:20.497890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0046974e-5957-4f1d-bb2b-75bdfc7e481c tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:20.498445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0046974e-5957-4f1d-bb2b-75bdfc7e481c tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:20.683064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0046974e-5957-4f1d-bb2b-75bdfc7e481c tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:20.692136 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0046974e-5957-4f1d-bb2b-75bdfc7e481c tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.217275 Jul 26 20:13:20.705335 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2721/5359] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:20 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:20.705335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03b44cc4-2d55-4cdc-8554-263d28ab36d1 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:20.705335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03b44cc4-2d55-4cdc-8554-263d28ab36d1 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:20.712594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03b44cc4-2d55-4cdc-8554-263d28ab36d1 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:20.713127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03b44cc4-2d55-4cdc-8554-263d28ab36d1 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:20.714214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03b44cc4-2d55-4cdc-8554-263d28ab36d1 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:20.715272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03b44cc4-2d55-4cdc-8554-263d28ab36d1 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:20.796782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03b44cc4-2d55-4cdc-8554-263d28ab36d1 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:20.807009 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03b44cc4-2d55-4cdc-8554-263d28ab36d1 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1275 microversion: 2.1 time: 0.112748 Jul 26 20:13:20.808085 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2722/5360] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:20 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:21.073520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36dd6300-8338-4ae4-9f9e-1c3b3dc42713 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:21.075021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-36dd6300-8338-4ae4-9f9e-1c3b3dc42713 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:21.082704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36dd6300-8338-4ae4-9f9e-1c3b3dc42713 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:21.083168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36dd6300-8338-4ae4-9f9e-1c3b3dc42713 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:21.083967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36dd6300-8338-4ae4-9f9e-1c3b3dc42713 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:21.084608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36dd6300-8338-4ae4-9f9e-1c3b3dc42713 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:21.166438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-36dd6300-8338-4ae4-9f9e-1c3b3dc42713 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:21.175688 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36dd6300-8338-4ae4-9f9e-1c3b3dc42713 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1272 microversion: 2.1 time: 0.106891 Jul 26 20:13:21.176684 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2723/5361] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:21 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:21.191799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a8f8760-35a3-4fd7-8e5c-69994d5353e4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:21.192421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a8f8760-35a3-4fd7-8e5c-69994d5353e4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:21.198812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a8f8760-35a3-4fd7-8e5c-69994d5353e4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:21.199373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a8f8760-35a3-4fd7-8e5c-69994d5353e4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:21.200456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a8f8760-35a3-4fd7-8e5c-69994d5353e4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:21.200894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a8f8760-35a3-4fd7-8e5c-69994d5353e4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:21.255340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-53d2f660-ebd2-4d1b-ab1b-297e4feb501b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:21.282160 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-53d2f660-ebd2-4d1b-ab1b-297e4feb501b tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1519 microversion: 2.1 time: 0.873424 Jul 26 20:13:21.284408 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2639/5362] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:20 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1519 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:21.286039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a8f8760-35a3-4fd7-8e5c-69994d5353e4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:21.296016 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a8f8760-35a3-4fd7-8e5c-69994d5353e4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1273 microversion: 2.1 time: 0.118199 Jul 26 20:13:21.297199 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2724/5363] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:21 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:21.713252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80f8cde3-11b1-46bc-a34a-a75259216544 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:21.715228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80f8cde3-11b1-46bc-a34a-a75259216544 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:21.727761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80f8cde3-11b1-46bc-a34a-a75259216544 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:21.740372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80f8cde3-11b1-46bc-a34a-a75259216544 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:21.741438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80f8cde3-11b1-46bc-a34a-a75259216544 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:21.742036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80f8cde3-11b1-46bc-a34a-a75259216544 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:21.830602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f9ee12f5-566d-4433-90ec-2f3ae76b329b tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:21.831228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f9ee12f5-566d-4433-90ec-2f3ae76b329b tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:21.849333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9ee12f5-566d-4433-90ec-2f3ae76b329b tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:21.850109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9ee12f5-566d-4433-90ec-2f3ae76b329b tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:21.851215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9ee12f5-566d-4433-90ec-2f3ae76b329b tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:21.851898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f9ee12f5-566d-4433-90ec-2f3ae76b329b tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:22.275238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f9ee12f5-566d-4433-90ec-2f3ae76b329b tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:22.277494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:22.290630 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f9ee12f5-566d-4433-90ec-2f3ae76b329b tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.464687 Jul 26 20:13:22.291443 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2725/5364] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:21 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:22.311092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e69e18f8-0eaa-4540-a363-b5cdd7f23138 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:22.313463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e69e18f8-0eaa-4540-a363-b5cdd7f23138 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:22.332631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e69e18f8-0eaa-4540-a363-b5cdd7f23138 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:22.336461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e69e18f8-0eaa-4540-a363-b5cdd7f23138 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:22.337701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e69e18f8-0eaa-4540-a363-b5cdd7f23138 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:22.339091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e69e18f8-0eaa-4540-a363-b5cdd7f23138 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:22.482343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-80f8cde3-11b1-46bc-a34a-a75259216544 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:22.494315 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80f8cde3-11b1-46bc-a34a-a75259216544 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.784000 Jul 26 20:13:22.495480 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2640/5365] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:21 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:22.508448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d3801319-bd37-4d41-b4d4-7b6510ecdd47 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:22.509312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d3801319-bd37-4d41-b4d4-7b6510ecdd47 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:22.523508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3801319-bd37-4d41-b4d4-7b6510ecdd47 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:22.524042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3801319-bd37-4d41-b4d4-7b6510ecdd47 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:22.524774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3801319-bd37-4d41-b4d4-7b6510ecdd47 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:22.529147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3801319-bd37-4d41-b4d4-7b6510ecdd47 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:22.589647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:22.630993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e69e18f8-0eaa-4540-a363-b5cdd7f23138 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:22.643918 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e69e18f8-0eaa-4540-a363-b5cdd7f23138 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.337629 Jul 26 20:13:22.644605 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2726/5366] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:22 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:22.651811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ff426ea-3484-4833-9b91-a472331ece97 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:22.656372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ff426ea-3484-4833-9b91-a472331ece97 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:22.666421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ff426ea-3484-4833-9b91-a472331ece97 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:22.669119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ff426ea-3484-4833-9b91-a472331ece97 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:22.671902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ff426ea-3484-4833-9b91-a472331ece97 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:22.673443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ff426ea-3484-4833-9b91-a472331ece97 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:22.788979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ff426ea-3484-4833-9b91-a472331ece97 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:22.798085 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ff426ea-3484-4833-9b91-a472331ece97 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1273 microversion: 2.1 time: 0.150898 Jul 26 20:13:22.799780 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2727/5367] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:22 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:23.321528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-318b2a27-8d7e-4b76-8616-6470b9fff263 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:23.324855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-318b2a27-8d7e-4b76-8616-6470b9fff263 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:23.341901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-318b2a27-8d7e-4b76-8616-6470b9fff263 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:23.342537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-318b2a27-8d7e-4b76-8616-6470b9fff263 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:23.344026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-318b2a27-8d7e-4b76-8616-6470b9fff263 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:23.345491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-318b2a27-8d7e-4b76-8616-6470b9fff263 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:23.594498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-318b2a27-8d7e-4b76-8616-6470b9fff263 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:23.631852 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-318b2a27-8d7e-4b76-8616-6470b9fff263 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.320841 Jul 26 20:13:23.633455 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2728/5368] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:23 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:23.634035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d3801319-bd37-4d41-b4d4-7b6510ecdd47 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:23.644698 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d3801319-bd37-4d41-b4d4-7b6510ecdd47 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 1.146993 Jul 26 20:13:23.645510 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2641/5369] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:22 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:23.646256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef358f5c-b5d9-4764-abc4-f65a9ef646a3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:23.648065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef358f5c-b5d9-4764-abc4-f65a9ef646a3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:23.658696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef358f5c-b5d9-4764-abc4-f65a9ef646a3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:23.659766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef358f5c-b5d9-4764-abc4-f65a9ef646a3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:23.668320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef358f5c-b5d9-4764-abc4-f65a9ef646a3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:23.671715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef358f5c-b5d9-4764-abc4-f65a9ef646a3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:23.701817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7b40c384-1f5d-4c93-8e61-dd23ab088576 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:23.708492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7b40c384-1f5d-4c93-8e61-dd23ab088576 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:23.722662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b40c384-1f5d-4c93-8e61-dd23ab088576 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:23.723306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b40c384-1f5d-4c93-8e61-dd23ab088576 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:23.724755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b40c384-1f5d-4c93-8e61-dd23ab088576 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:23.725376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b40c384-1f5d-4c93-8e61-dd23ab088576 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:23.907410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ef358f5c-b5d9-4764-abc4-f65a9ef646a3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:23.915186 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef358f5c-b5d9-4764-abc4-f65a9ef646a3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.279332 Jul 26 20:13:23.917002 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2729/5370] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:23 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:23.922767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-065e8e68-77ca-4f29-a932-b0119ee0bd16 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:23.924147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-065e8e68-77ca-4f29-a932-b0119ee0bd16 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:23.943849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-065e8e68-77ca-4f29-a932-b0119ee0bd16 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:23.944600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-065e8e68-77ca-4f29-a932-b0119ee0bd16 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:23.945594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-065e8e68-77ca-4f29-a932-b0119ee0bd16 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:23.946228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-065e8e68-77ca-4f29-a932-b0119ee0bd16 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:24.147571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-065e8e68-77ca-4f29-a932-b0119ee0bd16 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:24.159718 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-065e8e68-77ca-4f29-a932-b0119ee0bd16 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.240420 Jul 26 20:13:24.175575 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2730/5371] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:23 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:24.185215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-507fa220-cafd-4c79-8906-812a05e4ff2a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:24.186178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-507fa220-cafd-4c79-8906-812a05e4ff2a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:24.193065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-507fa220-cafd-4c79-8906-812a05e4ff2a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:24.193903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-507fa220-cafd-4c79-8906-812a05e4ff2a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:24.196290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-507fa220-cafd-4c79-8906-812a05e4ff2a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:24.196982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-507fa220-cafd-4c79-8906-812a05e4ff2a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:24.273913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-507fa220-cafd-4c79-8906-812a05e4ff2a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:24.283426 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-507fa220-cafd-4c79-8906-812a05e4ff2a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1273 microversion: 2.1 time: 0.106470 Jul 26 20:13:24.285123 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2731/5372] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:24 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:24.614553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b40c384-1f5d-4c93-8e61-dd23ab088576 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:24.636912 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7b40c384-1f5d-4c93-8e61-dd23ab088576 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.971739 Jul 26 20:13:24.639462 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2642/5373] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:23 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:24.664415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8909dd6f-3267-4729-936e-47ab87cfcdfb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:24.664992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8909dd6f-3267-4729-936e-47ab87cfcdfb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:24.682750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b1f3f0e5-7ba9-401a-be62-97f510fa07a2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:24.685207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b1f3f0e5-7ba9-401a-be62-97f510fa07a2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:24.685754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8909dd6f-3267-4729-936e-47ab87cfcdfb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:24.686942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8909dd6f-3267-4729-936e-47ab87cfcdfb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:24.692909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8909dd6f-3267-4729-936e-47ab87cfcdfb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:24.695214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8909dd6f-3267-4729-936e-47ab87cfcdfb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:24.698872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b1f3f0e5-7ba9-401a-be62-97f510fa07a2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:24.700660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b1f3f0e5-7ba9-401a-be62-97f510fa07a2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:24.701678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b1f3f0e5-7ba9-401a-be62-97f510fa07a2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:24.702344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b1f3f0e5-7ba9-401a-be62-97f510fa07a2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.167154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b1f3f0e5-7ba9-401a-be62-97f510fa07a2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:25.183166 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b1f3f0e5-7ba9-401a-be62-97f510fa07a2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.514989 Jul 26 20:13:25.200584 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2643/5374] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:24 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:25.211207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8909dd6f-3267-4729-936e-47ab87cfcdfb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:25.212358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-abf933a1-7017-41c5-bcb4-c0afa63a2ca3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:25.213459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-abf933a1-7017-41c5-bcb4-c0afa63a2ca3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:25.220191 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8909dd6f-3267-4729-936e-47ab87cfcdfb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.566321 Jul 26 20:13:25.224594 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2732/5375] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:24 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:25.231297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-baddfed3-948c-460c-9d4d-ccaee1f21c55 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:25.232141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-baddfed3-948c-460c-9d4d-ccaee1f21c55 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:25.248024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abf933a1-7017-41c5-bcb4-c0afa63a2ca3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.248490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abf933a1-7017-41c5-bcb4-c0afa63a2ca3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.249300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abf933a1-7017-41c5-bcb4-c0afa63a2ca3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.253838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-baddfed3-948c-460c-9d4d-ccaee1f21c55 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.254518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-baddfed3-948c-460c-9d4d-ccaee1f21c55 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.255514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-baddfed3-948c-460c-9d4d-ccaee1f21c55 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.255988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-baddfed3-948c-460c-9d4d-ccaee1f21c55 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.257633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abf933a1-7017-41c5-bcb4-c0afa63a2ca3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.555252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-baddfed3-948c-460c-9d4d-ccaee1f21c55 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:25.565049 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-baddfed3-948c-460c-9d4d-ccaee1f21c55 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.339033 Jul 26 20:13:25.577588 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2733/5376] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:25 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:25.586786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2657d17-0076-457b-9d03-fe81dd362b23 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:25.597652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c2657d17-0076-457b-9d03-fe81dd362b23 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 716fbd9c-2900-474c-aecb-c58396be0503 has no mapping to a cell. Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2657d17-0076-457b-9d03-fe81dd362b23 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/716fbd9c-2900-474c-aecb-c58396be0503/action HTTP/1.1 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 15 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: {"os-stop": {}} Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 716fbd9c-2900-474c-aecb-c58396be0503 has no mapping to a cell. Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '716fbd9c-2900-474c-aecb-c58396be0503', 'body': {'os-stop': {}}} Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 716fbd9c-2900-474c-aecb-c58396be0503 has no mapping to a cell. Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:25.607693 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 716fbd9c-2900-474c-aecb-c58396be0503 has no mapping to a cell. Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 716fbd9c-2900-474c-aecb-c58396be0503 has no mapping to a cell. Jul 26 20:13:25.613960 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:25.618609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2657d17-0076-457b-9d03-fe81dd362b23 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 716fbd9c-2900-474c-aecb-c58396be0503 has no mapping to a cell. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:25.620355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c2657d17-0076-457b-9d03-fe81dd362b23 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/716fbd9c-2900-474c-aecb-c58396be0503/action" status: 404 len: 117 microversion: 2.1 time: 0.040226 Jul 26 20:13:25.623570 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2734/5377] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:25 2022] POST /compute/v2.1/servers/716fbd9c-2900-474c-aecb-c58396be0503/action => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:25.640012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2380f900-4259-41db-96d2-f24f2d6441c5 req-9c1608ad-a7f0-420a-a4f2-0e218f706b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf5b644-09f9-42a3-9f8c-bf4b5c255480", "tag": "2636f5db-546e-48b2-a259-959f053d1921"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:25.655008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2380f900-4259-41db-96d2-f24f2d6441c5 req-9c1608ad-a7f0-420a-a4f2-0e218f706b82 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.655673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2380f900-4259-41db-96d2-f24f2d6441c5 req-9c1608ad-a7f0-420a-a4f2-0e218f706b82 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.688831 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2380f900-4259-41db-96d2-f24f2d6441c5 req-9c1608ad-a7f0-420a-a4f2-0e218f706b82 service nova] Creating event network-changed:2636f5db-546e-48b2-a259-959f053d1921 for instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 on n-h1-708768-8 Jul 26 20:13:25.698710 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2380f900-4259-41db-96d2-f24f2d6441c5 req-9c1608ad-a7f0-420a-a4f2-0e218f706b82 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072412 Jul 26 20:13:25.700448 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2735/5378] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:25.707155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e20b5d09-6339-4661-a788-547b880ca19a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:25.708208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e20b5d09-6339-4661-a788-547b880ca19a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:25.719801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e20b5d09-6339-4661-a788-547b880ca19a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.720767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e20b5d09-6339-4661-a788-547b880ca19a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.721886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e20b5d09-6339-4661-a788-547b880ca19a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.722974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e20b5d09-6339-4661-a788-547b880ca19a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.846094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:25.881132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=14 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:25.888756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-abf933a1-7017-41c5-bcb4-c0afa63a2ca3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:25.908969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-abf933a1-7017-41c5-bcb4-c0afa63a2ca3 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.707029 Jul 26 20:13:25.924631 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2644/5379] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:25 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:25.933101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64fc899b-80ca-4aa0-aa1d-3d36a6c9358e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:25.933810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64fc899b-80ca-4aa0-aa1d-3d36a6c9358e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:25.934267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e20b5d09-6339-4661-a788-547b880ca19a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:25.942186 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e20b5d09-6339-4661-a788-547b880ca19a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.240207 Jul 26 20:13:25.955510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64fc899b-80ca-4aa0-aa1d-3d36a6c9358e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.955510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64fc899b-80ca-4aa0-aa1d-3d36a6c9358e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.955510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64fc899b-80ca-4aa0-aa1d-3d36a6c9358e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:25.955510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64fc899b-80ca-4aa0-aa1d-3d36a6c9358e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:25.956556 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2736/5380] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:25 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:26.249674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e94ba757-b7eb-4571-9665-b736827336cb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:26.250309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e94ba757-b7eb-4571-9665-b736827336cb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:26.257594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e94ba757-b7eb-4571-9665-b736827336cb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.258045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e94ba757-b7eb-4571-9665-b736827336cb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:26.258835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e94ba757-b7eb-4571-9665-b736827336cb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.259456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e94ba757-b7eb-4571-9665-b736827336cb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:26.446256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e94ba757-b7eb-4571-9665-b736827336cb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:26.461286 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e94ba757-b7eb-4571-9665-b736827336cb tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.216772 Jul 26 20:13:26.462656 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2737/5381] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:26 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:26.593704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-affd923f-4088-4254-b392-71bb3d4369a3 req-f08deefd-ce22-4ff6-81e6-cc34a8606e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e8d96b-ad68-4918-b50c-63775a17cead", "name": "network-vif-plugged", "status": "completed", "tag": "e80d999c-8515-45a3-ab1d-634fa7e33baf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:26.606943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-affd923f-4088-4254-b392-71bb3d4369a3 req-f08deefd-ce22-4ff6-81e6-cc34a8606e33 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.607663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-affd923f-4088-4254-b392-71bb3d4369a3 req-f08deefd-ce22-4ff6-81e6-cc34a8606e33 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:26.620133 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-affd923f-4088-4254-b392-71bb3d4369a3 req-f08deefd-ce22-4ff6-81e6-cc34a8606e33 service nova] Creating event network-vif-plugged:e80d999c-8515-45a3-ab1d-634fa7e33baf for instance 25e8d96b-ad68-4918-b50c-63775a17cead on n-h2-708768-8 Jul 26 20:13:26.626645 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-affd923f-4088-4254-b392-71bb3d4369a3 req-f08deefd-ce22-4ff6-81e6-cc34a8606e33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045876 Jul 26 20:13:26.628233 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2738/5382] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:26.647403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d015f40-21ea-41bc-83db-fd3911d433fe tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:26.650152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d015f40-21ea-41bc-83db-fd3911d433fe tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:26.685498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d015f40-21ea-41bc-83db-fd3911d433fe tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.685944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d015f40-21ea-41bc-83db-fd3911d433fe tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:26.686716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d015f40-21ea-41bc-83db-fd3911d433fe tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.687150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d015f40-21ea-41bc-83db-fd3911d433fe tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:26.851885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3d015f40-21ea-41bc-83db-fd3911d433fe tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:26.864685 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d015f40-21ea-41bc-83db-fd3911d433fe tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.234679 Jul 26 20:13:26.865005 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2739/5383] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:26 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:26.893451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64fc899b-80ca-4aa0-aa1d-3d36a6c9358e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:26.906612 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64fc899b-80ca-4aa0-aa1d-3d36a6c9358e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.978819 Jul 26 20:13:26.907322 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2645/5384] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:25 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:26.939762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9abd91c4-45ac-4dd8-a9ce-bdba2a6d8691 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:26.940333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9abd91c4-45ac-4dd8-a9ce-bdba2a6d8691 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:26.940871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7c3bb34f-ee78-4393-b311-4f497fc2e512 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:26.941812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7c3bb34f-ee78-4393-b311-4f497fc2e512 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:26.952540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c3bb34f-ee78-4393-b311-4f497fc2e512 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.957562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c3bb34f-ee78-4393-b311-4f497fc2e512 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:26.957562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c3bb34f-ee78-4393-b311-4f497fc2e512 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.957562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c3bb34f-ee78-4393-b311-4f497fc2e512 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:26.959285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9abd91c4-45ac-4dd8-a9ce-bdba2a6d8691 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.960015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9abd91c4-45ac-4dd8-a9ce-bdba2a6d8691 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:26.963141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9abd91c4-45ac-4dd8-a9ce-bdba2a6d8691 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:26.963739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9abd91c4-45ac-4dd8-a9ce-bdba2a6d8691 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.136575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7c3bb34f-ee78-4393-b311-4f497fc2e512 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:27.146060 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7c3bb34f-ee78-4393-b311-4f497fc2e512 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1315 microversion: 2.1 time: 0.216457 Jul 26 20:13:27.146896 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2740/5385] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:26 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:27.164410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1b1893e-f3d5-4470-bf5c-35fee82ffa5a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:27.165038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a1b1893e-f3d5-4470-bf5c-35fee82ffa5a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:27.171916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1b1893e-f3d5-4470-bf5c-35fee82ffa5a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.172368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1b1893e-f3d5-4470-bf5c-35fee82ffa5a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.173362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1b1893e-f3d5-4470-bf5c-35fee82ffa5a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.174078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1b1893e-f3d5-4470-bf5c-35fee82ffa5a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.321341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1b1893e-f3d5-4470-bf5c-35fee82ffa5a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:27.331708 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1b1893e-f3d5-4470-bf5c-35fee82ffa5a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.183306 Jul 26 20:13:27.332676 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2741/5386] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:27 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:27.482825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1c0503a8-06e8-4947-9b98-f717677d6fce tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:27.483759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1c0503a8-06e8-4947-9b98-f717677d6fce tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:27.490492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c0503a8-06e8-4947-9b98-f717677d6fce tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.491121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c0503a8-06e8-4947-9b98-f717677d6fce tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.491917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c0503a8-06e8-4947-9b98-f717677d6fce tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.492503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1c0503a8-06e8-4947-9b98-f717677d6fce tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.574953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9abd91c4-45ac-4dd8-a9ce-bdba2a6d8691 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:27.585034 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9abd91c4-45ac-4dd8-a9ce-bdba2a6d8691 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.651526 Jul 26 20:13:27.586355 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2646/5387] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:26 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:27.607519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab9fca49-a1f8-4dd9-b9d5-0d5563d5010c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:27.608284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab9fca49-a1f8-4dd9-b9d5-0d5563d5010c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: fb65e610-e580-470b-bac0-80f380ae16cf] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:27.610479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:27.627951 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ab9fca49-a1f8-4dd9-b9d5-0d5563d5010c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance fb65e610-e580-470b-bac0-80f380ae16cf could not be found. Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab9fca49-a1f8-4dd9-b9d5-0d5563d5010c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/fb65e610-e580-470b-bac0-80f380ae16cf/action HTTP/1.1 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 15 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: {"suspend": {}} Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance fb65e610-e580-470b-bac0-80f380ae16cf could not be found. Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'fb65e610-e580-470b-bac0-80f380ae16cf', 'body': {'suspend': {}}} Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb65e610-e580-470b-bac0-80f380ae16cf could not be found. Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb65e610-e580-470b-bac0-80f380ae16cf could not be found. Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:27.629694 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:27.633985 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:27.633985 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:27.633985 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb65e610-e580-470b-bac0-80f380ae16cf could not be found. Jul 26 20:13:27.633985 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:27.633985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab9fca49-a1f8-4dd9-b9d5-0d5563d5010c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance fb65e610-e580-470b-bac0-80f380ae16cf could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:27.633985 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab9fca49-a1f8-4dd9-b9d5-0d5563d5010c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/fb65e610-e580-470b-bac0-80f380ae16cf/action" status: 404 len: 111 microversion: 2.1 time: 0.028446 Jul 26 20:13:27.648003 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2647/5388] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:27 2022] POST /compute/v2.1/servers/fb65e610-e580-470b-bac0-80f380ae16cf/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:13:27.654308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bd777ec-bc93-41b4-a84d-77707e83c41e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:27.654922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bd777ec-bc93-41b4-a84d-77707e83c41e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:27.661817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bd777ec-bc93-41b4-a84d-77707e83c41e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.662265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bd777ec-bc93-41b4-a84d-77707e83c41e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.663033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bd777ec-bc93-41b4-a84d-77707e83c41e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.663143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1c0503a8-06e8-4947-9b98-f717677d6fce tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:27.663529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bd777ec-bc93-41b4-a84d-77707e83c41e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.673242 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1c0503a8-06e8-4947-9b98-f717677d6fce tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.194697 Jul 26 20:13:27.674266 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2742/5389] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:27 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:27.926489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0ceefe68-f14b-4c5f-9acf-2501fe8b8843 req-42cfc426-5ba1-4c6a-a548-3beb6dccd04f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0854acd2-6921-4cab-ad5b-bddf5ba312c6", "tag": "d635264b-f76b-465b-9ca9-3ec59ae8da06"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:27.938097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0ceefe68-f14b-4c5f-9acf-2501fe8b8843 req-42cfc426-5ba1-4c6a-a548-3beb6dccd04f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.938759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0ceefe68-f14b-4c5f-9acf-2501fe8b8843 req-42cfc426-5ba1-4c6a-a548-3beb6dccd04f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.951404 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0ceefe68-f14b-4c5f-9acf-2501fe8b8843 req-42cfc426-5ba1-4c6a-a548-3beb6dccd04f service nova] Creating event network-changed:d635264b-f76b-465b-9ca9-3ec59ae8da06 for instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 on n-h1-708768-8 Jul 26 20:13:27.956452 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0ceefe68-f14b-4c5f-9acf-2501fe8b8843 req-42cfc426-5ba1-4c6a-a548-3beb6dccd04f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185069 Jul 26 20:13:27.957385 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2743/5390] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:13:27.963748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5051bd27-8f88-4acc-9d2e-ee59458ffad8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:27.964830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5051bd27-8f88-4acc-9d2e-ee59458ffad8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:27.971570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5051bd27-8f88-4acc-9d2e-ee59458ffad8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.972179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5051bd27-8f88-4acc-9d2e-ee59458ffad8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:27.973025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5051bd27-8f88-4acc-9d2e-ee59458ffad8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:27.973551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5051bd27-8f88-4acc-9d2e-ee59458ffad8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.044904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bd777ec-bc93-41b4-a84d-77707e83c41e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:28.056141 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bd777ec-bc93-41b4-a84d-77707e83c41e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.406808 Jul 26 20:13:28.057337 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2648/5391] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:27 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:28.083100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-025c344f-d36f-4338-817b-b595c9e2743c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:28.084033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-025c344f-d36f-4338-817b-b595c9e2743c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:28.093890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025c344f-d36f-4338-817b-b595c9e2743c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.094711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025c344f-d36f-4338-817b-b595c9e2743c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.096099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025c344f-d36f-4338-817b-b595c9e2743c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.096768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-025c344f-d36f-4338-817b-b595c9e2743c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.244641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5051bd27-8f88-4acc-9d2e-ee59458ffad8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:28.266426 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5051bd27-8f88-4acc-9d2e-ee59458ffad8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.307579 Jul 26 20:13:28.271669 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2744/5392] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:27 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:28.278109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd0e1a53-0d96-473c-957b-c20fc8e6fa96 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:28.279176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd0e1a53-0d96-473c-957b-c20fc8e6fa96 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:28.288052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0e1a53-0d96-473c-957b-c20fc8e6fa96 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.288784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0e1a53-0d96-473c-957b-c20fc8e6fa96 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.291000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0e1a53-0d96-473c-957b-c20fc8e6fa96 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.292148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd0e1a53-0d96-473c-957b-c20fc8e6fa96 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.316490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:28.497829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd0e1a53-0d96-473c-957b-c20fc8e6fa96 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:28.508819 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd0e1a53-0d96-473c-957b-c20fc8e6fa96 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1464 microversion: 2.1 time: 0.235170 Jul 26 20:13:28.509809 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2745/5393] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:28 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:28.515739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-51899768-fa87-435b-8077-036bbb3c7d8a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:28.516359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-51899768-fa87-435b-8077-036bbb3c7d8a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:28.518313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:28.519789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:28.533596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51899768-fa87-435b-8077-036bbb3c7d8a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.534736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51899768-fa87-435b-8077-036bbb3c7d8a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.535970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51899768-fa87-435b-8077-036bbb3c7d8a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.536457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51899768-fa87-435b-8077-036bbb3c7d8a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.609815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-025c344f-d36f-4338-817b-b595c9e2743c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:28.621734 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-025c344f-d36f-4338-817b-b595c9e2743c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.543380 Jul 26 20:13:28.623638 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2649/5394] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:28 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:28.643937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4c05f1ec-4a71-453d-92c2-bd5d43516633 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:28.644695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4c05f1ec-4a71-453d-92c2-bd5d43516633 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:28.653947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c05f1ec-4a71-453d-92c2-bd5d43516633 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.655182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c05f1ec-4a71-453d-92c2-bd5d43516633 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.656464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c05f1ec-4a71-453d-92c2-bd5d43516633 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.657280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c05f1ec-4a71-453d-92c2-bd5d43516633 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.689026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4c05f1ec-4a71-453d-92c2-bd5d43516633 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:13:28.696299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-51899768-fa87-435b-8077-036bbb3c7d8a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:28.706088 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-51899768-fa87-435b-8077-036bbb3c7d8a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.194690 Jul 26 20:13:28.707251 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2746/5395] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:28 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:28.716823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5307b076-4252-4a35-9eb3-bd615de43140 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:28.717889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5307b076-4252-4a35-9eb3-bd615de43140 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:28.724956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5307b076-4252-4a35-9eb3-bd615de43140 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.726090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5307b076-4252-4a35-9eb3-bd615de43140 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.727123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5307b076-4252-4a35-9eb3-bd615de43140 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.728019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5307b076-4252-4a35-9eb3-bd615de43140 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.759993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-5307b076-4252-4a35-9eb3-bd615de43140 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lazy-loading 'flavor' on Instance uuid 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:13:28.816379 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4c05f1ec-4a71-453d-92c2-bd5d43516633 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 204 len: 0 microversion: 2.1 time: 0.187396 Jul 26 20:13:28.820148 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2650/5396] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:13:28 2022] DELETE /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:13:28.823597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-331232b2-bbbf-4f0a-9bc4-834e21da4124 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:28.824951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-331232b2-bbbf-4f0a-9bc4-834e21da4124 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:28.832041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-331232b2-bbbf-4f0a-9bc4-834e21da4124 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.832686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-331232b2-bbbf-4f0a-9bc4-834e21da4124 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.833641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-331232b2-bbbf-4f0a-9bc4-834e21da4124 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.834237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-331232b2-bbbf-4f0a-9bc4-834e21da4124 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.879473 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5307b076-4252-4a35-9eb3-bd615de43140 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 202 len: 0 microversion: 2.1 time: 0.170581 Jul 26 20:13:28.882709 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2747/5397] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:28 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:13:28.886405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=18 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:28.897703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-64dcca52-cac6-476c-a5c5-5dbeffa21478 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:28.900113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-64dcca52-cac6-476c-a5c5-5dbeffa21478 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:28.909158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64dcca52-cac6-476c-a5c5-5dbeffa21478 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.909667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64dcca52-cac6-476c-a5c5-5dbeffa21478 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:28.910451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64dcca52-cac6-476c-a5c5-5dbeffa21478 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:28.910891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64dcca52-cac6-476c-a5c5-5dbeffa21478 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:29.060166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-331232b2-bbbf-4f0a-9bc4-834e21da4124 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:29.069356 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-331232b2-bbbf-4f0a-9bc4-834e21da4124 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.250637 Jul 26 20:13:29.070261 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2651/5398] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:28 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:29.076010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33d6ddd9-e541-4a8a-84aa-4ef4f3f9ec46 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:29.076968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-33d6ddd9-e541-4a8a-84aa-4ef4f3f9ec46 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:29.083890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33d6ddd9-e541-4a8a-84aa-4ef4f3f9ec46 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:29.084441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33d6ddd9-e541-4a8a-84aa-4ef4f3f9ec46 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:29.085406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33d6ddd9-e541-4a8a-84aa-4ef4f3f9ec46 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:29.085867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33d6ddd9-e541-4a8a-84aa-4ef4f3f9ec46 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:29.165518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-64dcca52-cac6-476c-a5c5-5dbeffa21478 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:29.176786 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-64dcca52-cac6-476c-a5c5-5dbeffa21478 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1470 microversion: 2.1 time: 0.292248 Jul 26 20:13:29.178295 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2748/5399] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:28 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:29.236455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-33d6ddd9-e541-4a8a-84aa-4ef4f3f9ec46 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:29.243979 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-33d6ddd9-e541-4a8a-84aa-4ef4f3f9ec46 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1514 microversion: 2.1 time: 0.172406 Jul 26 20:13:29.244486 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2652/5400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:29 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:29.292473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9ff67caf-a280-42f2-827e-76b09fd730a8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:29.293607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9ff67caf-a280-42f2-827e-76b09fd730a8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:29.300622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ff67caf-a280-42f2-827e-76b09fd730a8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:29.301084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ff67caf-a280-42f2-827e-76b09fd730a8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:29.301867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ff67caf-a280-42f2-827e-76b09fd730a8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:29.302309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ff67caf-a280-42f2-827e-76b09fd730a8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:29.522137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9ff67caf-a280-42f2-827e-76b09fd730a8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:29.536030 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9ff67caf-a280-42f2-827e-76b09fd730a8 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.247275 Jul 26 20:13:29.553884 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2749/5401] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:29 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:29.726706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bbde778a-c7c8-42eb-969a-4381600fc714 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:29.727572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bbde778a-c7c8-42eb-969a-4381600fc714 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:29.740075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbde778a-c7c8-42eb-969a-4381600fc714 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:29.740773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbde778a-c7c8-42eb-969a-4381600fc714 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:29.741724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbde778a-c7c8-42eb-969a-4381600fc714 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:29.742321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbde778a-c7c8-42eb-969a-4381600fc714 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.008032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e8ac020d-eb97-4ed5-970e-ffc1b121633c req-e87cecad-e9df-4266-87bd-37b952bdeeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906e76c3-27a3-4703-9938-4068a6ab1436", "tag": "782c6898-4df2-4812-b184-95c9c51920db"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:30.037062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e8ac020d-eb97-4ed5-970e-ffc1b121633c req-e87cecad-e9df-4266-87bd-37b952bdeeb1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.037767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e8ac020d-eb97-4ed5-970e-ffc1b121633c req-e87cecad-e9df-4266-87bd-37b952bdeeb1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.069075 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e8ac020d-eb97-4ed5-970e-ffc1b121633c req-e87cecad-e9df-4266-87bd-37b952bdeeb1 service nova] Creating event network-changed:782c6898-4df2-4812-b184-95c9c51920db for instance 906e76c3-27a3-4703-9938-4068a6ab1436 on n-h2-708768-8 Jul 26 20:13:30.076854 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e8ac020d-eb97-4ed5-970e-ffc1b121633c req-e87cecad-e9df-4266-87bd-37b952bdeeb1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091031 Jul 26 20:13:30.078244 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2750/5402] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:13:30.096246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e1f43e33-d594-4ed7-afb5-419635edad8d tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:30.097324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e1f43e33-d594-4ed7-afb5-419635edad8d tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:30.107751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1f43e33-d594-4ed7-afb5-419635edad8d tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.108520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1f43e33-d594-4ed7-afb5-419635edad8d tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.109479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1f43e33-d594-4ed7-afb5-419635edad8d tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.110061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1f43e33-d594-4ed7-afb5-419635edad8d tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.487852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1f43e33-d594-4ed7-afb5-419635edad8d tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:30.510440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bbde778a-c7c8-42eb-969a-4381600fc714 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:30.511001 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e1f43e33-d594-4ed7-afb5-419635edad8d tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.422059 Jul 26 20:13:30.511476 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2751/5403] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:30 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:30.522084 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bbde778a-c7c8-42eb-969a-4381600fc714 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.798216 Jul 26 20:13:30.532045 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2653/5404] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:29 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:30.532536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-78d1ff44-a472-4b30-b490-88c39048c0dc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:30.533148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-78d1ff44-a472-4b30-b490-88c39048c0dc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:30.539057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0660006-9aac-428f-8a2e-7df31f9736c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:30.539968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0660006-9aac-428f-8a2e-7df31f9736c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:30.549038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0660006-9aac-428f-8a2e-7df31f9736c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.549660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78d1ff44-a472-4b30-b490-88c39048c0dc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.550105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78d1ff44-a472-4b30-b490-88c39048c0dc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.550280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0660006-9aac-428f-8a2e-7df31f9736c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.550886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78d1ff44-a472-4b30-b490-88c39048c0dc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.551316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78d1ff44-a472-4b30-b490-88c39048c0dc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.551548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0660006-9aac-428f-8a2e-7df31f9736c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.552155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0660006-9aac-428f-8a2e-7df31f9736c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.820084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-78d1ff44-a472-4b30-b490-88c39048c0dc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:30.829845 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-78d1ff44-a472-4b30-b490-88c39048c0dc tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1470 microversion: 2.1 time: 0.300939 Jul 26 20:13:30.843643 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2752/5405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:30 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:30.843643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bb5a57c-4272-4a60-83cd-e5b5db2eb9c1 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:30.843643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5bb5a57c-4272-4a60-83cd-e5b5db2eb9c1 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:30.849258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bb5a57c-4272-4a60-83cd-e5b5db2eb9c1 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.849712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bb5a57c-4272-4a60-83cd-e5b5db2eb9c1 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:30.850485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bb5a57c-4272-4a60-83cd-e5b5db2eb9c1 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:30.850915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bb5a57c-4272-4a60-83cd-e5b5db2eb9c1 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.094771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e0660006-9aac-428f-8a2e-7df31f9736c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:31.104839 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0660006-9aac-428f-8a2e-7df31f9736c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1497 microversion: 2.1 time: 0.570573 Jul 26 20:13:31.106987 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2654/5406] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:30 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1497 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:31.132059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:31.132879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:31.146086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.146967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.147982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.148720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.187766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lazy-loading 'flavor' on Instance uuid 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:13:31.204455 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Cannot 'suspend' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state suspended Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action HTTP/1.1 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 15 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: {"suspend": {}} Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: exception: Cannot 'suspend' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state suspended Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'suspend': {}}} Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f in vm_state suspended. Cannot suspend while the instance is in this state. Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 26 20:13:31.207105 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state suspended Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state suspended Jul 26 20:13:31.211962 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:31.215285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 409 to user: Cannot 'suspend' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state suspended {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:31.216376 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90733e83-237e-4c95-8e2f-2a7f417209ad tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 409 len: 148 microversion: 2.1 time: 0.093376 Jul 26 20:13:31.220450 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2655/5407] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:31 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 148 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 20:13:31.226645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-564e1381-7596-429c-9be9-16a2d71e7dc5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:31.227893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-564e1381-7596-429c-9be9-16a2d71e7dc5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:31.236309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-564e1381-7596-429c-9be9-16a2d71e7dc5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.237003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-564e1381-7596-429c-9be9-16a2d71e7dc5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.237947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-564e1381-7596-429c-9be9-16a2d71e7dc5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.238586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-564e1381-7596-429c-9be9-16a2d71e7dc5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.288215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:31.300577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5bb5a57c-4272-4a60-83cd-e5b5db2eb9c1 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:31.313325 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5bb5a57c-4272-4a60-83cd-e5b5db2eb9c1 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.480625 Jul 26 20:13:31.317502 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2753/5408] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:30 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:31.335790 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-564e1381-7596-429c-9be9-16a2d71e7dc5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 202 len: 0 microversion: 2.1 time: 0.112994 Jul 26 20:13:31.337047 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2656/5409] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:31 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:13:31.346272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6763a2e7-f5b5-4e1f-9cf8-2990030b1723 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:31.346849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6763a2e7-f5b5-4e1f-9cf8-2990030b1723 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:31.359327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6763a2e7-f5b5-4e1f-9cf8-2990030b1723 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.359891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6763a2e7-f5b5-4e1f-9cf8-2990030b1723 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.360762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6763a2e7-f5b5-4e1f-9cf8-2990030b1723 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.361306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6763a2e7-f5b5-4e1f-9cf8-2990030b1723 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.534812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-943809cc-17a7-4e4d-b766-cf578a0ea2c2 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:31.535371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-943809cc-17a7-4e4d-b766-cf578a0ea2c2 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:31.550136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-943809cc-17a7-4e4d-b766-cf578a0ea2c2 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.550738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-943809cc-17a7-4e4d-b766-cf578a0ea2c2 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.551652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-943809cc-17a7-4e4d-b766-cf578a0ea2c2 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.552198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-943809cc-17a7-4e4d-b766-cf578a0ea2c2 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.557772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6763a2e7-f5b5-4e1f-9cf8-2990030b1723 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:31.575558 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6763a2e7-f5b5-4e1f-9cf8-2990030b1723 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1503 microversion: 2.1 time: 0.233347 Jul 26 20:13:31.587738 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2754/5410] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:31 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:31.598992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7fdb6853-7843-4678-a05d-0369fbf52a6f tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:31.599534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7fdb6853-7843-4678-a05d-0369fbf52a6f tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:31.606926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fdb6853-7843-4678-a05d-0369fbf52a6f tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.607396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fdb6853-7843-4678-a05d-0369fbf52a6f tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.608237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fdb6853-7843-4678-a05d-0369fbf52a6f tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.608800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7fdb6853-7843-4678-a05d-0369fbf52a6f tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.906838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7fdb6853-7843-4678-a05d-0369fbf52a6f tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:31.915233 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7fdb6853-7843-4678-a05d-0369fbf52a6f tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.326271 Jul 26 20:13:31.930721 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2755/5411] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:31 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:31.936110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0fc7d306-44af-4d81-b38a-40a16c4f8f70 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:31.936730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0fc7d306-44af-4d81-b38a-40a16c4f8f70 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:31.946031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fc7d306-44af-4d81-b38a-40a16c4f8f70 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.946379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fc7d306-44af-4d81-b38a-40a16c4f8f70 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:31.947162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fc7d306-44af-4d81-b38a-40a16c4f8f70 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:31.947599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fc7d306-44af-4d81-b38a-40a16c4f8f70 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:32.067796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0fc7d306-44af-4d81-b38a-40a16c4f8f70 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8ab9438322a4b68ad4e7177405d5e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0903a9d69c6841f589a47fecec113c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:32.079658 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0fc7d306-44af-4d81-b38a-40a16c4f8f70 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 200 len: 1428 microversion: 2.1 time: 0.147572 Jul 26 20:13:32.080740 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2756/5412] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:31 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 1428 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:32.095046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-943809cc-17a7-4e4d-b766-cf578a0ea2c2 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:32.104250 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-943809cc-17a7-4e4d-b766-cf578a0ea2c2 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.573565 Jul 26 20:13:32.107065 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2657/5413] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:31 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:32.251285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e0cd335f-1ceb-4cb9-9a02-8f518ed5bc1d req-dd70b310-8a2e-4e8a-b84f-60fe9619c88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf5b644-09f9-42a3-9f8c-bf4b5c255480", "name": "network-vif-plugged", "status": "completed", "tag": "2636f5db-546e-48b2-a259-959f053d1921"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:32.265980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e0cd335f-1ceb-4cb9-9a02-8f518ed5bc1d req-dd70b310-8a2e-4e8a-b84f-60fe9619c88d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:32.266962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e0cd335f-1ceb-4cb9-9a02-8f518ed5bc1d req-dd70b310-8a2e-4e8a-b84f-60fe9619c88d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:32.282823 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e0cd335f-1ceb-4cb9-9a02-8f518ed5bc1d req-dd70b310-8a2e-4e8a-b84f-60fe9619c88d service nova] Creating event network-vif-plugged:2636f5db-546e-48b2-a259-959f053d1921 for instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 on n-h1-708768-8 Jul 26 20:13:32.288094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e0cd335f-1ceb-4cb9-9a02-8f518ed5bc1d req-dd70b310-8a2e-4e8a-b84f-60fe9619c88d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041879 Jul 26 20:13:32.289270 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2757/5414] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:32.342515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0913024e-a54d-4050-b64e-029c1e1e9efc tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:32.343550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0913024e-a54d-4050-b64e-029c1e1e9efc tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:32.352542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0913024e-a54d-4050-b64e-029c1e1e9efc tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:32.353314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0913024e-a54d-4050-b64e-029c1e1e9efc tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:32.354279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0913024e-a54d-4050-b64e-029c1e1e9efc tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:32.356398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0913024e-a54d-4050-b64e-029c1e1e9efc tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:32.467459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5fa16755-2a54-4279-9078-1640affa9da8 req-38b4ea5f-a511-4da9-8aa3-e514b1b0f6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e8d96b-ad68-4918-b50c-63775a17cead", "name": "network-vif-deleted", "tag": "e80d999c-8515-45a3-ab1d-634fa7e33baf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:32.479319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5fa16755-2a54-4279-9078-1640affa9da8 req-38b4ea5f-a511-4da9-8aa3-e514b1b0f6f1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:32.479797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5fa16755-2a54-4279-9078-1640affa9da8 req-38b4ea5f-a511-4da9-8aa3-e514b1b0f6f1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:32.497815 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5fa16755-2a54-4279-9078-1640affa9da8 req-38b4ea5f-a511-4da9-8aa3-e514b1b0f6f1 service nova] Creating event network-vif-deleted:e80d999c-8515-45a3-ab1d-634fa7e33baf for instance 25e8d96b-ad68-4918-b50c-63775a17cead on n-h2-708768-8 Jul 26 20:13:32.503811 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5fa16755-2a54-4279-9078-1640affa9da8 req-38b4ea5f-a511-4da9-8aa3-e514b1b0f6f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041350 Jul 26 20:13:32.505011 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2758/5415] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:32.690754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ccbd144-6b4e-4ec3-b68f-7af114b3be44 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:32.691792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ccbd144-6b4e-4ec3-b68f-7af114b3be44 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:32.698613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ccbd144-6b4e-4ec3-b68f-7af114b3be44 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:32.699876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ccbd144-6b4e-4ec3-b68f-7af114b3be44 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:32.700801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ccbd144-6b4e-4ec3-b68f-7af114b3be44 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:32.701320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ccbd144-6b4e-4ec3-b68f-7af114b3be44 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:32.853931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ccbd144-6b4e-4ec3-b68f-7af114b3be44 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:32.863421 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ccbd144-6b4e-4ec3-b68f-7af114b3be44 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1503 microversion: 2.1 time: 0.176993 Jul 26 20:13:32.871672 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2759/5416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:32 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:32.932803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0913024e-a54d-4050-b64e-029c1e1e9efc tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:32.945653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0913024e-a54d-4050-b64e-029c1e1e9efc tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.610994 Jul 26 20:13:32.946498 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2658/5417] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:32 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:32.947955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a17f9502-9f76-4a65-91bf-776d03902509 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:32.948765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a17f9502-9f76-4a65-91bf-776d03902509 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:32.956869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a17f9502-9f76-4a65-91bf-776d03902509 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:32.957581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a17f9502-9f76-4a65-91bf-776d03902509 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:32.958547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a17f9502-9f76-4a65-91bf-776d03902509 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:32.959965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a17f9502-9f76-4a65-91bf-776d03902509 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:33.104063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:33.104867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] [instance: 25e8d96b-ad68-4918-b50c-63775a17cead] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:33.117150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:33.118502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:33.122454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:33.123956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:33.145802 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] HTTP exception thrown: Instance 25e8d96b-ad68-4918-b50c-63775a17cead could not be found. Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Request method failure captured: Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead HTTP/1.1 Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ErOmXFjYHbVwiprFqng8WOLIE2qqK7rpVDSVS-elFXNMtJxAETT5YaK3uogMpWOgmRQxe0h3-k_9y0w2vUMyNYauTBM7Nnx4C165GcQrgEJY3VNUZqbNDcaqGxZ0Bbv9GKvJU7AMJVe3g0gjLHwSLOLzE-F-Ll-7nDjEf4faKy1FiU Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 0903a9d69c6841f589a47fecec113c2b Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesNegativeTest-50894614 Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0903a9d69c6841f589a47fecec113c2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0903a9d69c6841f589a47fecec113c2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0903a9d69c6841f589a47fecec113c2b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0903a9d69c6841f589a47fecec113c2b"}]}] Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesNegativeTest-50894614 Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 0903a9d69c6841f589a47fecec113c2b Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesNegativeTest-50894614 Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesNegativeTest-50894614-project Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a8ab9438322a4b68ad4e7177405d5e31 Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesNegativeTest-50894614-project Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 25e8d96b-ad68-4918-b50c-63775a17cead could not be found. Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '25e8d96b-ad68-4918-b50c-63775a17cead'} Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e8d96b-ad68-4918-b50c-63775a17cead could not be found. Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e8d96b-ad68-4918-b50c-63775a17cead could not be found. Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:33.149097 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:33.154951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:33.154951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:33.154951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:33.154951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:33.154951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:33.154951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e8d96b-ad68-4918-b50c-63775a17cead could not be found. Jul 26 20:13:33.154951 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:33.157830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] Returning 404 to user: Instance 25e8d96b-ad68-4918-b50c-63775a17cead could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:33.159344 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-307e1c97-7913-45b1-bdcd-cf35b21e3ed4 tempest-VolumesNegativeTest-50894614 tempest-VolumesNegativeTest-50894614-project] 10.222.0.58 "GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead" status: 404 len: 111 microversion: 2.1 time: 0.061134 Jul 26 20:13:33.160436 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2659/5418] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:33 2022] GET /compute/v2.1/servers/25e8d96b-ad68-4918-b50c-63775a17cead => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:33.180129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d99d5df4-a39a-4ddf-9b5c-edbde7de1d19 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:33.182821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d99d5df4-a39a-4ddf-9b5c-edbde7de1d19 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:33.194645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d99d5df4-a39a-4ddf-9b5c-edbde7de1d19 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:33.195096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d99d5df4-a39a-4ddf-9b5c-edbde7de1d19 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:33.201218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d99d5df4-a39a-4ddf-9b5c-edbde7de1d19 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:33.207675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d99d5df4-a39a-4ddf-9b5c-edbde7de1d19 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:33.223146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a17f9502-9f76-4a65-91bf-776d03902509 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:33.237766 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a17f9502-9f76-4a65-91bf-776d03902509 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.299637 Jul 26 20:13:33.239702 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2760/5419] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:32 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:33.824549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d99d5df4-a39a-4ddf-9b5c-edbde7de1d19 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:33.836098 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d99d5df4-a39a-4ddf-9b5c-edbde7de1d19 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1317 microversion: 2.1 time: 0.673675 Jul 26 20:13:33.847324 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2660/5420] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:33 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:33.888492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cbcbd39a-a84f-4dea-a8e1-0b9062234cfb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:33.889279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cbcbd39a-a84f-4dea-a8e1-0b9062234cfb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:33.901543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cbcbd39a-a84f-4dea-a8e1-0b9062234cfb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:33.902887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cbcbd39a-a84f-4dea-a8e1-0b9062234cfb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:33.904841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cbcbd39a-a84f-4dea-a8e1-0b9062234cfb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:33.906276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cbcbd39a-a84f-4dea-a8e1-0b9062234cfb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:33.971149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d1713af-47de-40c6-9faa-da3afa7b47a2 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:33.971821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d1713af-47de-40c6-9faa-da3afa7b47a2 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:33.996618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d1713af-47de-40c6-9faa-da3afa7b47a2 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:34.003463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d1713af-47de-40c6-9faa-da3afa7b47a2 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:34.004522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d1713af-47de-40c6-9faa-da3afa7b47a2 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:34.005075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d1713af-47de-40c6-9faa-da3afa7b47a2 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:34.201011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cbcbd39a-a84f-4dea-a8e1-0b9062234cfb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:34.227124 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cbcbd39a-a84f-4dea-a8e1-0b9062234cfb tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1503 microversion: 2.1 time: 0.343915 Jul 26 20:13:34.229545 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2761/5421] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:33 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:34.265462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-876ad52d-7a81-4165-935a-a72bbe8ddabb tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:34.266613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-876ad52d-7a81-4165-935a-a72bbe8ddabb tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:34.281831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-876ad52d-7a81-4165-935a-a72bbe8ddabb tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:34.282541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-876ad52d-7a81-4165-935a-a72bbe8ddabb tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:34.283523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-876ad52d-7a81-4165-935a-a72bbe8ddabb tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:34.284173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-876ad52d-7a81-4165-935a-a72bbe8ddabb tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:34.290412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d1713af-47de-40c6-9faa-da3afa7b47a2 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:34.326635 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d1713af-47de-40c6-9faa-da3afa7b47a2 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.356317 Jul 26 20:13:34.327283 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2661/5422] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:33 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:34.337003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bf9815c9-1d30-4abf-a1a5-64251dcb5f65 req-b9a5211f-b45f-45ad-878c-820b10e03197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0854acd2-6921-4cab-ad5b-bddf5ba312c6", "name": "network-vif-plugged", "status": "completed", "tag": "d635264b-f76b-465b-9ca9-3ec59ae8da06"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:34.362068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:34.391569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bf9815c9-1d30-4abf-a1a5-64251dcb5f65 req-b9a5211f-b45f-45ad-878c-820b10e03197 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:34.392159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bf9815c9-1d30-4abf-a1a5-64251dcb5f65 req-b9a5211f-b45f-45ad-878c-820b10e03197 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:34.414729 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bf9815c9-1d30-4abf-a1a5-64251dcb5f65 req-b9a5211f-b45f-45ad-878c-820b10e03197 service nova] Creating event network-vif-plugged:d635264b-f76b-465b-9ca9-3ec59ae8da06 for instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 on n-h1-708768-8 Jul 26 20:13:34.450771 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bf9815c9-1d30-4abf-a1a5-64251dcb5f65 req-b9a5211f-b45f-45ad-878c-820b10e03197 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115892 Jul 26 20:13:34.453372 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2662/5423] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:34.599078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-876ad52d-7a81-4165-935a-a72bbe8ddabb tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:34.626298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-876ad52d-7a81-4165-935a-a72bbe8ddabb tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.364708 Jul 26 20:13:34.642059 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2762/5424] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:34 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:34.872178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc109879-bbbe-47e4-b9e7-82ec34af8a10 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:34.873066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc109879-bbbe-47e4-b9e7-82ec34af8a10 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:34.881389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc109879-bbbe-47e4-b9e7-82ec34af8a10 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:34.882488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc109879-bbbe-47e4-b9e7-82ec34af8a10 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:34.884168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc109879-bbbe-47e4-b9e7-82ec34af8a10 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:34.886027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc109879-bbbe-47e4-b9e7-82ec34af8a10 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.103729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc109879-bbbe-47e4-b9e7-82ec34af8a10 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:35.112332 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc109879-bbbe-47e4-b9e7-82ec34af8a10 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1506 microversion: 2.1 time: 0.247800 Jul 26 20:13:35.119671 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2663/5425] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:34 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:35.134599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-446e4af2-ed2c-477a-af62-49c4484d5c42 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:35.135758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-446e4af2-ed2c-477a-af62-49c4484d5c42 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:35.169525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-446e4af2-ed2c-477a-af62-49c4484d5c42 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.170115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-446e4af2-ed2c-477a-af62-49c4484d5c42 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.171047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-446e4af2-ed2c-477a-af62-49c4484d5c42 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.171598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-446e4af2-ed2c-477a-af62-49c4484d5c42 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.231658 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-446e4af2-ed2c-477a-af62-49c4484d5c42 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480/ips" status: 200 len: 109 microversion: 2.1 time: 0.100975 Jul 26 20:13:35.234432 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2763/5426] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:13:35 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480/ips => generated 109 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:13:35.253411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-be1db797-d049-4a39-99f5-e5eae609fd16 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:35.254417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-be1db797-d049-4a39-99f5-e5eae609fd16 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:35.257948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b016f140-f9c7-452c-960c-436559915e5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:35.258589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b016f140-f9c7-452c-960c-436559915e5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:35.263173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be1db797-d049-4a39-99f5-e5eae609fd16 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.264301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be1db797-d049-4a39-99f5-e5eae609fd16 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.265502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be1db797-d049-4a39-99f5-e5eae609fd16 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.266177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be1db797-d049-4a39-99f5-e5eae609fd16 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.279131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b016f140-f9c7-452c-960c-436559915e5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.279822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b016f140-f9c7-452c-960c-436559915e5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.280808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b016f140-f9c7-452c-960c-436559915e5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.282465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b016f140-f9c7-452c-960c-436559915e5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.296126 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-be1db797-d049-4a39-99f5-e5eae609fd16 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480/ips" status: 200 len: 109 microversion: 2.1 time: 0.046697 Jul 26 20:13:35.297394 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2664/5427] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:13:35 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480/ips => generated 109 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:13:35.326313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9713fb5d-aa08-4f16-8f42-b823a86846cf tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:35.327265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9713fb5d-aa08-4f16-8f42-b823a86846cf tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:35.348740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9713fb5d-aa08-4f16-8f42-b823a86846cf tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.349354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9713fb5d-aa08-4f16-8f42-b823a86846cf tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.350267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9713fb5d-aa08-4f16-8f42-b823a86846cf tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.351552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9713fb5d-aa08-4f16-8f42-b823a86846cf tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.390072 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9713fb5d-aa08-4f16-8f42-b823a86846cf tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480/ips/tempest-ServerAddressesTestJSON-114039299-network" status: 200 len: 94 microversion: 2.1 time: 0.079715 Jul 26 20:13:35.391659 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2665/5428] 10.222.0.58 () {58 vars in 1398 bytes} [Tue Jul 26 20:13:35 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480/ips/tempest-ServerAddressesTestJSON-114039299-network => generated 94 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:13:35.409612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a37a5519-f92c-4578-a214-3fcc7999bcfa tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:35.410497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a37a5519-f92c-4578-a214-3fcc7999bcfa tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:35.421928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a37a5519-f92c-4578-a214-3fcc7999bcfa tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.422835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a37a5519-f92c-4578-a214-3fcc7999bcfa tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.425127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a37a5519-f92c-4578-a214-3fcc7999bcfa tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.426167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a37a5519-f92c-4578-a214-3fcc7999bcfa tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.527516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b016f140-f9c7-452c-960c-436559915e5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:35.536259 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b016f140-f9c7-452c-960c-436559915e5a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.289630 Jul 26 20:13:35.539752 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2764/5429] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:35 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:35.549670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea534aa2-5ecf-4dcc-8b53-96d831eff170 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:35.551077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ea534aa2-5ecf-4dcc-8b53-96d831eff170 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:35.558658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea534aa2-5ecf-4dcc-8b53-96d831eff170 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.560227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea534aa2-5ecf-4dcc-8b53-96d831eff170 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.561302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea534aa2-5ecf-4dcc-8b53-96d831eff170 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.562879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea534aa2-5ecf-4dcc-8b53-96d831eff170 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.619428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ea534aa2-5ecf-4dcc-8b53-96d831eff170 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:13:35.721663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a37a5519-f92c-4578-a214-3fcc7999bcfa tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:35.734561 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a37a5519-f92c-4578-a214-3fcc7999bcfa tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1314 microversion: 2.1 time: 0.341463 Jul 26 20:13:35.735154 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2666/5430] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:35 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:35.743975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a7b05f2-43b3-42c6-bd10-41bd77aceb31 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:35.744825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a7b05f2-43b3-42c6-bd10-41bd77aceb31 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:35.755300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7b05f2-43b3-42c6-bd10-41bd77aceb31 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.756990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7b05f2-43b3-42c6-bd10-41bd77aceb31 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.757902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7b05f2-43b3-42c6-bd10-41bd77aceb31 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.758689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a7b05f2-43b3-42c6-bd10-41bd77aceb31 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.794148 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea534aa2-5ecf-4dcc-8b53-96d831eff170 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 204 len: 0 microversion: 2.1 time: 0.252420 Jul 26 20:13:35.794972 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2765/5431] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:13:35 2022] DELETE /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:13:35.802648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4d1250af-15f0-435a-a81f-7a6e8ea04460 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:35.804524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4d1250af-15f0-435a-a81f-7a6e8ea04460 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:35.814143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d1250af-15f0-435a-a81f-7a6e8ea04460 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.815040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d1250af-15f0-435a-a81f-7a6e8ea04460 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:35.816267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d1250af-15f0-435a-a81f-7a6e8ea04460 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:35.816932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4d1250af-15f0-435a-a81f-7a6e8ea04460 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:36.084249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4d1250af-15f0-435a-a81f-7a6e8ea04460 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:36.093672 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4d1250af-15f0-435a-a81f-7a6e8ea04460 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.297181 Jul 26 20:13:36.094327 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2766/5432] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:35 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:36.115229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9b91bce5-8ba3-48f2-b033-d6dc22a7d95e tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:36.116079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9b91bce5-8ba3-48f2-b033-d6dc22a7d95e tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:36.123392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b91bce5-8ba3-48f2-b033-d6dc22a7d95e tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:36.124074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b91bce5-8ba3-48f2-b033-d6dc22a7d95e tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:36.125016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b91bce5-8ba3-48f2-b033-d6dc22a7d95e tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:36.125610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b91bce5-8ba3-48f2-b033-d6dc22a7d95e tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:36.178805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1a7b05f2-43b3-42c6-bd10-41bd77aceb31 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:36.191093 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a7b05f2-43b3-42c6-bd10-41bd77aceb31 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.453172 Jul 26 20:13:36.192030 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2667/5433] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:35 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:36.221731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-17d6fddb-1e73-48b7-9894-28403a3bd2b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:36.223759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-17d6fddb-1e73-48b7-9894-28403a3bd2b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: e796a078-8f3e-4c9f-a358-634cbc5b6985] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:36.233982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-17d6fddb-1e73-48b7-9894-28403a3bd2b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance e796a078-8f3e-4c9f-a358-634cbc5b6985 could not be found. Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-17d6fddb-1e73-48b7-9894-28403a3bd2b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/e796a078-8f3e-4c9f-a358-634cbc5b6985/action HTTP/1.1 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 15 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: {"unpause": {}} Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e796a078-8f3e-4c9f-a358-634cbc5b6985 could not be found. Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e796a078-8f3e-4c9f-a358-634cbc5b6985', 'body': {'unpause': {}}} Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e796a078-8f3e-4c9f-a358-634cbc5b6985 could not be found. Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e796a078-8f3e-4c9f-a358-634cbc5b6985 could not be found. Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:36.236771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:36.242439 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:36.242439 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:36.242439 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e796a078-8f3e-4c9f-a358-634cbc5b6985 could not be found. Jul 26 20:13:36.242439 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:36.244276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-17d6fddb-1e73-48b7-9894-28403a3bd2b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance e796a078-8f3e-4c9f-a358-634cbc5b6985 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:36.246499 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-17d6fddb-1e73-48b7-9894-28403a3bd2b3 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/e796a078-8f3e-4c9f-a358-634cbc5b6985/action" status: 404 len: 111 microversion: 2.1 time: 0.035240 Jul 26 20:13:36.247692 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2668/5434] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:36 2022] POST /compute/v2.1/servers/e796a078-8f3e-4c9f-a358-634cbc5b6985/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:36.257160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9111b6fc-a4b3-4254-94c5-1fd54cb214c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:36.258279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9111b6fc-a4b3-4254-94c5-1fd54cb214c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:36.268538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9111b6fc-a4b3-4254-94c5-1fd54cb214c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:36.268994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9111b6fc-a4b3-4254-94c5-1fd54cb214c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:36.273206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9111b6fc-a4b3-4254-94c5-1fd54cb214c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:36.273206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9111b6fc-a4b3-4254-94c5-1fd54cb214c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:36.452019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9b91bce5-8ba3-48f2-b033-d6dc22a7d95e tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:36.464347 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9b91bce5-8ba3-48f2-b033-d6dc22a7d95e tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1512 microversion: 2.1 time: 0.354824 Jul 26 20:13:36.466560 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2767/5435] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:36 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:36.664722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9111b6fc-a4b3-4254-94c5-1fd54cb214c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:36.678367 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9111b6fc-a4b3-4254-94c5-1fd54cb214c5 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.426769 Jul 26 20:13:36.694700 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2669/5436] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:36 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:36.705271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-087686cb-8d11-4400-835b-149efd6d091f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:36.705904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-087686cb-8d11-4400-835b-149efd6d091f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:36.714309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-087686cb-8d11-4400-835b-149efd6d091f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:36.715283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-087686cb-8d11-4400-835b-149efd6d091f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:36.715875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-087686cb-8d11-4400-835b-149efd6d091f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:36.716459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-087686cb-8d11-4400-835b-149efd6d091f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:36.759910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4fdff3ff-214a-4f2e-8060-91793c1ef46e tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:36.762408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4fdff3ff-214a-4f2e-8060-91793c1ef46e tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:36.774612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4fdff3ff-214a-4f2e-8060-91793c1ef46e tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:36.775600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4fdff3ff-214a-4f2e-8060-91793c1ef46e tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:36.779398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4fdff3ff-214a-4f2e-8060-91793c1ef46e tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:36.781668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4fdff3ff-214a-4f2e-8060-91793c1ef46e tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:37.017740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4fdff3ff-214a-4f2e-8060-91793c1ef46e tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:37.031022 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4fdff3ff-214a-4f2e-8060-91793c1ef46e tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1498 microversion: 2.1 time: 0.274876 Jul 26 20:13:37.032349 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2670/5437] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:36 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1498 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:37.038153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c85db899-5ee7-4b61-9a58-cf4a2595ef80 req-8c91f1d7-002e-447d-ba82-b945525daf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906e76c3-27a3-4703-9938-4068a6ab1436", "name": "network-vif-plugged", "status": "completed", "tag": "782c6898-4df2-4812-b184-95c9c51920db"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:37.071326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c85db899-5ee7-4b61-9a58-cf4a2595ef80 req-8c91f1d7-002e-447d-ba82-b945525daf2c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:37.072027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c85db899-5ee7-4b61-9a58-cf4a2595ef80 req-8c91f1d7-002e-447d-ba82-b945525daf2c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:37.092833 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c85db899-5ee7-4b61-9a58-cf4a2595ef80 req-8c91f1d7-002e-447d-ba82-b945525daf2c service nova] Creating event network-vif-plugged:782c6898-4df2-4812-b184-95c9c51920db for instance 906e76c3-27a3-4703-9938-4068a6ab1436 on n-h2-708768-8 Jul 26 20:13:37.102087 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c85db899-5ee7-4b61-9a58-cf4a2595ef80 req-8c91f1d7-002e-447d-ba82-b945525daf2c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068099 Jul 26 20:13:37.103116 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2671/5438] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:37.127875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a0828ab-ffa7-4e84-b933-18aeceda4f8d tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:37.141492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a0828ab-ffa7-4e84-b933-18aeceda4f8d tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:37.171346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a0828ab-ffa7-4e84-b933-18aeceda4f8d tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:37.175453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a0828ab-ffa7-4e84-b933-18aeceda4f8d tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:37.178569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a0828ab-ffa7-4e84-b933-18aeceda4f8d tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:37.181162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a0828ab-ffa7-4e84-b933-18aeceda4f8d tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:37.434891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-087686cb-8d11-4400-835b-149efd6d091f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:37.447735 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-087686cb-8d11-4400-835b-149efd6d091f tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.746478 Jul 26 20:13:37.449422 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2768/5439] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:36 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:37.482919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:37.484481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:37.507740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:37.510427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:37.512177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:37.512810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:37.582186 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Cannot 'unpause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action HTTP/1.1 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 15 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: {"unpause": {}} Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: exception: Cannot 'unpause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'unpause': {}}} Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f in vm_state active. Cannot unpause while the instance is in this state. Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:37.586388 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:37.592007 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:37.592007 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:37.592007 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:37.592007 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:13:37.592007 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:37.593164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 409 to user: Cannot 'unpause' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:37.595523 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad47f218-2606-4711-a031-3483d2867df2 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 409 len: 145 microversion: 2.1 time: 0.127024 Jul 26 20:13:37.601196 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2769/5440] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:37 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 145 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 20:13:37.611978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8ac47d57-1f52-411c-a013-37b33b625878 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:37.613615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8ac47d57-1f52-411c-a013-37b33b625878 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:37.629403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ac47d57-1f52-411c-a013-37b33b625878 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:37.630529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ac47d57-1f52-411c-a013-37b33b625878 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:37.632373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ac47d57-1f52-411c-a013-37b33b625878 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:37.634619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8ac47d57-1f52-411c-a013-37b33b625878 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:37.968570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a0828ab-ffa7-4e84-b933-18aeceda4f8d tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:37.980281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a0828ab-ffa7-4e84-b933-18aeceda4f8d tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1315 microversion: 2.1 time: 0.862763 Jul 26 20:13:38.003660 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2672/5441] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:37 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1315 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:38.010916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-faab6171-d6a1-4672-9f57-1cf875e32322 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:38.012897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-faab6171-d6a1-4672-9f57-1cf875e32322 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:38.020341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faab6171-d6a1-4672-9f57-1cf875e32322 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:38.020967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faab6171-d6a1-4672-9f57-1cf875e32322 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:38.021895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faab6171-d6a1-4672-9f57-1cf875e32322 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:38.022504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-faab6171-d6a1-4672-9f57-1cf875e32322 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:38.477321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-faab6171-d6a1-4672-9f57-1cf875e32322 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:38.493584 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-faab6171-d6a1-4672-9f57-1cf875e32322 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.484844 Jul 26 20:13:38.509744 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2673/5442] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:38 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:38.528520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c6acf409-c4bc-48a8-9645-4f3e87b14f77 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:38.529139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c6acf409-c4bc-48a8-9645-4f3e87b14f77 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:38.547233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6acf409-c4bc-48a8-9645-4f3e87b14f77 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:38.548907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6acf409-c4bc-48a8-9645-4f3e87b14f77 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:38.550100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6acf409-c4bc-48a8-9645-4f3e87b14f77 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:38.553779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6acf409-c4bc-48a8-9645-4f3e87b14f77 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:38.717482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8ac47d57-1f52-411c-a013-37b33b625878 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763138aad438422995f86c67ac9504f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2642dbdbd38441c29901c098bebaecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:38.732215 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8ac47d57-1f52-411c-a013-37b33b625878 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 200 len: 1512 microversion: 2.1 time: 1.128345 Jul 26 20:13:38.755188 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2770/5443] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:37 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 1512 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:38.909880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-85dfd728-5952-44d8-8874-8f17c7de392c req-cd37193a-8e51-4e86-84d3-84393fb3625f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf5b644-09f9-42a3-9f8c-bf4b5c255480", "name": "network-vif-deleted", "tag": "2636f5db-546e-48b2-a259-959f053d1921"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:38.937342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-85dfd728-5952-44d8-8874-8f17c7de392c req-cd37193a-8e51-4e86-84d3-84393fb3625f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:38.944626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-85dfd728-5952-44d8-8874-8f17c7de392c req-cd37193a-8e51-4e86-84d3-84393fb3625f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:38.978630 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-85dfd728-5952-44d8-8874-8f17c7de392c req-cd37193a-8e51-4e86-84d3-84393fb3625f service nova] Creating event network-vif-deleted:2636f5db-546e-48b2-a259-959f053d1921 for instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 on n-h1-708768-8 Jul 26 20:13:38.997467 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-85dfd728-5952-44d8-8874-8f17c7de392c req-cd37193a-8e51-4e86-84d3-84393fb3625f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102209 Jul 26 20:13:38.998660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2771/5444] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:39.009721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c8fc5129-35d0-4d06-accb-92b4f4b3c556 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:39.010825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c8fc5129-35d0-4d06-accb-92b4f4b3c556 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:39.043583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8fc5129-35d0-4d06-accb-92b4f4b3c556 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.046508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8fc5129-35d0-4d06-accb-92b4f4b3c556 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.047899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8fc5129-35d0-4d06-accb-92b4f4b3c556 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.067096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c6acf409-c4bc-48a8-9645-4f3e87b14f77 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:39.075053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8fc5129-35d0-4d06-accb-92b4f4b3c556 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.079359 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c6acf409-c4bc-48a8-9645-4f3e87b14f77 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.561321 Jul 26 20:13:39.092884 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2674/5445] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:38 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:39.133782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b176ff77-e14a-47c3-8c5a-7c5ab6b867f7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:39.134356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b176ff77-e14a-47c3-8c5a-7c5ab6b867f7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:39.151749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-b176ff77-e14a-47c3-8c5a-7c5ab6b867f7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2 could not be found. Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b176ff77-e14a-47c3-8c5a-7c5ab6b867f7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2/action HTTP/1.1 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 18 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: {"unshelve": null} Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2 could not be found. Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2', 'body': {'unshelve': None}} Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2 could not be found. Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2 could not be found. Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.159771 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:39.163921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:39.163921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:39.163921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:39.163921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:39.163921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2 could not be found. Jul 26 20:13:39.163921 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.166856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b176ff77-e14a-47c3-8c5a-7c5ab6b867f7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:39.169221 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b176ff77-e14a-47c3-8c5a-7c5ab6b867f7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2/action" status: 404 len: 111 microversion: 2.1 time: 0.052587 Jul 26 20:13:39.174731 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2675/5446] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:39 2022] POST /compute/v2.1/servers/ac5c337a-2cd2-4ffd-a115-8d7b2c3299d2/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:39.185501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5d58f47-97ca-4d13-9e12-a4b626d04770 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:39.186945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5d58f47-97ca-4d13-9e12-a4b626d04770 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:39.209721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5d58f47-97ca-4d13-9e12-a4b626d04770 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.216359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5d58f47-97ca-4d13-9e12-a4b626d04770 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.218474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5d58f47-97ca-4d13-9e12-a4b626d04770 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.219127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f5d58f47-97ca-4d13-9e12-a4b626d04770 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.572953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f5d58f47-97ca-4d13-9e12-a4b626d04770 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:39.584349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5d58f47-97ca-4d13-9e12-a4b626d04770 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.407485 Jul 26 20:13:39.596959 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2676/5447] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:39 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:39.610879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-727c8b06-1a25-471f-bd2e-c87f0ea32913 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:39.612299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-727c8b06-1a25-471f-bd2e-c87f0ea32913 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:39.623556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-727c8b06-1a25-471f-bd2e-c87f0ea32913 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.624269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-727c8b06-1a25-471f-bd2e-c87f0ea32913 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.625261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-727c8b06-1a25-471f-bd2e-c87f0ea32913 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.625933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-727c8b06-1a25-471f-bd2e-c87f0ea32913 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.742813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c8fc5129-35d0-4d06-accb-92b4f4b3c556 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:39.758587 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c8fc5129-35d0-4d06-accb-92b4f4b3c556 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1502 microversion: 2.1 time: 0.752899 Jul 26 20:13:39.770534 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2772/5448] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:39 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1502 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:39.770534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:39.770534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] [instance: bdf5b644-09f9-42a3-9f8c-bf4b5c255480] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:39.785653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.786471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.788077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.788882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.809523 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] HTTP exception thrown: Instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 could not be found. Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Request method failure captured: Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 HTTP/1.1 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4ErYrgTsxdmSP7zMehWMkYY2lHoPKCBMRX8EhlEgzw-D-pz84KpUjlZpIf4Te6SkKMNFVmTupSciEmrxI9LStWVWR2dZEqzHue4iT8i1TG0upECg5fjwp59E_A0DPtceAHoLl7S3UPKr5wUnlbM7OcJ-n3Iss7use1AGWtpheC6uTdg Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2642dbdbd38441c29901c098bebaecb2 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerAddressesTestJSON-1832990867 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2642dbdbd38441c29901c098bebaecb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2642dbdbd38441c29901c098bebaecb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2642dbdbd38441c29901c098bebaecb2", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2642dbdbd38441c29901c098bebaecb2"}]}] Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerAddressesTestJSON-1832990867 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2642dbdbd38441c29901c098bebaecb2 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1832990867 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerAddressesTestJSON-1832990867-project Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 763138aad438422995f86c67ac9504f6 Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerAddressesTestJSON-1832990867-project Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 could not be found. Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'bdf5b644-09f9-42a3-9f8c-bf4b5c255480'} Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 could not be found. Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 could not be found. Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:39.812975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.819803 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:39.819803 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:39.819803 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:39.819803 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:39.819803 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:39.819803 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 could not be found. Jul 26 20:13:39.819803 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:39.825357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] Returning 404 to user: Instance bdf5b644-09f9-42a3-9f8c-bf4b5c255480 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:39.826569 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f0f2a32-28e5-4688-bb9b-db2d62e9e788 tempest-ServerAddressesTestJSON-1832990867 tempest-ServerAddressesTestJSON-1832990867-project] 10.222.0.58 "GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480" status: 404 len: 111 microversion: 2.1 time: 0.062935 Jul 26 20:13:39.827849 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2773/5449] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:39 2022] GET /compute/v2.1/servers/bdf5b644-09f9-42a3-9f8c-bf4b5c255480 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:39.833621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4309c7f2-5886-46cf-a824-1968605fa46e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:39.834620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4309c7f2-5886-46cf-a824-1968605fa46e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:39.845152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4309c7f2-5886-46cf-a824-1968605fa46e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.845932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4309c7f2-5886-46cf-a824-1968605fa46e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.847520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4309c7f2-5886-46cf-a824-1968605fa46e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:39.848853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4309c7f2-5886-46cf-a824-1968605fa46e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:39.940803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-727c8b06-1a25-471f-bd2e-c87f0ea32913 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:39.945844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:39.967179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-727c8b06-1a25-471f-bd2e-c87f0ea32913 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.362331 Jul 26 20:13:39.968485 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2677/5450] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:39 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:39.991887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:39.992469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:40.007863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.008487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.009427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.010017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.072453 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Cannot 'unshelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action HTTP/1.1 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 18 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: {"unshelve": null} Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: exception: Cannot 'unshelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'unshelve': None}} Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f in vm_state active. Cannot unshelve while the instance is in this state. Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 20:13:40.083928 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active Jul 26 20:13:40.088002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:40.094505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 409 to user: Cannot 'unshelve' instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f while it is in vm_state active {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:40.098251 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-965494c3-b353-4aa7-9033-03fae88c7268 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action" status: 409 len: 146 microversion: 2.1 time: 0.111656 Jul 26 20:13:40.099566 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2678/5451] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:39 2022] POST /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f/action => generated 146 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 20:13:40.107948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d13ed5cb-2903-40e6-8433-fd0203c078f8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:40.115180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d13ed5cb-2903-40e6-8433-fd0203c078f8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:40.140527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d13ed5cb-2903-40e6-8433-fd0203c078f8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.142359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d13ed5cb-2903-40e6-8433-fd0203c078f8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.144284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4309c7f2-5886-46cf-a824-1968605fa46e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:40.145476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d13ed5cb-2903-40e6-8433-fd0203c078f8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.146401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d13ed5cb-2903-40e6-8433-fd0203c078f8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.153749 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4309c7f2-5886-46cf-a824-1968605fa46e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1502 microversion: 2.1 time: 0.324585 Jul 26 20:13:40.171005 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2774/5452] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:39 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1502 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:40.178875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aa946331-6058-40b5-b66e-6942027b3a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:40.179417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aa946331-6058-40b5-b66e-6942027b3a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:40.197470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa946331-6058-40b5-b66e-6942027b3a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.197927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa946331-6058-40b5-b66e-6942027b3a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.199386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa946331-6058-40b5-b66e-6942027b3a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.199914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa946331-6058-40b5-b66e-6942027b3a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.226850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-aa946331-6058-40b5-b66e-6942027b3a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lazy-loading 'flavor' on Instance uuid 906e76c3-27a3-4703-9938-4068a6ab1436 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:13:40.369300 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aa946331-6058-40b5-b66e-6942027b3a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "POST /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436/action" status: 202 len: 0 microversion: 2.1 time: 0.192501 Jul 26 20:13:40.373706 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2775/5453] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:40 2022] POST /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:13:40.383653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6fe36858-de8b-49fb-9dfd-b6d380498d4b tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:40.388177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6fe36858-de8b-49fb-9dfd-b6d380498d4b tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:40.409351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6fe36858-de8b-49fb-9dfd-b6d380498d4b tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.410051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6fe36858-de8b-49fb-9dfd-b6d380498d4b tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.412547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6fe36858-de8b-49fb-9dfd-b6d380498d4b tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.413481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6fe36858-de8b-49fb-9dfd-b6d380498d4b tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.622344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6fe36858-de8b-49fb-9dfd-b6d380498d4b tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:40.624197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d13ed5cb-2903-40e6-8433-fd0203c078f8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:40.632888 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6fe36858-de8b-49fb-9dfd-b6d380498d4b tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1510 microversion: 2.1 time: 0.257905 Jul 26 20:13:40.633429 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d13ed5cb-2903-40e6-8433-fd0203c078f8 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.530060 Jul 26 20:13:40.643925 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2679/5454] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:40 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:40.649373 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2776/5455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:40 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:40.659184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4879e5ce-a621-4808-bf32-a3221a50656e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:40.660542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4879e5ce-a621-4808-bf32-a3221a50656e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:40.671785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4879e5ce-a621-4808-bf32-a3221a50656e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.676394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4879e5ce-a621-4808-bf32-a3221a50656e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:40.678378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4879e5ce-a621-4808-bf32-a3221a50656e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:40.678830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4879e5ce-a621-4808-bf32-a3221a50656e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:41.098482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4879e5ce-a621-4808-bf32-a3221a50656e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:41.109646 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4879e5ce-a621-4808-bf32-a3221a50656e tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.454432 Jul 26 20:13:41.124226 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2680/5456] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:40 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:41.132017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cfaf6d91-1c65-4ae6-9538-d36c57cbd0af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-425369331_updated"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:41.135099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cfaf6d91-1c65-4ae6-9538-d36c57cbd0af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 526a7cb6-2b5f-47ae-a857-cf0a04edd436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:41.146722 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-cfaf6d91-1c65-4ae6-9538-d36c57cbd0af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 526a7cb6-2b5f-47ae-a857-cf0a04edd436 could not be found. Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cfaf6d91-1c65-4ae6-9538-d36c57cbd0af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/servers/526a7cb6-2b5f-47ae-a857-cf0a04edd436 HTTP/1.1 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 80 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-425369331_updated"}} Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 526a7cb6-2b5f-47ae-a857-cf0a04edd436 could not be found. Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '526a7cb6-2b5f-47ae-a857-cf0a04edd436', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-425369331_updated'}}} Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526a7cb6-2b5f-47ae-a857-cf0a04edd436 could not be found. Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 26 20:13:41.152296 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526a7cb6-2b5f-47ae-a857-cf0a04edd436 could not be found. Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526a7cb6-2b5f-47ae-a857-cf0a04edd436 could not be found. Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cfaf6d91-1c65-4ae6-9538-d36c57cbd0af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 526a7cb6-2b5f-47ae-a857-cf0a04edd436 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:41.156397 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cfaf6d91-1c65-4ae6-9538-d36c57cbd0af tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "PUT /compute/v2.1/servers/526a7cb6-2b5f-47ae-a857-cf0a04edd436" status: 404 len: 111 microversion: 2.1 time: 0.028342 Jul 26 20:13:41.158986 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2777/5457] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 20:13:41 2022] PUT /compute/v2.1/servers/526a7cb6-2b5f-47ae-a857-cf0a04edd436 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:41.163921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1c59873d-f8f5-48c5-8c20-439ac7bf5c89 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:41.164543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1c59873d-f8f5-48c5-8c20-439ac7bf5c89 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:41.172277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c59873d-f8f5-48c5-8c20-439ac7bf5c89 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:41.172730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c59873d-f8f5-48c5-8c20-439ac7bf5c89 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:41.173522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c59873d-f8f5-48c5-8c20-439ac7bf5c89 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:41.179552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c59873d-f8f5-48c5-8c20-439ac7bf5c89 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:41.656681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1c59873d-f8f5-48c5-8c20-439ac7bf5c89 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:41.662415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be90f2ed-e2ac-4fdf-9d8b-a1dc578a5a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:41.663225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-be90f2ed-e2ac-4fdf-9d8b-a1dc578a5a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:41.667386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1c59873d-f8f5-48c5-8c20-439ac7bf5c89 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.507369 Jul 26 20:13:41.668676 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2681/5458] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:41 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:41.686341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be90f2ed-e2ac-4fdf-9d8b-a1dc578a5a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:41.688911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be90f2ed-e2ac-4fdf-9d8b-a1dc578a5a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:41.691534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be90f2ed-e2ac-4fdf-9d8b-a1dc578a5a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:41.695038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be90f2ed-e2ac-4fdf-9d8b-a1dc578a5a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:41.696905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b51d9637-9502-469c-9aff-56fc18270abf tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:41.697525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b51d9637-9502-469c-9aff-56fc18270abf tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:41.721712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b51d9637-9502-469c-9aff-56fc18270abf tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:41.722170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b51d9637-9502-469c-9aff-56fc18270abf tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:41.726008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b51d9637-9502-469c-9aff-56fc18270abf tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:41.729530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b51d9637-9502-469c-9aff-56fc18270abf tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:41.983147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-be90f2ed-e2ac-4fdf-9d8b-a1dc578a5a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:41.985523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:41.996968 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-be90f2ed-e2ac-4fdf-9d8b-a1dc578a5a7a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1493 microversion: 2.1 time: 0.338983 Jul 26 20:13:41.997696 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2778/5459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:41 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1493 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:42.012547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f58d3592-b345-488b-b968-4fa76394f1bb tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:42.012547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f58d3592-b345-488b-b968-4fa76394f1bb tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:42.014522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f58d3592-b345-488b-b968-4fa76394f1bb tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.015229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f58d3592-b345-488b-b968-4fa76394f1bb tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.016288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f58d3592-b345-488b-b968-4fa76394f1bb tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.016973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f58d3592-b345-488b-b968-4fa76394f1bb tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.052837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f58d3592-b345-488b-b968-4fa76394f1bb tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:13:42.207985 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f58d3592-b345-488b-b968-4fa76394f1bb tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 204 len: 0 microversion: 2.1 time: 0.207951 Jul 26 20:13:42.209091 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2779/5460] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:13:41 2022] DELETE /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:13:42.221942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7536b113-354b-4e9a-8bff-8fe07ca9dc19 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:42.222587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7536b113-354b-4e9a-8bff-8fe07ca9dc19 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:42.232692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7536b113-354b-4e9a-8bff-8fe07ca9dc19 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.232944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7536b113-354b-4e9a-8bff-8fe07ca9dc19 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.233898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7536b113-354b-4e9a-8bff-8fe07ca9dc19 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.234369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7536b113-354b-4e9a-8bff-8fe07ca9dc19 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.263585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b51d9637-9502-469c-9aff-56fc18270abf tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:42.297135 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b51d9637-9502-469c-9aff-56fc18270abf tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.603813 Jul 26 20:13:42.298796 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2682/5461] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:41 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:42.309253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e0a580b-fbab-4ecf-8d0e-88e5fd5e545f tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:42.325087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e0a580b-fbab-4ecf-8d0e-88e5fd5e545f tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:42.335273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e0a580b-fbab-4ecf-8d0e-88e5fd5e545f tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.343357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e0a580b-fbab-4ecf-8d0e-88e5fd5e545f tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.344453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e0a580b-fbab-4ecf-8d0e-88e5fd5e545f tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.345292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e0a580b-fbab-4ecf-8d0e-88e5fd5e545f tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.363853 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7536b113-354b-4e9a-8bff-8fe07ca9dc19 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "POST /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436/action" status: 202 len: 0 microversion: 2.1 time: 0.152093 Jul 26 20:13:42.364860 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2780/5462] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:42 2022] POST /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:13:42.384451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0fdf054-864f-442c-9034-9a0aec90148d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0fdf054-864f-442c-9034-9a0aec90148d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f HTTP/1.1 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 280 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:42.394216 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 20:13:42.398021 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:42.402058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0fdf054-864f-442c-9034-9a0aec90148d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:42.403369 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0fdf054-864f-442c-9034-9a0aec90148d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "PUT /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 400 len: 619 microversion: 2.1 time: 0.036805 Jul 26 20:13:42.404224 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2781/5463] 10.222.0.58 () {60 vars in 1257 bytes} [Tue Jul 26 20:13:42 2022] PUT /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:13:42.412975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8b27f209-f2e4-43da-94cd-19f9698fb9b1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:42.414335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8b27f209-f2e4-43da-94cd-19f9698fb9b1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:42.423864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b27f209-f2e4-43da-94cd-19f9698fb9b1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.424919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b27f209-f2e4-43da-94cd-19f9698fb9b1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.425958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b27f209-f2e4-43da-94cd-19f9698fb9b1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.426660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b27f209-f2e4-43da-94cd-19f9698fb9b1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.743429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8b27f209-f2e4-43da-94cd-19f9698fb9b1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:42.751858 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8b27f209-f2e4-43da-94cd-19f9698fb9b1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1499 microversion: 2.1 time: 0.343283 Jul 26 20:13:42.754385 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2782/5464] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:42 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1499 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:42.760183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63f0af72-2d17-4c85-a00a-00799afe29e7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:42.761004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63f0af72-2d17-4c85-a00a-00799afe29e7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:42.779091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63f0af72-2d17-4c85-a00a-00799afe29e7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.779885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63f0af72-2d17-4c85-a00a-00799afe29e7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:42.780823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63f0af72-2d17-4c85-a00a-00799afe29e7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:42.781413 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63f0af72-2d17-4c85-a00a-00799afe29e7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:43.065151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63f0af72-2d17-4c85-a00a-00799afe29e7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:43.074789 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63f0af72-2d17-4c85-a00a-00799afe29e7 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.318435 Jul 26 20:13:43.085449 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2783/5465] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:42 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:43.106704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3e1fdcf-53cf-489b-a94c-6da8f80b3ed6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:43.107534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3e1fdcf-53cf-489b-a94c-6da8f80b3ed6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:43.121570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3e1fdcf-53cf-489b-a94c-6da8f80b3ed6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:43.122191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3e1fdcf-53cf-489b-a94c-6da8f80b3ed6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:43.123105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3e1fdcf-53cf-489b-a94c-6da8f80b3ed6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:43.123920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3e1fdcf-53cf-489b-a94c-6da8f80b3ed6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:43.421476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3e1fdcf-53cf-489b-a94c-6da8f80b3ed6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:43.435180 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3e1fdcf-53cf-489b-a94c-6da8f80b3ed6 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.332441 Jul 26 20:13:43.438421 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2784/5466] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:43 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:43.462343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7789f83e-eff1-4ac2-b12e-63addb3dc484 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7789f83e-eff1-4ac2-b12e-63addb3dc484 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: request: PUT /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f HTTP/1.1 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 24 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: {"server": {"name": ""}} Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f', 'body': {'server': {'name': ''}}} Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi '' Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:13:43.466786 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 20:13:43.470816 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:13:43.474201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7789f83e-eff1-4ac2-b12e-63addb3dc484 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:43.476982 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7789f83e-eff1-4ac2-b12e-63addb3dc484 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "PUT /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 400 len: 108 microversion: 2.1 time: 0.018482 Jul 26 20:13:43.478453 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2785/5467] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 20:13:43 2022] PUT /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:13:43.488148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6a0ffd57-e7bb-4d8e-8a31-824e474f7a90 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:43.491378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6a0ffd57-e7bb-4d8e-8a31-824e474f7a90 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:43.514005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a0ffd57-e7bb-4d8e-8a31-824e474f7a90 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:43.515251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a0ffd57-e7bb-4d8e-8a31-824e474f7a90 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:43.517984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a0ffd57-e7bb-4d8e-8a31-824e474f7a90 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:43.518669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6a0ffd57-e7bb-4d8e-8a31-824e474f7a90 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:43.640708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e0a580b-fbab-4ecf-8d0e-88e5fd5e545f tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:43.650223 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e0a580b-fbab-4ecf-8d0e-88e5fd5e545f tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1504 microversion: 2.1 time: 1.348668 Jul 26 20:13:43.651002 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2683/5468] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:42 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1504 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:43.776229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-013f0eda-b781-4be8-9f34-f5d689f11a2c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:43.777765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-013f0eda-b781-4be8-9f34-f5d689f11a2c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:43.792604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-013f0eda-b781-4be8-9f34-f5d689f11a2c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:43.793909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-013f0eda-b781-4be8-9f34-f5d689f11a2c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:43.794913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-013f0eda-b781-4be8-9f34-f5d689f11a2c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:43.795517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-013f0eda-b781-4be8-9f34-f5d689f11a2c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:43.994455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6a0ffd57-e7bb-4d8e-8a31-824e474f7a90 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:44.006561 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6a0ffd57-e7bb-4d8e-8a31-824e474f7a90 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1506 microversion: 2.1 time: 0.522946 Jul 26 20:13:44.007144 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2786/5469] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:43 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:44.424681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-013f0eda-b781-4be8-9f34-f5d689f11a2c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:44.440275 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-013f0eda-b781-4be8-9f34-f5d689f11a2c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1499 microversion: 2.1 time: 0.668339 Jul 26 20:13:44.454559 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2684/5470] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:43 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1499 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:44.676668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d65234e-bf7c-4a78-a066-101f3ae22c38 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:44.677837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d65234e-bf7c-4a78-a066-101f3ae22c38 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:44.694544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d65234e-bf7c-4a78-a066-101f3ae22c38 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:44.695017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d65234e-bf7c-4a78-a066-101f3ae22c38 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:44.699479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d65234e-bf7c-4a78-a066-101f3ae22c38 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:44.702758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d65234e-bf7c-4a78-a066-101f3ae22c38 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:45.135400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d65234e-bf7c-4a78-a066-101f3ae22c38 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:45.146464 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d65234e-bf7c-4a78-a066-101f3ae22c38 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1504 microversion: 2.1 time: 0.474326 Jul 26 20:13:45.147337 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2787/5471] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:44 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:45.461859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dda59427-c4bd-44a5-bfdb-c43fe70f5165 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:45.462464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dda59427-c4bd-44a5-bfdb-c43fe70f5165 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:45.497458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dda59427-c4bd-44a5-bfdb-c43fe70f5165 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:45.497928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dda59427-c4bd-44a5-bfdb-c43fe70f5165 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:45.498725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dda59427-c4bd-44a5-bfdb-c43fe70f5165 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:45.499163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dda59427-c4bd-44a5-bfdb-c43fe70f5165 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:45.544784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-090a7237-2d88-403f-a217-90d4e812ed3a req-7d57e472-d110-4bf6-b467-d23d82ebc920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0854acd2-6921-4cab-ad5b-bddf5ba312c6", "name": "network-vif-deleted", "tag": "d635264b-f76b-465b-9ca9-3ec59ae8da06"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:45.568337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-090a7237-2d88-403f-a217-90d4e812ed3a req-7d57e472-d110-4bf6-b467-d23d82ebc920 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:45.572385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-090a7237-2d88-403f-a217-90d4e812ed3a req-7d57e472-d110-4bf6-b467-d23d82ebc920 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:45.603899 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-090a7237-2d88-403f-a217-90d4e812ed3a req-7d57e472-d110-4bf6-b467-d23d82ebc920 service nova] Creating event network-vif-deleted:d635264b-f76b-465b-9ca9-3ec59ae8da06 for instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 on n-h1-708768-8 Jul 26 20:13:45.624935 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-090a7237-2d88-403f-a217-90d4e812ed3a req-7d57e472-d110-4bf6-b467-d23d82ebc920 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084325 Jul 26 20:13:45.632801 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2788/5472] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:45.813469 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:13:45.814351 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 (ip 10.222.0.58) !!! Jul 26 20:13:45.908548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dda59427-c4bd-44a5-bfdb-c43fe70f5165 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:45.921883 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dda59427-c4bd-44a5-bfdb-c43fe70f5165 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1499 microversion: 2.1 time: 0.463734 Jul 26 20:13:45.926724 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2685/5473] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:45 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1499 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:46.170348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:46.171174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:46.193069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:46.196170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:46.197081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:46.197680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:46.295666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:46.296402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:46.298493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lazy-loading 'fault' on Instance uuid 0854acd2-6921-4cab-ad5b-bddf5ba312c6 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:13:46.406004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa0c11b139d459799360eec098cabb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d49a0ff8af1479580076bccd62001ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:46.427100 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-14b0c18d-3eb7-404e-9dd3-de434711c6d7 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 200 len: 1304 microversion: 2.1 time: 0.260345 Jul 26 20:13:46.428409 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2789/5474] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:46 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 1304 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:46.950825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dfeb90ce-1ef6-4aaa-b45e-75b3f04f3b87 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:46.952065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dfeb90ce-1ef6-4aaa-b45e-75b3f04f3b87 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:46.969681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfeb90ce-1ef6-4aaa-b45e-75b3f04f3b87 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:46.972187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfeb90ce-1ef6-4aaa-b45e-75b3f04f3b87 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:46.973666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfeb90ce-1ef6-4aaa-b45e-75b3f04f3b87 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:46.976226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfeb90ce-1ef6-4aaa-b45e-75b3f04f3b87 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:47.293077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dfeb90ce-1ef6-4aaa-b45e-75b3f04f3b87 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:47.312283 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dfeb90ce-1ef6-4aaa-b45e-75b3f04f3b87 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1502 microversion: 2.1 time: 0.356458 Jul 26 20:13:47.328119 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2686/5475] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:46 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1502 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:47.340003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d80fdca0-6e78-4ac6-acc1-ad0739c1953a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:47.341946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d80fdca0-6e78-4ac6-acc1-ad0739c1953a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:47.363029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d80fdca0-6e78-4ac6-acc1-ad0739c1953a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:47.364164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d80fdca0-6e78-4ac6-acc1-ad0739c1953a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:47.372844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d80fdca0-6e78-4ac6-acc1-ad0739c1953a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:47.375732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d80fdca0-6e78-4ac6-acc1-ad0739c1953a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:47.453130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-d80fdca0-6e78-4ac6-acc1-ad0739c1953a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lazy-loading 'flavor' on Instance uuid 906e76c3-27a3-4703-9938-4068a6ab1436 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:13:47.453375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:47.453954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] [instance: 0854acd2-6921-4cab-ad5b-bddf5ba312c6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:47.471393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:47.476326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:47.479354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:47.482828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:47.560707 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] HTTP exception thrown: Instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 could not be found. Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Request method failure captured: Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 HTTP/1.1 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ErTuQ2JjMfK_qXeX0DiBBfnXUTyRr2fjJlTsjjQW6l0P2TJInDjemnuspkgy3r0dsvhfL9ybW18gfqKhNqQy_GRKsHN8qJ5ZQgQO6CC7uI6mGPbgiHzSSJ4sUOLI7MXjHmpB_8SBWklYpvpujxgHM85d0pmf47GCOs66gIQ2FYUvC0 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 7d49a0ff8af1479580076bccd62001ac Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesActionsTest-2145810977 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d49a0ff8af1479580076bccd62001ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d49a0ff8af1479580076bccd62001ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d49a0ff8af1479580076bccd62001ac", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d49a0ff8af1479580076bccd62001ac"}]}] Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesActionsTest-2145810977 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 7d49a0ff8af1479580076bccd62001ac Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesActionsTest-2145810977 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesActionsTest-2145810977-project Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 6aa0c11b139d459799360eec098cabb4 Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesActionsTest-2145810977-project Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 could not be found. Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '0854acd2-6921-4cab-ad5b-bddf5ba312c6'} Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 could not be found. Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 could not be found. Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:47.571509 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:47.576328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:47.576328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:47.576328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:47.576328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:47.576328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:47.576328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 could not be found. Jul 26 20:13:47.576328 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:47.576328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] Returning 404 to user: Instance 0854acd2-6921-4cab-ad5b-bddf5ba312c6 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:47.577531 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d7d1eed-0b52-42b5-84f1-01c97d276b94 tempest-VolumesActionsTest-2145810977 tempest-VolumesActionsTest-2145810977-project] 10.222.0.58 "GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6" status: 404 len: 111 microversion: 2.1 time: 0.125476 Jul 26 20:13:47.581428 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2687/5476] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:47 2022] GET /compute/v2.1/servers/0854acd2-6921-4cab-ad5b-bddf5ba312c6 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:47.708940 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d80fdca0-6e78-4ac6-acc1-ad0739c1953a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "POST /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436/action" status: 202 len: 0 microversion: 2.1 time: 0.375296 Jul 26 20:13:47.709513 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2790/5477] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:47 2022] POST /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:13:47.717890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-353c11fa-4774-4c04-971c-d07a84ef907a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:47.718511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-353c11fa-4774-4c04-971c-d07a84ef907a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:47.744552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353c11fa-4774-4c04-971c-d07a84ef907a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:47.752241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353c11fa-4774-4c04-971c-d07a84ef907a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:47.754678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353c11fa-4774-4c04-971c-d07a84ef907a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:47.759466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353c11fa-4774-4c04-971c-d07a84ef907a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:48.547764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-353c11fa-4774-4c04-971c-d07a84ef907a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:48.556344 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-353c11fa-4774-4c04-971c-d07a84ef907a tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1510 microversion: 2.1 time: 0.842323 Jul 26 20:13:48.556927 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2688/5478] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:47 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1510 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:49.580894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-05688279-9737-4caf-a067-284405f75b1c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:49.581510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-05688279-9737-4caf-a067-284405f75b1c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:49.584457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:49.597736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05688279-9737-4caf-a067-284405f75b1c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:49.598431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05688279-9737-4caf-a067-284405f75b1c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:49.599369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05688279-9737-4caf-a067-284405f75b1c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:49.599994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05688279-9737-4caf-a067-284405f75b1c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:50.010103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05688279-9737-4caf-a067-284405f75b1c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:50.028159 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-05688279-9737-4caf-a067-284405f75b1c tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1493 microversion: 2.1 time: 0.450910 Jul 26 20:13:50.050445 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2791/5479] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:49 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1493 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:50.067818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-96f0b8f4-bd36-4557-9b9f-2eefd1e1eeb8 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:50.068398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-96f0b8f4-bd36-4557-9b9f-2eefd1e1eeb8 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:50.081185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96f0b8f4-bd36-4557-9b9f-2eefd1e1eeb8 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:50.084081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96f0b8f4-bd36-4557-9b9f-2eefd1e1eeb8 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:50.085050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96f0b8f4-bd36-4557-9b9f-2eefd1e1eeb8 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:50.085497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-96f0b8f4-bd36-4557-9b9f-2eefd1e1eeb8 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:50.280912 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-96f0b8f4-bd36-4557-9b9f-2eefd1e1eeb8 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "POST /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436/action" status: 202 len: 0 microversion: 2.1 time: 0.218233 Jul 26 20:13:50.281713 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2689/5480] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:13:50 2022] POST /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:13:50.294683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-580b55e3-01b3-4b47-9df3-79e65be28280 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:50.295926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-580b55e3-01b3-4b47-9df3-79e65be28280 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:50.317373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-580b55e3-01b3-4b47-9df3-79e65be28280 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:50.333748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-580b55e3-01b3-4b47-9df3-79e65be28280 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:50.336869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-580b55e3-01b3-4b47-9df3-79e65be28280 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:50.338218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-580b55e3-01b3-4b47-9df3-79e65be28280 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:50.677826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-580b55e3-01b3-4b47-9df3-79e65be28280 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:50.689952 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-580b55e3-01b3-4b47-9df3-79e65be28280 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1499 microversion: 2.1 time: 0.400474 Jul 26 20:13:50.692314 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2792/5481] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:50 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1499 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:51.717638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af3ef73c-624f-4c0b-8417-2c09a6b5380e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:51.718408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af3ef73c-624f-4c0b-8417-2c09a6b5380e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:51.733247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af3ef73c-624f-4c0b-8417-2c09a6b5380e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:51.743888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af3ef73c-624f-4c0b-8417-2c09a6b5380e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:51.745174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af3ef73c-624f-4c0b-8417-2c09a6b5380e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:51.746506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af3ef73c-624f-4c0b-8417-2c09a6b5380e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:52.166309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-af3ef73c-624f-4c0b-8417-2c09a6b5380e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:52.206917 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af3ef73c-624f-4c0b-8417-2c09a6b5380e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1499 microversion: 2.1 time: 0.494309 Jul 26 20:13:52.207429 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2690/5482] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:51 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1499 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:53.232059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2175c3a2-0b08-459d-ab99-f254019106d1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:53.232751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2175c3a2-0b08-459d-ab99-f254019106d1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:53.258915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2175c3a2-0b08-459d-ab99-f254019106d1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:53.259501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2175c3a2-0b08-459d-ab99-f254019106d1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:53.263215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2175c3a2-0b08-459d-ab99-f254019106d1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:53.264404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2175c3a2-0b08-459d-ab99-f254019106d1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:53.338235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:53.648576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2175c3a2-0b08-459d-ab99-f254019106d1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:53.658850 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2175c3a2-0b08-459d-ab99-f254019106d1 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1502 microversion: 2.1 time: 0.431505 Jul 26 20:13:53.661447 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2793/5483] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:53 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1502 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:53.685501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97a6ef3f-7a34-46b8-9431-9abd48ecdbf4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:53.686629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97a6ef3f-7a34-46b8-9431-9abd48ecdbf4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:53.695390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97a6ef3f-7a34-46b8-9431-9abd48ecdbf4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:53.697776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97a6ef3f-7a34-46b8-9431-9abd48ecdbf4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:53.699580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97a6ef3f-7a34-46b8-9431-9abd48ecdbf4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:53.700052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97a6ef3f-7a34-46b8-9431-9abd48ecdbf4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:53.859097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97a6ef3f-7a34-46b8-9431-9abd48ecdbf4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:13:54.181693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:54.194468 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97a6ef3f-7a34-46b8-9431-9abd48ecdbf4 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "DELETE /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 204 len: 0 microversion: 2.1 time: 0.513217 Jul 26 20:13:54.207330 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2691/5484] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:13:53 2022] DELETE /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:13:54.212935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8fcbb122-5262-4ce1-8430-a832ec4fc12e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:54.213564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8fcbb122-5262-4ce1-8430-a832ec4fc12e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:54.227569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fcbb122-5262-4ce1-8430-a832ec4fc12e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:54.228056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fcbb122-5262-4ce1-8430-a832ec4fc12e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:54.228857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fcbb122-5262-4ce1-8430-a832ec4fc12e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:54.229497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8fcbb122-5262-4ce1-8430-a832ec4fc12e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:54.709953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8fcbb122-5262-4ce1-8430-a832ec4fc12e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:54.722269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8fcbb122-5262-4ce1-8430-a832ec4fc12e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1508 microversion: 2.1 time: 0.513411 Jul 26 20:13:54.723412 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2794/5485] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:54 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1508 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:55.729577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:55.731743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:55.746651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-71603bb9-c9a0-41ea-96ca-d7556ad34002 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:55.749087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-71603bb9-c9a0-41ea-96ca-d7556ad34002 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:55.769865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:55.775737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71603bb9-c9a0-41ea-96ca-d7556ad34002 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:55.776536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71603bb9-c9a0-41ea-96ca-d7556ad34002 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:55.778094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71603bb9-c9a0-41ea-96ca-d7556ad34002 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:55.779037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:55.780067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:55.781336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71603bb9-c9a0-41ea-96ca-d7556ad34002 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:55.783866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:55.855038 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 HTTP/1.1 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3'} Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:55.865351 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.869913 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.876680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:55.882148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ef3e6f6-f0d8-49af-b0e4-e5f007a13223 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 404 len: 111 microversion: 2.1 time: 0.159174 Jul 26 20:13:55.887687 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2692/5486] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:13:55 2022] DELETE /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:55.909327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:55.916474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:55.937326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:55.938228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:55.940333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:55.942455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:55.985483 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 HTTP/1.1 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3'} Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:13:55.989048 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.994156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:13:55.994156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:13:55.994156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:13:55.994156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:13:55.994156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:13:55.994156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. Jul 26 20:13:55.994156 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:13:55.995693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:13:56.013556 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e2be7900-ec83-4b95-b215-ab3421bde7f4 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3" status: 404 len: 111 microversion: 2.1 time: 0.121685 Jul 26 20:13:56.015363 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2693/5487] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:55 2022] GET /compute/v2.1/servers/61eb49e0-7bfb-4c51-ae10-6d93dcbeecf3 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:13:56.031525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-057d6689-2ecf-41af-bef3-5ee74ed6abc0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:56.032392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-057d6689-2ecf-41af-bef3-5ee74ed6abc0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:56.068761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-057d6689-2ecf-41af-bef3-5ee74ed6abc0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:56.071113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-057d6689-2ecf-41af-bef3-5ee74ed6abc0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:56.077395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-057d6689-2ecf-41af-bef3-5ee74ed6abc0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:56.078150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-057d6689-2ecf-41af-bef3-5ee74ed6abc0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:56.081799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:13:56.144995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-71603bb9-c9a0-41ea-96ca-d7556ad34002 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:56.156270 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-71603bb9-c9a0-41ea-96ca-d7556ad34002 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1508 microversion: 2.1 time: 0.414183 Jul 26 20:13:56.159112 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2795/5488] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:55 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:56.204163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-057d6689-2ecf-41af-bef3-5ee74ed6abc0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:13:56.462317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-057d6689-2ecf-41af-bef3-5ee74ed6abc0 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 204 len: 0 microversion: 2.1 time: 0.433544 Jul 26 20:13:56.472046 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2694/5489] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:13:56 2022] DELETE /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:13:56.480325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9aa3739-6aef-460f-bb9f-47ae382a4354 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:56.481078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9aa3739-6aef-460f-bb9f-47ae382a4354 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:56.493481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9aa3739-6aef-460f-bb9f-47ae382a4354 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:56.494174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9aa3739-6aef-460f-bb9f-47ae382a4354 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:56.498099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9aa3739-6aef-460f-bb9f-47ae382a4354 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:56.505961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9aa3739-6aef-460f-bb9f-47ae382a4354 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:57.180922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9aa3739-6aef-460f-bb9f-47ae382a4354 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:57.184135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-51c6ab06-b145-4fa6-9409-d8489b164739 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:57.184913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-51c6ab06-b145-4fa6-9409-d8489b164739 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:57.201960 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9aa3739-6aef-460f-bb9f-47ae382a4354 tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 0.716002 Jul 26 20:13:57.205335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51c6ab06-b145-4fa6-9409-d8489b164739 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:57.205779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51c6ab06-b145-4fa6-9409-d8489b164739 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:57.206554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51c6ab06-b145-4fa6-9409-d8489b164739 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:57.206986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-51c6ab06-b145-4fa6-9409-d8489b164739 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:57.207933 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2796/5490] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:56 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:57.947041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1065290142", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "19fbc85c-c341-4f8a-8eba-24a40b29b97e"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:58.049170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] validate_networks() for [('19fbc85c-c341-4f8a-8eba-24a40b29b97e', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:13:58.133380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-51c6ab06-b145-4fa6-9409-d8489b164739 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:58.142722 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-51c6ab06-b145-4fa6-9409-d8489b164739 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1508 microversion: 2.1 time: 0.968840 Jul 26 20:13:58.143254 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2695/5491] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:57 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1508 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:13:58.226779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d253ad9-89fb-4741-bb4e-1a9c1d8d147c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:58.228540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1d253ad9-89fb-4741-bb4e-1a9c1d8d147c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:58.242982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d253ad9-89fb-4741-bb4e-1a9c1d8d147c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:58.245449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d253ad9-89fb-4741-bb4e-1a9c1d8d147c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:58.255664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d253ad9-89fb-4741-bb4e-1a9c1d8d147c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:58.257603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d253ad9-89fb-4741-bb4e-1a9c1d8d147c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:59.070953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1d253ad9-89fb-4741-bb4e-1a9c1d8d147c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:59.088238 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1d253ad9-89fb-4741-bb4e-1a9c1d8d147c tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1512 microversion: 2.1 time: 0.865644 Jul 26 20:13:59.088842 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2696/5492] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:58 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1512 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:59.152793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a2f3e732-68af-4ad1-a25b-7bd0ddf5e7c4 req-eca6140c-0e82-4eec-9cdc-a634214db5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906e76c3-27a3-4703-9938-4068a6ab1436", "name": "network-vif-deleted", "tag": "782c6898-4df2-4812-b184-95c9c51920db"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:13:59.191908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a2f3e732-68af-4ad1-a25b-7bd0ddf5e7c4 req-eca6140c-0e82-4eec-9cdc-a634214db5c8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:59.192357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a2f3e732-68af-4ad1-a25b-7bd0ddf5e7c4 req-eca6140c-0e82-4eec-9cdc-a634214db5c8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:59.218170 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a2f3e732-68af-4ad1-a25b-7bd0ddf5e7c4 req-eca6140c-0e82-4eec-9cdc-a634214db5c8 service nova] Creating event network-vif-deleted:782c6898-4df2-4812-b184-95c9c51920db for instance 906e76c3-27a3-4703-9938-4068a6ab1436 on n-h2-708768-8 Jul 26 20:13:59.229054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a2f3e732-68af-4ad1-a25b-7bd0ddf5e7c4 req-eca6140c-0e82-4eec-9cdc-a634214db5c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127917 Jul 26 20:13:59.233057 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2697/5493] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:13:59.238471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:59.252297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:59.260643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:59.261662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:59.272871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:59.273594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:59.333598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:59.334319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:59.334915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lazy-loading 'fault' on Instance uuid 906e76c3-27a3-4703-9938-4068a6ab1436 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:13:59.435947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:13:59.444322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:13:59.446595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:13:59.447235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:13:59.448146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:13:59.462905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:59.463689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:59.465137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:13:59.473866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:13:59.477552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4a000a62184f3bbde21b85bdb0a3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e44aa18a2d491eac66171ec892b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:59.491401 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ff1d83a-d2a7-41c8-8327-b60e4b0c4a20 tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 200 len: 1305 microversion: 2.1 time: 0.255152 Jul 26 20:13:59.496794 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2698/5494] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:59 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 1305 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:13:59.536244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Getting quotas for project 641c01c7142e4eaeb6a9cd7ea37d26dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:13:59.582066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Getting quotas for user fc75b56f29924188b32973a9a2ba1f9f and project 641c01c7142e4eaeb6a9cd7ea37d26dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:13:59.607013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:13:59.626270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:13:59.771264 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f6fae9c-9379-4aa1-8aad-6af0947d5abd tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.828621 Jul 26 20:13:59.773375 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2797/5495] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:13:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:13:59.785569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-16293b2b-f2f6-49b6-8445-3cf860767019 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:13:59.786189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-16293b2b-f2f6-49b6-8445-3cf860767019 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:13:59.949669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-16293b2b-f2f6-49b6-8445-3cf860767019 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:13:59.959638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-16293b2b-f2f6-49b6-8445-3cf860767019 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1219 microversion: 2.1 time: 0.177032 Jul 26 20:13:59.961010 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2699/5496] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:13:59 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1219 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:00.115426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d527a1e-7418-4f65-8a71-f537e9c94e2d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:00.116221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d527a1e-7418-4f65-8a71-f537e9c94e2d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:00.131780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d527a1e-7418-4f65-8a71-f537e9c94e2d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:00.134511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d527a1e-7418-4f65-8a71-f537e9c94e2d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:00.136279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d527a1e-7418-4f65-8a71-f537e9c94e2d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:00.141725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d527a1e-7418-4f65-8a71-f537e9c94e2d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:00.246668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d527a1e-7418-4f65-8a71-f537e9c94e2d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5db253037f7490cb99f9108c72010fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14657ed655d94ec08a847a22ec8d96d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:00.257084 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d527a1e-7418-4f65-8a71-f537e9c94e2d tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 200 len: 1470 microversion: 2.1 time: 0.150002 Jul 26 20:14:00.260770 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2798/5497] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:00 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:00.521458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:00.523295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] [instance: 906e76c3-27a3-4703-9938-4068a6ab1436] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:00.544420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:00.545008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:00.551058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:00.552123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:00.612054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] HTTP exception thrown: Instance 906e76c3-27a3-4703-9938-4068a6ab1436 could not be found. Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Request method failure captured: Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 HTTP/1.1 Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4ErW6u1n0gNmt430UmPaiAn5Nl2Vu9JK32CMLFwgII3PmsWPDra63dprM69FuiI10skvMhae0s9y9CBKS01v-1S_Dth3lg8txgCJWlMkSaj1gVRCozslopHYjxpCZ-_GjwktG0oZfgK0Z4pa_TncDWK4vJwRgGmB1_7FrhVN3EtbOVE Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: b7e44aa18a2d491eac66171ec892b99c Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestServerAdvancedOps-1879789005 Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b7e44aa18a2d491eac66171ec892b99c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b7e44aa18a2d491eac66171ec892b99c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b7e44aa18a2d491eac66171ec892b99c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b7e44aa18a2d491eac66171ec892b99c"}]}] Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestServerAdvancedOps-1879789005 Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: b7e44aa18a2d491eac66171ec892b99c Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestServerAdvancedOps-1879789005 Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestServerAdvancedOps-1879789005-project Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 2b4a000a62184f3bbde21b85bdb0a3fa Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestServerAdvancedOps-1879789005-project Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 906e76c3-27a3-4703-9938-4068a6ab1436 could not be found. Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '906e76c3-27a3-4703-9938-4068a6ab1436'} Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906e76c3-27a3-4703-9938-4068a6ab1436 could not be found. Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906e76c3-27a3-4703-9938-4068a6ab1436 could not be found. Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:00.623749 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:00.628515 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:00.628515 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:00.628515 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:00.628515 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:00.628515 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:00.628515 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906e76c3-27a3-4703-9938-4068a6ab1436 could not be found. Jul 26 20:14:00.628515 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:00.631739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] Returning 404 to user: Instance 906e76c3-27a3-4703-9938-4068a6ab1436 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:00.633284 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a16d1efc-616e-463c-94f0-41ed4485ce0e tempest-TestServerAdvancedOps-1879789005 tempest-TestServerAdvancedOps-1879789005-project] 10.222.0.58 "GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436" status: 404 len: 111 microversion: 2.1 time: 0.116329 Jul 26 20:14:00.634844 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2700/5498] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:00 2022] GET /compute/v2.1/servers/906e76c3-27a3-4703-9938-4068a6ab1436 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:14:00.982935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6cf78889-b47a-47a6-86f1-d74341f28545 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:00.984338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6cf78889-b47a-47a6-86f1-d74341f28545 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:00.997225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cf78889-b47a-47a6-86f1-d74341f28545 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:00.997941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cf78889-b47a-47a6-86f1-d74341f28545 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:01.002081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cf78889-b47a-47a6-86f1-d74341f28545 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:01.002689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cf78889-b47a-47a6-86f1-d74341f28545 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:01.302937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:01.303571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] [instance: 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:01.318840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:01.319539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:01.320732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:01.321374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:01.357983 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] HTTP exception thrown: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f could not be found. Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Request method failure captured: Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f HTTP/1.1 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Eohf4BLleGfwxlx6VEV4f_6i19jXGqORHyeLwUcGJjmnR8AbzfIb5ckGAEmMjpBbZAeyM7nPOLGxiTeLJYZxevjo2nJwkvRDvWwb7_yQfs7eBRtRe27BZfY_jn9CHYaRPh83Gtg8ZEPumitA4-rVmffJ73r92floQcMNKf15yYlfLk Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14657ed655d94ec08a847a22ec8d96d1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14657ed655d94ec08a847a22ec8d96d1"}]}] Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 14657ed655d94ec08a847a22ec8d96d1 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1131558360 Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c5db253037f7490cb99f9108c72010fc Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-1131558360-project Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f could not be found. Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f'} Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f could not be found. Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f could not be found. Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:01.359995 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:01.364134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:01.364134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:01.364134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:01.364134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:01.364134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:01.364134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f could not be found. Jul 26 20:14:01.364134 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:01.368052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] Returning 404 to user: Instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:01.369176 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-588ea08d-0c59-4467-ba08-688a012bf44a tempest-ServersNegativeTestJSON-1131558360 tempest-ServersNegativeTestJSON-1131558360-project] 10.222.0.58 "GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f" status: 404 len: 111 microversion: 2.1 time: 0.082798 Jul 26 20:14:01.369684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6cf78889-b47a-47a6-86f1-d74341f28545 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:01.370249 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2701/5499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:01 2022] GET /compute/v2.1/servers/5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:14:01.375625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-58f7ae11-3e32-48d0-af28-7ad135255bee req-4f5bbbd6-b56b-4e56-9984-7f02fd1e608a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f", "name": "network-vif-deleted", "tag": "2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:01.387758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-58f7ae11-3e32-48d0-af28-7ad135255bee req-4f5bbbd6-b56b-4e56-9984-7f02fd1e608a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:01.388590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-58f7ae11-3e32-48d0-af28-7ad135255bee req-4f5bbbd6-b56b-4e56-9984-7f02fd1e608a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:01.388967 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6cf78889-b47a-47a6-86f1-d74341f28545 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1215 microversion: 2.1 time: 0.406368 Jul 26 20:14:01.389643 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2799/5500] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:00 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1215 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:01.402821 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-58f7ae11-3e32-48d0-af28-7ad135255bee req-4f5bbbd6-b56b-4e56-9984-7f02fd1e608a service nova] Creating event network-vif-deleted:2a2f6f69-a5ae-4787-8f0e-64a3c1682f4c for instance 5cd4ad7d-6859-4ba2-8c27-3d74e6c9643f on n-h1-708768-8 Jul 26 20:14:01.408579 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-58f7ae11-3e32-48d0-af28-7ad135255bee req-4f5bbbd6-b56b-4e56-9984-7f02fd1e608a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036309 Jul 26 20:14:01.409364 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2702/5501] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:02.411212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-81ea8b4c-97c4-4b03-9334-45b79eefc375 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:02.412462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-81ea8b4c-97c4-4b03-9334-45b79eefc375 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:02.429041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81ea8b4c-97c4-4b03-9334-45b79eefc375 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:02.430673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81ea8b4c-97c4-4b03-9334-45b79eefc375 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:02.435129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81ea8b4c-97c4-4b03-9334-45b79eefc375 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:02.435592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-81ea8b4c-97c4-4b03-9334-45b79eefc375 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:02.626940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-81ea8b4c-97c4-4b03-9334-45b79eefc375 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:02.661562 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-81ea8b4c-97c4-4b03-9334-45b79eefc375 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1277 microversion: 2.1 time: 0.254889 Jul 26 20:14:02.662155 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2800/5502] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:02 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1277 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:03.685591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6cec4363-5a49-4cdb-afd4-0644df3ccb48 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:03.686284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6cec4363-5a49-4cdb-afd4-0644df3ccb48 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:03.699336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cec4363-5a49-4cdb-afd4-0644df3ccb48 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:03.700860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cec4363-5a49-4cdb-afd4-0644df3ccb48 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:03.703044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cec4363-5a49-4cdb-afd4-0644df3ccb48 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:03.704093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cec4363-5a49-4cdb-afd4-0644df3ccb48 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:03.868084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6cec4363-5a49-4cdb-afd4-0644df3ccb48 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:03.892789 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6cec4363-5a49-4cdb-afd4-0644df3ccb48 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1277 microversion: 2.1 time: 0.212370 Jul 26 20:14:03.894335 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2703/5503] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:03 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:04.917853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7faa46df-6f0c-46fb-a0f5-da890428b9b9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:04.918966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7faa46df-6f0c-46fb-a0f5-da890428b9b9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:04.942551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7faa46df-6f0c-46fb-a0f5-da890428b9b9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:04.943024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7faa46df-6f0c-46fb-a0f5-da890428b9b9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:04.943853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7faa46df-6f0c-46fb-a0f5-da890428b9b9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:04.950564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7faa46df-6f0c-46fb-a0f5-da890428b9b9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:06.151498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7faa46df-6f0c-46fb-a0f5-da890428b9b9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:06.177319 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7faa46df-6f0c-46fb-a0f5-da890428b9b9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 1.261731 Jul 26 20:14:06.185293 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2801/5504] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:04 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:07.206601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8f563327-63c5-438f-b777-b0c2f948cfce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:07.207437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8f563327-63c5-438f-b777-b0c2f948cfce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:07.219643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f563327-63c5-438f-b777-b0c2f948cfce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:07.238656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f563327-63c5-438f-b777-b0c2f948cfce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:07.241065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f563327-63c5-438f-b777-b0c2f948cfce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:07.241700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f563327-63c5-438f-b777-b0c2f948cfce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:09.703551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8f563327-63c5-438f-b777-b0c2f948cfce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:09.741572 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8f563327-63c5-438f-b777-b0c2f948cfce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 2.535435 Jul 26 20:14:09.746426 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2704/5505] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:07 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:10.763724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:10.765337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:10.772288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb89a7de-da07-43e4-938c-c8adcc266731 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:10.774421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eb89a7de-da07-43e4-938c-c8adcc266731 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:10.796155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb89a7de-da07-43e4-938c-c8adcc266731 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:10.797680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb89a7de-da07-43e4-938c-c8adcc266731 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:10.804885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb89a7de-da07-43e4-938c-c8adcc266731 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:10.815716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb89a7de-da07-43e4-938c-c8adcc266731 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:11.221761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:11.449125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eb89a7de-da07-43e4-938c-c8adcc266731 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:11.464769 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb89a7de-da07-43e4-938c-c8adcc266731 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 0.695972 Jul 26 20:14:11.466446 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2802/5506] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:10 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:11.634488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f35d97d0-b9ca-4bcb-8837-7656bd213c53 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Action: 'create', calling method: .version_select at 0x7f875d85f940>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1315872612", "policies": ["affinity"]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:11.689142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f35d97d0-b9ca-4bcb-8837-7656bd213c53 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:11.705541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f35d97d0-b9ca-4bcb-8837-7656bd213c53 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:11.855769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-56b850a9-4bc1-4681-933b-494952469c2c req-7ce6c449-c6ca-4280-8e5b-0f915940d4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558b7f2e-2747-41e5-abb9-f2593366c5b0", "tag": "e78d8958-a2f8-4ded-b330-20bf6ca8d76d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:11.865035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f35d97d0-b9ca-4bcb-8837-7656bd213c53 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:11.876299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-56b850a9-4bc1-4681-933b-494952469c2c req-7ce6c449-c6ca-4280-8e5b-0f915940d4f1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:11.876756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-56b850a9-4bc1-4681-933b-494952469c2c req-7ce6c449-c6ca-4280-8e5b-0f915940d4f1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:11.880635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-f35d97d0-b9ca-4bcb-8837-7656bd213c53 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:11.932813 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-56b850a9-4bc1-4681-933b-494952469c2c req-7ce6c449-c6ca-4280-8e5b-0f915940d4f1 service nova] Creating event network-changed:e78d8958-a2f8-4ded-b330-20bf6ca8d76d for instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 on n-h1-708768-8 Jul 26 20:14:11.951960 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-56b850a9-4bc1-4681-933b-494952469c2c req-7ce6c449-c6ca-4280-8e5b-0f915940d4f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100699 Jul 26 20:14:11.953047 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f35d97d0-b9ca-4bcb-8837-7656bd213c53 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.736910 Jul 26 20:14:11.954015 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2803/5507] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:11.956533 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2705/5508] 10.222.0.58 () {60 vars in 1174 bytes} [Tue Jul 26 20:14:11 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:14:11.972194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26e4857c-49dd-4bc7-8ac9-8d9fc966394a tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Action: 'create', calling method: .version_select at 0x7f8756034b80>, body: {"server_group": {"name": "tempest-server-group-1297942263", "policies": ["affinity"]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:12.041416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-26e4857c-49dd-4bc7-8ac9-8d9fc966394a tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:12.056577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-26e4857c-49dd-4bc7-8ac9-8d9fc966394a tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:12.214731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-26e4857c-49dd-4bc7-8ac9-8d9fc966394a tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:12.229970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-26e4857c-49dd-4bc7-8ac9-8d9fc966394a tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:12.263400 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-26e4857c-49dd-4bc7-8ac9-8d9fc966394a tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.296484 Jul 26 20:14:12.264658 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2804/5509] 10.222.0.58 () {60 vars in 1173 bytes} [Tue Jul 26 20:14:11 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:12.279394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7df8c7d5-3456-4c8b-afd9-8194c74d2532 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Action: 'create', calling method: .version_select at 0x7f875d85fb80>, body: {"server_group": {"name": "tempest-server-group-1297942263", "policies": ["affinity"]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:12.321883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7df8c7d5-3456-4c8b-afd9-8194c74d2532 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:12.345855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7df8c7d5-3456-4c8b-afd9-8194c74d2532 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:12.441058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7df8c7d5-3456-4c8b-afd9-8194c74d2532 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:12.466400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7df8c7d5-3456-4c8b-afd9-8194c74d2532 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:12.487185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7b4413d-48fa-4f7e-b0de-f35bd577c958 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:12.488279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7b4413d-48fa-4f7e-b0de-f35bd577c958 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:12.499534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b4413d-48fa-4f7e-b0de-f35bd577c958 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:12.507355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b4413d-48fa-4f7e-b0de-f35bd577c958 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:12.508252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b4413d-48fa-4f7e-b0de-f35bd577c958 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:12.508699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b4413d-48fa-4f7e-b0de-f35bd577c958 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:12.516024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7df8c7d5-3456-4c8b-afd9-8194c74d2532 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.241376 Jul 26 20:14:12.526068 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2706/5510] 10.222.0.58 () {60 vars in 1173 bytes} [Tue Jul 26 20:14:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:12.545168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0ca8083-4673-4501-bdca-41810a030a63 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:12.602277 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0ca8083-4673-4501-bdca-41810a030a63 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/724ffab2-8eec-4fc0-8730-fc48a22dba00" status: 204 len: 0 microversion: 2.1 time: 0.072746 Jul 26 20:14:12.603208 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2707/5511] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:12 2022] DELETE /compute/v2.1/os-server-groups/724ffab2-8eec-4fc0-8730-fc48a22dba00 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:14:12.613923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5121bf1a-db58-40e1-9f11-4c500a53bfa2 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:12.632991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:12.639425 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5121bf1a-db58-40e1-9f11-4c500a53bfa2 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.030004 Jul 26 20:14:12.648126 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2708/5512] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:14:12 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:12.653732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ec9dc9ee-39f7-44cf-ae3d-8f42f734e225 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:12.699807 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ec9dc9ee-39f7-44cf-ae3d-8f42f734e225 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/4a0e92c5-c2cb-428d-81ba-1ea68566029b" status: 204 len: 0 microversion: 2.1 time: 0.050298 Jul 26 20:14:12.700963 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2709/5513] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:12 2022] DELETE /compute/v2.1/os-server-groups/4a0e92c5-c2cb-428d-81ba-1ea68566029b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:14:12.709073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df683af3-7bb0-4cc3-a364-54a0becf23ef tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:12.727932 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df683af3-7bb0-4cc3-a364-54a0becf23ef tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022572 Jul 26 20:14:12.730635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2710/5514] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:14:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:14:12.750649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac525142-969b-40e3-8a08-13afa95bb2a1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Action: 'create', calling method: .version_select at 0x7f875d85fca0>, body: {"server_group": {"name": "tempest-server-group-2044858532", "policies": ["affinity"]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:12.817501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ac525142-969b-40e3-8a08-13afa95bb2a1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:12.841364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ac525142-969b-40e3-8a08-13afa95bb2a1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:12.942066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ac525142-969b-40e3-8a08-13afa95bb2a1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:12.962735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ac525142-969b-40e3-8a08-13afa95bb2a1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:13.011704 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ac525142-969b-40e3-8a08-13afa95bb2a1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.271991 Jul 26 20:14:13.015489 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2711/5515] 10.222.0.58 () {60 vars in 1173 bytes} [Tue Jul 26 20:14:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:14:13.031639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6d611774-f716-4e7a-8829-0106dacb47b9 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:13.087681 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6d611774-f716-4e7a-8829-0106dacb47b9 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/49ab28c1-c619-44fa-a86b-72b5edaec175" status: 204 len: 0 microversion: 2.1 time: 0.066844 Jul 26 20:14:13.093276 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2712/5516] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:13 2022] DELETE /compute/v2.1/os-server-groups/49ab28c1-c619-44fa-a86b-72b5edaec175 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:14:13.104709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7770b48-c716-48a4-ac9e-a023ea5675b4 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:13.124451 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c7770b48-c716-48a4-ac9e-a023ea5675b4 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.029416 Jul 26 20:14:13.125268 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2713/5517] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:14:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:13.138753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-51cad2ed-3f3e-4756-8d5f-fe0355eb9df8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Action: 'create', calling method: .version_select at 0x7f875d85fdc0>, body: {"server_group": {"name": "tempest-server-group-1302116652", "policies": ["anti-affinity"]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:13.157806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-51cad2ed-3f3e-4756-8d5f-fe0355eb9df8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:13.166376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-51cad2ed-3f3e-4756-8d5f-fe0355eb9df8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:13.305919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-51cad2ed-3f3e-4756-8d5f-fe0355eb9df8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:13.325309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-51cad2ed-3f3e-4756-8d5f-fe0355eb9df8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_groups'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:13.369235 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-51cad2ed-3f3e-4756-8d5f-fe0355eb9df8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.235155 Jul 26 20:14:13.384633 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2714/5518] 10.222.0.58 () {60 vars in 1173 bytes} [Tue Jul 26 20:14:13 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:13.400116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bff5f1fd-7310-4178-a565-7ef203b8b7ee tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:13.481656 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bff5f1fd-7310-4178-a565-7ef203b8b7ee tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/a2f658f0-9ea5-4f9f-9f6d-69541df0f99e" status: 204 len: 0 microversion: 2.1 time: 0.095917 Jul 26 20:14:13.482423 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2715/5519] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:13 2022] DELETE /compute/v2.1/os-server-groups/a2f658f0-9ea5-4f9f-9f6d-69541df0f99e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:14:13.492675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2707c640-3a67-414f-8651-fa7f39f4df52 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:13.518128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7b4413d-48fa-4f7e-b0de-f35bd577c958 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:13.534344 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7b4413d-48fa-4f7e-b0de-f35bd577c958 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 1.050689 Jul 26 20:14:13.535752 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2805/5520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:12 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:13.551086 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2707c640-3a67-414f-8651-fa7f39f4df52 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.062141 Jul 26 20:14:13.559363 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2716/5521] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:14:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:13.658812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-383941963", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "71c35f7b-30d2-40e7-afbb-0ce4aca4c7c9"}]}, "os:scheduler_hints": {"group": "636d0518-dca0-4147-84bf-d0042322cd6a"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:13.739059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] validate_networks() for [('71c35f7b-30d2-40e7-afbb-0ce4aca4c7c9', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:14:14.562698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ad17cf6-8213-4372-b9a6-4083849664d8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:14.564427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ad17cf6-8213-4372-b9a6-4083849664d8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:14.577837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ad17cf6-8213-4372-b9a6-4083849664d8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:14.578488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ad17cf6-8213-4372-b9a6-4083849664d8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:14.579574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ad17cf6-8213-4372-b9a6-4083849664d8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:14.580394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ad17cf6-8213-4372-b9a6-4083849664d8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:15.107452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ad17cf6-8213-4372-b9a6-4083849664d8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:15.119043 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ad17cf6-8213-4372-b9a6-4083849664d8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 0.561743 Jul 26 20:14:15.122020 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2717/5522] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:14 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:14:16.147132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dba0d89f-9875-403c-8367-13ded77f9388 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:16.148324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dba0d89f-9875-403c-8367-13ded77f9388 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:16.178267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dba0d89f-9875-403c-8367-13ded77f9388 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:16.179319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dba0d89f-9875-403c-8367-13ded77f9388 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:16.182453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dba0d89f-9875-403c-8367-13ded77f9388 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:16.183882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dba0d89f-9875-403c-8367-13ded77f9388 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:16.654905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:14:16.656000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:14:16.656612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:14:16.658064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:14:16.658626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:14:16.699870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:16.703846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:16.706520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:16.709967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:16.763085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:16.782036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:16.820607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:14:16.825002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dba0d89f-9875-403c-8367-13ded77f9388 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:16.827651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:14:16.844321 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dba0d89f-9875-403c-8367-13ded77f9388 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 0.703078 Jul 26 20:14:16.845940 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2718/5523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:16 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:16.948723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:16.975644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:17.033047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:17.184956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:17.229548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Getting quotas for user ef4c830232a04dfdac6d37d6c05c2bf0 and project 680c80206c884336a1d8cd452b8058e6. Resources: {'server_group_members'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:17.329108 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f4319d9-d84e-4e97-8d85-272dd567faaf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.674637 Jul 26 20:14:17.331994 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2806/5524] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:14:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:14:17.341207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5703b6ee-5283-4e1c-a0e4-2bbffd9174c2 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:17.341828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5703b6ee-5283-4e1c-a0e4-2bbffd9174c2 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:17.521719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5703b6ee-5283-4e1c-a0e4-2bbffd9174c2 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:17.531533 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5703b6ee-5283-4e1c-a0e4-2bbffd9174c2 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1212 microversion: 2.1 time: 0.194699 Jul 26 20:14:17.545351 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2719/5525] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:17 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1212 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:17.872188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce2f59ff-e396-4d92-9b52-6352e8a3085b tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:17.873453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ce2f59ff-e396-4d92-9b52-6352e8a3085b tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:17.891110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce2f59ff-e396-4d92-9b52-6352e8a3085b tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:17.891852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce2f59ff-e396-4d92-9b52-6352e8a3085b tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:17.894873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce2f59ff-e396-4d92-9b52-6352e8a3085b tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:17.895585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce2f59ff-e396-4d92-9b52-6352e8a3085b tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:18.553032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e1e5230-4715-4725-b656-04651997d130 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:18.554241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e1e5230-4715-4725-b656-04651997d130 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:18.744083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ce2f59ff-e396-4d92-9b52-6352e8a3085b tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:18.776244 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce2f59ff-e396-4d92-9b52-6352e8a3085b tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 0.891967 Jul 26 20:14:18.796687 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2807/5526] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:17 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:18.804700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4e1e5230-4715-4725-b656-04651997d130 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:18.826242 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e1e5230-4715-4725-b656-04651997d130 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1212 microversion: 2.1 time: 0.277553 Jul 26 20:14:18.828417 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2720/5527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:18 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1212 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:14:19.806991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8db3a31a-3b2c-409c-a22c-526792eb3aca tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:19.807772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8db3a31a-3b2c-409c-a22c-526792eb3aca tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:19.818875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8db3a31a-3b2c-409c-a22c-526792eb3aca tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:19.829154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8db3a31a-3b2c-409c-a22c-526792eb3aca tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:19.831393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8db3a31a-3b2c-409c-a22c-526792eb3aca tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:19.840047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8db3a31a-3b2c-409c-a22c-526792eb3aca tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:19.853614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ff7c641e-f553-4ca1-9593-884b30592900 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:19.854329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ff7c641e-f553-4ca1-9593-884b30592900 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:19.877751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff7c641e-f553-4ca1-9593-884b30592900 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:19.880406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff7c641e-f553-4ca1-9593-884b30592900 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:19.882016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff7c641e-f553-4ca1-9593-884b30592900 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:19.894799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff7c641e-f553-4ca1-9593-884b30592900 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:20.829120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ff7c641e-f553-4ca1-9593-884b30592900 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:20.840253 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ff7c641e-f553-4ca1-9593-884b30592900 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1282 microversion: 2.1 time: 0.992327 Jul 26 20:14:20.848969 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2721/5528] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:19 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1282 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:14:21.141643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8db3a31a-3b2c-409c-a22c-526792eb3aca tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:21.152654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8db3a31a-3b2c-409c-a22c-526792eb3aca tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 1.349186 Jul 26 20:14:21.177909 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2808/5529] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:19 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:21.630684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-69913399-4c11-4003-96a0-c3ca67bae401 tempest-ExtensionsTest-1157196533 tempest-ExtensionsTest-1157196533-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:21.632857 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-69913399-4c11-4003-96a0-c3ca67bae401 tempest-ExtensionsTest-1157196533 tempest-ExtensionsTest-1157196533-project] 10.222.0.58 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.223997 Jul 26 20:14:21.633567 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2722/5530] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Jul 26 20:14:21 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:21.646303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39c99852-bd15-4cac-869c-c59e32a0e190 tempest-ExtensionsTest-1157196533 tempest-ExtensionsTest-1157196533-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:21.649567 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39c99852-bd15-4cac-869c-c59e32a0e190 tempest-ExtensionsTest-1157196533 tempest-ExtensionsTest-1157196533-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008139 Jul 26 20:14:21.650684 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2809/5531] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Jul 26 20:14:21 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:14:21.869356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-39067bae-8edf-459b-a41a-83a3f3aa0907 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:21.870013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-39067bae-8edf-459b-a41a-83a3f3aa0907 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:21.881317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:21.890332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39067bae-8edf-459b-a41a-83a3f3aa0907 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:21.890801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39067bae-8edf-459b-a41a-83a3f3aa0907 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:21.891665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39067bae-8edf-459b-a41a-83a3f3aa0907 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:21.897481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39067bae-8edf-459b-a41a-83a3f3aa0907 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:22.176010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08c77d84-7fa8-460e-80ab-228668ae60f2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:22.180836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-08c77d84-7fa8-460e-80ab-228668ae60f2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:22.200769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08c77d84-7fa8-460e-80ab-228668ae60f2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:22.202898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08c77d84-7fa8-460e-80ab-228668ae60f2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:22.204190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08c77d84-7fa8-460e-80ab-228668ae60f2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:22.207505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08c77d84-7fa8-460e-80ab-228668ae60f2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:22.262359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-39067bae-8edf-459b-a41a-83a3f3aa0907 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:22.275595 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-39067bae-8edf-459b-a41a-83a3f3aa0907 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1270 microversion: 2.1 time: 0.410978 Jul 26 20:14:22.278974 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2723/5532] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:21 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1270 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:22.865658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5b6a45f0-e4b6-440d-9340-c7f9b5ba6d15 req-1b96d159-0843-4404-b320-b5a879d3629b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558b7f2e-2747-41e5-abb9-f2593366c5b0", "name": "network-vif-plugged", "status": "completed", "tag": "e78d8958-a2f8-4ded-b330-20bf6ca8d76d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:22.904890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5b6a45f0-e4b6-440d-9340-c7f9b5ba6d15 req-1b96d159-0843-4404-b320-b5a879d3629b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:22.905637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5b6a45f0-e4b6-440d-9340-c7f9b5ba6d15 req-1b96d159-0843-4404-b320-b5a879d3629b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:22.939375 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5b6a45f0-e4b6-440d-9340-c7f9b5ba6d15 req-1b96d159-0843-4404-b320-b5a879d3629b service nova] Creating event network-vif-plugged:e78d8958-a2f8-4ded-b330-20bf6ca8d76d for instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 on n-h1-708768-8 Jul 26 20:14:22.956700 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5b6a45f0-e4b6-440d-9340-c7f9b5ba6d15 req-1b96d159-0843-4404-b320-b5a879d3629b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.421065 Jul 26 20:14:22.958836 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2724/5533] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:23.208246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-08c77d84-7fa8-460e-80ab-228668ae60f2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:23.228658 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-08c77d84-7fa8-460e-80ab-228668ae60f2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 1.056946 Jul 26 20:14:23.231225 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2810/5534] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:22 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:23.303466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15a20e82-c421-4feb-988b-dc963a69f29c tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:23.304216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-15a20e82-c421-4feb-988b-dc963a69f29c tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:23.337074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15a20e82-c421-4feb-988b-dc963a69f29c tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:23.337552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15a20e82-c421-4feb-988b-dc963a69f29c tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:23.338359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15a20e82-c421-4feb-988b-dc963a69f29c tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:23.338803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15a20e82-c421-4feb-988b-dc963a69f29c tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:24.251897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a36de58-5b32-47f4-916b-929dac6f072a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:24.252554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a36de58-5b32-47f4-916b-929dac6f072a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:24.267924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a36de58-5b32-47f4-916b-929dac6f072a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:24.285510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a36de58-5b32-47f4-916b-929dac6f072a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:24.285510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a36de58-5b32-47f4-916b-929dac6f072a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:24.285510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a36de58-5b32-47f4-916b-929dac6f072a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:24.383647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=82 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:24.582226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-15a20e82-c421-4feb-988b-dc963a69f29c tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:24.592199 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15a20e82-c421-4feb-988b-dc963a69f29c tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 1.293426 Jul 26 20:14:24.614597 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2725/5535] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:23 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:25.555424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4a36de58-5b32-47f4-916b-929dac6f072a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:25.583276 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a36de58-5b32-47f4-916b-929dac6f072a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1319 microversion: 2.1 time: 1.335255 Jul 26 20:14:25.584944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2811/5536] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:24 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1319 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:25.619552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-16a93929-15a5-448e-8dab-fc0f2d4f6440 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:25.620396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-16a93929-15a5-448e-8dab-fc0f2d4f6440 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:25.662541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16a93929-15a5-448e-8dab-fc0f2d4f6440 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:25.664953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16a93929-15a5-448e-8dab-fc0f2d4f6440 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:25.667059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16a93929-15a5-448e-8dab-fc0f2d4f6440 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:25.669948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16a93929-15a5-448e-8dab-fc0f2d4f6440 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:26.592665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-16a93929-15a5-448e-8dab-fc0f2d4f6440 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:26.600266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:26.607126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b56e76e5-d164-4ac9-8bf7-3e15b8685c36 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:26.607849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b56e76e5-d164-4ac9-8bf7-3e15b8685c36 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:26.617181 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-16a93929-15a5-448e-8dab-fc0f2d4f6440 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 1.003227 Jul 26 20:14:26.621374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b56e76e5-d164-4ac9-8bf7-3e15b8685c36 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:26.627073 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2726/5537] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:25 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:26.651123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b56e76e5-d164-4ac9-8bf7-3e15b8685c36 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:26.652450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b56e76e5-d164-4ac9-8bf7-3e15b8685c36 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:26.652961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b56e76e5-d164-4ac9-8bf7-3e15b8685c36 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:26.737202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:26.984891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b56e76e5-d164-4ac9-8bf7-3e15b8685c36 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:26.996193 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b56e76e5-d164-4ac9-8bf7-3e15b8685c36 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1506 microversion: 2.1 time: 0.392405 Jul 26 20:14:26.997577 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2812/5538] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:26 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:27.651118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-698b1a19-0f14-441c-9410-0fe663f8a32d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:27.652721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-698b1a19-0f14-441c-9410-0fe663f8a32d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:27.669192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-698b1a19-0f14-441c-9410-0fe663f8a32d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:27.669646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-698b1a19-0f14-441c-9410-0fe663f8a32d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:27.670432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-698b1a19-0f14-441c-9410-0fe663f8a32d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:27.670865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-698b1a19-0f14-441c-9410-0fe663f8a32d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:28.771672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-698b1a19-0f14-441c-9410-0fe663f8a32d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:28.784539 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-698b1a19-0f14-441c-9410-0fe663f8a32d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 1.137485 Jul 26 20:14:28.787318 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2727/5539] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:27 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:28.909297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-80113dc2-7fa8-40cd-8b6d-a8381d375499 req-45016d85-c244-47e9-9b4a-fc1fd21e599c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21973152-7720-4166-aac2-9dcc46344cd6", "tag": "a1ca1f2a-bea3-4c3d-a8fd-d58ed0f5f42b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:28.924359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=22 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:28.950485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-80113dc2-7fa8-40cd-8b6d-a8381d375499 req-45016d85-c244-47e9-9b4a-fc1fd21e599c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:28.950941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-80113dc2-7fa8-40cd-8b6d-a8381d375499 req-45016d85-c244-47e9-9b4a-fc1fd21e599c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:29.002019 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-80113dc2-7fa8-40cd-8b6d-a8381d375499 req-45016d85-c244-47e9-9b4a-fc1fd21e599c service nova] Creating event network-changed:a1ca1f2a-bea3-4c3d-a8fd-d58ed0f5f42b for instance 21973152-7720-4166-aac2-9dcc46344cd6 on n-h2-708768-8 Jul 26 20:14:29.009624 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-80113dc2-7fa8-40cd-8b6d-a8381d375499 req-45016d85-c244-47e9-9b4a-fc1fd21e599c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104602 Jul 26 20:14:29.012080 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2813/5540] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:29.806185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-65814e0c-8541-4c5a-9149-9c1a97166ccc tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:29.806810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-65814e0c-8541-4c5a-9149-9c1a97166ccc tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:29.813680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=36 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:29.817734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65814e0c-8541-4c5a-9149-9c1a97166ccc tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:29.824308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65814e0c-8541-4c5a-9149-9c1a97166ccc tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:29.825153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65814e0c-8541-4c5a-9149-9c1a97166ccc tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:29.825598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65814e0c-8541-4c5a-9149-9c1a97166ccc tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:31.128138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-65814e0c-8541-4c5a-9149-9c1a97166ccc tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:31.140877 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-65814e0c-8541-4c5a-9149-9c1a97166ccc tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 1.337216 Jul 26 20:14:31.144286 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2728/5541] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:29 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:32.166517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6822ae5-1b95-4b99-9a47-75c41d0c1be8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:32.169229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f6822ae5-1b95-4b99-9a47-75c41d0c1be8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:32.194124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6822ae5-1b95-4b99-9a47-75c41d0c1be8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:32.194884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6822ae5-1b95-4b99-9a47-75c41d0c1be8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:32.201250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6822ae5-1b95-4b99-9a47-75c41d0c1be8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:32.202532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6822ae5-1b95-4b99-9a47-75c41d0c1be8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:32.936653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-011640ae-ea66-425b-a32b-bfb2862ebc6d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Action: 'create', calling method: .version_select at 0x7f875d8705e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1140950452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRvMRd1L7zOfVHMOyP7++ezO3MBZHy5Q2a+uW08CDKEU0nrONYWzcZhT1ygaVm6IABL9/KWIgykZbPXA12+7Ac/vg29hQ5QfEzvZEHDkdBR7LaKHuSS5YJL2O9fKxNyOQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:33.008406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-011640ae-ea66-425b-a32b-bfb2862ebc6d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Getting quotas for project 75fe1e4cfc6d4292a74e5d0194e52134. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:33.025209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-011640ae-ea66-425b-a32b-bfb2862ebc6d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Getting quotas for user 3221f96786b94685a458669711c802b9 and project 75fe1e4cfc6d4292a74e5d0194e52134. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:33.096265 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-011640ae-ea66-425b-a32b-bfb2862ebc6d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.639130 Jul 26 20:14:33.102310 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2729/5542] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:14:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:33.224272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f6822ae5-1b95-4b99-9a47-75c41d0c1be8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:33.233464 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f6822ae5-1b95-4b99-9a47-75c41d0c1be8 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 1.074789 Jul 26 20:14:33.234659 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2814/5543] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:32 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:34.258188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f6c04441-4526-4ebe-bc35-2aefd6289f7e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:34.259324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f6c04441-4526-4ebe-bc35-2aefd6289f7e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:34.276886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f6c04441-4526-4ebe-bc35-2aefd6289f7e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:34.278739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f6c04441-4526-4ebe-bc35-2aefd6289f7e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:34.283497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f6c04441-4526-4ebe-bc35-2aefd6289f7e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:34.285103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f6c04441-4526-4ebe-bc35-2aefd6289f7e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:36.830660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f6c04441-4526-4ebe-bc35-2aefd6289f7e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:36.849982 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f6c04441-4526-4ebe-bc35-2aefd6289f7e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 2.592619 Jul 26 20:14:36.871239 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2730/5544] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:34 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 2620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:37.877820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a16ff8cf-6aff-44b1-a733-e09464c1d71d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:37.879854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a16ff8cf-6aff-44b1-a733-e09464c1d71d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:37.892487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a16ff8cf-6aff-44b1-a733-e09464c1d71d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:37.897112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a16ff8cf-6aff-44b1-a733-e09464c1d71d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:37.898546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a16ff8cf-6aff-44b1-a733-e09464c1d71d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:37.903232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a16ff8cf-6aff-44b1-a733-e09464c1d71d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:38.763257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a16ff8cf-6aff-44b1-a733-e09464c1d71d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:38.773920 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a16ff8cf-6aff-44b1-a733-e09464c1d71d tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 0.901745 Jul 26 20:14:38.777329 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2815/5545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:37 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:39.803253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c333b5d-38fc-4064-bd0e-bf39554a6171 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:39.804525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c333b5d-38fc-4064-bd0e-bf39554a6171 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:39.826660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c333b5d-38fc-4064-bd0e-bf39554a6171 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:39.829145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c333b5d-38fc-4064-bd0e-bf39554a6171 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:39.830592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c333b5d-38fc-4064-bd0e-bf39554a6171 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:39.839145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c333b5d-38fc-4064-bd0e-bf39554a6171 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:40.383825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c333b5d-38fc-4064-bd0e-bf39554a6171 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:40.395509 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c333b5d-38fc-4064-bd0e-bf39554a6171 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 0.597183 Jul 26 20:14:40.398674 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2731/5546] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:39 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:41.423305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc0443c7-65cf-4a8e-bf19-ec3955fb0335 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:41.424150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fc0443c7-65cf-4a8e-bf19-ec3955fb0335 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:41.438647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc0443c7-65cf-4a8e-bf19-ec3955fb0335 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:41.440014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc0443c7-65cf-4a8e-bf19-ec3955fb0335 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:41.440852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc0443c7-65cf-4a8e-bf19-ec3955fb0335 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:41.445246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc0443c7-65cf-4a8e-bf19-ec3955fb0335 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:41.624972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7f425e05-891c-4898-a357-02cfb0da5e9a req-027cd436-f43e-45d4-a0d3-fc424a29394a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21973152-7720-4166-aac2-9dcc46344cd6", "name": "network-vif-plugged", "status": "completed", "tag": "a1ca1f2a-bea3-4c3d-a8fd-d58ed0f5f42b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:41.659477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7f425e05-891c-4898-a357-02cfb0da5e9a req-027cd436-f43e-45d4-a0d3-fc424a29394a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:41.662333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7f425e05-891c-4898-a357-02cfb0da5e9a req-027cd436-f43e-45d4-a0d3-fc424a29394a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:41.710749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7f425e05-891c-4898-a357-02cfb0da5e9a req-027cd436-f43e-45d4-a0d3-fc424a29394a service nova] Creating event network-vif-plugged:a1ca1f2a-bea3-4c3d-a8fd-d58ed0f5f42b for instance 21973152-7720-4166-aac2-9dcc46344cd6 on n-h2-708768-8 Jul 26 20:14:41.736259 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7f425e05-891c-4898-a357-02cfb0da5e9a req-027cd436-f43e-45d4-a0d3-fc424a29394a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115773 Jul 26 20:14:41.738661 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2732/5547] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:14:42.959648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fc0443c7-65cf-4a8e-bf19-ec3955fb0335 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:42.985647 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc0443c7-65cf-4a8e-bf19-ec3955fb0335 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1312 microversion: 2.1 time: 1.567343 Jul 26 20:14:42.991922 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2816/5548] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:41 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1312 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:44.037650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f2c0ff8-bf0b-4a01-ac87-6e2cf2fc28a7 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:44.039945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4f2c0ff8-bf0b-4a01-ac87-6e2cf2fc28a7 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:44.062680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:44.064866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ff8-bf0b-4a01-ac87-6e2cf2fc28a7 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:44.065403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ff8-bf0b-4a01-ac87-6e2cf2fc28a7 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:44.072591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ff8-bf0b-4a01-ac87-6e2cf2fc28a7 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:44.074333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ff8-bf0b-4a01-ac87-6e2cf2fc28a7 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:44.843009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4f2c0ff8-bf0b-4a01-ac87-6e2cf2fc28a7 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:44.862929 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4f2c0ff8-bf0b-4a01-ac87-6e2cf2fc28a7 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1497 microversion: 2.1 time: 0.832896 Jul 26 20:14:44.892194 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2733/5549] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:44 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1497 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:44.894283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-202a38e1-aac6-43b2-b9e9-3ac39d6eae24 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:44.928984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.server_groups [None req-202a38e1-aac6-43b2-b9e9-3ac39d6eae24 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Querying cell 0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) for 1 instances {{(pid=125964) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 20:14:44.930041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202a38e1-aac6-43b2-b9e9-3ac39d6eae24 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:44.930854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-202a38e1-aac6-43b2-b9e9-3ac39d6eae24 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:44.964647 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-202a38e1-aac6-43b2-b9e9-3ac39d6eae24 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/636d0518-dca0-4147-84bf-d0042322cd6a" status: 200 len: 222 microversion: 2.1 time: 0.073972 Jul 26 20:14:44.966138 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2817/5550] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 20:14:44 2022] GET /compute/v2.1/os-server-groups/636d0518-dca0-4147-84bf-d0042322cd6a => generated 222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:14:44.977864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a14643b7-2bd1-4d5f-97df-9288dbaf1dab tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:44.978568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a14643b7-2bd1-4d5f-97df-9288dbaf1dab tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:44.986653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a14643b7-2bd1-4d5f-97df-9288dbaf1dab tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:44.987853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a14643b7-2bd1-4d5f-97df-9288dbaf1dab tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:44.990129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a14643b7-2bd1-4d5f-97df-9288dbaf1dab tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:44.990772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a14643b7-2bd1-4d5f-97df-9288dbaf1dab tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:45.032446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a14643b7-2bd1-4d5f-97df-9288dbaf1dab tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:14:45.188103 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a14643b7-2bd1-4d5f-97df-9288dbaf1dab tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 204 len: 0 microversion: 2.1 time: 0.214791 Jul 26 20:14:45.190439 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2734/5551] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:14:44 2022] DELETE /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:14:45.200576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd4a2f4d-5c73-4ac7-b475-b6a807553ce5 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:45.201560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd4a2f4d-5c73-4ac7-b475-b6a807553ce5 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:45.214489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd4a2f4d-5c73-4ac7-b475-b6a807553ce5 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:45.215218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd4a2f4d-5c73-4ac7-b475-b6a807553ce5 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:45.216921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd4a2f4d-5c73-4ac7-b475-b6a807553ce5 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:45.217525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd4a2f4d-5c73-4ac7-b475-b6a807553ce5 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:45.880982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-430461aa-fa8e-4d50-adc0-597919d25fdc tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'create', calling method: .version_select at 0x7f875d8efee0>, body: {"keypair": {"name": "tempest-keypair-251973084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHat7dK/r6iHF3xvMAvGqJFwikfoRHhWeu9n4M0VrNd+S5jolJhbnYhagv783rfsmYcLbb89mY8BbP2GIqqEjXtTzucPIYbi+xx5GjIB5PHV6Pr/r6kW27pHLwssRTAQA=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:45.899137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-430461aa-fa8e-4d50-adc0-597919d25fdc tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Getting quotas for project 58108d56ca7244f793546a489bef892d. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:45.905548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-430461aa-fa8e-4d50-adc0-597919d25fdc tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Getting quotas for user 195a8048886e42148d7b51a0abc87ac9 and project 58108d56ca7244f793546a489bef892d. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:45.937539 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-430461aa-fa8e-4d50-adc0-597919d25fdc tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.440660 Jul 26 20:14:45.939712 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2735/5552] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:14:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:45.997498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd4a2f4d-5c73-4ac7-b475-b6a807553ce5 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:46.009665 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd4a2f4d-5c73-4ac7-b475-b6a807553ce5 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1503 microversion: 2.1 time: 0.814658 Jul 26 20:14:46.010264 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2818/5553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:45 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1503 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:47.041046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8f99a9bf-dac4-4656-a20a-61f6d2fc1154 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:47.044680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8f99a9bf-dac4-4656-a20a-61f6d2fc1154 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:47.083775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f99a9bf-dac4-4656-a20a-61f6d2fc1154 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:47.088073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f99a9bf-dac4-4656-a20a-61f6d2fc1154 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:47.095368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f99a9bf-dac4-4656-a20a-61f6d2fc1154 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:47.097890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f99a9bf-dac4-4656-a20a-61f6d2fc1154 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:47.834946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8f99a9bf-dac4-4656-a20a-61f6d2fc1154 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:47.847786 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8f99a9bf-dac4-4656-a20a-61f6d2fc1154 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1503 microversion: 2.1 time: 0.814447 Jul 26 20:14:47.850548 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2736/5554] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:47 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1503 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:48.806633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e5050998-2288-4667-8522-c96d72c9081e req-894df631-3f9f-471f-b771-fa6e4f95e924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21973152-7720-4166-aac2-9dcc46344cd6", "name": "network-vif-deleted", "tag": "a1ca1f2a-bea3-4c3d-a8fd-d58ed0f5f42b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:48.821340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef496ffc-7ac9-46bb-9bb5-67554fe5e65b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Action: 'create', calling method: .version_select at 0x7f875613a160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-12684620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO2P6U+a1Aj+jtMNwhqwOHZ1ZFI0CK++7kfa/KNUODIlW1suoVll4wheEslxh9Xuqp8Hbxb2/OxG80ZgX7HvH9i7m9mrshfazQQ62QyhLXJAfCCVblQjKSrnQfPUMsO5A=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:48.827857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e5050998-2288-4667-8522-c96d72c9081e req-894df631-3f9f-471f-b771-fa6e4f95e924 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:48.830441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e5050998-2288-4667-8522-c96d72c9081e req-894df631-3f9f-471f-b771-fa6e4f95e924 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:48.855021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=35 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:48.862318 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e5050998-2288-4667-8522-c96d72c9081e req-894df631-3f9f-471f-b771-fa6e4f95e924 service nova] Creating event network-vif-deleted:a1ca1f2a-bea3-4c3d-a8fd-d58ed0f5f42b for instance 21973152-7720-4166-aac2-9dcc46344cd6 on n-h2-708768-8 Jul 26 20:14:48.876882 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e5050998-2288-4667-8522-c96d72c9081e req-894df631-3f9f-471f-b771-fa6e4f95e924 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074714 Jul 26 20:14:48.880526 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2737/5555] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:48.897100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c907bdc8-1d72-43a4-b34e-f19066f73baf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:48.900736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c907bdc8-1d72-43a4-b34e-f19066f73baf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:48.910560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ef496ffc-7ac9-46bb-9bb5-67554fe5e65b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Getting quotas for project 1abeec2aac614325aed41cea10d85161. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:48.912857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c907bdc8-1d72-43a4-b34e-f19066f73baf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:48.917702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c907bdc8-1d72-43a4-b34e-f19066f73baf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:48.918960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c907bdc8-1d72-43a4-b34e-f19066f73baf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:48.920471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c907bdc8-1d72-43a4-b34e-f19066f73baf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:48.936937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ef496ffc-7ac9-46bb-9bb5-67554fe5e65b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Getting quotas for user 5d711c192b734055ad408b7af039ceae and project 1abeec2aac614325aed41cea10d85161. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:48.983463 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef496ffc-7ac9-46bb-9bb5-67554fe5e65b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.627409 Jul 26 20:14:48.990551 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2819/5556] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:14:48 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:49.499241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c907bdc8-1d72-43a4-b34e-f19066f73baf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4c830232a04dfdac6d37d6c05c2bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680c80206c884336a1d8cd452b8058e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:49.515811 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c907bdc8-1d72-43a4-b34e-f19066f73baf tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 200 len: 1297 microversion: 2.1 time: 0.631337 Jul 26 20:14:49.518990 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2738/5557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:48 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 1297 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:50.544334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:50.544889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:50.565599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:50.566064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:50.584249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:50.584998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:50.630264 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] HTTP exception thrown: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Request method failure captured: Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 HTTP/1.1 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EsTp0tqKDd_hX62Mo8TibRc3XL5t97wnIETUSqkl5D9w34YadM55hmrorMcw34CvHivklYslBQVYIGsb_hZsoo9bSjT1ZVjpMXDqGQfFveDboSyHAuE5QVx8IUrqi6Z52OVoKjvtKhnqbtmNHvlTLbtSW75I3ynhFb22wFDS22YcoE Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_680c80206c884336a1d8cd452b8058e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}] Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ef4c830232a04dfdac6d37d6c05c2bf0 Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '21973152-7720-4166-aac2-9dcc46344cd6'} Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:50.632018 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Returning 404 to user: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:50.636843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0bb620db-218e-4167-a3c9-2f6b4b4bd4fb tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 404 len: 111 microversion: 2.1 time: 0.095530 Jul 26 20:14:50.652798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbae2c8d-ac60-428f-bf54-8c8c32b1e7b1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:50.658138 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2820/5558] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:50 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:14:50.699662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.compute.server_groups [None req-cbae2c8d-ac60-428f-bf54-8c8c32b1e7b1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Querying cell 0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) for 1 instances {{(pid=125963) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 20:14:50.700898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbae2c8d-ac60-428f-bf54-8c8c32b1e7b1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:50.701446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbae2c8d-ac60-428f-bf54-8c8c32b1e7b1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:50.716980 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cbae2c8d-ac60-428f-bf54-8c8c32b1e7b1 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.069193 Jul 26 20:14:50.728041 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2739/5559] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:14:50 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:14:50.742830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-991c962f-45b1-4f33-aaae-bacf4722c622 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:50.809656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.compute.server_groups [None req-991c962f-45b1-4f33-aaae-bacf4722c622 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Querying cell 0393313e-ce6a-41bc-abff-62c7ad1eab5d(cell1) for 1 instances {{(pid=125964) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 20:14:50.815122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-991c962f-45b1-4f33-aaae-bacf4722c622 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:50.815739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-991c962f-45b1-4f33-aaae-bacf4722c622 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:50.864793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-991c962f-45b1-4f33-aaae-bacf4722c622 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/636d0518-dca0-4147-84bf-d0042322cd6a" status: 200 len: 184 microversion: 2.1 time: 0.137143 Jul 26 20:14:50.865393 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2821/5560] 10.222.0.58 () {58 vars in 1263 bytes} [Tue Jul 26 20:14:50 2022] GET /compute/v2.1/os-server-groups/636d0518-dca0-4147-84bf-d0042322cd6a => generated 184 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:14:50.878632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:50.879133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:50.893954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:50.894627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:50.895211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:50.895669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:50.965701 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] HTTP exception thrown: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Request method failure captured: Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 HTTP/1.1 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EsTp0tqKDd_hX62Mo8TibRc3XL5t97wnIETUSqkl5D9w34YadM55hmrorMcw34CvHivklYslBQVYIGsb_hZsoo9bSjT1ZVjpMXDqGQfFveDboSyHAuE5QVx8IUrqi6Z52OVoKjvtKhnqbtmNHvlTLbtSW75I3ynhFb22wFDS22YcoE Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_680c80206c884336a1d8cd452b8058e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}] Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ef4c830232a04dfdac6d37d6c05c2bf0 Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '21973152-7720-4166-aac2-9dcc46344cd6'} Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:14:50.971244 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Returning 404 to user: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:50.976356 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-57051a4e-7354-4e3e-b4ef-1bdbbee2cd99 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 404 len: 111 microversion: 2.1 time: 0.101583 Jul 26 20:14:50.983341 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2740/5561] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:14:50 2022] DELETE /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:14:50.990795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:50.991418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] [instance: 21973152-7720-4166-aac2-9dcc46344cd6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:51.007696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:51.008167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:51.016532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:51.021450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:51.061661 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] HTTP exception thrown: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Request method failure captured: Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 HTTP/1.1 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EsTp0tqKDd_hX62Mo8TibRc3XL5t97wnIETUSqkl5D9w34YadM55hmrorMcw34CvHivklYslBQVYIGsb_hZsoo9bSjT1ZVjpMXDqGQfFveDboSyHAuE5QVx8IUrqi6Z52OVoKjvtKhnqbtmNHvlTLbtSW75I3ynhFb22wFDS22YcoE Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_680c80206c884336a1d8cd452b8058e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}] Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ef4c830232a04dfdac6d37d6c05c2bf0 Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '21973152-7720-4166-aac2-9dcc46344cd6'} Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.075434 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Returning 404 to user: Instance 21973152-7720-4166-aac2-9dcc46344cd6 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:51.079646 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d3daea3-b745-4035-a4c4-6604e0b5011e tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6" status: 404 len: 111 microversion: 2.1 time: 0.090435 Jul 26 20:14:51.086805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a9415ea-dc74-4303-92b8-a38c11b5d683 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:51.091659 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2822/5562] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:50 2022] GET /compute/v2.1/servers/21973152-7720-4166-aac2-9dcc46344cd6 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:14:51.097536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-1a9415ea-dc74-4303-92b8-a38c11b5d683 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] HTTP exception thrown: Instance group a2f658f0-9ea5-4f9f-9f6d-69541df0f99e could not be found. Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a9415ea-dc74-4303-92b8-a38c11b5d683 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Request method failure captured: Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-server-groups/a2f658f0-9ea5-4f9f-9f6d-69541df0f99e HTTP/1.1 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EsTp0tqKDd_hX62Mo8TibRc3XL5t97wnIETUSqkl5D9w34YadM55hmrorMcw34CvHivklYslBQVYIGsb_hZsoo9bSjT1ZVjpMXDqGQfFveDboSyHAuE5QVx8IUrqi6Z52OVoKjvtKhnqbtmNHvlTLbtSW75I3ynhFb22wFDS22YcoE Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_680c80206c884336a1d8cd452b8058e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}] Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ef4c830232a04dfdac6d37d6c05c2bf0 Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance group a2f658f0-9ea5-4f9f-9f6d-69541df0f99e could not be found. Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a2f658f0-9ea5-4f9f-9f6d-69541df0f99e'} Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a2f658f0-9ea5-4f9f-9f6d-69541df0f99e could not be found. Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a2f658f0-9ea5-4f9f-9f6d-69541df0f99e could not be found. Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.113779 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a2f658f0-9ea5-4f9f-9f6d-69541df0f99e could not be found. Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a9415ea-dc74-4303-92b8-a38c11b5d683 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Returning 404 to user: Instance group a2f658f0-9ea5-4f9f-9f6d-69541df0f99e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a9415ea-dc74-4303-92b8-a38c11b5d683 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/a2f658f0-9ea5-4f9f-9f6d-69541df0f99e" status: 404 len: 117 microversion: 2.1 time: 0.032717 Jul 26 20:14:51.122963 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2741/5563] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:51 2022] DELETE /compute/v2.1/os-server-groups/a2f658f0-9ea5-4f9f-9f6d-69541df0f99e => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:14:51.126283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1b947e7-5d2d-4b0a-bef6-b7495748a3c3 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:51.137013 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f1b947e7-5d2d-4b0a-bef6-b7495748a3c3 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] HTTP exception thrown: Instance group 49ab28c1-c619-44fa-a86b-72b5edaec175 could not be found. Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1b947e7-5d2d-4b0a-bef6-b7495748a3c3 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Request method failure captured: Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-server-groups/49ab28c1-c619-44fa-a86b-72b5edaec175 HTTP/1.1 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EsTp0tqKDd_hX62Mo8TibRc3XL5t97wnIETUSqkl5D9w34YadM55hmrorMcw34CvHivklYslBQVYIGsb_hZsoo9bSjT1ZVjpMXDqGQfFveDboSyHAuE5QVx8IUrqi6Z52OVoKjvtKhnqbtmNHvlTLbtSW75I3ynhFb22wFDS22YcoE Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_680c80206c884336a1d8cd452b8058e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}] Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ef4c830232a04dfdac6d37d6c05c2bf0 Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance group 49ab28c1-c619-44fa-a86b-72b5edaec175 could not be found. Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '49ab28c1-c619-44fa-a86b-72b5edaec175'} Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 49ab28c1-c619-44fa-a86b-72b5edaec175 could not be found. Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 49ab28c1-c619-44fa-a86b-72b5edaec175 could not be found. Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.139389 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.145722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.145722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.145722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:51.145722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:51.145722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 49ab28c1-c619-44fa-a86b-72b5edaec175 could not be found. Jul 26 20:14:51.145722 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.145722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1b947e7-5d2d-4b0a-bef6-b7495748a3c3 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Returning 404 to user: Instance group 49ab28c1-c619-44fa-a86b-72b5edaec175 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:51.155208 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f1b947e7-5d2d-4b0a-bef6-b7495748a3c3 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/49ab28c1-c619-44fa-a86b-72b5edaec175" status: 404 len: 117 microversion: 2.1 time: 0.033662 Jul 26 20:14:51.159060 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2823/5564] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:51 2022] DELETE /compute/v2.1/os-server-groups/49ab28c1-c619-44fa-a86b-72b5edaec175 => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:14:51.164154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0adcad7b-d242-43e0-8ad6-7bf127eedc04 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:51.196372 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0adcad7b-d242-43e0-8ad6-7bf127eedc04 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] HTTP exception thrown: Instance group 4a0e92c5-c2cb-428d-81ba-1ea68566029b could not be found. Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0adcad7b-d242-43e0-8ad6-7bf127eedc04 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Request method failure captured: Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-server-groups/4a0e92c5-c2cb-428d-81ba-1ea68566029b HTTP/1.1 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EsTp0tqKDd_hX62Mo8TibRc3XL5t97wnIETUSqkl5D9w34YadM55hmrorMcw34CvHivklYslBQVYIGsb_hZsoo9bSjT1ZVjpMXDqGQfFveDboSyHAuE5QVx8IUrqi6Z52OVoKjvtKhnqbtmNHvlTLbtSW75I3ynhFb22wFDS22YcoE Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_680c80206c884336a1d8cd452b8058e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}] Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: ef4c830232a04dfdac6d37d6c05c2bf0 Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance group 4a0e92c5-c2cb-428d-81ba-1ea68566029b could not be found. Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '4a0e92c5-c2cb-428d-81ba-1ea68566029b'} Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4a0e92c5-c2cb-428d-81ba-1ea68566029b could not be found. Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4a0e92c5-c2cb-428d-81ba-1ea68566029b could not be found. Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.202890 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.211421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.211421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.211421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:51.211421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:51.211421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4a0e92c5-c2cb-428d-81ba-1ea68566029b could not be found. Jul 26 20:14:51.211421 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.216470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0adcad7b-d242-43e0-8ad6-7bf127eedc04 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Returning 404 to user: Instance group 4a0e92c5-c2cb-428d-81ba-1ea68566029b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:51.218358 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0adcad7b-d242-43e0-8ad6-7bf127eedc04 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/4a0e92c5-c2cb-428d-81ba-1ea68566029b" status: 404 len: 117 microversion: 2.1 time: 0.058245 Jul 26 20:14:51.226280 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2742/5565] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:51 2022] DELETE /compute/v2.1/os-server-groups/4a0e92c5-c2cb-428d-81ba-1ea68566029b => generated 117 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:14:51.231479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bab4e4d3-da18-4360-adc5-1ba5ed5932a9 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:51.249626 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-bab4e4d3-da18-4360-adc5-1ba5ed5932a9 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] HTTP exception thrown: Instance group 724ffab2-8eec-4fc0-8730-fc48a22dba00 could not be found. Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bab4e4d3-da18-4360-adc5-1ba5ed5932a9 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Request method failure captured: Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/os-server-groups/724ffab2-8eec-4fc0-8730-fc48a22dba00 HTTP/1.1 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EsTp0tqKDd_hX62Mo8TibRc3XL5t97wnIETUSqkl5D9w34YadM55hmrorMcw34CvHivklYslBQVYIGsb_hZsoo9bSjT1ZVjpMXDqGQfFveDboSyHAuE5QVx8IUrqi6Z52OVoKjvtKhnqbtmNHvlTLbtSW75I3ynhFb22wFDS22YcoE Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_680c80206c884336a1d8cd452b8058e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/680c80206c884336a1d8cd452b8058e6"}]}] Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 680c80206c884336a1d8cd452b8058e6 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerGroupTestJSON-1959194703 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: ef4c830232a04dfdac6d37d6c05c2bf0 Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerGroupTestJSON-1959194703-project Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance group 724ffab2-8eec-4fc0-8730-fc48a22dba00 could not be found. Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '724ffab2-8eec-4fc0-8730-fc48a22dba00'} Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 724ffab2-8eec-4fc0-8730-fc48a22dba00 could not be found. Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 724ffab2-8eec-4fc0-8730-fc48a22dba00 could not be found. Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.251285 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:14:51.262561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:14:51.262561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:14:51.262561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:14:51.262561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:14:51.262561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 724ffab2-8eec-4fc0-8730-fc48a22dba00 could not be found. Jul 26 20:14:51.262561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:14:51.262561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bab4e4d3-da18-4360-adc5-1ba5ed5932a9 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Returning 404 to user: Instance group 724ffab2-8eec-4fc0-8730-fc48a22dba00 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:14:51.262561 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bab4e4d3-da18-4360-adc5-1ba5ed5932a9 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/724ffab2-8eec-4fc0-8730-fc48a22dba00" status: 404 len: 117 microversion: 2.1 time: 0.026594 Jul 26 20:14:51.264045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2355decb-c293-4a1b-9caf-53104978d550 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:51.270654 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2824/5566] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:51 2022] DELETE /compute/v2.1/os-server-groups/724ffab2-8eec-4fc0-8730-fc48a22dba00 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:14:51.348955 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2355decb-c293-4a1b-9caf-53104978d550 tempest-ServerGroupTestJSON-1959194703 tempest-ServerGroupTestJSON-1959194703-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/636d0518-dca0-4147-84bf-d0042322cd6a" status: 204 len: 0 microversion: 2.1 time: 0.091130 Jul 26 20:14:51.361347 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2743/5567] 10.222.0.58 () {58 vars in 1266 bytes} [Tue Jul 26 20:14:51 2022] DELETE /compute/v2.1/os-server-groups/636d0518-dca0-4147-84bf-d0042322cd6a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:14:53.073285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-469243873", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7100de4-4da6-4097-b0e2-a71ad4e9e9e9"}], "security_groups": [{"name": "tempest-securitygroup--209461067"}], "key_name": "tempest-keypair-251973084", "user_data": "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:53.887907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] validate_networks() for [('d7100de4-4da6-4097-b0e2-a71ad4e9e9e9', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:14:55.512904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:14:55.513587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:14:55.513836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:14:55.514177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:14:55.524532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:14:55.535554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:55.536456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:55.537883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:55.538851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:55.556674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=48 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:55.618690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Getting quotas for project 58108d56ca7244f793546a489bef892d. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:55.632399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Getting quotas for user 195a8048886e42148d7b51a0abc87ac9 and project 58108d56ca7244f793546a489bef892d. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:55.673512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:14:55.680110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:14:55.893663 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4ae7cc2d-e4f5-4a9b-9a20-0e325ffd934a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.815783 Jul 26 20:14:55.903498 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2825/5568] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:14:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:14:55.908891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ac04505-1545-4a78-8712-7c746739365a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:55.910994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ac04505-1545-4a78-8712-7c746739365a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:55.913367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:55.918941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:14:56.109877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1123575253", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-12684620", "security_groups": [{"name": "tempest-secgroup-smoke-448209177"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "d78c6a40-e300-4429-8b1e-9ca5e22f2b55"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:56.146988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ac04505-1545-4a78-8712-7c746739365a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:56.154679 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ac04505-1545-4a78-8712-7c746739365a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1236 microversion: 2.1 time: 0.250814 Jul 26 20:14:56.163090 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2744/5569] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:55 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1236 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:56.584980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] validate_networks() for [('d78c6a40-e300-4429-8b1e-9ca5e22f2b55', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:14:56.779656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1872735265-access_point-1347049020", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "e5940419-09c2-4d8d-801a-5fbefffa024b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1140950452", "security_groups": [{"name": "tempest-secgroup_access--323142702"}, {"name": "tempest-secgroup_general--836143979"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:14:57.360408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] validate_networks() for [('e5940419-09c2-4d8d-801a-5fbefffa024b', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:14:58.803644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Getting quotas for project 1abeec2aac614325aed41cea10d85161. Resources: dict_keys(['metadata_items']) {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:58.835583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Getting quotas for user 5d711c192b734055ad408b7af039ceae and project 1abeec2aac614325aed41cea10d85161. Resources: dict_keys(['metadata_items']) {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:58.907969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:14:58.908574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:14:58.909583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:14:58.910115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:14:58.910658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:14:58.939993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:58.945031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:58.946054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:58.946615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:58.999333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Getting quotas for project 1abeec2aac614325aed41cea10d85161. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:14:59.005575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Getting quotas for user 5d711c192b734055ad408b7af039ceae and project 1abeec2aac614325aed41cea10d85161. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:14:59.042472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:14:59.044854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:14:59.184094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5875723b-65a0-4187-932e-a98c56f6910c tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.080275 Jul 26 20:14:59.198411 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2826/5570] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:14:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 3095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:14:59.213471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a41494a-61ea-41fd-8f46-be0d487d0783 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:59.214837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a41494a-61ea-41fd-8f46-be0d487d0783 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:59.230729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a41494a-61ea-41fd-8f46-be0d487d0783 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:59.231241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a41494a-61ea-41fd-8f46-be0d487d0783 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:59.232021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a41494a-61ea-41fd-8f46-be0d487d0783 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:14:59.232462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a41494a-61ea-41fd-8f46-be0d487d0783 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:14:59.396838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4a41494a-61ea-41fd-8f46-be0d487d0783 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:59.418334 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a41494a-61ea-41fd-8f46-be0d487d0783 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1294 microversion: 2.1 time: 0.218436 Jul 26 20:14:59.428334 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2827/5571] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:59 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1294 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:14:59.440545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-24d75023-a195-4ac4-9680-8c881b42c8d4 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:14:59.452966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-24d75023-a195-4ac4-9680-8c881b42c8d4 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:14:59.589513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-24d75023-a195-4ac4-9680-8c881b42c8d4 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:14:59.600323 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-24d75023-a195-4ac4-9680-8c881b42c8d4 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1301 microversion: 2.1 time: 0.169990 Jul 26 20:14:59.600917 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2828/5572] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:14:59 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1301 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:00.441258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a41f46bc-7a53-4592-b94c-619b5e7a5bf0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:00.441939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a41f46bc-7a53-4592-b94c-619b5e7a5bf0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:00.451534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a41f46bc-7a53-4592-b94c-619b5e7a5bf0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:00.452027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a41f46bc-7a53-4592-b94c-619b5e7a5bf0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:00.452820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a41f46bc-7a53-4592-b94c-619b5e7a5bf0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:00.453268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a41f46bc-7a53-4592-b94c-619b5e7a5bf0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:00.482095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:15:00.482600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:15:00.482724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:15:00.483121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:15:00.483533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:15:00.499951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:00.500407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:00.501217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:00.501784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:00.579887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:00.618963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Getting quotas for project 75fe1e4cfc6d4292a74e5d0194e52134. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:15:00.635787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Getting quotas for user 3221f96786b94685a458669711c802b9 and project 75fe1e4cfc6d4292a74e5d0194e52134. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:15:00.664329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:15:00.666385 n-d-708768-8 devstack@n-api.service[125963]: WARNING nova.utils [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1872735265-access_point-1347049020 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1872735265-ac Jul 26 20:15:00.667773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:15:00.749314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a41f46bc-7a53-4592-b94c-619b5e7a5bf0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:00.757219 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a41f46bc-7a53-4592-b94c-619b5e7a5bf0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1294 microversion: 2.1 time: 0.319489 Jul 26 20:15:00.769561 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2829/5573] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:00 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1294 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:15:00.769561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afdc56e0-512a-4f0d-9636-5a532bfa349b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:00.769561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-afdc56e0-512a-4f0d-9636-5a532bfa349b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:00.798590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afdc56e0-512a-4f0d-9636-5a532bfa349b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:00.803257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afdc56e0-512a-4f0d-9636-5a532bfa349b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:00.806818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afdc56e0-512a-4f0d-9636-5a532bfa349b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:00.807274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afdc56e0-512a-4f0d-9636-5a532bfa349b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:00.810893 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-24aa647d-a8d4-4ea0-becd-dbbbdce106e4 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 4.035903 Jul 26 20:15:00.811640 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2745/5574] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:14:56 2022] POST /compute/v2.1/servers => generated 456 bytes in 4037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:15:00.823456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a810613e-7573-4998-8ea2-4382571c2bcc tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:00.824329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a810613e-7573-4998-8ea2-4382571c2bcc tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:01.062083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a810613e-7573-4998-8ea2-4382571c2bcc tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:01.069664 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a810613e-7573-4998-8ea2-4382571c2bcc tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1295 microversion: 2.1 time: 0.250509 Jul 26 20:15:01.070243 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2746/5575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:00 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1295 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:01.216378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afdc56e0-512a-4f0d-9636-5a532bfa349b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:01.234468 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afdc56e0-512a-4f0d-9636-5a532bfa349b tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1353 microversion: 2.1 time: 0.467888 Jul 26 20:15:01.236212 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2830/5576] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:00 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1353 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:01.783035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-91958e0c-ab95-480f-bcc3-16fc83b35a22 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:01.783811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-91958e0c-ab95-480f-bcc3-16fc83b35a22 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:01.793291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91958e0c-ab95-480f-bcc3-16fc83b35a22 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:01.794086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91958e0c-ab95-480f-bcc3-16fc83b35a22 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:01.795080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91958e0c-ab95-480f-bcc3-16fc83b35a22 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:01.802484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-91958e0c-ab95-480f-bcc3-16fc83b35a22 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:02.091048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f49806d-a48b-41bc-9f24-1df68adfa79f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:02.091705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f49806d-a48b-41bc-9f24-1df68adfa79f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:02.105560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f49806d-a48b-41bc-9f24-1df68adfa79f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:02.116386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f49806d-a48b-41bc-9f24-1df68adfa79f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:02.117248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f49806d-a48b-41bc-9f24-1df68adfa79f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:02.117703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f49806d-a48b-41bc-9f24-1df68adfa79f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:02.118729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-91958e0c-ab95-480f-bcc3-16fc83b35a22 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:02.142621 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-91958e0c-ab95-480f-bcc3-16fc83b35a22 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1294 microversion: 2.1 time: 0.363324 Jul 26 20:15:02.153607 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2747/5577] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:01 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1294 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:02.265700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-315d69c9-f917-44b9-aa3d-1649c2e73189 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:02.266493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-315d69c9-f917-44b9-aa3d-1649c2e73189 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:02.281755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-315d69c9-f917-44b9-aa3d-1649c2e73189 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:02.304707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-315d69c9-f917-44b9-aa3d-1649c2e73189 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:02.306094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-315d69c9-f917-44b9-aa3d-1649c2e73189 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:02.306783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-315d69c9-f917-44b9-aa3d-1649c2e73189 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:02.453079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1f49806d-a48b-41bc-9f24-1df68adfa79f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:02.470591 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f49806d-a48b-41bc-9f24-1df68adfa79f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1291 microversion: 2.1 time: 0.383969 Jul 26 20:15:02.475243 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2831/5578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:02 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1291 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:15:02.529558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-315d69c9-f917-44b9-aa3d-1649c2e73189 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:02.554458 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-315d69c9-f917-44b9-aa3d-1649c2e73189 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1359 microversion: 2.1 time: 0.292687 Jul 26 20:15:02.556312 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2748/5579] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:02 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:15:03.174480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af9d7707-0afc-45cb-be55-f9c5ee51893d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:03.175762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-af9d7707-0afc-45cb-be55-f9c5ee51893d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:03.198919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af9d7707-0afc-45cb-be55-f9c5ee51893d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:03.199937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af9d7707-0afc-45cb-be55-f9c5ee51893d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:03.200912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af9d7707-0afc-45cb-be55-f9c5ee51893d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:03.201520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-af9d7707-0afc-45cb-be55-f9c5ee51893d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:03.496830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c3f3d0db-cb0f-42f1-8d8b-a4f2a57f096a tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:03.497453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c3f3d0db-cb0f-42f1-8d8b-a4f2a57f096a tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:03.509798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3f3d0db-cb0f-42f1-8d8b-a4f2a57f096a tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:03.517492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3f3d0db-cb0f-42f1-8d8b-a4f2a57f096a tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:03.524915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3f3d0db-cb0f-42f1-8d8b-a4f2a57f096a tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:03.525527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c3f3d0db-cb0f-42f1-8d8b-a4f2a57f096a tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:03.709139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c3f3d0db-cb0f-42f1-8d8b-a4f2a57f096a tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:03.724439 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c3f3d0db-cb0f-42f1-8d8b-a4f2a57f096a tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1353 microversion: 2.1 time: 0.231632 Jul 26 20:15:03.739039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2749/5580] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:03 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1353 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:03.744276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-83a490ce-d491-4fb8-b622-e11e49efeafd tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:03.756733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-83a490ce-d491-4fb8-b622-e11e49efeafd tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:03.764787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83a490ce-d491-4fb8-b622-e11e49efeafd tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:03.765524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83a490ce-d491-4fb8-b622-e11e49efeafd tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:03.766494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83a490ce-d491-4fb8-b622-e11e49efeafd tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:03.767096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-83a490ce-d491-4fb8-b622-e11e49efeafd tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:03.913703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-af9d7707-0afc-45cb-be55-f9c5ee51893d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:03.939503 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-af9d7707-0afc-45cb-be55-f9c5ee51893d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1361 microversion: 2.1 time: 0.768839 Jul 26 20:15:03.953543 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2832/5581] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:03 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1361 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:03.958165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-83a490ce-d491-4fb8-b622-e11e49efeafd tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:03.978791 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-83a490ce-d491-4fb8-b622-e11e49efeafd tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1359 microversion: 2.1 time: 0.233602 Jul 26 20:15:03.985488 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2750/5582] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:03 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:04.747126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c9746753-430a-4302-b664-b6489c02ae89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:04.748513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c9746753-430a-4302-b664-b6489c02ae89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:04.769302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c9746753-430a-4302-b664-b6489c02ae89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:04.770141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c9746753-430a-4302-b664-b6489c02ae89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:04.772331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c9746753-430a-4302-b664-b6489c02ae89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:04.775887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c9746753-430a-4302-b664-b6489c02ae89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:04.971713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aaf83248-8b25-4316-b352-55f92c553b9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:04.973116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aaf83248-8b25-4316-b352-55f92c553b9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:04.986934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf83248-8b25-4316-b352-55f92c553b9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:04.987759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf83248-8b25-4316-b352-55f92c553b9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:04.988746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf83248-8b25-4316-b352-55f92c553b9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:04.992190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aaf83248-8b25-4316-b352-55f92c553b9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:05.030453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c9746753-430a-4302-b664-b6489c02ae89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:05.052649 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c9746753-430a-4302-b664-b6489c02ae89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1353 microversion: 2.1 time: 0.309770 Jul 26 20:15:05.053969 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2833/5583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:04 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1353 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:05.065681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc19aeb3-b0e6-405d-b943-cdeb258ff537 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:05.066597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fc19aeb3-b0e6-405d-b943-cdeb258ff537 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:05.074396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc19aeb3-b0e6-405d-b943-cdeb258ff537 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:05.074851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc19aeb3-b0e6-405d-b943-cdeb258ff537 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:05.075795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc19aeb3-b0e6-405d-b943-cdeb258ff537 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:05.076812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc19aeb3-b0e6-405d-b943-cdeb258ff537 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:05.424441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fc19aeb3-b0e6-405d-b943-cdeb258ff537 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:05.437915 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc19aeb3-b0e6-405d-b943-cdeb258ff537 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 0.382582 Jul 26 20:15:05.453554 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2834/5584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:05 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:05.664680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aaf83248-8b25-4316-b352-55f92c553b9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:05.680516 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aaf83248-8b25-4316-b352-55f92c553b9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1361 microversion: 2.1 time: 0.708206 Jul 26 20:15:05.684311 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2751/5585] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:04 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1361 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:06.077481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f891a078-ea6e-4acb-bf75-f6580f34ead9 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:06.078112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f891a078-ea6e-4acb-bf75-f6580f34ead9 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:06.092697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f891a078-ea6e-4acb-bf75-f6580f34ead9 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:06.095941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f891a078-ea6e-4acb-bf75-f6580f34ead9 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:06.097031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f891a078-ea6e-4acb-bf75-f6580f34ead9 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:06.097681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f891a078-ea6e-4acb-bf75-f6580f34ead9 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:06.224430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f891a078-ea6e-4acb-bf75-f6580f34ead9 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:06.241106 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f891a078-ea6e-4acb-bf75-f6580f34ead9 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1353 microversion: 2.1 time: 0.170283 Jul 26 20:15:06.242697 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2835/5586] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:06 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:06.465367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-31fd51b2-cec9-47a3-9d44-eac0a8131ea7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:06.467422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-31fd51b2-cec9-47a3-9d44-eac0a8131ea7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:06.488920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31fd51b2-cec9-47a3-9d44-eac0a8131ea7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:06.490193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31fd51b2-cec9-47a3-9d44-eac0a8131ea7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:06.493258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31fd51b2-cec9-47a3-9d44-eac0a8131ea7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:06.497905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-31fd51b2-cec9-47a3-9d44-eac0a8131ea7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:06.672111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45484a8c-1cda-4a30-b788-789a0a58ef1e tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b3d889c-b954-4983-a78e-7ba7634a1844", "device": "/dev/sdb"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:06.675241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45484a8c-1cda-4a30-b788-789a0a58ef1e tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:06.690049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45484a8c-1cda-4a30-b788-789a0a58ef1e tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:06.690507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45484a8c-1cda-4a30-b788-789a0a58ef1e tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:06.691385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45484a8c-1cda-4a30-b788-789a0a58ef1e tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:06.691749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45484a8c-1cda-4a30-b788-789a0a58ef1e tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:07.055942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-31fd51b2-cec9-47a3-9d44-eac0a8131ea7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:07.087369 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-31fd51b2-cec9-47a3-9d44-eac0a8131ea7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 0.623820 Jul 26 20:15:07.089257 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2752/5587] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:06 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:07.105122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-101a53d3-928a-4490-b5dc-a53d84a25115 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:07.107462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-101a53d3-928a-4490-b5dc-a53d84a25115 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:07.141623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-101a53d3-928a-4490-b5dc-a53d84a25115 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:07.142640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-101a53d3-928a-4490-b5dc-a53d84a25115 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:07.145781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-101a53d3-928a-4490-b5dc-a53d84a25115 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:07.146268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-101a53d3-928a-4490-b5dc-a53d84a25115 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:07.164844 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45484a8c-1cda-4a30-b788-789a0a58ef1e tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "POST /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.498358 Jul 26 20:15:07.170864 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2836/5588] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:15:06 2022] POST /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:07.215442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-464b3faa-4a95-4e8e-bda9-748ecabfb001 req-2ab4394d-a06c-4164-bc87-87fcae40a7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d744cf68-c058-4eb6-8e8a-4e97b7a16f09", "tag": "6844a656-5cac-431f-b26b-fde6ee6b0c20"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:07.310935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-464b3faa-4a95-4e8e-bda9-748ecabfb001 req-2ab4394d-a06c-4164-bc87-87fcae40a7d9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:07.311405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-464b3faa-4a95-4e8e-bda9-748ecabfb001 req-2ab4394d-a06c-4164-bc87-87fcae40a7d9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:07.353717 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-464b3faa-4a95-4e8e-bda9-748ecabfb001 req-2ab4394d-a06c-4164-bc87-87fcae40a7d9 service nova] Creating event network-changed:6844a656-5cac-431f-b26b-fde6ee6b0c20 for instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 on n-h2-708768-8 Jul 26 20:15:07.369521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-464b3faa-4a95-4e8e-bda9-748ecabfb001 req-2ab4394d-a06c-4164-bc87-87fcae40a7d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174944 Jul 26 20:15:07.377681 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2837/5589] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:07.393124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6c9bd73e-a233-4f39-b691-6ac2ebecbe61 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:07.394263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6c9bd73e-a233-4f39-b691-6ac2ebecbe61 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:07.416298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c9bd73e-a233-4f39-b691-6ac2ebecbe61 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:07.416808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c9bd73e-a233-4f39-b691-6ac2ebecbe61 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:07.417681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c9bd73e-a233-4f39-b691-6ac2ebecbe61 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:07.420398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c9bd73e-a233-4f39-b691-6ac2ebecbe61 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:07.847107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c9bd73e-a233-4f39-b691-6ac2ebecbe61 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:07.864359 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6c9bd73e-a233-4f39-b691-6ac2ebecbe61 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1471 microversion: 2.1 time: 0.485047 Jul 26 20:15:07.875854 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2838/5590] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:07 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1471 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:08.114742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-941912c9-5bdb-42eb-97b4-82ce7be98f17 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:08.115260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-941912c9-5bdb-42eb-97b4-82ce7be98f17 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:08.127930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-941912c9-5bdb-42eb-97b4-82ce7be98f17 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:08.128379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-941912c9-5bdb-42eb-97b4-82ce7be98f17 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:08.129170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-941912c9-5bdb-42eb-97b4-82ce7be98f17 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:08.129607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-941912c9-5bdb-42eb-97b4-82ce7be98f17 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:08.226443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-101a53d3-928a-4490-b5dc-a53d84a25115 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:08.249423 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-101a53d3-928a-4490-b5dc-a53d84a25115 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1361 microversion: 2.1 time: 1.157452 Jul 26 20:15:08.250356 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2753/5591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:07 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1361 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:08.787477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-941912c9-5bdb-42eb-97b4-82ce7be98f17 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:08.804405 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-941912c9-5bdb-42eb-97b4-82ce7be98f17 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 0.693367 Jul 26 20:15:08.821599 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2839/5592] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:08 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:08.891079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5903e865-648c-4789-886e-02d1429f8713 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:08.891966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5903e865-648c-4789-886e-02d1429f8713 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:08.913258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5903e865-648c-4789-886e-02d1429f8713 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:08.916686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5903e865-648c-4789-886e-02d1429f8713 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:08.919088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5903e865-648c-4789-886e-02d1429f8713 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:08.920806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5903e865-648c-4789-886e-02d1429f8713 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:09.276582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f59ce3be-80b2-4d8a-9317-e492145c4e0e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:09.277664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f59ce3be-80b2-4d8a-9317-e492145c4e0e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:09.280022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:09.295267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f59ce3be-80b2-4d8a-9317-e492145c4e0e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:09.308637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f59ce3be-80b2-4d8a-9317-e492145c4e0e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:09.310126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f59ce3be-80b2-4d8a-9317-e492145c4e0e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:09.313420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f59ce3be-80b2-4d8a-9317-e492145c4e0e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:09.594733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=22 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:09.999295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f59ce3be-80b2-4d8a-9317-e492145c4e0e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:10.038729 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f59ce3be-80b2-4d8a-9317-e492145c4e0e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1361 microversion: 2.1 time: 0.764086 Jul 26 20:15:10.058024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2840/5593] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:09 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1361 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:15:10.075104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e247d9b7-e64d-4f61-9578-ac41182991d1 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:10.080915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e247d9b7-e64d-4f61-9578-ac41182991d1 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:10.108879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e247d9b7-e64d-4f61-9578-ac41182991d1 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:10.109839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e247d9b7-e64d-4f61-9578-ac41182991d1 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:10.114367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e247d9b7-e64d-4f61-9578-ac41182991d1 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:10.115104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e247d9b7-e64d-4f61-9578-ac41182991d1 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:10.555125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:10.615874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e247d9b7-e64d-4f61-9578-ac41182991d1 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:10.633643 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e247d9b7-e64d-4f61-9578-ac41182991d1 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 0.570616 Jul 26 20:15:10.645092 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2841/5594] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:10 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:10.650120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c4357c6f-796d-4446-a729-425657de1051 req-56350fb8-8c6d-414b-8bf8-74f787f6b735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1bc551-920e-4468-bead-13d6a4c0e44f", "tag": "399dd489-8b51-4146-af7c-61a26980789d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:10.732319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:10.734491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c4357c6f-796d-4446-a729-425657de1051 req-56350fb8-8c6d-414b-8bf8-74f787f6b735 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:10.734928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c4357c6f-796d-4446-a729-425657de1051 req-56350fb8-8c6d-414b-8bf8-74f787f6b735 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:10.820027 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c4357c6f-796d-4446-a729-425657de1051 req-56350fb8-8c6d-414b-8bf8-74f787f6b735 service nova] Creating event network-changed:399dd489-8b51-4146-af7c-61a26980789d for instance 6b1bc551-920e-4468-bead-13d6a4c0e44f on n-h1-708768-8 Jul 26 20:15:10.835846 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c4357c6f-796d-4446-a729-425657de1051 req-56350fb8-8c6d-414b-8bf8-74f787f6b735 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189157 Jul 26 20:15:10.840526 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2842/5595] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:10.885598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5903e865-648c-4789-886e-02d1429f8713 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:10.896378 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5903e865-648c-4789-886e-02d1429f8713 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1471 microversion: 2.1 time: 2.010352 Jul 26 20:15:10.904228 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2754/5596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:08 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1471 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:11.078567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6cdacf10-567d-42d4-9dab-11128d1b43fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:11.079344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6cdacf10-567d-42d4-9dab-11128d1b43fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:11.126539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cdacf10-567d-42d4-9dab-11128d1b43fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:11.127011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cdacf10-567d-42d4-9dab-11128d1b43fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:11.127861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cdacf10-567d-42d4-9dab-11128d1b43fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:11.128299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6cdacf10-567d-42d4-9dab-11128d1b43fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:11.669012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a158e219-efa4-4284-b70a-b5fef65867c2 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:11.670800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a158e219-efa4-4284-b70a-b5fef65867c2 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:11.681907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:11.696173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a158e219-efa4-4284-b70a-b5fef65867c2 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:11.698607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a158e219-efa4-4284-b70a-b5fef65867c2 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:11.701803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a158e219-efa4-4284-b70a-b5fef65867c2 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:11.704371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a158e219-efa4-4284-b70a-b5fef65867c2 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:12.036562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6cdacf10-567d-42d4-9dab-11128d1b43fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:12.054186 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6cdacf10-567d-42d4-9dab-11128d1b43fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1361 microversion: 2.1 time: 0.988184 Jul 26 20:15:12.069168 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2843/5597] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:11 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1361 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:12.079505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d44d716-78a7-4a85-a2f3-2c39168ff6cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:12.088345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d44d716-78a7-4a85-a2f3-2c39168ff6cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:12.106748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d44d716-78a7-4a85-a2f3-2c39168ff6cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:12.108969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d44d716-78a7-4a85-a2f3-2c39168ff6cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:12.110630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d44d716-78a7-4a85-a2f3-2c39168ff6cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:12.112663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d44d716-78a7-4a85-a2f3-2c39168ff6cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:12.124335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:12.946376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d44d716-78a7-4a85-a2f3-2c39168ff6cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:12.959436 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d44d716-78a7-4a85-a2f3-2c39168ff6cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1471 microversion: 2.1 time: 0.886816 Jul 26 20:15:12.961836 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2844/5598] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:12 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1471 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:13.072700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-83faf036-87d1-49ae-ad81-77372f6c415b req-88ae2da9-c9b8-4320-b110-fbddc1174731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f451a961-6f86-4496-a4a8-17d35625f345", "tag": "485b78f2-a796-4b62-b677-8a72329d48dc"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:13.096761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-83faf036-87d1-49ae-ad81-77372f6c415b req-88ae2da9-c9b8-4320-b110-fbddc1174731 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:13.097433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-83faf036-87d1-49ae-ad81-77372f6c415b req-88ae2da9-c9b8-4320-b110-fbddc1174731 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:13.155502 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-83faf036-87d1-49ae-ad81-77372f6c415b req-88ae2da9-c9b8-4320-b110-fbddc1174731 service nova] Creating event network-changed:485b78f2-a796-4b62-b677-8a72329d48dc for instance f451a961-6f86-4496-a4a8-17d35625f345 on n-h2-708768-8 Jul 26 20:15:13.180622 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-83faf036-87d1-49ae-ad81-77372f6c415b req-88ae2da9-c9b8-4320-b110-fbddc1174731 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111476 Jul 26 20:15:13.183409 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2845/5599] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:13.200096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3268a718-23fa-479f-9ce3-901bad1b3718 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:13.200813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3268a718-23fa-479f-9ce3-901bad1b3718 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:13.231055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3268a718-23fa-479f-9ce3-901bad1b3718 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:13.231507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3268a718-23fa-479f-9ce3-901bad1b3718 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:13.246299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3268a718-23fa-479f-9ce3-901bad1b3718 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:13.246526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3268a718-23fa-479f-9ce3-901bad1b3718 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:13.655397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3268a718-23fa-479f-9ce3-901bad1b3718 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:13.671434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3268a718-23fa-479f-9ce3-901bad1b3718 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1361 microversion: 2.1 time: 0.480509 Jul 26 20:15:13.673013 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2846/5600] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:13 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1361 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:13.988028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd95de37-28ff-43c0-882d-a81c80e28fbb tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:13.989017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd95de37-28ff-43c0-882d-a81c80e28fbb tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:13.999966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd95de37-28ff-43c0-882d-a81c80e28fbb tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:14.001313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd95de37-28ff-43c0-882d-a81c80e28fbb tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:14.003499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd95de37-28ff-43c0-882d-a81c80e28fbb tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:14.006498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd95de37-28ff-43c0-882d-a81c80e28fbb tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:14.066051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a158e219-efa4-4284-b70a-b5fef65867c2 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:14.091976 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a158e219-efa4-4284-b70a-b5fef65867c2 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 2.416556 Jul 26 20:15:14.093207 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2755/5601] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:11 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 2432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:14.408167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd95de37-28ff-43c0-882d-a81c80e28fbb tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:14.416631 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd95de37-28ff-43c0-882d-a81c80e28fbb tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1471 microversion: 2.1 time: 0.433701 Jul 26 20:15:14.417378 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2847/5602] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:13 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:15:14.675654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-01d3bbf0-c23b-4412-be09-710d62e9c154 req-7e28768b-0798-42e3-945b-30f6006a3bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d744cf68-c058-4eb6-8e8a-4e97b7a16f09", "name": "network-vif-plugged", "status": "completed", "tag": "6844a656-5cac-431f-b26b-fde6ee6b0c20"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:14.691219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-01d3bbf0-c23b-4412-be09-710d62e9c154 req-7e28768b-0798-42e3-945b-30f6006a3bda service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:14.699508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df927dc8-0929-417e-8e46-4e5006f11039 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:14.700603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df927dc8-0929-417e-8e46-4e5006f11039 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:14.704904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-01d3bbf0-c23b-4412-be09-710d62e9c154 req-7e28768b-0798-42e3-945b-30f6006a3bda service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:14.720840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df927dc8-0929-417e-8e46-4e5006f11039 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:14.723810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df927dc8-0929-417e-8e46-4e5006f11039 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:14.724872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df927dc8-0929-417e-8e46-4e5006f11039 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:14.725535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df927dc8-0929-417e-8e46-4e5006f11039 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:14.746429 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-01d3bbf0-c23b-4412-be09-710d62e9c154 req-7e28768b-0798-42e3-945b-30f6006a3bda service nova] Creating event network-vif-plugged:6844a656-5cac-431f-b26b-fde6ee6b0c20 for instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 on n-h2-708768-8 Jul 26 20:15:14.766369 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-01d3bbf0-c23b-4412-be09-710d62e9c154 req-7e28768b-0798-42e3-945b-30f6006a3bda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100669 Jul 26 20:15:14.770758 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2756/5603] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:15.105175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-df927dc8-0929-417e-8e46-4e5006f11039 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:15.115545 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df927dc8-0929-417e-8e46-4e5006f11039 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1361 microversion: 2.1 time: 0.422590 Jul 26 20:15:15.128533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0067a83a-0057-453d-b964-fff1100fc8a5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:15.128533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0067a83a-0057-453d-b964-fff1100fc8a5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:15.129803 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2848/5604] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:14 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:15.138853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0067a83a-0057-453d-b964-fff1100fc8a5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:15.139301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0067a83a-0057-453d-b964-fff1100fc8a5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:15.140115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0067a83a-0057-453d-b964-fff1100fc8a5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:15.140547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0067a83a-0057-453d-b964-fff1100fc8a5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:15.442299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5721730a-436d-4bc2-82f4-afe659d44e2b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:15.442993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5721730a-436d-4bc2-82f4-afe659d44e2b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:15.453521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5721730a-436d-4bc2-82f4-afe659d44e2b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:15.454232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5721730a-436d-4bc2-82f4-afe659d44e2b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:15.455463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5721730a-436d-4bc2-82f4-afe659d44e2b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:15.456213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5721730a-436d-4bc2-82f4-afe659d44e2b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:15.564255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0067a83a-0057-453d-b964-fff1100fc8a5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:15.586289 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0067a83a-0057-453d-b964-fff1100fc8a5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 0.474328 Jul 26 20:15:15.588218 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2757/5605] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:15 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:15:15.838004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5721730a-436d-4bc2-82f4-afe659d44e2b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:15.847394 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5721730a-436d-4bc2-82f4-afe659d44e2b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1471 microversion: 2.1 time: 0.411729 Jul 26 20:15:15.853298 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2849/5606] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:15 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:16.142256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8791cbe6-9d90-4396-826e-d5926f844d8a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:16.146859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8791cbe6-9d90-4396-826e-d5926f844d8a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:16.161169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8791cbe6-9d90-4396-826e-d5926f844d8a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:16.161958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8791cbe6-9d90-4396-826e-d5926f844d8a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:16.163209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8791cbe6-9d90-4396-826e-d5926f844d8a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:16.164276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8791cbe6-9d90-4396-826e-d5926f844d8a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:16.607513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36b04a99-3399-4485-854a-1fa31661de0f tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:16.608292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-36b04a99-3399-4485-854a-1fa31661de0f tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:16.622292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36b04a99-3399-4485-854a-1fa31661de0f tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:16.622749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36b04a99-3399-4485-854a-1fa31661de0f tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:16.623549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36b04a99-3399-4485-854a-1fa31661de0f tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:16.624022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36b04a99-3399-4485-854a-1fa31661de0f tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:16.910207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-36b04a99-3399-4485-854a-1fa31661de0f tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:16.922564 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36b04a99-3399-4485-854a-1fa31661de0f tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 0.319676 Jul 26 20:15:16.936634 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2850/5607] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:16 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:16.947356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d3f1c79-71df-44ef-a3ef-cbcfbc0512d8 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:16.948292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d3f1c79-71df-44ef-a3ef-cbcfbc0512d8 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:16.955464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d3f1c79-71df-44ef-a3ef-cbcfbc0512d8 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:16.956033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d3f1c79-71df-44ef-a3ef-cbcfbc0512d8 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:16.957102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d3f1c79-71df-44ef-a3ef-cbcfbc0512d8 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:16.957591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d3f1c79-71df-44ef-a3ef-cbcfbc0512d8 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:17.172059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d3f1c79-71df-44ef-a3ef-cbcfbc0512d8 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:17.185432 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d3f1c79-71df-44ef-a3ef-cbcfbc0512d8 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1471 microversion: 2.1 time: 0.242322 Jul 26 20:15:17.186872 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2851/5608] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:16 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1471 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:17.402099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8791cbe6-9d90-4396-826e-d5926f844d8a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:17.426312 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8791cbe6-9d90-4396-826e-d5926f844d8a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1361 microversion: 2.1 time: 1.289377 Jul 26 20:15:17.442103 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2758/5609] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:16 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1361 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:17.951063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc593852-dbc6-4c02-9027-5442a4299692 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:17.952116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bc593852-dbc6-4c02-9027-5442a4299692 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:17.961405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc593852-dbc6-4c02-9027-5442a4299692 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:17.962241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc593852-dbc6-4c02-9027-5442a4299692 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:17.964303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc593852-dbc6-4c02-9027-5442a4299692 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:17.965614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc593852-dbc6-4c02-9027-5442a4299692 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:18.211917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d253729-fc83-46f1-ada5-649b67effc1b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:18.216121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1d253729-fc83-46f1-ada5-649b67effc1b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:18.225048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d253729-fc83-46f1-ada5-649b67effc1b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:18.225732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d253729-fc83-46f1-ada5-649b67effc1b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:18.226930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d253729-fc83-46f1-ada5-649b67effc1b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:18.227592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d253729-fc83-46f1-ada5-649b67effc1b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:18.260752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc593852-dbc6-4c02-9027-5442a4299692 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:18.272746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc593852-dbc6-4c02-9027-5442a4299692 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 0.327943 Jul 26 20:15:18.274104 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2852/5610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:17 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:18.452862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-630f476b-3300-4794-8261-4c67d383fbeb tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:18.453549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-630f476b-3300-4794-8261-4c67d383fbeb tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:18.468532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630f476b-3300-4794-8261-4c67d383fbeb tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:18.469321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630f476b-3300-4794-8261-4c67d383fbeb tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:18.470612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630f476b-3300-4794-8261-4c67d383fbeb tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:18.472887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-630f476b-3300-4794-8261-4c67d383fbeb tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:18.614223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1d253729-fc83-46f1-ada5-649b67effc1b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:18.631102 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1d253729-fc83-46f1-ada5-649b67effc1b tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1471 microversion: 2.1 time: 0.427028 Jul 26 20:15:18.644407 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2759/5611] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:18 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:18.651560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-12e397a0-ba6f-4c6f-8cd8-4b4c1379c1ac req-aa25038d-b3fc-4810-a232-ce8354b55695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f451a961-6f86-4496-a4a8-17d35625f345", "name": "network-vif-plugged", "status": "completed", "tag": "485b78f2-a796-4b62-b677-8a72329d48dc"}, {"server_uuid": "6b1bc551-920e-4468-bead-13d6a4c0e44f", "name": "network-vif-plugged", "status": "completed", "tag": "399dd489-8b51-4146-af7c-61a26980789d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:18.696061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-12e397a0-ba6f-4c6f-8cd8-4b4c1379c1ac req-aa25038d-b3fc-4810-a232-ce8354b55695 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:18.699040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-12e397a0-ba6f-4c6f-8cd8-4b4c1379c1ac req-aa25038d-b3fc-4810-a232-ce8354b55695 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:18.749498 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-12e397a0-ba6f-4c6f-8cd8-4b4c1379c1ac req-aa25038d-b3fc-4810-a232-ce8354b55695 service nova] Creating event network-vif-plugged:485b78f2-a796-4b62-b677-8a72329d48dc for instance f451a961-6f86-4496-a4a8-17d35625f345 on n-h2-708768-8 Jul 26 20:15:18.751274 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-12e397a0-ba6f-4c6f-8cd8-4b4c1379c1ac req-aa25038d-b3fc-4810-a232-ce8354b55695 service nova] Creating event network-vif-plugged:399dd489-8b51-4146-af7c-61a26980789d for instance 6b1bc551-920e-4468-bead-13d6a4c0e44f on n-h1-708768-8 Jul 26 20:15:18.796438 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-12e397a0-ba6f-4c6f-8cd8-4b4c1379c1ac req-aa25038d-b3fc-4810-a232-ce8354b55695 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.150259 Jul 26 20:15:18.803126 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2760/5612] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:19.116864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-630f476b-3300-4794-8261-4c67d383fbeb tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:19.133946 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-630f476b-3300-4794-8261-4c67d383fbeb tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1546 microversion: 2.1 time: 0.688395 Jul 26 20:15:19.136980 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2853/5613] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:18 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1546 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:15:19.157670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bdc910f0-7e53-463b-b8f3-ad7ef5f7555b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:19.158254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bdc910f0-7e53-463b-b8f3-ad7ef5f7555b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:19.169522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdc910f0-7e53-463b-b8f3-ad7ef5f7555b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:19.169982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdc910f0-7e53-463b-b8f3-ad7ef5f7555b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:19.170768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdc910f0-7e53-463b-b8f3-ad7ef5f7555b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:19.171212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bdc910f0-7e53-463b-b8f3-ad7ef5f7555b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:19.296429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7b837ab6-7ba4-41b3-a709-9b84b4a6b2f0 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:19.297733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7b837ab6-7ba4-41b3-a709-9b84b4a6b2f0 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:19.307546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b837ab6-7ba4-41b3-a709-9b84b4a6b2f0 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:19.308512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b837ab6-7ba4-41b3-a709-9b84b4a6b2f0 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:19.309780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b837ab6-7ba4-41b3-a709-9b84b4a6b2f0 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:19.310457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b837ab6-7ba4-41b3-a709-9b84b4a6b2f0 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:19.722994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7b837ab6-7ba4-41b3-a709-9b84b4a6b2f0 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:19.734557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7b837ab6-7ba4-41b3-a709-9b84b4a6b2f0 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1426 microversion: 2.1 time: 0.444039 Jul 26 20:15:19.750028 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2854/5614] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:19 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1426 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:15:19.755485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2e7c3865-b270-4300-a113-25bd656e298e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:19.756346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2e7c3865-b270-4300-a113-25bd656e298e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:19.763913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e7c3865-b270-4300-a113-25bd656e298e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:19.764630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e7c3865-b270-4300-a113-25bd656e298e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:19.765601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e7c3865-b270-4300-a113-25bd656e298e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:19.766235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e7c3865-b270-4300-a113-25bd656e298e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:19.871833 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bdc910f0-7e53-463b-b8f3-ad7ef5f7555b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.718381 Jul 26 20:15:19.872763 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2761/5615] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:15:19 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/os-interface => generated 285 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:20.132185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2e7c3865-b270-4300-a113-25bd656e298e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:20.142941 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2e7c3865-b270-4300-a113-25bd656e298e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1471 microversion: 2.1 time: 0.390804 Jul 26 20:15:20.143945 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2855/5616] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:19 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:20.757011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-435a24c9-f22d-41e2-8f89-08a5e0627f94 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:20.759736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-435a24c9-f22d-41e2-8f89-08a5e0627f94 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:20.778671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-435a24c9-f22d-41e2-8f89-08a5e0627f94 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:20.779402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-435a24c9-f22d-41e2-8f89-08a5e0627f94 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:20.781412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-435a24c9-f22d-41e2-8f89-08a5e0627f94 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:20.782044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-435a24c9-f22d-41e2-8f89-08a5e0627f94 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:21.166839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74b656ac-c080-458e-802d-1481fee2c414 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:21.167559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74b656ac-c080-458e-802d-1481fee2c414 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:21.190042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74b656ac-c080-458e-802d-1481fee2c414 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:21.190984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74b656ac-c080-458e-802d-1481fee2c414 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:21.192777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74b656ac-c080-458e-802d-1481fee2c414 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:21.194523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74b656ac-c080-458e-802d-1481fee2c414 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:21.390659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-435a24c9-f22d-41e2-8f89-08a5e0627f94 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:21.400833 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-435a24c9-f22d-41e2-8f89-08a5e0627f94 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1606 microversion: 2.1 time: 0.648041 Jul 26 20:15:21.422209 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2762/5617] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:20 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1606 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:21.428424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0f8e673a-adb8-4e1e-aeb0-20dff901bc2a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:21.429645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0f8e673a-adb8-4e1e-aeb0-20dff901bc2a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:21.436969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f8e673a-adb8-4e1e-aeb0-20dff901bc2a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:21.437776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f8e673a-adb8-4e1e-aeb0-20dff901bc2a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:21.438804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f8e673a-adb8-4e1e-aeb0-20dff901bc2a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:21.439464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f8e673a-adb8-4e1e-aeb0-20dff901bc2a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:21.444800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-74b656ac-c080-458e-802d-1481fee2c414 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:21.452945 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74b656ac-c080-458e-802d-1481fee2c414 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1642 microversion: 2.1 time: 0.291891 Jul 26 20:15:21.453529 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2856/5618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:21 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1642 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:21.478134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6e47ab65-430d-48a2-ac4e-804740d6fb8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:21.478755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6e47ab65-430d-48a2-ac4e-804740d6fb8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:21.493285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e47ab65-430d-48a2-ac4e-804740d6fb8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:21.493736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e47ab65-430d-48a2-ac4e-804740d6fb8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:21.494513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e47ab65-430d-48a2-ac4e-804740d6fb8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:21.495501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e47ab65-430d-48a2-ac4e-804740d6fb8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:21.693666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6e47ab65-430d-48a2-ac4e-804740d6fb8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:21.704467 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6e47ab65-430d-48a2-ac4e-804740d6fb8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1642 microversion: 2.1 time: 0.230164 Jul 26 20:15:21.706373 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2857/5619] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:21 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1642 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:21.727452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-953be645-4560-450c-adf0-c5077bf4052a tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:21.728273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-953be645-4560-450c-adf0-c5077bf4052a tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:21.736692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-953be645-4560-450c-adf0-c5077bf4052a tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:21.737410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-953be645-4560-450c-adf0-c5077bf4052a tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:21.738434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-953be645-4560-450c-adf0-c5077bf4052a tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:21.739035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-953be645-4560-450c-adf0-c5077bf4052a tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:22.163489 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-953be645-4560-450c-adf0-c5077bf4052a tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1793 microversion: 2.1 time: 0.436057 Jul 26 20:15:22.164774 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2858/5620] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:21 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1793 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:22.682110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0f8e673a-adb8-4e1e-aeb0-20dff901bc2a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:22.694121 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0f8e673a-adb8-4e1e-aeb0-20dff901bc2a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1606 microversion: 2.1 time: 1.270179 Jul 26 20:15:22.694714 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2763/5621] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:21 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1606 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:22.719962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d88c2b7-7c8e-4b34-a0c8-241e351c271d tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:22.721363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d88c2b7-7c8e-4b34-a0c8-241e351c271d tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:22.736198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d88c2b7-7c8e-4b34-a0c8-241e351c271d tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:22.738436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d88c2b7-7c8e-4b34-a0c8-241e351c271d tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:22.740104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d88c2b7-7c8e-4b34-a0c8-241e351c271d tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:22.741788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d88c2b7-7c8e-4b34-a0c8-241e351c271d tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:23.047880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6d88c2b7-7c8e-4b34-a0c8-241e351c271d tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:23.058663 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d88c2b7-7c8e-4b34-a0c8-241e351c271d tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1606 microversion: 2.1 time: 0.343024 Jul 26 20:15:23.076907 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2859/5622] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:22 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1606 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:23.851856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5cba40f0-7eec-4a34-b260-3b2666fae483 req-413a855e-5a01-42a0-a9a1-1e324d845024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d744cf68-c058-4eb6-8e8a-4e97b7a16f09", "tag": "6844a656-5cac-431f-b26b-fde6ee6b0c20"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:23.877232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cba40f0-7eec-4a34-b260-3b2666fae483 req-413a855e-5a01-42a0-a9a1-1e324d845024 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:23.877675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cba40f0-7eec-4a34-b260-3b2666fae483 req-413a855e-5a01-42a0-a9a1-1e324d845024 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:23.916416 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5cba40f0-7eec-4a34-b260-3b2666fae483 req-413a855e-5a01-42a0-a9a1-1e324d845024 service nova] Creating event network-changed:6844a656-5cac-431f-b26b-fde6ee6b0c20 for instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 on n-h2-708768-8 Jul 26 20:15:23.928317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5cba40f0-7eec-4a34-b260-3b2666fae483 req-413a855e-5a01-42a0-a9a1-1e324d845024 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083166 Jul 26 20:15:23.928935 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2764/5623] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:27.270772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-300119819", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:27.371683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] validate_networks() for [('83f9ae95-37d0-4afa-aa49-ab2e266007e5', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:15:29.123834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:15:29.124445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:15:29.124717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:15:29.125120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:15:29.125727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:15:29.145548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:29.150576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:29.152525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:29.153151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:29.207212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Getting quotas for project a4c24400e9b14379a6df5970e9d68002. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:15:29.217351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Getting quotas for user 40681f18e62a405a87481253fbe843bd and project a4c24400e9b14379a6df5970e9d68002. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:15:29.245221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:15:29.254612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:15:29.380238 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d306b35e-3656-4d09-af74-8502e208c621 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.411428 Jul 26 20:15:29.395327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37dffbc6-1d7f-4938-a45e-e12b0c5f6593 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:29.396670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37dffbc6-1d7f-4938-a45e-e12b0c5f6593 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:29.399951 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2860/5624] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:15:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:15:29.402617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:29.474766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-37dffbc6-1d7f-4938-a45e-e12b0c5f6593 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:29.486457 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37dffbc6-1d7f-4938-a45e-e12b0c5f6593 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1213 microversion: 2.1 time: 0.096624 Jul 26 20:15:29.499260 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2765/5625] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:29 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:30.525573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-750901a5-f7ad-4930-9380-c034b042ddf4 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:30.526405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-750901a5-f7ad-4930-9380-c034b042ddf4 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:30.548924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-fb047f8d-c511-4a76-ad7d-cac772a29a43 req-2d1089b6-979d-4b93-be11-a0f9e7d666cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f451a961-6f86-4496-a4a8-17d35625f345", "tag": "485b78f2-a796-4b62-b677-8a72329d48dc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:30.553170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-750901a5-f7ad-4930-9380-c034b042ddf4 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:30.553830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-750901a5-f7ad-4930-9380-c034b042ddf4 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:30.555191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-750901a5-f7ad-4930-9380-c034b042ddf4 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:30.558482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-750901a5-f7ad-4930-9380-c034b042ddf4 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:30.596244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fb047f8d-c511-4a76-ad7d-cac772a29a43 req-2d1089b6-979d-4b93-be11-a0f9e7d666cb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:30.601453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fb047f8d-c511-4a76-ad7d-cac772a29a43 req-2d1089b6-979d-4b93-be11-a0f9e7d666cb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:30.633337 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-fb047f8d-c511-4a76-ad7d-cac772a29a43 req-2d1089b6-979d-4b93-be11-a0f9e7d666cb service nova] Creating event network-changed:485b78f2-a796-4b62-b677-8a72329d48dc for instance f451a961-6f86-4496-a4a8-17d35625f345 on n-h2-708768-8 Jul 26 20:15:30.659291 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-fb047f8d-c511-4a76-ad7d-cac772a29a43 req-2d1089b6-979d-4b93-be11-a0f9e7d666cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116331 Jul 26 20:15:30.665857 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2766/5626] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:15:30.890278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-750901a5-f7ad-4930-9380-c034b042ddf4 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:30.904752 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-750901a5-f7ad-4930-9380-c034b042ddf4 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1209 microversion: 2.1 time: 0.383731 Jul 26 20:15:30.908814 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2861/5627] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:30 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1209 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:31.934459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bfcd2c6a-fb14-4631-b43f-a0787861e822 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:31.936595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bfcd2c6a-fb14-4631-b43f-a0787861e822 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:31.946414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfcd2c6a-fb14-4631-b43f-a0787861e822 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:31.946865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfcd2c6a-fb14-4631-b43f-a0787861e822 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:31.947666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfcd2c6a-fb14-4631-b43f-a0787861e822 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:31.948341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfcd2c6a-fb14-4631-b43f-a0787861e822 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:32.016418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:32.116989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bfcd2c6a-fb14-4631-b43f-a0787861e822 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:32.126058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bfcd2c6a-fb14-4631-b43f-a0787861e822 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1271 microversion: 2.1 time: 0.199303 Jul 26 20:15:32.126674 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2767/5628] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:31 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:32.902658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-da53f215-5080-49b2-ac5d-cbd509312c64 req-94121561-18ea-4dca-8605-e1c8e4d4e570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1bc551-920e-4468-bead-13d6a4c0e44f", "tag": "399dd489-8b51-4146-af7c-61a26980789d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:32.948405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-da53f215-5080-49b2-ac5d-cbd509312c64 req-94121561-18ea-4dca-8605-e1c8e4d4e570 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:32.951011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-da53f215-5080-49b2-ac5d-cbd509312c64 req-94121561-18ea-4dca-8605-e1c8e4d4e570 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:32.969003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:32.990195 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-da53f215-5080-49b2-ac5d-cbd509312c64 req-94121561-18ea-4dca-8605-e1c8e4d4e570 service nova] Creating event network-changed:399dd489-8b51-4146-af7c-61a26980789d for instance 6b1bc551-920e-4468-bead-13d6a4c0e44f on n-h1-708768-8 Jul 26 20:15:33.009189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-da53f215-5080-49b2-ac5d-cbd509312c64 req-94121561-18ea-4dca-8605-e1c8e4d4e570 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116036 Jul 26 20:15:33.009808 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2862/5629] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:15:33.150462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1da700ab-94e0-46cc-85ad-648b5ea67417 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:33.151240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1da700ab-94e0-46cc-85ad-648b5ea67417 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:33.176321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1da700ab-94e0-46cc-85ad-648b5ea67417 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:33.176782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1da700ab-94e0-46cc-85ad-648b5ea67417 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:33.177856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1da700ab-94e0-46cc-85ad-648b5ea67417 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:33.178287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1da700ab-94e0-46cc-85ad-648b5ea67417 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:33.586940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1da700ab-94e0-46cc-85ad-648b5ea67417 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:33.600476 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1da700ab-94e0-46cc-85ad-648b5ea67417 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1271 microversion: 2.1 time: 0.453880 Jul 26 20:15:33.605427 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2768/5630] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:33 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1271 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:34.633596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-261c8b5e-fc9d-4d96-922c-7b3478695ff9 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:34.635093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-261c8b5e-fc9d-4d96-922c-7b3478695ff9 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:34.693023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-261c8b5e-fc9d-4d96-922c-7b3478695ff9 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:34.693638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-261c8b5e-fc9d-4d96-922c-7b3478695ff9 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:34.701108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-261c8b5e-fc9d-4d96-922c-7b3478695ff9 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:34.701904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-261c8b5e-fc9d-4d96-922c-7b3478695ff9 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:35.209860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-261c8b5e-fc9d-4d96-922c-7b3478695ff9 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:35.242668 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-261c8b5e-fc9d-4d96-922c-7b3478695ff9 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1313 microversion: 2.1 time: 0.611343 Jul 26 20:15:35.246036 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2863/5631] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:34 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:35.640578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bf2cb9af-c327-4eb6-8c9a-a47d5cc2c4b9 req-0eae51fe-c54e-4b35-b01e-8faf60804940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d", "tag": "a1fc5856-305e-424c-8d98-0c3d9a008755"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:35.657736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bf2cb9af-c327-4eb6-8c9a-a47d5cc2c4b9 req-0eae51fe-c54e-4b35-b01e-8faf60804940 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:35.662467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bf2cb9af-c327-4eb6-8c9a-a47d5cc2c4b9 req-0eae51fe-c54e-4b35-b01e-8faf60804940 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:35.693898 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bf2cb9af-c327-4eb6-8c9a-a47d5cc2c4b9 req-0eae51fe-c54e-4b35-b01e-8faf60804940 service nova] Creating event network-changed:a1fc5856-305e-424c-8d98-0c3d9a008755 for instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d on n-h1-708768-8 Jul 26 20:15:35.704906 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bf2cb9af-c327-4eb6-8c9a-a47d5cc2c4b9 req-0eae51fe-c54e-4b35-b01e-8faf60804940 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075433 Jul 26 20:15:35.711407 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2769/5632] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:36.267935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fdc36c41-f6aa-42e0-afea-dedb260d65d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:36.269171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fdc36c41-f6aa-42e0-afea-dedb260d65d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:36.280647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdc36c41-f6aa-42e0-afea-dedb260d65d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:36.282656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdc36c41-f6aa-42e0-afea-dedb260d65d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:36.283889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdc36c41-f6aa-42e0-afea-dedb260d65d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:36.284544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdc36c41-f6aa-42e0-afea-dedb260d65d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:36.667321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fdc36c41-f6aa-42e0-afea-dedb260d65d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:36.680672 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fdc36c41-f6aa-42e0-afea-dedb260d65d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1313 microversion: 2.1 time: 0.416657 Jul 26 20:15:36.681591 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2864/5633] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:36 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:37.704073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-67ab698e-5a3a-48c9-9b00-3ac4c6465862 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:37.705614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-67ab698e-5a3a-48c9-9b00-3ac4c6465862 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:37.716704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67ab698e-5a3a-48c9-9b00-3ac4c6465862 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:37.717360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67ab698e-5a3a-48c9-9b00-3ac4c6465862 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:37.719052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67ab698e-5a3a-48c9-9b00-3ac4c6465862 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:37.720985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67ab698e-5a3a-48c9-9b00-3ac4c6465862 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:38.312849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-67ab698e-5a3a-48c9-9b00-3ac4c6465862 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:38.320702 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-67ab698e-5a3a-48c9-9b00-3ac4c6465862 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1313 microversion: 2.1 time: 0.621857 Jul 26 20:15:38.332283 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2770/5634] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:37 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:39.344215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-571f10fd-80b3-4535-9516-7d24414fa4c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:39.346189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-571f10fd-80b3-4535-9516-7d24414fa4c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:39.359740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:39.360822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:39.389916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-571f10fd-80b3-4535-9516-7d24414fa4c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:39.394152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-571f10fd-80b3-4535-9516-7d24414fa4c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:39.408953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-571f10fd-80b3-4535-9516-7d24414fa4c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:39.410372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-571f10fd-80b3-4535-9516-7d24414fa4c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:40.225511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-571f10fd-80b3-4535-9516-7d24414fa4c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:40.234481 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-571f10fd-80b3-4535-9516-7d24414fa4c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1313 microversion: 2.1 time: 0.895820 Jul 26 20:15:40.236360 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2865/5635] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:39 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1313 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:40.898150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-77f25c07-3b63-4823-ba13-ba55211e47e9 req-e3df7490-4bb7-449b-a2f9-b1beb1026f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d", "name": "network-vif-plugged", "status": "completed", "tag": "a1fc5856-305e-424c-8d98-0c3d9a008755"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:40.918611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:40.924557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-77f25c07-3b63-4823-ba13-ba55211e47e9 req-e3df7490-4bb7-449b-a2f9-b1beb1026f9e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:40.925126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-77f25c07-3b63-4823-ba13-ba55211e47e9 req-e3df7490-4bb7-449b-a2f9-b1beb1026f9e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:40.954695 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-77f25c07-3b63-4823-ba13-ba55211e47e9 req-e3df7490-4bb7-449b-a2f9-b1beb1026f9e service nova] Creating event network-vif-plugged:a1fc5856-305e-424c-8d98-0c3d9a008755 for instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d on n-h1-708768-8 Jul 26 20:15:40.969222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-77f25c07-3b63-4823-ba13-ba55211e47e9 req-e3df7490-4bb7-449b-a2f9-b1beb1026f9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076231 Jul 26 20:15:40.972925 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2771/5636] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:41.266252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-59bf1c54-e9ce-4228-88ed-398a8a0d973f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:41.266952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-59bf1c54-e9ce-4228-88ed-398a8a0d973f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:41.288387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:41.290792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59bf1c54-e9ce-4228-88ed-398a8a0d973f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:41.292455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59bf1c54-e9ce-4228-88ed-398a8a0d973f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:41.297911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59bf1c54-e9ce-4228-88ed-398a8a0d973f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:41.298429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-59bf1c54-e9ce-4228-88ed-398a8a0d973f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:41.523240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-59bf1c54-e9ce-4228-88ed-398a8a0d973f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:41.532154 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-59bf1c54-e9ce-4228-88ed-398a8a0d973f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1313 microversion: 2.1 time: 0.275206 Jul 26 20:15:41.532989 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2866/5637] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:41 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:42.556420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-52b0dddf-194a-49b9-887d-2247e633bfa0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:42.558026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-52b0dddf-194a-49b9-887d-2247e633bfa0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:42.566096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52b0dddf-194a-49b9-887d-2247e633bfa0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:42.567302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52b0dddf-194a-49b9-887d-2247e633bfa0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:42.568298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52b0dddf-194a-49b9-887d-2247e633bfa0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:42.568905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52b0dddf-194a-49b9-887d-2247e633bfa0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:42.735111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-52b0dddf-194a-49b9-887d-2247e633bfa0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:42.743575 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-52b0dddf-194a-49b9-887d-2247e633bfa0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1498 microversion: 2.1 time: 0.193434 Jul 26 20:15:42.744529 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2772/5638] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:42 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:42.766661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-448a577e-066b-43ec-a088-5eade7263faa tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:42.769912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-448a577e-066b-43ec-a088-5eade7263faa tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:42.778224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-448a577e-066b-43ec-a088-5eade7263faa tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:42.778835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-448a577e-066b-43ec-a088-5eade7263faa tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:42.779954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-448a577e-066b-43ec-a088-5eade7263faa tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:42.780505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-448a577e-066b-43ec-a088-5eade7263faa tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:42.831318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-448a577e-066b-43ec-a088-5eade7263faa tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lazy-loading 'flavor' on Instance uuid 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:15:42.955215 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-448a577e-066b-43ec-a088-5eade7263faa tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "POST /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d/action" status: 200 len: 32 microversion: 2.1 time: 0.192261 Jul 26 20:15:42.966980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00f92fcf-14cb-4a66-9773-fa363995f49b tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:42.967634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00f92fcf-14cb-4a66-9773-fa363995f49b tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:42.970739 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2867/5639] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:15:42 2022] POST /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:15:42.974358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f92fcf-14cb-4a66-9773-fa363995f49b tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:42.975030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f92fcf-14cb-4a66-9773-fa363995f49b tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:42.976344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f92fcf-14cb-4a66-9773-fa363995f49b tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:42.976803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f92fcf-14cb-4a66-9773-fa363995f49b tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:43.001409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2e78bdfc-9e92-4563-9b84-0491fc02c199 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:43.001884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2e78bdfc-9e92-4563-9b84-0491fc02c199 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:43.012570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e78bdfc-9e92-4563-9b84-0491fc02c199 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:43.013265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e78bdfc-9e92-4563-9b84-0491fc02c199 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:43.014226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e78bdfc-9e92-4563-9b84-0491fc02c199 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:43.015096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e78bdfc-9e92-4563-9b84-0491fc02c199 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:43.126743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-2e78bdfc-9e92-4563-9b84-0491fc02c199 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lazy-loading 'services' on Instance uuid 558b7f2e-2747-41e5-abb9-f2593366c5b0 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:15:43.213289 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2e78bdfc-9e92-4563-9b84-0491fc02c199 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0/os-volume_attachments/3b3d889c-b954-4983-a78e-7ba7634a1844" status: 202 len: 0 microversion: 2.1 time: 0.216419 Jul 26 20:15:43.218549 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2868/5640] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:15:42 2022] DELETE /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0/os-volume_attachments/3b3d889c-b954-4983-a78e-7ba7634a1844 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:15:43.426016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00f92fcf-14cb-4a66-9773-fa363995f49b tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:43.435913 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00f92fcf-14cb-4a66-9773-fa363995f49b tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.473730 Jul 26 20:15:43.440285 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2773/5641] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:42 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:44.477118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88eeffcf-af34-4172-abb0-9302a0b79b64 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:44.477842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-88eeffcf-af34-4172-abb0-9302a0b79b64 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:44.489405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88eeffcf-af34-4172-abb0-9302a0b79b64 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:44.490474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88eeffcf-af34-4172-abb0-9302a0b79b64 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:44.492342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88eeffcf-af34-4172-abb0-9302a0b79b64 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:44.493012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88eeffcf-af34-4172-abb0-9302a0b79b64 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:44.712431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-88eeffcf-af34-4172-abb0-9302a0b79b64 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:44.722774 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88eeffcf-af34-4172-abb0-9302a0b79b64 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.268239 Jul 26 20:15:44.740173 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2869/5642] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:44 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:45.745572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-650fabf2-7b6c-49df-b272-d5bc8f52855a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:45.747195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-650fabf2-7b6c-49df-b272-d5bc8f52855a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:45.754577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-650fabf2-7b6c-49df-b272-d5bc8f52855a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:45.755356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-650fabf2-7b6c-49df-b272-d5bc8f52855a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:45.756416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-650fabf2-7b6c-49df-b272-d5bc8f52855a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:45.757329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-650fabf2-7b6c-49df-b272-d5bc8f52855a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:45.921091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-650fabf2-7b6c-49df-b272-d5bc8f52855a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:45.951117 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-650fabf2-7b6c-49df-b272-d5bc8f52855a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.208505 Jul 26 20:15:45.963650 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2774/5643] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:45 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:46.976278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f06be319-69e6-4853-8a4e-ea9e9912ff9c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:46.977478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f06be319-69e6-4853-8a4e-ea9e9912ff9c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:46.987255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f06be319-69e6-4853-8a4e-ea9e9912ff9c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:46.987955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f06be319-69e6-4853-8a4e-ea9e9912ff9c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:46.989515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f06be319-69e6-4853-8a4e-ea9e9912ff9c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:46.990253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f06be319-69e6-4853-8a4e-ea9e9912ff9c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:47.162560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f06be319-69e6-4853-8a4e-ea9e9912ff9c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:47.172741 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f06be319-69e6-4853-8a4e-ea9e9912ff9c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.202298 Jul 26 20:15:47.173915 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2870/5644] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:46 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:48.199225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-26212134-b886-411d-bd6d-13fd7af321d0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:48.199893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-26212134-b886-411d-bd6d-13fd7af321d0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:48.215002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26212134-b886-411d-bd6d-13fd7af321d0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:48.215997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26212134-b886-411d-bd6d-13fd7af321d0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:48.216468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26212134-b886-411d-bd6d-13fd7af321d0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:48.217379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-26212134-b886-411d-bd6d-13fd7af321d0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:48.467446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-26212134-b886-411d-bd6d-13fd7af321d0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:48.478136 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-26212134-b886-411d-bd6d-13fd7af321d0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.287480 Jul 26 20:15:48.492830 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2775/5645] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:48 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:49.505992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df55ef4e-cec3-4f77-835e-4aeab4426116 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:49.507746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df55ef4e-cec3-4f77-835e-4aeab4426116 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:49.519781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df55ef4e-cec3-4f77-835e-4aeab4426116 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:49.520653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df55ef4e-cec3-4f77-835e-4aeab4426116 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:49.522430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df55ef4e-cec3-4f77-835e-4aeab4426116 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:49.522988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df55ef4e-cec3-4f77-835e-4aeab4426116 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:49.698580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-df55ef4e-cec3-4f77-835e-4aeab4426116 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:49.707632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df55ef4e-cec3-4f77-835e-4aeab4426116 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.208471 Jul 26 20:15:49.708214 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2871/5646] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:49 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:49.899254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de6642d8-7451-4a0f-8ba4-05ee9d874442 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:49.900033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de6642d8-7451-4a0f-8ba4-05ee9d874442 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:49.908248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de6642d8-7451-4a0f-8ba4-05ee9d874442 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:49.908968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de6642d8-7451-4a0f-8ba4-05ee9d874442 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:49.909914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de6642d8-7451-4a0f-8ba4-05ee9d874442 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:49.910518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de6642d8-7451-4a0f-8ba4-05ee9d874442 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:49.953649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de6642d8-7451-4a0f-8ba4-05ee9d874442 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:15:50.098454 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de6642d8-7451-4a0f-8ba4-05ee9d874442 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 204 len: 0 microversion: 2.1 time: 0.206100 Jul 26 20:15:50.098874 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2776/5647] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:15:49 2022] DELETE /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:15:50.107704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5989195c-b1d2-4ad1-b066-99f5c60c7fb9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:50.109966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5989195c-b1d2-4ad1-b066-99f5c60c7fb9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:50.121217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5989195c-b1d2-4ad1-b066-99f5c60c7fb9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:50.122239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5989195c-b1d2-4ad1-b066-99f5c60c7fb9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:50.124864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5989195c-b1d2-4ad1-b066-99f5c60c7fb9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:50.125320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5989195c-b1d2-4ad1-b066-99f5c60c7fb9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:50.318473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5989195c-b1d2-4ad1-b066-99f5c60c7fb9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:50.328854 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5989195c-b1d2-4ad1-b066-99f5c60c7fb9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1512 microversion: 2.1 time: 0.225279 Jul 26 20:15:50.329463 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2872/5648] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:50 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:50.733034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d7e0e42-8f50-41af-ae70-d2c4cbc6f575 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:50.733744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d7e0e42-8f50-41af-ae70-d2c4cbc6f575 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:50.742856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7e0e42-8f50-41af-ae70-d2c4cbc6f575 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:50.743528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7e0e42-8f50-41af-ae70-d2c4cbc6f575 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:50.744627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7e0e42-8f50-41af-ae70-d2c4cbc6f575 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:50.745470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d7e0e42-8f50-41af-ae70-d2c4cbc6f575 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:50.927376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d7e0e42-8f50-41af-ae70-d2c4cbc6f575 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:50.942998 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d7e0e42-8f50-41af-ae70-d2c4cbc6f575 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.214898 Jul 26 20:15:50.955867 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2777/5649] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:50 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:51.354637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f10fd6a8-5cfa-4c10-85d6-7062910ba10a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:51.356090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f10fd6a8-5cfa-4c10-85d6-7062910ba10a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:51.365224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f10fd6a8-5cfa-4c10-85d6-7062910ba10a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:51.365852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f10fd6a8-5cfa-4c10-85d6-7062910ba10a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:51.366950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f10fd6a8-5cfa-4c10-85d6-7062910ba10a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:51.367234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f10fd6a8-5cfa-4c10-85d6-7062910ba10a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:51.610931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f10fd6a8-5cfa-4c10-85d6-7062910ba10a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:51.621987 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f10fd6a8-5cfa-4c10-85d6-7062910ba10a tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1512 microversion: 2.1 time: 0.271400 Jul 26 20:15:51.623038 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2873/5650] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:51 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:51.986928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e5ea507-fa80-4c66-a5f3-111a316d8deb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:51.988240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e5ea507-fa80-4c66-a5f3-111a316d8deb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:51.996492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e5ea507-fa80-4c66-a5f3-111a316d8deb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:51.997188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e5ea507-fa80-4c66-a5f3-111a316d8deb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:51.998118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e5ea507-fa80-4c66-a5f3-111a316d8deb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:51.998709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e5ea507-fa80-4c66-a5f3-111a316d8deb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:52.235799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e5ea507-fa80-4c66-a5f3-111a316d8deb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:52.244167 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e5ea507-fa80-4c66-a5f3-111a316d8deb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.272433 Jul 26 20:15:52.245405 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2778/5651] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:51 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:52.440886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-34c34c34-d9dc-4b4a-bce3-853919916aaa req-630862a2-128a-409a-b3fb-fb90f453311f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558b7f2e-2747-41e5-abb9-f2593366c5b0", "name": "network-vif-deleted", "tag": "e78d8958-a2f8-4ded-b330-20bf6ca8d76d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:52.460265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-34c34c34-d9dc-4b4a-bce3-853919916aaa req-630862a2-128a-409a-b3fb-fb90f453311f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:52.461067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-34c34c34-d9dc-4b4a-bce3-853919916aaa req-630862a2-128a-409a-b3fb-fb90f453311f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:52.475990 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-34c34c34-d9dc-4b4a-bce3-853919916aaa req-630862a2-128a-409a-b3fb-fb90f453311f service nova] Creating event network-vif-deleted:e78d8958-a2f8-4ded-b330-20bf6ca8d76d for instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 on n-h1-708768-8 Jul 26 20:15:52.482679 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-34c34c34-d9dc-4b4a-bce3-853919916aaa req-630862a2-128a-409a-b3fb-fb90f453311f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045321 Jul 26 20:15:52.483959 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2874/5652] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:52.647099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:52.647755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:52.657930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:52.658373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:52.659137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:52.663803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:52.698417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:52.699314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:52.699942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lazy-loading 'fault' on Instance uuid 558b7f2e-2747-41e5-abb9-f2593366c5b0 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:15:52.757717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:52.767017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e4a8109-61c2-4421-bdae-a384535ff4e0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 200 len: 1309 microversion: 2.1 time: 0.124173 Jul 26 20:15:52.768093 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2779/5653] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:52 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:53.267333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c69b30d4-81a4-4411-9a51-71adf54c5aee tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:53.268190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c69b30d4-81a4-4411-9a51-71adf54c5aee tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:53.274918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c69b30d4-81a4-4411-9a51-71adf54c5aee tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:53.275442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c69b30d4-81a4-4411-9a51-71adf54c5aee tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:53.276537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c69b30d4-81a4-4411-9a51-71adf54c5aee tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:53.277127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c69b30d4-81a4-4411-9a51-71adf54c5aee tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:53.426652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c69b30d4-81a4-4411-9a51-71adf54c5aee tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:53.438198 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c69b30d4-81a4-4411-9a51-71adf54c5aee tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.175188 Jul 26 20:15:53.439054 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2875/5654] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:53 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:53.801639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:53.802251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 558b7f2e-2747-41e5-abb9-f2593366c5b0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:53.810002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:53.810582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:53.811365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:53.811857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:53.827389 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] HTTP exception thrown: Instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 could not be found. Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Request method failure captured: Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 HTTP/1.1 Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EqfLICOiXoFVV5obcZAgYFtHe24vZAwJ0mOmnJdTMp1b0cVcujcoLG2JRQV_gKnDDpd8c-_qk2vuxzZHMbw2rZt6sRW_9NRkN3GucDJ6y3-8SBU0IKsvTGbyLcfEXP8c8w0DqnEiEYYXBMdkfHic2qVZSyTTqlyGXJgZu73qQnh1KU Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 641c01c7142e4eaeb6a9cd7ea37d26dd Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesSnapshotTestJSON-757006942 Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/641c01c7142e4eaeb6a9cd7ea37d26dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/641c01c7142e4eaeb6a9cd7ea37d26dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_641c01c7142e4eaeb6a9cd7ea37d26dd", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/641c01c7142e4eaeb6a9cd7ea37d26dd"}]}] Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesSnapshotTestJSON-757006942 Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 641c01c7142e4eaeb6a9cd7ea37d26dd Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-757006942 Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesSnapshotTestJSON-757006942-project Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: fc75b56f29924188b32973a9a2ba1f9f Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesSnapshotTestJSON-757006942-project Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 could not be found. Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '558b7f2e-2747-41e5-abb9-f2593366c5b0'} Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 could not be found. Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 could not be found. Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:15:53.829172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 could not be found. Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Returning 404 to user: Instance 558b7f2e-2747-41e5-abb9-f2593366c5b0 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:15:53.834386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ebc317f5-ce94-4129-816b-86fa55b81979 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0" status: 404 len: 111 microversion: 2.1 time: 0.033296 Jul 26 20:15:53.835094 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2780/5655] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:53 2022] GET /compute/v2.1/servers/558b7f2e-2747-41e5-abb9-f2593366c5b0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:15:54.463026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68c6e0b7-67e7-4cb7-98c2-c7801d17790f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:54.464004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68c6e0b7-67e7-4cb7-98c2-c7801d17790f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:54.476261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68c6e0b7-67e7-4cb7-98c2-c7801d17790f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:54.476719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68c6e0b7-67e7-4cb7-98c2-c7801d17790f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:54.477569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68c6e0b7-67e7-4cb7-98c2-c7801d17790f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:54.478014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68c6e0b7-67e7-4cb7-98c2-c7801d17790f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:54.622176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68c6e0b7-67e7-4cb7-98c2-c7801d17790f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:54.630283 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68c6e0b7-67e7-4cb7-98c2-c7801d17790f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.173672 Jul 26 20:15:54.630885 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2876/5656] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:54 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:55.648176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f54a5daa-99cb-4ab1-a712-fd2d99acb7b0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:55.649317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f54a5daa-99cb-4ab1-a712-fd2d99acb7b0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:55.654693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-057b0ca4-86f5-48dd-92c3-9dc49a09c595 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:55.659762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f54a5daa-99cb-4ab1-a712-fd2d99acb7b0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:55.660219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f54a5daa-99cb-4ab1-a712-fd2d99acb7b0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:55.660975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-057b0ca4-86f5-48dd-92c3-9dc49a09c595 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:55.661094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f54a5daa-99cb-4ab1-a712-fd2d99acb7b0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:55.661410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f54a5daa-99cb-4ab1-a712-fd2d99acb7b0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:55.670663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-057b0ca4-86f5-48dd-92c3-9dc49a09c595 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:55.671462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-057b0ca4-86f5-48dd-92c3-9dc49a09c595 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:55.672549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-057b0ca4-86f5-48dd-92c3-9dc49a09c595 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:55.673200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-057b0ca4-86f5-48dd-92c3-9dc49a09c595 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:55.707896 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f54a5daa-99cb-4ab1-a712-fd2d99acb7b0 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/ips" status: 200 len: 145 microversion: 2.1 time: 0.064800 Jul 26 20:15:55.709648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:55.717388 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2781/5657] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:15:55 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/ips => generated 145 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:55.848688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-057b0ca4-86f5-48dd-92c3-9dc49a09c595 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:55.858923 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-057b0ca4-86f5-48dd-92c3-9dc49a09c595 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.210540 Jul 26 20:15:55.859602 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2877/5658] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:55 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:56.882844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fd9ed0c0-1f3c-44ae-b3f2-a1498765843d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:56.884174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd9ed0c0-1f3c-44ae-b3f2-a1498765843d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:56.897072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd9ed0c0-1f3c-44ae-b3f2-a1498765843d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:56.897520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd9ed0c0-1f3c-44ae-b3f2-a1498765843d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:56.899455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd9ed0c0-1f3c-44ae-b3f2-a1498765843d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:56.900173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd9ed0c0-1f3c-44ae-b3f2-a1498765843d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:57.139746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fd9ed0c0-1f3c-44ae-b3f2-a1498765843d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:57.150374 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fd9ed0c0-1f3c-44ae-b3f2-a1498765843d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.271744 Jul 26 20:15:57.152847 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2782/5659] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:56 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:58.173112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1552a220-26a2-4a1f-bf7c-ffa2112dc47d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:58.173749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1552a220-26a2-4a1f-bf7c-ffa2112dc47d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:58.199945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1552a220-26a2-4a1f-bf7c-ffa2112dc47d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:58.202648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1552a220-26a2-4a1f-bf7c-ffa2112dc47d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:58.205538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1552a220-26a2-4a1f-bf7c-ffa2112dc47d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:58.206383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1552a220-26a2-4a1f-bf7c-ffa2112dc47d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:58.726086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2d43de4-5efb-4ef4-9ba8-1f36826befb5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:58.726944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d2d43de4-5efb-4ef4-9ba8-1f36826befb5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:58.740948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2d43de4-5efb-4ef4-9ba8-1f36826befb5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:58.748338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2d43de4-5efb-4ef4-9ba8-1f36826befb5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:58.756781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2d43de4-5efb-4ef4-9ba8-1f36826befb5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:58.757615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2d43de4-5efb-4ef4-9ba8-1f36826befb5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:58.773145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1552a220-26a2-4a1f-bf7c-ffa2112dc47d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:15:58.791415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1552a220-26a2-4a1f-bf7c-ffa2112dc47d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.622911 Jul 26 20:15:58.799410 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2878/5660] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:58 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:15:58.821960 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2d43de4-5efb-4ef4-9ba8-1f36826befb5 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.100122 Jul 26 20:15:58.822623 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2783/5661] 10.222.0.58 () {58 vars in 1293 bytes} [Tue Jul 26 20:15:58 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f/os-server-password => generated 116 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:59.438337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-80b7a5f3-66e9-495e-a215-b44dd85d1127 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abda1f18-cb98-4ae0-8022-c4963563fb12"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:15:59.441409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-80b7a5f3-66e9-495e-a215-b44dd85d1127 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:59.460048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80b7a5f3-66e9-495e-a215-b44dd85d1127 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:59.460518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80b7a5f3-66e9-495e-a215-b44dd85d1127 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:59.461332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80b7a5f3-66e9-495e-a215-b44dd85d1127 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:59.461778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-80b7a5f3-66e9-495e-a215-b44dd85d1127 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:59.819031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b54abcbf-850c-4655-8763-8b5dcce47767 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:15:59.819845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b54abcbf-850c-4655-8763-8b5dcce47767 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:15:59.832027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:15:59.836975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b54abcbf-850c-4655-8763-8b5dcce47767 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:59.837581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b54abcbf-850c-4655-8763-8b5dcce47767 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:59.839476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b54abcbf-850c-4655-8763-8b5dcce47767 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:15:59.847398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b54abcbf-850c-4655-8763-8b5dcce47767 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:15:59.865907 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-80b7a5f3-66e9-495e-a215-b44dd85d1127 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432497 Jul 26 20:15:59.876291 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2879/5662] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:15:59 2022] POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:15:59.891498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:00.154663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b54abcbf-850c-4655-8763-8b5dcce47767 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:00.165626 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b54abcbf-850c-4655-8763-8b5dcce47767 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.350302 Jul 26 20:16:00.167283 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2784/5663] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:15:59 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:01.192575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-41896400-4489-4929-8a07-f998ccf904f2 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:01.195112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41896400-4489-4929-8a07-f998ccf904f2 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:01.216514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41896400-4489-4929-8a07-f998ccf904f2 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:01.217114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41896400-4489-4929-8a07-f998ccf904f2 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:01.217957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41896400-4489-4929-8a07-f998ccf904f2 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:01.218586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41896400-4489-4929-8a07-f998ccf904f2 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:01.612449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-41896400-4489-4929-8a07-f998ccf904f2 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:01.622525 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-41896400-4489-4929-8a07-f998ccf904f2 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.436707 Jul 26 20:16:01.627362 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2880/5664] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:01 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:02.364650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1282895338", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "19fbc85c-c341-4f8a-8eba-24a40b29b97e"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:02.499265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] validate_networks() for [('19fbc85c-c341-4f8a-8eba-24a40b29b97e', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:16:02.644157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-322e0f1d-f820-4f91-9609-ba28bf342906 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:02.645356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-322e0f1d-f820-4f91-9609-ba28bf342906 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:02.660211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-322e0f1d-f820-4f91-9609-ba28bf342906 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:02.664326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-322e0f1d-f820-4f91-9609-ba28bf342906 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:02.665533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-322e0f1d-f820-4f91-9609-ba28bf342906 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:02.666696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-322e0f1d-f820-4f91-9609-ba28bf342906 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:03.434551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:16:03.435740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:16:03.436499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:16:03.437119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:16:03.437758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:16:03.452230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:03.453001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:03.454015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:03.454579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:03.511547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Getting quotas for project 641c01c7142e4eaeb6a9cd7ea37d26dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:16:03.528844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Getting quotas for user fc75b56f29924188b32973a9a2ba1f9f and project 641c01c7142e4eaeb6a9cd7ea37d26dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:16:03.586013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:16:03.594166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:16:03.749662 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f38e071-62db-4c52-9d67-da146c1d14b8 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388917 Jul 26 20:16:03.751866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2785/5665] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:16:03.778621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5a32537-2180-40c4-a08d-6a2a78ed91f0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:03.779428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5a32537-2180-40c4-a08d-6a2a78ed91f0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:03.920627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f5a32537-2180-40c4-a08d-6a2a78ed91f0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:03.932665 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5a32537-2180-40c4-a08d-6a2a78ed91f0 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1219 microversion: 2.1 time: 0.172178 Jul 26 20:16:03.936011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2786/5666] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:03 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:04.060156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-322e0f1d-f820-4f91-9609-ba28bf342906 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:04.070260 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-322e0f1d-f820-4f91-9609-ba28bf342906 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 1.429926 Jul 26 20:16:04.070852 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2881/5667] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:02 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:04.958298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f8860dad-3c35-409f-ad46-c741444adb80 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:04.959698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f8860dad-3c35-409f-ad46-c741444adb80 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:04.983794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8860dad-3c35-409f-ad46-c741444adb80 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:04.988855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8860dad-3c35-409f-ad46-c741444adb80 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:04.991304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8860dad-3c35-409f-ad46-c741444adb80 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:05.001408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8860dad-3c35-409f-ad46-c741444adb80 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:05.100525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-765da118-e986-47a0-b4bc-ba2b6a235f3c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:05.101415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-765da118-e986-47a0-b4bc-ba2b6a235f3c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:05.121242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-765da118-e986-47a0-b4bc-ba2b6a235f3c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:05.124247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-765da118-e986-47a0-b4bc-ba2b6a235f3c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:05.127446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f8860dad-3c35-409f-ad46-c741444adb80 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:05.128365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-765da118-e986-47a0-b4bc-ba2b6a235f3c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:05.130119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-765da118-e986-47a0-b4bc-ba2b6a235f3c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:05.137749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f8860dad-3c35-409f-ad46-c741444adb80 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1215 microversion: 2.1 time: 0.185391 Jul 26 20:16:05.138918 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2787/5668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:04 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:05.784730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-765da118-e986-47a0-b4bc-ba2b6a235f3c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:05.796956 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-765da118-e986-47a0-b4bc-ba2b6a235f3c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.703612 Jul 26 20:16:05.801363 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2882/5669] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:05 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:06.170594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bfc08f0a-13c7-474b-a70d-4abf0c5510d4 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:06.171412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bfc08f0a-13c7-474b-a70d-4abf0c5510d4 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:06.199656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfc08f0a-13c7-474b-a70d-4abf0c5510d4 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:06.204105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfc08f0a-13c7-474b-a70d-4abf0c5510d4 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:06.208079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfc08f0a-13c7-474b-a70d-4abf0c5510d4 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:06.208742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfc08f0a-13c7-474b-a70d-4abf0c5510d4 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:06.377144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bfc08f0a-13c7-474b-a70d-4abf0c5510d4 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:06.389797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bfc08f0a-13c7-474b-a70d-4abf0c5510d4 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1277 microversion: 2.1 time: 0.229540 Jul 26 20:16:06.409416 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2788/5670] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:06 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:06.845861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-924e4585-b47c-42a8-abf1-1e3a8eedcbe0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:06.847081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-924e4585-b47c-42a8-abf1-1e3a8eedcbe0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:06.886716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-924e4585-b47c-42a8-abf1-1e3a8eedcbe0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:06.888945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-924e4585-b47c-42a8-abf1-1e3a8eedcbe0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:06.892468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-924e4585-b47c-42a8-abf1-1e3a8eedcbe0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:06.893160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-924e4585-b47c-42a8-abf1-1e3a8eedcbe0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:07.425180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-111f1556-a2b4-4253-86fa-d38f21db1739 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:07.427302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-111f1556-a2b4-4253-86fa-d38f21db1739 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:07.458414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-111f1556-a2b4-4253-86fa-d38f21db1739 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:07.458883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-111f1556-a2b4-4253-86fa-d38f21db1739 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:07.459712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-111f1556-a2b4-4253-86fa-d38f21db1739 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:07.460152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-111f1556-a2b4-4253-86fa-d38f21db1739 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:07.615711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-111f1556-a2b4-4253-86fa-d38f21db1739 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:07.630442 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-111f1556-a2b4-4253-86fa-d38f21db1739 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1277 microversion: 2.1 time: 0.210384 Jul 26 20:16:07.650538 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2789/5671] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:07 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:07.739989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-924e4585-b47c-42a8-abf1-1e3a8eedcbe0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:07.753619 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-924e4585-b47c-42a8-abf1-1e3a8eedcbe0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.912717 Jul 26 20:16:07.756656 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2883/5672] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:06 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:08.663826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-edaa67e0-8c4b-40a8-a11a-2c15bd5e74e9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:08.667761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-edaa67e0-8c4b-40a8-a11a-2c15bd5e74e9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:08.683076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edaa67e0-8c4b-40a8-a11a-2c15bd5e74e9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:08.684019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edaa67e0-8c4b-40a8-a11a-2c15bd5e74e9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:08.687268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edaa67e0-8c4b-40a8-a11a-2c15bd5e74e9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:08.689513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-edaa67e0-8c4b-40a8-a11a-2c15bd5e74e9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:08.785019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29489c4e-5928-4b59-a3ab-24279ce24d52 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:08.786999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-29489c4e-5928-4b59-a3ab-24279ce24d52 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:08.847071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29489c4e-5928-4b59-a3ab-24279ce24d52 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:08.854838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29489c4e-5928-4b59-a3ab-24279ce24d52 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:08.866147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29489c4e-5928-4b59-a3ab-24279ce24d52 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:08.866907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29489c4e-5928-4b59-a3ab-24279ce24d52 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:08.905016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-edaa67e0-8c4b-40a8-a11a-2c15bd5e74e9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:08.926541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-edaa67e0-8c4b-40a8-a11a-2c15bd5e74e9 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1277 microversion: 2.1 time: 0.268465 Jul 26 20:16:08.929966 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2790/5673] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:08 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:08.948365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1840046122", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "9426423d-a64d-42ab-ad2b-2400ece7c032"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1140950452", "security_groups": []}, "os:scheduler_hints": {"different_host": ["f451a961-6f86-4496-a4a8-17d35625f345"]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:09.053348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] validate_networks() for [('9426423d-a64d-42ab-ad2b-2400ece7c032', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:16:09.548205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-29489c4e-5928-4b59-a3ab-24279ce24d52 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:09.582564 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29489c4e-5928-4b59-a3ab-24279ce24d52 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.798590 Jul 26 20:16:09.586289 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2884/5674] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:08 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:09.964548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dc6faf3d-114e-4a1e-a23a-fd8f4a623008 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:09.966002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dc6faf3d-114e-4a1e-a23a-fd8f4a623008 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:09.991145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc6faf3d-114e-4a1e-a23a-fd8f4a623008 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:09.992029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc6faf3d-114e-4a1e-a23a-fd8f4a623008 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:09.993051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc6faf3d-114e-4a1e-a23a-fd8f4a623008 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:09.993724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dc6faf3d-114e-4a1e-a23a-fd8f4a623008 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:10.075843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:16:10.076972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:16:10.077939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:16:10.078559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:16:10.079175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:16:10.091866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:10.092739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:10.093796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:10.094450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:10.145293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Getting quotas for project 75fe1e4cfc6d4292a74e5d0194e52134. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:16:10.165319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Getting quotas for user 3221f96786b94685a458669711c802b9 and project 75fe1e4cfc6d4292a74e5d0194e52134. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:16:10.185284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:16:10.189584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:16:10.263743 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-599a4b02-6792-4ba6-9ae5-1efde9436472 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.325803 Jul 26 20:16:10.264578 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2791/5675] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:16:08 2022] POST /compute/v2.1/servers => generated 361 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:16:10.283055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d1e5c71b-d5ef-4480-a447-bcc23d5d4455 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:10.285071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d1e5c71b-d5ef-4480-a447-bcc23d5d4455 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:10.465888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d1e5c71b-d5ef-4480-a447-bcc23d5d4455 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:10.480405 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d1e5c71b-d5ef-4480-a447-bcc23d5d4455 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1242 microversion: 2.1 time: 0.204369 Jul 26 20:16:10.482948 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2792/5676] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:10 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1242 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:10.613981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fed258d8-c191-4c1c-94e3-4a936584362a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:10.615235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fed258d8-c191-4c1c-94e3-4a936584362a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:10.658350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fed258d8-c191-4c1c-94e3-4a936584362a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:10.658806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fed258d8-c191-4c1c-94e3-4a936584362a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:10.659627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fed258d8-c191-4c1c-94e3-4a936584362a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:10.660072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fed258d8-c191-4c1c-94e3-4a936584362a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:10.832153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dc6faf3d-114e-4a1e-a23a-fd8f4a623008 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:10.841961 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dc6faf3d-114e-4a1e-a23a-fd8f4a623008 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1319 microversion: 2.1 time: 0.881944 Jul 26 20:16:10.873209 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2885/5677] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:09 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1319 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:11.322075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fed258d8-c191-4c1c-94e3-4a936584362a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:11.337222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fed258d8-c191-4c1c-94e3-4a936584362a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1504 microversion: 2.1 time: 0.727957 Jul 26 20:16:11.355696 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2793/5678] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:10 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1504 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:11.504296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0fdbfa7e-03a8-4af9-9af2-7bfd45e55d10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:11.505809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0fdbfa7e-03a8-4af9-9af2-7bfd45e55d10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:11.508924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=40 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:11.880098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-858e0916-35ae-4b8d-a434-a046cc570cda tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:11.881231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-858e0916-35ae-4b8d-a434-a046cc570cda tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:11.903735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-858e0916-35ae-4b8d-a434-a046cc570cda tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:11.912191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-858e0916-35ae-4b8d-a434-a046cc570cda tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:11.914585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-858e0916-35ae-4b8d-a434-a046cc570cda tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:11.915248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-858e0916-35ae-4b8d-a434-a046cc570cda tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:12.004161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0fdbfa7e-03a8-4af9-9af2-7bfd45e55d10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:12.011474 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0fdbfa7e-03a8-4af9-9af2-7bfd45e55d10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1242 microversion: 2.1 time: 0.512267 Jul 26 20:16:12.044694 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2886/5679] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:11 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1242 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:12.315034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-858e0916-35ae-4b8d-a434-a046cc570cda tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:12.327046 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-858e0916-35ae-4b8d-a434-a046cc570cda tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1319 microversion: 2.1 time: 0.451745 Jul 26 20:16:12.343914 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2794/5680] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:11 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:12.365357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-580083f2-124c-4df9-856f-e43f47648374 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:12.366354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-580083f2-124c-4df9-856f-e43f47648374 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:12.374186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-580083f2-124c-4df9-856f-e43f47648374 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:12.375081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-580083f2-124c-4df9-856f-e43f47648374 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:12.376878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-580083f2-124c-4df9-856f-e43f47648374 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:12.377615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-580083f2-124c-4df9-856f-e43f47648374 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:12.939362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-580083f2-124c-4df9-856f-e43f47648374 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:12.951958 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-580083f2-124c-4df9-856f-e43f47648374 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1484 microversion: 2.1 time: 0.591093 Jul 26 20:16:12.970861 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2795/5681] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:12 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1484 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:13.005046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1d6555cc-86d8-460a-871e-a5812f70e4eb req-3d0c476e-5dd4-4cd2-bd17-2e2e779fd933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1544d688-3d30-43c9-8b72-0232f88ae818", "tag": "d838bc36-5b29-488a-981e-b40770f2e65b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:13.045175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fbaef7f6-de49-49ec-9f0b-fcd5e078ad8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:13.046409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fbaef7f6-de49-49ec-9f0b-fcd5e078ad8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:13.054288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbaef7f6-de49-49ec-9f0b-fcd5e078ad8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:13.055114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbaef7f6-de49-49ec-9f0b-fcd5e078ad8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:13.056202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbaef7f6-de49-49ec-9f0b-fcd5e078ad8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:13.056992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbaef7f6-de49-49ec-9f0b-fcd5e078ad8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:13.060060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1d6555cc-86d8-460a-871e-a5812f70e4eb req-3d0c476e-5dd4-4cd2-bd17-2e2e779fd933 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:13.060377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1d6555cc-86d8-460a-871e-a5812f70e4eb req-3d0c476e-5dd4-4cd2-bd17-2e2e779fd933 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:13.111075 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1d6555cc-86d8-460a-871e-a5812f70e4eb req-3d0c476e-5dd4-4cd2-bd17-2e2e779fd933 service nova] Creating event network-changed:d838bc36-5b29-488a-981e-b40770f2e65b for instance 1544d688-3d30-43c9-8b72-0232f88ae818 on n-h2-708768-8 Jul 26 20:16:13.127838 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1d6555cc-86d8-460a-871e-a5812f70e4eb req-3d0c476e-5dd4-4cd2-bd17-2e2e779fd933 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.943201 Jul 26 20:16:13.138238 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2887/5682] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:13.161503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fbaef7f6-de49-49ec-9f0b-fcd5e078ad8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:13.172705 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fbaef7f6-de49-49ec-9f0b-fcd5e078ad8e tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1294 microversion: 2.1 time: 0.132394 Jul 26 20:16:13.187992 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2796/5683] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:13 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1294 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:13.284726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1398194659", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:13.348894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-916f517b-e5c1-4312-818c-1f7e6add4184 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:13.350199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-916f517b-e5c1-4312-818c-1f7e6add4184 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:13.367475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-916f517b-e5c1-4312-818c-1f7e6add4184 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:13.368398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-916f517b-e5c1-4312-818c-1f7e6add4184 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:13.371953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-916f517b-e5c1-4312-818c-1f7e6add4184 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:13.372678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-916f517b-e5c1-4312-818c-1f7e6add4184 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:13.429292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] validate_networks() for [('83f9ae95-37d0-4afa-aa49-ab2e266007e5', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:16:13.957935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-916f517b-e5c1-4312-818c-1f7e6add4184 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:13.967255 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-916f517b-e5c1-4312-818c-1f7e6add4184 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1319 microversion: 2.1 time: 0.622583 Jul 26 20:16:13.969186 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2797/5684] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:13 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1319 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:14.195416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e8a349c7-df3e-42a2-a217-8f36b0ccdd38 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:14.196070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e8a349c7-df3e-42a2-a217-8f36b0ccdd38 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:14.210157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e8a349c7-df3e-42a2-a217-8f36b0ccdd38 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:14.210870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e8a349c7-df3e-42a2-a217-8f36b0ccdd38 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:14.213435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e8a349c7-df3e-42a2-a217-8f36b0ccdd38 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:14.215074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e8a349c7-df3e-42a2-a217-8f36b0ccdd38 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:14.395717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e8a349c7-df3e-42a2-a217-8f36b0ccdd38 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:14.405782 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e8a349c7-df3e-42a2-a217-8f36b0ccdd38 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.215224 Jul 26 20:16:14.419285 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2798/5685] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:14 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:14.990333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c6e72186-8242-49db-8de6-36835a7855ce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:14.990953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c6e72186-8242-49db-8de6-36835a7855ce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:15.017622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6e72186-8242-49db-8de6-36835a7855ce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:15.018109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6e72186-8242-49db-8de6-36835a7855ce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:15.026643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6e72186-8242-49db-8de6-36835a7855ce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:15.034193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6e72186-8242-49db-8de6-36835a7855ce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:15.268397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:16:15.269804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:16:15.272747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:16:15.273130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:16:15.274002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:16:15.290924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:15.292152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:15.300592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:15.304014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:15.394476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Getting quotas for project a4c24400e9b14379a6df5970e9d68002. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:16:15.415144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Getting quotas for user 40681f18e62a405a87481253fbe843bd and project a4c24400e9b14379a6df5970e9d68002. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:16:15.454031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:16:15.461166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:16:15.593119 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-992ad1a2-20e0-4b1c-a0e9-61629949e50c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.312912 Jul 26 20:16:15.594411 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2888/5686] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:16:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:16:15.599770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5906073e-d4ac-4a95-aff3-647cc1490858 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:15.600604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5906073e-d4ac-4a95-aff3-647cc1490858 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:15.609197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5906073e-d4ac-4a95-aff3-647cc1490858 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:15.610132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5906073e-d4ac-4a95-aff3-647cc1490858 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:15.611089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5906073e-d4ac-4a95-aff3-647cc1490858 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:15.611727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5906073e-d4ac-4a95-aff3-647cc1490858 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:15.784841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5906073e-d4ac-4a95-aff3-647cc1490858 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:15.795313 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5906073e-d4ac-4a95-aff3-647cc1490858 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.199473 Jul 26 20:16:15.796114 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2889/5687] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:15 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:15.801532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1423bc7-ebae-426a-82a6-b6233643c760 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:15.802406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a1423bc7-ebae-426a-82a6-b6233643c760 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:15.924725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c6e72186-8242-49db-8de6-36835a7855ce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:15.934235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1423bc7-ebae-426a-82a6-b6233643c760 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:15.938340 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c6e72186-8242-49db-8de6-36835a7855ce tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1319 microversion: 2.1 time: 0.951486 Jul 26 20:16:15.946471 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1423bc7-ebae-426a-82a6-b6233643c760 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1214 microversion: 2.1 time: 0.149024 Jul 26 20:16:15.948677 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2890/5688] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:15 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:15.949222 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2799/5689] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:14 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1319 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:16.823505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5470163e-6ad3-4d35-938a-3432f09114cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:16.823854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2fef4489-8545-4666-b297-efd9140a98c6 req-dd300cad-06d7-4275-a1ba-4a14311229bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1544d688-3d30-43c9-8b72-0232f88ae818", "name": "network-vif-plugged", "status": "completed", "tag": "d838bc36-5b29-488a-981e-b40770f2e65b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:16.824579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5470163e-6ad3-4d35-938a-3432f09114cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:16.849136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5470163e-6ad3-4d35-938a-3432f09114cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:16.849595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5470163e-6ad3-4d35-938a-3432f09114cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:16.850395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5470163e-6ad3-4d35-938a-3432f09114cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:16.850831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5470163e-6ad3-4d35-938a-3432f09114cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:16.856093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2fef4489-8545-4666-b297-efd9140a98c6 req-dd300cad-06d7-4275-a1ba-4a14311229bd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:16.858485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2fef4489-8545-4666-b297-efd9140a98c6 req-dd300cad-06d7-4275-a1ba-4a14311229bd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:16.897872 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2fef4489-8545-4666-b297-efd9140a98c6 req-dd300cad-06d7-4275-a1ba-4a14311229bd service nova] Creating event network-vif-plugged:d838bc36-5b29-488a-981e-b40770f2e65b for instance 1544d688-3d30-43c9-8b72-0232f88ae818 on n-h2-708768-8 Jul 26 20:16:16.908830 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2fef4489-8545-4666-b297-efd9140a98c6 req-dd300cad-06d7-4275-a1ba-4a14311229bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096321 Jul 26 20:16:16.909442 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2891/5690] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:16.968156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8114dfa9-fcc7-4d75-aa1a-c1f2b778fe84 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:16.968873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8114dfa9-fcc7-4d75-aa1a-c1f2b778fe84 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:16.981255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8114dfa9-fcc7-4d75-aa1a-c1f2b778fe84 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:16.981712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8114dfa9-fcc7-4d75-aa1a-c1f2b778fe84 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:16.982814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8114dfa9-fcc7-4d75-aa1a-c1f2b778fe84 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:16.983440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8114dfa9-fcc7-4d75-aa1a-c1f2b778fe84 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:17.049108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5470163e-6ad3-4d35-938a-3432f09114cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:17.072036 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5470163e-6ad3-4d35-938a-3432f09114cd tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.258241 Jul 26 20:16:17.092545 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2800/5691] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:16 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:17.098083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00f70622-ec2c-42d5-9393-831cb946d447 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:17.106876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00f70622-ec2c-42d5-9393-831cb946d447 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:17.124148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f70622-ec2c-42d5-9393-831cb946d447 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:17.125007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f70622-ec2c-42d5-9393-831cb946d447 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:17.125982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f70622-ec2c-42d5-9393-831cb946d447 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:17.128757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f70622-ec2c-42d5-9393-831cb946d447 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:17.231557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00f70622-ec2c-42d5-9393-831cb946d447 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:17.241059 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00f70622-ec2c-42d5-9393-831cb946d447 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1284 microversion: 2.1 time: 0.146928 Jul 26 20:16:17.247397 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2801/5692] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:17 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:17.427250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd41fdc2-4250-4375-9cc2-8e0c0ec55bcf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:17.433822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd41fdc2-4250-4375-9cc2-8e0c0ec55bcf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:17.434552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd41fdc2-4250-4375-9cc2-8e0c0ec55bcf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:17.443914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8114dfa9-fcc7-4d75-aa1a-c1f2b778fe84 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:17.452308 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8114dfa9-fcc7-4d75-aa1a-c1f2b778fe84 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1319 microversion: 2.1 time: 0.490866 Jul 26 20:16:17.455929 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2892/5693] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:16 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:17.460652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd41fdc2-4250-4375-9cc2-8e0c0ec55bcf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Going to try to stop instance {{(pid=125963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:16:17.515993 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd41fdc2-4250-4375-9cc2-8e0c0ec55bcf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/action" status: 202 len: 0 microversion: 2.1 time: 0.092398 Jul 26 20:16:17.517273 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2802/5694] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:16:17 2022] POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:16:17.525612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e55f6c69-6897-4aa2-8687-2f24c3e7bfd6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:17.526229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e55f6c69-6897-4aa2-8687-2f24c3e7bfd6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:17.545738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e55f6c69-6897-4aa2-8687-2f24c3e7bfd6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:17.546188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e55f6c69-6897-4aa2-8687-2f24c3e7bfd6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:17.548044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e55f6c69-6897-4aa2-8687-2f24c3e7bfd6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:17.548909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e55f6c69-6897-4aa2-8687-2f24c3e7bfd6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:17.793530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e55f6c69-6897-4aa2-8687-2f24c3e7bfd6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:17.804157 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e55f6c69-6897-4aa2-8687-2f24c3e7bfd6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.281291 Jul 26 20:16:17.808601 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2893/5695] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:17 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:18.095964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0c0208f-91b3-4d6a-9925-838792354aec tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:18.096669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0c0208f-91b3-4d6a-9925-838792354aec tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:18.110758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0c0208f-91b3-4d6a-9925-838792354aec tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.111529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0c0208f-91b3-4d6a-9925-838792354aec tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:18.112918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0c0208f-91b3-4d6a-9925-838792354aec tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.114058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0c0208f-91b3-4d6a-9925-838792354aec tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:18.174306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:18.276946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68c30b96-5cdf-4905-9c3b-fd83087f39d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:18.278071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68c30b96-5cdf-4905-9c3b-fd83087f39d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:18.293271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68c30b96-5cdf-4905-9c3b-fd83087f39d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.293742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68c30b96-5cdf-4905-9c3b-fd83087f39d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:18.296943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68c30b96-5cdf-4905-9c3b-fd83087f39d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.297665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68c30b96-5cdf-4905-9c3b-fd83087f39d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:18.506522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b0c0208f-91b3-4d6a-9925-838792354aec tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:18.534784 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0c0208f-91b3-4d6a-9925-838792354aec tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.444690 Jul 26 20:16:18.556175 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2803/5696] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:18 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:18.564148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e8a5401b-ed14-4ffb-9ec7-cd057de4f6e3 req-9ba88348-a615-40c2-a8c2-c9a6b86ea972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9047d6f-2529-46e6-9ffe-52a4141aa1dd", "tag": "4e64b978-05fa-40ae-a070-a310023932d4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:18.579685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e8a5401b-ed14-4ffb-9ec7-cd057de4f6e3 req-9ba88348-a615-40c2-a8c2-c9a6b86ea972 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.580727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e8a5401b-ed14-4ffb-9ec7-cd057de4f6e3 req-9ba88348-a615-40c2-a8c2-c9a6b86ea972 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:18.606008 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e8a5401b-ed14-4ffb-9ec7-cd057de4f6e3 req-9ba88348-a615-40c2-a8c2-c9a6b86ea972 service nova] Creating event network-changed:4e64b978-05fa-40ae-a070-a310023932d4 for instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd on n-h1-708768-8 Jul 26 20:16:18.629350 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e8a5401b-ed14-4ffb-9ec7-cd057de4f6e3 req-9ba88348-a615-40c2-a8c2-c9a6b86ea972 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069694 Jul 26 20:16:18.632952 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2804/5697] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:18.641607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e522d261-6868-4bc2-9410-95607a70a433 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:18.642595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e522d261-6868-4bc2-9410-95607a70a433 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:18.652813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e522d261-6868-4bc2-9410-95607a70a433 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.653446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e522d261-6868-4bc2-9410-95607a70a433 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:18.654732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e522d261-6868-4bc2-9410-95607a70a433 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.655441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e522d261-6868-4bc2-9410-95607a70a433 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:18.720699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68c30b96-5cdf-4905-9c3b-fd83087f39d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:18.732321 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68c30b96-5cdf-4905-9c3b-fd83087f39d8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.464199 Jul 26 20:16:18.760929 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2894/5698] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:18 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:18.836881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7c761ce-ecf2-4e12-9689-7edf08c6784c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:18.837528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7c761ce-ecf2-4e12-9689-7edf08c6784c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:18.855549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7c761ce-ecf2-4e12-9689-7edf08c6784c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.856047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7c761ce-ecf2-4e12-9689-7edf08c6784c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:18.856857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7c761ce-ecf2-4e12-9689-7edf08c6784c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:18.857307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7c761ce-ecf2-4e12-9689-7edf08c6784c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:19.051160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e522d261-6868-4bc2-9410-95607a70a433 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:19.062329 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e522d261-6868-4bc2-9410-95607a70a433 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1319 microversion: 2.1 time: 0.427179 Jul 26 20:16:19.062932 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2805/5699] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:18 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:19.244230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7c761ce-ecf2-4e12-9689-7edf08c6784c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:19.258826 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7c761ce-ecf2-4e12-9689-7edf08c6784c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.430230 Jul 26 20:16:19.263024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2895/5700] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:18 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:19.563805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d435927f-8852-4d2c-a538-208c00082966 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:19.564969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d435927f-8852-4d2c-a538-208c00082966 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:19.576603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d435927f-8852-4d2c-a538-208c00082966 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:19.577888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d435927f-8852-4d2c-a538-208c00082966 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:19.579241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d435927f-8852-4d2c-a538-208c00082966 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:19.580402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d435927f-8852-4d2c-a538-208c00082966 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:19.649774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-458053b2-d314-4479-8b2f-7afcd4ae8355 req-a253546b-b323-4599-bc79-b0412183927c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3af1a9-417c-44e7-8398-4ef25d43ad2f", "tag": "d246717b-c9f7-4d86-aa37-bd4aae4b26bf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:19.671877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-458053b2-d314-4479-8b2f-7afcd4ae8355 req-a253546b-b323-4599-bc79-b0412183927c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:19.673300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-458053b2-d314-4479-8b2f-7afcd4ae8355 req-a253546b-b323-4599-bc79-b0412183927c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:19.687172 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-458053b2-d314-4479-8b2f-7afcd4ae8355 req-a253546b-b323-4599-bc79-b0412183927c service nova] Creating event network-changed:d246717b-c9f7-4d86-aa37-bd4aae4b26bf for instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f on n-h1-708768-8 Jul 26 20:16:19.693272 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-458053b2-d314-4479-8b2f-7afcd4ae8355 req-a253546b-b323-4599-bc79-b0412183927c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047685 Jul 26 20:16:19.694349 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2896/5701] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:19.702636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d435927f-8852-4d2c-a538-208c00082966 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:19.710951 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d435927f-8852-4d2c-a538-208c00082966 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.154663 Jul 26 20:16:19.711850 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2806/5702] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:19 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:19.775040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63418522-8af3-4f14-a6b1-e2f30520544e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:19.776982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63418522-8af3-4f14-a6b1-e2f30520544e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:19.785295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63418522-8af3-4f14-a6b1-e2f30520544e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:19.786098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63418522-8af3-4f14-a6b1-e2f30520544e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:19.787136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63418522-8af3-4f14-a6b1-e2f30520544e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:19.788387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63418522-8af3-4f14-a6b1-e2f30520544e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:19.806548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:19.969650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63418522-8af3-4f14-a6b1-e2f30520544e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:19.981737 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63418522-8af3-4f14-a6b1-e2f30520544e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.211159 Jul 26 20:16:19.982906 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2897/5703] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:19 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:20.085869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e2c6432-3b70-4664-b5a6-3e62c6c20bf2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:20.086582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5e2c6432-3b70-4664-b5a6-3e62c6c20bf2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:20.093766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e2c6432-3b70-4664-b5a6-3e62c6c20bf2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:20.094288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e2c6432-3b70-4664-b5a6-3e62c6c20bf2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:20.095282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e2c6432-3b70-4664-b5a6-3e62c6c20bf2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:20.095894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e2c6432-3b70-4664-b5a6-3e62c6c20bf2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:20.127885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:20.285268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a846494-5e33-41e9-b3e4-a83b7b1e5a0a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:20.286263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1a846494-5e33-41e9-b3e4-a83b7b1e5a0a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:20.299867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a846494-5e33-41e9-b3e4-a83b7b1e5a0a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:20.300416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a846494-5e33-41e9-b3e4-a83b7b1e5a0a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:20.301598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a846494-5e33-41e9-b3e4-a83b7b1e5a0a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:20.302108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a846494-5e33-41e9-b3e4-a83b7b1e5a0a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:20.472006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=16 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:20.638833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a846494-5e33-41e9-b3e4-a83b7b1e5a0a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:20.665271 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a846494-5e33-41e9-b3e4-a83b7b1e5a0a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.382946 Jul 26 20:16:20.670680 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2898/5704] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:20 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:20.701694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5e2c6432-3b70-4664-b5a6-3e62c6c20bf2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:20.711729 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5e2c6432-3b70-4664-b5a6-3e62c6c20bf2 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1507 microversion: 2.1 time: 0.630347 Jul 26 20:16:20.712653 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2807/5705] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:20 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1507 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:20.745701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b323c4bd-33a3-4a3a-87be-ebb770c8fb90 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "319ac569-a1e1-497e-ac60-c85390b03c0c", "device": "/dev/sdb"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:20.751874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7b5bc8b5-cdda-4f45-a068-c8e0a9ac4f88 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:20.752818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7b5bc8b5-cdda-4f45-a068-c8e0a9ac4f88 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:20.762563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b323c4bd-33a3-4a3a-87be-ebb770c8fb90 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:20.775223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b323c4bd-33a3-4a3a-87be-ebb770c8fb90 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:20.778303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b323c4bd-33a3-4a3a-87be-ebb770c8fb90 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:20.786485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b5bc8b5-cdda-4f45-a068-c8e0a9ac4f88 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:20.788213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b5bc8b5-cdda-4f45-a068-c8e0a9ac4f88 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:20.789671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b5bc8b5-cdda-4f45-a068-c8e0a9ac4f88 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:20.791976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b5bc8b5-cdda-4f45-a068-c8e0a9ac4f88 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:20.799550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b323c4bd-33a3-4a3a-87be-ebb770c8fb90 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:20.800071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b323c4bd-33a3-4a3a-87be-ebb770c8fb90 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:20.991235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7b5bc8b5-cdda-4f45-a068-c8e0a9ac4f88 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:21.008503 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7b5bc8b5-cdda-4f45-a068-c8e0a9ac4f88 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.272834 Jul 26 20:16:21.013672 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2899/5706] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:20 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:21.046559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-874ff2e2-6fbb-4bc5-958f-85efda3e2f6c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:21.047477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-874ff2e2-6fbb-4bc5-958f-85efda3e2f6c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:21.058019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-874ff2e2-6fbb-4bc5-958f-85efda3e2f6c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:21.063798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-874ff2e2-6fbb-4bc5-958f-85efda3e2f6c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:21.065137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-874ff2e2-6fbb-4bc5-958f-85efda3e2f6c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:21.065767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-874ff2e2-6fbb-4bc5-958f-85efda3e2f6c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:21.244776 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b323c4bd-33a3-4a3a-87be-ebb770c8fb90 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "POST /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503371 Jul 26 20:16:21.246466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2808/5707] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:16:20 2022] POST /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:21.443289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-874ff2e2-6fbb-4bc5-958f-85efda3e2f6c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:21.453570 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-874ff2e2-6fbb-4bc5-958f-85efda3e2f6c tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.438074 Jul 26 20:16:21.465697 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2900/5708] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:21 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:21.701718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-353e1440-ff58-429d-8d97-1c9c46ed3e9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:21.703155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-353e1440-ff58-429d-8d97-1c9c46ed3e9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:21.721142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353e1440-ff58-429d-8d97-1c9c46ed3e9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:21.722012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353e1440-ff58-429d-8d97-1c9c46ed3e9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:21.723042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353e1440-ff58-429d-8d97-1c9c46ed3e9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:21.724203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-353e1440-ff58-429d-8d97-1c9c46ed3e9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:22.037869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-50fa282d-d06a-4675-a397-2149278e3c77 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:22.038497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-50fa282d-d06a-4675-a397-2149278e3c77 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:22.038627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-353e1440-ff58-429d-8d97-1c9c46ed3e9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:22.049333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50fa282d-d06a-4675-a397-2149278e3c77 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:22.050213 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-353e1440-ff58-429d-8d97-1c9c46ed3e9c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.353866 Jul 26 20:16:22.051333 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2809/5709] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:21 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:22.052525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50fa282d-d06a-4675-a397-2149278e3c77 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:22.053709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50fa282d-d06a-4675-a397-2149278e3c77 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:22.056509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-50fa282d-d06a-4675-a397-2149278e3c77 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:22.159487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-50fa282d-d06a-4675-a397-2149278e3c77 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:22.169457 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-50fa282d-d06a-4675-a397-2149278e3c77 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.139073 Jul 26 20:16:22.170369 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2901/5710] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:22 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:22.477785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-48d2f0a9-8adb-4a3b-9b8c-b277a6535346 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:22.479306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-48d2f0a9-8adb-4a3b-9b8c-b277a6535346 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:22.486403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48d2f0a9-8adb-4a3b-9b8c-b277a6535346 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:22.487186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48d2f0a9-8adb-4a3b-9b8c-b277a6535346 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:22.488388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48d2f0a9-8adb-4a3b-9b8c-b277a6535346 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:22.489036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48d2f0a9-8adb-4a3b-9b8c-b277a6535346 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:22.701453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-48d2f0a9-8adb-4a3b-9b8c-b277a6535346 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:22.717920 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-48d2f0a9-8adb-4a3b-9b8c-b277a6535346 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.243078 Jul 26 20:16:22.720812 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2810/5711] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:22 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:23.072826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-758e10e6-88c0-4db5-94e5-0156c7dd1f9b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:23.074211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-758e10e6-88c0-4db5-94e5-0156c7dd1f9b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:23.081579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-758e10e6-88c0-4db5-94e5-0156c7dd1f9b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:23.082024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-758e10e6-88c0-4db5-94e5-0156c7dd1f9b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:23.082794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-758e10e6-88c0-4db5-94e5-0156c7dd1f9b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:23.083230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-758e10e6-88c0-4db5-94e5-0156c7dd1f9b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:23.191502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2f7eec01-51f1-40e8-b86d-b0d45f9c40a0 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:23.192142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2f7eec01-51f1-40e8-b86d-b0d45f9c40a0 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:23.205170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f7eec01-51f1-40e8-b86d-b0d45f9c40a0 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:23.205616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f7eec01-51f1-40e8-b86d-b0d45f9c40a0 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:23.206544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f7eec01-51f1-40e8-b86d-b0d45f9c40a0 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:23.206984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2f7eec01-51f1-40e8-b86d-b0d45f9c40a0 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:23.258424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-758e10e6-88c0-4db5-94e5-0156c7dd1f9b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:23.270583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-758e10e6-88c0-4db5-94e5-0156c7dd1f9b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.201593 Jul 26 20:16:23.281637 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2902/5712] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:23 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:23.370279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2f7eec01-51f1-40e8-b86d-b0d45f9c40a0 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:23.381358 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2f7eec01-51f1-40e8-b86d-b0d45f9c40a0 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.193640 Jul 26 20:16:23.381955 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2811/5713] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:23 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:23.741035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b2a0499a-c016-4600-ac5b-296b6b1622a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:23.741653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b2a0499a-c016-4600-ac5b-296b6b1622a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:23.754127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2a0499a-c016-4600-ac5b-296b6b1622a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:23.754510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2a0499a-c016-4600-ac5b-296b6b1622a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:23.755357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2a0499a-c016-4600-ac5b-296b6b1622a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:23.755839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b2a0499a-c016-4600-ac5b-296b6b1622a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:23.989853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b2a0499a-c016-4600-ac5b-296b6b1622a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:24.004888 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b2a0499a-c016-4600-ac5b-296b6b1622a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.266155 Jul 26 20:16:24.008161 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2903/5714] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:23 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:24.294305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02a6da33-28e2-4901-9804-00c9d5ac7e91 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:24.294888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-02a6da33-28e2-4901-9804-00c9d5ac7e91 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:24.302238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02a6da33-28e2-4901-9804-00c9d5ac7e91 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:24.302983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02a6da33-28e2-4901-9804-00c9d5ac7e91 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:24.303787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02a6da33-28e2-4901-9804-00c9d5ac7e91 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:24.304489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02a6da33-28e2-4901-9804-00c9d5ac7e91 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:24.405032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-64a371b9-6ff0-4e8f-b93b-4fa85548c967 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:24.406019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-64a371b9-6ff0-4e8f-b93b-4fa85548c967 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:24.421999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64a371b9-6ff0-4e8f-b93b-4fa85548c967 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:24.422798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64a371b9-6ff0-4e8f-b93b-4fa85548c967 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:24.423865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64a371b9-6ff0-4e8f-b93b-4fa85548c967 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:24.424505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-64a371b9-6ff0-4e8f-b93b-4fa85548c967 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:24.492744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-02a6da33-28e2-4901-9804-00c9d5ac7e91 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:24.504285 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02a6da33-28e2-4901-9804-00c9d5ac7e91 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.214953 Jul 26 20:16:24.505493 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2812/5715] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:24 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:24.548766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-64a371b9-6ff0-4e8f-b93b-4fa85548c967 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:24.558000 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-64a371b9-6ff0-4e8f-b93b-4fa85548c967 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.158916 Jul 26 20:16:24.559130 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2904/5716] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:24 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:24.902424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-dacd52ba-16df-4030-8b7c-15d4cacd3719 req-d657fe64-3f5f-4f45-8a48-e84610fa2652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9047d6f-2529-46e6-9ffe-52a4141aa1dd", "name": "network-vif-plugged", "status": "completed", "tag": "4e64b978-05fa-40ae-a070-a310023932d4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:24.915490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dacd52ba-16df-4030-8b7c-15d4cacd3719 req-d657fe64-3f5f-4f45-8a48-e84610fa2652 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:24.917228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dacd52ba-16df-4030-8b7c-15d4cacd3719 req-d657fe64-3f5f-4f45-8a48-e84610fa2652 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:24.931440 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-dacd52ba-16df-4030-8b7c-15d4cacd3719 req-d657fe64-3f5f-4f45-8a48-e84610fa2652 service nova] Creating event network-vif-plugged:4e64b978-05fa-40ae-a070-a310023932d4 for instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd on n-h1-708768-8 Jul 26 20:16:24.937978 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-dacd52ba-16df-4030-8b7c-15d4cacd3719 req-d657fe64-3f5f-4f45-8a48-e84610fa2652 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040620 Jul 26 20:16:24.939402 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2813/5717] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:25.029149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2914c0ee-33e2-419e-ace0-00830c078a21 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:25.030245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2914c0ee-33e2-419e-ace0-00830c078a21 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:25.053667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2914c0ee-33e2-419e-ace0-00830c078a21 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:25.055005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2914c0ee-33e2-419e-ace0-00830c078a21 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:25.056084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2914c0ee-33e2-419e-ace0-00830c078a21 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:25.057952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2914c0ee-33e2-419e-ace0-00830c078a21 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:25.267661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2914c0ee-33e2-419e-ace0-00830c078a21 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:25.277901 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2914c0ee-33e2-419e-ace0-00830c078a21 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.254432 Jul 26 20:16:25.291752 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2905/5718] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:25 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:25.528148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-76d44a28-bffb-47e1-8bdb-f20c60818d46 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:25.530550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-76d44a28-bffb-47e1-8bdb-f20c60818d46 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:25.562058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76d44a28-bffb-47e1-8bdb-f20c60818d46 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:25.562600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76d44a28-bffb-47e1-8bdb-f20c60818d46 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:25.563500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76d44a28-bffb-47e1-8bdb-f20c60818d46 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:25.564293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76d44a28-bffb-47e1-8bdb-f20c60818d46 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:25.579260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe01a48b-6223-49f6-a94b-a05e11d72f00 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:25.580079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fe01a48b-6223-49f6-a94b-a05e11d72f00 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:25.582120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:25.589783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe01a48b-6223-49f6-a94b-a05e11d72f00 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:25.590636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe01a48b-6223-49f6-a94b-a05e11d72f00 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:25.591933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe01a48b-6223-49f6-a94b-a05e11d72f00 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:25.592509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe01a48b-6223-49f6-a94b-a05e11d72f00 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:25.702635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fe01a48b-6223-49f6-a94b-a05e11d72f00 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:25.711040 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe01a48b-6223-49f6-a94b-a05e11d72f00 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1300 microversion: 2.1 time: 0.135969 Jul 26 20:16:25.717179 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2906/5719] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:25 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:25.762937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-76d44a28-bffb-47e1-8bdb-f20c60818d46 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:25.772591 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-76d44a28-bffb-47e1-8bdb-f20c60818d46 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.250452 Jul 26 20:16:25.773692 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2814/5720] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:25 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:26.300808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0c29609b-afd5-4084-8a3c-6826ce6bd6e0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:26.301704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0c29609b-afd5-4084-8a3c-6826ce6bd6e0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:26.308247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:26.311700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c29609b-afd5-4084-8a3c-6826ce6bd6e0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:26.312389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c29609b-afd5-4084-8a3c-6826ce6bd6e0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:26.313380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c29609b-afd5-4084-8a3c-6826ce6bd6e0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:26.313991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0c29609b-afd5-4084-8a3c-6826ce6bd6e0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:26.473473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0c29609b-afd5-4084-8a3c-6826ce6bd6e0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:26.481929 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0c29609b-afd5-4084-8a3c-6826ce6bd6e0 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.185044 Jul 26 20:16:26.482857 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2907/5721] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:26 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:26.732971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8922b01-27e9-47bf-a4d2-e4b892e0bd68 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:26.734301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8922b01-27e9-47bf-a4d2-e4b892e0bd68 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:26.747926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8922b01-27e9-47bf-a4d2-e4b892e0bd68 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:26.753004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8922b01-27e9-47bf-a4d2-e4b892e0bd68 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:26.754103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8922b01-27e9-47bf-a4d2-e4b892e0bd68 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:26.754724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8922b01-27e9-47bf-a4d2-e4b892e0bd68 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:26.797406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-28f329a2-a8e8-4f47-8572-3c8bd01d2ba4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:26.798039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-28f329a2-a8e8-4f47-8572-3c8bd01d2ba4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:26.810874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28f329a2-a8e8-4f47-8572-3c8bd01d2ba4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:26.811521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28f329a2-a8e8-4f47-8572-3c8bd01d2ba4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:26.812159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28f329a2-a8e8-4f47-8572-3c8bd01d2ba4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:26.812604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28f329a2-a8e8-4f47-8572-3c8bd01d2ba4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:26.897511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8922b01-27e9-47bf-a4d2-e4b892e0bd68 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:26.905975 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8922b01-27e9-47bf-a4d2-e4b892e0bd68 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1471 microversion: 2.1 time: 0.177219 Jul 26 20:16:26.908539 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2815/5722] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:26 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:26.928978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0b508677-6926-42ac-b4e9-785dbfafd447 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:26.930204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0b508677-6926-42ac-b4e9-785dbfafd447 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:26.938769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b508677-6926-42ac-b4e9-785dbfafd447 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:26.943411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b508677-6926-42ac-b4e9-785dbfafd447 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:26.944528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b508677-6926-42ac-b4e9-785dbfafd447 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:26.945219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b508677-6926-42ac-b4e9-785dbfafd447 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.072987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b508677-6926-42ac-b4e9-785dbfafd447 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:27.085670 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0b508677-6926-42ac-b4e9-785dbfafd447 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1471 microversion: 2.1 time: 0.160569 Jul 26 20:16:27.087128 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2816/5723] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:26 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:27.095742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-28f329a2-a8e8-4f47-8572-3c8bd01d2ba4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:27.112283 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-28f329a2-a8e8-4f47-8572-3c8bd01d2ba4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.318738 Jul 26 20:16:27.115310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4cc2ede3-bdb7-45f6-ae00-f30b2d5df262 tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:27.116454 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2908/5724] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:26 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:27.120813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4cc2ede3-bdb7-45f6-ae00-f30b2d5df262 tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:27.130637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-62e027b8-4afb-46da-9b00-03ccfd500534 req-3e1d39ee-8d7a-4b8e-b2b8-f597b008d49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3af1a9-417c-44e7-8398-4ef25d43ad2f", "name": "network-vif-plugged", "status": "completed", "tag": "d246717b-c9f7-4d86-aa37-bd4aae4b26bf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:27.132404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:27.139396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cc2ede3-bdb7-45f6-ae00-f30b2d5df262 tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.140217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cc2ede3-bdb7-45f6-ae00-f30b2d5df262 tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.141289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cc2ede3-bdb7-45f6-ae00-f30b2d5df262 tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.141819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cc2ede3-bdb7-45f6-ae00-f30b2d5df262 tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.151686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-62e027b8-4afb-46da-9b00-03ccfd500534 req-3e1d39ee-8d7a-4b8e-b2b8-f597b008d49d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.153841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-62e027b8-4afb-46da-9b00-03ccfd500534 req-3e1d39ee-8d7a-4b8e-b2b8-f597b008d49d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.184042 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-62e027b8-4afb-46da-9b00-03ccfd500534 req-3e1d39ee-8d7a-4b8e-b2b8-f597b008d49d service nova] Creating event network-vif-plugged:d246717b-c9f7-4d86-aa37-bd4aae4b26bf for instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f on n-h1-708768-8 Jul 26 20:16:27.196518 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-62e027b8-4afb-46da-9b00-03ccfd500534 req-3e1d39ee-8d7a-4b8e-b2b8-f597b008d49d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077299 Jul 26 20:16:27.204801 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2909/5725] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:27.381063 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4cc2ede3-bdb7-45f6-ae00-f30b2d5df262 tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1622 microversion: 2.1 time: 0.273496 Jul 26 20:16:27.383303 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2817/5726] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:27 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1622 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:27.404977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-986f502d-e025-4a2f-b82f-5057834923ae tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:27.406033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-986f502d-e025-4a2f-b82f-5057834923ae tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:27.413294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-986f502d-e025-4a2f-b82f-5057834923ae tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.414060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-986f502d-e025-4a2f-b82f-5057834923ae tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.415163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-986f502d-e025-4a2f-b82f-5057834923ae tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.415887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-986f502d-e025-4a2f-b82f-5057834923ae tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.505907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a0352aa-3e39-46c0-8e5c-aabda534f742 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:27.506566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a0352aa-3e39-46c0-8e5c-aabda534f742 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:27.513991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a0352aa-3e39-46c0-8e5c-aabda534f742 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.514447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a0352aa-3e39-46c0-8e5c-aabda534f742 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.515239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a0352aa-3e39-46c0-8e5c-aabda534f742 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.517146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a0352aa-3e39-46c0-8e5c-aabda534f742 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.592250 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-986f502d-e025-4a2f-b82f-5057834923ae tempest-TestSecurityGroupsBasicOps-1843947166 tempest-TestSecurityGroupsBasicOps-1843947166-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1911 microversion: 2.1 time: 0.193392 Jul 26 20:16:27.593396 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2910/5727] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:27 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1911 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:27.665367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9224e0ad-5be5-446f-9c37-fae2bfb2db72 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:27.666356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9224e0ad-5be5-446f-9c37-fae2bfb2db72 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:27.673801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9224e0ad-5be5-446f-9c37-fae2bfb2db72 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.678190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9224e0ad-5be5-446f-9c37-fae2bfb2db72 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.680594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9224e0ad-5be5-446f-9c37-fae2bfb2db72 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.681288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9224e0ad-5be5-446f-9c37-fae2bfb2db72 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.717476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a0352aa-3e39-46c0-8e5c-aabda534f742 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:27.727593 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a0352aa-3e39-46c0-8e5c-aabda534f742 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.225543 Jul 26 20:16:27.736040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9224e0ad-5be5-446f-9c37-fae2bfb2db72 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:16:27.740724 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2818/5728] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:27 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:27.838071 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9224e0ad-5be5-446f-9c37-fae2bfb2db72 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 204 len: 0 microversion: 2.1 time: 0.176157 Jul 26 20:16:27.843417 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2911/5729] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:16:27 2022] DELETE /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:16:27.848980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37d3e0c8-bc97-4e08-9128-f534f14a160d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:27.849857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37d3e0c8-bc97-4e08-9128-f534f14a160d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:27.858107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d3e0c8-bc97-4e08-9128-f534f14a160d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.858555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d3e0c8-bc97-4e08-9128-f534f14a160d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.859317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d3e0c8-bc97-4e08-9128-f534f14a160d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:27.859780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37d3e0c8-bc97-4e08-9128-f534f14a160d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:27.947167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-37d3e0c8-bc97-4e08-9128-f534f14a160d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:27.955899 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37d3e0c8-bc97-4e08-9128-f534f14a160d tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1477 microversion: 2.1 time: 0.111543 Jul 26 20:16:27.960953 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2819/5730] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:27 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1477 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:28.143063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1020b8fe-ebe1-430c-9207-c751c57d9114 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:28.144180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1020b8fe-ebe1-430c-9207-c751c57d9114 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:28.150851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1020b8fe-ebe1-430c-9207-c751c57d9114 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:28.151430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1020b8fe-ebe1-430c-9207-c751c57d9114 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:28.152295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1020b8fe-ebe1-430c-9207-c751c57d9114 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:28.152806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1020b8fe-ebe1-430c-9207-c751c57d9114 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:28.311718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1020b8fe-ebe1-430c-9207-c751c57d9114 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:28.324103 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1020b8fe-ebe1-430c-9207-c751c57d9114 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.187096 Jul 26 20:16:28.325118 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2912/5731] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:28 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:28.749798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9494287d-6cb0-4532-89cc-8ebc1ba65aeb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:28.751248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9494287d-6cb0-4532-89cc-8ebc1ba65aeb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:28.757522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9494287d-6cb0-4532-89cc-8ebc1ba65aeb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:28.757975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9494287d-6cb0-4532-89cc-8ebc1ba65aeb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:28.758752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9494287d-6cb0-4532-89cc-8ebc1ba65aeb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:28.759423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9494287d-6cb0-4532-89cc-8ebc1ba65aeb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:28.762223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:28.931728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9494287d-6cb0-4532-89cc-8ebc1ba65aeb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:28.941063 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9494287d-6cb0-4532-89cc-8ebc1ba65aeb tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1314 microversion: 2.1 time: 0.195119 Jul 26 20:16:28.941792 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2820/5732] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:28 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:28.979088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2ab3a83b-a2cc-4179-8128-30e30a3ba66c tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:28.979817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2ab3a83b-a2cc-4179-8128-30e30a3ba66c tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:28.988056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ab3a83b-a2cc-4179-8128-30e30a3ba66c tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:28.988391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ab3a83b-a2cc-4179-8128-30e30a3ba66c tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:28.989417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ab3a83b-a2cc-4179-8128-30e30a3ba66c tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:28.989640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2ab3a83b-a2cc-4179-8128-30e30a3ba66c tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:28.992650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:29.108954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2ab3a83b-a2cc-4179-8128-30e30a3ba66c tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:29.118941 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2ab3a83b-a2cc-4179-8128-30e30a3ba66c tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1477 microversion: 2.1 time: 0.144802 Jul 26 20:16:29.120816 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2913/5733] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:28 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1477 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:29.352548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7604e646-5202-4420-9c98-11c452b9b1ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:29.353270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7604e646-5202-4420-9c98-11c452b9b1ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:29.360368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7604e646-5202-4420-9c98-11c452b9b1ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:29.360817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7604e646-5202-4420-9c98-11c452b9b1ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:29.361604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7604e646-5202-4420-9c98-11c452b9b1ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:29.362046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7604e646-5202-4420-9c98-11c452b9b1ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:29.568576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7604e646-5202-4420-9c98-11c452b9b1ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:29.577523 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7604e646-5202-4420-9c98-11c452b9b1ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.229309 Jul 26 20:16:29.578119 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2821/5734] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:29 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:29.965510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-812c0b5d-a840-404a-8cd1-8cdb294767ac tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:29.966149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-812c0b5d-a840-404a-8cd1-8cdb294767ac tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:29.977709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-812c0b5d-a840-404a-8cd1-8cdb294767ac tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:29.978434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-812c0b5d-a840-404a-8cd1-8cdb294767ac tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:29.982060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-812c0b5d-a840-404a-8cd1-8cdb294767ac tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:29.983261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-812c0b5d-a840-404a-8cd1-8cdb294767ac tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.145563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f4525f8-0fc8-4b03-bbfb-e111d5ef845f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:30.147809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5f4525f8-0fc8-4b03-bbfb-e111d5ef845f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:30.164949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f4525f8-0fc8-4b03-bbfb-e111d5ef845f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.165799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f4525f8-0fc8-4b03-bbfb-e111d5ef845f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.167033 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f4525f8-0fc8-4b03-bbfb-e111d5ef845f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.169421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f4525f8-0fc8-4b03-bbfb-e111d5ef845f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.205998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-812c0b5d-a840-404a-8cd1-8cdb294767ac tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:30.226111 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-812c0b5d-a840-404a-8cd1-8cdb294767ac tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1499 microversion: 2.1 time: 0.264972 Jul 26 20:16:30.228208 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2914/5735] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:29 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1499 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:30.253381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-28ac3fb8-259c-4767-a922-8d018903f5c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:30.256263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-28ac3fb8-259c-4767-a922-8d018903f5c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:30.275381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28ac3fb8-259c-4767-a922-8d018903f5c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.275923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28ac3fb8-259c-4767-a922-8d018903f5c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.282665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28ac3fb8-259c-4767-a922-8d018903f5c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.283324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28ac3fb8-259c-4767-a922-8d018903f5c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.331978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5f4525f8-0fc8-4b03-bbfb-e111d5ef845f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:30.341923 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f4525f8-0fc8-4b03-bbfb-e111d5ef845f tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 200 len: 1477 microversion: 2.1 time: 0.200165 Jul 26 20:16:30.342524 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2822/5736] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:30 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:30.347196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1faefb4d-b854-4dec-822b-4f3df9e1637a req-03d941dd-9dce-49c0-ae81-685e8df0a306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9047d6f-2529-46e6-9ffe-52a4141aa1dd", "name": "network-vif-deleted", "tag": "4e64b978-05fa-40ae-a070-a310023932d4"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:30.371077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-28ac3fb8-259c-4767-a922-8d018903f5c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lazy-loading 'flavor' on Instance uuid 4f3af1a9-417c-44e7-8398-4ef25d43ad2f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:16:30.389919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1faefb4d-b854-4dec-822b-4f3df9e1637a req-03d941dd-9dce-49c0-ae81-685e8df0a306 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.390430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1faefb4d-b854-4dec-822b-4f3df9e1637a req-03d941dd-9dce-49c0-ae81-685e8df0a306 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.416530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1faefb4d-b854-4dec-822b-4f3df9e1637a req-03d941dd-9dce-49c0-ae81-685e8df0a306 service nova] Creating event network-vif-deleted:4e64b978-05fa-40ae-a070-a310023932d4 for instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd on n-h1-708768-8 Jul 26 20:16:30.423495 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1faefb4d-b854-4dec-822b-4f3df9e1637a req-03d941dd-9dce-49c0-ae81-685e8df0a306 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079608 Jul 26 20:16:30.424831 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2823/5737] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:30.518073 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-28ac3fb8-259c-4767-a922-8d018903f5c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "POST /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f/action" status: 200 len: 32 microversion: 2.1 time: 0.273979 Jul 26 20:16:30.519723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2915/5738] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:16:30 2022] POST /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:16:30.545101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28c71645-7535-4126-94c6-cba2b32b3949 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:30.548101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-28c71645-7535-4126-94c6-cba2b32b3949 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:30.556452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28c71645-7535-4126-94c6-cba2b32b3949 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.557236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28c71645-7535-4126-94c6-cba2b32b3949 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.558216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28c71645-7535-4126-94c6-cba2b32b3949 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.558827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28c71645-7535-4126-94c6-cba2b32b3949 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.601596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c28825bf-23b2-464d-a1ea-f08460291859 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:30.602581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c28825bf-23b2-464d-a1ea-f08460291859 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:30.618842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c28825bf-23b2-464d-a1ea-f08460291859 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.622323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c28825bf-23b2-464d-a1ea-f08460291859 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.625241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c28825bf-23b2-464d-a1ea-f08460291859 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:30.625697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c28825bf-23b2-464d-a1ea-f08460291859 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:30.868749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c28825bf-23b2-464d-a1ea-f08460291859 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:30.877283 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c28825bf-23b2-464d-a1ea-f08460291859 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.280266 Jul 26 20:16:30.893134 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2916/5739] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:30 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:30.920449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-28c71645-7535-4126-94c6-cba2b32b3949 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:30.930139 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-28c71645-7535-4126-94c6-cba2b32b3949 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.404403 Jul 26 20:16:30.931060 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2824/5740] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:30 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:31.363653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:31.364466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: c9047d6f-2529-46e6-9ffe-52a4141aa1dd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:31.372640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:31.373088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:31.373872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:31.374314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:31.401757 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] HTTP exception thrown: Instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd could not be found. Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Request method failure captured: Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd HTTP/1.1 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EslQoWaYn2sZqZD7sFQJgBnKSqmxXTv71ebaOFr7dBeEr1EMlos7Ca0G5_lCt7D-4rYxFoXobpWEtYmRSISaVN_gMxn5DYso57tzsBeOMs_TCpSPRzoe0TURopQPeUZkCoOs48eAXmMRgf_1NP31riwLrBfq04g2XEGFrlNcy8x3ao Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 75fe1e4cfc6d4292a74e5d0194e52134 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1872735265 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/75fe1e4cfc6d4292a74e5d0194e52134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75fe1e4cfc6d4292a74e5d0194e52134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_75fe1e4cfc6d4292a74e5d0194e52134", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75fe1e4cfc6d4292a74e5d0194e52134"}]}] Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1872735265 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 75fe1e4cfc6d4292a74e5d0194e52134 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1872735265 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestSecurityGroupsBasicOps-1872735265-project Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 3221f96786b94685a458669711c802b9 Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1872735265-project Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd could not be found. Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'c9047d6f-2529-46e6-9ffe-52a4141aa1dd'} Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd could not be found. Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd could not be found. Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:16:31.403886 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:16:31.410458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:16:31.410458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:16:31.410458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:16:31.410458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:16:31.410458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:16:31.410458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd could not be found. Jul 26 20:16:31.410458 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:16:31.412286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Returning 404 to user: Instance c9047d6f-2529-46e6-9ffe-52a4141aa1dd could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:16:31.413367 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c546f28e-d345-4118-8be1-bfa89e556441 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd" status: 404 len: 111 microversion: 2.1 time: 0.054795 Jul 26 20:16:31.422222 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2917/5741] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:31 2022] GET /compute/v2.1/servers/c9047d6f-2529-46e6-9ffe-52a4141aa1dd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:16:31.901360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d817415-3479-4a72-9beb-38749562824d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:31.902069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d817415-3479-4a72-9beb-38749562824d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:31.911912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d817415-3479-4a72-9beb-38749562824d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:31.912431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d817415-3479-4a72-9beb-38749562824d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:31.913677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d817415-3479-4a72-9beb-38749562824d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:31.914193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d817415-3479-4a72-9beb-38749562824d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:31.952179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82b60b76-1484-4453-8738-78190e9ce20a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:31.952791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82b60b76-1484-4453-8738-78190e9ce20a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:31.961165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82b60b76-1484-4453-8738-78190e9ce20a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:31.961624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82b60b76-1484-4453-8738-78190e9ce20a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:31.962412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82b60b76-1484-4453-8738-78190e9ce20a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:31.967132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82b60b76-1484-4453-8738-78190e9ce20a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:32.108599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d817415-3479-4a72-9beb-38749562824d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:32.118868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d817415-3479-4a72-9beb-38749562824d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.222754 Jul 26 20:16:32.128852 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2825/5742] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:31 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:32.637821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82b60b76-1484-4453-8738-78190e9ce20a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:32.645774 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82b60b76-1484-4453-8738-78190e9ce20a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.698182 Jul 26 20:16:32.653537 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2918/5743] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:31 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:33.141642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c2b70f41-8e82-4ed7-a4d4-ae537d00aa24 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:33.142994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c2b70f41-8e82-4ed7-a4d4-ae537d00aa24 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:33.152164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2b70f41-8e82-4ed7-a4d4-ae537d00aa24 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:33.152936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2b70f41-8e82-4ed7-a4d4-ae537d00aa24 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:33.154023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2b70f41-8e82-4ed7-a4d4-ae537d00aa24 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:33.154930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2b70f41-8e82-4ed7-a4d4-ae537d00aa24 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:33.354930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c2b70f41-8e82-4ed7-a4d4-ae537d00aa24 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:33.364195 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c2b70f41-8e82-4ed7-a4d4-ae537d00aa24 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.226579 Jul 26 20:16:33.365207 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2826/5744] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:33 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:33.666863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f24cfc8e-7b9e-4f29-98d0-86006bec20fd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:33.667684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f24cfc8e-7b9e-4f29-98d0-86006bec20fd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:33.681155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f24cfc8e-7b9e-4f29-98d0-86006bec20fd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:33.682396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f24cfc8e-7b9e-4f29-98d0-86006bec20fd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:33.684660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f24cfc8e-7b9e-4f29-98d0-86006bec20fd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:33.687013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f24cfc8e-7b9e-4f29-98d0-86006bec20fd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:34.204769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f24cfc8e-7b9e-4f29-98d0-86006bec20fd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:34.221495 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f24cfc8e-7b9e-4f29-98d0-86006bec20fd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.557543 Jul 26 20:16:34.222121 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2919/5745] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:33 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:34.386978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14d9cf16-9788-482e-9c9a-c5c2c0bc05c6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:34.387652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14d9cf16-9788-482e-9c9a-c5c2c0bc05c6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:34.402726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14d9cf16-9788-482e-9c9a-c5c2c0bc05c6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:34.403196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14d9cf16-9788-482e-9c9a-c5c2c0bc05c6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:34.424075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14d9cf16-9788-482e-9c9a-c5c2c0bc05c6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:34.424758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14d9cf16-9788-482e-9c9a-c5c2c0bc05c6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:34.786461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14d9cf16-9788-482e-9c9a-c5c2c0bc05c6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:34.820749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14d9cf16-9788-482e-9c9a-c5c2c0bc05c6 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.436500 Jul 26 20:16:34.825019 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2827/5746] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:34 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:35.243898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08eb5c73-04db-47a1-bb32-46bebb12dded tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:35.245277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-08eb5c73-04db-47a1-bb32-46bebb12dded tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:35.254951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08eb5c73-04db-47a1-bb32-46bebb12dded tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:35.255407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08eb5c73-04db-47a1-bb32-46bebb12dded tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:35.256225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08eb5c73-04db-47a1-bb32-46bebb12dded tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:35.256663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08eb5c73-04db-47a1-bb32-46bebb12dded tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:35.581525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-08eb5c73-04db-47a1-bb32-46bebb12dded tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:35.593010 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-08eb5c73-04db-47a1-bb32-46bebb12dded tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.353032 Jul 26 20:16:35.593938 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2920/5747] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:35 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:35.846049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8576aa26-2d3c-4af6-bcc8-7845b6765f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:35.846660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8576aa26-2d3c-4af6-bcc8-7845b6765f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:35.861707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8576aa26-2d3c-4af6-bcc8-7845b6765f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:35.862188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8576aa26-2d3c-4af6-bcc8-7845b6765f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:35.868989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8576aa26-2d3c-4af6-bcc8-7845b6765f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:35.870120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8576aa26-2d3c-4af6-bcc8-7845b6765f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:36.226714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8576aa26-2d3c-4af6-bcc8-7845b6765f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:36.246084 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8576aa26-2d3c-4af6-bcc8-7845b6765f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.403831 Jul 26 20:16:36.270713 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2828/5748] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:35 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:36.618280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-78cddcec-5e70-470f-af4f-d40aa0ed2dfc tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:36.629750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-78cddcec-5e70-470f-af4f-d40aa0ed2dfc tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:36.655861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78cddcec-5e70-470f-af4f-d40aa0ed2dfc tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:36.658401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78cddcec-5e70-470f-af4f-d40aa0ed2dfc tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:36.662534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78cddcec-5e70-470f-af4f-d40aa0ed2dfc tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:36.663812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78cddcec-5e70-470f-af4f-d40aa0ed2dfc tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:36.878747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-78cddcec-5e70-470f-af4f-d40aa0ed2dfc tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:36.887670 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-78cddcec-5e70-470f-af4f-d40aa0ed2dfc tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.274843 Jul 26 20:16:36.888258 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2921/5749] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:36 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:37.276138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6a4d1b83-225a-4f9c-b8a2-409898a39c8f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:37.279460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6a4d1b83-225a-4f9c-b8a2-409898a39c8f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:37.289768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a4d1b83-225a-4f9c-b8a2-409898a39c8f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:37.290697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a4d1b83-225a-4f9c-b8a2-409898a39c8f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:37.292214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a4d1b83-225a-4f9c-b8a2-409898a39c8f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:37.292906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6a4d1b83-225a-4f9c-b8a2-409898a39c8f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:37.501440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6a4d1b83-225a-4f9c-b8a2-409898a39c8f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:37.512423 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6a4d1b83-225a-4f9c-b8a2-409898a39c8f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.239998 Jul 26 20:16:37.528624 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2829/5750] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:37 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:37.652909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4cbc528-e6c8-49cc-aba6-5b82ffa7ae10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:37.653423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4cbc528-e6c8-49cc-aba6-5b82ffa7ae10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:37.668907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-cdb351a5-0fd1-42e4-a023-9c0e8694ce31 req-45f13fa5-b300-43c5-acff-f975466bbb42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f451a961-6f86-4496-a4a8-17d35625f345", "tag": "485b78f2-a796-4b62-b677-8a72329d48dc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:37.691199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cdb351a5-0fd1-42e4-a023-9c0e8694ce31 req-45f13fa5-b300-43c5-acff-f975466bbb42 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:37.692057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cdb351a5-0fd1-42e4-a023-9c0e8694ce31 req-45f13fa5-b300-43c5-acff-f975466bbb42 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:37.694853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4cbc528-e6c8-49cc-aba6-5b82ffa7ae10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:37.695474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4cbc528-e6c8-49cc-aba6-5b82ffa7ae10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:37.696548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4cbc528-e6c8-49cc-aba6-5b82ffa7ae10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:37.697064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4cbc528-e6c8-49cc-aba6-5b82ffa7ae10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:37.712918 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-cdb351a5-0fd1-42e4-a023-9c0e8694ce31 req-45f13fa5-b300-43c5-acff-f975466bbb42 service nova] Creating event network-changed:485b78f2-a796-4b62-b677-8a72329d48dc for instance f451a961-6f86-4496-a4a8-17d35625f345 on n-h2-708768-8 Jul 26 20:16:37.731694 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-cdb351a5-0fd1-42e4-a023-9c0e8694ce31 req-45f13fa5-b300-43c5-acff-f975466bbb42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066068 Jul 26 20:16:37.733595 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2830/5751] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:37.761916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4cbc528-e6c8-49cc-aba6-5b82ffa7ae10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:16:37.912804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-71d8f5de-c703-4e50-80d0-eb2267bcc71a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:37.913819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-71d8f5de-c703-4e50-80d0-eb2267bcc71a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:37.933709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:37.971730 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4cbc528-e6c8-49cc-aba6-5b82ffa7ae10 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 204 len: 0 microversion: 2.1 time: 0.304111 Jul 26 20:16:37.971963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71d8f5de-c703-4e50-80d0-eb2267bcc71a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:37.971963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71d8f5de-c703-4e50-80d0-eb2267bcc71a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:37.971963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71d8f5de-c703-4e50-80d0-eb2267bcc71a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:37.971963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-71d8f5de-c703-4e50-80d0-eb2267bcc71a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:37.997960 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2922/5752] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:16:37 2022] DELETE /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:16:38.013053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba9c231b-f3ad-4266-a76b-7ea63e931e54 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:38.036696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba9c231b-f3ad-4266-a76b-7ea63e931e54 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:38.048994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba9c231b-f3ad-4266-a76b-7ea63e931e54 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:38.056250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba9c231b-f3ad-4266-a76b-7ea63e931e54 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:38.059115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba9c231b-f3ad-4266-a76b-7ea63e931e54 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:38.059769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba9c231b-f3ad-4266-a76b-7ea63e931e54 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:38.161920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-71d8f5de-c703-4e50-80d0-eb2267bcc71a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:38.170813 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-71d8f5de-c703-4e50-80d0-eb2267bcc71a tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.263750 Jul 26 20:16:38.172963 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2831/5753] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:37 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:38.347938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba9c231b-f3ad-4266-a76b-7ea63e931e54 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:38.356656 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba9c231b-f3ad-4266-a76b-7ea63e931e54 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1766 microversion: 2.1 time: 0.350762 Jul 26 20:16:38.371466 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2923/5754] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:38 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1766 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:38.537104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ef45f64-9fa4-4ee1-b842-67eaf598e0ef tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:38.537721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ef45f64-9fa4-4ee1-b842-67eaf598e0ef tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:38.549473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ef45f64-9fa4-4ee1-b842-67eaf598e0ef tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:38.560606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ef45f64-9fa4-4ee1-b842-67eaf598e0ef tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:38.561809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ef45f64-9fa4-4ee1-b842-67eaf598e0ef tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:38.562472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ef45f64-9fa4-4ee1-b842-67eaf598e0ef tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:38.776611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ef45f64-9fa4-4ee1-b842-67eaf598e0ef tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:38.790887 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ef45f64-9fa4-4ee1-b842-67eaf598e0ef tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.258348 Jul 26 20:16:38.792299 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2832/5755] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:38 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:39.202687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-168779db-66e2-4421-a24b-b7967df41a44 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:39.204110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-168779db-66e2-4421-a24b-b7967df41a44 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:39.214084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-168779db-66e2-4421-a24b-b7967df41a44 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:39.214953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-168779db-66e2-4421-a24b-b7967df41a44 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:39.216026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-168779db-66e2-4421-a24b-b7967df41a44 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:39.216717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-168779db-66e2-4421-a24b-b7967df41a44 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:39.401526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1f18ccb8-9dce-407d-83a0-4b8149b45a89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:39.402688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1f18ccb8-9dce-407d-83a0-4b8149b45a89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:39.420824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f18ccb8-9dce-407d-83a0-4b8149b45a89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:39.421613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f18ccb8-9dce-407d-83a0-4b8149b45a89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:39.422730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f18ccb8-9dce-407d-83a0-4b8149b45a89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:39.424492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1f18ccb8-9dce-407d-83a0-4b8149b45a89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:39.632180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-168779db-66e2-4421-a24b-b7967df41a44 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:39.645092 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-168779db-66e2-4421-a24b-b7967df41a44 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.445736 Jul 26 20:16:39.645092 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2924/5756] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:39 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:39.834490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c16f1e2b-f84e-408a-a309-2f0109f40200 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:39.836784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c16f1e2b-f84e-408a-a309-2f0109f40200 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:39.878367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c16f1e2b-f84e-408a-a309-2f0109f40200 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:39.879067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c16f1e2b-f84e-408a-a309-2f0109f40200 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:39.880077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c16f1e2b-f84e-408a-a309-2f0109f40200 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:39.881988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c16f1e2b-f84e-408a-a309-2f0109f40200 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:40.024335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1f18ccb8-9dce-407d-83a0-4b8149b45a89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3221f96786b94685a458669711c802b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe1e4cfc6d4292a74e5d0194e52134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:40.033631 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1f18ccb8-9dce-407d-83a0-4b8149b45a89 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 200 len: 1766 microversion: 2.1 time: 0.656394 Jul 26 20:16:40.034800 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2833/5757] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:39 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 1766 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:40.202135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c16f1e2b-f84e-408a-a309-2f0109f40200 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:40.210526 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c16f1e2b-f84e-408a-a309-2f0109f40200 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.400427 Jul 26 20:16:40.211279 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2925/5758] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:39 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:40.368785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-eace1d33-81ce-4452-a7da-013df2875ec2 req-93f42d09-6e50-4e46-b523-8355e9dcb638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f451a961-6f86-4496-a4a8-17d35625f345", "name": "network-vif-deleted", "tag": "485b78f2-a796-4b62-b677-8a72329d48dc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:40.379894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-eace1d33-81ce-4452-a7da-013df2875ec2 req-93f42d09-6e50-4e46-b523-8355e9dcb638 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:40.380337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-eace1d33-81ce-4452-a7da-013df2875ec2 req-93f42d09-6e50-4e46-b523-8355e9dcb638 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:40.392665 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-eace1d33-81ce-4452-a7da-013df2875ec2 req-93f42d09-6e50-4e46-b523-8355e9dcb638 service nova] Creating event network-vif-deleted:485b78f2-a796-4b62-b677-8a72329d48dc for instance f451a961-6f86-4496-a4a8-17d35625f345 on n-h2-708768-8 Jul 26 20:16:40.397725 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-eace1d33-81ce-4452-a7da-013df2875ec2 req-93f42d09-6e50-4e46-b523-8355e9dcb638 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Jul 26 20:16:40.398331 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2834/5759] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:40.671824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-010c0df6-f30b-4678-88b6-4a988009e79f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:40.672456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-010c0df6-f30b-4678-88b6-4a988009e79f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:40.679425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-010c0df6-f30b-4678-88b6-4a988009e79f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:40.680241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-010c0df6-f30b-4678-88b6-4a988009e79f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:40.681101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-010c0df6-f30b-4678-88b6-4a988009e79f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:40.681551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-010c0df6-f30b-4678-88b6-4a988009e79f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:40.873450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-010c0df6-f30b-4678-88b6-4a988009e79f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:40.875826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:40.887840 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-010c0df6-f30b-4678-88b6-4a988009e79f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.219741 Jul 26 20:16:40.903262 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2926/5760] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:40 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:41.059363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:41.060211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] [instance: f451a961-6f86-4496-a4a8-17d35625f345] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:41.081264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:41.081701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:41.082712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:41.083487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:41.101071 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] HTTP exception thrown: Instance f451a961-6f86-4496-a4a8-17d35625f345 could not be found. Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Request method failure captured: Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 HTTP/1.1 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EslQoWaYn2sZqZD7sFQJgBnKSqmxXTv71ebaOFr7dBeEr1EMlos7Ca0G5_lCt7D-4rYxFoXobpWEtYmRSISaVN_gMxn5DYso57tzsBeOMs_TCpSPRzoe0TURopQPeUZkCoOs48eAXmMRgf_1NP31riwLrBfq04g2XEGFrlNcy8x3ao Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 75fe1e4cfc6d4292a74e5d0194e52134 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1872735265 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/75fe1e4cfc6d4292a74e5d0194e52134"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75fe1e4cfc6d4292a74e5d0194e52134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_75fe1e4cfc6d4292a74e5d0194e52134", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/75fe1e4cfc6d4292a74e5d0194e52134"}]}] Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1872735265 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 75fe1e4cfc6d4292a74e5d0194e52134 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1872735265 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestSecurityGroupsBasicOps-1872735265-project Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 3221f96786b94685a458669711c802b9 Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1872735265-project Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f451a961-6f86-4496-a4a8-17d35625f345 could not be found. Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f451a961-6f86-4496-a4a8-17d35625f345'} Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f451a961-6f86-4496-a4a8-17d35625f345 could not be found. Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f451a961-6f86-4496-a4a8-17d35625f345 could not be found. Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:16:41.103172 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:16:41.108627 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:16:41.108627 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:16:41.108627 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:16:41.108627 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:16:41.108627 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:16:41.108627 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f451a961-6f86-4496-a4a8-17d35625f345 could not be found. Jul 26 20:16:41.108627 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:16:41.110289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Returning 404 to user: Instance f451a961-6f86-4496-a4a8-17d35625f345 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:16:41.111313 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f564cc0e-96da-4ab3-a08b-84be1f7532b2 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345" status: 404 len: 111 microversion: 2.1 time: 0.057166 Jul 26 20:16:41.115468 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2835/5761] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:41 2022] GET /compute/v2.1/servers/f451a961-6f86-4496-a4a8-17d35625f345 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:16:41.233737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd029d04-1711-4830-a002-6ba55f150543 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:41.234445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd029d04-1711-4830-a002-6ba55f150543 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:41.245094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd029d04-1711-4830-a002-6ba55f150543 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:41.248258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd029d04-1711-4830-a002-6ba55f150543 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:41.249672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd029d04-1711-4830-a002-6ba55f150543 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:41.250093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd029d04-1711-4830-a002-6ba55f150543 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:41.512379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd029d04-1711-4830-a002-6ba55f150543 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:41.528101 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd029d04-1711-4830-a002-6ba55f150543 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.299483 Jul 26 20:16:41.528988 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2927/5762] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:41 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:41.910462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae7941b8-d3bb-4176-a8a8-217aee3f5900 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:41.911066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ae7941b8-d3bb-4176-a8a8-217aee3f5900 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:41.918335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae7941b8-d3bb-4176-a8a8-217aee3f5900 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:41.918786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae7941b8-d3bb-4176-a8a8-217aee3f5900 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:41.919571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae7941b8-d3bb-4176-a8a8-217aee3f5900 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:41.920028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae7941b8-d3bb-4176-a8a8-217aee3f5900 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:42.237064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ae7941b8-d3bb-4176-a8a8-217aee3f5900 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:42.254277 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ae7941b8-d3bb-4176-a8a8-217aee3f5900 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.346872 Jul 26 20:16:42.257026 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2836/5763] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:41 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:42.552124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4869853-9a82-4363-9bc4-6d69770d6b53 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:42.553667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b4869853-9a82-4363-9bc4-6d69770d6b53 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:42.567126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4869853-9a82-4363-9bc4-6d69770d6b53 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:42.567930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4869853-9a82-4363-9bc4-6d69770d6b53 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:42.568923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4869853-9a82-4363-9bc4-6d69770d6b53 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:42.569740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4869853-9a82-4363-9bc4-6d69770d6b53 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:42.975588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b4869853-9a82-4363-9bc4-6d69770d6b53 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:43.011514 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4869853-9a82-4363-9bc4-6d69770d6b53 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1721 microversion: 2.1 time: 0.464829 Jul 26 20:16:43.019699 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2928/5764] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:42 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1721 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:43.279402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-38800e7c-a78e-4794-bb04-45167d9830b1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:43.280749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-38800e7c-a78e-4794-bb04-45167d9830b1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:43.293763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38800e7c-a78e-4794-bb04-45167d9830b1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:43.294214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38800e7c-a78e-4794-bb04-45167d9830b1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:43.295010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38800e7c-a78e-4794-bb04-45167d9830b1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:43.295689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-38800e7c-a78e-4794-bb04-45167d9830b1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:43.449021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-38800e7c-a78e-4794-bb04-45167d9830b1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:43.457307 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-38800e7c-a78e-4794-bb04-45167d9830b1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.182870 Jul 26 20:16:43.459326 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2837/5765] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:43 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:44.041733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9bcc7aba-20e7-407a-9cd7-e419f3202f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:44.048676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9bcc7aba-20e7-407a-9cd7-e419f3202f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:44.068283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bcc7aba-20e7-407a-9cd7-e419f3202f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:44.069096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bcc7aba-20e7-407a-9cd7-e419f3202f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:44.070100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bcc7aba-20e7-407a-9cd7-e419f3202f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:44.071281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bcc7aba-20e7-407a-9cd7-e419f3202f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:44.364931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9bcc7aba-20e7-407a-9cd7-e419f3202f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:44.382728 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9bcc7aba-20e7-407a-9cd7-e419f3202f1e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1698 microversion: 2.1 time: 0.345396 Jul 26 20:16:44.398428 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2929/5766] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:44 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1698 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:44.407171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-49549e68-8594-4cf6-b6c3-6ac43b4d972d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:44.417750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49549e68-8594-4cf6-b6c3-6ac43b4d972d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:44.426346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49549e68-8594-4cf6-b6c3-6ac43b4d972d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:44.469303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-49549e68-8594-4cf6-b6c3-6ac43b4d972d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Going to try to start instance {{(pid=125963) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 20:16:44.485842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0167feda-a031-4163-80c5-3b5888f8db6e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:44.486776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0167feda-a031-4163-80c5-3b5888f8db6e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:44.498707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0167feda-a031-4163-80c5-3b5888f8db6e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:44.499167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0167feda-a031-4163-80c5-3b5888f8db6e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:44.500891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0167feda-a031-4163-80c5-3b5888f8db6e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:44.501332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0167feda-a031-4163-80c5-3b5888f8db6e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:44.528691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:44.571000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-49549e68-8594-4cf6-b6c3-6ac43b4d972d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/action" status: 202 len: 0 microversion: 2.1 time: 0.165143 Jul 26 20:16:44.575846 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2838/5767] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:16:44 2022] POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:16:44.587590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ff3afa0-164d-46b0-83b3-cd93a9f0d4ba tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:44.590330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ff3afa0-164d-46b0-83b3-cd93a9f0d4ba tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:44.605036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ff3afa0-164d-46b0-83b3-cd93a9f0d4ba tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:44.607604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ff3afa0-164d-46b0-83b3-cd93a9f0d4ba tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:44.609863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ff3afa0-164d-46b0-83b3-cd93a9f0d4ba tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:44.611600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ff3afa0-164d-46b0-83b3-cd93a9f0d4ba tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:45.121939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ff3afa0-164d-46b0-83b3-cd93a9f0d4ba tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:45.139348 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ff3afa0-164d-46b0-83b3-cd93a9f0d4ba tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1707 microversion: 2.1 time: 0.561956 Jul 26 20:16:45.139988 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2839/5768] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:44 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1707 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:45.218055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0167feda-a031-4163-80c5-3b5888f8db6e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:45.227709 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0167feda-a031-4163-80c5-3b5888f8db6e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.748991 Jul 26 20:16:45.228305 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2930/5769] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:44 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:46.162977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de2497e3-9a19-4397-a8ad-10e19736e4a9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:46.169041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de2497e3-9a19-4397-a8ad-10e19736e4a9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:46.186467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de2497e3-9a19-4397-a8ad-10e19736e4a9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:46.187289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de2497e3-9a19-4397-a8ad-10e19736e4a9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:46.188354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de2497e3-9a19-4397-a8ad-10e19736e4a9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:46.189019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de2497e3-9a19-4397-a8ad-10e19736e4a9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:46.250831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-70e5c369-f8aa-4251-9bc7-7415ac6380c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:46.254733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-70e5c369-f8aa-4251-9bc7-7415ac6380c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:46.271043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70e5c369-f8aa-4251-9bc7-7415ac6380c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:46.271817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70e5c369-f8aa-4251-9bc7-7415ac6380c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:46.272851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70e5c369-f8aa-4251-9bc7-7415ac6380c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:46.275456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70e5c369-f8aa-4251-9bc7-7415ac6380c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:46.711629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-70e5c369-f8aa-4251-9bc7-7415ac6380c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:46.722944 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-70e5c369-f8aa-4251-9bc7-7415ac6380c6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.475707 Jul 26 20:16:46.725920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-de2497e3-9a19-4397-a8ad-10e19736e4a9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:46.728303 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2931/5770] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:46 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:16:46.735917 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de2497e3-9a19-4397-a8ad-10e19736e4a9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1707 microversion: 2.1 time: 0.578799 Jul 26 20:16:46.736511 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2840/5771] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:46 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1707 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:47.127329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5986fdce-910a-4763-bf8a-53edc943dbe3 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] Calling method '.version_select at 0x7f8756604a60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:47.156199 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5986fdce-910a-4763-bf8a-53edc943dbe3 tempest-TestSecurityGroupsBasicOps-1872735265 tempest-TestSecurityGroupsBasicOps-1872735265-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1140950452" status: 202 len: 0 microversion: 2.1 time: 0.037264 Jul 26 20:16:47.157575 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2932/5772] 10.222.0.58 () {58 vars in 1278 bytes} [Tue Jul 26 20:16:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1140950452 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:16:47.745725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-16e8bd4c-808c-4d58-8a47-f59b6cb90f79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:47.746350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-16e8bd4c-808c-4d58-8a47-f59b6cb90f79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:47.759202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c354aeb4-8122-4c2e-b55b-cc80817d6ed5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:47.760518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c354aeb4-8122-4c2e-b55b-cc80817d6ed5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:47.770786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16e8bd4c-808c-4d58-8a47-f59b6cb90f79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:47.771600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16e8bd4c-808c-4d58-8a47-f59b6cb90f79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:47.772684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16e8bd4c-808c-4d58-8a47-f59b6cb90f79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:47.773884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-16e8bd4c-808c-4d58-8a47-f59b6cb90f79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:47.774675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c354aeb4-8122-4c2e-b55b-cc80817d6ed5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:47.776393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c354aeb4-8122-4c2e-b55b-cc80817d6ed5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:47.778368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c354aeb4-8122-4c2e-b55b-cc80817d6ed5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:47.781319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c354aeb4-8122-4c2e-b55b-cc80817d6ed5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:48.150733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c354aeb4-8122-4c2e-b55b-cc80817d6ed5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:48.161373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c354aeb4-8122-4c2e-b55b-cc80817d6ed5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1711 microversion: 2.1 time: 0.406945 Jul 26 20:16:48.177828 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2933/5773] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:47 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1711 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:48.206556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-16e8bd4c-808c-4d58-8a47-f59b6cb90f79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:48.234499 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-16e8bd4c-808c-4d58-8a47-f59b6cb90f79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.493499 Jul 26 20:16:48.235116 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2841/5774] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:47 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:49.267937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b17cde98-817d-422e-8453-b715dfe82218 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:49.269091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b17cde98-817d-422e-8453-b715dfe82218 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:49.292670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b17cde98-817d-422e-8453-b715dfe82218 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:49.293146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b17cde98-817d-422e-8453-b715dfe82218 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:49.294007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b17cde98-817d-422e-8453-b715dfe82218 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:49.298896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b17cde98-817d-422e-8453-b715dfe82218 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:49.487757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b17cde98-817d-422e-8453-b715dfe82218 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:49.504255 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b17cde98-817d-422e-8453-b715dfe82218 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.246911 Jul 26 20:16:49.504867 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2934/5775] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:49 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:49.837930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5572df7b-84bd-4cb0-9861-9960c1c52669 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:49.838723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5572df7b-84bd-4cb0-9861-9960c1c52669 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:49.851026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5572df7b-84bd-4cb0-9861-9960c1c52669 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:49.851736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5572df7b-84bd-4cb0-9861-9960c1c52669 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:49.852737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5572df7b-84bd-4cb0-9861-9960c1c52669 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:49.853240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5572df7b-84bd-4cb0-9861-9960c1c52669 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:49.978288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-5572df7b-84bd-4cb0-9861-9960c1c52669 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lazy-loading 'services' on Instance uuid 1544d688-3d30-43c9-8b72-0232f88ae818 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:16:50.070318 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5572df7b-84bd-4cb0-9861-9960c1c52669 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818/os-volume_attachments/319ac569-a1e1-497e-ac60-c85390b03c0c" status: 202 len: 0 microversion: 2.1 time: 0.236649 Jul 26 20:16:50.071492 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2842/5776] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:16:49 2022] DELETE /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818/os-volume_attachments/319ac569-a1e1-497e-ac60-c85390b03c0c => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:16:50.526739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6e8da2a6-e590-4f8f-bf04-301018f45679 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:50.527374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6e8da2a6-e590-4f8f-bf04-301018f45679 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:50.534887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e8da2a6-e590-4f8f-bf04-301018f45679 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:50.535537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e8da2a6-e590-4f8f-bf04-301018f45679 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:50.536435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e8da2a6-e590-4f8f-bf04-301018f45679 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:50.537020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e8da2a6-e590-4f8f-bf04-301018f45679 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:50.720625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6e8da2a6-e590-4f8f-bf04-301018f45679 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:50.728626 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6e8da2a6-e590-4f8f-bf04-301018f45679 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.206270 Jul 26 20:16:50.745853 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2935/5777] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:50 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:51.751287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c1f62b3-2626-4d50-a2a8-582e2d4f8221 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:51.752691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c1f62b3-2626-4d50-a2a8-582e2d4f8221 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:51.768057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c1f62b3-2626-4d50-a2a8-582e2d4f8221 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:51.768792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c1f62b3-2626-4d50-a2a8-582e2d4f8221 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:51.769815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c1f62b3-2626-4d50-a2a8-582e2d4f8221 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:51.770449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c1f62b3-2626-4d50-a2a8-582e2d4f8221 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:52.328616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c1f62b3-2626-4d50-a2a8-582e2d4f8221 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:52.358866 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c1f62b3-2626-4d50-a2a8-582e2d4f8221 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.611810 Jul 26 20:16:52.377302 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2843/5778] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:51 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:53.390358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d726cc9-b5ce-41b5-bdaf-1ce78a1a967f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:53.391600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d726cc9-b5ce-41b5-bdaf-1ce78a1a967f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:53.422899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d726cc9-b5ce-41b5-bdaf-1ce78a1a967f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:53.423544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d726cc9-b5ce-41b5-bdaf-1ce78a1a967f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:53.424536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d726cc9-b5ce-41b5-bdaf-1ce78a1a967f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:53.425141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d726cc9-b5ce-41b5-bdaf-1ce78a1a967f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:53.718801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d726cc9-b5ce-41b5-bdaf-1ce78a1a967f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:53.733189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d726cc9-b5ce-41b5-bdaf-1ce78a1a967f tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.351861 Jul 26 20:16:53.750962 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2936/5779] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:53 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:54.762316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e15d9e51-5ed1-42f0-96b9-54f988d733ef tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:54.764248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e15d9e51-5ed1-42f0-96b9-54f988d733ef tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:54.773844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e15d9e51-5ed1-42f0-96b9-54f988d733ef tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:54.775103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e15d9e51-5ed1-42f0-96b9-54f988d733ef tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:54.777835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e15d9e51-5ed1-42f0-96b9-54f988d733ef tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:54.778467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e15d9e51-5ed1-42f0-96b9-54f988d733ef tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:55.040732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e15d9e51-5ed1-42f0-96b9-54f988d733ef tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:55.053060 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e15d9e51-5ed1-42f0-96b9-54f988d733ef tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.298000 Jul 26 20:16:55.056105 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2844/5780] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:54 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:56.082125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9849f7f3-0887-4362-8eae-4c2871f8b63d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:56.083720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9849f7f3-0887-4362-8eae-4c2871f8b63d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:56.094146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9849f7f3-0887-4362-8eae-4c2871f8b63d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:56.094995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9849f7f3-0887-4362-8eae-4c2871f8b63d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:56.096750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9849f7f3-0887-4362-8eae-4c2871f8b63d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:56.097418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9849f7f3-0887-4362-8eae-4c2871f8b63d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:56.318779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9849f7f3-0887-4362-8eae-4c2871f8b63d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:56.327148 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9849f7f3-0887-4362-8eae-4c2871f8b63d tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.249361 Jul 26 20:16:56.327772 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2937/5781] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:56 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:56.819731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fce3d79a-6383-452f-aeb5-32da3fd68f42 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:56.820330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fce3d79a-6383-452f-aeb5-32da3fd68f42 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:56.827294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fce3d79a-6383-452f-aeb5-32da3fd68f42 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:56.827799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fce3d79a-6383-452f-aeb5-32da3fd68f42 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:56.828610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fce3d79a-6383-452f-aeb5-32da3fd68f42 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:56.829053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fce3d79a-6383-452f-aeb5-32da3fd68f42 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:56.856810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fce3d79a-6383-452f-aeb5-32da3fd68f42 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:16:56.962360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fce3d79a-6383-452f-aeb5-32da3fd68f42 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 204 len: 0 microversion: 2.1 time: 0.146334 Jul 26 20:16:56.964137 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2845/5782] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:16:56 2022] DELETE /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:16:56.972761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c0a765e4-5fc4-421d-83b0-0650e5164d26 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:56.973709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c0a765e4-5fc4-421d-83b0-0650e5164d26 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:56.983154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0a765e4-5fc4-421d-83b0-0650e5164d26 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:56.983755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0a765e4-5fc4-421d-83b0-0650e5164d26 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:56.984647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0a765e4-5fc4-421d-83b0-0650e5164d26 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:56.985214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0a765e4-5fc4-421d-83b0-0650e5164d26 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:57.159762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c0a765e4-5fc4-421d-83b0-0650e5164d26 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:57.168993 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c0a765e4-5fc4-421d-83b0-0650e5164d26 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1513 microversion: 2.1 time: 0.200353 Jul 26 20:16:57.179779 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2938/5783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:56 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:57.360501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-92f5fa4b-6c5d-42f8-b373-e3a9d1c4eb26 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:57.364466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-92f5fa4b-6c5d-42f8-b373-e3a9d1c4eb26 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:57.375556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:16:57.378123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92f5fa4b-6c5d-42f8-b373-e3a9d1c4eb26 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:57.380616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92f5fa4b-6c5d-42f8-b373-e3a9d1c4eb26 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:57.381757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92f5fa4b-6c5d-42f8-b373-e3a9d1c4eb26 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:57.382833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92f5fa4b-6c5d-42f8-b373-e3a9d1c4eb26 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:57.649757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-92f5fa4b-6c5d-42f8-b373-e3a9d1c4eb26 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:57.659406 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-92f5fa4b-6c5d-42f8-b373-e3a9d1c4eb26 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.313121 Jul 26 20:16:57.673751 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2846/5784] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:57 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:58.192122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a59bad47-57fa-45d4-bde4-fa764f7cd049 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:58.193388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a59bad47-57fa-45d4-bde4-fa764f7cd049 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:58.201278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a59bad47-57fa-45d4-bde4-fa764f7cd049 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:58.201733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a59bad47-57fa-45d4-bde4-fa764f7cd049 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:58.202693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a59bad47-57fa-45d4-bde4-fa764f7cd049 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:58.204412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a59bad47-57fa-45d4-bde4-fa764f7cd049 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:58.401792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a59bad47-57fa-45d4-bde4-fa764f7cd049 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:58.410065 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a59bad47-57fa-45d4-bde4-fa764f7cd049 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1513 microversion: 2.1 time: 0.221819 Jul 26 20:16:58.410762 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2939/5785] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:58 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:58.682842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-398a3ed1-bba6-4c68-8459-d6e1ad1fe1dd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:58.684421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-398a3ed1-bba6-4c68-8459-d6e1ad1fe1dd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:58.695158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-398a3ed1-bba6-4c68-8459-d6e1ad1fe1dd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:58.700119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-398a3ed1-bba6-4c68-8459-d6e1ad1fe1dd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:58.701461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-398a3ed1-bba6-4c68-8459-d6e1ad1fe1dd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:58.702123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-398a3ed1-bba6-4c68-8459-d6e1ad1fe1dd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:58.983177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-398a3ed1-bba6-4c68-8459-d6e1ad1fe1dd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:59.012743 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-398a3ed1-bba6-4c68-8459-d6e1ad1fe1dd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.335021 Jul 26 20:16:59.020637 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2847/5786] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:58 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:16:59.287508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6bdbc82a-2c47-49c1-b813-496156d322e0 req-95f7dbf3-cb74-49f7-b7ec-2e950c329a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1544d688-3d30-43c9-8b72-0232f88ae818", "name": "network-vif-deleted", "tag": "d838bc36-5b29-488a-981e-b40770f2e65b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:16:59.339970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6bdbc82a-2c47-49c1-b813-496156d322e0 req-95f7dbf3-cb74-49f7-b7ec-2e950c329a79 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:59.340441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6bdbc82a-2c47-49c1-b813-496156d322e0 req-95f7dbf3-cb74-49f7-b7ec-2e950c329a79 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:59.359953 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6bdbc82a-2c47-49c1-b813-496156d322e0 req-95f7dbf3-cb74-49f7-b7ec-2e950c329a79 service nova] Creating event network-vif-deleted:d838bc36-5b29-488a-981e-b40770f2e65b for instance 1544d688-3d30-43c9-8b72-0232f88ae818 on n-h2-708768-8 Jul 26 20:16:59.378817 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6bdbc82a-2c47-49c1-b813-496156d322e0 req-95f7dbf3-cb74-49f7-b7ec-2e950c329a79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090741 Jul 26 20:16:59.385266 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2940/5787] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:16:59.440003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:16:59.440705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:16:59.460325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:59.465563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:59.466476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:59.468112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:59.560863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:16:59.561314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:16:59.563128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lazy-loading 'fault' on Instance uuid 1544d688-3d30-43c9-8b72-0232f88ae818 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:16:59.609136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc75b56f29924188b32973a9a2ba1f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641c01c7142e4eaeb6a9cd7ea37d26dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:16:59.626270 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a9247de9-4907-46d8-ba28-6d81ddfe7831 tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 200 len: 1309 microversion: 2.1 time: 0.196671 Jul 26 20:16:59.627115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2848/5788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:16:59 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:00.044415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c8d958a0-8c2d-49d4-a2b5-6b0abdb79292 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:00.047031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c8d958a0-8c2d-49d4-a2b5-6b0abdb79292 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:00.054505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8d958a0-8c2d-49d4-a2b5-6b0abdb79292 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:00.055602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8d958a0-8c2d-49d4-a2b5-6b0abdb79292 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:00.056853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8d958a0-8c2d-49d4-a2b5-6b0abdb79292 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:00.057551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c8d958a0-8c2d-49d4-a2b5-6b0abdb79292 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:00.225100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c8d958a0-8c2d-49d4-a2b5-6b0abdb79292 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:00.235576 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c8d958a0-8c2d-49d4-a2b5-6b0abdb79292 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1485 microversion: 2.1 time: 0.193640 Jul 26 20:17:00.237686 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2941/5789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:00 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1485 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:00.257672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-50df5d7b-f263-4bc6-b5d3-4e44cc67c0a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:00.259513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-50df5d7b-f263-4bc6-b5d3-4e44cc67c0a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:00.268177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50df5d7b-f263-4bc6-b5d3-4e44cc67c0a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:00.269039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50df5d7b-f263-4bc6-b5d3-4e44cc67c0a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:00.270058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50df5d7b-f263-4bc6-b5d3-4e44cc67c0a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:00.270728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50df5d7b-f263-4bc6-b5d3-4e44cc67c0a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:00.364990 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-50df5d7b-f263-4bc6-b5d3-4e44cc67c0a5 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "POST /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f/action" status: 202 len: 0 microversion: 2.1 time: 0.111164 Jul 26 20:17:00.366757 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2849/5790] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:17:00 2022] POST /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:17:00.375259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bff58dff-3486-485f-aebc-93f7645a2a63 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:00.376561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bff58dff-3486-485f-aebc-93f7645a2a63 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:00.384221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bff58dff-3486-485f-aebc-93f7645a2a63 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:00.385877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bff58dff-3486-485f-aebc-93f7645a2a63 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:00.386953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bff58dff-3486-485f-aebc-93f7645a2a63 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:00.387668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bff58dff-3486-485f-aebc-93f7645a2a63 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:00.544567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bff58dff-3486-485f-aebc-93f7645a2a63 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:00.552689 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bff58dff-3486-485f-aebc-93f7645a2a63 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1493 microversion: 2.1 time: 0.181290 Jul 26 20:17:00.553344 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2942/5791] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:00 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1493 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:00.648945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:00.650071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] [instance: 1544d688-3d30-43c9-8b72-0232f88ae818] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:00.664533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:00.665084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:00.666501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:00.667077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:00.683950 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] HTTP exception thrown: Instance 1544d688-3d30-43c9-8b72-0232f88ae818 could not be found. Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Request method failure captured: Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 HTTP/1.1 Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EqfLICOiXoFVV5obcZAgYFtHe24vZAwJ0mOmnJdTMp1b0cVcujcoLG2JRQV_gKnDDpd8c-_qk2vuxzZHMbw2rZt6sRW_9NRkN3GucDJ6y3-8SBU0IKsvTGbyLcfEXP8c8w0DqnEiEYYXBMdkfHic2qVZSyTTqlyGXJgZu73qQnh1KU Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 641c01c7142e4eaeb6a9cd7ea37d26dd Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesSnapshotTestJSON-757006942 Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/641c01c7142e4eaeb6a9cd7ea37d26dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/641c01c7142e4eaeb6a9cd7ea37d26dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_641c01c7142e4eaeb6a9cd7ea37d26dd", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/641c01c7142e4eaeb6a9cd7ea37d26dd"}]}] Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesSnapshotTestJSON-757006942 Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 641c01c7142e4eaeb6a9cd7ea37d26dd Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-757006942 Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesSnapshotTestJSON-757006942-project Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: fc75b56f29924188b32973a9a2ba1f9f Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesSnapshotTestJSON-757006942-project Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 1544d688-3d30-43c9-8b72-0232f88ae818 could not be found. Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '1544d688-3d30-43c9-8b72-0232f88ae818'} Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1544d688-3d30-43c9-8b72-0232f88ae818 could not be found. Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1544d688-3d30-43c9-8b72-0232f88ae818 could not be found. Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:17:00.685692 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1544d688-3d30-43c9-8b72-0232f88ae818 could not be found. Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] Returning 404 to user: Instance 1544d688-3d30-43c9-8b72-0232f88ae818 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8342e7e2-7912-47c5-92a2-f17db508ddea tempest-VolumesSnapshotTestJSON-757006942 tempest-VolumesSnapshotTestJSON-757006942-project] 10.222.0.58 "GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818" status: 404 len: 111 microversion: 2.1 time: 0.042550 Jul 26 20:17:00.694441 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2850/5792] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:00 2022] GET /compute/v2.1/servers/1544d688-3d30-43c9-8b72-0232f88ae818 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:17:01.576177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-93118bcb-43f6-4277-802d-e9d6a046c3bd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:01.576790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-93118bcb-43f6-4277-802d-e9d6a046c3bd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:01.595471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93118bcb-43f6-4277-802d-e9d6a046c3bd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:01.595978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93118bcb-43f6-4277-802d-e9d6a046c3bd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:01.596809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93118bcb-43f6-4277-802d-e9d6a046c3bd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:01.597476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93118bcb-43f6-4277-802d-e9d6a046c3bd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:01.808950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-93118bcb-43f6-4277-802d-e9d6a046c3bd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:01.817621 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-93118bcb-43f6-4277-802d-e9d6a046c3bd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1493 microversion: 2.1 time: 0.247018 Jul 26 20:17:01.824406 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2943/5793] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:01 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1493 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:02.848697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fde5ba9c-10ca-44cd-8f91-ef93dacbfa9e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:02.849922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fde5ba9c-10ca-44cd-8f91-ef93dacbfa9e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:02.863699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fde5ba9c-10ca-44cd-8f91-ef93dacbfa9e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:02.864565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fde5ba9c-10ca-44cd-8f91-ef93dacbfa9e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:02.865718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fde5ba9c-10ca-44cd-8f91-ef93dacbfa9e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:02.866845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fde5ba9c-10ca-44cd-8f91-ef93dacbfa9e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:03.071327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fde5ba9c-10ca-44cd-8f91-ef93dacbfa9e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:03.079041 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fde5ba9c-10ca-44cd-8f91-ef93dacbfa9e tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1499 microversion: 2.1 time: 0.242353 Jul 26 20:17:03.079637 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2851/5794] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:02 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1499 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:03.106774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7b32e6f-cb82-4b0b-98b6-ae36e6c68c79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:03.107231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c7b32e6f-cb82-4b0b-98b6-ae36e6c68c79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:03.113901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7b32e6f-cb82-4b0b-98b6-ae36e6c68c79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:03.114356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7b32e6f-cb82-4b0b-98b6-ae36e6c68c79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:03.115133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7b32e6f-cb82-4b0b-98b6-ae36e6c68c79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:03.116119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7b32e6f-cb82-4b0b-98b6-ae36e6c68c79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:03.146385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c7b32e6f-cb82-4b0b-98b6-ae36e6c68c79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:17:03.162377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:03.266715 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c7b32e6f-cb82-4b0b-98b6-ae36e6c68c79 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 204 len: 0 microversion: 2.1 time: 0.163110 Jul 26 20:17:03.270320 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2944/5795] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:17:03 2022] DELETE /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:17:03.276483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-964ccfd4-d7eb-493f-9c6c-75209220ddbd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:03.277238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-964ccfd4-d7eb-493f-9c6c-75209220ddbd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:03.287082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-964ccfd4-d7eb-493f-9c6c-75209220ddbd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:03.287670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-964ccfd4-d7eb-493f-9c6c-75209220ddbd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:03.288345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-964ccfd4-d7eb-493f-9c6c-75209220ddbd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:03.288786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-964ccfd4-d7eb-493f-9c6c-75209220ddbd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:03.292396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:03.552432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-964ccfd4-d7eb-493f-9c6c-75209220ddbd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:03.580450 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-964ccfd4-d7eb-493f-9c6c-75209220ddbd tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.308717 Jul 26 20:17:03.581451 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2852/5796] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:03 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:04.604906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e84528bb-2162-4a18-8a81-f0938a35ebb6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:04.606435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e84528bb-2162-4a18-8a81-f0938a35ebb6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:04.616953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e84528bb-2162-4a18-8a81-f0938a35ebb6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:04.617721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e84528bb-2162-4a18-8a81-f0938a35ebb6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:04.618713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e84528bb-2162-4a18-8a81-f0938a35ebb6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:04.619655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e84528bb-2162-4a18-8a81-f0938a35ebb6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:04.808333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e84528bb-2162-4a18-8a81-f0938a35ebb6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:04.822186 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e84528bb-2162-4a18-8a81-f0938a35ebb6 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.223338 Jul 26 20:17:04.823698 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2945/5797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:04 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:05.852387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1cd8f679-7a30-4063-8170-c00360740701 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:05.853014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1cd8f679-7a30-4063-8170-c00360740701 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:05.860913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cd8f679-7a30-4063-8170-c00360740701 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:05.861358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cd8f679-7a30-4063-8170-c00360740701 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:05.862151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cd8f679-7a30-4063-8170-c00360740701 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:05.862586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cd8f679-7a30-4063-8170-c00360740701 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:06.013126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1cd8f679-7a30-4063-8170-c00360740701 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:06.030075 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1cd8f679-7a30-4063-8170-c00360740701 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1505 microversion: 2.1 time: 0.181655 Jul 26 20:17:06.038563 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2853/5798] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:05 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:06.631580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e03cfba0-1bef-49f9-9d57-0807f71a12cf req-420098e3-db96-4626-9548-1d2d94615d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3af1a9-417c-44e7-8398-4ef25d43ad2f", "name": "network-vif-deleted", "tag": "d246717b-c9f7-4d86-aa37-bd4aae4b26bf"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:06.645734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e03cfba0-1bef-49f9-9d57-0807f71a12cf req-420098e3-db96-4626-9548-1d2d94615d2d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:06.646630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e03cfba0-1bef-49f9-9d57-0807f71a12cf req-420098e3-db96-4626-9548-1d2d94615d2d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:06.661650 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e03cfba0-1bef-49f9-9d57-0807f71a12cf req-420098e3-db96-4626-9548-1d2d94615d2d service nova] Creating event network-vif-deleted:d246717b-c9f7-4d86-aa37-bd4aae4b26bf for instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f on n-h1-708768-8 Jul 26 20:17:06.667847 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e03cfba0-1bef-49f9-9d57-0807f71a12cf req-420098e3-db96-4626-9548-1d2d94615d2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042421 Jul 26 20:17:06.668731 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2946/5799] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:17:07.058647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:07.059275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:07.068205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:07.068663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:07.069452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:07.069900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:07.142416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:07.143106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:07.143831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lazy-loading 'fault' on Instance uuid 4f3af1a9-417c-44e7-8398-4ef25d43ad2f {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:17:07.231400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:07.250324 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ca8ae0e5-36d1-4613-9e62-2c527bea1e62 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 200 len: 1304 microversion: 2.1 time: 0.195721 Jul 26 20:17:07.251718 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2854/5800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:07 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 1304 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:08.274371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:08.276002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 4f3af1a9-417c-44e7-8398-4ef25d43ad2f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:08.279337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:08.284377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:08.284876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:08.286012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:08.286524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:08.302976 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] HTTP exception thrown: Instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f could not be found. Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Request method failure captured: Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f HTTP/1.1 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ete0w0vMZm30z9KwdC-mPbXJlXDbWPm3kj1oeRYr3v7eF4GpcFVrRtKv3OlvRVnZQBtMwXwztcQ8EnkOOc0yZlMEKOXIr_jMfoeqH1tX_aQMk8_89uiigZXzJ1BKkYHUUhlR7oIPTmtjEXa5zp1wFqf6nWk32pdJi4pQREsb5T_PUo Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a4c24400e9b14379a6df5970e9d68002 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerRescueTestJSON-1205084461 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a4c24400e9b14379a6df5970e9d68002"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4c24400e9b14379a6df5970e9d68002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a4c24400e9b14379a6df5970e9d68002", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4c24400e9b14379a6df5970e9d68002"}]}] Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerRescueTestJSON-1205084461 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a4c24400e9b14379a6df5970e9d68002 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerRescueTestJSON-1205084461 Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerRescueTestJSON-1205084461-project Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 40681f18e62a405a87481253fbe843bd Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerRescueTestJSON-1205084461-project Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f could not be found. Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '4f3af1a9-417c-44e7-8398-4ef25d43ad2f'} Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f could not be found. Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f could not be found. Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:17:08.304780 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f could not be found. Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Returning 404 to user: Instance 4f3af1a9-417c-44e7-8398-4ef25d43ad2f could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5078d7a7-d8e8-485b-9c71-dbd5b72d28da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f" status: 404 len: 111 microversion: 2.1 time: 0.037737 Jul 26 20:17:08.315230 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2947/5801] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:08 2022] GET /compute/v2.1/servers/4f3af1a9-417c-44e7-8398-4ef25d43ad2f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:17:08.316683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4789922-ec0d-4781-9921-c4f9461a2c57 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:08.317209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4789922-ec0d-4781-9921-c4f9461a2c57 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:08.324993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4789922-ec0d-4781-9921-c4f9461a2c57 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:08.325452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4789922-ec0d-4781-9921-c4f9461a2c57 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:08.326229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4789922-ec0d-4781-9921-c4f9461a2c57 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:08.326663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4789922-ec0d-4781-9921-c4f9461a2c57 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:08.352506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4789922-ec0d-4781-9921-c4f9461a2c57 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:17:08.440208 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4789922-ec0d-4781-9921-c4f9461a2c57 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 204 len: 0 microversion: 2.1 time: 0.127291 Jul 26 20:17:08.441022 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2855/5802] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:17:08 2022] DELETE /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:17:08.452051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b3056b99-9146-4f9e-a534-f9d2079f84e1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:08.453035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b3056b99-9146-4f9e-a534-f9d2079f84e1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:08.460276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3056b99-9146-4f9e-a534-f9d2079f84e1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:08.460732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3056b99-9146-4f9e-a534-f9d2079f84e1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:08.461514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3056b99-9146-4f9e-a534-f9d2079f84e1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:08.461951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b3056b99-9146-4f9e-a534-f9d2079f84e1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:08.615821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b3056b99-9146-4f9e-a534-f9d2079f84e1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:08.625415 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b3056b99-9146-4f9e-a534-f9d2079f84e1 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1490 microversion: 2.1 time: 0.178985 Jul 26 20:17:08.626000 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2948/5803] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:08 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1490 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:09.648514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8f48266f-a901-40f3-a9a0-8946ebd7a6a8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:09.649962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8f48266f-a901-40f3-a9a0-8946ebd7a6a8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:09.661911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f48266f-a901-40f3-a9a0-8946ebd7a6a8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:09.666507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f48266f-a901-40f3-a9a0-8946ebd7a6a8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:09.667324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f48266f-a901-40f3-a9a0-8946ebd7a6a8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:09.668073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8f48266f-a901-40f3-a9a0-8946ebd7a6a8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:09.846398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8f48266f-a901-40f3-a9a0-8946ebd7a6a8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:09.854610 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8f48266f-a901-40f3-a9a0-8946ebd7a6a8 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1490 microversion: 2.1 time: 0.210380 Jul 26 20:17:09.856423 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2856/5804] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:09 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1490 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:17:10.877119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd8d3090-0c89-4ffe-9a16-97522d2c7a93 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:10.878448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd8d3090-0c89-4ffe-9a16-97522d2c7a93 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:10.890411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd8d3090-0c89-4ffe-9a16-97522d2c7a93 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:10.891279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd8d3090-0c89-4ffe-9a16-97522d2c7a93 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:10.892355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd8d3090-0c89-4ffe-9a16-97522d2c7a93 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:10.896367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd8d3090-0c89-4ffe-9a16-97522d2c7a93 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:11.118445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bd8d3090-0c89-4ffe-9a16-97522d2c7a93 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40681f18e62a405a87481253fbe843bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c24400e9b14379a6df5970e9d68002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:11.130662 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd8d3090-0c89-4ffe-9a16-97522d2c7a93 tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 200 len: 1490 microversion: 2.1 time: 0.254000 Jul 26 20:17:11.139528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-098b21a0-7c9f-4931-b8d7-b9158ff72915 req-f8fa802a-2723-4e8e-9899-bd34019d617c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d", "name": "network-vif-deleted", "tag": "a1fc5856-305e-424c-8d98-0c3d9a008755"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:11.147837 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2949/5805] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:10 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 1490 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:11.150669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-098b21a0-7c9f-4931-b8d7-b9158ff72915 req-f8fa802a-2723-4e8e-9899-bd34019d617c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:11.151116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-098b21a0-7c9f-4931-b8d7-b9158ff72915 req-f8fa802a-2723-4e8e-9899-bd34019d617c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:11.165308 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-098b21a0-7c9f-4931-b8d7-b9158ff72915 req-f8fa802a-2723-4e8e-9899-bd34019d617c service nova] Creating event network-vif-deleted:a1fc5856-305e-424c-8d98-0c3d9a008755 for instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d on n-h1-708768-8 Jul 26 20:17:11.172356 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-098b21a0-7c9f-4931-b8d7-b9158ff72915 req-f8fa802a-2723-4e8e-9899-bd34019d617c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038737 Jul 26 20:17:11.173499 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2857/5806] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:12.151466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:12.152689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] [instance: 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:12.160119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:12.160762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:12.161699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:12.162289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:12.178445 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] HTTP exception thrown: Instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d could not be found. Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Request method failure captured: Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d HTTP/1.1 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ete0w0vMZm30z9KwdC-mPbXJlXDbWPm3kj1oeRYr3v7eF4GpcFVrRtKv3OlvRVnZQBtMwXwztcQ8EnkOOc0yZlMEKOXIr_jMfoeqH1tX_aQMk8_89uiigZXzJ1BKkYHUUhlR7oIPTmtjEXa5zp1wFqf6nWk32pdJi4pQREsb5T_PUo Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a4c24400e9b14379a6df5970e9d68002 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerRescueTestJSON-1205084461 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a4c24400e9b14379a6df5970e9d68002"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4c24400e9b14379a6df5970e9d68002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a4c24400e9b14379a6df5970e9d68002", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4c24400e9b14379a6df5970e9d68002"}]}] Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerRescueTestJSON-1205084461 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a4c24400e9b14379a6df5970e9d68002 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerRescueTestJSON-1205084461 Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerRescueTestJSON-1205084461-project Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 40681f18e62a405a87481253fbe843bd Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerRescueTestJSON-1205084461-project Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d could not be found. Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d'} Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d could not be found. Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d could not be found. Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:17:12.180681 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d could not be found. Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] Returning 404 to user: Instance 0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c0d57d05-9e68-46d0-8042-c9e9a58d37da tempest-ServerRescueTestJSON-1205084461 tempest-ServerRescueTestJSON-1205084461-project] 10.222.0.58 "GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d" status: 404 len: 111 microversion: 2.1 time: 0.035476 Jul 26 20:17:12.194048 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2950/5807] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:12 2022] GET /compute/v2.1/servers/0d07cc5f-8c6a-40c3-a5c1-1d4fff5b993d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:17:21.246888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:21.248474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:21.259527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30b8a731-80dc-455a-b054-0295a457a74b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:21.262395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30b8a731-80dc-455a-b054-0295a457a74b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:21.289325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30b8a731-80dc-455a-b054-0295a457a74b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:21.289325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30b8a731-80dc-455a-b054-0295a457a74b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:21.289325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30b8a731-80dc-455a-b054-0295a457a74b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:21.289325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30b8a731-80dc-455a-b054-0295a457a74b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:21.405721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-30b8a731-80dc-455a-b054-0295a457a74b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lazy-loading 'services' on Instance uuid d744cf68-c058-4eb6-8e8a-4e97b7a16f09 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:17:21.507226 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-30b8a731-80dc-455a-b054-0295a457a74b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/os-volume_attachments/abda1f18-cb98-4ae0-8022-c4963563fb12" status: 202 len: 0 microversion: 2.1 time: 0.264974 Jul 26 20:17:21.511231 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2858/5808] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:17:21 2022] DELETE /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/os-volume_attachments/abda1f18-cb98-4ae0-8022-c4963563fb12 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:17:28.281672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47aaf922-c57f-4d9b-957a-a58fc40f75ca tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:28.285672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=7 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:28.287382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:28.299967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47aaf922-c57f-4d9b-957a-a58fc40f75ca tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:28.300678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47aaf922-c57f-4d9b-957a-a58fc40f75ca tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:28.350782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47aaf922-c57f-4d9b-957a-a58fc40f75ca tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Going to try to stop instance {{(pid=125964) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:17:28.449959 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47aaf922-c57f-4d9b-957a-a58fc40f75ca tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/action" status: 202 len: 0 microversion: 2.1 time: 0.166109 Jul 26 20:17:28.451851 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2951/5809] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:17:28 2022] POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:17:28.461911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-070349c5-922d-4cc2-9618-be9c25bbf72c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:28.463401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-070349c5-922d-4cc2-9618-be9c25bbf72c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:28.472273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-070349c5-922d-4cc2-9618-be9c25bbf72c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:28.472976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-070349c5-922d-4cc2-9618-be9c25bbf72c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:28.473939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-070349c5-922d-4cc2-9618-be9c25bbf72c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:28.474541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-070349c5-922d-4cc2-9618-be9c25bbf72c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:28.784946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-070349c5-922d-4cc2-9618-be9c25bbf72c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:28.807835 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-070349c5-922d-4cc2-9618-be9c25bbf72c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1675 microversion: 2.1 time: 0.351430 Jul 26 20:17:28.826136 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2859/5810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:28 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1675 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:29.838827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d570edf2-8f27-4c02-bd7f-46e5d1d4b57f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:29.840840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d570edf2-8f27-4c02-bd7f-46e5d1d4b57f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:29.856179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d570edf2-8f27-4c02-bd7f-46e5d1d4b57f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:29.856870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d570edf2-8f27-4c02-bd7f-46e5d1d4b57f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:29.858078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d570edf2-8f27-4c02-bd7f-46e5d1d4b57f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:29.858690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d570edf2-8f27-4c02-bd7f-46e5d1d4b57f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:30.205867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d570edf2-8f27-4c02-bd7f-46e5d1d4b57f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:30.215755 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d570edf2-8f27-4c02-bd7f-46e5d1d4b57f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1675 microversion: 2.1 time: 0.381531 Jul 26 20:17:30.216529 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2952/5811] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:29 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1675 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:31.242632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8e6cb8c2-866e-46ff-b302-011ab3741a79 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:31.243266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8e6cb8c2-866e-46ff-b302-011ab3741a79 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:31.261507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e6cb8c2-866e-46ff-b302-011ab3741a79 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:31.263972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e6cb8c2-866e-46ff-b302-011ab3741a79 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:31.265158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e6cb8c2-866e-46ff-b302-011ab3741a79 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:31.266914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8e6cb8c2-866e-46ff-b302-011ab3741a79 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:31.617596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8e6cb8c2-866e-46ff-b302-011ab3741a79 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:31.630021 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8e6cb8c2-866e-46ff-b302-011ab3741a79 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1675 microversion: 2.1 time: 0.392755 Jul 26 20:17:31.644728 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2860/5812] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:31 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1675 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:32.656092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b77b48e0-9895-4cc0-988b-7f87083a7257 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:32.656717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b77b48e0-9895-4cc0-988b-7f87083a7257 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:32.669393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b77b48e0-9895-4cc0-988b-7f87083a7257 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:32.671119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b77b48e0-9895-4cc0-988b-7f87083a7257 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:32.672156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b77b48e0-9895-4cc0-988b-7f87083a7257 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:32.672769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b77b48e0-9895-4cc0-988b-7f87083a7257 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:32.978709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b77b48e0-9895-4cc0-988b-7f87083a7257 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:32.987110 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b77b48e0-9895-4cc0-988b-7f87083a7257 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1675 microversion: 2.1 time: 0.335923 Jul 26 20:17:32.989523 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2953/5813] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:32 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1675 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:34.010526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-13caf8c5-3f81-42ab-90d5-5f90dc237624 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:34.011181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-13caf8c5-3f81-42ab-90d5-5f90dc237624 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:34.028151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13caf8c5-3f81-42ab-90d5-5f90dc237624 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:34.035268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13caf8c5-3f81-42ab-90d5-5f90dc237624 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:34.038936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13caf8c5-3f81-42ab-90d5-5f90dc237624 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:34.040362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13caf8c5-3f81-42ab-90d5-5f90dc237624 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:34.235267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-13caf8c5-3f81-42ab-90d5-5f90dc237624 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:34.247037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-13caf8c5-3f81-42ab-90d5-5f90dc237624 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1675 microversion: 2.1 time: 0.240575 Jul 26 20:17:34.247924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2861/5814] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:34 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:35.272475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1fe4697d-5776-4d94-a694-e253b7c4db64 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:35.273024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1fe4697d-5776-4d94-a694-e253b7c4db64 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:35.290354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fe4697d-5776-4d94-a694-e253b7c4db64 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:35.292569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fe4697d-5776-4d94-a694-e253b7c4db64 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:35.294237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fe4697d-5776-4d94-a694-e253b7c4db64 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:35.296182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fe4697d-5776-4d94-a694-e253b7c4db64 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:35.613027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1fe4697d-5776-4d94-a694-e253b7c4db64 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:35.628130 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1fe4697d-5776-4d94-a694-e253b7c4db64 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1675 microversion: 2.1 time: 0.361720 Jul 26 20:17:35.643415 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2954/5815] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:35 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1675 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:36.656704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5002d10-604d-4407-8875-c524d7b54d33 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:36.657346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a5002d10-604d-4407-8875-c524d7b54d33 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:36.671370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5002d10-604d-4407-8875-c524d7b54d33 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:36.682520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5002d10-604d-4407-8875-c524d7b54d33 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:36.683395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5002d10-604d-4407-8875-c524d7b54d33 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:36.683866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5002d10-604d-4407-8875-c524d7b54d33 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:37.451432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a5002d10-604d-4407-8875-c524d7b54d33 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:37.464397 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5002d10-604d-4407-8875-c524d7b54d33 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1675 microversion: 2.1 time: 0.813684 Jul 26 20:17:37.468459 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2862/5816] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:36 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1675 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:38.495657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-004d00ea-50c5-4531-aecd-c7556db545be tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:38.496439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-004d00ea-50c5-4531-aecd-c7556db545be tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:38.513348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-004d00ea-50c5-4531-aecd-c7556db545be tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:38.513885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-004d00ea-50c5-4531-aecd-c7556db545be tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:38.515699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-004d00ea-50c5-4531-aecd-c7556db545be tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:38.522570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-004d00ea-50c5-4531-aecd-c7556db545be tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:38.907960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-004d00ea-50c5-4531-aecd-c7556db545be tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:38.933956 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-004d00ea-50c5-4531-aecd-c7556db545be tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1675 microversion: 2.1 time: 0.445299 Jul 26 20:17:38.934685 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2955/5817] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:38 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1675 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:39.960936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-05872347-9bbd-4515-b2cb-b3f295615bd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:39.962470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-05872347-9bbd-4515-b2cb-b3f295615bd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:39.977182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05872347-9bbd-4515-b2cb-b3f295615bd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:39.977674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05872347-9bbd-4515-b2cb-b3f295615bd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:39.981558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05872347-9bbd-4515-b2cb-b3f295615bd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:39.982028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-05872347-9bbd-4515-b2cb-b3f295615bd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:40.332577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-05872347-9bbd-4515-b2cb-b3f295615bd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:40.345693 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-05872347-9bbd-4515-b2cb-b3f295615bd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1652 microversion: 2.1 time: 0.388703 Jul 26 20:17:40.348813 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2863/5818] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:39 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1652 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:40.377061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d06caa1a-c6c8-41a9-8357-549babd364df tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:40.402727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d06caa1a-c6c8-41a9-8357-549babd364df tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:40.403511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d06caa1a-c6c8-41a9-8357-549babd364df tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:40.453200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d06caa1a-c6c8-41a9-8357-549babd364df tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Going to try to start instance {{(pid=125964) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 20:17:40.564240 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d06caa1a-c6c8-41a9-8357-549babd364df tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/action" status: 202 len: 0 microversion: 2.1 time: 0.193971 Jul 26 20:17:40.564975 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2956/5819] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:17:40 2022] POST /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:17:40.574677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7f967c18-b573-4b45-bed2-84d81e1b8793 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:40.575228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7f967c18-b573-4b45-bed2-84d81e1b8793 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:40.586152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f967c18-b573-4b45-bed2-84d81e1b8793 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:40.588060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f967c18-b573-4b45-bed2-84d81e1b8793 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:40.589942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f967c18-b573-4b45-bed2-84d81e1b8793 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:40.591356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7f967c18-b573-4b45-bed2-84d81e1b8793 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:41.442526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7f967c18-b573-4b45-bed2-84d81e1b8793 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:41.451536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7f967c18-b573-4b45-bed2-84d81e1b8793 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1661 microversion: 2.1 time: 0.881081 Jul 26 20:17:41.452586 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2864/5820] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:40 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1661 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:42.292867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff57bc25-9216-4f42-a540-bf60a7770db5 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-582964392", "availability_zone": "foo_zone"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:42.298229 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:42.298229 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:17:42.301265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.aggregate [None req-ff57bc25-9216-4f42-a540-bf60a7770db5 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Generated uuid c09d61e0-dc21-48de-af3c-88ceeb1a5d9b for aggregate {{(pid=125964) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 20:17:42.350149 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff57bc25-9216-4f42-a540-bf60a7770db5 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.298177 Jul 26 20:17:42.351223 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2957/5821] 10.222.0.58 () {60 vars in 1164 bytes} [Tue Jul 26 20:17:42 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:42.367150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3d8cd919-1d58-4c5e-a22f-4566768690d0 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:42.370799 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:42.370799 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 20:17:42.413667 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3d8cd919-1d58-4c5e-a22f-4566768690d0 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.054523 Jul 26 20:17:42.416684 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2865/5822] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 20:17:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:42.445815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96f087b6-c4d2-4b0c-94af-5782e5fadcc9 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:42.450590 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:42.450590 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:17:42.453912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96f087b6-c4d2-4b0c-94af-5782e5fadcc9 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:42.454373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96f087b6-c4d2-4b0c-94af-5782e5fadcc9 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:42.455182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96f087b6-c4d2-4b0c-94af-5782e5fadcc9 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:42.458953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96f087b6-c4d2-4b0c-94af-5782e5fadcc9 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:42.474164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-19f8d421-f865-434e-895e-f30c6400b9a1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:42.476174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-19f8d421-f865-434e-895e-f30c6400b9a1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:42.486567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19f8d421-f865-434e-895e-f30c6400b9a1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:42.493021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19f8d421-f865-434e-895e-f30c6400b9a1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:42.494963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19f8d421-f865-434e-895e-f30c6400b9a1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:42.495571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19f8d421-f865-434e-895e-f30c6400b9a1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:42.509136 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96f087b6-c4d2-4b0c-94af-5782e5fadcc9 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085184 Jul 26 20:17:42.510358 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2958/5823] 10.222.0.58 () {58 vars in 1176 bytes} [Tue Jul 26 20:17:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:42.547656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7b8d567c-b732-4eeb-b743-cd35bffc8863 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:42.549636 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:42.549636 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:17:42.558634 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7b8d567c-b732-4eeb-b743-cd35bffc8863 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.034443 Jul 26 20:17:42.559488 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2959/5824] 10.222.0.58 () {58 vars in 1143 bytes} [Tue Jul 26 20:17:42 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:42.573714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3b092f91-8443-4e83-9a68-6f40c16a8493 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-708768-8"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:42.582390 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:42.582390 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:17:42.605255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b092f91-8443-4e83-9a68-6f40c16a8493 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:42.605969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b092f91-8443-4e83-9a68-6f40c16a8493 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:42.826830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-19f8d421-f865-434e-895e-f30c6400b9a1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:42.841459 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-19f8d421-f865-434e-895e-f30c6400b9a1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1661 microversion: 2.1 time: 0.371391 Jul 26 20:17:42.847021 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2866/5825] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:42 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1661 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:17:43.093167 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3b092f91-8443-4e83-9a68-6f40c16a8493 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.525803 Jul 26 20:17:43.094883 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2960/5826] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 20:17:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:17:43.105809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e7c371fa-8992-42b8-8363-65498b1804f6 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:43.107292 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:43.107292 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 20:17:43.115366 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e7c371fa-8992-42b8-8363-65498b1804f6 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.013705 Jul 26 20:17:43.122872 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2867/5827] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:17:43 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:43.128503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d35f6819-ebaa-44cd-9ead-56648af0f638 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1248603018", "availability_zone": "foo_zone"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:43.132503 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:43.132503 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:17:43.185145 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d35f6819-ebaa-44cd-9ead-56648af0f638 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.060364 Jul 26 20:17:43.192357 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2961/5828] 10.222.0.58 () {60 vars in 1173 bytes} [Tue Jul 26 20:17:43 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:43.198853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dc0eb191-fd9f-4548-8ad5-89484d52850f tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:43.202151 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:43.202151 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 20:17:43.242249 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dc0eb191-fd9f-4548-8ad5-89484d52850f tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.048590 Jul 26 20:17:43.245179 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2868/5829] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 20:17:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:43.256182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-effd0e73-ab16-4522-b9ac-c86a4ca7468c tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:43.257084 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:43.257084 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:17:43.283440 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-effd0e73-ab16-4522-b9ac-c86a4ca7468c tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.031396 Jul 26 20:17:43.296503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ddfbb88-b5d1-44fb-bec1-6e58a08087bc tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-708768-8"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:43.299124 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:43.299124 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 20:17:43.300635 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2962/5830] 10.222.0.58 () {58 vars in 1152 bytes} [Tue Jul 26 20:17:43 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:43.310566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ddfbb88-b5d1-44fb-bec1-6e58a08087bc tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:43.311032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ddfbb88-b5d1-44fb-bec1-6e58a08087bc tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:43.659235 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ddfbb88-b5d1-44fb-bec1-6e58a08087bc tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.366684 Jul 26 20:17:43.661364 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2869/5831] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Jul 26 20:17:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:17:43.672694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a842c8a8-ddbf-45b0-91c3-b9927c9c9715 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:43.673525 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:17:43.673525 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:17:43.710895 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a842c8a8-ddbf-45b0-91c3-b9927c9c9715 tempest-TestAggregatesBasicOps-28932267 tempest-TestAggregatesBasicOps-28932267-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.041829 Jul 26 20:17:43.724101 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2963/5832] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Jul 26 20:17:43 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 20:17:43.862960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e46ad238-67e7-495c-ae6f-7871d43ef4c9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:17:43.863578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e46ad238-67e7-495c-ae6f-7871d43ef4c9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:17:43.872589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e46ad238-67e7-495c-ae6f-7871d43ef4c9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:43.873048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e46ad238-67e7-495c-ae6f-7871d43ef4c9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:43.873842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e46ad238-67e7-495c-ae6f-7871d43ef4c9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:17:43.876906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e46ad238-67e7-495c-ae6f-7871d43ef4c9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:17:44.262199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e46ad238-67e7-495c-ae6f-7871d43ef4c9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:17:44.272929 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e46ad238-67e7-495c-ae6f-7871d43ef4c9 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1665 microversion: 2.1 time: 0.414371 Jul 26 20:17:44.273540 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2870/5833] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:17:43 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1665 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:17:56.993865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:56.995485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:56.996603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:17:57.238082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-054afda6-3b75-4d5a-a4bf-a60f262015fe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'create', calling method: .version_select at 0x7f8756e32160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-178706905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWOJU9rZnB7WRjq2QxPgjM+vsQEYYiWuQeTTZw9ZwwK0P3qh0CfTBaN/9h5sNOwUjzFgdjNgp8NcofvyEHaCTPrGDOPfxE0UUs5XpDdUWk0IxPi7qenm+RG7rog4ZIdg=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:17:57.255757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-054afda6-3b75-4d5a-a4bf-a60f262015fe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:17:57.263261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-054afda6-3b75-4d5a-a4bf-a60f262015fe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for user 65245c71525848afaf82742412b31a8a and project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:17:57.291644 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-054afda6-3b75-4d5a-a4bf-a60f262015fe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.303176 Jul 26 20:17:57.292462 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2964/5834] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:17:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:05.967247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1727523697", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "d48ae6d7-0600-4d55-9be0-de2739aba714"}], "key_name": "tempest-TestNetworkAdvancedServerOps-178706905", "security_groups": [{"name": "tempest-secgroup-smoke-1861742742"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:05.981657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:05.982941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:06.142794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] validate_networks() for [('d48ae6d7-0600-4d55-9be0-de2739aba714', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:18:06.824433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:18:06.824946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:18:06.825490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:18:06.825973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:18:06.826457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:18:06.861947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:06.862491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:06.863310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:06.863777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:06.886220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:18:06.897433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for user 65245c71525848afaf82742412b31a8a and project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:18:06.915968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:18:06.918597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:18:07.012822 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-35a7fc53-c770-453c-990a-1fa66ae9f111 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.049415 Jul 26 20:18:07.015193 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2871/5835] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:18:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:18:07.032265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3fc60e9b-672f-4bed-aa73-57a13eb0b54a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:07.033544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3fc60e9b-672f-4bed-aa73-57a13eb0b54a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:07.210878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3fc60e9b-672f-4bed-aa73-57a13eb0b54a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:07.226434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3fc60e9b-672f-4bed-aa73-57a13eb0b54a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1266 microversion: 2.1 time: 0.199076 Jul 26 20:18:07.227536 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2965/5836] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:07 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:08.252669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e4e58ae1-d969-4e46-a6eb-0331e4fa5ccc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:08.254802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e4e58ae1-d969-4e46-a6eb-0331e4fa5ccc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:08.268535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4e58ae1-d969-4e46-a6eb-0331e4fa5ccc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:08.269491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4e58ae1-d969-4e46-a6eb-0331e4fa5ccc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:08.271589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4e58ae1-d969-4e46-a6eb-0331e4fa5ccc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:08.272421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e4e58ae1-d969-4e46-a6eb-0331e4fa5ccc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:08.362673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e4e58ae1-d969-4e46-a6eb-0331e4fa5ccc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:08.373236 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e4e58ae1-d969-4e46-a6eb-0331e4fa5ccc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1318 microversion: 2.1 time: 0.126536 Jul 26 20:18:08.374011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2872/5837] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:08 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1318 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:09.394592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7dd83ea1-860c-46a3-af54-a3b793752510 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:09.395862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7dd83ea1-860c-46a3-af54-a3b793752510 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:09.405256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dd83ea1-860c-46a3-af54-a3b793752510 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:09.406562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dd83ea1-860c-46a3-af54-a3b793752510 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:09.407560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dd83ea1-860c-46a3-af54-a3b793752510 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:09.408224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7dd83ea1-860c-46a3-af54-a3b793752510 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:09.831582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7dd83ea1-860c-46a3-af54-a3b793752510 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:09.844954 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7dd83ea1-860c-46a3-af54-a3b793752510 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1324 microversion: 2.1 time: 0.454251 Jul 26 20:18:09.847888 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2966/5838] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:09 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1324 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:10.867159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-62a5d673-f7a8-4309-8ed6-7abdb8a93c66 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:10.867802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-62a5d673-f7a8-4309-8ed6-7abdb8a93c66 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:10.887715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62a5d673-f7a8-4309-8ed6-7abdb8a93c66 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:10.888149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62a5d673-f7a8-4309-8ed6-7abdb8a93c66 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:10.893776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62a5d673-f7a8-4309-8ed6-7abdb8a93c66 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:10.894623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-62a5d673-f7a8-4309-8ed6-7abdb8a93c66 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:12.061053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-62a5d673-f7a8-4309-8ed6-7abdb8a93c66 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:12.070579 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-62a5d673-f7a8-4309-8ed6-7abdb8a93c66 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 1.207454 Jul 26 20:18:12.091346 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2873/5839] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:10 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:13.097720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61814acb-a74e-4e8c-b6ac-9e7c3bc1c23f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:13.098336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61814acb-a74e-4e8c-b6ac-9e7c3bc1c23f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:13.115530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61814acb-a74e-4e8c-b6ac-9e7c3bc1c23f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:13.115929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61814acb-a74e-4e8c-b6ac-9e7c3bc1c23f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:13.116721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61814acb-a74e-4e8c-b6ac-9e7c3bc1c23f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:13.117160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61814acb-a74e-4e8c-b6ac-9e7c3bc1c23f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:13.466965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61814acb-a74e-4e8c-b6ac-9e7c3bc1c23f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:13.479180 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61814acb-a74e-4e8c-b6ac-9e7c3bc1c23f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 0.385251 Jul 26 20:18:13.481885 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2967/5840] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:13 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:13.567998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7b2fb3d2-a621-470c-a7f0-8cb6cea4b47f req-7bea1611-0abf-471a-bf5d-74234b6c9bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abb33a0-987a-4fa5-824b-e18244f0d127", "tag": "8c8dd919-0f65-4029-a818-403cebfd673e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:13.602608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7b2fb3d2-a621-470c-a7f0-8cb6cea4b47f req-7bea1611-0abf-471a-bf5d-74234b6c9bf4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:13.603961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7b2fb3d2-a621-470c-a7f0-8cb6cea4b47f req-7bea1611-0abf-471a-bf5d-74234b6c9bf4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:13.654944 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7b2fb3d2-a621-470c-a7f0-8cb6cea4b47f req-7bea1611-0abf-471a-bf5d-74234b6c9bf4 service nova] Creating event network-changed:8c8dd919-0f65-4029-a818-403cebfd673e for instance 4abb33a0-987a-4fa5-824b-e18244f0d127 on n-h1-708768-8 Jul 26 20:18:13.685402 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7b2fb3d2-a621-470c-a7f0-8cb6cea4b47f req-7bea1611-0abf-471a-bf5d-74234b6c9bf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122256 Jul 26 20:18:13.686147 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2874/5841] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:14.500473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2d6e2760-87b3-4cee-bd8b-52059a7d363e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:14.501679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2d6e2760-87b3-4cee-bd8b-52059a7d363e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:14.510015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d6e2760-87b3-4cee-bd8b-52059a7d363e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:14.510015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d6e2760-87b3-4cee-bd8b-52059a7d363e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:14.510015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d6e2760-87b3-4cee-bd8b-52059a7d363e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:14.510434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d6e2760-87b3-4cee-bd8b-52059a7d363e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:14.755453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2d6e2760-87b3-4cee-bd8b-52059a7d363e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:14.774382 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2d6e2760-87b3-4cee-bd8b-52059a7d363e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 0.277593 Jul 26 20:18:14.779937 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2968/5842] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:14 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:15.798734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14b76c2c-2096-4f90-ae86-981b985ae1d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:15.800299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14b76c2c-2096-4f90-ae86-981b985ae1d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:15.813553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14b76c2c-2096-4f90-ae86-981b985ae1d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:15.815492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14b76c2c-2096-4f90-ae86-981b985ae1d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:15.817534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14b76c2c-2096-4f90-ae86-981b985ae1d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:15.818426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-14b76c2c-2096-4f90-ae86-981b985ae1d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:16.251938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14b76c2c-2096-4f90-ae86-981b985ae1d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:16.280904 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14b76c2c-2096-4f90-ae86-981b985ae1d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 0.486859 Jul 26 20:18:16.282314 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2875/5843] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:15 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:16.965053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dbd324e1-bd41-4dd7-8e68-44866d54440e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:16.968139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dbd324e1-bd41-4dd7-8e68-44866d54440e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:16.981974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbd324e1-bd41-4dd7-8e68-44866d54440e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:16.982432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbd324e1-bd41-4dd7-8e68-44866d54440e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:16.984565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbd324e1-bd41-4dd7-8e68-44866d54440e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:16.987097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbd324e1-bd41-4dd7-8e68-44866d54440e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:17.057263 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dbd324e1-bd41-4dd7-8e68-44866d54440e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096561 Jul 26 20:18:17.067203 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2969/5844] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:18:16 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:18:17.192794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57f843fc-1f24-4988-9d6f-7e11885408ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:17.193996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-57f843fc-1f24-4988-9d6f-7e11885408ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:17.200185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:17.204169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:17.233646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57f843fc-1f24-4988-9d6f-7e11885408ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:17.235953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57f843fc-1f24-4988-9d6f-7e11885408ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:17.246923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57f843fc-1f24-4988-9d6f-7e11885408ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:17.247661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57f843fc-1f24-4988-9d6f-7e11885408ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:17.303597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c434c43-1ba7-4c4a-8f80-90646df7810e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:17.304240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3c434c43-1ba7-4c4a-8f80-90646df7810e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:17.307708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:17.320381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c434c43-1ba7-4c4a-8f80-90646df7810e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:17.320827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c434c43-1ba7-4c4a-8f80-90646df7810e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:17.331065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c434c43-1ba7-4c4a-8f80-90646df7810e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:17.331735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c434c43-1ba7-4c4a-8f80-90646df7810e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:17.365213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-57f843fc-1f24-4988-9d6f-7e11885408ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:18:17.643592 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-57f843fc-1f24-4988-9d6f-7e11885408ad tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 204 len: 0 microversion: 2.1 time: 0.454577 Jul 26 20:18:17.645293 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2876/5845] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:18:17 2022] DELETE /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:18:17.667997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a4af30e2-eaf7-4d19-9cbe-b58f862e0d3a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:17.675326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a4af30e2-eaf7-4d19-9cbe-b58f862e0d3a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:17.696875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4af30e2-eaf7-4d19-9cbe-b58f862e0d3a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:17.698857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4af30e2-eaf7-4d19-9cbe-b58f862e0d3a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:17.700842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4af30e2-eaf7-4d19-9cbe-b58f862e0d3a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:17.702720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a4af30e2-eaf7-4d19-9cbe-b58f862e0d3a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:17.746094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c434c43-1ba7-4c4a-8f80-90646df7810e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:17.763434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c434c43-1ba7-4c4a-8f80-90646df7810e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 0.463813 Jul 26 20:18:17.767238 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2970/5846] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:17 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:17.956566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a4af30e2-eaf7-4d19-9cbe-b58f862e0d3a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:17.968025 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a4af30e2-eaf7-4d19-9cbe-b58f862e0d3a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1671 microversion: 2.1 time: 0.317641 Jul 26 20:18:17.968924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2877/5847] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:17 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1671 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:18.787064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6059800-0e48-4686-ad27-05279f454309 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:18.787723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b6059800-0e48-4686-ad27-05279f454309 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:18.809925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6059800-0e48-4686-ad27-05279f454309 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:18.812746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6059800-0e48-4686-ad27-05279f454309 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:18.819547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6059800-0e48-4686-ad27-05279f454309 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:18.820340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6059800-0e48-4686-ad27-05279f454309 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:19.001637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0890a10-ecb4-4db3-be5c-3cc4a64a5b87 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:19.002923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0890a10-ecb4-4db3-be5c-3cc4a64a5b87 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:19.017823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0890a10-ecb4-4db3-be5c-3cc4a64a5b87 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:19.024792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0890a10-ecb4-4db3-be5c-3cc4a64a5b87 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:19.025931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0890a10-ecb4-4db3-be5c-3cc4a64a5b87 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:19.026890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0890a10-ecb4-4db3-be5c-3cc4a64a5b87 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:19.605696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b6059800-0e48-4686-ad27-05279f454309 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:19.618192 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b6059800-0e48-4686-ad27-05279f454309 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 0.837373 Jul 26 20:18:19.619671 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2971/5848] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:18 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:19.984287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0890a10-ecb4-4db3-be5c-3cc4a64a5b87 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:19.993313 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0890a10-ecb4-4db3-be5c-3cc4a64a5b87 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1671 microversion: 2.1 time: 1.003422 Jul 26 20:18:20.004248 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2878/5849] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:18 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1671 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:20.647227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1bbb603-47e2-4962-b405-e707fdce1673 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:20.647978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a1bbb603-47e2-4962-b405-e707fdce1673 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:20.674824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1bbb603-47e2-4962-b405-e707fdce1673 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:20.675215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1bbb603-47e2-4962-b405-e707fdce1673 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:20.676048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1bbb603-47e2-4962-b405-e707fdce1673 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:20.676488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a1bbb603-47e2-4962-b405-e707fdce1673 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:21.017929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e18762ef-e52d-452d-a875-f29446ecff3f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:21.019917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e18762ef-e52d-452d-a875-f29446ecff3f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:21.044494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e18762ef-e52d-452d-a875-f29446ecff3f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:21.045345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e18762ef-e52d-452d-a875-f29446ecff3f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:21.046729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e18762ef-e52d-452d-a875-f29446ecff3f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:21.047464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e18762ef-e52d-452d-a875-f29446ecff3f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:21.083594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1bbb603-47e2-4962-b405-e707fdce1673 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:21.095209 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1bbb603-47e2-4962-b405-e707fdce1673 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 0.454150 Jul 26 20:18:21.097219 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2972/5850] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:20 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:21.194652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e18762ef-e52d-452d-a875-f29446ecff3f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:21.206730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e18762ef-e52d-452d-a875-f29446ecff3f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1604 microversion: 2.1 time: 0.192534 Jul 26 20:18:21.209361 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2879/5851] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:21 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:22.042908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-aae969e9-2394-4ecb-a0fe-e82949dd1feb req-272653c5-ca04-45cc-9bda-5cc94ffe9fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abb33a0-987a-4fa5-824b-e18244f0d127", "name": "network-vif-plugged", "status": "completed", "tag": "8c8dd919-0f65-4029-a818-403cebfd673e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:22.060713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-aae969e9-2394-4ecb-a0fe-e82949dd1feb req-272653c5-ca04-45cc-9bda-5cc94ffe9fcc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:22.061524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-aae969e9-2394-4ecb-a0fe-e82949dd1feb req-272653c5-ca04-45cc-9bda-5cc94ffe9fcc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:22.083546 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-aae969e9-2394-4ecb-a0fe-e82949dd1feb req-272653c5-ca04-45cc-9bda-5cc94ffe9fcc service nova] Creating event network-vif-plugged:8c8dd919-0f65-4029-a818-403cebfd673e for instance 4abb33a0-987a-4fa5-824b-e18244f0d127 on n-h1-708768-8 Jul 26 20:18:22.091159 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-aae969e9-2394-4ecb-a0fe-e82949dd1feb req-272653c5-ca04-45cc-9bda-5cc94ffe9fcc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052463 Jul 26 20:18:22.092883 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2973/5852] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:22.118302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-92846338-467f-4c88-8f0d-230e8d5488b8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:22.121101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-92846338-467f-4c88-8f0d-230e8d5488b8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:22.136026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92846338-467f-4c88-8f0d-230e8d5488b8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:22.137388 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92846338-467f-4c88-8f0d-230e8d5488b8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:22.140307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92846338-467f-4c88-8f0d-230e8d5488b8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:22.145030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92846338-467f-4c88-8f0d-230e8d5488b8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:22.231746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-154cb3e2-3e6f-48dc-957b-be39d211f0f4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:22.232463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-154cb3e2-3e6f-48dc-957b-be39d211f0f4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:22.254418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-154cb3e2-3e6f-48dc-957b-be39d211f0f4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:22.255195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-154cb3e2-3e6f-48dc-957b-be39d211f0f4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:22.256185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-154cb3e2-3e6f-48dc-957b-be39d211f0f4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:22.256788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-154cb3e2-3e6f-48dc-957b-be39d211f0f4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:22.450362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-154cb3e2-3e6f-48dc-957b-be39d211f0f4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:22.471299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-92846338-467f-4c88-8f0d-230e8d5488b8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:22.485863 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-154cb3e2-3e6f-48dc-957b-be39d211f0f4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 200 len: 1604 microversion: 2.1 time: 0.237120 Jul 26 20:18:22.486698 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-92846338-467f-4c88-8f0d-230e8d5488b8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 0.368814 Jul 26 20:18:22.487750 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2974/5853] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:22 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:22.503381 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2880/5854] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:22 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:22.515764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9b143aa1-08ec-4573-96e1-155ffbd3c7a9 req-9180e4a8-e16e-4f83-b384-4493812b4af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d744cf68-c058-4eb6-8e8a-4e97b7a16f09", "name": "network-vif-deleted", "tag": "6844a656-5cac-431f-b26b-fde6ee6b0c20"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:22.534274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9b143aa1-08ec-4573-96e1-155ffbd3c7a9 req-9180e4a8-e16e-4f83-b384-4493812b4af1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:22.534725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9b143aa1-08ec-4573-96e1-155ffbd3c7a9 req-9180e4a8-e16e-4f83-b384-4493812b4af1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:22.549918 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9b143aa1-08ec-4573-96e1-155ffbd3c7a9 req-9180e4a8-e16e-4f83-b384-4493812b4af1 service nova] Creating event network-vif-deleted:6844a656-5cac-431f-b26b-fde6ee6b0c20 for instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 on n-h2-708768-8 Jul 26 20:18:22.556577 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9b143aa1-08ec-4573-96e1-155ffbd3c7a9 req-9180e4a8-e16e-4f83-b384-4493812b4af1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054254 Jul 26 20:18:22.557993 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2975/5855] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:23.524103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:23.526400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:23.535058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02d6c024-ddfd-4ad7-97fc-24c732d6b3e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:23.536351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02d6c024-ddfd-4ad7-97fc-24c732d6b3e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:23.553092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:23.554004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:23.554986 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:23.563058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:23.566110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02d6c024-ddfd-4ad7-97fc-24c732d6b3e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:23.566581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02d6c024-ddfd-4ad7-97fc-24c732d6b3e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:23.567371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02d6c024-ddfd-4ad7-97fc-24c732d6b3e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:23.567852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02d6c024-ddfd-4ad7-97fc-24c732d6b3e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:23.589904 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] HTTP exception thrown: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Request method failure captured: Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 HTTP/1.1 Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Es1vxbaJ2SDYHh_JTG_MEgX36GsXpzeRNewBXIUUIJWBq-FuTE6YrplrQjcmt5uT__blg2vf3PcQf59Uo24q8ToFAvjR9TfIjU_iZmaEupruTdeSIAJ83olbW0YcC8HSx4Nvkq96LUIi7xl9NjmFeyp2LiP1O6BkIVgxSP2EWCvc9w Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58108d56ca7244f793546a489bef892d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58108d56ca7244f793546a489bef892d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}] Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 195a8048886e42148d7b51a0abc87ac9 Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'd744cf68-c058-4eb6-8e8a-4e97b7a16f09'} Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:18:23.592390 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:23.598480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:18:23.598480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:18:23.598480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:18:23.598480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:18:23.598480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:18:23.598480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:18:23.598480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:23.599869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Returning 404 to user: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:18:23.601249 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6496cf6f-4145-485d-9db8-2c392e2485d2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 404 len: 111 microversion: 2.1 time: 0.081295 Jul 26 20:18:23.602366 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2881/5856] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:23 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:18:23.610726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ecbaa842-3a57-4be5-885b-bc7f5dc5578f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '.version_select at 0x7f875e155310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:23.637654 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ecbaa842-3a57-4be5-885b-bc7f5dc5578f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251973084" status: 202 len: 0 microversion: 2.1 time: 0.030461 Jul 26 20:18:23.640612 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2882/5857] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 20:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251973084 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:18:23.925432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02d6c024-ddfd-4ad7-97fc-24c732d6b3e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:23.948870 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02d6c024-ddfd-4ad7-97fc-24c732d6b3e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1392 microversion: 2.1 time: 0.410584 Jul 26 20:18:23.963092 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2976/5858] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:23 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1392 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:24.714653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7136aeca-d901-47f6-998a-1e21f4f121b4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'create', calling method: .version_select at 0x7f875e439dc0>, body: {"keypair": {"name": "tempest-keypair-753764095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcUUm10y475URCeFqcyR7i7YhCQkP8tPYKNmqMpOAu27xEMHuthchMGmWJTnJa7TGcQADcHkVa48KdQAfR7qCXRb4u4MFMFvMJmlajLThg4C5Cn0xFqN6uCDY8qcNet1Q=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:24.734771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7136aeca-d901-47f6-998a-1e21f4f121b4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Getting quotas for project 58108d56ca7244f793546a489bef892d. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:18:24.741812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7136aeca-d901-47f6-998a-1e21f4f121b4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Getting quotas for user 195a8048886e42148d7b51a0abc87ac9 and project 58108d56ca7244f793546a489bef892d. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:18:24.779847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7136aeca-d901-47f6-998a-1e21f4f121b4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068359 Jul 26 20:18:24.782545 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2883/5859] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:18:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:24.969916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5e6360bc-9e6d-4fe0-86ff-65d5d9860e50 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:24.970547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5e6360bc-9e6d-4fe0-86ff-65d5d9860e50 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:24.981521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e6360bc-9e6d-4fe0-86ff-65d5d9860e50 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:24.981984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e6360bc-9e6d-4fe0-86ff-65d5d9860e50 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:24.982776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e6360bc-9e6d-4fe0-86ff-65d5d9860e50 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:24.987465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5e6360bc-9e6d-4fe0-86ff-65d5d9860e50 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:25.335162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5e6360bc-9e6d-4fe0-86ff-65d5d9860e50 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:25.344303 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5e6360bc-9e6d-4fe0-86ff-65d5d9860e50 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1565 microversion: 2.1 time: 0.378356 Jul 26 20:18:25.349159 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2977/5860] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:24 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1565 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:25.371969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3e7f70e-e973-4e6f-8ca7-7a87c9b4a28a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:25.373915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a3e7f70e-e973-4e6f-8ca7-7a87c9b4a28a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:25.393738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3e7f70e-e973-4e6f-8ca7-7a87c9b4a28a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:25.394192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3e7f70e-e973-4e6f-8ca7-7a87c9b4a28a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:25.395280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3e7f70e-e973-4e6f-8ca7-7a87c9b4a28a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:25.395934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3e7f70e-e973-4e6f-8ca7-7a87c9b4a28a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:25.664133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3e7f70e-e973-4e6f-8ca7-7a87c9b4a28a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:25.685667 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3e7f70e-e973-4e6f-8ca7-7a87c9b4a28a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1565 microversion: 2.1 time: 0.316961 Jul 26 20:18:25.688392 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2884/5861] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:25 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1565 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:26.504597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1322550117", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cff72306-bbf0-4f56-a2c6-80195730b01d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8dd04748-e18a-4968-8aa4-c87b9f3665a7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:26.574612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] validate_networks() for [('8dd04748-e18a-4968-8aa4-c87b9f3665a7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:18:27.162869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-893374122", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7100de4-4da6-4097-b0e2-a71ad4e9e9e9"}], "security_groups": [{"name": "tempest-securitygroup--1231605912"}], "key_name": "tempest-keypair-753764095", "user_data": "}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:27.362616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] validate_networks() for [('d7100de4-4da6-4097-b0e2-a71ad4e9e9e9', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:18:27.460416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:18:27.461581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:18:27.463220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:18:27.464152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:18:27.465209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:18:27.475856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:27.508263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:27.509983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:27.514344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:27.514817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:27.654262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:18:27.678379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:18:27.850789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:18:27.853020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cff72306-bbf0-4f56-a2c6-80195730b01d',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:18:28.149669 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06b9ea1d-a999-40a9-b2f8-66f8d86aad2c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648924 Jul 26 20:18:28.150671 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2978/5862] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:18:28.165831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5730ad7b-5929-418d-a26e-49f64ed95bdf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:28.166961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5730ad7b-5929-418d-a26e-49f64ed95bdf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:28.275187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5730ad7b-5929-418d-a26e-49f64ed95bdf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:28.287546 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5730ad7b-5929-418d-a26e-49f64ed95bdf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1057 microversion: 2.1 time: 0.127245 Jul 26 20:18:28.293524 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2979/5863] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:28 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1057 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:28.831216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:18:28.833393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:18:28.838768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:18:28.842496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:18:28.847443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:18:28.862866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:28.863638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:28.865500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:28.866248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:28.904091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Getting quotas for project 58108d56ca7244f793546a489bef892d. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:18:28.910733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Getting quotas for user 195a8048886e42148d7b51a0abc87ac9 and project 58108d56ca7244f793546a489bef892d. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:18:28.927038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:18:28.930043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:18:28.986825 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fdcf60cd-32e9-4896-827d-f989680eb62c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.829722 Jul 26 20:18:28.994145 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2885/5864] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:18:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:18:29.003110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66c9ced4-7227-4b4c-9e0d-f5235df271fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:29.005705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66c9ced4-7227-4b4c-9e0d-f5235df271fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:29.146534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-66c9ced4-7227-4b4c-9e0d-f5235df271fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:29.156715 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66c9ced4-7227-4b4c-9e0d-f5235df271fd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1236 microversion: 2.1 time: 0.160916 Jul 26 20:18:29.164707 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2980/5865] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:28 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1236 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:29.320990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f88c5fd-0d7b-4215-91e8-20be2e86dac2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:29.322237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4f88c5fd-0d7b-4215-91e8-20be2e86dac2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:29.331631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f88c5fd-0d7b-4215-91e8-20be2e86dac2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:29.334129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f88c5fd-0d7b-4215-91e8-20be2e86dac2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:29.336895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f88c5fd-0d7b-4215-91e8-20be2e86dac2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:29.340001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f88c5fd-0d7b-4215-91e8-20be2e86dac2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:29.372839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-58590265-7f45-4633-b75a-adebfdf8813a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:29.380662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-58590265-7f45-4633-b75a-adebfdf8813a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:29.399192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58590265-7f45-4633-b75a-adebfdf8813a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:29.401936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58590265-7f45-4633-b75a-adebfdf8813a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:29.418714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58590265-7f45-4633-b75a-adebfdf8813a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:29.419177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-58590265-7f45-4633-b75a-adebfdf8813a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:29.424459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4f88c5fd-0d7b-4215-91e8-20be2e86dac2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:29.449431 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4f88c5fd-0d7b-4215-91e8-20be2e86dac2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1155 microversion: 2.1 time: 0.139462 Jul 26 20:18:29.454449 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2886/5866] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:29 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1155 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:29.765462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-58590265-7f45-4633-b75a-adebfdf8813a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:29.777434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-58590265-7f45-4633-b75a-adebfdf8813a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1565 microversion: 2.1 time: 0.424790 Jul 26 20:18:29.778045 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2981/5867] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:29 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1565 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:29.837409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-262a06b3-af47-4bfa-b157-d333f256773c req-c4168f8c-862d-4106-980e-9ae0fe7d3b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abb33a0-987a-4fa5-824b-e18244f0d127", "tag": "8c8dd919-0f65-4029-a818-403cebfd673e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:29.855834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-262a06b3-af47-4bfa-b157-d333f256773c req-c4168f8c-862d-4106-980e-9ae0fe7d3b01 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:29.862676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-262a06b3-af47-4bfa-b157-d333f256773c req-c4168f8c-862d-4106-980e-9ae0fe7d3b01 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:29.895923 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-262a06b3-af47-4bfa-b157-d333f256773c req-c4168f8c-862d-4106-980e-9ae0fe7d3b01 service nova] Creating event network-changed:8c8dd919-0f65-4029-a818-403cebfd673e for instance 4abb33a0-987a-4fa5-824b-e18244f0d127 on n-h1-708768-8 Jul 26 20:18:29.906556 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-262a06b3-af47-4bfa-b157-d333f256773c req-c4168f8c-862d-4106-980e-9ae0fe7d3b01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.446535 Jul 26 20:18:29.911180 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2887/5868] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:30.178995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aec73415-7d62-4075-a471-6b77be9942d1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:30.179801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aec73415-7d62-4075-a471-6b77be9942d1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:30.194231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aec73415-7d62-4075-a471-6b77be9942d1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:30.194689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aec73415-7d62-4075-a471-6b77be9942d1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:30.198527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aec73415-7d62-4075-a471-6b77be9942d1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:30.199166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aec73415-7d62-4075-a471-6b77be9942d1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:30.384942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-aec73415-7d62-4075-a471-6b77be9942d1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:30.398746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aec73415-7d62-4075-a471-6b77be9942d1 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1288 microversion: 2.1 time: 0.224663 Jul 26 20:18:30.399354 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2982/5869] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:30 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1288 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:30.482129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03fc527e-f3b9-41a1-bd2d-45cecf550727 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:30.482994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03fc527e-f3b9-41a1-bd2d-45cecf550727 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:30.498435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03fc527e-f3b9-41a1-bd2d-45cecf550727 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:30.498962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03fc527e-f3b9-41a1-bd2d-45cecf550727 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:30.499818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03fc527e-f3b9-41a1-bd2d-45cecf550727 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:30.500263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03fc527e-f3b9-41a1-bd2d-45cecf550727 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:30.722673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03fc527e-f3b9-41a1-bd2d-45cecf550727 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:30.752438 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03fc527e-f3b9-41a1-bd2d-45cecf550727 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1173 microversion: 2.1 time: 0.272039 Jul 26 20:18:30.753728 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2888/5870] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:30 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1173 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:31.422528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39e36658-92de-4b32-8837-0d8bf97e539d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:31.423153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39e36658-92de-4b32-8837-0d8bf97e539d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:31.434946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39e36658-92de-4b32-8837-0d8bf97e539d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:31.435403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39e36658-92de-4b32-8837-0d8bf97e539d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:31.436255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39e36658-92de-4b32-8837-0d8bf97e539d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:31.436812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39e36658-92de-4b32-8837-0d8bf97e539d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:31.678857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-39e36658-92de-4b32-8837-0d8bf97e539d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:31.693139 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39e36658-92de-4b32-8837-0d8bf97e539d tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1294 microversion: 2.1 time: 0.274343 Jul 26 20:18:31.694843 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2983/5871] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:31 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1294 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:31.774577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0757995-b214-4f9d-a83d-ffcd43e1629a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:31.775484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0757995-b214-4f9d-a83d-ffcd43e1629a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:31.788898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0757995-b214-4f9d-a83d-ffcd43e1629a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:31.789273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0757995-b214-4f9d-a83d-ffcd43e1629a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:31.790068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0757995-b214-4f9d-a83d-ffcd43e1629a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:31.790556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0757995-b214-4f9d-a83d-ffcd43e1629a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:32.260599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b0757995-b214-4f9d-a83d-ffcd43e1629a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:32.272501 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0757995-b214-4f9d-a83d-ffcd43e1629a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1215 microversion: 2.1 time: 0.501464 Jul 26 20:18:32.274413 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2889/5872] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:31 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1215 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:32.581803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a37033f1-c2f5-4ec7-898c-71ceb315190c req-e9570f4f-ff80-44ef-85d8-19c93afbbd77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62259a36-dba6-40de-9a43-62b44372f548", "tag": "6dc3acab-1c4a-42a3-8f10-a25d277c26a8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:32.606579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a37033f1-c2f5-4ec7-898c-71ceb315190c req-e9570f4f-ff80-44ef-85d8-19c93afbbd77 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:32.607041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a37033f1-c2f5-4ec7-898c-71ceb315190c req-e9570f4f-ff80-44ef-85d8-19c93afbbd77 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:32.623586 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a37033f1-c2f5-4ec7-898c-71ceb315190c req-e9570f4f-ff80-44ef-85d8-19c93afbbd77 service nova] Creating event network-changed:6dc3acab-1c4a-42a3-8f10-a25d277c26a8 for instance 62259a36-dba6-40de-9a43-62b44372f548 on n-h2-708768-8 Jul 26 20:18:32.630164 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a37033f1-c2f5-4ec7-898c-71ceb315190c req-e9570f4f-ff80-44ef-85d8-19c93afbbd77 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052019 Jul 26 20:18:32.632740 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2984/5873] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:32.719028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6e9e9435-71fb-4b55-befa-b0ceba74d259 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:32.719676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6e9e9435-71fb-4b55-befa-b0ceba74d259 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:32.734647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e9e9435-71fb-4b55-befa-b0ceba74d259 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:32.735524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e9e9435-71fb-4b55-befa-b0ceba74d259 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:32.736532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e9e9435-71fb-4b55-befa-b0ceba74d259 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:32.737309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6e9e9435-71fb-4b55-befa-b0ceba74d259 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:33.236654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6e9e9435-71fb-4b55-befa-b0ceba74d259 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:33.250231 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6e9e9435-71fb-4b55-befa-b0ceba74d259 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1362 microversion: 2.1 time: 0.534135 Jul 26 20:18:33.252361 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2890/5874] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:32 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:33.295746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9eb2a0f-c9d1-449c-945a-160be767aa7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:33.297388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9eb2a0f-c9d1-449c-945a-160be767aa7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:33.308471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9eb2a0f-c9d1-449c-945a-160be767aa7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:33.309238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9eb2a0f-c9d1-449c-945a-160be767aa7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:33.310141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9eb2a0f-c9d1-449c-945a-160be767aa7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:33.310586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9eb2a0f-c9d1-449c-945a-160be767aa7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:33.549620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9eb2a0f-c9d1-449c-945a-160be767aa7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:33.566728 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9eb2a0f-c9d1-449c-945a-160be767aa7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1215 microversion: 2.1 time: 0.275912 Jul 26 20:18:33.582903 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2985/5875] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:33 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1215 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:34.275652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fab43e92-2cb4-43e9-9c07-54139e1b21c2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:34.277201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fab43e92-2cb4-43e9-9c07-54139e1b21c2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:34.285575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fab43e92-2cb4-43e9-9c07-54139e1b21c2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:34.286395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fab43e92-2cb4-43e9-9c07-54139e1b21c2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:34.287576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fab43e92-2cb4-43e9-9c07-54139e1b21c2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:34.288473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fab43e92-2cb4-43e9-9c07-54139e1b21c2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:34.294445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:34.590224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a08effc5-0cc2-49a0-9f6c-be6f00dfcdbe tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:34.590850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a08effc5-0cc2-49a0-9f6c-be6f00dfcdbe tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:34.598912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a08effc5-0cc2-49a0-9f6c-be6f00dfcdbe tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:34.599361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a08effc5-0cc2-49a0-9f6c-be6f00dfcdbe tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:34.600421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a08effc5-0cc2-49a0-9f6c-be6f00dfcdbe tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:34.600864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a08effc5-0cc2-49a0-9f6c-be6f00dfcdbe tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:34.633627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fab43e92-2cb4-43e9-9c07-54139e1b21c2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:34.644218 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fab43e92-2cb4-43e9-9c07-54139e1b21c2 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1362 microversion: 2.1 time: 0.372961 Jul 26 20:18:34.649564 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2891/5876] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:34 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:34.767030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a08effc5-0cc2-49a0-9f6c-be6f00dfcdbe tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:34.776117 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a08effc5-0cc2-49a0-9f6c-be6f00dfcdbe tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1215 microversion: 2.1 time: 0.190735 Jul 26 20:18:34.776723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2986/5877] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:34 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:34.882173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0ddaf3f4-48d6-4f49-a141-56966afee675 req-0c74d8d9-ae48-41a1-acc9-dd6c19e4bb70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b6679a-ff3f-4a52-ae8a-854040630a74", "tag": "dfc6c58c-ddd6-436b-9b2b-88e134ad0ff1"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:34.928042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0ddaf3f4-48d6-4f49-a141-56966afee675 req-0c74d8d9-ae48-41a1-acc9-dd6c19e4bb70 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:34.928496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0ddaf3f4-48d6-4f49-a141-56966afee675 req-0c74d8d9-ae48-41a1-acc9-dd6c19e4bb70 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:34.942948 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0ddaf3f4-48d6-4f49-a141-56966afee675 req-0c74d8d9-ae48-41a1-acc9-dd6c19e4bb70 service nova] Creating event network-changed:dfc6c58c-ddd6-436b-9b2b-88e134ad0ff1 for instance 09b6679a-ff3f-4a52-ae8a-854040630a74 on n-h2-708768-8 Jul 26 20:18:34.948206 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0ddaf3f4-48d6-4f49-a141-56966afee675 req-0c74d8d9-ae48-41a1-acc9-dd6c19e4bb70 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080218 Jul 26 20:18:34.950684 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2892/5878] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:35.671246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-340e764b-1d1e-46ed-9260-5b61396734cf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:35.672642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-340e764b-1d1e-46ed-9260-5b61396734cf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:35.681839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-340e764b-1d1e-46ed-9260-5b61396734cf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:35.682544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-340e764b-1d1e-46ed-9260-5b61396734cf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:35.683652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-340e764b-1d1e-46ed-9260-5b61396734cf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:35.684171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-340e764b-1d1e-46ed-9260-5b61396734cf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:35.689454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:35.797934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80bbb5b1-a94f-49d0-ad2c-559e86abacc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:35.799182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80bbb5b1-a94f-49d0-ad2c-559e86abacc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:35.807418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80bbb5b1-a94f-49d0-ad2c-559e86abacc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:35.808379 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80bbb5b1-a94f-49d0-ad2c-559e86abacc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:35.809356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80bbb5b1-a94f-49d0-ad2c-559e86abacc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:35.809964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80bbb5b1-a94f-49d0-ad2c-559e86abacc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:35.841078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-340e764b-1d1e-46ed-9260-5b61396734cf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:35.848873 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-340e764b-1d1e-46ed-9260-5b61396734cf tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1362 microversion: 2.1 time: 0.182163 Jul 26 20:18:35.852360 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2987/5879] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:35 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:36.033297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-80bbb5b1-a94f-49d0-ad2c-559e86abacc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:36.042235 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80bbb5b1-a94f-49d0-ad2c-559e86abacc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1215 microversion: 2.1 time: 0.248317 Jul 26 20:18:36.043073 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2893/5880] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:35 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:36.873201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5366210b-35c8-4295-8883-40d363b18230 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:36.874477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5366210b-35c8-4295-8883-40d363b18230 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:36.881988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5366210b-35c8-4295-8883-40d363b18230 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:36.882783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5366210b-35c8-4295-8883-40d363b18230 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:36.883562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5366210b-35c8-4295-8883-40d363b18230 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:36.885004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5366210b-35c8-4295-8883-40d363b18230 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:37.064867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5be82022-4c0f-46d2-9bd6-f69e822ff6b6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:37.065499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5be82022-4c0f-46d2-9bd6-f69e822ff6b6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:37.072330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:37.078297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5be82022-4c0f-46d2-9bd6-f69e822ff6b6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:37.079095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5be82022-4c0f-46d2-9bd6-f69e822ff6b6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:37.079935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5be82022-4c0f-46d2-9bd6-f69e822ff6b6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:37.080382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5be82022-4c0f-46d2-9bd6-f69e822ff6b6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:37.168961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5366210b-35c8-4295-8883-40d363b18230 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:37.180094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5366210b-35c8-4295-8883-40d363b18230 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1362 microversion: 2.1 time: 0.312113 Jul 26 20:18:37.181773 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2988/5881] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:36 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:37.485914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5be82022-4c0f-46d2-9bd6-f69e822ff6b6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:37.494552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5be82022-4c0f-46d2-9bd6-f69e822ff6b6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.434924 Jul 26 20:18:37.495148 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2894/5882] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:37 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:38.203316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-843e6b21-96bb-4baf-879c-161ece74362c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:38.204001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-843e6b21-96bb-4baf-879c-161ece74362c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:38.205921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:38.213424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-843e6b21-96bb-4baf-879c-161ece74362c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:38.213877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-843e6b21-96bb-4baf-879c-161ece74362c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:38.214662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-843e6b21-96bb-4baf-879c-161ece74362c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:38.215106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-843e6b21-96bb-4baf-879c-161ece74362c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:38.518051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5115dbf0-2b5b-4097-9d50-3534853cd5ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:38.518692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5115dbf0-2b5b-4097-9d50-3534853cd5ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:38.527135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-2b5b-4097-9d50-3534853cd5ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:38.527584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-2b5b-4097-9d50-3534853cd5ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:38.528417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-2b5b-4097-9d50-3534853cd5ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:38.528861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-2b5b-4097-9d50-3534853cd5ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:38.668947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5115dbf0-2b5b-4097-9d50-3534853cd5ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:38.676580 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5115dbf0-2b5b-4097-9d50-3534853cd5ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.162948 Jul 26 20:18:38.677450 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2895/5883] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:38 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:38.801227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-843e6b21-96bb-4baf-879c-161ece74362c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:38.809407 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-843e6b21-96bb-4baf-879c-161ece74362c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1362 microversion: 2.1 time: 0.610061 Jul 26 20:18:38.810078 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2989/5884] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:38 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1362 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:39.699856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-abe8090c-2a03-46de-9518-dfac2c2558f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:39.700471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-abe8090c-2a03-46de-9518-dfac2c2558f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:39.702552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:39.703484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:39.710971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abe8090c-2a03-46de-9518-dfac2c2558f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:39.711429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abe8090c-2a03-46de-9518-dfac2c2558f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:39.712435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abe8090c-2a03-46de-9518-dfac2c2558f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:39.712878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abe8090c-2a03-46de-9518-dfac2c2558f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:39.831930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a00db7be-ebfb-40d8-8a66-e39e18bebb4e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:39.833503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a00db7be-ebfb-40d8-8a66-e39e18bebb4e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:39.840704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:39.844201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a00db7be-ebfb-40d8-8a66-e39e18bebb4e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:39.845055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a00db7be-ebfb-40d8-8a66-e39e18bebb4e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:39.846586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a00db7be-ebfb-40d8-8a66-e39e18bebb4e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:39.847211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a00db7be-ebfb-40d8-8a66-e39e18bebb4e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:39.882608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-abe8090c-2a03-46de-9518-dfac2c2558f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:39.891036 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-abe8090c-2a03-46de-9518-dfac2c2558f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.195219 Jul 26 20:18:39.891686 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2896/5885] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:39 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:40.130819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a00db7be-ebfb-40d8-8a66-e39e18bebb4e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:40.138709 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a00db7be-ebfb-40d8-8a66-e39e18bebb4e tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1362 microversion: 2.1 time: 0.311831 Jul 26 20:18:40.139299 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2990/5886] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:39 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:40.912284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68beabf1-0505-49bf-8101-be372aef5b0a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:40.912895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68beabf1-0505-49bf-8101-be372aef5b0a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:40.920438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68beabf1-0505-49bf-8101-be372aef5b0a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:40.920886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68beabf1-0505-49bf-8101-be372aef5b0a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:40.921657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68beabf1-0505-49bf-8101-be372aef5b0a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:40.922111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68beabf1-0505-49bf-8101-be372aef5b0a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:41.053935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68beabf1-0505-49bf-8101-be372aef5b0a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:41.062592 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68beabf1-0505-49bf-8101-be372aef5b0a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.154299 Jul 26 20:18:41.063158 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2897/5887] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:40 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:41.160484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d4a2b76a-7b0d-45ea-bf65-298ab9d0347f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:41.161141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d4a2b76a-7b0d-45ea-bf65-298ab9d0347f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:41.168357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4a2b76a-7b0d-45ea-bf65-298ab9d0347f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:41.168819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4a2b76a-7b0d-45ea-bf65-298ab9d0347f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:41.169695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4a2b76a-7b0d-45ea-bf65-298ab9d0347f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:41.170221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d4a2b76a-7b0d-45ea-bf65-298ab9d0347f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:41.348760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d4a2b76a-7b0d-45ea-bf65-298ab9d0347f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:41.357300 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d4a2b76a-7b0d-45ea-bf65-298ab9d0347f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1362 microversion: 2.1 time: 0.200677 Jul 26 20:18:41.371720 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2991/5888] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:41 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:41.443817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-37ba9394-ba58-4a99-9314-758e39438039 req-481b6f5a-fd71-4f34-8593-63768af753a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b6679a-ff3f-4a52-ae8a-854040630a74", "name": "network-vif-plugged", "status": "completed", "tag": "dfc6c58c-ddd6-436b-9b2b-88e134ad0ff1"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:41.457586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-37ba9394-ba58-4a99-9314-758e39438039 req-481b6f5a-fd71-4f34-8593-63768af753a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:41.458023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-37ba9394-ba58-4a99-9314-758e39438039 req-481b6f5a-fd71-4f34-8593-63768af753a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:41.471529 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-37ba9394-ba58-4a99-9314-758e39438039 req-481b6f5a-fd71-4f34-8593-63768af753a5 service nova] Creating event network-vif-plugged:dfc6c58c-ddd6-436b-9b2b-88e134ad0ff1 for instance 09b6679a-ff3f-4a52-ae8a-854040630a74 on n-h2-708768-8 Jul 26 20:18:41.477148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-37ba9394-ba58-4a99-9314-758e39438039 req-481b6f5a-fd71-4f34-8593-63768af753a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038451 Jul 26 20:18:41.478617 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2898/5889] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:42.084261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bbb92861-8188-409f-9928-15c2a78e1cec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:42.084882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bbb92861-8188-409f-9928-15c2a78e1cec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:42.091190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbb92861-8188-409f-9928-15c2a78e1cec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:42.091666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbb92861-8188-409f-9928-15c2a78e1cec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:42.092574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbb92861-8188-409f-9928-15c2a78e1cec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:42.093015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bbb92861-8188-409f-9928-15c2a78e1cec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:42.225291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bbb92861-8188-409f-9928-15c2a78e1cec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:42.233737 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bbb92861-8188-409f-9928-15c2a78e1cec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.153584 Jul 26 20:18:42.234322 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2992/5890] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:42 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:42.379805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-594a7c94-6d3f-4749-97fd-d46af2c38757 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:42.380507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-594a7c94-6d3f-4749-97fd-d46af2c38757 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:42.387167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-594a7c94-6d3f-4749-97fd-d46af2c38757 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:42.387635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-594a7c94-6d3f-4749-97fd-d46af2c38757 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:42.388419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-594a7c94-6d3f-4749-97fd-d46af2c38757 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:42.388859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-594a7c94-6d3f-4749-97fd-d46af2c38757 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:42.586363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-594a7c94-6d3f-4749-97fd-d46af2c38757 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:42.595356 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-594a7c94-6d3f-4749-97fd-d46af2c38757 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1362 microversion: 2.1 time: 0.220668 Jul 26 20:18:42.596310 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2899/5891] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:42 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:43.255667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-319b3e82-6338-47c8-86d4-fffc052243f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:43.256348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-319b3e82-6338-47c8-86d4-fffc052243f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:43.264269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-319b3e82-6338-47c8-86d4-fffc052243f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:43.264749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-319b3e82-6338-47c8-86d4-fffc052243f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:43.265588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-319b3e82-6338-47c8-86d4-fffc052243f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:43.266048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-319b3e82-6338-47c8-86d4-fffc052243f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:43.494123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-319b3e82-6338-47c8-86d4-fffc052243f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:43.501966 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-319b3e82-6338-47c8-86d4-fffc052243f9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.250301 Jul 26 20:18:43.502568 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2993/5892] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:43 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:43.617310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b74479f9-2690-4112-b0d7-fb9967f02568 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:43.617928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b74479f9-2690-4112-b0d7-fb9967f02568 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:43.626208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-2690-4112-b0d7-fb9967f02568 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:43.626666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-2690-4112-b0d7-fb9967f02568 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:43.627446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-2690-4112-b0d7-fb9967f02568 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:43.627930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b74479f9-2690-4112-b0d7-fb9967f02568 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:43.767596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b74479f9-2690-4112-b0d7-fb9967f02568 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:43.776556 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b74479f9-2690-4112-b0d7-fb9967f02568 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1547 microversion: 2.1 time: 0.163133 Jul 26 20:18:43.777334 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2900/5893] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:43 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:43.799763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a616ef38-72eb-4c39-a1a5-a03fa101e051 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:43.800273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a616ef38-72eb-4c39-a1a5-a03fa101e051 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:43.806679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a616ef38-72eb-4c39-a1a5-a03fa101e051 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:43.807130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a616ef38-72eb-4c39-a1a5-a03fa101e051 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:43.807944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a616ef38-72eb-4c39-a1a5-a03fa101e051 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:43.808660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a616ef38-72eb-4c39-a1a5-a03fa101e051 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:43.888699 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a616ef38-72eb-4c39-a1a5-a03fa101e051 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092957 Jul 26 20:18:43.889529 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2994/5894] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:18:43 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:44.523123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-84759161-3b7e-45ca-9ee5-6dabcef7cc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:44.523769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-84759161-3b7e-45ca-9ee5-6dabcef7cc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:44.531235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84759161-3b7e-45ca-9ee5-6dabcef7cc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:44.531724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84759161-3b7e-45ca-9ee5-6dabcef7cc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:44.532817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84759161-3b7e-45ca-9ee5-6dabcef7cc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:44.533320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84759161-3b7e-45ca-9ee5-6dabcef7cc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:44.681182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-84759161-3b7e-45ca-9ee5-6dabcef7cc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:44.689158 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-84759161-3b7e-45ca-9ee5-6dabcef7cc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.169983 Jul 26 20:18:44.690078 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2901/5895] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:44 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:44.889785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1f801e30-db0d-4c9a-b690-0704eb50707e req-0566f31b-f82c-4b4b-b736-a49473ebe736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b6679a-ff3f-4a52-ae8a-854040630a74", "tag": "dfc6c58c-ddd6-436b-9b2b-88e134ad0ff1"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:44.901614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1f801e30-db0d-4c9a-b690-0704eb50707e req-0566f31b-f82c-4b4b-b736-a49473ebe736 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:44.902225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1f801e30-db0d-4c9a-b690-0704eb50707e req-0566f31b-f82c-4b4b-b736-a49473ebe736 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:44.914213 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1f801e30-db0d-4c9a-b690-0704eb50707e req-0566f31b-f82c-4b4b-b736-a49473ebe736 service nova] Creating event network-changed:dfc6c58c-ddd6-436b-9b2b-88e134ad0ff1 for instance 09b6679a-ff3f-4a52-ae8a-854040630a74 on n-h2-708768-8 Jul 26 20:18:44.921305 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1f801e30-db0d-4c9a-b690-0704eb50707e req-0566f31b-f82c-4b4b-b736-a49473ebe736 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034683 Jul 26 20:18:44.922492 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2995/5896] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:45.710142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5cf1fdeb-dd05-4ccd-b5dd-f6c619d72e59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:45.710754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5cf1fdeb-dd05-4ccd-b5dd-f6c619d72e59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:45.719705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cf1fdeb-dd05-4ccd-b5dd-f6c619d72e59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:45.720153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cf1fdeb-dd05-4ccd-b5dd-f6c619d72e59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:45.720923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cf1fdeb-dd05-4ccd-b5dd-f6c619d72e59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:45.721355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5cf1fdeb-dd05-4ccd-b5dd-f6c619d72e59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:45.890988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5cf1fdeb-dd05-4ccd-b5dd-f6c619d72e59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:45.898622 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5cf1fdeb-dd05-4ccd-b5dd-f6c619d72e59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.192164 Jul 26 20:18:45.916206 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2902/5897] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:45 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:46.923650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c6baaa4-2449-4792-9582-e2b68013e9f1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:46.924546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c6baaa4-2449-4792-9582-e2b68013e9f1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:46.932316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c6baaa4-2449-4792-9582-e2b68013e9f1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:46.932855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c6baaa4-2449-4792-9582-e2b68013e9f1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:46.933977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c6baaa4-2449-4792-9582-e2b68013e9f1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:46.934525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c6baaa4-2449-4792-9582-e2b68013e9f1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:47.075570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c6baaa4-2449-4792-9582-e2b68013e9f1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:47.084285 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c6baaa4-2449-4792-9582-e2b68013e9f1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.165117 Jul 26 20:18:47.084992 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2996/5898] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:46 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:47.449052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-04bb2c17-f994-4837-89cf-8ce78c5debe6 req-9632c13b-b3fc-471b-92bd-fceed0c18fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62259a36-dba6-40de-9a43-62b44372f548", "name": "network-vif-plugged", "status": "completed", "tag": "6dc3acab-1c4a-42a3-8f10-a25d277c26a8"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:47.460687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-04bb2c17-f994-4837-89cf-8ce78c5debe6 req-9632c13b-b3fc-471b-92bd-fceed0c18fdc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:47.461418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-04bb2c17-f994-4837-89cf-8ce78c5debe6 req-9632c13b-b3fc-471b-92bd-fceed0c18fdc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:47.477597 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-04bb2c17-f994-4837-89cf-8ce78c5debe6 req-9632c13b-b3fc-471b-92bd-fceed0c18fdc service nova] Creating event network-vif-plugged:6dc3acab-1c4a-42a3-8f10-a25d277c26a8 for instance 62259a36-dba6-40de-9a43-62b44372f548 on n-h2-708768-8 Jul 26 20:18:47.482809 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-04bb2c17-f994-4837-89cf-8ce78c5debe6 req-9632c13b-b3fc-471b-92bd-fceed0c18fdc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 Jul 26 20:18:47.483590 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2903/5899] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:48.106721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-84f9362a-778c-464a-9e32-17e29c995720 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:48.107340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-84f9362a-778c-464a-9e32-17e29c995720 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:48.114893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84f9362a-778c-464a-9e32-17e29c995720 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:48.115339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84f9362a-778c-464a-9e32-17e29c995720 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:48.116148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84f9362a-778c-464a-9e32-17e29c995720 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:48.116584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-84f9362a-778c-464a-9e32-17e29c995720 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:48.259423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-84f9362a-778c-464a-9e32-17e29c995720 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:48.268994 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-84f9362a-778c-464a-9e32-17e29c995720 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1203 microversion: 2.1 time: 0.166692 Jul 26 20:18:48.269597 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2997/5900] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:48 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:48.406225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a05eeade-490d-4f30-9ed3-c1ac12a8432d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:48.408479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a05eeade-490d-4f30-9ed3-c1ac12a8432d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:48.414905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a05eeade-490d-4f30-9ed3-c1ac12a8432d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:48.416236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a05eeade-490d-4f30-9ed3-c1ac12a8432d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:48.417026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a05eeade-490d-4f30-9ed3-c1ac12a8432d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:48.417467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a05eeade-490d-4f30-9ed3-c1ac12a8432d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:48.470662 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a05eeade-490d-4f30-9ed3-c1ac12a8432d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action" status: 200 len: 24546 microversion: 2.1 time: 0.068709 Jul 26 20:18:48.471335 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2904/5901] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:18:48 2022] POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action => generated 24546 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:18:49.290773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56049d7f-ecee-4dfc-9e35-c5e5439d0c4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:49.291425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56049d7f-ecee-4dfc-9e35-c5e5439d0c4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:49.298407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56049d7f-ecee-4dfc-9e35-c5e5439d0c4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:49.298863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56049d7f-ecee-4dfc-9e35-c5e5439d0c4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:49.299663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56049d7f-ecee-4dfc-9e35-c5e5439d0c4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:49.300113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56049d7f-ecee-4dfc-9e35-c5e5439d0c4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:49.440353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56049d7f-ecee-4dfc-9e35-c5e5439d0c4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:49.448260 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56049d7f-ecee-4dfc-9e35-c5e5439d0c4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1389 microversion: 2.1 time: 0.161753 Jul 26 20:18:49.449086 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2998/5902] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:49 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:49.471246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bb280d2f-772d-4f91-8abc-e0c95cc7fcb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:49.471970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb280d2f-772d-4f91-8abc-e0c95cc7fcb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:49.480365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb280d2f-772d-4f91-8abc-e0c95cc7fcb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:49.480817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb280d2f-772d-4f91-8abc-e0c95cc7fcb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:49.481587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb280d2f-772d-4f91-8abc-e0c95cc7fcb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:49.482026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb280d2f-772d-4f91-8abc-e0c95cc7fcb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:49.734102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bb280d2f-772d-4f91-8abc-e0c95cc7fcb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:49.741825 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bb280d2f-772d-4f91-8abc-e0c95cc7fcb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1389 microversion: 2.1 time: 0.274819 Jul 26 20:18:49.742407 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2905/5903] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:49 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1389 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:49.762178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-268b2eab-2891-465b-8335-a38bc49a33c6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:49.762830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-268b2eab-2891-465b-8335-a38bc49a33c6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:49.768971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-268b2eab-2891-465b-8335-a38bc49a33c6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:49.769434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-268b2eab-2891-465b-8335-a38bc49a33c6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:49.770208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-268b2eab-2891-465b-8335-a38bc49a33c6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:49.770651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-268b2eab-2891-465b-8335-a38bc49a33c6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:49.906967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-268b2eab-2891-465b-8335-a38bc49a33c6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:49.914725 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-268b2eab-2891-465b-8335-a38bc49a33c6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1389 microversion: 2.1 time: 0.156604 Jul 26 20:18:49.916207 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 2999/5904] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:49 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:49.935855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a772a852-ad53-4d6a-b8e5-df9292c53d70 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:49.936940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a772a852-ad53-4d6a-b8e5-df9292c53d70 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:49.943369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a772a852-ad53-4d6a-b8e5-df9292c53d70 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:49.943879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a772a852-ad53-4d6a-b8e5-df9292c53d70 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:49.944644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a772a852-ad53-4d6a-b8e5-df9292c53d70 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:49.945075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a772a852-ad53-4d6a-b8e5-df9292c53d70 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:49.971984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a772a852-ad53-4d6a-b8e5-df9292c53d70 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:18:50.047954 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a772a852-ad53-4d6a-b8e5-df9292c53d70 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 204 len: 0 microversion: 2.1 time: 0.115988 Jul 26 20:18:50.049148 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2906/5905] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:18:49 2022] DELETE /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:18:50.059827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-425e3357-e736-46e1-93ab-2f3204e5d56a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:50.060446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-425e3357-e736-46e1-93ab-2f3204e5d56a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:50.066702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-425e3357-e736-46e1-93ab-2f3204e5d56a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:50.067337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-425e3357-e736-46e1-93ab-2f3204e5d56a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:50.068213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-425e3357-e736-46e1-93ab-2f3204e5d56a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:50.068914 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-425e3357-e736-46e1-93ab-2f3204e5d56a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:50.204832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-425e3357-e736-46e1-93ab-2f3204e5d56a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:50.213474 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-425e3357-e736-46e1-93ab-2f3204e5d56a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1395 microversion: 2.1 time: 0.159039 Jul 26 20:18:50.214061 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3000/5906] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:50 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:51.235343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ef4811c-931a-4cb7-b468-5ecec4957d01 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:51.236282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5ef4811c-931a-4cb7-b468-5ecec4957d01 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:51.244815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ef4811c-931a-4cb7-b468-5ecec4957d01 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:51.245267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ef4811c-931a-4cb7-b468-5ecec4957d01 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:51.246060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ef4811c-931a-4cb7-b468-5ecec4957d01 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:51.246502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ef4811c-931a-4cb7-b468-5ecec4957d01 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:51.450111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ef4811c-931a-4cb7-b468-5ecec4957d01 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:51.457776 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ef4811c-931a-4cb7-b468-5ecec4957d01 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1395 microversion: 2.1 time: 0.226760 Jul 26 20:18:51.458365 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2907/5907] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:51 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1395 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:52.424176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2b65f270-b6db-44d0-bf45-d43792f21b64 req-a5b604eb-01b2-47c7-a455-44cba4ba3cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62259a36-dba6-40de-9a43-62b44372f548", "name": "network-vif-deleted", "tag": "6dc3acab-1c4a-42a3-8f10-a25d277c26a8"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:52.439343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2b65f270-b6db-44d0-bf45-d43792f21b64 req-a5b604eb-01b2-47c7-a455-44cba4ba3cd8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:52.440099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2b65f270-b6db-44d0-bf45-d43792f21b64 req-a5b604eb-01b2-47c7-a455-44cba4ba3cd8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:52.453168 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2b65f270-b6db-44d0-bf45-d43792f21b64 req-a5b604eb-01b2-47c7-a455-44cba4ba3cd8 service nova] Creating event network-vif-deleted:6dc3acab-1c4a-42a3-8f10-a25d277c26a8 for instance 62259a36-dba6-40de-9a43-62b44372f548 on n-h2-708768-8 Jul 26 20:18:52.460558 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2b65f270-b6db-44d0-bf45-d43792f21b64 req-a5b604eb-01b2-47c7-a455-44cba4ba3cd8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040328 Jul 26 20:18:52.461543 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3001/5908] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:18:52.481287 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6d80f803-0147-4755-a68d-02be41466127 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:52.487201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6d80f803-0147-4755-a68d-02be41466127 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:52.498053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d80f803-0147-4755-a68d-02be41466127 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:52.499142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d80f803-0147-4755-a68d-02be41466127 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:52.500161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d80f803-0147-4755-a68d-02be41466127 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:52.500805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d80f803-0147-4755-a68d-02be41466127 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:52.542367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:52.629520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6d80f803-0147-4755-a68d-02be41466127 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:52.637979 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6d80f803-0147-4755-a68d-02be41466127 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1188 microversion: 2.1 time: 0.162295 Jul 26 20:18:52.638659 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2908/5909] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:52 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1188 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:53.659944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b9fd1d6-336f-456c-bdc7-e1751ded5848 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:53.660765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0b9fd1d6-336f-456c-bdc7-e1751ded5848 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:53.667818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b9fd1d6-336f-456c-bdc7-e1751ded5848 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:53.668666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b9fd1d6-336f-456c-bdc7-e1751ded5848 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:53.669636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b9fd1d6-336f-456c-bdc7-e1751ded5848 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:53.670407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b9fd1d6-336f-456c-bdc7-e1751ded5848 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:53.739855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0b9fd1d6-336f-456c-bdc7-e1751ded5848 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:53.748574 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0b9fd1d6-336f-456c-bdc7-e1751ded5848 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1188 microversion: 2.1 time: 0.093767 Jul 26 20:18:53.749166 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3002/5910] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:53 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:54.770278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1abde729-465f-4c46-859d-c85c8b1bce28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:54.771245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1abde729-465f-4c46-859d-c85c8b1bce28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:54.778811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1abde729-465f-4c46-859d-c85c8b1bce28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:54.779268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1abde729-465f-4c46-859d-c85c8b1bce28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:54.780086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1abde729-465f-4c46-859d-c85c8b1bce28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:54.780528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1abde729-465f-4c46-859d-c85c8b1bce28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:54.857293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-69b1455e-43da-49d6-953a-7f94b255b058 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:54.858356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-69b1455e-43da-49d6-953a-7f94b255b058 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:54.860868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1abde729-465f-4c46-859d-c85c8b1bce28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:54.870260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69b1455e-43da-49d6-953a-7f94b255b058 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:54.871043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69b1455e-43da-49d6-953a-7f94b255b058 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:54.871207 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1abde729-465f-4c46-859d-c85c8b1bce28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1188 microversion: 2.1 time: 0.104697 Jul 26 20:18:54.872442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69b1455e-43da-49d6-953a-7f94b255b058 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:54.872548 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2909/5911] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:54 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:54.873268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69b1455e-43da-49d6-953a-7f94b255b058 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.182756 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-69b1455e-43da-49d6-953a-7f94b255b058 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1835 microversion: 2.1 time: 0.328453 Jul 26 20:18:55.201490 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3003/5912] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:54 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1835 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:55.209736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-879b83f4-0ba6-43aa-bab2-177f92d2e3e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:55.210461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-879b83f4-0ba6-43aa-bab2-177f92d2e3e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:55.217249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-879b83f4-0ba6-43aa-bab2-177f92d2e3e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:55.217948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-879b83f4-0ba6-43aa-bab2-177f92d2e3e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.218911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-879b83f4-0ba6-43aa-bab2-177f92d2e3e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:55.219527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-879b83f4-0ba6-43aa-bab2-177f92d2e3e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.471125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-879b83f4-0ba6-43aa-bab2-177f92d2e3e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:55.486227 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-879b83f4-0ba6-43aa-bab2-177f92d2e3e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1684 microversion: 2.1 time: 0.282810 Jul 26 20:18:55.488735 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2910/5913] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:55 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1684 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:55.614833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de945f5e-8a6a-452e-8120-936943530391 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:55.617974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de945f5e-8a6a-452e-8120-936943530391 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:55.639247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de945f5e-8a6a-452e-8120-936943530391 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:55.639867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de945f5e-8a6a-452e-8120-936943530391 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.640735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de945f5e-8a6a-452e-8120-936943530391 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:55.641254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de945f5e-8a6a-452e-8120-936943530391 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.694827 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de945f5e-8a6a-452e-8120-936943530391 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action" status: 200 len: 32618 microversion: 2.1 time: 0.083616 Jul 26 20:18:55.695502 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3004/5914] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:18:55 2022] POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action => generated 32618 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:18:55.882563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:18:55.883293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:55.891324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:55.891805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.892580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:55.893186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.895088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-69235f80-c61a-48a7-a6a9-77c39e73c510 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:55.896036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-69235f80-c61a-48a7-a6a9-77c39e73c510 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:55.904926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69235f80-c61a-48a7-a6a9-77c39e73c510 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:55.905754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69235f80-c61a-48a7-a6a9-77c39e73c510 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.907740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69235f80-c61a-48a7-a6a9-77c39e73c510 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:55.908388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69235f80-c61a-48a7-a6a9-77c39e73c510 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:55.985560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-69235f80-c61a-48a7-a6a9-77c39e73c510 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:55.990219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:55.997410 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-69235f80-c61a-48a7-a6a9-77c39e73c510 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1188 microversion: 2.1 time: 0.106933 Jul 26 20:18:56.002797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3dc7fecf323e4a4baa2e15dd04c6a46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952686847a924ff0b90669babdbd1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:56.003735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] flavor_id is None. Assuming migration. {{(pid=125963) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 20:18:56.004303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125963) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:18:56.012617 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3005/5915] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:55 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1188 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:56.387026 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8331661a-d202-410c-bf36-2802cba34e78 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action" status: 202 len: 0 microversion: 2.1 time: 0.508125 Jul 26 20:18:56.388169 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2911/5916] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:18:55 2022] POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:18:56.396156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6adc70d8-e48e-410c-ad35-5c4b3d8dc97b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:56.396804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6adc70d8-e48e-410c-ad35-5c4b3d8dc97b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:56.405435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6adc70d8-e48e-410c-ad35-5c4b3d8dc97b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:56.406273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6adc70d8-e48e-410c-ad35-5c4b3d8dc97b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:56.407236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6adc70d8-e48e-410c-ad35-5c4b3d8dc97b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:56.407888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6adc70d8-e48e-410c-ad35-5c4b3d8dc97b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:56.563534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6adc70d8-e48e-410c-ad35-5c4b3d8dc97b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:56.573178 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6adc70d8-e48e-410c-ad35-5c4b3d8dc97b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1693 microversion: 2.1 time: 0.180533 Jul 26 20:18:56.573890 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3006/5917] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:56 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:18:57.034796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:57.035455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:57.050397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:57.050863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:57.052733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:57.053496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:57.126101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:57.126420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:57.127062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lazy-loading 'fault' on Instance uuid 62259a36-dba6-40de-9a43-62b44372f548 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:18:57.199322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:57.208312 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2324b6bb-c470-4981-957e-15993bb91707 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 200 len: 1193 microversion: 2.1 time: 0.193630 Jul 26 20:18:57.208895 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2912/5918] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:57 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 1193 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:57.596131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bdf5dd1-75b0-47ca-9312-441e86355239 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:57.597179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5bdf5dd1-75b0-47ca-9312-441e86355239 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:57.600669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:18:57.607409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bdf5dd1-75b0-47ca-9312-441e86355239 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:57.607913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bdf5dd1-75b0-47ca-9312-441e86355239 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:57.608864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bdf5dd1-75b0-47ca-9312-441e86355239 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:57.609306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bdf5dd1-75b0-47ca-9312-441e86355239 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:57.763937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5bdf5dd1-75b0-47ca-9312-441e86355239 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:57.771794 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5bdf5dd1-75b0-47ca-9312-441e86355239 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1693 microversion: 2.1 time: 0.179696 Jul 26 20:18:57.772307 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3007/5919] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:57 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:58.231550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:58.232429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 62259a36-dba6-40de-9a43-62b44372f548] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:58.239430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:58.240038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:58.241009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:58.241542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:58.256247 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 62259a36-dba6-40de-9a43-62b44372f548 could not be found. Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 HTTP/1.1 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 62259a36-dba6-40de-9a43-62b44372f548 could not be found. Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '62259a36-dba6-40de-9a43-62b44372f548'} Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62259a36-dba6-40de-9a43-62b44372f548 could not be found. Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62259a36-dba6-40de-9a43-62b44372f548 could not be found. Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:18:58.258029 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:58.262626 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:18:58.262626 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:18:58.262626 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:18:58.262626 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:18:58.262626 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:18:58.262626 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62259a36-dba6-40de-9a43-62b44372f548 could not be found. Jul 26 20:18:58.262626 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:18:58.263783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 62259a36-dba6-40de-9a43-62b44372f548 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:18:58.264763 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ac5e2a95-7d32-4579-af5a-8306267e2685 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548" status: 404 len: 111 microversion: 2.1 time: 0.038517 Jul 26 20:18:58.265870 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2913/5920] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:58 2022] GET /compute/v2.1/servers/62259a36-dba6-40de-9a43-62b44372f548 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:18:58.800199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-315afcc5-8c49-4a0e-9d28-637584f9e7d9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:58.800839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-315afcc5-8c49-4a0e-9d28-637584f9e7d9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:18:58.819848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-315afcc5-8c49-4a0e-9d28-637584f9e7d9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:58.820482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-315afcc5-8c49-4a0e-9d28-637584f9e7d9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:58.822153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-315afcc5-8c49-4a0e-9d28-637584f9e7d9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:18:58.822925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-315afcc5-8c49-4a0e-9d28-637584f9e7d9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:18:58.968091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-315afcc5-8c49-4a0e-9d28-637584f9e7d9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:18:58.976322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-315afcc5-8c49-4a0e-9d28-637584f9e7d9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.185165 Jul 26 20:18:58.976899 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3008/5921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:58 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:18:59.998383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5f4806ab-8aa4-4b53-9359-98fabb2b619d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:18:59.999173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5f4806ab-8aa4-4b53-9359-98fabb2b619d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:00.006444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f4806ab-8aa4-4b53-9359-98fabb2b619d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:00.007011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f4806ab-8aa4-4b53-9359-98fabb2b619d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:00.008041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f4806ab-8aa4-4b53-9359-98fabb2b619d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:00.008581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5f4806ab-8aa4-4b53-9359-98fabb2b619d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:00.165087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5f4806ab-8aa4-4b53-9359-98fabb2b619d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:00.173844 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5f4806ab-8aa4-4b53-9359-98fabb2b619d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.179455 Jul 26 20:19:00.174472 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2914/5922] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:18:59 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:01.195262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7d3611c0-a4ab-44cc-b165-1d174f3c35da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:01.195909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7d3611c0-a4ab-44cc-b165-1d174f3c35da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:01.203253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d3611c0-a4ab-44cc-b165-1d174f3c35da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:01.203938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d3611c0-a4ab-44cc-b165-1d174f3c35da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:01.204785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d3611c0-a4ab-44cc-b165-1d174f3c35da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:01.205373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7d3611c0-a4ab-44cc-b165-1d174f3c35da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:01.404652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7d3611c0-a4ab-44cc-b165-1d174f3c35da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:01.413263 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7d3611c0-a4ab-44cc-b165-1d174f3c35da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.221949 Jul 26 20:19:01.413960 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3009/5923] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:01 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:02.436568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-319a6b86-0449-45b0-b4ac-c832cf6a90cc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:02.437685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-319a6b86-0449-45b0-b4ac-c832cf6a90cc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:02.447910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319a6b86-0449-45b0-b4ac-c832cf6a90cc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:02.448364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319a6b86-0449-45b0-b4ac-c832cf6a90cc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:02.449143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319a6b86-0449-45b0-b4ac-c832cf6a90cc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:02.449580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-319a6b86-0449-45b0-b4ac-c832cf6a90cc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:02.600717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-319a6b86-0449-45b0-b4ac-c832cf6a90cc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:02.609297 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-319a6b86-0449-45b0-b4ac-c832cf6a90cc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.177256 Jul 26 20:19:02.609875 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2915/5924] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:02 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:03.378317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-274158551", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8b93c900-abdb-4e6f-bd73-a15e7468fd30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8dd04748-e18a-4968-8aa4-c87b9f3665a7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:03.445913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] validate_networks() for [('8dd04748-e18a-4968-8aa4-c87b9f3665a7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:19:03.631359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-838eb992-0438-4f61-9d87-d8a94a56fb05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:03.632025 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-838eb992-0438-4f61-9d87-d8a94a56fb05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:03.639966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-838eb992-0438-4f61-9d87-d8a94a56fb05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:03.640424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-838eb992-0438-4f61-9d87-d8a94a56fb05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:03.641206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-838eb992-0438-4f61-9d87-d8a94a56fb05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:03.641652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-838eb992-0438-4f61-9d87-d8a94a56fb05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:03.776122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-838eb992-0438-4f61-9d87-d8a94a56fb05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:03.783747 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-838eb992-0438-4f61-9d87-d8a94a56fb05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.156216 Jul 26 20:19:03.784330 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2916/5925] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:03 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:19:04.175463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:19:04.176016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:19:04.176552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:19:04.177102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:19:04.177577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:19:04.186746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:04.187191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:04.188022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:04.188454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:04.204978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:19:04.210215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:19:04.267600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:19:04.269957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b93c900-abdb-4e6f-bd73-a15e7468fd30',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:19:04.408520 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ecb50294-c4fa-47ef-a293-4df9d5f63470 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034086 Jul 26 20:19:04.409189 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3010/5926] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:19:04.420352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d5b5d78b-5086-4a95-b76a-76877942deaf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:04.421504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d5b5d78b-5086-4a95-b76a-76877942deaf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:04.482496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d5b5d78b-5086-4a95-b76a-76877942deaf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:04.491048 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d5b5d78b-5086-4a95-b76a-76877942deaf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1056 microversion: 2.1 time: 0.074512 Jul 26 20:19:04.492595 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2917/5927] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:04 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1056 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:04.807825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-795a7100-f5bc-49ca-900a-8f5d19196c75 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:04.808538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-795a7100-f5bc-49ca-900a-8f5d19196c75 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:04.815631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-795a7100-f5bc-49ca-900a-8f5d19196c75 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:04.816093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-795a7100-f5bc-49ca-900a-8f5d19196c75 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:04.816862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-795a7100-f5bc-49ca-900a-8f5d19196c75 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:04.817302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-795a7100-f5bc-49ca-900a-8f5d19196c75 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:05.061069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-795a7100-f5bc-49ca-900a-8f5d19196c75 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:05.069244 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-795a7100-f5bc-49ca-900a-8f5d19196c75 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.266849 Jul 26 20:19:05.069914 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3011/5928] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:04 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:05.512851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eb44183b-e11c-4859-9152-8cfd6dba042d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:05.513951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eb44183b-e11c-4859-9152-8cfd6dba042d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:05.522097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb44183b-e11c-4859-9152-8cfd6dba042d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:05.522728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb44183b-e11c-4859-9152-8cfd6dba042d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:05.523681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb44183b-e11c-4859-9152-8cfd6dba042d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:05.524263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eb44183b-e11c-4859-9152-8cfd6dba042d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:05.626301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eb44183b-e11c-4859-9152-8cfd6dba042d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:05.634037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eb44183b-e11c-4859-9152-8cfd6dba042d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1172 microversion: 2.1 time: 0.125156 Jul 26 20:19:05.635163 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2918/5929] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:05 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1172 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:06.094292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a043ab71-0572-4890-9262-7be5a9fdf5b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:06.096202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a043ab71-0572-4890-9262-7be5a9fdf5b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:06.125309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a043ab71-0572-4890-9262-7be5a9fdf5b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:06.126960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a043ab71-0572-4890-9262-7be5a9fdf5b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:06.128020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a043ab71-0572-4890-9262-7be5a9fdf5b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:06.129304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a043ab71-0572-4890-9262-7be5a9fdf5b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:06.662140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a043ab71-0572-4890-9262-7be5a9fdf5b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:06.676164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-97501276-e491-4473-9a1e-8955aca670fd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:06.677360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-97501276-e491-4473-9a1e-8955aca670fd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:06.694175 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a043ab71-0572-4890-9262-7be5a9fdf5b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.605301 Jul 26 20:19:06.707155 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3012/5930] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:06 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:06.719983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97501276-e491-4473-9a1e-8955aca670fd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:06.720517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97501276-e491-4473-9a1e-8955aca670fd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:06.722503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97501276-e491-4473-9a1e-8955aca670fd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:06.722982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-97501276-e491-4473-9a1e-8955aca670fd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:06.993879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-97501276-e491-4473-9a1e-8955aca670fd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:07.005693 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-97501276-e491-4473-9a1e-8955aca670fd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1214 microversion: 2.1 time: 0.352137 Jul 26 20:19:07.007054 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2919/5931] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:06 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:07.104456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-3e8be603-429b-4508-9dfd-51a84d420b78 req-b52b8b29-0a70-467d-bbf9-7f5bc3f97329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee3cd62-a4b1-4654-ab99-89bdc44dfd47", "tag": "99ba9507-ba1b-4c2e-80b9-f9d0aa1af704"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:07.140606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3e8be603-429b-4508-9dfd-51a84d420b78 req-b52b8b29-0a70-467d-bbf9-7f5bc3f97329 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:07.140984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3e8be603-429b-4508-9dfd-51a84d420b78 req-b52b8b29-0a70-467d-bbf9-7f5bc3f97329 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:07.166926 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3e8be603-429b-4508-9dfd-51a84d420b78 req-b52b8b29-0a70-467d-bbf9-7f5bc3f97329 service nova] Creating event network-changed:99ba9507-ba1b-4c2e-80b9-f9d0aa1af704 for instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 on n-h2-708768-8 Jul 26 20:19:07.177721 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-3e8be603-429b-4508-9dfd-51a84d420b78 req-b52b8b29-0a70-467d-bbf9-7f5bc3f97329 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079611 Jul 26 20:19:07.181551 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3013/5932] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:07.722804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9a2f2768-45fc-4035-9fea-3f49ea7e03f3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:07.723327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9a2f2768-45fc-4035-9fea-3f49ea7e03f3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:07.729760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:07.731927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a2f2768-45fc-4035-9fea-3f49ea7e03f3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:07.732572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a2f2768-45fc-4035-9fea-3f49ea7e03f3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:07.733632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a2f2768-45fc-4035-9fea-3f49ea7e03f3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:07.734338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9a2f2768-45fc-4035-9fea-3f49ea7e03f3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:07.983098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9a2f2768-45fc-4035-9fea-3f49ea7e03f3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:07.996067 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9a2f2768-45fc-4035-9fea-3f49ea7e03f3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.276201 Jul 26 20:19:07.997866 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2920/5933] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:07 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:08.042083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6fb6fe2-c756-464c-a157-884e03698d45 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:08.043003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f6fb6fe2-c756-464c-a157-884e03698d45 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:08.052209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6fb6fe2-c756-464c-a157-884e03698d45 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:08.053085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6fb6fe2-c756-464c-a157-884e03698d45 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:08.054093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6fb6fe2-c756-464c-a157-884e03698d45 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:08.054854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6fb6fe2-c756-464c-a157-884e03698d45 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:08.307603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f6fb6fe2-c756-464c-a157-884e03698d45 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:08.316115 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f6fb6fe2-c756-464c-a157-884e03698d45 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1214 microversion: 2.1 time: 0.282888 Jul 26 20:19:08.316799 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3014/5934] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:08 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:09.017442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c6d89c8c-c230-4fab-98b5-ac63cfafdf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:09.018063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c6d89c8c-c230-4fab-98b5-ac63cfafdf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:09.027113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6d89c8c-c230-4fab-98b5-ac63cfafdf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:09.028426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6d89c8c-c230-4fab-98b5-ac63cfafdf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:09.029414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6d89c8c-c230-4fab-98b5-ac63cfafdf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:09.030628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6d89c8c-c230-4fab-98b5-ac63cfafdf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:09.185460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c6d89c8c-c230-4fab-98b5-ac63cfafdf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:09.194374 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c6d89c8c-c230-4fab-98b5-ac63cfafdf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.180783 Jul 26 20:19:09.195556 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2921/5935] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:09 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:09.338782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68e3b79c-55fd-4e9b-9ae1-e319cc034781 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:09.339986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68e3b79c-55fd-4e9b-9ae1-e319cc034781 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:09.348984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e3b79c-55fd-4e9b-9ae1-e319cc034781 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:09.349599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e3b79c-55fd-4e9b-9ae1-e319cc034781 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:09.350544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e3b79c-55fd-4e9b-9ae1-e319cc034781 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:09.351122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68e3b79c-55fd-4e9b-9ae1-e319cc034781 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:09.597875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68e3b79c-55fd-4e9b-9ae1-e319cc034781 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:09.609855 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68e3b79c-55fd-4e9b-9ae1-e319cc034781 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1214 microversion: 2.1 time: 0.276361 Jul 26 20:19:09.610453 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3015/5936] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:09 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1214 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:10.217192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1c3ca0b6-72cd-49cd-8a9b-2bf86374d0a3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:10.217809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1c3ca0b6-72cd-49cd-8a9b-2bf86374d0a3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:10.231704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c3ca0b6-72cd-49cd-8a9b-2bf86374d0a3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:10.232161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c3ca0b6-72cd-49cd-8a9b-2bf86374d0a3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:10.233230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c3ca0b6-72cd-49cd-8a9b-2bf86374d0a3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:10.233677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c3ca0b6-72cd-49cd-8a9b-2bf86374d0a3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:10.452655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1c3ca0b6-72cd-49cd-8a9b-2bf86374d0a3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:10.461328 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1c3ca0b6-72cd-49cd-8a9b-2bf86374d0a3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1698 microversion: 2.1 time: 0.248087 Jul 26 20:19:10.463694 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2922/5937] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:10 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1698 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:10.632801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a87ec920-d50f-4ea2-a17c-6f4f2d00e40c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:10.634185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a87ec920-d50f-4ea2-a17c-6f4f2d00e40c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:10.641494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a87ec920-d50f-4ea2-a17c-6f4f2d00e40c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:10.642120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a87ec920-d50f-4ea2-a17c-6f4f2d00e40c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:10.643027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a87ec920-d50f-4ea2-a17c-6f4f2d00e40c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:10.643595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a87ec920-d50f-4ea2-a17c-6f4f2d00e40c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:10.891691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a87ec920-d50f-4ea2-a17c-6f4f2d00e40c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:10.901952 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a87ec920-d50f-4ea2-a17c-6f4f2d00e40c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1214 microversion: 2.1 time: 0.272956 Jul 26 20:19:10.903446 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3016/5938] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:10 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:11.326016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5cd1b36c-e696-4426-95e2-15745e4db0f3 req-e486ae95-3efe-47a8-b261-a14a61517642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abb33a0-987a-4fa5-824b-e18244f0d127", "name": "network-vif-unplugged", "status": "completed", "tag": "8c8dd919-0f65-4029-a818-403cebfd673e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:11.337489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cd1b36c-e696-4426-95e2-15745e4db0f3 req-e486ae95-3efe-47a8-b261-a14a61517642 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:11.338064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cd1b36c-e696-4426-95e2-15745e4db0f3 req-e486ae95-3efe-47a8-b261-a14a61517642 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:11.351063 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5cd1b36c-e696-4426-95e2-15745e4db0f3 req-e486ae95-3efe-47a8-b261-a14a61517642 service nova] Creating event network-vif-unplugged:8c8dd919-0f65-4029-a818-403cebfd673e for instance 4abb33a0-987a-4fa5-824b-e18244f0d127 on n-h2-708768-8 Jul 26 20:19:11.356720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-5cd1b36c-e696-4426-95e2-15745e4db0f3 req-e486ae95-3efe-47a8-b261-a14a61517642 service nova] Instance 4abb33a0-987a-4fa5-824b-e18244f0d127 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:19:11.368265 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5cd1b36c-e696-4426-95e2-15745e4db0f3 req-e486ae95-3efe-47a8-b261-a14a61517642 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045795 Jul 26 20:19:11.369125 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2923/5939] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:19:11.483109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5dabfe3a-831b-4c3b-8b76-85f59a442e8b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:11.484117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5dabfe3a-831b-4c3b-8b76-85f59a442e8b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:11.495803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dabfe3a-831b-4c3b-8b76-85f59a442e8b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:11.496474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dabfe3a-831b-4c3b-8b76-85f59a442e8b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:11.497444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dabfe3a-831b-4c3b-8b76-85f59a442e8b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:11.498298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dabfe3a-831b-4c3b-8b76-85f59a442e8b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:11.794348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5dabfe3a-831b-4c3b-8b76-85f59a442e8b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:11.802420 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5dabfe3a-831b-4c3b-8b76-85f59a442e8b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1697 microversion: 2.1 time: 0.323585 Jul 26 20:19:11.803543 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3017/5940] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:11 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1697 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:11.924645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82bc5b5e-c1b0-423b-aa12-ebb7d6a52e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:11.925533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-82bc5b5e-c1b0-423b-aa12-ebb7d6a52e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:11.932816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82bc5b5e-c1b0-423b-aa12-ebb7d6a52e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:11.933267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82bc5b5e-c1b0-423b-aa12-ebb7d6a52e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:11.934479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82bc5b5e-c1b0-423b-aa12-ebb7d6a52e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:11.934919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82bc5b5e-c1b0-423b-aa12-ebb7d6a52e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:12.150142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-82bc5b5e-c1b0-423b-aa12-ebb7d6a52e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:12.160648 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-82bc5b5e-c1b0-423b-aa12-ebb7d6a52e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.240063 Jul 26 20:19:12.161610 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2924/5941] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:11 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:12.827483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-31cceaaf-07f6-417d-aa1a-24d6209df1c2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:12.828748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-31cceaaf-07f6-417d-aa1a-24d6209df1c2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:12.835769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31cceaaf-07f6-417d-aa1a-24d6209df1c2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:12.836304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31cceaaf-07f6-417d-aa1a-24d6209df1c2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:12.838389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31cceaaf-07f6-417d-aa1a-24d6209df1c2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:12.838898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31cceaaf-07f6-417d-aa1a-24d6209df1c2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:13.074683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-31cceaaf-07f6-417d-aa1a-24d6209df1c2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:13.082350 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-31cceaaf-07f6-417d-aa1a-24d6209df1c2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1697 microversion: 2.1 time: 0.258773 Jul 26 20:19:13.083013 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3018/5942] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:12 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1697 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:13.183050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fbad3984-d81d-49e8-8cf6-816ab680036b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:13.183951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fbad3984-d81d-49e8-8cf6-816ab680036b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:13.191698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbad3984-d81d-49e8-8cf6-816ab680036b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:13.192151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbad3984-d81d-49e8-8cf6-816ab680036b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:13.192932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbad3984-d81d-49e8-8cf6-816ab680036b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:13.193370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fbad3984-d81d-49e8-8cf6-816ab680036b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:13.201474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:13.369840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fbad3984-d81d-49e8-8cf6-816ab680036b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:13.377850 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fbad3984-d81d-49e8-8cf6-816ab680036b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.199327 Jul 26 20:19:13.378422 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2925/5943] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:13 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:13.393172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c78775b3-7e7a-4b4c-aa63-ae2daab7d82f req-4748b587-7a55-4987-a8e0-90841eb73dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abb33a0-987a-4fa5-824b-e18244f0d127", "tag": "8c8dd919-0f65-4029-a818-403cebfd673e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:13.410185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c78775b3-7e7a-4b4c-aa63-ae2daab7d82f req-4748b587-7a55-4987-a8e0-90841eb73dda service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:13.411011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c78775b3-7e7a-4b4c-aa63-ae2daab7d82f req-4748b587-7a55-4987-a8e0-90841eb73dda service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:13.427527 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c78775b3-7e7a-4b4c-aa63-ae2daab7d82f req-4748b587-7a55-4987-a8e0-90841eb73dda service nova] Creating event network-changed:8c8dd919-0f65-4029-a818-403cebfd673e for instance 4abb33a0-987a-4fa5-824b-e18244f0d127 on n-h2-708768-8 Jul 26 20:19:13.433649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-c78775b3-7e7a-4b4c-aa63-ae2daab7d82f req-4748b587-7a55-4987-a8e0-90841eb73dda service nova] Instance 4abb33a0-987a-4fa5-824b-e18244f0d127 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:19:13.445126 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c78775b3-7e7a-4b4c-aa63-ae2daab7d82f req-4748b587-7a55-4987-a8e0-90841eb73dda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059113 Jul 26 20:19:13.445818 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3019/5944] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:19:14.104906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e094f619-1e6e-44ba-bd1d-ac93d1e8be35 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:14.106067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e094f619-1e6e-44ba-bd1d-ac93d1e8be35 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:14.112916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e094f619-1e6e-44ba-bd1d-ac93d1e8be35 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:14.113538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e094f619-1e6e-44ba-bd1d-ac93d1e8be35 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:14.114427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e094f619-1e6e-44ba-bd1d-ac93d1e8be35 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:14.114971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e094f619-1e6e-44ba-bd1d-ac93d1e8be35 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:14.398348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:14.400400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:14.411173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-874f7c43-a92e-4705-ba86-8f0164806a35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:14.412575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-874f7c43-a92e-4705-ba86-8f0164806a35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:14.420933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-874f7c43-a92e-4705-ba86-8f0164806a35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:14.421308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-874f7c43-a92e-4705-ba86-8f0164806a35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:14.422211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-874f7c43-a92e-4705-ba86-8f0164806a35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:14.422822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-874f7c43-a92e-4705-ba86-8f0164806a35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:14.487438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:14.496047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e094f619-1e6e-44ba-bd1d-ac93d1e8be35 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:14.518582 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e094f619-1e6e-44ba-bd1d-ac93d1e8be35 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1695 microversion: 2.1 time: 0.417654 Jul 26 20:19:14.521524 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2926/5945] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:14 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1695 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:14.562940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-874f7c43-a92e-4705-ba86-8f0164806a35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:14.572309 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-874f7c43-a92e-4705-ba86-8f0164806a35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.175837 Jul 26 20:19:14.574943 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3020/5946] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:14 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:15.542803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9744b6b8-da59-41a0-aead-afa41c289ebd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:15.544234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9744b6b8-da59-41a0-aead-afa41c289ebd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:15.570554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9744b6b8-da59-41a0-aead-afa41c289ebd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:15.572961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9744b6b8-da59-41a0-aead-afa41c289ebd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:15.575239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9744b6b8-da59-41a0-aead-afa41c289ebd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:15.575880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9744b6b8-da59-41a0-aead-afa41c289ebd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:15.596041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea955f2a-64aa-4785-baac-114f73c1d205 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:15.596645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ea955f2a-64aa-4785-baac-114f73c1d205 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:15.606104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea955f2a-64aa-4785-baac-114f73c1d205 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:15.606570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea955f2a-64aa-4785-baac-114f73c1d205 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:15.607368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea955f2a-64aa-4785-baac-114f73c1d205 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:15.607841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea955f2a-64aa-4785-baac-114f73c1d205 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:15.769829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ea955f2a-64aa-4785-baac-114f73c1d205 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:15.778543 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea955f2a-64aa-4785-baac-114f73c1d205 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.186690 Jul 26 20:19:15.779240 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3021/5947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:15 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:15.887146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9744b6b8-da59-41a0-aead-afa41c289ebd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:15.897329 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9744b6b8-da59-41a0-aead-afa41c289ebd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1692 microversion: 2.1 time: 0.359521 Jul 26 20:19:15.929746 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2927/5948] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:15 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1692 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:15.934723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15c29906-95f5-472b-8ecb-8bf548f784e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:15.936172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15c29906-95f5-472b-8ecb-8bf548f784e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:15.946680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15c29906-95f5-472b-8ecb-8bf548f784e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:15.947349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15c29906-95f5-472b-8ecb-8bf548f784e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:15.948373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15c29906-95f5-472b-8ecb-8bf548f784e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:15.949014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15c29906-95f5-472b-8ecb-8bf548f784e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:16.027993 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15c29906-95f5-472b-8ecb-8bf548f784e1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action" status: 204 len: 0 microversion: 2.1 time: 0.101288 Jul 26 20:19:16.028827 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3022/5949] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:19:15 2022] POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:19:16.038180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f52d91a9-1f72-4c25-850f-be490ca69d95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:16.038804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f52d91a9-1f72-4c25-850f-be490ca69d95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:16.052516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f52d91a9-1f72-4c25-850f-be490ca69d95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:16.053617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f52d91a9-1f72-4c25-850f-be490ca69d95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:16.054517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f52d91a9-1f72-4c25-850f-be490ca69d95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:16.055285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f52d91a9-1f72-4c25-850f-be490ca69d95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:16.444282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f52d91a9-1f72-4c25-850f-be490ca69d95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:16.453570 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f52d91a9-1f72-4c25-850f-be490ca69d95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1692 microversion: 2.1 time: 0.419722 Jul 26 20:19:16.454173 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2928/5950] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:16 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1692 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:16.801542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8617dd37-db57-4d92-b626-35b3b160dea9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:16.802270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8617dd37-db57-4d92-b626-35b3b160dea9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:16.819738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8617dd37-db57-4d92-b626-35b3b160dea9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:16.820878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8617dd37-db57-4d92-b626-35b3b160dea9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:16.821730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8617dd37-db57-4d92-b626-35b3b160dea9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:16.822171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8617dd37-db57-4d92-b626-35b3b160dea9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:16.886791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:17.060667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8617dd37-db57-4d92-b626-35b3b160dea9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:17.068476 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8617dd37-db57-4d92-b626-35b3b160dea9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.271377 Jul 26 20:19:17.069260 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3023/5951] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:16 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:17.261990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e8324c2-36a5-4d72-a773-d7e984cfabf5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:17.263264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5e8324c2-36a5-4d72-a773-d7e984cfabf5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:17.273949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e8324c2-36a5-4d72-a773-d7e984cfabf5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:17.275504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e8324c2-36a5-4d72-a773-d7e984cfabf5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:17.276405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e8324c2-36a5-4d72-a773-d7e984cfabf5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:17.276974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5e8324c2-36a5-4d72-a773-d7e984cfabf5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:17.315533 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5e8324c2-36a5-4d72-a773-d7e984cfabf5 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/ips" status: 200 len: 144 microversion: 2.1 time: 0.057585 Jul 26 20:19:17.316478 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2929/5952] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:19:17 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/ips => generated 144 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:17.481151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a87d8b12-e8d7-40a2-b7fe-f84b4304a86b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:17.481987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a87d8b12-e8d7-40a2-b7fe-f84b4304a86b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:17.494537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a87d8b12-e8d7-40a2-b7fe-f84b4304a86b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:17.498240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a87d8b12-e8d7-40a2-b7fe-f84b4304a86b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:17.499604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a87d8b12-e8d7-40a2-b7fe-f84b4304a86b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:17.500803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a87d8b12-e8d7-40a2-b7fe-f84b4304a86b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:17.857993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a87d8b12-e8d7-40a2-b7fe-f84b4304a86b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:17.868633 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a87d8b12-e8d7-40a2-b7fe-f84b4304a86b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1692 microversion: 2.1 time: 0.394136 Jul 26 20:19:17.874188 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3024/5953] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:17 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1692 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:18.092207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0cb81abe-fc7d-491d-ada5-b3a0ca812e27 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:18.093068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0cb81abe-fc7d-491d-ada5-b3a0ca812e27 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:18.104773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cb81abe-fc7d-491d-ada5-b3a0ca812e27 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:18.106848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cb81abe-fc7d-491d-ada5-b3a0ca812e27 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:18.107917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cb81abe-fc7d-491d-ada5-b3a0ca812e27 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:18.109214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0cb81abe-fc7d-491d-ada5-b3a0ca812e27 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:18.385215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0cb81abe-fc7d-491d-ada5-b3a0ca812e27 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:18.394224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0cb81abe-fc7d-491d-ada5-b3a0ca812e27 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.307294 Jul 26 20:19:18.397591 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2930/5954] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:18 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:18.894631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de645769-9ab7-456f-99ea-2098a65a3156 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:18.895272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de645769-9ab7-456f-99ea-2098a65a3156 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:18.903715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de645769-9ab7-456f-99ea-2098a65a3156 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:18.904199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de645769-9ab7-456f-99ea-2098a65a3156 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:18.904987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de645769-9ab7-456f-99ea-2098a65a3156 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:18.905427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de645769-9ab7-456f-99ea-2098a65a3156 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:19.049730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-de645769-9ab7-456f-99ea-2098a65a3156 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:19.057843 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de645769-9ab7-456f-99ea-2098a65a3156 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1684 microversion: 2.1 time: 0.167196 Jul 26 20:19:19.058420 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3025/5955] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:18 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:19.418929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d5d34a7d-4201-4f93-b8bc-b589b4c5c60c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:19.420306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d5d34a7d-4201-4f93-b8bc-b589b4c5c60c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:19.427707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d5d34a7d-4201-4f93-b8bc-b589b4c5c60c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:19.428161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d5d34a7d-4201-4f93-b8bc-b589b4c5c60c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:19.428940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d5d34a7d-4201-4f93-b8bc-b589b4c5c60c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:19.429383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d5d34a7d-4201-4f93-b8bc-b589b4c5c60c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:19.622613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d5d34a7d-4201-4f93-b8bc-b589b4c5c60c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:19.631148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d5d34a7d-4201-4f93-b8bc-b589b4c5c60c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.216706 Jul 26 20:19:19.632360 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2931/5956] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:19 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:19.852456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-574be1f5-a1c9-48dc-982e-4731ff8871b3 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bdf8682-aff5-4af5-a9e9-39c8ff7771e9"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:19.856257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-574be1f5-a1c9-48dc-982e-4731ff8871b3 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:19.868634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-574be1f5-a1c9-48dc-982e-4731ff8871b3 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:19.869743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-574be1f5-a1c9-48dc-982e-4731ff8871b3 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:19.871165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-574be1f5-a1c9-48dc-982e-4731ff8871b3 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:19.871878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-574be1f5-a1c9-48dc-982e-4731ff8871b3 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:19.903373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-6922c333-5c70-49c5-9097-8bb4f5b1ded2 req-9a098f8f-f119-42e7-90d7-6e9f6f51feae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abb33a0-987a-4fa5-824b-e18244f0d127", "name": "network-vif-plugged", "status": "completed", "tag": "8c8dd919-0f65-4029-a818-403cebfd673e"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:19.923318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6922c333-5c70-49c5-9097-8bb4f5b1ded2 req-9a098f8f-f119-42e7-90d7-6e9f6f51feae service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:19.924081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-6922c333-5c70-49c5-9097-8bb4f5b1ded2 req-9a098f8f-f119-42e7-90d7-6e9f6f51feae service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:19.940136 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-6922c333-5c70-49c5-9097-8bb4f5b1ded2 req-9a098f8f-f119-42e7-90d7-6e9f6f51feae service nova] Creating event network-vif-plugged:8c8dd919-0f65-4029-a818-403cebfd673e for instance 4abb33a0-987a-4fa5-824b-e18244f0d127 on n-h2-708768-8 Jul 26 20:19:19.946249 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-6922c333-5c70-49c5-9097-8bb4f5b1ded2 req-9a098f8f-f119-42e7-90d7-6e9f6f51feae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050595 Jul 26 20:19:19.948095 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2932/5957] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:19:20.137130 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-574be1f5-a1c9-48dc-982e-4731ff8871b3 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288882 Jul 26 20:19:20.142753 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3026/5958] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:19:19 2022] POST /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:20.654306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-be574a90-c025-48f3-a9a3-53b2375cc386 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:20.655384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-be574a90-c025-48f3-a9a3-53b2375cc386 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:20.662482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be574a90-c025-48f3-a9a3-53b2375cc386 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:20.662946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be574a90-c025-48f3-a9a3-53b2375cc386 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:20.663774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be574a90-c025-48f3-a9a3-53b2375cc386 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:20.664407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be574a90-c025-48f3-a9a3-53b2375cc386 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:20.801580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-be574a90-c025-48f3-a9a3-53b2375cc386 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:20.810350 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-be574a90-c025-48f3-a9a3-53b2375cc386 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.160969 Jul 26 20:19:20.810925 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2933/5959] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:20 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:21.834396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-da757348-cf52-4b5c-b319-1dd9f4f4b03e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:21.835735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-da757348-cf52-4b5c-b319-1dd9f4f4b03e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:21.842964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da757348-cf52-4b5c-b319-1dd9f4f4b03e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:21.843424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da757348-cf52-4b5c-b319-1dd9f4f4b03e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:21.844228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da757348-cf52-4b5c-b319-1dd9f4f4b03e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:21.844829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-da757348-cf52-4b5c-b319-1dd9f4f4b03e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:21.969731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-164188e0-24b8-4f17-bddd-f426e02feeba req-c706bc37-c709-451b-8754-aa2e2300b56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee3cd62-a4b1-4654-ab99-89bdc44dfd47", "name": "network-vif-plugged", "status": "completed", "tag": "99ba9507-ba1b-4c2e-80b9-f9d0aa1af704"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:21.982465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-164188e0-24b8-4f17-bddd-f426e02feeba req-c706bc37-c709-451b-8754-aa2e2300b56f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:21.983065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-164188e0-24b8-4f17-bddd-f426e02feeba req-c706bc37-c709-451b-8754-aa2e2300b56f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:21.996228 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-164188e0-24b8-4f17-bddd-f426e02feeba req-c706bc37-c709-451b-8754-aa2e2300b56f service nova] Creating event network-vif-plugged:99ba9507-ba1b-4c2e-80b9-f9d0aa1af704 for instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 on n-h2-708768-8 Jul 26 20:19:22.001781 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-164188e0-24b8-4f17-bddd-f426e02feeba req-c706bc37-c709-451b-8754-aa2e2300b56f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036559 Jul 26 20:19:22.002712 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2934/5960] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:22.093249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-da757348-cf52-4b5c-b319-1dd9f4f4b03e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:22.109713 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-da757348-cf52-4b5c-b319-1dd9f4f4b03e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.280548 Jul 26 20:19:22.110834 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3027/5961] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:21 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:23.131784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f447404d-8a31-47ac-8829-0330fd261604 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:23.132542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f447404d-8a31-47ac-8829-0330fd261604 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:23.139364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f447404d-8a31-47ac-8829-0330fd261604 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:23.139848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f447404d-8a31-47ac-8829-0330fd261604 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:23.140622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f447404d-8a31-47ac-8829-0330fd261604 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:23.141063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f447404d-8a31-47ac-8829-0330fd261604 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:23.431895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f447404d-8a31-47ac-8829-0330fd261604 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:23.441912 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f447404d-8a31-47ac-8829-0330fd261604 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1202 microversion: 2.1 time: 0.314152 Jul 26 20:19:23.441912 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2935/5962] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:23 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1202 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:24.477354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02e9e19b-2b6e-4c1b-8c52-74fc1ecf2d60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:24.483929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02e9e19b-2b6e-4c1b-8c52-74fc1ecf2d60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:24.498716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02e9e19b-2b6e-4c1b-8c52-74fc1ecf2d60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:24.499417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02e9e19b-2b6e-4c1b-8c52-74fc1ecf2d60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:24.500511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02e9e19b-2b6e-4c1b-8c52-74fc1ecf2d60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:24.501044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02e9e19b-2b6e-4c1b-8c52-74fc1ecf2d60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:24.664919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02e9e19b-2b6e-4c1b-8c52-74fc1ecf2d60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:24.673510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02e9e19b-2b6e-4c1b-8c52-74fc1ecf2d60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1389 microversion: 2.1 time: 0.213771 Jul 26 20:19:24.675340 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3028/5963] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:24 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1389 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:24.695247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0354b39-4263-4bf7-ba1d-c61349d126e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:24.695907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a0354b39-4263-4bf7-ba1d-c61349d126e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:24.704071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0354b39-4263-4bf7-ba1d-c61349d126e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:24.704748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0354b39-4263-4bf7-ba1d-c61349d126e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:24.705876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0354b39-4263-4bf7-ba1d-c61349d126e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:24.706640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0354b39-4263-4bf7-ba1d-c61349d126e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:25.152206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a0354b39-4263-4bf7-ba1d-c61349d126e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:25.161269 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0354b39-4263-4bf7-ba1d-c61349d126e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1389 microversion: 2.1 time: 0.469771 Jul 26 20:19:25.162279 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2936/5964] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:24 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1389 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:25.187570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7332847a-af24-47f1-a07c-4bc5b8782646 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:25.188578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7332847a-af24-47f1-a07c-4bc5b8782646 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:25.197589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7332847a-af24-47f1-a07c-4bc5b8782646 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:25.198107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7332847a-af24-47f1-a07c-4bc5b8782646 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:25.198915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7332847a-af24-47f1-a07c-4bc5b8782646 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:25.199375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7332847a-af24-47f1-a07c-4bc5b8782646 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:25.339971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7332847a-af24-47f1-a07c-4bc5b8782646 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:25.347672 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7332847a-af24-47f1-a07c-4bc5b8782646 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1389 microversion: 2.1 time: 0.164855 Jul 26 20:19:25.348243 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3029/5965] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:25 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:25.368814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a2b69e90-dd9a-435f-8f1d-9a3b8b1dcc40 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:25.369565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a2b69e90-dd9a-435f-8f1d-9a3b8b1dcc40 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:25.375824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2b69e90-dd9a-435f-8f1d-9a3b8b1dcc40 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:25.376330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2b69e90-dd9a-435f-8f1d-9a3b8b1dcc40 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:25.377326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2b69e90-dd9a-435f-8f1d-9a3b8b1dcc40 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:25.377803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2b69e90-dd9a-435f-8f1d-9a3b8b1dcc40 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:25.403437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a2b69e90-dd9a-435f-8f1d-9a3b8b1dcc40 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:19:25.481566 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a2b69e90-dd9a-435f-8f1d-9a3b8b1dcc40 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 204 len: 0 microversion: 2.1 time: 0.116995 Jul 26 20:19:25.482412 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2937/5966] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:19:25 2022] DELETE /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:19:25.494041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-528859da-a0c5-4a10-9fa9-5f622cb77658 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:25.498097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-528859da-a0c5-4a10-9fa9-5f622cb77658 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:25.507495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-528859da-a0c5-4a10-9fa9-5f622cb77658 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:25.508041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-528859da-a0c5-4a10-9fa9-5f622cb77658 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:25.509055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-528859da-a0c5-4a10-9fa9-5f622cb77658 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:25.509965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-528859da-a0c5-4a10-9fa9-5f622cb77658 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:25.657659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-528859da-a0c5-4a10-9fa9-5f622cb77658 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:25.666680 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-528859da-a0c5-4a10-9fa9-5f622cb77658 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1395 microversion: 2.1 time: 0.179946 Jul 26 20:19:25.667776 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3030/5967] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:25 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1395 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:19:26.689008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-feddf8b5-779c-4c2d-a6d6-7fa561cf49e2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:26.689644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-feddf8b5-779c-4c2d-a6d6-7fa561cf49e2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:26.697622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-feddf8b5-779c-4c2d-a6d6-7fa561cf49e2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:26.698103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-feddf8b5-779c-4c2d-a6d6-7fa561cf49e2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:26.698883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-feddf8b5-779c-4c2d-a6d6-7fa561cf49e2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:26.699325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-feddf8b5-779c-4c2d-a6d6-7fa561cf49e2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:26.830448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-feddf8b5-779c-4c2d-a6d6-7fa561cf49e2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:26.838277 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-feddf8b5-779c-4c2d-a6d6-7fa561cf49e2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1395 microversion: 2.1 time: 0.153946 Jul 26 20:19:26.838870 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2938/5968] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:26 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:27.800465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6493c4e7-ffeb-4cf2-825f-733734575095 req-18e451b4-d0ef-4a52-b944-9aa895e6ca8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee3cd62-a4b1-4654-ab99-89bdc44dfd47", "name": "network-vif-deleted", "tag": "99ba9507-ba1b-4c2e-80b9-f9d0aa1af704"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:27.812375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:27.818688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6493c4e7-ffeb-4cf2-825f-733734575095 req-18e451b4-d0ef-4a52-b944-9aa895e6ca8a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:27.819333 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6493c4e7-ffeb-4cf2-825f-733734575095 req-18e451b4-d0ef-4a52-b944-9aa895e6ca8a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:27.841377 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6493c4e7-ffeb-4cf2-825f-733734575095 req-18e451b4-d0ef-4a52-b944-9aa895e6ca8a service nova] Creating event network-vif-deleted:99ba9507-ba1b-4c2e-80b9-f9d0aa1af704 for instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 on n-h2-708768-8 Jul 26 20:19:27.852884 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6493c4e7-ffeb-4cf2-825f-733734575095 req-18e451b4-d0ef-4a52-b944-9aa895e6ca8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059627 Jul 26 20:19:27.853515 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3031/5969] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:27.859784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6de45b40-e1b3-4520-b122-a578cbd3beb4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:27.861006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6de45b40-e1b3-4520-b122-a578cbd3beb4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:27.873156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6de45b40-e1b3-4520-b122-a578cbd3beb4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:27.874111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6de45b40-e1b3-4520-b122-a578cbd3beb4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:27.875158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6de45b40-e1b3-4520-b122-a578cbd3beb4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:27.876030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6de45b40-e1b3-4520-b122-a578cbd3beb4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:27.968623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6de45b40-e1b3-4520-b122-a578cbd3beb4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:27.979160 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6de45b40-e1b3-4520-b122-a578cbd3beb4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1187 microversion: 2.1 time: 0.123552 Jul 26 20:19:27.979798 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2939/5970] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:27 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:19:29.000831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb2f2132-62ba-4349-ab36-b45e9d6877f8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:29.002127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eb2f2132-62ba-4349-ab36-b45e9d6877f8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:29.009828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb2f2132-62ba-4349-ab36-b45e9d6877f8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:29.010483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb2f2132-62ba-4349-ab36-b45e9d6877f8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:29.011427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb2f2132-62ba-4349-ab36-b45e9d6877f8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:29.012035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb2f2132-62ba-4349-ab36-b45e9d6877f8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:29.111330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eb2f2132-62ba-4349-ab36-b45e9d6877f8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:29.119120 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb2f2132-62ba-4349-ab36-b45e9d6877f8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1187 microversion: 2.1 time: 0.122563 Jul 26 20:19:29.119718 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3032/5971] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:28 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:30.141997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eabb58c3-61cf-4fb4-9af2-ff9c31c7cd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:30.142617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eabb58c3-61cf-4fb4-9af2-ff9c31c7cd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:30.150637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eabb58c3-61cf-4fb4-9af2-ff9c31c7cd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:30.151348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eabb58c3-61cf-4fb4-9af2-ff9c31c7cd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:30.152161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eabb58c3-61cf-4fb4-9af2-ff9c31c7cd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:30.152602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eabb58c3-61cf-4fb4-9af2-ff9c31c7cd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:30.219573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eabb58c3-61cf-4fb4-9af2-ff9c31c7cd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:30.228888 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eabb58c3-61cf-4fb4-9af2-ff9c31c7cd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1187 microversion: 2.1 time: 0.090963 Jul 26 20:19:30.229514 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2940/5972] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:30 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:30.971224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-94422237-b021-40a0-9dc4-03558473228c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:30.973959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-94422237-b021-40a0-9dc4-03558473228c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:30.982023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94422237-b021-40a0-9dc4-03558473228c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:30.982474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94422237-b021-40a0-9dc4-03558473228c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:30.983289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94422237-b021-40a0-9dc4-03558473228c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:30.983945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-94422237-b021-40a0-9dc4-03558473228c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:31.027686 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-94422237-b021-40a0-9dc4-03558473228c tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060858 Jul 26 20:19:31.039776 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3033/5973] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:19:30 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:31.041351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d3a1d2c3-950e-43ff-bfd7-672557ecae89 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:31.042492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d3a1d2c3-950e-43ff-bfd7-672557ecae89 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:31.049531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3a1d2c3-950e-43ff-bfd7-672557ecae89 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:31.049961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3a1d2c3-950e-43ff-bfd7-672557ecae89 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:31.050993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3a1d2c3-950e-43ff-bfd7-672557ecae89 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:31.051435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3a1d2c3-950e-43ff-bfd7-672557ecae89 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:31.085059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:31.092395 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d3a1d2c3-950e-43ff-bfd7-672557ecae89 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/6bdf8682-aff5-4af5-a9e9-39c8ff7771e9" status: 200 len: 194 microversion: 2.1 time: 0.056372 Jul 26 20:19:31.093024 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2941/5974] 10.222.0.58 () {58 vars in 1413 bytes} [Tue Jul 26 20:19:31 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/6bdf8682-aff5-4af5-a9e9-39c8ff7771e9 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:31.255288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-00a01671-32de-49a5-b5c1-f8e919727d84 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:31.256126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-00a01671-32de-49a5-b5c1-f8e919727d84 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:31.263304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00a01671-32de-49a5-b5c1-f8e919727d84 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:31.263979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00a01671-32de-49a5-b5c1-f8e919727d84 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:31.264772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00a01671-32de-49a5-b5c1-f8e919727d84 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:31.265231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00a01671-32de-49a5-b5c1-f8e919727d84 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:31.357670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-00a01671-32de-49a5-b5c1-f8e919727d84 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:31.380654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-00a01671-32de-49a5-b5c1-f8e919727d84 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1187 microversion: 2.1 time: 0.129194 Jul 26 20:19:31.382087 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3034/5975] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:31 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1187 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:19:32.410662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:32.411781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:32.421336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:32.421791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:32.422629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:32.423072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:32.458648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:32.459102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:32.459564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lazy-loading 'fault' on Instance uuid aee3cd62-a4b1-4654-ab99-89bdc44dfd47 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:19:32.514546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:32.530709 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-854a5fef-6e56-4b5f-b536-d0767a54e227 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 200 len: 1192 microversion: 2.1 time: 0.115860 Jul 26 20:19:32.530709 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2942/5976] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:32 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 1192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:32.538833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89b5fc5e-14cc-42a5-bb46-8062c980b1e4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b435eec8-0542-4055-92e5-1d1b543ded00"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:32.541695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89b5fc5e-14cc-42a5-bb46-8062c980b1e4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:32.549114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89b5fc5e-14cc-42a5-bb46-8062c980b1e4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:32.549580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89b5fc5e-14cc-42a5-bb46-8062c980b1e4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:32.550392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89b5fc5e-14cc-42a5-bb46-8062c980b1e4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:32.550799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89b5fc5e-14cc-42a5-bb46-8062c980b1e4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:32.853609 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89b5fc5e-14cc-42a5-bb46-8062c980b1e4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "POST /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320712 Jul 26 20:19:32.854247 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3035/5977] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:19:32 2022] POST /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:33.545091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:33.545796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: aee3cd62-a4b1-4654-ab99-89bdc44dfd47] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:33.552842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:33.553383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:33.554240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:33.554746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:33.569297 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 could not be found. Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 HTTP/1.1 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 could not be found. Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'aee3cd62-a4b1-4654-ab99-89bdc44dfd47'} Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 could not be found. Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 could not be found. Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:19:33.570968 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 could not be found. Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance aee3cd62-a4b1-4654-ab99-89bdc44dfd47 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ced39d8f-7b48-483c-b7a5-0e1361080f53 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47" status: 404 len: 111 microversion: 2.1 time: 0.031369 Jul 26 20:19:33.575044 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2943/5978] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:33 2022] GET /compute/v2.1/servers/aee3cd62-a4b1-4654-ab99-89bdc44dfd47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:19:41.252311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8db8222c-d432-4188-803c-dda7a0470878 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:41.255326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8db8222c-d432-4188-803c-dda7a0470878 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:41.266557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8db8222c-d432-4188-803c-dda7a0470878 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:41.267014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8db8222c-d432-4188-803c-dda7a0470878 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:41.268006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8db8222c-d432-4188-803c-dda7a0470878 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:41.269134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8db8222c-d432-4188-803c-dda7a0470878 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:41.332172 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8db8222c-d432-4188-803c-dda7a0470878 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action" status: 200 len: 24576 microversion: 2.1 time: 0.084141 Jul 26 20:19:41.333295 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3036/5979] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:19:41 2022] POST /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127/action => generated 24576 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:19:44.836163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9abbe595-206d-474e-846a-993cc2b5acd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:44.841394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9abbe595-206d-474e-846a-993cc2b5acd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:44.844461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:44.845125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:44.852814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9abbe595-206d-474e-846a-993cc2b5acd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:44.853505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9abbe595-206d-474e-846a-993cc2b5acd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:44.854445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9abbe595-206d-474e-846a-993cc2b5acd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:44.855039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9abbe595-206d-474e-846a-993cc2b5acd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:44.889516 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9abbe595-206d-474e-846a-993cc2b5acd8 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057649 Jul 26 20:19:44.890126 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2944/5980] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:19:44 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:45.032544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-063e6062-692b-433f-9d63-ebbea7a214dd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:45.033205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-063e6062-692b-433f-9d63-ebbea7a214dd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:45.042606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-063e6062-692b-433f-9d63-ebbea7a214dd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:45.043275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-063e6062-692b-433f-9d63-ebbea7a214dd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:45.044248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-063e6062-692b-433f-9d63-ebbea7a214dd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:45.045212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-063e6062-692b-433f-9d63-ebbea7a214dd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:45.099776 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-063e6062-692b-433f-9d63-ebbea7a214dd tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/6bdf8682-aff5-4af5-a9e9-39c8ff7771e9" status: 200 len: 194 microversion: 2.1 time: 0.075146 Jul 26 20:19:45.103602 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3037/5981] 10.222.0.58 () {58 vars in 1413 bytes} [Tue Jul 26 20:19:45 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/6bdf8682-aff5-4af5-a9e9-39c8ff7771e9 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:45.111660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-17c0d3fa-92ec-49ac-91df-5caf4db04c5b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:45.112589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-17c0d3fa-92ec-49ac-91df-5caf4db04c5b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:45.122615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17c0d3fa-92ec-49ac-91df-5caf4db04c5b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:45.123678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17c0d3fa-92ec-49ac-91df-5caf4db04c5b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:45.124975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17c0d3fa-92ec-49ac-91df-5caf4db04c5b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:45.125633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17c0d3fa-92ec-49ac-91df-5caf4db04c5b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:45.222469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-17c0d3fa-92ec-49ac-91df-5caf4db04c5b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lazy-loading 'services' on Instance uuid 09b6679a-ff3f-4a52-ae8a-854040630a74 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:19:45.312969 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-17c0d3fa-92ec-49ac-91df-5caf4db04c5b tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/6bdf8682-aff5-4af5-a9e9-39c8ff7771e9" status: 202 len: 0 microversion: 2.1 time: 0.205463 Jul 26 20:19:45.313643 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2945/5982] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:19:45 2022] DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/6bdf8682-aff5-4af5-a9e9-39c8ff7771e9 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:19:47.516444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98620171-9380-4a15-97df-af1231f38071 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:47.517800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-98620171-9380-4a15-97df-af1231f38071 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:47.528212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98620171-9380-4a15-97df-af1231f38071 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:47.530811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98620171-9380-4a15-97df-af1231f38071 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:47.533794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98620171-9380-4a15-97df-af1231f38071 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:47.534457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98620171-9380-4a15-97df-af1231f38071 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:47.548515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:47.762906 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98620171-9380-4a15-97df-af1231f38071 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1835 microversion: 2.1 time: 0.250232 Jul 26 20:19:47.765949 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3038/5983] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:47 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1835 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:49.712320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0a6f1c1e-7e4f-465f-b954-b14121653fa3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:49.712938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0a6f1c1e-7e4f-465f-b954-b14121653fa3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:49.731601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0a6f1c1e-7e4f-465f-b954-b14121653fa3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:49.732071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0a6f1c1e-7e4f-465f-b954-b14121653fa3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:49.733055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0a6f1c1e-7e4f-465f-b954-b14121653fa3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:49.733641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0a6f1c1e-7e4f-465f-b954-b14121653fa3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:49.749866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c48aada8-1969-428b-ad86-106b7a878d46 req-562990a7-27cd-4571-9bad-4e8050907fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abb33a0-987a-4fa5-824b-e18244f0d127", "tag": "8c8dd919-0f65-4029-a818-403cebfd673e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:49.775930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c48aada8-1969-428b-ad86-106b7a878d46 req-562990a7-27cd-4571-9bad-4e8050907fab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:49.776378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c48aada8-1969-428b-ad86-106b7a878d46 req-562990a7-27cd-4571-9bad-4e8050907fab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:49.814084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0a6f1c1e-7e4f-465f-b954-b14121653fa3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:19:49.817464 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c48aada8-1969-428b-ad86-106b7a878d46 req-562990a7-27cd-4571-9bad-4e8050907fab service nova] Creating event network-changed:8c8dd919-0f65-4029-a818-403cebfd673e for instance 4abb33a0-987a-4fa5-824b-e18244f0d127 on n-h2-708768-8 Jul 26 20:19:49.825002 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c48aada8-1969-428b-ad86-106b7a878d46 req-562990a7-27cd-4571-9bad-4e8050907fab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078683 Jul 26 20:19:49.832758 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3039/5984] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:19:49.966923 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0a6f1c1e-7e4f-465f-b954-b14121653fa3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 204 len: 0 microversion: 2.1 time: 0.258648 Jul 26 20:19:49.967532 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2946/5985] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:19:49 2022] DELETE /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:19:49.976532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f774a41-be70-4d2b-937b-e5f5092b5f46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:49.978280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4f774a41-be70-4d2b-937b-e5f5092b5f46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:49.998263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f774a41-be70-4d2b-937b-e5f5092b5f46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:49.998720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f774a41-be70-4d2b-937b-e5f5092b5f46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:49.999509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f774a41-be70-4d2b-937b-e5f5092b5f46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:49.999981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f774a41-be70-4d2b-937b-e5f5092b5f46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:50.309225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4f774a41-be70-4d2b-937b-e5f5092b5f46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:50.317418 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f774a41-be70-4d2b-937b-e5f5092b5f46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1690 microversion: 2.1 time: 0.345351 Jul 26 20:19:50.334587 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3040/5986] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:49 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1690 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:51.342413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5d4c9c77-6bbc-4d29-8f5b-1d84437fff3e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:51.344000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5d4c9c77-6bbc-4d29-8f5b-1d84437fff3e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:51.365511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d4c9c77-6bbc-4d29-8f5b-1d84437fff3e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:51.366213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d4c9c77-6bbc-4d29-8f5b-1d84437fff3e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:51.367813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d4c9c77-6bbc-4d29-8f5b-1d84437fff3e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:51.368406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5d4c9c77-6bbc-4d29-8f5b-1d84437fff3e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:51.801958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5d4c9c77-6bbc-4d29-8f5b-1d84437fff3e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:51.815664 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5d4c9c77-6bbc-4d29-8f5b-1d84437fff3e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1690 microversion: 2.1 time: 0.478843 Jul 26 20:19:51.824226 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2947/5987] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:51 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1690 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:52.015681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c775e71-5e4e-4b26-bfc7-c94d0cf82a83 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:52.016213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c775e71-5e4e-4b26-bfc7-c94d0cf82a83 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:52.045272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c775e71-5e4e-4b26-bfc7-c94d0cf82a83 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:52.046789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c775e71-5e4e-4b26-bfc7-c94d0cf82a83 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:52.051530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c775e71-5e4e-4b26-bfc7-c94d0cf82a83 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:52.053692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c775e71-5e4e-4b26-bfc7-c94d0cf82a83 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:52.121328 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c775e71-5e4e-4b26-bfc7-c94d0cf82a83 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/b435eec8-0542-4055-92e5-1d1b543ded00" status: 200 len: 194 microversion: 2.1 time: 0.109880 Jul 26 20:19:52.123010 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3041/5988] 10.222.0.58 () {58 vars in 1413 bytes} [Tue Jul 26 20:19:52 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/b435eec8-0542-4055-92e5-1d1b543ded00 => generated 194 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:52.134911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1add0eb1-7aa5-42b2-8b4c-417f1ea60015 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:52.135727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1add0eb1-7aa5-42b2-8b4c-417f1ea60015 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:52.150303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1add0eb1-7aa5-42b2-8b4c-417f1ea60015 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:52.151134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1add0eb1-7aa5-42b2-8b4c-417f1ea60015 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:52.152876 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1add0eb1-7aa5-42b2-8b4c-417f1ea60015 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:52.153485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1add0eb1-7aa5-42b2-8b4c-417f1ea60015 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:52.362354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-1add0eb1-7aa5-42b2-8b4c-417f1ea60015 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lazy-loading 'services' on Instance uuid 09b6679a-ff3f-4a52-ae8a-854040630a74 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:19:52.515974 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1add0eb1-7aa5-42b2-8b4c-417f1ea60015 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/b435eec8-0542-4055-92e5-1d1b543ded00" status: 202 len: 0 microversion: 2.1 time: 0.386722 Jul 26 20:19:52.520316 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2948/5989] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:19:52 2022] DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments/b435eec8-0542-4055-92e5-1d1b543ded00 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:19:52.658214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-89c488ea-7445-4069-89ab-7690dac513f8 req-a253d990-e570-4d64-87d3-ff8622ec870c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abb33a0-987a-4fa5-824b-e18244f0d127", "name": "network-vif-deleted", "tag": "8c8dd919-0f65-4029-a818-403cebfd673e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:52.669015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-89c488ea-7445-4069-89ab-7690dac513f8 req-a253d990-e570-4d64-87d3-ff8622ec870c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:52.669718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-89c488ea-7445-4069-89ab-7690dac513f8 req-a253d990-e570-4d64-87d3-ff8622ec870c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:52.682650 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-89c488ea-7445-4069-89ab-7690dac513f8 req-a253d990-e570-4d64-87d3-ff8622ec870c service nova] Creating event network-vif-deleted:8c8dd919-0f65-4029-a818-403cebfd673e for instance 4abb33a0-987a-4fa5-824b-e18244f0d127 on n-h2-708768-8 Jul 26 20:19:52.688509 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-89c488ea-7445-4069-89ab-7690dac513f8 req-a253d990-e570-4d64-87d3-ff8622ec870c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034131 Jul 26 20:19:52.690558 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3042/5990] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:52.840964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:52.841626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:52.849306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:52.849974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:52.850744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:52.851182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:52.885305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:52.885944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:52.886784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lazy-loading 'fault' on Instance uuid 4abb33a0-987a-4fa5-824b-e18244f0d127 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:19:52.947720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:19:52.964940 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-581abcac-aff1-48e4-a19f-67d0c3546ffe tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 200 len: 1356 microversion: 2.1 time: 0.128931 Jul 26 20:19:52.972128 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2949/5991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:52 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 1356 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:19:53.992806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:53.994046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4abb33a0-987a-4fa5-824b-e18244f0d127] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:54.008145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:54.008855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:54.014763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:54.015250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:54.038613 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] HTTP exception thrown: Instance 4abb33a0-987a-4fa5-824b-e18244f0d127 could not be found. Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Request method failure captured: Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 HTTP/1.1 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ev0ii1kBGUjwonVMhglrcrFlU3ywjFoPd0j4-8Ft4EZjC2YdZCk_P7SzH0uKeOzNjC55zbxY6dmJY6OfLxELdx2TCM7IDW_K3LF0CPkmaPQwEIV-GCQklx3o29ilUs5O3xJoo-sekz8seqkI-Y14MIT1Hi5pSkJ3GaJ0NLv_CA6DXk Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: c6c35edbc1a1413c90d22de414aa71e6 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6c35edbc1a1413c90d22de414aa71e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6c35edbc1a1413c90d22de414aa71e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6c35edbc1a1413c90d22de414aa71e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6c35edbc1a1413c90d22de414aa71e6"}]}] Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: c6c35edbc1a1413c90d22de414aa71e6 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestNetworkAdvancedServerOps-357288115-project Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 65245c71525848afaf82742412b31a8a Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestNetworkAdvancedServerOps-357288115-project Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 4abb33a0-987a-4fa5-824b-e18244f0d127 could not be found. Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '4abb33a0-987a-4fa5-824b-e18244f0d127'} Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abb33a0-987a-4fa5-824b-e18244f0d127 could not be found. Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abb33a0-987a-4fa5-824b-e18244f0d127 could not be found. Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:19:54.040952 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abb33a0-987a-4fa5-824b-e18244f0d127 could not be found. Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Returning 404 to user: Instance 4abb33a0-987a-4fa5-824b-e18244f0d127 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:19:54.045230 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-26479ab5-909c-4e05-8e23-bba26f111efa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127" status: 404 len: 111 microversion: 2.1 time: 0.056041 Jul 26 20:19:54.047773 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3043/5992] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:19:53 2022] GET /compute/v2.1/servers/4abb33a0-987a-4fa5-824b-e18244f0d127 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:19:59.118057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02edb287-bb4d-488a-95cc-271837f4ecf5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '.version_select at 0x7f875efc2ee0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:59.170272 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02edb287-bb4d-488a-95cc-271837f4ecf5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-178706905" status: 202 len: 0 microversion: 2.1 time: 0.062115 Jul 26 20:19:59.171670 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2950/5993] 10.222.0.58 () {58 vars in 1281 bytes} [Tue Jul 26 20:19:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-178706905 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:19:59.205161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d853fd5b-d6cf-495e-a1ed-0ae10004cdd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'create', calling method: .version_select at 0x7f87682d53a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-828840122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+QPOQyjJ1HPCqx2dZEDygW8GM14iGuYMNpnJM4kFm56Hu+WsUwDDvAsfSPk28+ENg3aZDE3pq93ORMfuzFSLOvMIPrZryvxirCjGb06CctA7ADbrAia6ZwoAwSxb4XTQ=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:19:59.216201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=26 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:19:59.248697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d853fd5b-d6cf-495e-a1ed-0ae10004cdd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:19:59.269697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d853fd5b-d6cf-495e-a1ed-0ae10004cdd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for user 65245c71525848afaf82742412b31a8a and project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:19:59.326761 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d853fd5b-d6cf-495e-a1ed-0ae10004cdd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.125453 Jul 26 20:19:59.327562 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3044/5994] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:19:59 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:19:59.361954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55de75e6-b488-4df8-b3f4-8d0cb619d06a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:59.364435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55de75e6-b488-4df8-b3f4-8d0cb619d06a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:59.374400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55de75e6-b488-4df8-b3f4-8d0cb619d06a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:59.375115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55de75e6-b488-4df8-b3f4-8d0cb619d06a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:59.376116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55de75e6-b488-4df8-b3f4-8d0cb619d06a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:59.376868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55de75e6-b488-4df8-b3f4-8d0cb619d06a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:59.442259 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55de75e6-b488-4df8-b3f4-8d0cb619d06a tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085149 Jul 26 20:19:59.442767 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2951/5995] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:19:59 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:19:59.681668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5322152-24e9-4887-afa9-846c425c7766 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:59.684856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5322152-24e9-4887-afa9-846c425c7766 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:59.702090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5322152-24e9-4887-afa9-846c425c7766 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:59.704020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5322152-24e9-4887-afa9-846c425c7766 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:59.705068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5322152-24e9-4887-afa9-846c425c7766 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:59.706037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5322152-24e9-4887-afa9-846c425c7766 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:59.756777 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5322152-24e9-4887-afa9-846c425c7766 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079794 Jul 26 20:19:59.757406 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3045/5996] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:19:59 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:19:59.872248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8bd7ccd4-f698-4b43-acfb-ea1c053c2b98 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:19:59.873434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8bd7ccd4-f698-4b43-acfb-ea1c053c2b98 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:19:59.886739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bd7ccd4-f698-4b43-acfb-ea1c053c2b98 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:59.887196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bd7ccd4-f698-4b43-acfb-ea1c053c2b98 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:59.888009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bd7ccd4-f698-4b43-acfb-ea1c053c2b98 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:19:59.892411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8bd7ccd4-f698-4b43-acfb-ea1c053c2b98 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:19:59.928077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8bd7ccd4-f698-4b43-acfb-ea1c053c2b98 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:20:00.066090 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8bd7ccd4-f698-4b43-acfb-ea1c053c2b98 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 204 len: 0 microversion: 2.1 time: 0.198277 Jul 26 20:20:00.066999 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2952/5997] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:19:59 2022] DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:20:00.076265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8553f1fe-2fcc-41b9-b272-5cce54b53618 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:00.077243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8553f1fe-2fcc-41b9-b272-5cce54b53618 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:00.089507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8553f1fe-2fcc-41b9-b272-5cce54b53618 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:00.090283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8553f1fe-2fcc-41b9-b272-5cce54b53618 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:00.091287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8553f1fe-2fcc-41b9-b272-5cce54b53618 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:00.091909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8553f1fe-2fcc-41b9-b272-5cce54b53618 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:00.439303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8553f1fe-2fcc-41b9-b272-5cce54b53618 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:00.452705 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8553f1fe-2fcc-41b9-b272-5cce54b53618 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1671 microversion: 2.1 time: 0.381008 Jul 26 20:20:00.453382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3046/5998] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:00 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1671 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:01.476505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b7053bb3-cc7f-41ee-8d91-0b0111d0dad7 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:01.478805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b7053bb3-cc7f-41ee-8d91-0b0111d0dad7 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:01.503219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7053bb3-cc7f-41ee-8d91-0b0111d0dad7 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:01.505605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7053bb3-cc7f-41ee-8d91-0b0111d0dad7 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:01.506753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7053bb3-cc7f-41ee-8d91-0b0111d0dad7 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:01.507211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7053bb3-cc7f-41ee-8d91-0b0111d0dad7 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:01.812325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b7053bb3-cc7f-41ee-8d91-0b0111d0dad7 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:01.837632 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b7053bb3-cc7f-41ee-8d91-0b0111d0dad7 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1671 microversion: 2.1 time: 0.366345 Jul 26 20:20:01.838322 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2953/5999] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:01 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1671 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:02.707233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6030a08b-d8ff-42d5-954d-1b5bc01244b9 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:02.708710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6030a08b-d8ff-42d5-954d-1b5bc01244b9 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:02.717898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6030a08b-d8ff-42d5-954d-1b5bc01244b9 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:02.718654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6030a08b-d8ff-42d5-954d-1b5bc01244b9 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:02.720050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6030a08b-d8ff-42d5-954d-1b5bc01244b9 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:02.721188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6030a08b-d8ff-42d5-954d-1b5bc01244b9 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:02.753404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6030a08b-d8ff-42d5-954d-1b5bc01244b9 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:20:02.862541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c2cedd85-c9d9-4a9c-86a5-3d4f327320a4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:02.863405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c2cedd85-c9d9-4a9c-86a5-3d4f327320a4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:02.872606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2cedd85-c9d9-4a9c-86a5-3d4f327320a4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:02.873160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2cedd85-c9d9-4a9c-86a5-3d4f327320a4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:02.874219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2cedd85-c9d9-4a9c-86a5-3d4f327320a4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:02.874727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c2cedd85-c9d9-4a9c-86a5-3d4f327320a4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:02.878077 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6030a08b-d8ff-42d5-954d-1b5bc01244b9 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 204 len: 0 microversion: 2.1 time: 0.456913 Jul 26 20:20:02.878941 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3047/6000] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:20:02 2022] DELETE /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:20:02.890584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-530550cf-2ef6-418f-b4a0-38f621189107 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:02.891316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-530550cf-2ef6-418f-b4a0-38f621189107 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:02.902147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-530550cf-2ef6-418f-b4a0-38f621189107 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:02.903268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-530550cf-2ef6-418f-b4a0-38f621189107 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:02.904094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-530550cf-2ef6-418f-b4a0-38f621189107 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:02.904921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-530550cf-2ef6-418f-b4a0-38f621189107 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:03.238367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-530550cf-2ef6-418f-b4a0-38f621189107 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:03.253414 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-530550cf-2ef6-418f-b4a0-38f621189107 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1731 microversion: 2.1 time: 0.369618 Jul 26 20:20:03.254744 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3048/6001] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:02 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1731 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:03.419481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c2cedd85-c9d9-4a9c-86a5-3d4f327320a4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:03.432727 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c2cedd85-c9d9-4a9c-86a5-3d4f327320a4 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1671 microversion: 2.1 time: 0.574841 Jul 26 20:20:03.447891 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2954/6002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:02 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1671 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:04.275254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c27a9b72-6d0d-412a-b5f0-b685d9f0b683 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:04.275975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c27a9b72-6d0d-412a-b5f0-b685d9f0b683 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:04.289285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c27a9b72-6d0d-412a-b5f0-b685d9f0b683 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:04.292146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c27a9b72-6d0d-412a-b5f0-b685d9f0b683 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:04.293262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c27a9b72-6d0d-412a-b5f0-b685d9f0b683 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:04.294564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c27a9b72-6d0d-412a-b5f0-b685d9f0b683 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:04.392620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-32a11041-cc6f-4992-99a4-0f4ca0a9e308 req-f22cae61-e0f3-4023-9b01-648263aff94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b6679a-ff3f-4a52-ae8a-854040630a74", "name": "network-vif-deleted", "tag": "dfc6c58c-ddd6-436b-9b2b-88e134ad0ff1"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:04.413306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-32a11041-cc6f-4992-99a4-0f4ca0a9e308 req-f22cae61-e0f3-4023-9b01-648263aff94b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:04.413737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-32a11041-cc6f-4992-99a4-0f4ca0a9e308 req-f22cae61-e0f3-4023-9b01-648263aff94b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:04.446813 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-32a11041-cc6f-4992-99a4-0f4ca0a9e308 req-f22cae61-e0f3-4023-9b01-648263aff94b service nova] Creating event network-vif-deleted:dfc6c58c-ddd6-436b-9b2b-88e134ad0ff1 for instance 09b6679a-ff3f-4a52-ae8a-854040630a74 on n-h2-708768-8 Jul 26 20:20:04.474580 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-32a11041-cc6f-4992-99a4-0f4ca0a9e308 req-f22cae61-e0f3-4023-9b01-648263aff94b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079476 Jul 26 20:20:04.476284 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2955/6003] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:20:04.482786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:04.489210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:04.511063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:04.511871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:04.512884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:04.513517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:04.582073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:04.582536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:04.582996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lazy-loading 'fault' on Instance uuid 09b6679a-ff3f-4a52-ae8a-854040630a74 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:20:04.638330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195a8048886e42148d7b51a0abc87ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58108d56ca7244f793546a489bef892d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:04.646331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:04.651313 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a503cf86-60c8-4b9f-9609-00bb38dbbe50 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 200 len: 1326 microversion: 2.1 time: 0.173127 Jul 26 20:20:04.652623 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2956/6004] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:04 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 1326 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:04.972753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c27a9b72-6d0d-412a-b5f0-b685d9f0b683 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:04.996098 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c27a9b72-6d0d-412a-b5f0-b685d9f0b683 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1731 microversion: 2.1 time: 0.725474 Jul 26 20:20:04.999250 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3049/6005] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:04 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1731 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:05.696885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:05.706919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:05.756823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:05.757762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:05.759528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:05.766606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:05.800799 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] HTTP exception thrown: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Request method failure captured: Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 HTTP/1.1 Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Es1vxbaJ2SDYHh_JTG_MEgX36GsXpzeRNewBXIUUIJWBq-FuTE6YrplrQjcmt5uT__blg2vf3PcQf59Uo24q8ToFAvjR9TfIjU_iZmaEupruTdeSIAJ83olbW0YcC8HSx4Nvkq96LUIi7xl9NjmFeyp2LiP1O6BkIVgxSP2EWCvc9w Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58108d56ca7244f793546a489bef892d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58108d56ca7244f793546a489bef892d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}] Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 195a8048886e42148d7b51a0abc87ac9 Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '09b6679a-ff3f-4a52-ae8a-854040630a74'} Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:05.803115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:05.807472 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:05.807472 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:05.807472 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:05.807472 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:05.807472 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:05.807472 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:05.807472 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:05.807472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Returning 404 to user: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:05.812078 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87f263c7-e7ff-4d73-a093-ed1578d58945 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 404 len: 111 microversion: 2.1 time: 0.132450 Jul 26 20:20:05.812078 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2957/6006] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:05 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:05.819175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3d9c23b7-6914-427a-bc35-cf41f5dab784 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '.version_select at 0x7f8756ec4940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:05.867258 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3d9c23b7-6914-427a-bc35-cf41f5dab784 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753764095" status: 202 len: 0 microversion: 2.1 time: 0.051819 Jul 26 20:20:05.869436 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3050/6007] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 20:20:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753764095 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:20:06.030607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8eddbecf-2d22-44da-b96a-1851c2bd09a7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:06.031258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8eddbecf-2d22-44da-b96a-1851c2bd09a7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:06.058973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8eddbecf-2d22-44da-b96a-1851c2bd09a7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:06.060730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8eddbecf-2d22-44da-b96a-1851c2bd09a7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:06.065016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8eddbecf-2d22-44da-b96a-1851c2bd09a7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:06.067311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8eddbecf-2d22-44da-b96a-1851c2bd09a7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:06.292658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8eddbecf-2d22-44da-b96a-1851c2bd09a7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:06.306104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8eddbecf-2d22-44da-b96a-1851c2bd09a7 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1664 microversion: 2.1 time: 0.288430 Jul 26 20:20:06.323203 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2958/6008] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:06 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1664 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:06.409954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1675316404", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c231bc12-c025-4ff3-8c8b-b1292a1182d9", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8dd04748-e18a-4968-8aa4-c87b9f3665a7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:06.617566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] validate_networks() for [('8dd04748-e18a-4968-8aa4-c87b9f3665a7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:20:07.016293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c33d6516-60ae-4f22-9ba0-0d111da93d2e req-09882b97-7788-4614-925b-296a869d2d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1bc551-920e-4468-bead-13d6a4c0e44f", "name": "network-vif-deleted", "tag": "399dd489-8b51-4146-af7c-61a26980789d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:07.056183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c33d6516-60ae-4f22-9ba0-0d111da93d2e req-09882b97-7788-4614-925b-296a869d2d91 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:07.057358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c33d6516-60ae-4f22-9ba0-0d111da93d2e req-09882b97-7788-4614-925b-296a869d2d91 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:07.093179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c33d6516-60ae-4f22-9ba0-0d111da93d2e req-09882b97-7788-4614-925b-296a869d2d91 service nova] Creating event network-vif-deleted:399dd489-8b51-4146-af7c-61a26980789d for instance 6b1bc551-920e-4468-bead-13d6a4c0e44f on n-h1-708768-8 Jul 26 20:20:07.105333 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c33d6516-60ae-4f22-9ba0-0d111da93d2e req-09882b97-7788-4614-925b-296a869d2d91 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089512 Jul 26 20:20:07.109624 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2959/6009] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:20:07.333988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:07.334708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:07.344944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:07.349998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:07.350845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:07.351293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:07.419737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:07.426069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:20:07.426596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:20:07.427214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:20:07.427332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:20:07.427936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:20:07.436540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:07.438947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lazy-loading 'fault' on Instance uuid 6b1bc551-920e-4468-bead-13d6a4c0e44f {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:20:07.453348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:07.456030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:07.457067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:07.458903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:07.500336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:20:07.510093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:20:07.532107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:20:07.539249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c231bc12-c025-4ff3-8c8b-b1292a1182d9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:20:07.552283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d711c192b734055ad408b7af039ceae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abeec2aac614325aed41cea10d85161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:07.564813 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d72fa30b-63fb-4a3b-94a4-188ca4b5b219 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 200 len: 1387 microversion: 2.1 time: 0.234279 Jul 26 20:20:07.566577 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2960/6010] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:07 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 1387 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:07.741989 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6850d3d2-67b4-4528-80e3-0e5130d43e4c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.336082 Jul 26 20:20:07.743195 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3051/6011] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:20:07.754616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5da52382-f924-4d42-9c1e-f28fa10055b9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:07.756171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5da52382-f924-4d42-9c1e-f28fa10055b9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:08.006644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5da52382-f924-4d42-9c1e-f28fa10055b9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:08.016349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5da52382-f924-4d42-9c1e-f28fa10055b9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1057 microversion: 2.1 time: 0.265500 Jul 26 20:20:08.023932 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2961/6012] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:07 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1057 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:08.594049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:08.594692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:08.610364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:08.611016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:08.611861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:08.612302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:08.636928 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] HTTP exception thrown: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Request method failure captured: Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f HTTP/1.1 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EsjhKQObh9r6CTMpCeqKo38L_F313aN2ePi-ON5JArKp4Lhlj4I_ABLaK-wur_Mu0nTnU-1qi9Oj69WcGrinI-3kFaybJP001pdLsZkfWTzWMp0ESdfYjxFAfe_eQCHtbi1Omv_7yu7OjxYDddQS58CskKtWIlD0Ezm1QQcTbbvKJ0 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 1abeec2aac614325aed41cea10d85161 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestServerBasicOps-263635328 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1abeec2aac614325aed41cea10d85161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1abeec2aac614325aed41cea10d85161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1abeec2aac614325aed41cea10d85161", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1abeec2aac614325aed41cea10d85161"}]}] Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestServerBasicOps-263635328 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 1abeec2aac614325aed41cea10d85161 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestServerBasicOps-263635328 Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestServerBasicOps-263635328-project Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5d711c192b734055ad408b7af039ceae Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestServerBasicOps-263635328-project Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '6b1bc551-920e-4468-bead-13d6a4c0e44f'} Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:08.644613 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Returning 404 to user: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:08.649902 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b47d4fa8-7c69-4469-87ea-0bddeb4e8c67 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 404 len: 111 microversion: 2.1 time: 0.058304 Jul 26 20:20:08.661799 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3052/6013] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:08 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:09.052953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c47ed739-0754-4601-b4c1-f7230c21446b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:09.053559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c47ed739-0754-4601-b4c1-f7230c21446b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:09.061642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c47ed739-0754-4601-b4c1-f7230c21446b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:09.062327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c47ed739-0754-4601-b4c1-f7230c21446b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:09.063256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c47ed739-0754-4601-b4c1-f7230c21446b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:09.070577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c47ed739-0754-4601-b4c1-f7230c21446b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:09.238302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c47ed739-0754-4601-b4c1-f7230c21446b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:09.248489 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c47ed739-0754-4601-b4c1-f7230c21446b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1109 microversion: 2.1 time: 0.203520 Jul 26 20:20:09.264250 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2962/6014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:09 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1109 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:09.611978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:09.612487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:09.636746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:09.637217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:09.638042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:09.638481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:09.747666 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] HTTP exception thrown: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Request method failure captured: Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f HTTP/1.1 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EsjhKQObh9r6CTMpCeqKo38L_F313aN2ePi-ON5JArKp4Lhlj4I_ABLaK-wur_Mu0nTnU-1qi9Oj69WcGrinI-3kFaybJP001pdLsZkfWTzWMp0ESdfYjxFAfe_eQCHtbi1Omv_7yu7OjxYDddQS58CskKtWIlD0Ezm1QQcTbbvKJ0 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 1abeec2aac614325aed41cea10d85161 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestServerBasicOps-263635328 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1abeec2aac614325aed41cea10d85161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1abeec2aac614325aed41cea10d85161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1abeec2aac614325aed41cea10d85161", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1abeec2aac614325aed41cea10d85161"}]}] Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestServerBasicOps-263635328 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 1abeec2aac614325aed41cea10d85161 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestServerBasicOps-263635328 Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestServerBasicOps-263635328-project Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 5d711c192b734055ad408b7af039ceae Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestServerBasicOps-263635328-project Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '6b1bc551-920e-4468-bead-13d6a4c0e44f'} Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:09.753975 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.757452 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.760158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Returning 404 to user: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:09.761083 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fccff993-b958-4b78-aed2-415e60f3c425 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 404 len: 111 microversion: 2.1 time: 0.153336 Jul 26 20:20:09.769882 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3053/6015] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:20:09 2022] DELETE /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:09.778268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:09.778894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] [instance: 6b1bc551-920e-4468-bead-13d6a4c0e44f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:09.802725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:09.803181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:09.804002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:09.804611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:09.855297 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] HTTP exception thrown: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Request method failure captured: Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f HTTP/1.1 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EsjhKQObh9r6CTMpCeqKo38L_F313aN2ePi-ON5JArKp4Lhlj4I_ABLaK-wur_Mu0nTnU-1qi9Oj69WcGrinI-3kFaybJP001pdLsZkfWTzWMp0ESdfYjxFAfe_eQCHtbi1Omv_7yu7OjxYDddQS58CskKtWIlD0Ezm1QQcTbbvKJ0 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 1abeec2aac614325aed41cea10d85161 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestServerBasicOps-263635328 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1abeec2aac614325aed41cea10d85161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1abeec2aac614325aed41cea10d85161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1abeec2aac614325aed41cea10d85161", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1abeec2aac614325aed41cea10d85161"}]}] Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestServerBasicOps-263635328 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 1abeec2aac614325aed41cea10d85161 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestServerBasicOps-263635328 Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestServerBasicOps-263635328-project Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 5d711c192b734055ad408b7af039ceae Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestServerBasicOps-263635328-project Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6b1bc551-920e-4468-bead-13d6a4c0e44f'} Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:09.856863 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.860707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:09.860707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:09.860707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:09.860707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:09.860707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:09.860707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. Jul 26 20:20:09.860707 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:09.862245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Returning 404 to user: Instance 6b1bc551-920e-4468-bead-13d6a4c0e44f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:09.863710 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5c156d91-508c-4c80-9c06-29bb57a2112a tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f" status: 404 len: 111 microversion: 2.1 time: 0.089505 Jul 26 20:20:09.864492 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2963/6016] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:09 2022] GET /compute/v2.1/servers/6b1bc551-920e-4468-bead-13d6a4c0e44f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:10.253436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-19b40a95-513d-4f32-b1bf-3b3c3d3bf744 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] Calling method '.version_select at 0x7f8756718af0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:10.274281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-904aeb7d-f9a8-424d-8426-befdd8c370e0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:10.275963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-904aeb7d-f9a8-424d-8426-befdd8c370e0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:10.288553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-904aeb7d-f9a8-424d-8426-befdd8c370e0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:10.293755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-904aeb7d-f9a8-424d-8426-befdd8c370e0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:10.296959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-904aeb7d-f9a8-424d-8426-befdd8c370e0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:10.296959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-904aeb7d-f9a8-424d-8426-befdd8c370e0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:10.337727 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-19b40a95-513d-4f32-b1bf-3b3c3d3bf744 tempest-TestServerBasicOps-263635328 tempest-TestServerBasicOps-263635328-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-12684620" status: 202 len: 0 microversion: 2.1 time: 0.088363 Jul 26 20:20:10.356467 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3054/6017] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:20:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-12684620 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:20:10.542312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-904aeb7d-f9a8-424d-8426-befdd8c370e0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:10.550199 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-904aeb7d-f9a8-424d-8426-befdd8c370e0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1127 microversion: 2.1 time: 0.279753 Jul 26 20:20:10.564032 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2964/6018] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:10 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1127 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:11.577614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10a1a0bc-9826-422d-9feb-bfedf28ffe4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:11.578283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-10a1a0bc-9826-422d-9feb-bfedf28ffe4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:11.598580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10a1a0bc-9826-422d-9feb-bfedf28ffe4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:11.601273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10a1a0bc-9826-422d-9feb-bfedf28ffe4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:11.602172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10a1a0bc-9826-422d-9feb-bfedf28ffe4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:11.602624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10a1a0bc-9826-422d-9feb-bfedf28ffe4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:12.018933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10a1a0bc-9826-422d-9feb-bfedf28ffe4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:12.028653 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-10a1a0bc-9826-422d-9feb-bfedf28ffe4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1127 microversion: 2.1 time: 0.456553 Jul 26 20:20:12.044811 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3055/6019] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:11 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1127 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:13.076624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-852aaa6f-6235-4d60-8523-1333cdcbf0d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:13.077255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-852aaa6f-6235-4d60-8523-1333cdcbf0d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:13.113654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-852aaa6f-6235-4d60-8523-1333cdcbf0d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:13.114114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-852aaa6f-6235-4d60-8523-1333cdcbf0d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:13.114913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-852aaa6f-6235-4d60-8523-1333cdcbf0d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:13.115358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-852aaa6f-6235-4d60-8523-1333cdcbf0d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:13.446563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-852aaa6f-6235-4d60-8523-1333cdcbf0d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:13.454615 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-852aaa6f-6235-4d60-8523-1333cdcbf0d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1127 microversion: 2.1 time: 0.399247 Jul 26 20:20:13.455212 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2965/6020] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:13 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1127 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:14.484769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77bb2aab-4377-4129-a1ca-668bb58b8211 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:14.487434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77bb2aab-4377-4129-a1ca-668bb58b8211 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:14.512518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77bb2aab-4377-4129-a1ca-668bb58b8211 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:14.512919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77bb2aab-4377-4129-a1ca-668bb58b8211 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:14.523209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77bb2aab-4377-4129-a1ca-668bb58b8211 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:14.523700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77bb2aab-4377-4129-a1ca-668bb58b8211 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:15.124114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77bb2aab-4377-4129-a1ca-668bb58b8211 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:15.132187 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77bb2aab-4377-4129-a1ca-668bb58b8211 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.652704 Jul 26 20:20:15.135912 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3056/6021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:14 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:16.162032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d4bbf24e-598a-4e6c-8c1c-5bf9793833db tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:16.163369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4bbf24e-598a-4e6c-8c1c-5bf9793833db tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:16.174899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:16.178059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4bbf24e-598a-4e6c-8c1c-5bf9793833db tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:16.181624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4bbf24e-598a-4e6c-8c1c-5bf9793833db tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:16.182644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4bbf24e-598a-4e6c-8c1c-5bf9793833db tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:16.185512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4bbf24e-598a-4e6c-8c1c-5bf9793833db tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:17.041702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4bbf24e-598a-4e6c-8c1c-5bf9793833db tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:17.063115 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d4bbf24e-598a-4e6c-8c1c-5bf9793833db tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.900098 Jul 26 20:20:17.068206 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2966/6022] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:16 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:17.975058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-753712574", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "21c788da-8897-490e-bd8d-c042dd767bea"}], "key_name": "tempest-TestNetworkAdvancedServerOps-828840122", "security_groups": [{"name": "tempest-secgroup-smoke-2134889466"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:18.000398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:18.001488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:18.084606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bff26155-7d7b-4fbf-9a80-277a91dd0c8a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:18.085733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bff26155-7d7b-4fbf-9a80-277a91dd0c8a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:18.096169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:18.105745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bff26155-7d7b-4fbf-9a80-277a91dd0c8a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:18.106458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bff26155-7d7b-4fbf-9a80-277a91dd0c8a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:18.107430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bff26155-7d7b-4fbf-9a80-277a91dd0c8a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:18.108112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bff26155-7d7b-4fbf-9a80-277a91dd0c8a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:18.611447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] validate_networks() for [('21c788da-8897-490e-bd8d-c042dd767bea', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:20:18.825461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bff26155-7d7b-4fbf-9a80-277a91dd0c8a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:18.839651 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bff26155-7d7b-4fbf-9a80-277a91dd0c8a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.759098 Jul 26 20:20:18.840816 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2967/6023] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:18 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:19.288204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f88718a2-364c-4d42-a9b9-08060ac3578c req-affe9d2e-9ae4-429c-a884-fcee9a87ff19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0152d9-e815-4488-9b6e-0a7301feb510", "tag": "c5988699-4d94-4c9e-ba43-244b4ba1c8bc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:19.332527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f88718a2-364c-4d42-a9b9-08060ac3578c req-affe9d2e-9ae4-429c-a884-fcee9a87ff19 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:19.333353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f88718a2-364c-4d42-a9b9-08060ac3578c req-affe9d2e-9ae4-429c-a884-fcee9a87ff19 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:19.393689 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f88718a2-364c-4d42-a9b9-08060ac3578c req-affe9d2e-9ae4-429c-a884-fcee9a87ff19 service nova] Creating event network-changed:c5988699-4d94-4c9e-ba43-244b4ba1c8bc for instance bb0152d9-e815-4488-9b6e-0a7301feb510 on n-h1-708768-8 Jul 26 20:20:19.411365 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f88718a2-364c-4d42-a9b9-08060ac3578c req-affe9d2e-9ae4-429c-a884-fcee9a87ff19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127117 Jul 26 20:20:19.412635 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2968/6024] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:20:19.865591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0a9538a7-4991-4e6c-8558-48c535781295 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:19.871298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0a9538a7-4991-4e6c-8558-48c535781295 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:19.882711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0a9538a7-4991-4e6c-8558-48c535781295 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:19.889513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0a9538a7-4991-4e6c-8558-48c535781295 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:19.890747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0a9538a7-4991-4e6c-8558-48c535781295 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:19.891396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0a9538a7-4991-4e6c-8558-48c535781295 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:20.671917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0a9538a7-4991-4e6c-8558-48c535781295 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:20.681830 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0a9538a7-4991-4e6c-8558-48c535781295 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.820165 Jul 26 20:20:20.687563 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2969/6025] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:19 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:21.051130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:20:21.051587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:20:21.052162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:20:21.052796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:20:21.053354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:20:21.075499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:21.088802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:21.090028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:21.092202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:21.122661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:21.161299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:20:21.184051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for user 65245c71525848afaf82742412b31a8a and project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:20:21.212738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:20:21.229432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:20:21.388073 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-83d9c2a2-fecd-47d4-b219-7e827f4c2f2b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.416750 Jul 26 20:20:21.389328 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3057/6026] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:20:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 3419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:20:21.402031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6de04ddb-f5f9-4393-b2b7-c7471693ccfb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:21.402954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6de04ddb-f5f9-4393-b2b7-c7471693ccfb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:21.717956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-39071624-8cec-407d-a8be-e8116c1cf5e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:21.718582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-39071624-8cec-407d-a8be-e8116c1cf5e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:21.737709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39071624-8cec-407d-a8be-e8116c1cf5e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:21.739238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39071624-8cec-407d-a8be-e8116c1cf5e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:21.743960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39071624-8cec-407d-a8be-e8116c1cf5e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:21.746629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-39071624-8cec-407d-a8be-e8116c1cf5e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:22.209657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6de04ddb-f5f9-4393-b2b7-c7471693ccfb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:22.211369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-39071624-8cec-407d-a8be-e8116c1cf5e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:22.231339 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-39071624-8cec-407d-a8be-e8116c1cf5e5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.517933 Jul 26 20:20:22.245182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3058/6027] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:21 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:22.252314 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6de04ddb-f5f9-4393-b2b7-c7471693ccfb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1265 microversion: 2.1 time: 0.855017 Jul 26 20:20:22.253329 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2970/6028] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:21 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1265 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:23.202664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:23.203187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:23.225148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:23.225749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:23.226483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:23.234488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:23.259784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d296e0ea-15d5-4866-8e1b-cb193f73c800 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:23.261298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d296e0ea-15d5-4866-8e1b-cb193f73c800 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:23.287943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d296e0ea-15d5-4866-8e1b-cb193f73c800 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:23.289012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d296e0ea-15d5-4866-8e1b-cb193f73c800 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:23.290149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d296e0ea-15d5-4866-8e1b-cb193f73c800 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:23.290603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d296e0ea-15d5-4866-8e1b-cb193f73c800 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:23.300518 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] HTTP exception thrown: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Request method failure captured: Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 HTTP/1.1 Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Es1vxbaJ2SDYHh_JTG_MEgX36GsXpzeRNewBXIUUIJWBq-FuTE6YrplrQjcmt5uT__blg2vf3PcQf59Uo24q8ToFAvjR9TfIjU_iZmaEupruTdeSIAJ83olbW0YcC8HSx4Nvkq96LUIi7xl9NjmFeyp2LiP1O6BkIVgxSP2EWCvc9w Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58108d56ca7244f793546a489bef892d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58108d56ca7244f793546a489bef892d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}] Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 195a8048886e42148d7b51a0abc87ac9 Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '09b6679a-ff3f-4a52-ae8a-854040630a74'} Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:23.305761 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.309172 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.310651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Returning 404 to user: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:23.316601 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ed8e0eb-4a86-45b3-b555-f3fc26213510 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 404 len: 111 microversion: 2.1 time: 0.118547 Jul 26 20:20:23.321525 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3059/6029] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:20:23 2022] DELETE /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:23.333574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8b8c6924-ee50-4101-9886-f1b6f43bae16 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:23.337242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8b8c6924-ee50-4101-9886-f1b6f43bae16 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:23.358140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b8c6924-ee50-4101-9886-f1b6f43bae16 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:23.370470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b8c6924-ee50-4101-9886-f1b6f43bae16 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:23.372802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b8c6924-ee50-4101-9886-f1b6f43bae16 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:23.373405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8b8c6924-ee50-4101-9886-f1b6f43bae16 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:23.514648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8b8c6924-ee50-4101-9886-f1b6f43bae16 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:23.547634 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8b8c6924-ee50-4101-9886-f1b6f43bae16 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1317 microversion: 2.1 time: 0.214579 Jul 26 20:20:23.549016 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3060/6030] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:23 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:23.557548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:23.558349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: 09b6679a-ff3f-4a52-ae8a-854040630a74] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:23.597879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:23.602230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:23.608169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:23.608801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:23.613596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d296e0ea-15d5-4866-8e1b-cb193f73c800 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:23.645128 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d296e0ea-15d5-4866-8e1b-cb193f73c800 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.390282 Jul 26 20:20:23.656104 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2971/6031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:23 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:23.684984 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] HTTP exception thrown: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Request method failure captured: Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 HTTP/1.1 Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Es1vxbaJ2SDYHh_JTG_MEgX36GsXpzeRNewBXIUUIJWBq-FuTE6YrplrQjcmt5uT__blg2vf3PcQf59Uo24q8ToFAvjR9TfIjU_iZmaEupruTdeSIAJ83olbW0YcC8HSx4Nvkq96LUIi7xl9NjmFeyp2LiP1O6BkIVgxSP2EWCvc9w Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58108d56ca7244f793546a489bef892d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58108d56ca7244f793546a489bef892d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}] Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 195a8048886e42148d7b51a0abc87ac9 Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '09b6679a-ff3f-4a52-ae8a-854040630a74'} Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:23.689184 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.694202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:23.694202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:23.694202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:23.694202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:23.694202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:23.694202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. Jul 26 20:20:23.694202 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:23.698855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Returning 404 to user: Instance 09b6679a-ff3f-4a52-ae8a-854040630a74 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:23.706131 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77b93521-a73e-43b3-bb50-b612c460759f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74" status: 404 len: 111 microversion: 2.1 time: 0.147055 Jul 26 20:20:23.707126 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3061/6032] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:23 2022] GET /compute/v2.1/servers/09b6679a-ff3f-4a52-ae8a-854040630a74 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:24.574992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-07b4cfd5-03ca-4745-b282-d39a11969edd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:24.576385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-07b4cfd5-03ca-4745-b282-d39a11969edd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:24.603017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07b4cfd5-03ca-4745-b282-d39a11969edd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:24.605699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07b4cfd5-03ca-4745-b282-d39a11969edd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:24.608772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07b4cfd5-03ca-4745-b282-d39a11969edd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:24.610849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07b4cfd5-03ca-4745-b282-d39a11969edd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:24.682846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-76d99bc0-a3e7-45d3-b516-d182d43fa199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:24.684585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-76d99bc0-a3e7-45d3-b516-d182d43fa199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:24.722314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76d99bc0-a3e7-45d3-b516-d182d43fa199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:24.730062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76d99bc0-a3e7-45d3-b516-d182d43fa199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:24.732993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76d99bc0-a3e7-45d3-b516-d182d43fa199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:24.739280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76d99bc0-a3e7-45d3-b516-d182d43fa199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:24.978679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-07b4cfd5-03ca-4745-b282-d39a11969edd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:24.999249 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-07b4cfd5-03ca-4745-b282-d39a11969edd tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1323 microversion: 2.1 time: 0.425339 Jul 26 20:20:25.020079 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2972/6033] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:24 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:25.020289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-76d99bc0-a3e7-45d3-b516-d182d43fa199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:25.031696 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-76d99bc0-a3e7-45d3-b516-d182d43fa199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.355412 Jul 26 20:20:25.045662 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3062/6034] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:24 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:26.037589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-846c5f6c-1ca1-41dd-9ce1-55faa5b1d591 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:26.038213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-846c5f6c-1ca1-41dd-9ce1-55faa5b1d591 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:26.054406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-482e8a76-aae1-45f4-82b1-c93fde5cd254 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:26.055865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-482e8a76-aae1-45f4-82b1-c93fde5cd254 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:26.062212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-846c5f6c-1ca1-41dd-9ce1-55faa5b1d591 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:26.065246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-846c5f6c-1ca1-41dd-9ce1-55faa5b1d591 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:26.068011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-846c5f6c-1ca1-41dd-9ce1-55faa5b1d591 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:26.068639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-846c5f6c-1ca1-41dd-9ce1-55faa5b1d591 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:26.069056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-482e8a76-aae1-45f4-82b1-c93fde5cd254 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:26.071795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-482e8a76-aae1-45f4-82b1-c93fde5cd254 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:26.074184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-482e8a76-aae1-45f4-82b1-c93fde5cd254 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:26.074722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-482e8a76-aae1-45f4-82b1-c93fde5cd254 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:26.482421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-846c5f6c-1ca1-41dd-9ce1-55faa5b1d591 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:26.482673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-482e8a76-aae1-45f4-82b1-c93fde5cd254 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:26.496651 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-482e8a76-aae1-45f4-82b1-c93fde5cd254 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.446900 Jul 26 20:20:26.511260 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3063/6035] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:26 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:26.511590 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-846c5f6c-1ca1-41dd-9ce1-55faa5b1d591 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1391 microversion: 2.1 time: 0.469572 Jul 26 20:20:26.520300 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2973/6036] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:26 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:27.518301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4755fc67-470a-4141-9f1e-fac3c7a05afd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:27.519074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4755fc67-470a-4141-9f1e-fac3c7a05afd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:27.527248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-499dc708-93b8-4c0e-84f0-cfcfe42751db tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:27.528152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-499dc708-93b8-4c0e-84f0-cfcfe42751db tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:27.540926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4755fc67-470a-4141-9f1e-fac3c7a05afd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:27.548374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4755fc67-470a-4141-9f1e-fac3c7a05afd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:27.550379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4755fc67-470a-4141-9f1e-fac3c7a05afd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:27.558976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4755fc67-470a-4141-9f1e-fac3c7a05afd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:27.580893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-499dc708-93b8-4c0e-84f0-cfcfe42751db tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:27.588172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-499dc708-93b8-4c0e-84f0-cfcfe42751db tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:27.591498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-499dc708-93b8-4c0e-84f0-cfcfe42751db tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:27.594077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-499dc708-93b8-4c0e-84f0-cfcfe42751db tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:28.317812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-499dc708-93b8-4c0e-84f0-cfcfe42751db tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:28.327066 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-499dc708-93b8-4c0e-84f0-cfcfe42751db tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1391 microversion: 2.1 time: 0.804492 Jul 26 20:20:28.333179 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2974/6037] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:27 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1391 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:28.971117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-14417983-1e47-440c-a37c-a8c04f73e25e req-afeb6872-0d27-495f-aca5-fa8b416f2fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:28.994450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-14417983-1e47-440c-a37c-a8c04f73e25e req-afeb6872-0d27-495f-aca5-fa8b416f2fe4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:28.996497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-14417983-1e47-440c-a37c-a8c04f73e25e req-afeb6872-0d27-495f-aca5-fa8b416f2fe4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:29.017351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-14417983-1e47-440c-a37c-a8c04f73e25e req-afeb6872-0d27-495f-aca5-fa8b416f2fe4 service nova] Creating event network-changed:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h2-708768-8 Jul 26 20:20:29.026621 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-14417983-1e47-440c-a37c-a8c04f73e25e req-afeb6872-0d27-495f-aca5-fa8b416f2fe4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059266 Jul 26 20:20:29.027835 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2975/6038] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:20:29.351417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a69256d8-d0bb-4eaa-86a4-0397902d6eb4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:29.353510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a69256d8-d0bb-4eaa-86a4-0397902d6eb4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:29.370271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a69256d8-d0bb-4eaa-86a4-0397902d6eb4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:29.376643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a69256d8-d0bb-4eaa-86a4-0397902d6eb4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:29.382430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a69256d8-d0bb-4eaa-86a4-0397902d6eb4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:29.383032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a69256d8-d0bb-4eaa-86a4-0397902d6eb4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:29.410409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4755fc67-470a-4141-9f1e-fac3c7a05afd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:29.427654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4755fc67-470a-4141-9f1e-fac3c7a05afd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 1.911238 Jul 26 20:20:29.435996 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3064/6039] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:27 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:29.772779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:29.773280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:29.780096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:29.796622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:29.798060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:29.799185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:29.801117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a69256d8-d0bb-4eaa-86a4-0397902d6eb4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:29.801955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:29.813031 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a69256d8-d0bb-4eaa-86a4-0397902d6eb4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1391 microversion: 2.1 time: 0.466274 Jul 26 20:20:29.816669 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2976/6040] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:29 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1391 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:29.840846 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] HTTP exception thrown: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Request method failure captured: Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 HTTP/1.1 Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Es1vxbaJ2SDYHh_JTG_MEgX36GsXpzeRNewBXIUUIJWBq-FuTE6YrplrQjcmt5uT__blg2vf3PcQf59Uo24q8ToFAvjR9TfIjU_iZmaEupruTdeSIAJ83olbW0YcC8HSx4Nvkq96LUIi7xl9NjmFeyp2LiP1O6BkIVgxSP2EWCvc9w Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58108d56ca7244f793546a489bef892d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58108d56ca7244f793546a489bef892d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}] Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 195a8048886e42148d7b51a0abc87ac9 Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'd744cf68-c058-4eb6-8e8a-4e97b7a16f09'} Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:29.842478 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Returning 404 to user: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:29.847514 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d8eb4135-0710-4222-bb99-3ea3d635974f tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 404 len: 111 microversion: 2.1 time: 0.075093 Jul 26 20:20:29.852439 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3065/6041] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:20:29 2022] DELETE /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:20:29.857255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:29.857860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] [instance: d744cf68-c058-4eb6-8e8a-4e97b7a16f09] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:29.870074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:29.870530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:29.871316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:29.871902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:29.913376 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] HTTP exception thrown: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Request method failure captured: Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 HTTP/1.1 Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Es1vxbaJ2SDYHh_JTG_MEgX36GsXpzeRNewBXIUUIJWBq-FuTE6YrplrQjcmt5uT__blg2vf3PcQf59Uo24q8ToFAvjR9TfIjU_iZmaEupruTdeSIAJ83olbW0YcC8HSx4Nvkq96LUIi7xl9NjmFeyp2LiP1O6BkIVgxSP2EWCvc9w Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58108d56ca7244f793546a489bef892d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58108d56ca7244f793546a489bef892d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58108d56ca7244f793546a489bef892d"}]}] Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 58108d56ca7244f793546a489bef892d Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1912317299 Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 195a8048886e42148d7b51a0abc87ac9 Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-AttachVolumeTestJSON-1912317299-project Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'd744cf68-c058-4eb6-8e8a-4e97b7a16f09'} Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:29.915733 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.920129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:29.920129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:29.920129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:29.920129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:29.920129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:29.920129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. Jul 26 20:20:29.920129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:29.933773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] Returning 404 to user: Instance d744cf68-c058-4eb6-8e8a-4e97b7a16f09 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:29.934910 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6d239950-35b7-4e7a-b5ea-1c32fe3a9d02 tempest-AttachVolumeTestJSON-1912317299 tempest-AttachVolumeTestJSON-1912317299-project] 10.222.0.58 "GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09" status: 404 len: 111 microversion: 2.1 time: 0.081374 Jul 26 20:20:29.935456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2977/6042] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:29 2022] GET /compute/v2.1/servers/d744cf68-c058-4eb6-8e8a-4e97b7a16f09 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:30.451198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d3b09604-1059-41b2-be3a-b25c9615cd34 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:30.452415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d3b09604-1059-41b2-be3a-b25c9615cd34 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:30.464499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3b09604-1059-41b2-be3a-b25c9615cd34 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:30.465223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3b09604-1059-41b2-be3a-b25c9615cd34 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:30.469165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3b09604-1059-41b2-be3a-b25c9615cd34 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:30.469803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3b09604-1059-41b2-be3a-b25c9615cd34 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:30.842940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b43e6003-b780-4389-bffc-02bbf8149a30 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:30.843549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b43e6003-b780-4389-bffc-02bbf8149a30 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:30.858993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b43e6003-b780-4389-bffc-02bbf8149a30 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:30.859442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b43e6003-b780-4389-bffc-02bbf8149a30 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:30.860840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b43e6003-b780-4389-bffc-02bbf8149a30 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:30.861280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b43e6003-b780-4389-bffc-02bbf8149a30 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:31.022485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3b09604-1059-41b2-be3a-b25c9615cd34 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:31.034130 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d3b09604-1059-41b2-be3a-b25c9615cd34 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.588618 Jul 26 20:20:31.042322 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3066/6043] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:30 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:31.556297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b43e6003-b780-4389-bffc-02bbf8149a30 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:31.569455 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b43e6003-b780-4389-bffc-02bbf8149a30 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1391 microversion: 2.1 time: 0.730205 Jul 26 20:20:31.583642 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2978/6044] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:30 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1391 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:32.066633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e652fae8-d5bc-4476-876d-5e7c5e290e2f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:32.067328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e652fae8-d5bc-4476-876d-5e7c5e290e2f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:32.070171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:32.071967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:32.103357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e652fae8-d5bc-4476-876d-5e7c5e290e2f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:32.104795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e652fae8-d5bc-4476-876d-5e7c5e290e2f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:32.107887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e652fae8-d5bc-4476-876d-5e7c5e290e2f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:32.107887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e652fae8-d5bc-4476-876d-5e7c5e290e2f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:32.605368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bfd47004-d3e8-479e-ac05-4de5d30793b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:32.607804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bfd47004-d3e8-479e-ac05-4de5d30793b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:32.624022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:32.628669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfd47004-d3e8-479e-ac05-4de5d30793b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:32.634839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfd47004-d3e8-479e-ac05-4de5d30793b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:32.638735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfd47004-d3e8-479e-ac05-4de5d30793b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:32.639399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bfd47004-d3e8-479e-ac05-4de5d30793b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:32.701356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:32.737968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e652fae8-d5bc-4476-876d-5e7c5e290e2f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:32.751403 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e652fae8-d5bc-4476-876d-5e7c5e290e2f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.689928 Jul 26 20:20:32.752592 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3067/6045] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:32 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:33.342442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bfd47004-d3e8-479e-ac05-4de5d30793b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:33.354963 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bfd47004-d3e8-479e-ac05-4de5d30793b4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1391 microversion: 2.1 time: 0.757499 Jul 26 20:20:33.370685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2979/6046] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:32 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1391 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:33.788761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a69319f-54a9-4d6f-ac5f-a89f576688df tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:33.790329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a69319f-54a9-4d6f-ac5f-a89f576688df tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:33.806143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a69319f-54a9-4d6f-ac5f-a89f576688df tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:33.806970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a69319f-54a9-4d6f-ac5f-a89f576688df tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:33.810703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a69319f-54a9-4d6f-ac5f-a89f576688df tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:33.811394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a69319f-54a9-4d6f-ac5f-a89f576688df tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:34.085147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4a69319f-54a9-4d6f-ac5f-a89f576688df tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:34.092434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a69319f-54a9-4d6f-ac5f-a89f576688df tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1169 microversion: 2.1 time: 0.312359 Jul 26 20:20:34.114058 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3068/6047] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:33 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1169 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:34.378640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc42a524-1e6f-4c53-9c59-d5f66e066499 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:34.380565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc42a524-1e6f-4c53-9c59-d5f66e066499 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:34.394078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc42a524-1e6f-4c53-9c59-d5f66e066499 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:34.398382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc42a524-1e6f-4c53-9c59-d5f66e066499 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:34.408893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc42a524-1e6f-4c53-9c59-d5f66e066499 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:34.409378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc42a524-1e6f-4c53-9c59-d5f66e066499 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:34.770217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc42a524-1e6f-4c53-9c59-d5f66e066499 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:34.779506 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc42a524-1e6f-4c53-9c59-d5f66e066499 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1391 microversion: 2.1 time: 0.404918 Jul 26 20:20:34.780720 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2980/6048] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:34 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1391 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:35.114785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49285c1b-27d5-44dc-b9a5-f352cd50e747 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:35.115629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-49285c1b-27d5-44dc-b9a5-f352cd50e747 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:35.123580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49285c1b-27d5-44dc-b9a5-f352cd50e747 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:35.124189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49285c1b-27d5-44dc-b9a5-f352cd50e747 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:35.125076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49285c1b-27d5-44dc-b9a5-f352cd50e747 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:35.125739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49285c1b-27d5-44dc-b9a5-f352cd50e747 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:35.452348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-49285c1b-27d5-44dc-b9a5-f352cd50e747 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:35.460297 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-49285c1b-27d5-44dc-b9a5-f352cd50e747 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1203 microversion: 2.1 time: 0.349501 Jul 26 20:20:35.460638 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3069/6049] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:35 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1203 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:35.806046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-771dbae2-b1e7-41c4-bec2-d755fc05f189 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:35.806624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-771dbae2-b1e7-41c4-bec2-d755fc05f189 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:35.814286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-771dbae2-b1e7-41c4-bec2-d755fc05f189 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:35.815113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-771dbae2-b1e7-41c4-bec2-d755fc05f189 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:35.816029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-771dbae2-b1e7-41c4-bec2-d755fc05f189 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:35.816593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-771dbae2-b1e7-41c4-bec2-d755fc05f189 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:36.044808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-771dbae2-b1e7-41c4-bec2-d755fc05f189 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:36.052891 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-771dbae2-b1e7-41c4-bec2-d755fc05f189 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1391 microversion: 2.1 time: 0.251385 Jul 26 20:20:36.053989 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2981/6050] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:35 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:36.145179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d7d4b4b5-e8cb-43dd-b0cf-e1e494a55445 req-0e451ac7-2b0c-421f-87ae-75060b098a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "name": "network-vif-plugged", "status": "completed", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:36.156782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d7d4b4b5-e8cb-43dd-b0cf-e1e494a55445 req-0e451ac7-2b0c-421f-87ae-75060b098a25 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:36.157351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d7d4b4b5-e8cb-43dd-b0cf-e1e494a55445 req-0e451ac7-2b0c-421f-87ae-75060b098a25 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:36.170311 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d7d4b4b5-e8cb-43dd-b0cf-e1e494a55445 req-0e451ac7-2b0c-421f-87ae-75060b098a25 service nova] Creating event network-vif-plugged:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h2-708768-8 Jul 26 20:20:36.176462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d7d4b4b5-e8cb-43dd-b0cf-e1e494a55445 req-0e451ac7-2b0c-421f-87ae-75060b098a25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300961 Jul 26 20:20:36.177692 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3070/6051] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:36.482241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-20349787-04b1-475c-860a-c8e9fcf80c7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:36.482858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-20349787-04b1-475c-860a-c8e9fcf80c7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:36.491651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20349787-04b1-475c-860a-c8e9fcf80c7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:36.492530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20349787-04b1-475c-860a-c8e9fcf80c7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:36.494003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20349787-04b1-475c-860a-c8e9fcf80c7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:36.494620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20349787-04b1-475c-860a-c8e9fcf80c7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:36.762382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-20349787-04b1-475c-860a-c8e9fcf80c7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:36.770561 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-20349787-04b1-475c-860a-c8e9fcf80c7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1203 microversion: 2.1 time: 0.292243 Jul 26 20:20:36.771823 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2982/6052] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:36 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1203 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:37.077641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ec48113-ab5e-4e69-bc48-bc2e4e614ae6 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:37.079351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5ec48113-ab5e-4e69-bc48-bc2e4e614ae6 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:37.086902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ec48113-ab5e-4e69-bc48-bc2e4e614ae6 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:37.087603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ec48113-ab5e-4e69-bc48-bc2e4e614ae6 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:37.088723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ec48113-ab5e-4e69-bc48-bc2e4e614ae6 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:37.089459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ec48113-ab5e-4e69-bc48-bc2e4e614ae6 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:37.165305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c4c53d91-0d5e-4cc4-a97f-e150d9c0c65c tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Action: 'create', calling method: .version_select at 0x7f8756ddc430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1001187878"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:37.321415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ec48113-ab5e-4e69-bc48-bc2e4e614ae6 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:37.332448 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ec48113-ab5e-4e69-bc48-bc2e4e614ae6 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1391 microversion: 2.1 time: 0.259414 Jul 26 20:20:37.332952 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2983/6053] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:37 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:37.544821 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c4c53d91-0d5e-4cc4-a97f-e150d9c0c65c tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.510926 Jul 26 20:20:37.545822 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3071/6054] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Jul 26 20:20:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 513 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 20:20:37.558563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7028e790-ab0a-4dd9-915d-e0f66ed48042 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f875f123d30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:37.610189 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7028e790-ab0a-4dd9-915d-e0f66ed48042 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc" status: 200 len: 345 microversion: 2.1 time: 0.056248 Jul 26 20:20:37.610775 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2984/6055] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 20:20:37 2022] GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:20:37.796078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c37feb4-bbb5-4c06-864f-eb95775a5a64 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:37.796921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c37feb4-bbb5-4c06-864f-eb95775a5a64 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:37.809074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c37feb4-bbb5-4c06-864f-eb95775a5a64 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:37.809620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c37feb4-bbb5-4c06-864f-eb95775a5a64 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:37.810486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c37feb4-bbb5-4c06-864f-eb95775a5a64 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:37.813211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c37feb4-bbb5-4c06-864f-eb95775a5a64 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:38.040589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c37feb4-bbb5-4c06-864f-eb95775a5a64 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:38.049978 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c37feb4-bbb5-4c06-864f-eb95775a5a64 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1203 microversion: 2.1 time: 0.258032 Jul 26 20:20:38.050569 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3072/6056] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:37 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1203 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:38.363477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80fb6022-0a91-444e-ac01-c04cf72deb10 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:38.364215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80fb6022-0a91-444e-ac01-c04cf72deb10 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:38.385864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80fb6022-0a91-444e-ac01-c04cf72deb10 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:38.386231 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80fb6022-0a91-444e-ac01-c04cf72deb10 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:38.387023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80fb6022-0a91-444e-ac01-c04cf72deb10 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:38.387460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80fb6022-0a91-444e-ac01-c04cf72deb10 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:38.595589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-80fb6022-0a91-444e-ac01-c04cf72deb10 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:38.605110 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80fb6022-0a91-444e-ac01-c04cf72deb10 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1563 microversion: 2.1 time: 0.256313 Jul 26 20:20:38.607332 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2985/6057] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:38 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1563 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:38.630327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c99740bd-1164-4a3d-a187-6f33dccfd752 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f875652a430>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:38.636369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dbfacec3-f1b2-4df8-8cad-6c1bf3e060df tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:38.637620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dbfacec3-f1b2-4df8-8cad-6c1bf3e060df tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:38.646481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbfacec3-f1b2-4df8-8cad-6c1bf3e060df tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:38.646926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbfacec3-f1b2-4df8-8cad-6c1bf3e060df tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:38.647733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbfacec3-f1b2-4df8-8cad-6c1bf3e060df tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:38.648170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbfacec3-f1b2-4df8-8cad-6c1bf3e060df tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:38.697751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c99740bd-1164-4a3d-a187-6f33dccfd752 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc" status: 200 len: 346 microversion: 2.1 time: 0.077230 Jul 26 20:20:38.698374 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3073/6058] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 20:20:38 2022] GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:38.713874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-83ffc0b6-521b-41f5-887a-f0ff56b05228 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Action: 'create', calling method: .version_select at 0x7f8756ddc0d0>, body: {"snapshot": {"volume_id": "6e4b9896-edea-4802-95b7-169e12717efc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1152680258"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:38.815249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dbfacec3-f1b2-4df8-8cad-6c1bf3e060df tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:38.832795 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dbfacec3-f1b2-4df8-8cad-6c1bf3e060df tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1563 microversion: 2.1 time: 0.205314 Jul 26 20:20:38.834007 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2986/6059] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:38 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:38.970466 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-83ffc0b6-521b-41f5-887a-f0ff56b05228 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.262753 Jul 26 20:20:38.982286 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3074/6060] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Jul 26 20:20:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:20:38.983387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11af10ee-c635-4445-9581-84bf0b746147 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f87681cc160>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:39.030953 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11af10ee-c635-4445-9581-84bf0b746147 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7" status: 200 len: 287 microversion: 2.1 time: 0.051546 Jul 26 20:20:39.030953 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2987/6061] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 20:20:38 2022] GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:39.043204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e562db8a-1d44-46c4-bdfb-cb81683bfdb9 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f8757137700>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:39.072298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8165333-c851-40dd-a687-d94cc38f8349 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:39.073032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8165333-c851-40dd-a687-d94cc38f8349 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:39.081673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8165333-c851-40dd-a687-d94cc38f8349 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:39.082288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8165333-c851-40dd-a687-d94cc38f8349 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:39.083435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8165333-c851-40dd-a687-d94cc38f8349 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:39.084280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8165333-c851-40dd-a687-d94cc38f8349 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:39.088732 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e562db8a-1d44-46c4-bdfb-cb81683bfdb9 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050723 Jul 26 20:20:39.089321 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3075/6062] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Jul 26 20:20:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:39.103149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-97ac1411-785a-4535-ba7f-63c1912424a1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f875710c1f0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:39.147194 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-97ac1411-785a-4535-ba7f-63c1912424a1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7" status: 200 len: 287 microversion: 2.1 time: 0.050916 Jul 26 20:20:39.148106 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3076/6063] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 20:20:39 2022] GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:20:39.330053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b8165333-c851-40dd-a687-d94cc38f8349 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:39.355555 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8165333-c851-40dd-a687-d94cc38f8349 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1203 microversion: 2.1 time: 0.287585 Jul 26 20:20:39.359914 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2988/6064] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:39 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1203 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:40.160943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe15c103-8c12-49ed-89e2-2e90d299f7f9 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f8757129ee0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:40.212977 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe15c103-8c12-49ed-89e2-2e90d299f7f9 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7" status: 200 len: 287 microversion: 2.1 time: 0.056592 Jul 26 20:20:40.214345 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3077/6065] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 20:20:40 2022] GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:40.382116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ba9bca7b-ffaa-4554-8fe4-1a7b1a6cc283 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:40.383706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ba9bca7b-ffaa-4554-8fe4-1a7b1a6cc283 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:40.396803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba9bca7b-ffaa-4554-8fe4-1a7b1a6cc283 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:40.402509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba9bca7b-ffaa-4554-8fe4-1a7b1a6cc283 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:40.406461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba9bca7b-ffaa-4554-8fe4-1a7b1a6cc283 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:40.407095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba9bca7b-ffaa-4554-8fe4-1a7b1a6cc283 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:40.816617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ba9bca7b-ffaa-4554-8fe4-1a7b1a6cc283 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:40.832826 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ba9bca7b-ffaa-4554-8fe4-1a7b1a6cc283 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1203 microversion: 2.1 time: 0.456317 Jul 26 20:20:40.835268 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2989/6066] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:40 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1203 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:41.225593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f570ea1a-d9a9-481e-9a29-3007826ae7d0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:41.226060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-461e5b8c-dabe-4b3a-9fe9-a8b32e944987 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f875eef1b80>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:41.226237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f570ea1a-d9a9-481e-9a29-3007826ae7d0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:41.233317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f570ea1a-d9a9-481e-9a29-3007826ae7d0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:41.233968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f570ea1a-d9a9-481e-9a29-3007826ae7d0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:41.234921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f570ea1a-d9a9-481e-9a29-3007826ae7d0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:41.235536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f570ea1a-d9a9-481e-9a29-3007826ae7d0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:41.261864 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-461e5b8c-dabe-4b3a-9fe9-a8b32e944987 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7" status: 200 len: 288 microversion: 2.1 time: 0.040397 Jul 26 20:20:41.262551 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2990/6067] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 20:20:41 2022] GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:41.268353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-40ac702f-2f8f-41ac-bf31-053e99ae8975 req-775e78af-e5ee-486f-b235-5368fae7bbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:41.280356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-40ac702f-2f8f-41ac-bf31-053e99ae8975 req-775e78af-e5ee-486f-b235-5368fae7bbd5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:41.281026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-40ac702f-2f8f-41ac-bf31-053e99ae8975 req-775e78af-e5ee-486f-b235-5368fae7bbd5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:41.298607 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-40ac702f-2f8f-41ac-bf31-053e99ae8975 req-775e78af-e5ee-486f-b235-5368fae7bbd5 service nova] Creating event network-changed:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h2-708768-8 Jul 26 20:20:41.304731 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-40ac702f-2f8f-41ac-bf31-053e99ae8975 req-775e78af-e5ee-486f-b235-5368fae7bbd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040737 Jul 26 20:20:41.306361 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2991/6068] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:41.329823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37af560b-b639-4572-ab58-3ddfee70c6e1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f87683b2310>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:41.399310 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37af560b-b639-4572-ab58-3ddfee70c6e1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7" status: 202 len: 0 microversion: 2.1 time: 0.091227 Jul 26 20:20:41.403166 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2992/6069] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Jul 26 20:20:41 2022] DELETE /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:20:41.410991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-13d78010-ba87-4c63-8ed0-b18e68734b1a tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f87681ccd30>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:41.467129 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-13d78010-ba87-4c63-8ed0-b18e68734b1a tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7" status: 200 len: 287 microversion: 2.1 time: 0.061105 Jul 26 20:20:41.467813 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2993/6070] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 20:20:41 2022] GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:41.570421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f570ea1a-d9a9-481e-9a29-3007826ae7d0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:41.583589 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f570ea1a-d9a9-481e-9a29-3007826ae7d0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1563 microversion: 2.1 time: 0.362621 Jul 26 20:20:41.584630 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3078/6071] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:41 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1563 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:41.857190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e103591d-ba7b-4a9a-912a-51658c2c2b10 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:41.858461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e103591d-ba7b-4a9a-912a-51658c2c2b10 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:41.866425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e103591d-ba7b-4a9a-912a-51658c2c2b10 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:41.868309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e103591d-ba7b-4a9a-912a-51658c2c2b10 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:41.869352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e103591d-ba7b-4a9a-912a-51658c2c2b10 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:41.870012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e103591d-ba7b-4a9a-912a-51658c2c2b10 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:42.104318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e103591d-ba7b-4a9a-912a-51658c2c2b10 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:42.125518 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e103591d-ba7b-4a9a-912a-51658c2c2b10 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1203 microversion: 2.1 time: 0.272192 Jul 26 20:20:42.127399 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2994/6072] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:41 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:42.482341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a25ca98e-3ee7-4e0e-8332-73973d9b2936 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f8756f45a60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:42.545080 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a25ca98e-3ee7-4e0e-8332-73973d9b2936 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7" status: 200 len: 287 microversion: 2.1 time: 0.069143 Jul 26 20:20:42.546050 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3079/6073] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 20:20:42 2022] GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:43.157166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4001db09-8dee-4c87-999c-117f3bc0f600 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:43.159790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4001db09-8dee-4c87-999c-117f3bc0f600 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:43.172224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4001db09-8dee-4c87-999c-117f3bc0f600 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:43.173473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4001db09-8dee-4c87-999c-117f3bc0f600 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:43.174291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4001db09-8dee-4c87-999c-117f3bc0f600 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:43.174733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4001db09-8dee-4c87-999c-117f3bc0f600 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:43.471566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4001db09-8dee-4c87-999c-117f3bc0f600 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:43.486341 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4001db09-8dee-4c87-999c-117f3bc0f600 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1203 microversion: 2.1 time: 0.342103 Jul 26 20:20:43.501366 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2995/6074] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:43 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1203 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:43.565048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-48d0119f-d886-491d-b7f1-077e895a7af1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f87566f03a0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:43.593672 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-48d0119f-d886-491d-b7f1-077e895a7af1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] HTTP exception thrown: Snapshot 8e0369f6-d651-450a-8c30-3a3f457167b7 could not be found. Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-48d0119f-d886-491d-b7f1-077e895a7af1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Request method failure captured: Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 HTTP/1.1 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EyU8ddYkIdwyLNVQ3-rFECLT27KRbYt2TILzaAeNdCzR54ikm1PGw-_GFdc7DgUsV44yIE0PDGItBRSkTJSxIa74FDjRQxq1pW80p3hLOdmpDOjvjZkrinC_Tg7n4scTsYH8k4dEl7PvEAuFtYCWGqsxwlHT6yV8JtvryQ_H2nv0fc Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: ed4d92e9cbf340698f5abde510e368a9 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed4d92e9cbf340698f5abde510e368a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed4d92e9cbf340698f5abde510e368a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed4d92e9cbf340698f5abde510e368a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed4d92e9cbf340698f5abde510e368a9"}]}] Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: ed4d92e9cbf340698f5abde510e368a9 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-VolumesSnapshotsTestJSON-655827943-project Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: e58e39da68d24466b67b6cb4c3438935 Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655827943-project Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: method: Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: exception: Snapshot 8e0369f6-d651-450a-8c30-3a3f457167b7 could not be found. Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '8e0369f6-d651-450a-8c30-3a3f457167b7'} Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8e0369f6-d651-450a-8c30-3a3f457167b7 could not be found. (HTTP 404) (Request-ID: req-bdc35a15-ee41-48f1-a1f2-84807fe402c4) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 20:20:43.602283 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8e0369f6-d651-450a-8c30-3a3f457167b7 could not be found. Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8e0369f6-d651-450a-8c30-3a3f457167b7 could not be found. Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8e0369f6-d651-450a-8c30-3a3f457167b7 could not be found. Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-48d0119f-d886-491d-b7f1-077e895a7af1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Returning 404 to user: Snapshot 8e0369f6-d651-450a-8c30-3a3f457167b7 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:43.606304 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-48d0119f-d886-491d-b7f1-077e895a7af1 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7" status: 404 len: 111 microversion: 2.1 time: 0.052826 Jul 26 20:20:43.608714 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3080/6075] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 20:20:43 2022] GET /compute/v2.1/os-snapshots/8e0369f6-d651-450a-8c30-3a3f457167b7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:20:43.615128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45ce4577-1b8b-49c6-b2f2-21c4a2fc0e0b tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f875ebe1700>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:43.688949 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45ce4577-1b8b-49c6-b2f2-21c4a2fc0e0b tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc" status: 202 len: 0 microversion: 2.1 time: 0.077763 Jul 26 20:20:43.689538 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2996/6076] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:20:43 2022] DELETE /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:20:43.698372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5bc726b-186c-48da-b0ed-1a4198962f7f tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f8756676670>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:43.760003 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5bc726b-186c-48da-b0ed-1a4198962f7f tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc" status: 200 len: 345 microversion: 2.1 time: 0.065823 Jul 26 20:20:43.766734 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3081/6077] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 20:20:43 2022] GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:44.153975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e5e9aae9-eadc-4ed6-8f65-d49ba9c6c9aa req-cdd8af26-1f58-4848-aac9-1451bb829382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0152d9-e815-4488-9b6e-0a7301feb510", "name": "network-vif-plugged", "status": "completed", "tag": "c5988699-4d94-4c9e-ba43-244b4ba1c8bc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:44.184571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e5e9aae9-eadc-4ed6-8f65-d49ba9c6c9aa req-cdd8af26-1f58-4848-aac9-1451bb829382 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:44.185227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e5e9aae9-eadc-4ed6-8f65-d49ba9c6c9aa req-cdd8af26-1f58-4848-aac9-1451bb829382 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:44.197504 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e5e9aae9-eadc-4ed6-8f65-d49ba9c6c9aa req-cdd8af26-1f58-4848-aac9-1451bb829382 service nova] Creating event network-vif-plugged:c5988699-4d94-4c9e-ba43-244b4ba1c8bc for instance bb0152d9-e815-4488-9b6e-0a7301feb510 on n-h1-708768-8 Jul 26 20:20:44.208999 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e5e9aae9-eadc-4ed6-8f65-d49ba9c6c9aa req-cdd8af26-1f58-4848-aac9-1451bb829382 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058568 Jul 26 20:20:44.209934 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2997/6078] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:44.508735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c97bc2e6-359a-488e-a9f0-807a1037ce87 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:44.509372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c97bc2e6-359a-488e-a9f0-807a1037ce87 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:44.516810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c97bc2e6-359a-488e-a9f0-807a1037ce87 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:44.517535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c97bc2e6-359a-488e-a9f0-807a1037ce87 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:44.518332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c97bc2e6-359a-488e-a9f0-807a1037ce87 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:44.518936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c97bc2e6-359a-488e-a9f0-807a1037ce87 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:44.775749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c1fd805-b9ca-442a-927f-21e643ecda56 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f875e3b1f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:44.777789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c97bc2e6-359a-488e-a9f0-807a1037ce87 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:44.798847 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c97bc2e6-359a-488e-a9f0-807a1037ce87 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1203 microversion: 2.1 time: 0.294154 Jul 26 20:20:44.809019 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3082/6079] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:44 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1203 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:44.849677 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c1fd805-b9ca-442a-927f-21e643ecda56 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc" status: 200 len: 345 microversion: 2.1 time: 0.078915 Jul 26 20:20:44.850281 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2998/6080] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 20:20:44 2022] GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:20:45.828576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-733fd73f-9f32-4134-8158-211aea3574ac tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:45.829879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-733fd73f-9f32-4134-8158-211aea3574ac tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:45.837983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-733fd73f-9f32-4134-8158-211aea3574ac tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:45.838856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-733fd73f-9f32-4134-8158-211aea3574ac tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:45.839871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-733fd73f-9f32-4134-8158-211aea3574ac tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:45.840534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-733fd73f-9f32-4134-8158-211aea3574ac tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:45.869380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cfeda15d-7bbc-42c4-84a4-df192474c835 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f87681e2820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:45.915977 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-cfeda15d-7bbc-42c4-84a4-df192474c835 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] HTTP exception thrown: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cfeda15d-7bbc-42c4-84a4-df192474c835 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Request method failure captured: Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc HTTP/1.1 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EyU8ddYkIdwyLNVQ3-rFECLT27KRbYt2TILzaAeNdCzR54ikm1PGw-_GFdc7DgUsV44yIE0PDGItBRSkTJSxIa74FDjRQxq1pW80p3hLOdmpDOjvjZkrinC_Tg7n4scTsYH8k4dEl7PvEAuFtYCWGqsxwlHT6yV8JtvryQ_H2nv0fc Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: ed4d92e9cbf340698f5abde510e368a9 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed4d92e9cbf340698f5abde510e368a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed4d92e9cbf340698f5abde510e368a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed4d92e9cbf340698f5abde510e368a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed4d92e9cbf340698f5abde510e368a9"}]}] Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: ed4d92e9cbf340698f5abde510e368a9 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesSnapshotsTestJSON-655827943-project Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e58e39da68d24466b67b6cb4c3438935 Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655827943-project Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: exception: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6e4b9896-edea-4802-95b7-169e12717efc'} Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. (HTTP 404) (Request-ID: req-12331825-e572-4f76-a5d1-a99b471c9a6f) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 20:20:45.918076 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cfeda15d-7bbc-42c4-84a4-df192474c835 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Returning 404 to user: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cfeda15d-7bbc-42c4-84a4-df192474c835 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc" status: 404 len: 109 microversion: 2.1 time: 0.059759 Jul 26 20:20:45.921959 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 2999/6081] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 20:20:45 2022] GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:20:45.933413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24ee0517-3c56-408f-839a-8606c1cd5369 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f875f00e700>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:45.976294 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-24ee0517-3c56-408f-839a-8606c1cd5369 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] HTTP exception thrown: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24ee0517-3c56-408f-839a-8606c1cd5369 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Request method failure captured: Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc HTTP/1.1 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EyU8ddYkIdwyLNVQ3-rFECLT27KRbYt2TILzaAeNdCzR54ikm1PGw-_GFdc7DgUsV44yIE0PDGItBRSkTJSxIa74FDjRQxq1pW80p3hLOdmpDOjvjZkrinC_Tg7n4scTsYH8k4dEl7PvEAuFtYCWGqsxwlHT6yV8JtvryQ_H2nv0fc Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: ed4d92e9cbf340698f5abde510e368a9 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed4d92e9cbf340698f5abde510e368a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed4d92e9cbf340698f5abde510e368a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed4d92e9cbf340698f5abde510e368a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed4d92e9cbf340698f5abde510e368a9"}]}] Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: ed4d92e9cbf340698f5abde510e368a9 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesSnapshotsTestJSON-655827943-project Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e58e39da68d24466b67b6cb4c3438935 Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655827943-project Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: exception: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6e4b9896-edea-4802-95b7-169e12717efc'} Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. (HTTP 404) (Request-ID: req-fa2a4538-6596-4e50-afee-ca30553a745d) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 20:20:45.979036 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:45.983143 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:45.986538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24ee0517-3c56-408f-839a-8606c1cd5369 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Returning 404 to user: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:45.987579 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-24ee0517-3c56-408f-839a-8606c1cd5369 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc" status: 404 len: 109 microversion: 2.1 time: 0.060245 Jul 26 20:20:45.988655 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3000/6082] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Jul 26 20:20:45 2022] DELETE /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:45.998186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c75d56cf-7920-4c86-9f00-6aa0a43fba83 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Calling method '.version_select at 0x7f875e155f70>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:46.058640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-733fd73f-9f32-4134-8158-211aea3574ac tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:46.068057 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-733fd73f-9f32-4134-8158-211aea3574ac tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1390 microversion: 2.1 time: 0.243888 Jul 26 20:20:46.068651 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3083/6083] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:45 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1390 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:46.085925 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c75d56cf-7920-4c86-9f00-6aa0a43fba83 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] HTTP exception thrown: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:46.089502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15df3a39-35d6-4212-964c-925f21546241 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c75d56cf-7920-4c86-9f00-6aa0a43fba83 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Request method failure captured: Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc HTTP/1.1 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EyU8ddYkIdwyLNVQ3-rFECLT27KRbYt2TILzaAeNdCzR54ikm1PGw-_GFdc7DgUsV44yIE0PDGItBRSkTJSxIa74FDjRQxq1pW80p3hLOdmpDOjvjZkrinC_Tg7n4scTsYH8k4dEl7PvEAuFtYCWGqsxwlHT6yV8JtvryQ_H2nv0fc Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: ed4d92e9cbf340698f5abde510e368a9 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed4d92e9cbf340698f5abde510e368a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed4d92e9cbf340698f5abde510e368a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed4d92e9cbf340698f5abde510e368a9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed4d92e9cbf340698f5abde510e368a9"}]}] Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: ed4d92e9cbf340698f5abde510e368a9 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655827943 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-VolumesSnapshotsTestJSON-655827943-project Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e58e39da68d24466b67b6cb4c3438935 Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655827943-project Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: method: Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: exception: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6e4b9896-edea-4802-95b7-169e12717efc'} Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. (HTTP 404) (Request-ID: req-cc16d7b1-9975-44e1-8c86-314361a9387e) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 20:20:46.089923 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. Jul 26 20:20:46.093670 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:46.096406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15df3a39-35d6-4212-964c-925f21546241 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:46.096494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c75d56cf-7920-4c86-9f00-6aa0a43fba83 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] Returning 404 to user: Volume 6e4b9896-edea-4802-95b7-169e12717efc could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:46.096494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c75d56cf-7920-4c86-9f00-6aa0a43fba83 tempest-VolumesSnapshotsTestJSON-655827943 tempest-VolumesSnapshotsTestJSON-655827943-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc" status: 404 len: 109 microversion: 2.1 time: 0.098919 Jul 26 20:20:46.096494 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3001/6084] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Jul 26 20:20:45 2022] GET /compute/v2.1/os-volumes/6e4b9896-edea-4802-95b7-169e12717efc => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:20:46.116373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15df3a39-35d6-4212-964c-925f21546241 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:46.119863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15df3a39-35d6-4212-964c-925f21546241 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:46.120961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15df3a39-35d6-4212-964c-925f21546241 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:46.121680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15df3a39-35d6-4212-964c-925f21546241 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:46.361329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15df3a39-35d6-4212-964c-925f21546241 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:46.374489 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15df3a39-35d6-4212-964c-925f21546241 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1390 microversion: 2.1 time: 0.289455 Jul 26 20:20:46.375224 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3084/6085] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:46 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:46.397105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d6f1fa6-9c63-4fe4-9844-c383662f7da2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:46.399113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1d6f1fa6-9c63-4fe4-9844-c383662f7da2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:46.401403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=54 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:46.419567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d6f1fa6-9c63-4fe4-9844-c383662f7da2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:46.422840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d6f1fa6-9c63-4fe4-9844-c383662f7da2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:46.424059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d6f1fa6-9c63-4fe4-9844-c383662f7da2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:46.426862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d6f1fa6-9c63-4fe4-9844-c383662f7da2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:46.729924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1d6f1fa6-9c63-4fe4-9844-c383662f7da2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:46.746753 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1d6f1fa6-9c63-4fe4-9844-c383662f7da2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1390 microversion: 2.1 time: 0.352904 Jul 26 20:20:46.748448 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3002/6086] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:46 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1390 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:46.840716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f79a404f-4060-4617-a77b-899d012d4c35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:46.841274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f79a404f-4060-4617-a77b-899d012d4c35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:46.849429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f79a404f-4060-4617-a77b-899d012d4c35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:46.850095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f79a404f-4060-4617-a77b-899d012d4c35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:46.851773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f79a404f-4060-4617-a77b-899d012d4c35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:46.852418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f79a404f-4060-4617-a77b-899d012d4c35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:46.885326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f79a404f-4060-4617-a77b-899d012d4c35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:20:46.902296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:20:46.983263 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f79a404f-4060-4617-a77b-899d012d4c35 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 204 len: 0 microversion: 2.1 time: 0.145540 Jul 26 20:20:46.984760 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3085/6087] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:20:46 2022] DELETE /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:20:46.993493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-853fd5db-9d74-433e-b6b5-49932b96b2e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:46.994148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-853fd5db-9d74-433e-b6b5-49932b96b2e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:47.018807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-853fd5db-9d74-433e-b6b5-49932b96b2e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:47.019256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-853fd5db-9d74-433e-b6b5-49932b96b2e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:47.034248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-853fd5db-9d74-433e-b6b5-49932b96b2e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:47.034834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-853fd5db-9d74-433e-b6b5-49932b96b2e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:47.370438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-853fd5db-9d74-433e-b6b5-49932b96b2e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:47.379588 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-853fd5db-9d74-433e-b6b5-49932b96b2e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1396 microversion: 2.1 time: 0.390277 Jul 26 20:20:47.381224 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3003/6088] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:46 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1396 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:20:48.409662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f93fae3-f64a-493c-ac93-169e31efcc7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:48.410596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7f93fae3-f64a-493c-ac93-169e31efcc7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:48.436565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f93fae3-f64a-493c-ac93-169e31efcc7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:48.437520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f93fae3-f64a-493c-ac93-169e31efcc7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:48.444293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f93fae3-f64a-493c-ac93-169e31efcc7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:48.444749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f93fae3-f64a-493c-ac93-169e31efcc7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:48.823803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7f93fae3-f64a-493c-ac93-169e31efcc7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:48.833187 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f93fae3-f64a-493c-ac93-169e31efcc7b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1396 microversion: 2.1 time: 0.428074 Jul 26 20:20:48.837987 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3086/6089] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:48 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1396 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:49.332048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ee11ea7a-daa8-4775-a633-041c0eca52fa req-e3954434-4b54-465d-9809-84cd6f9c4489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0152d9-e815-4488-9b6e-0a7301feb510", "name": "network-vif-deleted", "tag": "c5988699-4d94-4c9e-ba43-244b4ba1c8bc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:20:49.344001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ee11ea7a-daa8-4775-a633-041c0eca52fa req-e3954434-4b54-465d-9809-84cd6f9c4489 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:49.344483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ee11ea7a-daa8-4775-a633-041c0eca52fa req-e3954434-4b54-465d-9809-84cd6f9c4489 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:49.363181 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ee11ea7a-daa8-4775-a633-041c0eca52fa req-e3954434-4b54-465d-9809-84cd6f9c4489 service nova] Creating event network-vif-deleted:c5988699-4d94-4c9e-ba43-244b4ba1c8bc for instance bb0152d9-e815-4488-9b6e-0a7301feb510 on n-h1-708768-8 Jul 26 20:20:49.369985 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ee11ea7a-daa8-4775-a633-041c0eca52fa req-e3954434-4b54-465d-9809-84cd6f9c4489 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041018 Jul 26 20:20:49.375600 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3004/6090] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:20:49.860392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-78d54069-132b-4799-a276-d381b2120fd4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:49.861022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-78d54069-132b-4799-a276-d381b2120fd4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:49.868627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78d54069-132b-4799-a276-d381b2120fd4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:49.869311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78d54069-132b-4799-a276-d381b2120fd4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:49.870268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78d54069-132b-4799-a276-d381b2120fd4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:49.870869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-78d54069-132b-4799-a276-d381b2120fd4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:49.947759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-78d54069-132b-4799-a276-d381b2120fd4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:49.955868 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-78d54069-132b-4799-a276-d381b2120fd4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1188 microversion: 2.1 time: 0.099300 Jul 26 20:20:49.959649 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3087/6091] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:49 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:50.979997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe289006-0997-4c8e-91ec-da0383b6230c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:50.980861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe289006-0997-4c8e-91ec-da0383b6230c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:50.997509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe289006-0997-4c8e-91ec-da0383b6230c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:50.998139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe289006-0997-4c8e-91ec-da0383b6230c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:50.999559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe289006-0997-4c8e-91ec-da0383b6230c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:51.000064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe289006-0997-4c8e-91ec-da0383b6230c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:51.107274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fe289006-0997-4c8e-91ec-da0383b6230c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:51.118303 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe289006-0997-4c8e-91ec-da0383b6230c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1188 microversion: 2.1 time: 0.143854 Jul 26 20:20:51.124305 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3005/6092] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:50 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1188 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:52.143418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf17edda-c8c9-49c4-a8e9-696c75ae4f62 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:52.145002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf17edda-c8c9-49c4-a8e9-696c75ae4f62 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:52.152982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf17edda-c8c9-49c4-a8e9-696c75ae4f62 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:52.153735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf17edda-c8c9-49c4-a8e9-696c75ae4f62 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:52.154715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf17edda-c8c9-49c4-a8e9-696c75ae4f62 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:52.155318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf17edda-c8c9-49c4-a8e9-696c75ae4f62 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:52.250128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf17edda-c8c9-49c4-a8e9-696c75ae4f62 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:52.261137 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf17edda-c8c9-49c4-a8e9-696c75ae4f62 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1188 microversion: 2.1 time: 0.121542 Jul 26 20:20:52.262882 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3088/6093] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:52 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1188 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:53.287125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1af9114c-1b9f-40f6-b954-e9bacc7bc5ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:53.287125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1af9114c-1b9f-40f6-b954-e9bacc7bc5ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:53.298098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1af9114c-1b9f-40f6-b954-e9bacc7bc5ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:53.298906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1af9114c-1b9f-40f6-b954-e9bacc7bc5ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:53.299736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1af9114c-1b9f-40f6-b954-e9bacc7bc5ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:53.300652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1af9114c-1b9f-40f6-b954-e9bacc7bc5ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:53.387213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1af9114c-1b9f-40f6-b954-e9bacc7bc5ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:53.396911 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1af9114c-1b9f-40f6-b954-e9bacc7bc5ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1188 microversion: 2.1 time: 0.116606 Jul 26 20:20:53.397843 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3006/6094] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:53 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1188 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:54.435272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:54.440010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:54.466976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:54.467691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:54.468773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:54.469408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:54.514530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:54.515291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:54.515997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lazy-loading 'fault' on Instance uuid bb0152d9-e815-4488-9b6e-0a7301feb510 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:20:54.597961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:20:54.613035 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d3131d63-4238-45c2-b55e-65eed923a998 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 200 len: 1193 microversion: 2.1 time: 0.196983 Jul 26 20:20:54.614592 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3089/6095] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:54 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 1193 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:20:55.637088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:55.637687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:55.657632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:55.658094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:55.659089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:55.659711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:55.685707 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 HTTP/1.1 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'bb0152d9-e815-4488-9b6e-0a7301feb510'} Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:55.687946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:55.692246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:55.692246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:55.692246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:55.692246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:55.692246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:55.692246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:55.692246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:55.704487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:55.705376 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-80a357a4-f8c2-4c12-bc5b-5fa082de03d1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 404 len: 111 microversion: 2.1 time: 0.072314 Jul 26 20:20:55.705966 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3007/6096] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:55 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:57.926863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:57.928215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:57.941902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:57.942604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:57.943769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:57.944365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:57.976774 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 HTTP/1.1 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'bb0152d9-e815-4488-9b6e-0a7301feb510'} Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:57.983386 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:20:57.987557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:57.989175 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1be67574-a84d-4e4c-979a-525fafe28186 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 404 len: 111 microversion: 2.1 time: 0.062227 Jul 26 20:20:57.990236 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3090/6097] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:20:57 2022] DELETE /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:20:57.999689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:20:58.001061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: bb0152d9-e815-4488-9b6e-0a7301feb510] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:20:58.009912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:58.010620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:58.012533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:20:58.013411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:20:58.051273 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 HTTP/1.1 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'bb0152d9-e815-4488-9b6e-0a7301feb510'} Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:20:58.053188 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:58.059918 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:20:58.059918 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:20:58.059918 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:20:58.059918 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:20:58.059918 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:20:58.059918 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. Jul 26 20:20:58.059918 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:20:58.065933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance bb0152d9-e815-4488-9b6e-0a7301feb510 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:20:58.067160 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d7041db7-73eb-4cff-8829-78606e51affd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510" status: 404 len: 111 microversion: 2.1 time: 0.071537 Jul 26 20:20:58.068058 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3008/6098] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:20:57 2022] GET /compute/v2.1/servers/bb0152d9-e815-4488-9b6e-0a7301feb510 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:21:02.177576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36f93809-dadb-4b42-adb2-6c34e0eb720a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:02.182426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-36f93809-dadb-4b42-adb2-6c34e0eb720a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:02.191295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:02.193694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36f93809-dadb-4b42-adb2-6c34e0eb720a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:02.194747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36f93809-dadb-4b42-adb2-6c34e0eb720a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:02.196313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36f93809-dadb-4b42-adb2-6c34e0eb720a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:02.197078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36f93809-dadb-4b42-adb2-6c34e0eb720a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:02.256858 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36f93809-dadb-4b42-adb2-6c34e0eb720a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action" status: 200 len: 24573 microversion: 2.1 time: 0.082656 Jul 26 20:21:02.266787 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3091/6099] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:21:02 2022] POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action => generated 24573 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:21:13.254423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-49c989db-0f22-4dce-8d0a-d9d4833715ff tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:13.255572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-49c989db-0f22-4dce-8d0a-d9d4833715ff tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:13.259904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=13 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:13.261087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:13.269362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49c989db-0f22-4dce-8d0a-d9d4833715ff tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:13.270078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49c989db-0f22-4dce-8d0a-d9d4833715ff tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:13.270872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49c989db-0f22-4dce-8d0a-d9d4833715ff tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:13.271315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-49c989db-0f22-4dce-8d0a-d9d4833715ff tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:13.567705 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-49c989db-0f22-4dce-8d0a-d9d4833715ff tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1832 microversion: 2.1 time: 0.316939 Jul 26 20:21:13.568547 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3009/6100] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:13 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1832 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:13.591922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-893a4ac4-764b-47fb-8cc0-2068c7b94b6d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:13.594610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-893a4ac4-764b-47fb-8cc0-2068c7b94b6d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:13.602007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:13.605762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:13.608673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-893a4ac4-764b-47fb-8cc0-2068c7b94b6d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:13.609576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-893a4ac4-764b-47fb-8cc0-2068c7b94b6d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:13.610542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-893a4ac4-764b-47fb-8cc0-2068c7b94b6d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:13.611131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-893a4ac4-764b-47fb-8cc0-2068c7b94b6d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:13.950759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-893a4ac4-764b-47fb-8cc0-2068c7b94b6d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:13.964836 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-893a4ac4-764b-47fb-8cc0-2068c7b94b6d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1681 microversion: 2.1 time: 0.379125 Jul 26 20:21:13.966009 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3092/6101] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:13 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1681 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:14.107673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7afad157-15f5-4c78-9fcc-6b4ed24edccf tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:14.110047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7afad157-15f5-4c78-9fcc-6b4ed24edccf tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:14.118205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7afad157-15f5-4c78-9fcc-6b4ed24edccf tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:14.118659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7afad157-15f5-4c78-9fcc-6b4ed24edccf tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:14.120672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7afad157-15f5-4c78-9fcc-6b4ed24edccf tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:14.121229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7afad157-15f5-4c78-9fcc-6b4ed24edccf tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:14.183887 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7afad157-15f5-4c78-9fcc-6b4ed24edccf tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action" status: 200 len: 32645 microversion: 2.1 time: 0.079911 Jul 26 20:21:14.186876 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3010/6102] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:21:14 2022] POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action => generated 32645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:21:14.373070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:14.373853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:14.383991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:14.384551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:14.387546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:14.388625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:14.595820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3dc7fecf323e4a4baa2e15dd04c6a46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952686847a924ff0b90669babdbd1a23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:14.597188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] flavor_id is None. Assuming migration. {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 20:21:14.597811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:21:14.992030 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a85a1704-421c-40db-b8a5-37212abde72c tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action" status: 202 len: 0 microversion: 2.1 time: 0.620981 Jul 26 20:21:14.992030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3093/6103] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:21:14 2022] POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:21:15.000993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b58a13ce-ae3f-4ea5-a974-6736fdb4347c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:15.001698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b58a13ce-ae3f-4ea5-a974-6736fdb4347c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:15.029979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b58a13ce-ae3f-4ea5-a974-6736fdb4347c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:15.030633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b58a13ce-ae3f-4ea5-a974-6736fdb4347c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:15.035419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b58a13ce-ae3f-4ea5-a974-6736fdb4347c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:15.054052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b58a13ce-ae3f-4ea5-a974-6736fdb4347c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:15.364571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b58a13ce-ae3f-4ea5-a974-6736fdb4347c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:15.375290 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b58a13ce-ae3f-4ea5-a974-6736fdb4347c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1690 microversion: 2.1 time: 0.379622 Jul 26 20:21:15.375896 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3011/6104] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:14 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1690 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:16.408416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3618b948-55d5-435c-864c-c994e08911a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:16.409050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3618b948-55d5-435c-864c-c994e08911a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:16.430876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3618b948-55d5-435c-864c-c994e08911a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:16.431328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3618b948-55d5-435c-864c-c994e08911a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:16.436370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3618b948-55d5-435c-864c-c994e08911a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:16.450230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3618b948-55d5-435c-864c-c994e08911a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:16.874277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3618b948-55d5-435c-864c-c994e08911a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:16.901062 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3618b948-55d5-435c-864c-c994e08911a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1690 microversion: 2.1 time: 0.501387 Jul 26 20:21:16.908562 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3094/6105] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:16 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1690 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:17.932241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c518756b-b637-4c96-83c3-bc9932313aee tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:17.933812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c518756b-b637-4c96-83c3-bc9932313aee tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:17.945276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c518756b-b637-4c96-83c3-bc9932313aee tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:17.946230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c518756b-b637-4c96-83c3-bc9932313aee tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:17.947600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c518756b-b637-4c96-83c3-bc9932313aee tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:17.948361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c518756b-b637-4c96-83c3-bc9932313aee tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:18.395457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c518756b-b637-4c96-83c3-bc9932313aee tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:18.416405 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c518756b-b637-4c96-83c3-bc9932313aee tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1690 microversion: 2.1 time: 0.494102 Jul 26 20:21:18.428130 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3012/6106] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:17 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1690 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:19.443700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-79805b32-668f-4b13-a9ec-d75c80436569 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:19.444290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-79805b32-668f-4b13-a9ec-d75c80436569 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:19.460953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79805b32-668f-4b13-a9ec-d75c80436569 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:19.461814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79805b32-668f-4b13-a9ec-d75c80436569 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:19.462784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79805b32-668f-4b13-a9ec-d75c80436569 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:19.463380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-79805b32-668f-4b13-a9ec-d75c80436569 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:19.677967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-79805b32-668f-4b13-a9ec-d75c80436569 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:19.687306 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-79805b32-668f-4b13-a9ec-d75c80436569 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.248762 Jul 26 20:21:19.694682 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3095/6107] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:19 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:20.718984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-109b7c33-2cbf-4efb-b0aa-31b4441d3355 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:20.719600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-109b7c33-2cbf-4efb-b0aa-31b4441d3355 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:20.731717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-109b7c33-2cbf-4efb-b0aa-31b4441d3355 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:20.733948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-109b7c33-2cbf-4efb-b0aa-31b4441d3355 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:20.736745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-109b7c33-2cbf-4efb-b0aa-31b4441d3355 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:20.737374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-109b7c33-2cbf-4efb-b0aa-31b4441d3355 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:21.021019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-109b7c33-2cbf-4efb-b0aa-31b4441d3355 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:21.037148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-109b7c33-2cbf-4efb-b0aa-31b4441d3355 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.321424 Jul 26 20:21:21.041197 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3013/6108] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:20 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:22.062122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab340316-2507-4b7a-b3fa-546757905ab2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:22.062575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ab340316-2507-4b7a-b3fa-546757905ab2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:22.070122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab340316-2507-4b7a-b3fa-546757905ab2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:22.070990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab340316-2507-4b7a-b3fa-546757905ab2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:22.072004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab340316-2507-4b7a-b3fa-546757905ab2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:22.072647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab340316-2507-4b7a-b3fa-546757905ab2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:22.262683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ab340316-2507-4b7a-b3fa-546757905ab2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:22.270933 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ab340316-2507-4b7a-b3fa-546757905ab2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.212753 Jul 26 20:21:22.271533 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3096/6109] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:22 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:23.294703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8dff3f94-a3ac-41b3-a38c-f331da7cc78a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:23.296132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8dff3f94-a3ac-41b3-a38c-f331da7cc78a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:23.304181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8dff3f94-a3ac-41b3-a38c-f331da7cc78a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:23.305831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8dff3f94-a3ac-41b3-a38c-f331da7cc78a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:23.306782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8dff3f94-a3ac-41b3-a38c-f331da7cc78a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:23.307373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8dff3f94-a3ac-41b3-a38c-f331da7cc78a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:23.549799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8dff3f94-a3ac-41b3-a38c-f331da7cc78a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:23.579512 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8dff3f94-a3ac-41b3-a38c-f331da7cc78a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.287980 Jul 26 20:21:23.584016 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3014/6110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:23 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:24.602804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df550821-2072-425b-8048-e3b152861ce3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:24.604542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df550821-2072-425b-8048-e3b152861ce3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:24.614061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df550821-2072-425b-8048-e3b152861ce3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:24.614520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df550821-2072-425b-8048-e3b152861ce3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:24.615303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df550821-2072-425b-8048-e3b152861ce3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:24.615773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df550821-2072-425b-8048-e3b152861ce3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:24.662482 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:21:24.663014 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:21:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:21:24.795265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-df550821-2072-425b-8048-e3b152861ce3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:24.820687 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df550821-2072-425b-8048-e3b152861ce3 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.219321 Jul 26 20:21:24.838371 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3097/6111] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:24 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:25.846891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-72c612d4-ca24-43a5-b44f-6e065ccf56c5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:25.847890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-72c612d4-ca24-43a5-b44f-6e065ccf56c5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:25.861982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72c612d4-ca24-43a5-b44f-6e065ccf56c5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:25.862574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72c612d4-ca24-43a5-b44f-6e065ccf56c5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:25.863713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72c612d4-ca24-43a5-b44f-6e065ccf56c5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:25.864222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72c612d4-ca24-43a5-b44f-6e065ccf56c5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:26.092187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-72c612d4-ca24-43a5-b44f-6e065ccf56c5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:26.106940 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-72c612d4-ca24-43a5-b44f-6e065ccf56c5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.264976 Jul 26 20:21:26.108442 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3015/6112] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:25 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:27.130870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a2430118-da68-42da-93db-2c8ff8bf76a2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:27.132997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a2430118-da68-42da-93db-2c8ff8bf76a2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:27.142520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2430118-da68-42da-93db-2c8ff8bf76a2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:27.144023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2430118-da68-42da-93db-2c8ff8bf76a2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:27.145945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2430118-da68-42da-93db-2c8ff8bf76a2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:27.147087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2430118-da68-42da-93db-2c8ff8bf76a2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:27.385597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a2430118-da68-42da-93db-2c8ff8bf76a2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:27.397476 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a2430118-da68-42da-93db-2c8ff8bf76a2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.271749 Jul 26 20:21:27.399029 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3098/6113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:27 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:28.262807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1002105015", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "271fa869-61ff-4cf0-a9e0-c7a62a692ee1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8dd04748-e18a-4968-8aa4-c87b9f3665a7"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:28.338081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] validate_networks() for [('8dd04748-e18a-4968-8aa4-c87b9f3665a7', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:21:28.423494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c795a646-ce62-4a2e-b648-beac9fd4a550 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:28.425063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c795a646-ce62-4a2e-b648-beac9fd4a550 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:28.433884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c795a646-ce62-4a2e-b648-beac9fd4a550 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:28.435522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c795a646-ce62-4a2e-b648-beac9fd4a550 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:28.436591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c795a646-ce62-4a2e-b648-beac9fd4a550 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:28.437238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c795a646-ce62-4a2e-b648-beac9fd4a550 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:28.676601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c795a646-ce62-4a2e-b648-beac9fd4a550 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:28.685802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c795a646-ce62-4a2e-b648-beac9fd4a550 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.268490 Jul 26 20:21:28.688863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3099/6114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:28 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:29.147380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:21:29.148110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:21:29.150499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:21:29.151667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:21:29.152814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:21:29.169901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:29.170911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:29.172150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:29.172978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:29.198270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:21:29.205026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:21:29.326104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:21:29.328386 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='271fa869-61ff-4cf0-a9e0-c7a62a692ee1',volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:21:29.499858 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a8b43b6b-b529-48dc-9804-8bc742536049 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240999 Jul 26 20:21:29.506280 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3016/6115] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:21:29.512018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d451cc63-6661-4c1f-9995-6570ade883c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:29.512793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d451cc63-6661-4c1f-9995-6570ade883c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:29.593886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d451cc63-6661-4c1f-9995-6570ade883c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:29.605623 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d451cc63-6661-4c1f-9995-6570ade883c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1071 microversion: 2.1 time: 0.097759 Jul 26 20:21:29.606217 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3100/6116] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:29 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1071 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:29.710759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-de6a1de4-15f7-48a0-9ebc-baf4c3128605 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:29.712242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-de6a1de4-15f7-48a0-9ebc-baf4c3128605 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:29.720752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de6a1de4-15f7-48a0-9ebc-baf4c3128605 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:29.721445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de6a1de4-15f7-48a0-9ebc-baf4c3128605 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:29.722465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de6a1de4-15f7-48a0-9ebc-baf4c3128605 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:29.723061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-de6a1de4-15f7-48a0-9ebc-baf4c3128605 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:30.348893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-de6a1de4-15f7-48a0-9ebc-baf4c3128605 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:30.359696 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-de6a1de4-15f7-48a0-9ebc-baf4c3128605 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1695 microversion: 2.1 time: 0.653690 Jul 26 20:21:30.360611 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3017/6117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:29 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1695 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:30.627660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ea6a3003-83e9-4371-8190-92e10b15fd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:30.628234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ea6a3003-83e9-4371-8190-92e10b15fd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:30.651942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea6a3003-83e9-4371-8190-92e10b15fd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:30.652498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea6a3003-83e9-4371-8190-92e10b15fd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:30.653384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea6a3003-83e9-4371-8190-92e10b15fd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:30.654694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ea6a3003-83e9-4371-8190-92e10b15fd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:30.814457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ea6a3003-83e9-4371-8190-92e10b15fd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:30.838608 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ea6a3003-83e9-4371-8190-92e10b15fd9f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1177 microversion: 2.1 time: 0.215050 Jul 26 20:21:30.855433 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3101/6118] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:30 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1177 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:31.383645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ebd818a6-687e-46de-acd3-b3094e8d6b46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:31.384420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ebd818a6-687e-46de-acd3-b3094e8d6b46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:31.406832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebd818a6-687e-46de-acd3-b3094e8d6b46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:31.407444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebd818a6-687e-46de-acd3-b3094e8d6b46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:31.408710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebd818a6-687e-46de-acd3-b3094e8d6b46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:31.411262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ebd818a6-687e-46de-acd3-b3094e8d6b46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:31.861473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6883d106-ae7c-4fba-9971-d53182ad0c7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:31.862197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6883d106-ae7c-4fba-9971-d53182ad0c7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:31.871102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6883d106-ae7c-4fba-9971-d53182ad0c7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:31.871883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6883d106-ae7c-4fba-9971-d53182ad0c7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:31.873350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6883d106-ae7c-4fba-9971-d53182ad0c7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:31.873997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6883d106-ae7c-4fba-9971-d53182ad0c7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:31.964630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ebd818a6-687e-46de-acd3-b3094e8d6b46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:31.978526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6883d106-ae7c-4fba-9971-d53182ad0c7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:31.985205 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ebd818a6-687e-46de-acd3-b3094e8d6b46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1694 microversion: 2.1 time: 0.604330 Jul 26 20:21:31.988279 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3018/6119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:31 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1694 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:31.997089 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6883d106-ae7c-4fba-9971-d53182ad0c7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1187 microversion: 2.1 time: 0.139659 Jul 26 20:21:31.997677 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3102/6120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:31 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:32.260690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-95f6d58f-c33e-4cd0-a6a0-92141a8ad693 req-dc3f0e28-af9d-4a3b-80b3-3c2ca2230d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "name": "network-vif-unplugged", "status": "completed", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:32.306717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-95f6d58f-c33e-4cd0-a6a0-92141a8ad693 req-dc3f0e28-af9d-4a3b-80b3-3c2ca2230d50 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:32.307197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-95f6d58f-c33e-4cd0-a6a0-92141a8ad693 req-dc3f0e28-af9d-4a3b-80b3-3c2ca2230d50 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:32.345999 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-95f6d58f-c33e-4cd0-a6a0-92141a8ad693 req-dc3f0e28-af9d-4a3b-80b3-3c2ca2230d50 service nova] Creating event network-vif-unplugged:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h1-708768-8 Jul 26 20:21:32.361960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-95f6d58f-c33e-4cd0-a6a0-92141a8ad693 req-dc3f0e28-af9d-4a3b-80b3-3c2ca2230d50 service nova] Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:21:32.395000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-95f6d58f-c33e-4cd0-a6a0-92141a8ad693 req-dc3f0e28-af9d-4a3b-80b3-3c2ca2230d50 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148919 Jul 26 20:21:32.398617 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3019/6121] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:21:33.021084 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f57ef740-8127-4c50-b31e-fa0bb06617c0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:33.025147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f57ef740-8127-4c50-b31e-fa0bb06617c0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:33.027136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f21f401d-24ca-404a-9edd-db8fb5fb7ad6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:33.028289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f21f401d-24ca-404a-9edd-db8fb5fb7ad6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:33.052173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f57ef740-8127-4c50-b31e-fa0bb06617c0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:33.056588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f21f401d-24ca-404a-9edd-db8fb5fb7ad6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:33.057394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f57ef740-8127-4c50-b31e-fa0bb06617c0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:33.059276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f57ef740-8127-4c50-b31e-fa0bb06617c0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:33.064529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f21f401d-24ca-404a-9edd-db8fb5fb7ad6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:33.065344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f57ef740-8127-4c50-b31e-fa0bb06617c0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:33.069156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f21f401d-24ca-404a-9edd-db8fb5fb7ad6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:33.069612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f21f401d-24ca-404a-9edd-db8fb5fb7ad6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:33.882542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f21f401d-24ca-404a-9edd-db8fb5fb7ad6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:33.908917 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f21f401d-24ca-404a-9edd-db8fb5fb7ad6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1229 microversion: 2.1 time: 0.889481 Jul 26 20:21:33.909464 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3020/6122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:33 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1229 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:34.302447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f57ef740-8127-4c50-b31e-fa0bb06617c0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:34.321208 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f57ef740-8127-4c50-b31e-fa0bb06617c0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1694 microversion: 2.1 time: 1.308458 Jul 26 20:21:34.346623 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3103/6123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:33 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1694 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:34.420653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3968748d-09be-4975-a877-a21f5b765f56 req-1ce3fe59-0fb6-40e8-9336-5dacda8c5d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:34.447652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3968748d-09be-4975-a877-a21f5b765f56 req-1ce3fe59-0fb6-40e8-9336-5dacda8c5d8b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:34.448093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3968748d-09be-4975-a877-a21f5b765f56 req-1ce3fe59-0fb6-40e8-9336-5dacda8c5d8b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:34.496908 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3968748d-09be-4975-a877-a21f5b765f56 req-1ce3fe59-0fb6-40e8-9336-5dacda8c5d8b service nova] Creating event network-changed:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h1-708768-8 Jul 26 20:21:34.503660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-3968748d-09be-4975-a877-a21f5b765f56 req-1ce3fe59-0fb6-40e8-9336-5dacda8c5d8b service nova] Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:21:34.528575 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3968748d-09be-4975-a877-a21f5b765f56 req-1ce3fe59-0fb6-40e8-9336-5dacda8c5d8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115281 Jul 26 20:21:34.529824 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3021/6124] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:21:34.934840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a6c68788-8ec8-40d4-a863-49adb221e9ae tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:34.935751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a6c68788-8ec8-40d4-a863-49adb221e9ae tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:34.946203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6c68788-8ec8-40d4-a863-49adb221e9ae tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:34.947031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6c68788-8ec8-40d4-a863-49adb221e9ae tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:34.948119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6c68788-8ec8-40d4-a863-49adb221e9ae tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:34.948876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6c68788-8ec8-40d4-a863-49adb221e9ae tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:35.354442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-52e73aed-6098-45cd-9eed-126ea18d0eae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:35.355139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-52e73aed-6098-45cd-9eed-126ea18d0eae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:35.374168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52e73aed-6098-45cd-9eed-126ea18d0eae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:35.375278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52e73aed-6098-45cd-9eed-126ea18d0eae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:35.377992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52e73aed-6098-45cd-9eed-126ea18d0eae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:35.378635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52e73aed-6098-45cd-9eed-126ea18d0eae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:35.608703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6c68788-8ec8-40d4-a863-49adb221e9ae tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:35.626322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a6c68788-8ec8-40d4-a863-49adb221e9ae tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1229 microversion: 2.1 time: 0.698545 Jul 26 20:21:35.628779 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3104/6125] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:34 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1229 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:35.639539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-52e73aed-6098-45cd-9eed-126ea18d0eae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:35.682887 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-52e73aed-6098-45cd-9eed-126ea18d0eae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1694 microversion: 2.1 time: 0.324552 Jul 26 20:21:35.683855 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3022/6126] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:35 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1694 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:36.590478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0cb524ad-6dd2-4dc6-aea6-ad9d6be386b3 req-a77dbeab-ed90-4094-82ae-17baf51ed4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bc4a19-a758-4dfa-a103-54ed97bd43a1", "tag": "5bef1124-7bfe-407b-90b8-fc5af6710676"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:36.610388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0cb524ad-6dd2-4dc6-aea6-ad9d6be386b3 req-a77dbeab-ed90-4094-82ae-17baf51ed4e6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:36.611006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0cb524ad-6dd2-4dc6-aea6-ad9d6be386b3 req-a77dbeab-ed90-4094-82ae-17baf51ed4e6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:36.629214 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0cb524ad-6dd2-4dc6-aea6-ad9d6be386b3 req-a77dbeab-ed90-4094-82ae-17baf51ed4e6 service nova] Creating event network-changed:5bef1124-7bfe-407b-90b8-fc5af6710676 for instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 on n-h1-708768-8 Jul 26 20:21:36.638269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0cb524ad-6dd2-4dc6-aea6-ad9d6be386b3 req-a77dbeab-ed90-4094-82ae-17baf51ed4e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370628 Jul 26 20:21:36.639147 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3105/6127] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:21:36.649796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d3b28e75-1c45-4c2c-8042-faa01b98e906 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:36.650405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d3b28e75-1c45-4c2c-8042-faa01b98e906 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:36.657913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3b28e75-1c45-4c2c-8042-faa01b98e906 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:36.658614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3b28e75-1c45-4c2c-8042-faa01b98e906 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:36.659554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3b28e75-1c45-4c2c-8042-faa01b98e906 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:36.660167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3b28e75-1c45-4c2c-8042-faa01b98e906 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:36.707795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dff210c9-0b0d-4140-84ca-769d89378571 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:36.708867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dff210c9-0b0d-4140-84ca-769d89378571 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:36.716464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dff210c9-0b0d-4140-84ca-769d89378571 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:36.717142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dff210c9-0b0d-4140-84ca-769d89378571 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:36.718088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dff210c9-0b0d-4140-84ca-769d89378571 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:36.718700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dff210c9-0b0d-4140-84ca-769d89378571 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:37.092346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d3b28e75-1c45-4c2c-8042-faa01b98e906 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:37.127966 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d3b28e75-1c45-4c2c-8042-faa01b98e906 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1229 microversion: 2.1 time: 0.482500 Jul 26 20:21:37.139889 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3023/6128] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:36 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1229 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:37.736709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dff210c9-0b0d-4140-84ca-769d89378571 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:37.751703 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dff210c9-0b0d-4140-84ca-769d89378571 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1692 microversion: 2.1 time: 1.049130 Jul 26 20:21:37.752960 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3106/6129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:36 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1692 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:21:38.166292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8a5aaeda-87c9-4f6e-a5cd-c116be7bd64e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:38.167057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8a5aaeda-87c9-4f6e-a5cd-c116be7bd64e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:38.180044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeda-87c9-4f6e-a5cd-c116be7bd64e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:38.180613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeda-87c9-4f6e-a5cd-c116be7bd64e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:38.181403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeda-87c9-4f6e-a5cd-c116be7bd64e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:38.181848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a5aaeda-87c9-4f6e-a5cd-c116be7bd64e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:38.393466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8a5aaeda-87c9-4f6e-a5cd-c116be7bd64e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:38.403753 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8a5aaeda-87c9-4f6e-a5cd-c116be7bd64e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1229 microversion: 2.1 time: 0.244359 Jul 26 20:21:38.415671 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3024/6130] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:38 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1229 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:38.774280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec019746-d5af-49fd-8d9c-e543539484e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:38.775480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ec019746-d5af-49fd-8d9c-e543539484e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:38.782770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec019746-d5af-49fd-8d9c-e543539484e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:38.783432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec019746-d5af-49fd-8d9c-e543539484e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:38.784272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec019746-d5af-49fd-8d9c-e543539484e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:38.784708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec019746-d5af-49fd-8d9c-e543539484e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:39.032894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ec019746-d5af-49fd-8d9c-e543539484e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:39.041024 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ec019746-d5af-49fd-8d9c-e543539484e0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1689 microversion: 2.1 time: 0.271041 Jul 26 20:21:39.041633 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3107/6131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:38 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:21:39.062035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-decc8aeb-e2fa-4c51-8548-5542ff1f53bb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:39.063078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-decc8aeb-e2fa-4c51-8548-5542ff1f53bb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:39.070975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-decc8aeb-e2fa-4c51-8548-5542ff1f53bb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:39.071422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-decc8aeb-e2fa-4c51-8548-5542ff1f53bb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:39.072366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-decc8aeb-e2fa-4c51-8548-5542ff1f53bb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:39.072858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-decc8aeb-e2fa-4c51-8548-5542ff1f53bb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:39.169848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:39.195755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:39.198560 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-decc8aeb-e2fa-4c51-8548-5542ff1f53bb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action" status: 202 len: 0 microversion: 2.1 time: 0.140219 Jul 26 20:21:39.199252 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3025/6132] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:21:39 2022] POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:21:39.207740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77f8c7f3-a06a-4a2c-a2f9-f169102d5721 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:39.208592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77f8c7f3-a06a-4a2c-a2f9-f169102d5721 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:39.216642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77f8c7f3-a06a-4a2c-a2f9-f169102d5721 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:39.217275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77f8c7f3-a06a-4a2c-a2f9-f169102d5721 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:39.218580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77f8c7f3-a06a-4a2c-a2f9-f169102d5721 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:39.218767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77f8c7f3-a06a-4a2c-a2f9-f169102d5721 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:39.243511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:39.423713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:39.429855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b498fb20-0da8-4e64-bfe8-b1d72d9c5c38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:39.429855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b498fb20-0da8-4e64-bfe8-b1d72d9c5c38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:39.438305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b498fb20-0da8-4e64-bfe8-b1d72d9c5c38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:39.439012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b498fb20-0da8-4e64-bfe8-b1d72d9c5c38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:39.439830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b498fb20-0da8-4e64-bfe8-b1d72d9c5c38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:39.440263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b498fb20-0da8-4e64-bfe8-b1d72d9c5c38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:39.598242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:39.609264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77f8c7f3-a06a-4a2c-a2f9-f169102d5721 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:39.628233 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77f8c7f3-a06a-4a2c-a2f9-f169102d5721 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1688 microversion: 2.1 time: 0.424240 Jul 26 20:21:39.628833 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3108/6133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:39 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1688 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:39.673171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b498fb20-0da8-4e64-bfe8-b1d72d9c5c38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:39.684311 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b498fb20-0da8-4e64-bfe8-b1d72d9c5c38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.261071 Jul 26 20:21:39.685483 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3026/6134] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:39 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:40.651650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ffcf4e07-62bc-47f0-bc85-ac5de9b5d354 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:40.665212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ffcf4e07-62bc-47f0-bc85-ac5de9b5d354 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:40.672023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffcf4e07-62bc-47f0-bc85-ac5de9b5d354 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:40.673396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffcf4e07-62bc-47f0-bc85-ac5de9b5d354 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:40.684744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffcf4e07-62bc-47f0-bc85-ac5de9b5d354 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:40.685200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ffcf4e07-62bc-47f0-bc85-ac5de9b5d354 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:40.707981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f312f0d0-d0ca-4422-ac8b-75bc5319c49d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:40.709517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f312f0d0-d0ca-4422-ac8b-75bc5319c49d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:40.735470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f312f0d0-d0ca-4422-ac8b-75bc5319c49d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:40.736093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f312f0d0-d0ca-4422-ac8b-75bc5319c49d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:40.736976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f312f0d0-d0ca-4422-ac8b-75bc5319c49d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:40.737762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f312f0d0-d0ca-4422-ac8b-75bc5319c49d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:40.990053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f312f0d0-d0ca-4422-ac8b-75bc5319c49d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:40.998069 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f312f0d0-d0ca-4422-ac8b-75bc5319c49d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.294203 Jul 26 20:21:40.998758 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3027/6135] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:40 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:41.014286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-22c8af0b-01fb-4bbd-b13e-666a70654902 req-5cc9d827-d0e2-4312-95b9-2ccec38acf6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "name": "network-vif-plugged", "status": "completed", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:41.027336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-22c8af0b-01fb-4bbd-b13e-666a70654902 req-5cc9d827-d0e2-4312-95b9-2ccec38acf6c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:41.028068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-22c8af0b-01fb-4bbd-b13e-666a70654902 req-5cc9d827-d0e2-4312-95b9-2ccec38acf6c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:41.044473 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-22c8af0b-01fb-4bbd-b13e-666a70654902 req-5cc9d827-d0e2-4312-95b9-2ccec38acf6c service nova] Creating event network-vif-plugged:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h1-708768-8 Jul 26 20:21:41.051465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-22c8af0b-01fb-4bbd-b13e-666a70654902 req-5cc9d827-d0e2-4312-95b9-2ccec38acf6c service nova] Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:21:41.064245 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-22c8af0b-01fb-4bbd-b13e-666a70654902 req-5cc9d827-d0e2-4312-95b9-2ccec38acf6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063110 Jul 26 20:21:41.068083 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3028/6136] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:21:41.120182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ffcf4e07-62bc-47f0-bc85-ac5de9b5d354 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:41.128698 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ffcf4e07-62bc-47f0-bc85-ac5de9b5d354 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1688 microversion: 2.1 time: 0.481037 Jul 26 20:21:41.129469 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3109/6137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:40 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1688 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:42.021997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0475ee50-fabb-4915-a114-9c56fffd5c4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:42.023564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0475ee50-fabb-4915-a114-9c56fffd5c4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:42.032662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0475ee50-fabb-4915-a114-9c56fffd5c4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:42.033423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0475ee50-fabb-4915-a114-9c56fffd5c4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:42.034440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0475ee50-fabb-4915-a114-9c56fffd5c4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:42.035284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0475ee50-fabb-4915-a114-9c56fffd5c4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:42.151807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f5b5ace-d6f8-4ca8-975b-f9d2a55badae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:42.154687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f5b5ace-d6f8-4ca8-975b-f9d2a55badae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:42.173473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f5b5ace-d6f8-4ca8-975b-f9d2a55badae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:42.174657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f5b5ace-d6f8-4ca8-975b-f9d2a55badae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:42.175510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f5b5ace-d6f8-4ca8-975b-f9d2a55badae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:42.176178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f5b5ace-d6f8-4ca8-975b-f9d2a55badae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:42.204786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0475ee50-fabb-4915-a114-9c56fffd5c4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:42.217653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0475ee50-fabb-4915-a114-9c56fffd5c4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.201496 Jul 26 20:21:42.218396 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3029/6138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:42 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:42.525541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5f5b5ace-d6f8-4ca8-975b-f9d2a55badae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:42.543349 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f5b5ace-d6f8-4ca8-975b-f9d2a55badae tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1688 microversion: 2.1 time: 0.396726 Jul 26 20:21:42.544287 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3110/6139] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:42 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1688 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:21:43.238647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-65b775d4-4040-4584-8558-e8467b27734e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:43.240056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-65b775d4-4040-4584-8558-e8467b27734e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:43.248280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65b775d4-4040-4584-8558-e8467b27734e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:43.249051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65b775d4-4040-4584-8558-e8467b27734e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:43.250176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65b775d4-4040-4584-8558-e8467b27734e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:43.250884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65b775d4-4040-4584-8558-e8467b27734e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:43.572291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-65b775d4-4040-4584-8558-e8467b27734e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:43.574801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77740661-2987-4714-984a-97c3538bccd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:43.579677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77740661-2987-4714-984a-97c3538bccd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:43.590706 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-65b775d4-4040-4584-8558-e8467b27734e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.355983 Jul 26 20:21:43.593618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77740661-2987-4714-984a-97c3538bccd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:43.594323 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3030/6140] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:43 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:43.594738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77740661-2987-4714-984a-97c3538bccd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:43.595709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77740661-2987-4714-984a-97c3538bccd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:43.596297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77740661-2987-4714-984a-97c3538bccd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:43.947521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-77740661-2987-4714-984a-97c3538bccd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:43.959005 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77740661-2987-4714-984a-97c3538bccd2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1688 microversion: 2.1 time: 0.393330 Jul 26 20:21:43.974657 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3111/6141] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:43 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1688 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:44.143987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-54a921e9-4796-4279-8ecc-edef81b4cbb4 req-ee1c53c5-a9fb-41f9-9095-c2e37e0ed163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "name": "network-vif-unplugged", "status": "completed", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:44.151059 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:44.155498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-54a921e9-4796-4279-8ecc-edef81b4cbb4 req-ee1c53c5-a9fb-41f9-9095-c2e37e0ed163 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:44.156298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-54a921e9-4796-4279-8ecc-edef81b4cbb4 req-ee1c53c5-a9fb-41f9-9095-c2e37e0ed163 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:44.172834 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-54a921e9-4796-4279-8ecc-edef81b4cbb4 req-ee1c53c5-a9fb-41f9-9095-c2e37e0ed163 service nova] Creating event network-vif-unplugged:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h2-708768-8 Jul 26 20:21:44.180397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-54a921e9-4796-4279-8ecc-edef81b4cbb4 req-ee1c53c5-a9fb-41f9-9095-c2e37e0ed163 service nova] Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:21:44.192115 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-54a921e9-4796-4279-8ecc-edef81b4cbb4 req-ee1c53c5-a9fb-41f9-9095-c2e37e0ed163 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051679 Jul 26 20:21:44.192954 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3031/6142] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:21:44.618877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10b9ad59-4d77-497f-bdab-3349fd3420cd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:44.620126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-10b9ad59-4d77-497f-bdab-3349fd3420cd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:44.623046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=45 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:21:44.631033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10b9ad59-4d77-497f-bdab-3349fd3420cd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:44.631683 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10b9ad59-4d77-497f-bdab-3349fd3420cd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:44.633215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10b9ad59-4d77-497f-bdab-3349fd3420cd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:44.633821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10b9ad59-4d77-497f-bdab-3349fd3420cd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:44.976662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10b9ad59-4d77-497f-bdab-3349fd3420cd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:44.983310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22d8e142-6c85-4cea-a99c-bb3b574b3f45 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:44.984299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-22d8e142-6c85-4cea-a99c-bb3b574b3f45 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:44.990401 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-10b9ad59-4d77-497f-bdab-3349fd3420cd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.376709 Jul 26 20:21:44.994317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22d8e142-6c85-4cea-a99c-bb3b574b3f45 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:44.995073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22d8e142-6c85-4cea-a99c-bb3b574b3f45 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:44.996092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22d8e142-6c85-4cea-a99c-bb3b574b3f45 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:44.996871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22d8e142-6c85-4cea-a99c-bb3b574b3f45 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:44.999660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3112/6143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:44 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:45.386735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22d8e142-6c85-4cea-a99c-bb3b574b3f45 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:45.395263 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22d8e142-6c85-4cea-a99c-bb3b574b3f45 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1688 microversion: 2.1 time: 0.417330 Jul 26 20:21:45.395996 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3032/6144] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:44 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1688 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:46.022239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cdc3c8d8-cbbc-4e06-8d3c-a305b3fef6fb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:46.024042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cdc3c8d8-cbbc-4e06-8d3c-a305b3fef6fb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:46.031548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc3c8d8-cbbc-4e06-8d3c-a305b3fef6fb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:46.032725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc3c8d8-cbbc-4e06-8d3c-a305b3fef6fb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:46.033856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc3c8d8-cbbc-4e06-8d3c-a305b3fef6fb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:46.034260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdc3c8d8-cbbc-4e06-8d3c-a305b3fef6fb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:46.198704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cdc3c8d8-cbbc-4e06-8d3c-a305b3fef6fb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:46.212510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cdc3c8d8-cbbc-4e06-8d3c-a305b3fef6fb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.192480 Jul 26 20:21:46.213127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d8cef820-1208-4ed0-893e-9cd04a6f8cb2 req-588dcc56-f800-450f-8934-ecb5ea69f24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:46.214568 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3113/6145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:46 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:46.229893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d8cef820-1208-4ed0-893e-9cd04a6f8cb2 req-588dcc56-f800-450f-8934-ecb5ea69f24b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:46.230789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d8cef820-1208-4ed0-893e-9cd04a6f8cb2 req-588dcc56-f800-450f-8934-ecb5ea69f24b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:46.244077 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d8cef820-1208-4ed0-893e-9cd04a6f8cb2 req-588dcc56-f800-450f-8934-ecb5ea69f24b service nova] Creating event network-changed:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h2-708768-8 Jul 26 20:21:46.250297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-d8cef820-1208-4ed0-893e-9cd04a6f8cb2 req-588dcc56-f800-450f-8934-ecb5ea69f24b service nova] Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:21:46.264116 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d8cef820-1208-4ed0-893e-9cd04a6f8cb2 req-588dcc56-f800-450f-8934-ecb5ea69f24b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055506 Jul 26 20:21:46.268725 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3033/6146] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:21:46.421462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-615561cd-7621-48a9-9567-36e0a66e6921 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:46.422373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-615561cd-7621-48a9-9567-36e0a66e6921 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:46.437428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-615561cd-7621-48a9-9567-36e0a66e6921 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:46.442614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-615561cd-7621-48a9-9567-36e0a66e6921 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:46.444525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-615561cd-7621-48a9-9567-36e0a66e6921 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:46.447753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-615561cd-7621-48a9-9567-36e0a66e6921 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:46.943956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-615561cd-7621-48a9-9567-36e0a66e6921 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:46.955332 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-615561cd-7621-48a9-9567-36e0a66e6921 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1688 microversion: 2.1 time: 0.541742 Jul 26 20:21:46.970428 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3114/6147] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:46 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1688 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:47.238186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-acde0bb0-5309-49a5-82ff-67b9d03dd602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:47.238948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-acde0bb0-5309-49a5-82ff-67b9d03dd602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:47.272055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acde0bb0-5309-49a5-82ff-67b9d03dd602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:47.279568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acde0bb0-5309-49a5-82ff-67b9d03dd602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:47.283944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acde0bb0-5309-49a5-82ff-67b9d03dd602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:47.286332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acde0bb0-5309-49a5-82ff-67b9d03dd602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:47.748560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-acde0bb0-5309-49a5-82ff-67b9d03dd602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:47.763229 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-acde0bb0-5309-49a5-82ff-67b9d03dd602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.529058 Jul 26 20:21:47.764366 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3034/6148] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:47 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:47.989701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ccae3cc-5a22-4cc4-961a-fb1911caf6c1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:47.990433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ccae3cc-5a22-4cc4-961a-fb1911caf6c1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:48.007358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ccae3cc-5a22-4cc4-961a-fb1911caf6c1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:48.008969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ccae3cc-5a22-4cc4-961a-fb1911caf6c1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:48.009998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ccae3cc-5a22-4cc4-961a-fb1911caf6c1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:48.010656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ccae3cc-5a22-4cc4-961a-fb1911caf6c1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:48.248793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ccae3cc-5a22-4cc4-961a-fb1911caf6c1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:48.264082 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ccae3cc-5a22-4cc4-961a-fb1911caf6c1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1681 microversion: 2.1 time: 0.277761 Jul 26 20:21:48.265244 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3115/6149] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:47 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1681 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:48.795300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e842ccf5-76e2-4008-bf55-9fbb764a2442 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:48.796707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e842ccf5-76e2-4008-bf55-9fbb764a2442 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:48.806581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e842ccf5-76e2-4008-bf55-9fbb764a2442 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:48.807433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e842ccf5-76e2-4008-bf55-9fbb764a2442 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:48.808521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e842ccf5-76e2-4008-bf55-9fbb764a2442 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:48.809169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e842ccf5-76e2-4008-bf55-9fbb764a2442 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:49.110056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e842ccf5-76e2-4008-bf55-9fbb764a2442 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:49.124627 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e842ccf5-76e2-4008-bf55-9fbb764a2442 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.335362 Jul 26 20:21:49.137357 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3035/6150] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:48 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:50.160294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ade650b9-16cf-455f-90d3-b440565c2385 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:50.161077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ade650b9-16cf-455f-90d3-b440565c2385 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:50.174436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ade650b9-16cf-455f-90d3-b440565c2385 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:50.181052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ade650b9-16cf-455f-90d3-b440565c2385 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:50.182287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ade650b9-16cf-455f-90d3-b440565c2385 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:50.184891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ade650b9-16cf-455f-90d3-b440565c2385 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:50.405173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ade650b9-16cf-455f-90d3-b440565c2385 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:50.425576 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ade650b9-16cf-455f-90d3-b440565c2385 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.275751 Jul 26 20:21:50.436533 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3116/6151] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:50 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:51.455381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41a52ea1-dbd3-494c-bc3c-df4a282ba602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:51.456032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41a52ea1-dbd3-494c-bc3c-df4a282ba602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:51.463482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41a52ea1-dbd3-494c-bc3c-df4a282ba602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:51.472438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41a52ea1-dbd3-494c-bc3c-df4a282ba602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:51.473559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41a52ea1-dbd3-494c-bc3c-df4a282ba602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:51.474158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41a52ea1-dbd3-494c-bc3c-df4a282ba602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:51.745147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fd680543-3c00-439f-8c88-b276d56bec2b req-621a07ca-f504-41a6-af89-0da8a73dab66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bc4a19-a758-4dfa-a103-54ed97bd43a1", "name": "network-vif-plugged", "status": "completed", "tag": "5bef1124-7bfe-407b-90b8-fc5af6710676"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:51.761502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-41a52ea1-dbd3-494c-bc3c-df4a282ba602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:51.776560 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41a52ea1-dbd3-494c-bc3c-df4a282ba602 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.325060 Jul 26 20:21:51.778261 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3036/6152] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:51 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:51.791657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fd680543-3c00-439f-8c88-b276d56bec2b req-621a07ca-f504-41a6-af89-0da8a73dab66 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:51.792076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fd680543-3c00-439f-8c88-b276d56bec2b req-621a07ca-f504-41a6-af89-0da8a73dab66 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:51.831944 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fd680543-3c00-439f-8c88-b276d56bec2b req-621a07ca-f504-41a6-af89-0da8a73dab66 service nova] Creating event network-vif-plugged:5bef1124-7bfe-407b-90b8-fc5af6710676 for instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 on n-h1-708768-8 Jul 26 20:21:51.851992 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fd680543-3c00-439f-8c88-b276d56bec2b req-621a07ca-f504-41a6-af89-0da8a73dab66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128443 Jul 26 20:21:51.853292 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3117/6153] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:21:52.800242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-07730b16-321a-4a4d-b73e-fbaf5fe92815 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:52.801717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-07730b16-321a-4a4d-b73e-fbaf5fe92815 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:52.828618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07730b16-321a-4a4d-b73e-fbaf5fe92815 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:52.829550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07730b16-321a-4a4d-b73e-fbaf5fe92815 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:52.833106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07730b16-321a-4a4d-b73e-fbaf5fe92815 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:52.833578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07730b16-321a-4a4d-b73e-fbaf5fe92815 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:53.327200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-07730b16-321a-4a4d-b73e-fbaf5fe92815 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:53.341273 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-07730b16-321a-4a4d-b73e-fbaf5fe92815 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1217 microversion: 2.1 time: 0.541734 Jul 26 20:21:53.342067 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3037/6154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:52 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1217 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:54.084115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-412ad6e0-434b-4129-9bd6-148d769b69e3 req-a6a69f52-1f2e-48b3-b4f2-118202fa4733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "name": "network-vif-plugged", "status": "completed", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:54.102987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-412ad6e0-434b-4129-9bd6-148d769b69e3 req-a6a69f52-1f2e-48b3-b4f2-118202fa4733 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:54.107878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-412ad6e0-434b-4129-9bd6-148d769b69e3 req-a6a69f52-1f2e-48b3-b4f2-118202fa4733 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:54.139013 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-412ad6e0-434b-4129-9bd6-148d769b69e3 req-a6a69f52-1f2e-48b3-b4f2-118202fa4733 service nova] Creating event network-vif-plugged:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h2-708768-8 Jul 26 20:21:54.145892 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-412ad6e0-434b-4129-9bd6-148d769b69e3 req-a6a69f52-1f2e-48b3-b4f2-118202fa4733 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070551 Jul 26 20:21:54.149455 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3118/6155] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:21:54.365235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e8e1a32-0327-44e2-a28b-a4cc7d44ca4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:54.368207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9e8e1a32-0327-44e2-a28b-a4cc7d44ca4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:54.376881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8e1a32-0327-44e2-a28b-a4cc7d44ca4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:54.377796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8e1a32-0327-44e2-a28b-a4cc7d44ca4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:54.378755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8e1a32-0327-44e2-a28b-a4cc7d44ca4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:54.379355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8e1a32-0327-44e2-a28b-a4cc7d44ca4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:54.780250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e8e1a32-0327-44e2-a28b-a4cc7d44ca4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:54.789490 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e8e1a32-0327-44e2-a28b-a4cc7d44ca4f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1403 microversion: 2.1 time: 0.427527 Jul 26 20:21:54.790308 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3038/6156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:54 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1403 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:54.829490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-578d6eb9-15ae-4d45-afc5-2bdbc3685df7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:21:54.830408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-578d6eb9-15ae-4d45-afc5-2bdbc3685df7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:54.841680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578d6eb9-15ae-4d45-afc5-2bdbc3685df7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:54.848797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578d6eb9-15ae-4d45-afc5-2bdbc3685df7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:54.849885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578d6eb9-15ae-4d45-afc5-2bdbc3685df7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:54.852091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-578d6eb9-15ae-4d45-afc5-2bdbc3685df7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:55.135043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-578d6eb9-15ae-4d45-afc5-2bdbc3685df7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:21:55.189850 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-578d6eb9-15ae-4d45-afc5-2bdbc3685df7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1403 microversion: 2.1 time: 0.371958 Jul 26 20:21:55.190553 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3119/6157] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:21:54 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1403 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:21:55.223826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-774945608"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:55.229306 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:21:55.239508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:55.243035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:55.244126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:21:55.244653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:21:55.390733 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.api [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Attempting to quiesce instance before volume snapshot. Jul 26 20:21:55.466251 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.api [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 26 20:21:55.555819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Creating snapshot from volume 271fa869-61ff-4cf0-a9e0-c7a62a692ee1. {{(pid=125963) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 26 20:21:57.252748 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c603ffaa-ccf5-4096-bbf2-9b44dcc6443c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1/action" status: 202 len: 0 microversion: 2.1 time: 2.043170 Jul 26 20:21:57.254022 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3039/6158] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:21:55 2022] POST /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1/action => generated 0 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 20:21:59.640162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1322889478", "imageRef": "92cf78de-f9d2-47dd-80d4-a0333b53cf3d", "flavorRef": "452", "networks": [{"uuid": "8dd04748-e18a-4968-8aa4-c87b9f3665a7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:21:59.745916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] validate_networks() for [('8dd04748-e18a-4968-8aa4-c87b9f3665a7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:22:00.591016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:22:00.592850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:22:00.593811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:22:00.594383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:22:00.594953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:22:00.605702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:00.606354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:00.607328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:00.607942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:00.630753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:22:00.638083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:22:00.655237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:22:00.660558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='340d2648-d565-4824-9c76-46f6071607e5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:22:00.780858 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f110a5ed-2d3c-45d6-95d9-af021187fc7c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144388 Jul 26 20:22:00.783139 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3120/6159] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:21:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:22:00.803557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d3d0ed59-f502-451d-83e4-806b41067fa2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:00.811920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d3d0ed59-f502-451d-83e4-806b41067fa2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:01.431929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d3d0ed59-f502-451d-83e4-806b41067fa2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:01.442818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d3d0ed59-f502-451d-83e4-806b41067fa2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1230 microversion: 2.1 time: 0.648286 Jul 26 20:22:01.445209 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3040/6160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:00 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1230 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:02.473622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22201832-1a92-4c5d-94bf-f93ead9b1056 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:02.474415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-22201832-1a92-4c5d-94bf-f93ead9b1056 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:02.504349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22201832-1a92-4c5d-94bf-f93ead9b1056 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:02.504910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22201832-1a92-4c5d-94bf-f93ead9b1056 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:02.505726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22201832-1a92-4c5d-94bf-f93ead9b1056 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:02.506177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22201832-1a92-4c5d-94bf-f93ead9b1056 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:02.692511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22201832-1a92-4c5d-94bf-f93ead9b1056 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:02.706359 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22201832-1a92-4c5d-94bf-f93ead9b1056 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1300 microversion: 2.1 time: 0.246864 Jul 26 20:22:02.707074 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3121/6161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:02 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:03.733914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-165f3486-2e5e-453c-a3da-c15ceb832e0f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:03.734803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-165f3486-2e5e-453c-a3da-c15ceb832e0f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:03.760279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-165f3486-2e5e-453c-a3da-c15ceb832e0f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:03.768095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-165f3486-2e5e-453c-a3da-c15ceb832e0f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:03.769421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-165f3486-2e5e-453c-a3da-c15ceb832e0f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:03.769904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-165f3486-2e5e-453c-a3da-c15ceb832e0f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:04.415697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-165f3486-2e5e-453c-a3da-c15ceb832e0f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:04.422578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:04.438318 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-165f3486-2e5e-453c-a3da-c15ceb832e0f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.709244 Jul 26 20:22:04.442750 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3041/6162] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:03 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:04.858896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-3c2aa32f-a88e-454d-aba4-8bdeb6e0e6b5 req-f9783cb7-4e4e-4216-9719-78fa7bbe2d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "601e4db3-f29a-46f3-a3b0-5c6fe8366eab", "tag": "f07de14c-278f-4d75-baee-2bb634466dda"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:04.897712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3c2aa32f-a88e-454d-aba4-8bdeb6e0e6b5 req-f9783cb7-4e4e-4216-9719-78fa7bbe2d11 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:04.901115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3c2aa32f-a88e-454d-aba4-8bdeb6e0e6b5 req-f9783cb7-4e4e-4216-9719-78fa7bbe2d11 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:04.919455 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3c2aa32f-a88e-454d-aba4-8bdeb6e0e6b5 req-f9783cb7-4e4e-4216-9719-78fa7bbe2d11 service nova] Creating event network-changed:f07de14c-278f-4d75-baee-2bb634466dda for instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab on n-h1-708768-8 Jul 26 20:22:04.928052 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-3c2aa32f-a88e-454d-aba4-8bdeb6e0e6b5 req-f9783cb7-4e4e-4216-9719-78fa7bbe2d11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072160 Jul 26 20:22:04.929936 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3122/6163] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:22:05.464604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dfb93209-d323-45e6-bf73-d2d772bd10c0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:05.465432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dfb93209-d323-45e6-bf73-d2d772bd10c0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:05.488172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfb93209-d323-45e6-bf73-d2d772bd10c0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:05.490691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfb93209-d323-45e6-bf73-d2d772bd10c0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:05.497981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfb93209-d323-45e6-bf73-d2d772bd10c0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:05.499746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dfb93209-d323-45e6-bf73-d2d772bd10c0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:06.413127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dfb93209-d323-45e6-bf73-d2d772bd10c0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:06.428738 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dfb93209-d323-45e6-bf73-d2d772bd10c0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.970042 Jul 26 20:22:06.429345 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3042/6164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:05 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:07.466888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-20d0a22b-dc0b-4c10-b1c7-8ca87a4f92e6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:07.468624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-20d0a22b-dc0b-4c10-b1c7-8ca87a4f92e6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:07.500066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20d0a22b-dc0b-4c10-b1c7-8ca87a4f92e6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:07.519558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20d0a22b-dc0b-4c10-b1c7-8ca87a4f92e6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:07.524257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20d0a22b-dc0b-4c10-b1c7-8ca87a4f92e6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:07.529472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20d0a22b-dc0b-4c10-b1c7-8ca87a4f92e6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:07.988591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-20d0a22b-dc0b-4c10-b1c7-8ca87a4f92e6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:08.002508 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-20d0a22b-dc0b-4c10-b1c7-8ca87a4f92e6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.554411 Jul 26 20:22:08.009423 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3123/6165] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:07 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:09.049490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-81785169-292f-4e27-bc7c-043a7cd73ac1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:09.050374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-81785169-292f-4e27-bc7c-043a7cd73ac1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:09.072878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81785169-292f-4e27-bc7c-043a7cd73ac1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:09.073490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81785169-292f-4e27-bc7c-043a7cd73ac1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:09.082613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81785169-292f-4e27-bc7c-043a7cd73ac1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:09.083719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81785169-292f-4e27-bc7c-043a7cd73ac1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:09.529817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-81785169-292f-4e27-bc7c-043a7cd73ac1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:09.548429 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-81785169-292f-4e27-bc7c-043a7cd73ac1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.512184 Jul 26 20:22:09.549720 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3043/6166] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:09 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:10.573406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b7645cc-0ed4-4071-b125-d7218ee260ad tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:10.574629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1b7645cc-0ed4-4071-b125-d7218ee260ad tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:10.583524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b7645cc-0ed4-4071-b125-d7218ee260ad tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:10.584446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b7645cc-0ed4-4071-b125-d7218ee260ad tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:10.585485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b7645cc-0ed4-4071-b125-d7218ee260ad tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:10.586959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b7645cc-0ed4-4071-b125-d7218ee260ad tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:10.599866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=77 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:10.633950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:10.654559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:11.299932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1b7645cc-0ed4-4071-b125-d7218ee260ad tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:11.326692 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b7645cc-0ed4-4071-b125-d7218ee260ad tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.754649 Jul 26 20:22:11.329615 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3124/6167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:10 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:22:12.354158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0dd22df1-0427-4b5f-a86d-4ce5a0fc1e12 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:12.355560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0dd22df1-0427-4b5f-a86d-4ce5a0fc1e12 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:12.373654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:12.405788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dd22df1-0427-4b5f-a86d-4ce5a0fc1e12 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:12.411011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dd22df1-0427-4b5f-a86d-4ce5a0fc1e12 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:12.419933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dd22df1-0427-4b5f-a86d-4ce5a0fc1e12 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:12.420922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0dd22df1-0427-4b5f-a86d-4ce5a0fc1e12 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:12.526276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-037ce19c-f230-416a-af3f-883a998a7620 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:12.530209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-037ce19c-f230-416a-af3f-883a998a7620 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:12.559076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-037ce19c-f230-416a-af3f-883a998a7620 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:12.559544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-037ce19c-f230-416a-af3f-883a998a7620 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:12.560365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-037ce19c-f230-416a-af3f-883a998a7620 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:12.560805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-037ce19c-f230-416a-af3f-883a998a7620 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:12.700662 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-037ce19c-f230-416a-af3f-883a998a7620 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action" status: 200 len: 63187 microversion: 2.1 time: 0.184500 Jul 26 20:22:12.709136 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3125/6168] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:22:12 2022] POST /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16/action => generated 63187 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:22:13.061171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0dd22df1-0427-4b5f-a86d-4ce5a0fc1e12 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:13.079814 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0dd22df1-0427-4b5f-a86d-4ce5a0fc1e12 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.731505 Jul 26 20:22:13.113351 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3044/6169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:12 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:14.120938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-056867a2-f7df-4528-9990-89c75f51a6d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:14.124988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-056867a2-f7df-4528-9990-89c75f51a6d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:14.160583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-056867a2-f7df-4528-9990-89c75f51a6d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:14.163685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-056867a2-f7df-4528-9990-89c75f51a6d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:14.168075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-056867a2-f7df-4528-9990-89c75f51a6d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:14.169866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-056867a2-f7df-4528-9990-89c75f51a6d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:14.796636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-056867a2-f7df-4528-9990-89c75f51a6d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:14.821050 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-056867a2-f7df-4528-9990-89c75f51a6d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.706435 Jul 26 20:22:14.821977 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3126/6170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:14 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:15.845125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f405cfa6-b982-4068-b22c-80e73ced3825 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:15.846381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f405cfa6-b982-4068-b22c-80e73ced3825 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:15.849689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=30 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:15.862849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f405cfa6-b982-4068-b22c-80e73ced3825 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:15.865728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f405cfa6-b982-4068-b22c-80e73ced3825 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:15.866729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f405cfa6-b982-4068-b22c-80e73ced3825 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:15.867381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f405cfa6-b982-4068-b22c-80e73ced3825 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:16.357873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f405cfa6-b982-4068-b22c-80e73ced3825 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:16.365820 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f405cfa6-b982-4068-b22c-80e73ced3825 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.524548 Jul 26 20:22:16.380035 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3045/6171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:15 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:17.391958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5ea583f-0eb4-45a2-8ed5-63ccc78a3a4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:17.392684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f5ea583f-0eb4-45a2-8ed5-63ccc78a3a4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:17.395622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:17.402878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5ea583f-0eb4-45a2-8ed5-63ccc78a3a4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:17.403260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5ea583f-0eb4-45a2-8ed5-63ccc78a3a4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:17.404286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5ea583f-0eb4-45a2-8ed5-63ccc78a3a4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:17.404905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5ea583f-0eb4-45a2-8ed5-63ccc78a3a4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:17.690873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f5ea583f-0eb4-45a2-8ed5-63ccc78a3a4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:17.699243 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5ea583f-0eb4-45a2-8ed5-63ccc78a3a4a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.311332 Jul 26 20:22:17.700449 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3127/6172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:17 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:18.724678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-039540d1-6b69-4f7c-807d-429aeaf17a91 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:18.726630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-039540d1-6b69-4f7c-807d-429aeaf17a91 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:18.747170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-039540d1-6b69-4f7c-807d-429aeaf17a91 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:18.748211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-039540d1-6b69-4f7c-807d-429aeaf17a91 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:18.751457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-039540d1-6b69-4f7c-807d-429aeaf17a91 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:18.753375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-039540d1-6b69-4f7c-807d-429aeaf17a91 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:19.041947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0fab761b-87c2-453c-8f71-cc516874eebe tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:19.043322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0fab761b-87c2-453c-8f71-cc516874eebe tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:19.064761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fab761b-87c2-453c-8f71-cc516874eebe tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:19.066818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fab761b-87c2-453c-8f71-cc516874eebe tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:19.071654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fab761b-87c2-453c-8f71-cc516874eebe tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:19.074590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fab761b-87c2-453c-8f71-cc516874eebe tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:19.079055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-039540d1-6b69-4f7c-807d-429aeaf17a91 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:19.092329 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-039540d1-6b69-4f7c-807d-429aeaf17a91 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.374027 Jul 26 20:22:19.106703 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3046/6173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:18 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:19.530781 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0fab761b-87c2-453c-8f71-cc516874eebe tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1832 microversion: 2.1 time: 0.497586 Jul 26 20:22:19.535873 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3128/6174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:19 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1832 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:20.114308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fcda67b2-b33b-4519-abb0-8080773fea86 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:20.116773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fcda67b2-b33b-4519-abb0-8080773fea86 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:20.140361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcda67b2-b33b-4519-abb0-8080773fea86 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:20.140828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcda67b2-b33b-4519-abb0-8080773fea86 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:20.141638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcda67b2-b33b-4519-abb0-8080773fea86 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:20.142088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fcda67b2-b33b-4519-abb0-8080773fea86 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:20.582862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fcda67b2-b33b-4519-abb0-8080773fea86 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:20.603682 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fcda67b2-b33b-4519-abb0-8080773fea86 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.484819 Jul 26 20:22:20.613399 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3047/6175] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:20 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:21.627921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-789052c1-9fc5-4d69-82e4-b4bdc6926c0c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:21.629653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-789052c1-9fc5-4d69-82e4-b4bdc6926c0c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:21.651241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-789052c1-9fc5-4d69-82e4-b4bdc6926c0c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:21.652259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-789052c1-9fc5-4d69-82e4-b4bdc6926c0c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:21.654917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-789052c1-9fc5-4d69-82e4-b4bdc6926c0c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:21.664048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-789052c1-9fc5-4d69-82e4-b4bdc6926c0c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:21.964536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-789052c1-9fc5-4d69-82e4-b4bdc6926c0c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:21.975919 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-789052c1-9fc5-4d69-82e4-b4bdc6926c0c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.352766 Jul 26 20:22:21.976895 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3129/6176] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:21 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:22.221297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-30788f1c-2e66-4cd2-bae7-becb9f1f50a7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:22.222549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30788f1c-2e66-4cd2-bae7-becb9f1f50a7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:22.253112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1f8078c8-675d-4162-b758-8f5e7b92d51c req-31a24c8f-7661-4efa-914f-db5e2bd0fd08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:22.276493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30788f1c-2e66-4cd2-bae7-becb9f1f50a7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:22.277879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30788f1c-2e66-4cd2-bae7-becb9f1f50a7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:22.281166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30788f1c-2e66-4cd2-bae7-becb9f1f50a7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:22.285538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-30788f1c-2e66-4cd2-bae7-becb9f1f50a7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:22.288376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1f8078c8-675d-4162-b758-8f5e7b92d51c req-31a24c8f-7661-4efa-914f-db5e2bd0fd08 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:22.289159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1f8078c8-675d-4162-b758-8f5e7b92d51c req-31a24c8f-7661-4efa-914f-db5e2bd0fd08 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:22.324334 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1f8078c8-675d-4162-b758-8f5e7b92d51c req-31a24c8f-7661-4efa-914f-db5e2bd0fd08 service nova] Creating event network-changed:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h2-708768-8 Jul 26 20:22:22.340731 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1f8078c8-675d-4162-b758-8f5e7b92d51c req-31a24c8f-7661-4efa-914f-db5e2bd0fd08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096345 Jul 26 20:22:22.341535 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3130/6177] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:22:22.346273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-30788f1c-2e66-4cd2-bae7-becb9f1f50a7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:22:22.521617 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-30788f1c-2e66-4cd2-bae7-becb9f1f50a7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 204 len: 0 microversion: 2.1 time: 0.305481 Jul 26 20:22:22.522324 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3048/6178] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:22:22 2022] DELETE /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:22:22.534038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f3e57ad-c259-484c-b390-5b32b1b50d05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:22.535193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4f3e57ad-c259-484c-b390-5b32b1b50d05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:22.544068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f3e57ad-c259-484c-b390-5b32b1b50d05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:22.544866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f3e57ad-c259-484c-b390-5b32b1b50d05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:22.545965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f3e57ad-c259-484c-b390-5b32b1b50d05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:22.546730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f3e57ad-c259-484c-b390-5b32b1b50d05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:22.859652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4f3e57ad-c259-484c-b390-5b32b1b50d05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:22.866693 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f3e57ad-c259-484c-b390-5b32b1b50d05 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1687 microversion: 2.1 time: 0.338577 Jul 26 20:22:22.872908 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3131/6179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:22 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1687 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:23.002939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-516f5cc7-5896-43f4-9eb8-04fbcacd13be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:23.003845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-516f5cc7-5896-43f4-9eb8-04fbcacd13be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:23.019353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-516f5cc7-5896-43f4-9eb8-04fbcacd13be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:23.019923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-516f5cc7-5896-43f4-9eb8-04fbcacd13be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:23.020791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-516f5cc7-5896-43f4-9eb8-04fbcacd13be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:23.021601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-516f5cc7-5896-43f4-9eb8-04fbcacd13be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:23.559224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-516f5cc7-5896-43f4-9eb8-04fbcacd13be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:23.572286 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-516f5cc7-5896-43f4-9eb8-04fbcacd13be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 0.573089 Jul 26 20:22:23.573467 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3049/6180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:22 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:23.897724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8395a67f-fb08-4edb-a128-1681eac8fa5b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:23.901345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8395a67f-fb08-4edb-a128-1681eac8fa5b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:23.923359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8395a67f-fb08-4edb-a128-1681eac8fa5b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:23.923910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8395a67f-fb08-4edb-a128-1681eac8fa5b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:23.925690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8395a67f-fb08-4edb-a128-1681eac8fa5b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:23.927130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8395a67f-fb08-4edb-a128-1681eac8fa5b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:24.604631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2c8b4fe-cb6c-41bb-92f6-b77ebd5d91f7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:24.605556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d2c8b4fe-cb6c-41bb-92f6-b77ebd5d91f7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:24.622971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2c8b4fe-cb6c-41bb-92f6-b77ebd5d91f7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:24.628234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2c8b4fe-cb6c-41bb-92f6-b77ebd5d91f7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:24.631988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2c8b4fe-cb6c-41bb-92f6-b77ebd5d91f7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:24.634992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d2c8b4fe-cb6c-41bb-92f6-b77ebd5d91f7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:25.192121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8395a67f-fb08-4edb-a128-1681eac8fa5b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:25.205449 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8395a67f-fb08-4edb-a128-1681eac8fa5b tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1687 microversion: 2.1 time: 1.312274 Jul 26 20:22:25.214871 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3132/6181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:23 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1687 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:25.816976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d2c8b4fe-cb6c-41bb-92f6-b77ebd5d91f7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:25.830340 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2c8b4fe-cb6c-41bb-92f6-b77ebd5d91f7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1342 microversion: 2.1 time: 1.231287 Jul 26 20:22:25.832775 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3050/6182] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:24 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1342 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:25.856937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-35faeb1f-2d38-4b4d-9dd2-0032a483d083 req-98fd8e5d-3ba4-43ac-991c-4d89253d08fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d7fb2a-57e5-48b1-be6b-9016134dbe16", "name": "network-vif-deleted", "tag": "59f047f3-4c2e-42e2-a4d7-5c99d860dd3b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:25.888553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-35faeb1f-2d38-4b4d-9dd2-0032a483d083 req-98fd8e5d-3ba4-43ac-991c-4d89253d08fb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:25.889125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-35faeb1f-2d38-4b4d-9dd2-0032a483d083 req-98fd8e5d-3ba4-43ac-991c-4d89253d08fb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:25.925086 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-35faeb1f-2d38-4b4d-9dd2-0032a483d083 req-98fd8e5d-3ba4-43ac-991c-4d89253d08fb service nova] Creating event network-vif-deleted:59f047f3-4c2e-42e2-a4d7-5c99d860dd3b for instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 on n-h2-708768-8 Jul 26 20:22:25.931746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-35faeb1f-2d38-4b4d-9dd2-0032a483d083 req-98fd8e5d-3ba4-43ac-991c-4d89253d08fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080510 Jul 26 20:22:25.932542 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3133/6183] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:22:26.235420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:26.236729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:26.258143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:26.260236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:26.261325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:26.263471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:26.368051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:26.370620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:26.371297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lazy-loading 'fault' on Instance uuid 69d7fb2a-57e5-48b1-be6b-9016134dbe16 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:22:26.564926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:26.584258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-53366a51-cfbe-4bce-8d9a-a1f2d872bd46 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 200 len: 1355 microversion: 2.1 time: 0.350085 Jul 26 20:22:26.585171 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3051/6184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:26 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 1355 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:26.860884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e90fb211-1508-4962-a1a9-ca1f9a53a90e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:26.861671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e90fb211-1508-4962-a1a9-ca1f9a53a90e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:26.870267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e90fb211-1508-4962-a1a9-ca1f9a53a90e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:26.870977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e90fb211-1508-4962-a1a9-ca1f9a53a90e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:26.872154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e90fb211-1508-4962-a1a9-ca1f9a53a90e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:26.872826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e90fb211-1508-4962-a1a9-ca1f9a53a90e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:27.227081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e90fb211-1508-4962-a1a9-ca1f9a53a90e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:27.263400 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e90fb211-1508-4962-a1a9-ca1f9a53a90e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1388 microversion: 2.1 time: 0.405601 Jul 26 20:22:27.265377 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3134/6185] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:26 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1388 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:27.606737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:27.607440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 69d7fb2a-57e5-48b1-be6b-9016134dbe16] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:27.614982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:27.615433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:27.617292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:27.618035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:27.643177 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] HTTP exception thrown: Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 could not be found. Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Request method failure captured: Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 HTTP/1.1 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ev0ii1kBGUjwonVMhglrcrFlU3ywjFoPd0j4-8Ft4EZjC2YdZCk_P7SzH0uKeOzNjC55zbxY6dmJY6OfLxELdx2TCM7IDW_K3LF0CPkmaPQwEIV-GCQklx3o29ilUs5O3xJoo-sekz8seqkI-Y14MIT1Hi5pSkJ3GaJ0NLv_CA6DXk Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: c6c35edbc1a1413c90d22de414aa71e6 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6c35edbc1a1413c90d22de414aa71e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6c35edbc1a1413c90d22de414aa71e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6c35edbc1a1413c90d22de414aa71e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6c35edbc1a1413c90d22de414aa71e6"}]}] Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: c6c35edbc1a1413c90d22de414aa71e6 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestNetworkAdvancedServerOps-357288115-project Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 65245c71525848afaf82742412b31a8a Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestNetworkAdvancedServerOps-357288115-project Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 could not be found. Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '69d7fb2a-57e5-48b1-be6b-9016134dbe16'} Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 could not be found. Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 could not be found. Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:22:27.645988 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:22:27.651246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:22:27.651246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:22:27.651246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:22:27.651246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:22:27.651246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:22:27.651246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 could not be found. Jul 26 20:22:27.651246 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:22:27.653240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Returning 404 to user: Instance 69d7fb2a-57e5-48b1-be6b-9016134dbe16 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:22:27.654361 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-36957488-ba82-4085-99f4-330ef1867402 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16" status: 404 len: 111 microversion: 2.1 time: 0.051763 Jul 26 20:22:27.659214 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3052/6186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:27 2022] GET /compute/v2.1/servers/69d7fb2a-57e5-48b1-be6b-9016134dbe16 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:22:28.297005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-69f69f1c-cb11-43b4-91ac-23b489b76fca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:28.297699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-69f69f1c-cb11-43b4-91ac-23b489b76fca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:28.312195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69f69f1c-cb11-43b4-91ac-23b489b76fca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:28.313067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69f69f1c-cb11-43b4-91ac-23b489b76fca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:28.314176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69f69f1c-cb11-43b4-91ac-23b489b76fca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:28.314920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69f69f1c-cb11-43b4-91ac-23b489b76fca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:28.546728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-69f69f1c-cb11-43b4-91ac-23b489b76fca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:28.557512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-69f69f1c-cb11-43b4-91ac-23b489b76fca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1376 microversion: 2.1 time: 0.270988 Jul 26 20:22:28.558272 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3135/6187] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:28 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1376 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:29.580995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bcae7bfd-86a8-4359-9ab4-e2c9597ded60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:29.582149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bcae7bfd-86a8-4359-9ab4-e2c9597ded60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:29.590515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bcae7bfd-86a8-4359-9ab4-e2c9597ded60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:29.591031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bcae7bfd-86a8-4359-9ab4-e2c9597ded60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:29.591881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bcae7bfd-86a8-4359-9ab4-e2c9597ded60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:29.592519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bcae7bfd-86a8-4359-9ab4-e2c9597ded60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:30.044090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bcae7bfd-86a8-4359-9ab4-e2c9597ded60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:30.051992 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bcae7bfd-86a8-4359-9ab4-e2c9597ded60 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1376 microversion: 2.1 time: 0.475510 Jul 26 20:22:30.053058 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3053/6188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:29 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1376 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:31.080638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba0363ca-1164-45a3-93c3-d5902aff34aa tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:31.082336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba0363ca-1164-45a3-93c3-d5902aff34aa tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:31.090274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba0363ca-1164-45a3-93c3-d5902aff34aa tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:31.090807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba0363ca-1164-45a3-93c3-d5902aff34aa tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:31.091763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba0363ca-1164-45a3-93c3-d5902aff34aa tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:31.092432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba0363ca-1164-45a3-93c3-d5902aff34aa tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:31.233452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ba0363ca-1164-45a3-93c3-d5902aff34aa tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:31.241298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba0363ca-1164-45a3-93c3-d5902aff34aa tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1376 microversion: 2.1 time: 0.164875 Jul 26 20:22:31.241893 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3136/6189] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:31 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:32.264547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a26980c3-a75c-4206-841d-9bc5811e807a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:32.266096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a26980c3-a75c-4206-841d-9bc5811e807a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:32.281311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26980c3-a75c-4206-841d-9bc5811e807a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:32.281885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26980c3-a75c-4206-841d-9bc5811e807a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:32.284057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26980c3-a75c-4206-841d-9bc5811e807a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:32.284522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a26980c3-a75c-4206-841d-9bc5811e807a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:32.568572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a26980c3-a75c-4206-841d-9bc5811e807a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:32.579945 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a26980c3-a75c-4206-841d-9bc5811e807a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1376 microversion: 2.1 time: 0.320770 Jul 26 20:22:32.580869 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3054/6190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:32 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1376 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:33.603377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-70909731-0ed9-4ef7-816d-a4f1f8991ef9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:33.604075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-70909731-0ed9-4ef7-816d-a4f1f8991ef9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:33.616335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70909731-0ed9-4ef7-816d-a4f1f8991ef9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:33.617171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70909731-0ed9-4ef7-816d-a4f1f8991ef9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:33.618420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70909731-0ed9-4ef7-816d-a4f1f8991ef9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:33.619673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-70909731-0ed9-4ef7-816d-a4f1f8991ef9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:33.798809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-70909731-0ed9-4ef7-816d-a4f1f8991ef9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:33.817283 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-70909731-0ed9-4ef7-816d-a4f1f8991ef9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1376 microversion: 2.1 time: 0.216646 Jul 26 20:22:33.818250 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3137/6191] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:33 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1376 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:34.155517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe26735a-0055-4e02-ad4a-ebd462acaf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '.version_select at 0x7f875da0edc0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:34.201868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe26735a-0055-4e02-ad4a-ebd462acaf40 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-828840122" status: 202 len: 0 microversion: 2.1 time: 0.051944 Jul 26 20:22:34.216259 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3055/6192] 10.222.0.58 () {58 vars in 1281 bytes} [Tue Jul 26 20:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-828840122 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:22:34.247131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-72a45144-bfd9-4297-baa2-255a1c6eaba7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'create', calling method: .version_select at 0x7f8756ddc8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1452605321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbhWr4f3sbo4L4R7fs5MceBruGPM/dk/AEQSZRUw7U3dHX78gzT4Im2oUZ0a1nolmpwe/jLbD25Pqw3ciHH691a28s5DKw7byEKoojfJ8BfzaT+yvwFymdUWENplAF3XA=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:34.273701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-72a45144-bfd9-4297-baa2-255a1c6eaba7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:22:34.286257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-72a45144-bfd9-4297-baa2-255a1c6eaba7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for user 65245c71525848afaf82742412b31a8a and project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:22:34.320510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-72a45144-bfd9-4297-baa2-255a1c6eaba7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.079045 Jul 26 20:22:34.323663 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3138/6193] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:22:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:22:34.839810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe8add7a-ea8b-49a6-9e55-3afbac2becc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:34.840579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe8add7a-ea8b-49a6-9e55-3afbac2becc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:34.854485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe8add7a-ea8b-49a6-9e55-3afbac2becc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:34.854485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe8add7a-ea8b-49a6-9e55-3afbac2becc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:34.855962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe8add7a-ea8b-49a6-9e55-3afbac2becc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:34.856438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe8add7a-ea8b-49a6-9e55-3afbac2becc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:35.355392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fe8add7a-ea8b-49a6-9e55-3afbac2becc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:35.364380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe8add7a-ea8b-49a6-9e55-3afbac2becc4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1376 microversion: 2.1 time: 0.529102 Jul 26 20:22:35.369508 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3056/6194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:34 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1376 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:36.387471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9b16b358-3cac-468b-b807-18c62735b11f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:36.388307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9b16b358-3cac-468b-b807-18c62735b11f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:36.420421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b16b358-3cac-468b-b807-18c62735b11f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:36.421106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b16b358-3cac-468b-b807-18c62735b11f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:36.424776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b16b358-3cac-468b-b807-18c62735b11f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:36.425680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b16b358-3cac-468b-b807-18c62735b11f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:36.777742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9b16b358-3cac-468b-b807-18c62735b11f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:36.794379 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9b16b358-3cac-468b-b807-18c62735b11f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1376 microversion: 2.1 time: 0.411879 Jul 26 20:22:36.806743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3139/6195] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:36 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1376 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:36.902487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-cd717017-6220-4470-bee9-8760ff7d955a req-8a4becb2-da07-4d1b-ae4c-eb154dc20f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "601e4db3-f29a-46f3-a3b0-5c6fe8366eab", "name": "network-vif-plugged", "status": "completed", "tag": "f07de14c-278f-4d75-baee-2bb634466dda"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:36.922889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cd717017-6220-4470-bee9-8760ff7d955a req-8a4becb2-da07-4d1b-ae4c-eb154dc20f36 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:36.923782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-cd717017-6220-4470-bee9-8760ff7d955a req-8a4becb2-da07-4d1b-ae4c-eb154dc20f36 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:36.931041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:36.956838 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-cd717017-6220-4470-bee9-8760ff7d955a req-8a4becb2-da07-4d1b-ae4c-eb154dc20f36 service nova] Creating event network-vif-plugged:f07de14c-278f-4d75-baee-2bb634466dda for instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab on n-h1-708768-8 Jul 26 20:22:36.963990 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-cd717017-6220-4470-bee9-8760ff7d955a req-8a4becb2-da07-4d1b-ae4c-eb154dc20f36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067534 Jul 26 20:22:36.964921 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3057/6196] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:22:37.820625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5486630-95c3-4ce7-be40-c72b81f2d2b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:37.821970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5486630-95c3-4ce7-be40-c72b81f2d2b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:37.834096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5486630-95c3-4ce7-be40-c72b81f2d2b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:37.834810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5486630-95c3-4ce7-be40-c72b81f2d2b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:37.836574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5486630-95c3-4ce7-be40-c72b81f2d2b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:37.837195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5486630-95c3-4ce7-be40-c72b81f2d2b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:38.103707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5486630-95c3-4ce7-be40-c72b81f2d2b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:38.115420 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5486630-95c3-4ce7-be40-c72b81f2d2b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1376 microversion: 2.1 time: 0.300367 Jul 26 20:22:38.116277 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3140/6197] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:37 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1376 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:39.139457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d157ccf5-8c37-4954-b65e-a9bce5212199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:39.140866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d157ccf5-8c37-4954-b65e-a9bce5212199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:39.150278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d157ccf5-8c37-4954-b65e-a9bce5212199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:39.150786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d157ccf5-8c37-4954-b65e-a9bce5212199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:39.151642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d157ccf5-8c37-4954-b65e-a9bce5212199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:39.152126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d157ccf5-8c37-4954-b65e-a9bce5212199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:39.413942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d157ccf5-8c37-4954-b65e-a9bce5212199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:39.427016 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d157ccf5-8c37-4954-b65e-a9bce5212199 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1563 microversion: 2.1 time: 0.292212 Jul 26 20:22:39.428262 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3058/6198] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:39 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1563 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:39.450978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-abce7d10-a8a0-47af-80af-190b28a28ae5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:39.451587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-abce7d10-a8a0-47af-80af-190b28a28ae5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:39.458879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abce7d10-a8a0-47af-80af-190b28a28ae5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:39.459641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abce7d10-a8a0-47af-80af-190b28a28ae5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:39.460606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abce7d10-a8a0-47af-80af-190b28a28ae5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:39.461044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abce7d10-a8a0-47af-80af-190b28a28ae5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:39.757936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-abce7d10-a8a0-47af-80af-190b28a28ae5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:39.770539 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-abce7d10-a8a0-47af-80af-190b28a28ae5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1563 microversion: 2.1 time: 0.323550 Jul 26 20:22:39.771738 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3141/6199] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:39 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1563 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:22:39.881251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1cb8674d-0e6f-4dd1-913f-7e5296126e9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:39.881789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1cb8674d-0e6f-4dd1-913f-7e5296126e9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:39.893949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cb8674d-0e6f-4dd1-913f-7e5296126e9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:39.896537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cb8674d-0e6f-4dd1-913f-7e5296126e9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:39.898756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cb8674d-0e6f-4dd1-913f-7e5296126e9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:39.901095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cb8674d-0e6f-4dd1-913f-7e5296126e9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:39.961819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1cb8674d-0e6f-4dd1-913f-7e5296126e9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:22:40.115017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1cb8674d-0e6f-4dd1-913f-7e5296126e9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 204 len: 0 microversion: 2.1 time: 0.238239 Jul 26 20:22:40.116098 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3059/6200] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:22:39 2022] DELETE /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:22:40.126615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9077ec2d-64d6-4c92-8456-a7fd251759be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:40.127338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9077ec2d-64d6-4c92-8456-a7fd251759be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:40.144735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9077ec2d-64d6-4c92-8456-a7fd251759be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:40.145187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9077ec2d-64d6-4c92-8456-a7fd251759be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:40.150874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9077ec2d-64d6-4c92-8456-a7fd251759be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:40.151456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9077ec2d-64d6-4c92-8456-a7fd251759be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:40.759775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9077ec2d-64d6-4c92-8456-a7fd251759be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:40.765775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:40.775302 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9077ec2d-64d6-4c92-8456-a7fd251759be tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1569 microversion: 2.1 time: 0.653808 Jul 26 20:22:40.777037 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3142/6201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:40 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1569 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:22:41.799359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11cf8fad-6a7f-47c8-9e00-53f23a1c3a9e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:41.800232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11cf8fad-6a7f-47c8-9e00-53f23a1c3a9e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:41.809487 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11cf8fad-6a7f-47c8-9e00-53f23a1c3a9e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:41.819055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11cf8fad-6a7f-47c8-9e00-53f23a1c3a9e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:41.820859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11cf8fad-6a7f-47c8-9e00-53f23a1c3a9e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:41.822544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11cf8fad-6a7f-47c8-9e00-53f23a1c3a9e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:42.074765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-11cf8fad-6a7f-47c8-9e00-53f23a1c3a9e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:42.086051 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11cf8fad-6a7f-47c8-9e00-53f23a1c3a9e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1569 microversion: 2.1 time: 0.291165 Jul 26 20:22:42.087281 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3060/6202] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:41 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1569 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:43.067994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c2096047-cb05-40a6-8b7d-1c49531c2a5d req-8599eb81-baf9-43b6-a6d6-87e42d51d39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "601e4db3-f29a-46f3-a3b0-5c6fe8366eab", "name": "network-vif-deleted", "tag": "f07de14c-278f-4d75-baee-2bb634466dda"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:43.115686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5dda531b-c732-4a8a-abe0-74588eb309dc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:43.117461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5dda531b-c732-4a8a-abe0-74588eb309dc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:43.135101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c2096047-cb05-40a6-8b7d-1c49531c2a5d req-8599eb81-baf9-43b6-a6d6-87e42d51d39d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:43.135724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c2096047-cb05-40a6-8b7d-1c49531c2a5d req-8599eb81-baf9-43b6-a6d6-87e42d51d39d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:43.147445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dda531b-c732-4a8a-abe0-74588eb309dc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:43.148358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dda531b-c732-4a8a-abe0-74588eb309dc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:43.154654 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c2096047-cb05-40a6-8b7d-1c49531c2a5d req-8599eb81-baf9-43b6-a6d6-87e42d51d39d service nova] Creating event network-vif-deleted:f07de14c-278f-4d75-baee-2bb634466dda for instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab on n-h1-708768-8 Jul 26 20:22:43.161256 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c2096047-cb05-40a6-8b7d-1c49531c2a5d req-8599eb81-baf9-43b6-a6d6-87e42d51d39d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097521 Jul 26 20:22:43.163646 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3143/6203] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:22:43.176611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dda531b-c732-4a8a-abe0-74588eb309dc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:43.177085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dda531b-c732-4a8a-abe0-74588eb309dc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:43.346434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5dda531b-c732-4a8a-abe0-74588eb309dc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:43.358303 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5dda531b-c732-4a8a-abe0-74588eb309dc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1361 microversion: 2.1 time: 0.249011 Jul 26 20:22:43.364820 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3061/6204] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:43 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:44.388139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef85723e-a0fe-4965-be0a-910ba7e502e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:44.389665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef85723e-a0fe-4965-be0a-910ba7e502e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:44.394193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:44.410577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef85723e-a0fe-4965-be0a-910ba7e502e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:44.412029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef85723e-a0fe-4965-be0a-910ba7e502e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:44.413268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef85723e-a0fe-4965-be0a-910ba7e502e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:44.414260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef85723e-a0fe-4965-be0a-910ba7e502e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:44.541935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ef85723e-a0fe-4965-be0a-910ba7e502e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:44.553036 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef85723e-a0fe-4965-be0a-910ba7e502e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1361 microversion: 2.1 time: 0.171071 Jul 26 20:22:44.568051 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3144/6205] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:44 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:45.579544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-13e28a4e-0987-4919-9d5a-763372737363 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:45.581249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-13e28a4e-0987-4919-9d5a-763372737363 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:45.598916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13e28a4e-0987-4919-9d5a-763372737363 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:45.599396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13e28a4e-0987-4919-9d5a-763372737363 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:45.600250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13e28a4e-0987-4919-9d5a-763372737363 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:45.600700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-13e28a4e-0987-4919-9d5a-763372737363 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:45.719312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-13e28a4e-0987-4919-9d5a-763372737363 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:45.728351 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-13e28a4e-0987-4919-9d5a-763372737363 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1361 microversion: 2.1 time: 0.153378 Jul 26 20:22:45.733478 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3062/6206] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:45 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:46.211099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-48065005", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "75215bcc-1b73-4043-aa7c-8fe12361396e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1452605321", "security_groups": [{"name": "tempest-secgroup-smoke-1384035981"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:46.348761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] validate_networks() for [('75215bcc-1b73-4043-aa7c-8fe12361396e', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:22:46.754391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1060f095-db74-4953-a481-5e21bef93383 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:46.755639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1060f095-db74-4953-a481-5e21bef93383 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:46.759861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:46.771022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1060f095-db74-4953-a481-5e21bef93383 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:46.771491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1060f095-db74-4953-a481-5e21bef93383 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:46.772316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1060f095-db74-4953-a481-5e21bef93383 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:46.778012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1060f095-db74-4953-a481-5e21bef93383 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:46.921772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1060f095-db74-4953-a481-5e21bef93383 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:46.932162 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1060f095-db74-4953-a481-5e21bef93383 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1361 microversion: 2.1 time: 0.180542 Jul 26 20:22:46.936880 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3063/6207] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:46 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:22:47.128665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:22:47.129087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:22:47.129561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:22:47.129973 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:22:47.130387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:22:47.140620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:47.141077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:47.142014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:47.150887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:47.182431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:22:47.199654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for user 65245c71525848afaf82742412b31a8a and project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:22:47.222984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:22:47.226169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:22:47.300667 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0cb052f0-4d27-44cf-a2c2-4eb7e5b3d001 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.093456 Jul 26 20:22:47.303835 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3145/6208] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:22:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:22:47.315436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cee512dd-eee6-477b-b157-575880cfdf95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:47.320589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cee512dd-eee6-477b-b157-575880cfdf95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:47.436259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cee512dd-eee6-477b-b157-575880cfdf95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:47.448222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cee512dd-eee6-477b-b157-575880cfdf95 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1265 microversion: 2.1 time: 0.136999 Jul 26 20:22:47.450038 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3064/6209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:47 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:47.961888 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-141e39f2-52a4-40cc-b817-a6ad298e9c94 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:47.963186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-141e39f2-52a4-40cc-b817-a6ad298e9c94 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:47.973492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:47.980821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-141e39f2-52a4-40cc-b817-a6ad298e9c94 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:47.981703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-141e39f2-52a4-40cc-b817-a6ad298e9c94 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:47.985345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-141e39f2-52a4-40cc-b817-a6ad298e9c94 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:47.988119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-141e39f2-52a4-40cc-b817-a6ad298e9c94 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:48.197894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-141e39f2-52a4-40cc-b817-a6ad298e9c94 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:48.222044 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-141e39f2-52a4-40cc-b817-a6ad298e9c94 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1361 microversion: 2.1 time: 0.264726 Jul 26 20:22:48.240110 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3146/6210] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:47 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:48.470349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d7c81d5-8aeb-4339-a48a-04475e8fa107 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:48.470972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d7c81d5-8aeb-4339-a48a-04475e8fa107 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:48.495813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d7c81d5-8aeb-4339-a48a-04475e8fa107 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:48.496273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d7c81d5-8aeb-4339-a48a-04475e8fa107 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:48.497072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d7c81d5-8aeb-4339-a48a-04475e8fa107 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:48.497517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d7c81d5-8aeb-4339-a48a-04475e8fa107 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:48.626246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4d7c81d5-8aeb-4339-a48a-04475e8fa107 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:48.646267 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d7c81d5-8aeb-4339-a48a-04475e8fa107 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1261 microversion: 2.1 time: 0.179981 Jul 26 20:22:48.647395 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3065/6211] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:48 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:49.248411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cee149d0-3fa9-4eef-9ae2-fd88b1088b37 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:49.250111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cee149d0-3fa9-4eef-9ae2-fd88b1088b37 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:49.265780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cee149d0-3fa9-4eef-9ae2-fd88b1088b37 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:49.267789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cee149d0-3fa9-4eef-9ae2-fd88b1088b37 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:49.270918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cee149d0-3fa9-4eef-9ae2-fd88b1088b37 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:49.271717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cee149d0-3fa9-4eef-9ae2-fd88b1088b37 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:49.373240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cee149d0-3fa9-4eef-9ae2-fd88b1088b37 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:49.384250 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cee149d0-3fa9-4eef-9ae2-fd88b1088b37 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1361 microversion: 2.1 time: 0.138501 Jul 26 20:22:49.384869 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3147/6212] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:49 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1361 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:49.670321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1b4c48ab-2946-4ffe-a745-ffb456881603 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:49.671883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1b4c48ab-2946-4ffe-a745-ffb456881603 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:49.698007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b4c48ab-2946-4ffe-a745-ffb456881603 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:49.698482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b4c48ab-2946-4ffe-a745-ffb456881603 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:49.699296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b4c48ab-2946-4ffe-a745-ffb456881603 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:49.699775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1b4c48ab-2946-4ffe-a745-ffb456881603 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:49.809732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1b4c48ab-2946-4ffe-a745-ffb456881603 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:49.822697 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1b4c48ab-2946-4ffe-a745-ffb456881603 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1323 microversion: 2.1 time: 0.157644 Jul 26 20:22:49.824831 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3066/6213] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:49 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:50.414187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:50.415706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:50.435118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:50.438410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:50.441822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:50.442627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:50.583042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:50.583543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:50.587131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lazy-loading 'fault' on Instance uuid 601e4db3-f29a-46f3-a3b0-5c6fe8366eab {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:22:50.810780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:50.833375 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ab0f6275-e358-432d-90e4-32276727b668 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 200 len: 1320 microversion: 2.1 time: 0.425971 Jul 26 20:22:50.852614 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3148/6214] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:50 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:50.857157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c33d8118-a917-4b5f-8156-f5d57f5e08da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:50.857886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c33d8118-a917-4b5f-8156-f5d57f5e08da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:50.867937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c33d8118-a917-4b5f-8156-f5d57f5e08da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:50.868831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c33d8118-a917-4b5f-8156-f5d57f5e08da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:50.869773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c33d8118-a917-4b5f-8156-f5d57f5e08da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:50.876316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c33d8118-a917-4b5f-8156-f5d57f5e08da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:51.303135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c33d8118-a917-4b5f-8156-f5d57f5e08da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:51.327703 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c33d8118-a917-4b5f-8156-f5d57f5e08da tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1391 microversion: 2.1 time: 0.481854 Jul 26 20:22:51.340662 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3067/6215] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:50 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1391 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:51.866248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:51.868220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:51.885648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:51.886144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:51.887034 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:51.887546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:51.917403 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab HTTP/1.1 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '601e4db3-f29a-46f3-a3b0-5c6fe8366eab'} Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:22:51.919408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:22:51.924091 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:22:51.924091 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:22:51.924091 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:22:51.924091 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:22:51.924091 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:22:51.924091 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:22:51.924091 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:22:51.926682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:22:51.927860 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2da89f7c-3a1a-46ba-be5f-0a19067e2ccd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 404 len: 111 microversion: 2.1 time: 0.065656 Jul 26 20:22:51.931518 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3149/6216] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:51 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:22:52.030026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c90b5c54-6a98-4d39-a3e6-2d6388393658 req-7504cae7-92bf-4643-8d20-1d01b2c7379d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca8ed32-5be3-44c5-8d0c-13900e5afe97", "tag": "b7f3c859-eb49-45fd-af6c-a6f730444ba9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:52.059016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c90b5c54-6a98-4d39-a3e6-2d6388393658 req-7504cae7-92bf-4643-8d20-1d01b2c7379d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:52.059860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c90b5c54-6a98-4d39-a3e6-2d6388393658 req-7504cae7-92bf-4643-8d20-1d01b2c7379d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:52.073471 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c90b5c54-6a98-4d39-a3e6-2d6388393658 req-7504cae7-92bf-4643-8d20-1d01b2c7379d service nova] Creating event network-changed:b7f3c859-eb49-45fd-af6c-a6f730444ba9 for instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 on n-h2-708768-8 Jul 26 20:22:52.093589 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c90b5c54-6a98-4d39-a3e6-2d6388393658 req-7504cae7-92bf-4643-8d20-1d01b2c7379d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067087 Jul 26 20:22:52.094510 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3068/6217] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:22:52.354513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9f872a3-1266-45aa-ae94-93e2a8cd6521 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:52.355144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9f872a3-1266-45aa-ae94-93e2a8cd6521 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:52.365471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9f872a3-1266-45aa-ae94-93e2a8cd6521 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:52.366199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9f872a3-1266-45aa-ae94-93e2a8cd6521 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:52.367878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9f872a3-1266-45aa-ae94-93e2a8cd6521 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:52.368638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9f872a3-1266-45aa-ae94-93e2a8cd6521 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:52.538519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9f872a3-1266-45aa-ae94-93e2a8cd6521 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:52.546819 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9f872a3-1266-45aa-ae94-93e2a8cd6521 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1391 microversion: 2.1 time: 0.197682 Jul 26 20:22:52.547399 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3150/6218] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:52 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:53.568703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b83e62b9-f1b1-48db-a3c7-7f0b8f9afa3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:53.569873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b83e62b9-f1b1-48db-a3c7-7f0b8f9afa3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:53.592809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b83e62b9-f1b1-48db-a3c7-7f0b8f9afa3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:53.593569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b83e62b9-f1b1-48db-a3c7-7f0b8f9afa3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:53.596173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b83e62b9-f1b1-48db-a3c7-7f0b8f9afa3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:53.596839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b83e62b9-f1b1-48db-a3c7-7f0b8f9afa3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:53.916419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b83e62b9-f1b1-48db-a3c7-7f0b8f9afa3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:53.925031 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b83e62b9-f1b1-48db-a3c7-7f0b8f9afa3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1391 microversion: 2.1 time: 0.360653 Jul 26 20:22:53.928951 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3069/6219] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:53 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:54.950279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6219c45c-4cc6-47c9-a213-2d8017e6c961 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:54.952233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6219c45c-4cc6-47c9-a213-2d8017e6c961 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:54.959543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6219c45c-4cc6-47c9-a213-2d8017e6c961 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:54.960406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6219c45c-4cc6-47c9-a213-2d8017e6c961 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:54.961541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6219c45c-4cc6-47c9-a213-2d8017e6c961 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:54.962687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6219c45c-4cc6-47c9-a213-2d8017e6c961 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:55.253865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6219c45c-4cc6-47c9-a213-2d8017e6c961 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:55.265131 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6219c45c-4cc6-47c9-a213-2d8017e6c961 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1391 microversion: 2.1 time: 0.318860 Jul 26 20:22:55.266629 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3151/6220] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:54 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1391 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:56.286233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-978baa23-32fb-4ea6-aab6-d76dabfc2fce tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:56.286858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-978baa23-32fb-4ea6-aab6-d76dabfc2fce tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:56.294327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-978baa23-32fb-4ea6-aab6-d76dabfc2fce tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:56.294992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-978baa23-32fb-4ea6-aab6-d76dabfc2fce tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:56.295816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-978baa23-32fb-4ea6-aab6-d76dabfc2fce tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:56.296266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-978baa23-32fb-4ea6-aab6-d76dabfc2fce tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:56.355340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c4c89f37-60be-4275-8613-fe616ca18e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:56.355924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c4c89f37-60be-4275-8613-fe616ca18e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:56.362675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4c89f37-60be-4275-8613-fe616ca18e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:56.363365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4c89f37-60be-4275-8613-fe616ca18e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:56.364371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4c89f37-60be-4275-8613-fe616ca18e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:56.365050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4c89f37-60be-4275-8613-fe616ca18e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:56.401679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c4c89f37-60be-4275-8613-fe616ca18e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:22:56.542595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-978baa23-32fb-4ea6-aab6-d76dabfc2fce tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:56.548171 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c4c89f37-60be-4275-8613-fe616ca18e6a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 204 len: 0 microversion: 2.1 time: 0.196971 Jul 26 20:22:56.550288 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3152/6221] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:22:56 2022] DELETE /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:22:56.559439 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-978baa23-32fb-4ea6-aab6-d76dabfc2fce tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1391 microversion: 2.1 time: 0.273615 Jul 26 20:22:56.560097 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3070/6222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:56 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:56.561134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d6528b4d-2d0a-4eca-89dd-1f38b2b6097a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:56.561928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d6528b4d-2d0a-4eca-89dd-1f38b2b6097a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:56.569221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6528b4d-2d0a-4eca-89dd-1f38b2b6097a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:56.569751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6528b4d-2d0a-4eca-89dd-1f38b2b6097a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:56.570557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6528b4d-2d0a-4eca-89dd-1f38b2b6097a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:56.571050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6528b4d-2d0a-4eca-89dd-1f38b2b6097a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:56.732340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d6528b4d-2d0a-4eca-89dd-1f38b2b6097a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:56.739974 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d6528b4d-2d0a-4eca-89dd-1f38b2b6097a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1409 microversion: 2.1 time: 0.185061 Jul 26 20:22:56.740543 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3153/6223] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:56 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:22:57.584456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:57.767507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f2f14bcb-f026-41fc-a370-e3b199ff85a0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:57.768810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f2f14bcb-f026-41fc-a370-e3b199ff85a0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:57.774263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:57.778782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:22:57.792243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f14bcb-f026-41fc-a370-e3b199ff85a0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:57.793759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f14bcb-f026-41fc-a370-e3b199ff85a0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:57.793759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f14bcb-f026-41fc-a370-e3b199ff85a0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:57.794316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f2f14bcb-f026-41fc-a370-e3b199ff85a0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:57.867465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-61e4fdab-0464-47f4-8e3a-ea5e2e3f9c41 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:57.868660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-61e4fdab-0464-47f4-8e3a-ea5e2e3f9c41 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:57.879965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61e4fdab-0464-47f4-8e3a-ea5e2e3f9c41 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:57.884377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61e4fdab-0464-47f4-8e3a-ea5e2e3f9c41 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:57.886314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61e4fdab-0464-47f4-8e3a-ea5e2e3f9c41 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:57.888074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61e4fdab-0464-47f4-8e3a-ea5e2e3f9c41 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:58.051236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f2f14bcb-f026-41fc-a370-e3b199ff85a0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:58.065321 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f2f14bcb-f026-41fc-a370-e3b199ff85a0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1409 microversion: 2.1 time: 0.305983 Jul 26 20:22:58.068844 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3154/6224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:57 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1409 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:58.095008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-61e4fdab-0464-47f4-8e3a-ea5e2e3f9c41 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:58.108713 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-61e4fdab-0464-47f4-8e3a-ea5e2e3f9c41 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1391 microversion: 2.1 time: 0.530717 Jul 26 20:22:58.110837 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3071/6225] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:57 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1391 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:22:58.591448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bfa2587c-4182-40b7-b0f4-5fb789fad3cb req-2afed64e-3461-495d-a2d3-35967d6c370b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca8ed32-5be3-44c5-8d0c-13900e5afe97", "name": "network-vif-plugged", "status": "completed", "tag": "b7f3c859-eb49-45fd-af6c-a6f730444ba9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:58.612538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bfa2587c-4182-40b7-b0f4-5fb789fad3cb req-2afed64e-3461-495d-a2d3-35967d6c370b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:58.613012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bfa2587c-4182-40b7-b0f4-5fb789fad3cb req-2afed64e-3461-495d-a2d3-35967d6c370b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:58.646339 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bfa2587c-4182-40b7-b0f4-5fb789fad3cb req-2afed64e-3461-495d-a2d3-35967d6c370b service nova] Creating event network-vif-plugged:b7f3c859-eb49-45fd-af6c-a6f730444ba9 for instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 on n-h2-708768-8 Jul 26 20:22:58.675326 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bfa2587c-4182-40b7-b0f4-5fb789fad3cb req-2afed64e-3461-495d-a2d3-35967d6c370b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083672 Jul 26 20:22:58.675326 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3155/6226] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:22:58.691890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-db9f0424-d69b-4581-92cc-cb3667fd156c req-6d6af658-2460-4b53-b475-a6a608899bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bc4a19-a758-4dfa-a103-54ed97bd43a1", "name": "network-vif-deleted", "tag": "5bef1124-7bfe-407b-90b8-fc5af6710676"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:22:58.705180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-db9f0424-d69b-4581-92cc-cb3667fd156c req-6d6af658-2460-4b53-b475-a6a608899bc6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:58.705647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-db9f0424-d69b-4581-92cc-cb3667fd156c req-6d6af658-2460-4b53-b475-a6a608899bc6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:58.719027 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-db9f0424-d69b-4581-92cc-cb3667fd156c req-6d6af658-2460-4b53-b475-a6a608899bc6 service nova] Creating event network-vif-deleted:5bef1124-7bfe-407b-90b8-fc5af6710676 for instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 on n-h1-708768-8 Jul 26 20:22:58.737323 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-db9f0424-d69b-4581-92cc-cb3667fd156c req-6d6af658-2460-4b53-b475-a6a608899bc6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042027 Jul 26 20:22:58.742809 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3072/6227] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:22:59.094474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7b9361f-83d1-4a87-9d9e-9f9d8c252472 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:59.096016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7b9361f-83d1-4a87-9d9e-9f9d8c252472 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:59.123019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b9361f-83d1-4a87-9d9e-9f9d8c252472 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:59.124658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b9361f-83d1-4a87-9d9e-9f9d8c252472 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:59.126864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b9361f-83d1-4a87-9d9e-9f9d8c252472 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:59.129012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7b9361f-83d1-4a87-9d9e-9f9d8c252472 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:59.150122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a2ebb3f-a58e-4427-ad71-2e6c79ba4dcb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:22:59.150723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a2ebb3f-a58e-4427-ad71-2e6c79ba4dcb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:22:59.166603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb3f-a58e-4427-ad71-2e6c79ba4dcb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:59.167703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb3f-a58e-4427-ad71-2e6c79ba4dcb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:59.172262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb3f-a58e-4427-ad71-2e6c79ba4dcb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:22:59.173403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a2ebb3f-a58e-4427-ad71-2e6c79ba4dcb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:22:59.271724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7b9361f-83d1-4a87-9d9e-9f9d8c252472 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:59.281226 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7b9361f-83d1-4a87-9d9e-9f9d8c252472 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1202 microversion: 2.1 time: 0.192812 Jul 26 20:22:59.282980 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3156/6228] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:59 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:22:59.401749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a2ebb3f-a58e-4427-ad71-2e6c79ba4dcb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:22:59.410703 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a2ebb3f-a58e-4427-ad71-2e6c79ba4dcb tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1391 microversion: 2.1 time: 0.265815 Jul 26 20:22:59.411500 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3073/6229] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:22:59 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:00.323329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e7d37de7-017a-4ef1-9f37-8fbd04f19376 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:00.324603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e7d37de7-017a-4ef1-9f37-8fbd04f19376 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:00.331759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7d37de7-017a-4ef1-9f37-8fbd04f19376 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:00.332645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7d37de7-017a-4ef1-9f37-8fbd04f19376 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:00.333786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7d37de7-017a-4ef1-9f37-8fbd04f19376 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:00.334272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e7d37de7-017a-4ef1-9f37-8fbd04f19376 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:00.415448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e7d37de7-017a-4ef1-9f37-8fbd04f19376 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:00.423494 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e7d37de7-017a-4ef1-9f37-8fbd04f19376 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1202 microversion: 2.1 time: 0.106841 Jul 26 20:23:00.424508 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3157/6230] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:00 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1202 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:00.447020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0471f514-5199-4c80-bec6-893b13336da4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:00.447944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0471f514-5199-4c80-bec6-893b13336da4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:00.456124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0471f514-5199-4c80-bec6-893b13336da4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:00.456861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0471f514-5199-4c80-bec6-893b13336da4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:00.457845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0471f514-5199-4c80-bec6-893b13336da4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:00.458506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0471f514-5199-4c80-bec6-893b13336da4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:00.725958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0471f514-5199-4c80-bec6-893b13336da4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:00.735295 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0471f514-5199-4c80-bec6-893b13336da4 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1564 microversion: 2.1 time: 0.297643 Jul 26 20:23:00.736653 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3074/6231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:00 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1564 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:00.756619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a47df85-987e-41f9-ac60-f09f49b2bdf2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:00.758085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a47df85-987e-41f9-ac60-f09f49b2bdf2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:00.771762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a47df85-987e-41f9-ac60-f09f49b2bdf2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:00.772219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a47df85-987e-41f9-ac60-f09f49b2bdf2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:00.773725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a47df85-987e-41f9-ac60-f09f49b2bdf2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:00.774509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a47df85-987e-41f9-ac60-f09f49b2bdf2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:00.974159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0a47df85-987e-41f9-ac60-f09f49b2bdf2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:00.982865 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a47df85-987e-41f9-ac60-f09f49b2bdf2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1564 microversion: 2.1 time: 0.230243 Jul 26 20:23:00.983732 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3158/6232] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:00 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1564 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:01.459878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09502795-9c56-4af1-944d-395c8b575bd0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:01.461697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-09502795-9c56-4af1-944d-395c8b575bd0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:01.471347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09502795-9c56-4af1-944d-395c8b575bd0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:01.472403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09502795-9c56-4af1-944d-395c8b575bd0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:01.473809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09502795-9c56-4af1-944d-395c8b575bd0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:01.474472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09502795-9c56-4af1-944d-395c8b575bd0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:01.504440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:01.563176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09502795-9c56-4af1-944d-395c8b575bd0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:01.573272 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09502795-9c56-4af1-944d-395c8b575bd0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1202 microversion: 2.1 time: 0.126892 Jul 26 20:23:01.574861 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3075/6233] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:01 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1202 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:02.601577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6eac03e7-3924-42ae-96c9-6f9ac8c8de28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:02.603366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6eac03e7-3924-42ae-96c9-6f9ac8c8de28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:02.610193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6eac03e7-3924-42ae-96c9-6f9ac8c8de28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:02.610658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6eac03e7-3924-42ae-96c9-6f9ac8c8de28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:02.611564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6eac03e7-3924-42ae-96c9-6f9ac8c8de28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:02.612271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6eac03e7-3924-42ae-96c9-6f9ac8c8de28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:02.724380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6eac03e7-3924-42ae-96c9-6f9ac8c8de28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:02.740603 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6eac03e7-3924-42ae-96c9-6f9ac8c8de28 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1202 microversion: 2.1 time: 0.144489 Jul 26 20:23:02.742604 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3159/6234] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:02 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1202 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:03.773191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-372feccd-de2a-46af-8aa8-e368c2bce6a9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:03.786732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-372feccd-de2a-46af-8aa8-e368c2bce6a9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:03.819376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-372feccd-de2a-46af-8aa8-e368c2bce6a9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:03.821471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-372feccd-de2a-46af-8aa8-e368c2bce6a9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:03.822862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-372feccd-de2a-46af-8aa8-e368c2bce6a9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:03.827111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-372feccd-de2a-46af-8aa8-e368c2bce6a9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:03.880359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e81f3520-f3bf-4dfa-9de6-917d783b6210 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:03.881938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e81f3520-f3bf-4dfa-9de6-917d783b6210 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:03.893845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e81f3520-f3bf-4dfa-9de6-917d783b6210 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:03.894544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e81f3520-f3bf-4dfa-9de6-917d783b6210 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:03.895560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e81f3520-f3bf-4dfa-9de6-917d783b6210 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:03.896699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e81f3520-f3bf-4dfa-9de6-917d783b6210 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:03.903051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:03.948740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-372feccd-de2a-46af-8aa8-e368c2bce6a9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:03.974665 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-372feccd-de2a-46af-8aa8-e368c2bce6a9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 200 len: 1202 microversion: 2.1 time: 0.213821 Jul 26 20:23:03.977348 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3076/6235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:03 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 1202 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:04.023018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-ed750dc5-ebea-43c5-81f5-8d780bab86c5 req-7cc7994b-1eb0-4558-b61f-069a257b51bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca8ed32-5be3-44c5-8d0c-13900e5afe97", "tag": "b7f3c859-eb49-45fd-af6c-a6f730444ba9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:04.057248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ed750dc5-ebea-43c5-81f5-8d780bab86c5 req-7cc7994b-1eb0-4558-b61f-069a257b51bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:04.058761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-ed750dc5-ebea-43c5-81f5-8d780bab86c5 req-7cc7994b-1eb0-4558-b61f-069a257b51bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:04.089838 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-ed750dc5-ebea-43c5-81f5-8d780bab86c5 req-7cc7994b-1eb0-4558-b61f-069a257b51bb service nova] Creating event network-changed:b7f3c859-eb49-45fd-af6c-a6f730444ba9 for instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 on n-h2-708768-8 Jul 26 20:23:04.123281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-ed750dc5-ebea-43c5-81f5-8d780bab86c5 req-7cc7994b-1eb0-4558-b61f-069a257b51bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128987 Jul 26 20:23:04.124616 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3077/6236] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:04.223076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e81f3520-f3bf-4dfa-9de6-917d783b6210 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:04.233725 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e81f3520-f3bf-4dfa-9de6-917d783b6210 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1564 microversion: 2.1 time: 0.364695 Jul 26 20:23:04.234530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3160/6237] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:03 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1564 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:04.999665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:05.000471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:05.011197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:05.013443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:05.014460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:05.016500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:05.054281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 HTTP/1.1 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '54bc4a19-a758-4dfa-a103-54ed97bd43a1'} Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:05.060451 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:05.065225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:05.065225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:05.065225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:05.065225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:23:05.065225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:23:05.065225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:05.065225 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:05.065882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:23:05.067958 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-927d20e5-3510-42b4-a5d5-190ee6bc06e4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 404 len: 111 microversion: 2.1 time: 0.073820 Jul 26 20:23:05.068986 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3078/6238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:04 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:23:08.385004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:08.388336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:08.395584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:08.396286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:08.397475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:08.398053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:08.426535 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab HTTP/1.1 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '601e4db3-f29a-46f3-a3b0-5c6fe8366eab'} Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:23:08.431281 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.435929 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.437311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:23:08.438188 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c2c90587-2066-417e-8f7f-5c49221b37bc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 404 len: 111 microversion: 2.1 time: 0.057218 Jul 26 20:23:08.438857 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3161/6239] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:23:08 2022] DELETE /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:23:08.449343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:08.450111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 601e4db3-f29a-46f3-a3b0-5c6fe8366eab] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:08.464871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:08.465380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:08.466178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:08.466671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:08.508004 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab HTTP/1.1 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '601e4db3-f29a-46f3-a3b0-5c6fe8366eab'} Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:08.509556 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 601e4db3-f29a-46f3-a3b0-5c6fe8366eab could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f7825d1b-98bb-4792-8bd9-8efed6e0399f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab" status: 404 len: 111 microversion: 2.1 time: 0.065669 Jul 26 20:23:08.518239 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3079/6240] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:08 2022] GET /compute/v2.1/servers/601e4db3-f29a-46f3-a3b0-5c6fe8366eab => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:23:09.122774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:09.123329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:09.129428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:09.129878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:09.130642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:09.131078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:09.145208 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 HTTP/1.1 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '54bc4a19-a758-4dfa-a103-54ed97bd43a1'} Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:23:09.146762 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-17822f71-8786-4b63-aa72-1fe6bc9a4004 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 404 len: 111 microversion: 2.1 time: 0.030013 Jul 26 20:23:09.151656 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3162/6241] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:23:09 2022] DELETE /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:23:09.157509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:09.158131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 54bc4a19-a758-4dfa-a103-54ed97bd43a1] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:09.164244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:09.164699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:09.165474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:09.165922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:09.179427 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 HTTP/1.1 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '54bc4a19-a758-4dfa-a103-54ed97bd43a1'} Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:09.180990 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 54bc4a19-a758-4dfa-a103-54ed97bd43a1 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bf5d2e20-9025-46cd-9825-021eca1d4f9a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1" status: 404 len: 111 microversion: 2.1 time: 0.028746 Jul 26 20:23:09.185119 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3080/6242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:09 2022] GET /compute/v2.1/servers/54bc4a19-a758-4dfa-a103-54ed97bd43a1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:23:09.259975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-903df60d-be64-49f1-9605-94d973f734d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: .version_select at 0x7f8755fc3af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-82311540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKIEQIHhCJwC7CXkPR7X4rasJ+LsctEDHmrDEIEODbMVqNAgzjlF8GBZhyjqKNQ/lQvQa+oQ53SurbngwMFVt4AOcT1VtN0MQx5zu1FRP1lGA32IUdQPhGOrgR2HxnNUw=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:09.276699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-903df60d-be64-49f1-9605-94d973f734d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:23:09.282123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-903df60d-be64-49f1-9605-94d973f734d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:23:09.308588 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-903df60d-be64-49f1-9605-94d973f734d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.053307 Jul 26 20:23:09.310143 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3163/6243] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:23:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:24.730350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7eeb0138-a061-4067-8617-728fb4e3824a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:24.732953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7eeb0138-a061-4067-8617-728fb4e3824a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:24.736163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=37 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:24.737419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=19 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:24.747046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7eeb0138-a061-4067-8617-728fb4e3824a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:24.748056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7eeb0138-a061-4067-8617-728fb4e3824a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:24.749115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7eeb0138-a061-4067-8617-728fb4e3824a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:24.750202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7eeb0138-a061-4067-8617-728fb4e3824a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:24.816392 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7eeb0138-a061-4067-8617-728fb4e3824a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97/action" status: 200 len: 24570 microversion: 2.1 time: 0.090112 Jul 26 20:23:24.818095 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3081/6244] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:23:24 2022] POST /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97/action => generated 24570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:23:30.693770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=9 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:30.695277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:30.696687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:30.701341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1456959057", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-82311540", "security_groups": [{"name": "tempest-secgroup-smoke-64409093"}], "block_device_mapping_v2": [{"uuid": "3f04678b-2157-43aa-8e03-6d550dfbc8c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8dd04748-e18a-4968-8aa4-c87b9f3665a7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:30.965708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] validate_networks() for [('8dd04748-e18a-4968-8aa4-c87b9f3665a7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:23:31.385156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:23:31.385590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:23:31.386075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:23:31.386491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:23:31.386910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:23:31.396668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:31.397420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:31.398946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:31.399470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:31.418638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:23:31.424255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:23:31.484184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:23:31.486312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f04678b-2157-43aa-8e03-6d550dfbc8c9',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:23:31.630739 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d95f4fdf-466c-4b3e-808f-70a53dfadd59 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.938986 Jul 26 20:23:31.631698 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3164/6245] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:23:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:23:31.643473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-58388494-3f61-47e7-b424-519536567cf2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:31.644858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-58388494-3f61-47e7-b424-519536567cf2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:31.875989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-58388494-3f61-47e7-b424-519536567cf2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:31.883813 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-58388494-3f61-47e7-b424-519536567cf2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1093 microversion: 2.1 time: 0.244539 Jul 26 20:23:31.887333 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3082/6246] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:31 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1093 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:32.912053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-496329a0-c834-420c-99bd-d6f4b967328c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:32.925087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-496329a0-c834-420c-99bd-d6f4b967328c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:32.959895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-496329a0-c834-420c-99bd-d6f4b967328c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:32.960604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-496329a0-c834-420c-99bd-d6f4b967328c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:32.962334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-496329a0-c834-420c-99bd-d6f4b967328c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:32.963913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-496329a0-c834-420c-99bd-d6f4b967328c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:33.092075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-496329a0-c834-420c-99bd-d6f4b967328c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:33.106969 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-496329a0-c834-420c-99bd-d6f4b967328c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1209 microversion: 2.1 time: 0.201945 Jul 26 20:23:33.111201 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3165/6247] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:32 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1209 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:34.129124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-eff9b633-bb12-48f1-8398-3828d72028d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:34.130398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-eff9b633-bb12-48f1-8398-3828d72028d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:34.142437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eff9b633-bb12-48f1-8398-3828d72028d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:34.145223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eff9b633-bb12-48f1-8398-3828d72028d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:34.146227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eff9b633-bb12-48f1-8398-3828d72028d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:34.146733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-eff9b633-bb12-48f1-8398-3828d72028d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:34.387706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-eff9b633-bb12-48f1-8398-3828d72028d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:34.396395 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-eff9b633-bb12-48f1-8398-3828d72028d5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1275 microversion: 2.1 time: 0.271347 Jul 26 20:23:34.398831 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3083/6248] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:34 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:34.873148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d1090b99-594c-4cca-94db-368dbf922f6c req-1e7f1f77-36c0-49fe-a11a-5cf8396cc4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0", "tag": "370e64ab-409d-4a25-bd84-b4f3ad56385b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:34.906107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d1090b99-594c-4cca-94db-368dbf922f6c req-1e7f1f77-36c0-49fe-a11a-5cf8396cc4df service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:34.910120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d1090b99-594c-4cca-94db-368dbf922f6c req-1e7f1f77-36c0-49fe-a11a-5cf8396cc4df service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:34.954754 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d1090b99-594c-4cca-94db-368dbf922f6c req-1e7f1f77-36c0-49fe-a11a-5cf8396cc4df service nova] Creating event network-changed:370e64ab-409d-4a25-bd84-b4f3ad56385b for instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 on n-h1-708768-8 Jul 26 20:23:34.963881 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d1090b99-594c-4cca-94db-368dbf922f6c req-1e7f1f77-36c0-49fe-a11a-5cf8396cc4df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101609 Jul 26 20:23:34.965724 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3166/6249] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:35.419498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8dc341d-a706-4c17-82e1-3ebd06f509b4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:35.420153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8dc341d-a706-4c17-82e1-3ebd06f509b4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:35.441608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8dc341d-a706-4c17-82e1-3ebd06f509b4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:35.442181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8dc341d-a706-4c17-82e1-3ebd06f509b4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:35.443242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8dc341d-a706-4c17-82e1-3ebd06f509b4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:35.443713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8dc341d-a706-4c17-82e1-3ebd06f509b4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:35.727522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c8dc341d-a706-4c17-82e1-3ebd06f509b4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:35.741682 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8dc341d-a706-4c17-82e1-3ebd06f509b4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1275 microversion: 2.1 time: 0.322855 Jul 26 20:23:35.743918 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3084/6250] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:35 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1275 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:35.896823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd4d5122-e7f4-41de-b7dc-ade492119668 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:35.898763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd4d5122-e7f4-41de-b7dc-ade492119668 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:35.911654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd4d5122-e7f4-41de-b7dc-ade492119668 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:35.914911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd4d5122-e7f4-41de-b7dc-ade492119668 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:35.917909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd4d5122-e7f4-41de-b7dc-ade492119668 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:35.920075 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd4d5122-e7f4-41de-b7dc-ade492119668 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:36.371769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd4d5122-e7f4-41de-b7dc-ade492119668 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:36.381727 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd4d5122-e7f4-41de-b7dc-ade492119668 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1682 microversion: 2.1 time: 0.489997 Jul 26 20:23:36.384310 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3167/6251] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:35 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1682 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:36.515997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b744f56-0a96-4c69-8c77-b1d61aa6b79e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:36.518333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b744f56-0a96-4c69-8c77-b1d61aa6b79e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:36.540446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b744f56-0a96-4c69-8c77-b1d61aa6b79e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:36.542609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b744f56-0a96-4c69-8c77-b1d61aa6b79e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:36.543445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b744f56-0a96-4c69-8c77-b1d61aa6b79e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:36.543933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b744f56-0a96-4c69-8c77-b1d61aa6b79e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:36.622335 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b744f56-0a96-4c69-8c77-b1d61aa6b79e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97/action" status: 200 len: 32645 microversion: 2.1 time: 0.110143 Jul 26 20:23:36.632933 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3085/6252] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:23:36 2022] POST /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97/action => generated 32645 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:23:36.770635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16e6a447-b640-445b-8852-903c0da4cbda tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:36.771386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-16e6a447-b640-445b-8852-903c0da4cbda tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:36.779760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16e6a447-b640-445b-8852-903c0da4cbda tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:36.780528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16e6a447-b640-445b-8852-903c0da4cbda tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:36.781505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16e6a447-b640-445b-8852-903c0da4cbda tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:36.782124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16e6a447-b640-445b-8852-903c0da4cbda tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:37.109828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-16e6a447-b640-445b-8852-903c0da4cbda tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:37.124298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16e6a447-b640-445b-8852-903c0da4cbda tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1275 microversion: 2.1 time: 0.357733 Jul 26 20:23:37.125469 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3168/6253] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:36 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1275 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:37.243336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc71cdfc-3d4d-4977-9200-e40f274df33e tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:37.244545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc71cdfc-3d4d-4977-9200-e40f274df33e tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:37.256822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc71cdfc-3d4d-4977-9200-e40f274df33e tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:37.258240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc71cdfc-3d4d-4977-9200-e40f274df33e tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:37.260161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc71cdfc-3d4d-4977-9200-e40f274df33e tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:37.260889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc71cdfc-3d4d-4977-9200-e40f274df33e tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:37.420950 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc71cdfc-3d4d-4977-9200-e40f274df33e tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1833 microversion: 2.1 time: 0.609140 Jul 26 20:23:37.421545 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3086/6254] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:36 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1833 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:37.456327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:37.459213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:37.466307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:37.466769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:37.467588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:37.468198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:37.501863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lazy-loading 'flavor' on Instance uuid 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:23:37.518403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Going to try to live migrate instance to another host {{(pid=125964) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 20:23:38.150540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-92647aa0-cf2c-4fa3-aba8-26ad5d744bcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:38.151948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-92647aa0-cf2c-4fa3-aba8-26ad5d744bcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:38.160130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92647aa0-cf2c-4fa3-aba8-26ad5d744bcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:38.161067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92647aa0-cf2c-4fa3-aba8-26ad5d744bcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:38.162000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92647aa0-cf2c-4fa3-aba8-26ad5d744bcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:38.162595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92647aa0-cf2c-4fa3-aba8-26ad5d744bcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:38.434881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-92647aa0-cf2c-4fa3-aba8-26ad5d744bcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:38.445847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-92647aa0-cf2c-4fa3-aba8-26ad5d744bcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1275 microversion: 2.1 time: 0.300451 Jul 26 20:23:38.447073 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3087/6255] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:38 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:39.468495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d51bfec-fd7e-40fc-be28-e2fa69067a07 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:39.469660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d51bfec-fd7e-40fc-be28-e2fa69067a07 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:39.480767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d51bfec-fd7e-40fc-be28-e2fa69067a07 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:39.481786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d51bfec-fd7e-40fc-be28-e2fa69067a07 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:39.482789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d51bfec-fd7e-40fc-be28-e2fa69067a07 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:39.483363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d51bfec-fd7e-40fc-be28-e2fa69067a07 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:39.705622 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a328ed87-5ae6-4f9c-b5b1-b750a5200271 tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97/action" status: 202 len: 0 microversion: 2.1 time: 2.253073 Jul 26 20:23:39.706602 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3169/6256] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:23:37 2022] POST /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97/action => generated 0 bytes in 2255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:23:39.716795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b183645a-81f0-4ae0-89da-d35ee89ca96e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:39.717678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b183645a-81f0-4ae0-89da-d35ee89ca96e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:39.735293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b183645a-81f0-4ae0-89da-d35ee89ca96e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:39.735731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d51bfec-fd7e-40fc-be28-e2fa69067a07 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:39.736263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b183645a-81f0-4ae0-89da-d35ee89ca96e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:39.737217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b183645a-81f0-4ae0-89da-d35ee89ca96e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:39.737818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b183645a-81f0-4ae0-89da-d35ee89ca96e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:39.745232 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d51bfec-fd7e-40fc-be28-e2fa69067a07 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1275 microversion: 2.1 time: 0.282126 Jul 26 20:23:39.747775 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3088/6257] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:39 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1275 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:39.889948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b183645a-81f0-4ae0-89da-d35ee89ca96e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:39.899275 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b183645a-81f0-4ae0-89da-d35ee89ca96e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1692 microversion: 2.1 time: 0.186754 Jul 26 20:23:39.899903 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3170/6258] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:39 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:40.768505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1cecfc23-7127-4224-8405-02144e0b35a3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:40.769889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1cecfc23-7127-4224-8405-02144e0b35a3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:40.780288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cecfc23-7127-4224-8405-02144e0b35a3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:40.780752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cecfc23-7127-4224-8405-02144e0b35a3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:40.783331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cecfc23-7127-4224-8405-02144e0b35a3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:40.783965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1cecfc23-7127-4224-8405-02144e0b35a3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:40.922448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3bf80d21-56a9-4c0e-8ffb-73d0f5b77681 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:40.923125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3bf80d21-56a9-4c0e-8ffb-73d0f5b77681 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:40.934543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bf80d21-56a9-4c0e-8ffb-73d0f5b77681 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:40.936316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bf80d21-56a9-4c0e-8ffb-73d0f5b77681 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:40.937909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bf80d21-56a9-4c0e-8ffb-73d0f5b77681 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:40.938477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bf80d21-56a9-4c0e-8ffb-73d0f5b77681 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:40.992810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1cecfc23-7127-4224-8405-02144e0b35a3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:41.001787 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1cecfc23-7127-4224-8405-02144e0b35a3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.237849 Jul 26 20:23:41.013706 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3089/6259] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:40 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:41.260753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3bf80d21-56a9-4c0e-8ffb-73d0f5b77681 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:41.270740 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3bf80d21-56a9-4c0e-8ffb-73d0f5b77681 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1692 microversion: 2.1 time: 0.352846 Jul 26 20:23:41.275771 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3171/6260] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:40 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1692 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:41.339699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-150fdcce-eaf8-4e07-aa44-112bca94b862 req-acd8379c-303d-4da9-a996-01df3ad2742a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca8ed32-5be3-44c5-8d0c-13900e5afe97", "name": "network-vif-unplugged", "status": "completed", "tag": "b7f3c859-eb49-45fd-af6c-a6f730444ba9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:41.357070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-150fdcce-eaf8-4e07-aa44-112bca94b862 req-acd8379c-303d-4da9-a996-01df3ad2742a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:41.357882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-150fdcce-eaf8-4e07-aa44-112bca94b862 req-acd8379c-303d-4da9-a996-01df3ad2742a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:41.395827 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-150fdcce-eaf8-4e07-aa44-112bca94b862 req-acd8379c-303d-4da9-a996-01df3ad2742a service nova] Creating event network-vif-unplugged:b7f3c859-eb49-45fd-af6c-a6f730444ba9 for instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 on n-h2-708768-8 Jul 26 20:23:41.402672 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-150fdcce-eaf8-4e07-aa44-112bca94b862 req-acd8379c-303d-4da9-a996-01df3ad2742a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070122 Jul 26 20:23:41.404024 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3090/6261] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:42.026741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2385aae-2390-4dcb-b0ae-1ced18830631 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:42.026741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d2385aae-2390-4dcb-b0ae-1ced18830631 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:42.029503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:42.030795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:42.049284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2385aae-2390-4dcb-b0ae-1ced18830631 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:42.050582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2385aae-2390-4dcb-b0ae-1ced18830631 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:42.052899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2385aae-2390-4dcb-b0ae-1ced18830631 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:42.053569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2385aae-2390-4dcb-b0ae-1ced18830631 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:42.296445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:42.301975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e04e7231-0f09-420a-b8b3-752df6b39f3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:42.302771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e04e7231-0f09-420a-b8b3-752df6b39f3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:42.327422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e04e7231-0f09-420a-b8b3-752df6b39f3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:42.327918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e04e7231-0f09-420a-b8b3-752df6b39f3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:42.328723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e04e7231-0f09-420a-b8b3-752df6b39f3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:42.329180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e04e7231-0f09-420a-b8b3-752df6b39f3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:42.349739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d2385aae-2390-4dcb-b0ae-1ced18830631 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:42.361123 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d2385aae-2390-4dcb-b0ae-1ced18830631 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.342035 Jul 26 20:23:42.362759 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3172/6262] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:42 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:42.519101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e04e7231-0f09-420a-b8b3-752df6b39f3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:42.528342 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e04e7231-0f09-420a-b8b3-752df6b39f3d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1692 microversion: 2.1 time: 0.233746 Jul 26 20:23:42.528938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3091/6263] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:42 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1692 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:43.383087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-35254beb-d3f5-417a-a477-b341c453f44b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:43.383748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-35254beb-d3f5-417a-a477-b341c453f44b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:43.390984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35254beb-d3f5-417a-a477-b341c453f44b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:43.391435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35254beb-d3f5-417a-a477-b341c453f44b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:43.392252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35254beb-d3f5-417a-a477-b341c453f44b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:43.392684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35254beb-d3f5-417a-a477-b341c453f44b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:43.537467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-35254beb-d3f5-417a-a477-b341c453f44b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:43.549199 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-35254beb-d3f5-417a-a477-b341c453f44b tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.170799 Jul 26 20:23:43.550160 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3173/6264] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:43 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:43.550711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cae52148-c0d8-458e-97cf-ae31846fd1e5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:43.551424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cae52148-c0d8-458e-97cf-ae31846fd1e5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:43.559811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cae52148-c0d8-458e-97cf-ae31846fd1e5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:43.560439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cae52148-c0d8-458e-97cf-ae31846fd1e5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:43.561440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cae52148-c0d8-458e-97cf-ae31846fd1e5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:43.562680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cae52148-c0d8-458e-97cf-ae31846fd1e5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:43.718111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cae52148-c0d8-458e-97cf-ae31846fd1e5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:43.727266 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cae52148-c0d8-458e-97cf-ae31846fd1e5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1692 microversion: 2.1 time: 0.180870 Jul 26 20:23:43.727872 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3092/6265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:43 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:43.805651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-3cabf208-7349-4474-abf6-4ed46cb8a530 req-e63fbb98-e98f-4018-8a6b-ab2309bf10cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca8ed32-5be3-44c5-8d0c-13900e5afe97", "tag": "b7f3c859-eb49-45fd-af6c-a6f730444ba9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:43.816289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3cabf208-7349-4474-abf6-4ed46cb8a530 req-e63fbb98-e98f-4018-8a6b-ab2309bf10cd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:43.817092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3cabf208-7349-4474-abf6-4ed46cb8a530 req-e63fbb98-e98f-4018-8a6b-ab2309bf10cd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:43.830467 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3cabf208-7349-4474-abf6-4ed46cb8a530 req-e63fbb98-e98f-4018-8a6b-ab2309bf10cd service nova] Creating event network-changed:b7f3c859-eb49-45fd-af6c-a6f730444ba9 for instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 on n-h2-708768-8 Jul 26 20:23:43.836096 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-3cabf208-7349-4474-abf6-4ed46cb8a530 req-e63fbb98-e98f-4018-8a6b-ab2309bf10cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033670 Jul 26 20:23:43.837023 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3174/6266] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:44.573814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73db0b95-d763-4bbe-b00a-49aec1bf6688 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:44.574450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73db0b95-d763-4bbe-b00a-49aec1bf6688 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:44.581774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73db0b95-d763-4bbe-b00a-49aec1bf6688 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:44.582532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73db0b95-d763-4bbe-b00a-49aec1bf6688 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:44.583587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73db0b95-d763-4bbe-b00a-49aec1bf6688 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:44.584172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73db0b95-d763-4bbe-b00a-49aec1bf6688 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:44.754736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e50688ab-2558-4033-8595-20a77c77e9d2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:44.755685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e50688ab-2558-4033-8595-20a77c77e9d2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:44.771339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e50688ab-2558-4033-8595-20a77c77e9d2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:44.771828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e50688ab-2558-4033-8595-20a77c77e9d2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:44.772803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e50688ab-2558-4033-8595-20a77c77e9d2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:44.773476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e50688ab-2558-4033-8595-20a77c77e9d2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:44.818949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-73db0b95-d763-4bbe-b00a-49aec1bf6688 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:44.842883 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73db0b95-d763-4bbe-b00a-49aec1bf6688 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.273382 Jul 26 20:23:44.843510 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3093/6267] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:44 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:44.979555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e50688ab-2558-4033-8595-20a77c77e9d2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:44.988049 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e50688ab-2558-4033-8595-20a77c77e9d2 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1692 microversion: 2.1 time: 0.237700 Jul 26 20:23:44.988743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3175/6268] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:44 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1692 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:45.870773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-036fc632-5b03-4e76-be02-8d874861c581 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:45.871423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-036fc632-5b03-4e76-be02-8d874861c581 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:45.878364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-036fc632-5b03-4e76-be02-8d874861c581 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:45.878871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-036fc632-5b03-4e76-be02-8d874861c581 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:45.879805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-036fc632-5b03-4e76-be02-8d874861c581 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:45.880451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-036fc632-5b03-4e76-be02-8d874861c581 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:46.012078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-247ee767-6313-465b-822d-b7e315b3d0be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:46.012702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-247ee767-6313-465b-822d-b7e315b3d0be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:46.031734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-247ee767-6313-465b-822d-b7e315b3d0be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:46.034488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-247ee767-6313-465b-822d-b7e315b3d0be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:46.035002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-247ee767-6313-465b-822d-b7e315b3d0be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:46.035569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-247ee767-6313-465b-822d-b7e315b3d0be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:46.041699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-036fc632-5b03-4e76-be02-8d874861c581 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:46.049903 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-036fc632-5b03-4e76-be02-8d874861c581 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.184909 Jul 26 20:23:46.050942 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3094/6269] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:45 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:46.227486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-247ee767-6313-465b-822d-b7e315b3d0be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:46.236348 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-247ee767-6313-465b-822d-b7e315b3d0be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1692 microversion: 2.1 time: 0.229323 Jul 26 20:23:46.252490 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3176/6270] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:46 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1692 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:47.075084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-17e8c206-d5c9-439c-8ef9-990d791b3729 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:47.076342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-17e8c206-d5c9-439c-8ef9-990d791b3729 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:47.093756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17e8c206-d5c9-439c-8ef9-990d791b3729 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:47.094465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17e8c206-d5c9-439c-8ef9-990d791b3729 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:47.095435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17e8c206-d5c9-439c-8ef9-990d791b3729 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:47.096068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-17e8c206-d5c9-439c-8ef9-990d791b3729 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:47.264620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9b0a7838-8865-45fd-86aa-51e64d08a54d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:47.265952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9b0a7838-8865-45fd-86aa-51e64d08a54d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:47.278312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b0a7838-8865-45fd-86aa-51e64d08a54d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:47.279685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b0a7838-8865-45fd-86aa-51e64d08a54d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:47.281071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b0a7838-8865-45fd-86aa-51e64d08a54d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:47.282249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9b0a7838-8865-45fd-86aa-51e64d08a54d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:47.328010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-17e8c206-d5c9-439c-8ef9-990d791b3729 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:47.341466 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-17e8c206-d5c9-439c-8ef9-990d791b3729 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.270579 Jul 26 20:23:47.346850 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3095/6271] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:47 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:47.498462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9b0a7838-8865-45fd-86aa-51e64d08a54d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:47.507491 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9b0a7838-8865-45fd-86aa-51e64d08a54d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1692 microversion: 2.1 time: 0.247550 Jul 26 20:23:47.523010 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3177/6272] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:47 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1692 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:48.051903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-98069ece-3f7e-498d-ac28-1df1674bffad req-849b4003-57ab-4cf0-98db-421d3ffdbf9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca8ed32-5be3-44c5-8d0c-13900e5afe97", "name": "network-vif-unplugged", "status": "completed", "tag": "b7f3c859-eb49-45fd-af6c-a6f730444ba9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:48.065767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-98069ece-3f7e-498d-ac28-1df1674bffad req-849b4003-57ab-4cf0-98db-421d3ffdbf9d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:48.066927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-98069ece-3f7e-498d-ac28-1df1674bffad req-849b4003-57ab-4cf0-98db-421d3ffdbf9d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:48.088945 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-98069ece-3f7e-498d-ac28-1df1674bffad req-849b4003-57ab-4cf0-98db-421d3ffdbf9d service nova] Creating event network-vif-unplugged:b7f3c859-eb49-45fd-af6c-a6f730444ba9 for instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 on n-h2-708768-8 Jul 26 20:23:48.096052 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-98069ece-3f7e-498d-ac28-1df1674bffad req-849b4003-57ab-4cf0-98db-421d3ffdbf9d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.242420 Jul 26 20:23:48.107472 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3096/6273] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:48.367167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6bd38134-a616-469d-89b0-7d118e66d8d2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:48.367817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6bd38134-a616-469d-89b0-7d118e66d8d2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:48.377246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bd38134-a616-469d-89b0-7d118e66d8d2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:48.377789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bd38134-a616-469d-89b0-7d118e66d8d2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:48.378676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bd38134-a616-469d-89b0-7d118e66d8d2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:48.379550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6bd38134-a616-469d-89b0-7d118e66d8d2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:48.531013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c46cc73-97f0-448e-a2c5-afaa8693fd70 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:48.531765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6c46cc73-97f0-448e-a2c5-afaa8693fd70 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:48.545851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c46cc73-97f0-448e-a2c5-afaa8693fd70 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:48.546322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c46cc73-97f0-448e-a2c5-afaa8693fd70 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:48.547289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c46cc73-97f0-448e-a2c5-afaa8693fd70 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:48.547776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c46cc73-97f0-448e-a2c5-afaa8693fd70 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:48.642253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6bd38134-a616-469d-89b0-7d118e66d8d2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:48.654814 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6bd38134-a616-469d-89b0-7d118e66d8d2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.289229 Jul 26 20:23:48.656961 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3178/6274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:48 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:48.825419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c46cc73-97f0-448e-a2c5-afaa8693fd70 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:48.833148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c46cc73-97f0-448e-a2c5-afaa8693fd70 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1692 microversion: 2.1 time: 0.306370 Jul 26 20:23:48.836436 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3097/6275] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:48 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1692 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:49.683015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa37f5ea-999e-49fa-834f-2f223a2dffb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:49.683713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa37f5ea-999e-49fa-834f-2f223a2dffb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:49.700195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa37f5ea-999e-49fa-834f-2f223a2dffb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:49.702706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa37f5ea-999e-49fa-834f-2f223a2dffb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:49.704660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa37f5ea-999e-49fa-834f-2f223a2dffb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:49.710680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa37f5ea-999e-49fa-834f-2f223a2dffb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:49.860538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3d0be016-0c9f-4bad-9f95-2fc9a8aeda0e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:49.861317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3d0be016-0c9f-4bad-9f95-2fc9a8aeda0e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:49.886095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d0be016-0c9f-4bad-9f95-2fc9a8aeda0e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:49.887376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d0be016-0c9f-4bad-9f95-2fc9a8aeda0e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:49.889885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d0be016-0c9f-4bad-9f95-2fc9a8aeda0e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:49.892268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d0be016-0c9f-4bad-9f95-2fc9a8aeda0e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:50.075685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fa37f5ea-999e-49fa-834f-2f223a2dffb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:50.088618 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa37f5ea-999e-49fa-834f-2f223a2dffb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.411466 Jul 26 20:23:50.091829 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3179/6276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:49 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:50.152023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3d0be016-0c9f-4bad-9f95-2fc9a8aeda0e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:50.161640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3d0be016-0c9f-4bad-9f95-2fc9a8aeda0e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1682 microversion: 2.1 time: 0.307882 Jul 26 20:23:50.162399 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3098/6277] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:49 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1682 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:50.187641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4a0e8f3-0a41-4511-af21-d2843d79235f tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:50.188462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4a0e8f3-0a41-4511-af21-d2843d79235f tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:50.195709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4a0e8f3-0a41-4511-af21-d2843d79235f tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:50.196272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4a0e8f3-0a41-4511-af21-d2843d79235f tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:50.197252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4a0e8f3-0a41-4511-af21-d2843d79235f tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:50.197802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4a0e8f3-0a41-4511-af21-d2843d79235f tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:50.397945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:50.403373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4a0e8f3-0a41-4511-af21-d2843d79235f tempest-TestNetworkAdvancedServerOps-1477942789 tempest-TestNetworkAdvancedServerOps-1477942789-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1833 microversion: 2.1 time: 0.219422 Jul 26 20:23:50.404272 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3180/6278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:50 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1833 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:50.432806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-36f48dde-4407-414d-a944-48ea8cdc046f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:50.433435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-36f48dde-4407-414d-a944-48ea8cdc046f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:50.441049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36f48dde-4407-414d-a944-48ea8cdc046f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:50.441514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36f48dde-4407-414d-a944-48ea8cdc046f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:50.442652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36f48dde-4407-414d-a944-48ea8cdc046f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:50.443874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-36f48dde-4407-414d-a944-48ea8cdc046f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:50.649724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-36f48dde-4407-414d-a944-48ea8cdc046f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:50.657942 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-36f48dde-4407-414d-a944-48ea8cdc046f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1682 microversion: 2.1 time: 0.230052 Jul 26 20:23:50.658834 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3099/6279] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:50 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:50.774406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5dffa80f-7940-4a7f-93fa-6956b49ada3a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:50.776588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5dffa80f-7940-4a7f-93fa-6956b49ada3a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:50.785498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dffa80f-7940-4a7f-93fa-6956b49ada3a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:50.786243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dffa80f-7940-4a7f-93fa-6956b49ada3a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:50.787212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dffa80f-7940-4a7f-93fa-6956b49ada3a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:50.789022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5dffa80f-7940-4a7f-93fa-6956b49ada3a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:50.869370 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5dffa80f-7940-4a7f-93fa-6956b49ada3a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97/action" status: 200 len: 38675 microversion: 2.1 time: 0.099603 Jul 26 20:23:50.876639 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3181/6280] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:23:50 2022] POST /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97/action => generated 38675 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:23:51.057105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-606c4117-b112-4be4-b9c4-4c189d3c3dd0 req-41dabf8b-4bdf-4b2e-988f-7e491bb60829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0", "name": "network-vif-plugged", "status": "completed", "tag": "370e64ab-409d-4a25-bd84-b4f3ad56385b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:51.071469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-606c4117-b112-4be4-b9c4-4c189d3c3dd0 req-41dabf8b-4bdf-4b2e-988f-7e491bb60829 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:51.072277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-606c4117-b112-4be4-b9c4-4c189d3c3dd0 req-41dabf8b-4bdf-4b2e-988f-7e491bb60829 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:51.090407 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-606c4117-b112-4be4-b9c4-4c189d3c3dd0 req-41dabf8b-4bdf-4b2e-988f-7e491bb60829 service nova] Creating event network-vif-plugged:370e64ab-409d-4a25-bd84-b4f3ad56385b for instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 on n-h1-708768-8 Jul 26 20:23:51.098219 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-606c4117-b112-4be4-b9c4-4c189d3c3dd0 req-41dabf8b-4bdf-4b2e-988f-7e491bb60829 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044716 Jul 26 20:23:51.099006 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3100/6281] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:51.111293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-87f9f6f1-bf44-4a97-952e-8f463b33a33d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:51.112686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-87f9f6f1-bf44-4a97-952e-8f463b33a33d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:51.121317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87f9f6f1-bf44-4a97-952e-8f463b33a33d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:51.121972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87f9f6f1-bf44-4a97-952e-8f463b33a33d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:51.122779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87f9f6f1-bf44-4a97-952e-8f463b33a33d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:51.123407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-87f9f6f1-bf44-4a97-952e-8f463b33a33d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:51.340449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-87f9f6f1-bf44-4a97-952e-8f463b33a33d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:51.348113 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-87f9f6f1-bf44-4a97-952e-8f463b33a33d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1263 microversion: 2.1 time: 0.241203 Jul 26 20:23:51.352615 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3182/6282] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:51 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1263 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:52.370788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7d66ede-b7ab-4198-89d3-91e10ed9212a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:52.372158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d7d66ede-b7ab-4198-89d3-91e10ed9212a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:52.378651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7d66ede-b7ab-4198-89d3-91e10ed9212a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:52.379385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7d66ede-b7ab-4198-89d3-91e10ed9212a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:52.380470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7d66ede-b7ab-4198-89d3-91e10ed9212a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:52.381062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7d66ede-b7ab-4198-89d3-91e10ed9212a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:52.400079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:52.556532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d7d66ede-b7ab-4198-89d3-91e10ed9212a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:52.564537 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d7d66ede-b7ab-4198-89d3-91e10ed9212a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1449 microversion: 2.1 time: 0.199106 Jul 26 20:23:52.565725 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3101/6283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:52 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1449 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:52.587076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3a27259-19d2-4f04-a5c9-067584201b88 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:52.587723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3a27259-19d2-4f04-a5c9-067584201b88 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:52.598506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3a27259-19d2-4f04-a5c9-067584201b88 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:52.598961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3a27259-19d2-4f04-a5c9-067584201b88 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:52.599784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3a27259-19d2-4f04-a5c9-067584201b88 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:52.600225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3a27259-19d2-4f04-a5c9-067584201b88 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:52.762213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3a27259-19d2-4f04-a5c9-067584201b88 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:52.770365 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3a27259-19d2-4f04-a5c9-067584201b88 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1449 microversion: 2.1 time: 0.187798 Jul 26 20:23:52.784165 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3183/6284] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:52 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1449 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:53.975011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1618502086", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:54.037380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:23:54.557225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:23:54.557803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:23:54.558513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:23:54.559118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:23:54.559543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:23:54.573497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:54.574253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:54.575307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:54.575961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:54.597583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Getting quotas for project 0a2ac213c66b4f7491b9c942aced759a. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:23:54.605111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Getting quotas for user 73f3ef47784445a6b41da056d502526b and project 0a2ac213c66b4f7491b9c942aced759a. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:23:54.626747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:23:54.629139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:23:54.677881 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd5909a2-feac-4bd2-809e-7359bc894ce3 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706976 Jul 26 20:23:54.683809 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3102/6285] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:23:54.689590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f5f5015-0479-4f56-8545-b5ced6aab288 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:54.690796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f5f5015-0479-4f56-8545-b5ced6aab288 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:54.758846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f5f5015-0479-4f56-8545-b5ced6aab288 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:54.766804 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f5f5015-0479-4f56-8545-b5ced6aab288 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1214 microversion: 2.1 time: 0.081048 Jul 26 20:23:54.767702 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3184/6286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:54 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:23:55.147915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-451077e2-9a28-4083-9c1d-bbbb5b0d28a4 req-ac8b788e-ac00-44ce-915b-a19cf5199b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0", "tag": "370e64ab-409d-4a25-bd84-b4f3ad56385b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:55.167451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:23:55.180283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-451077e2-9a28-4083-9c1d-bbbb5b0d28a4 req-ac8b788e-ac00-44ce-915b-a19cf5199b92 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:55.181026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-451077e2-9a28-4083-9c1d-bbbb5b0d28a4 req-ac8b788e-ac00-44ce-915b-a19cf5199b92 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:55.202877 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-451077e2-9a28-4083-9c1d-bbbb5b0d28a4 req-ac8b788e-ac00-44ce-915b-a19cf5199b92 service nova] Creating event network-changed:370e64ab-409d-4a25-bd84-b4f3ad56385b for instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 on n-h1-708768-8 Jul 26 20:23:55.210730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-451077e2-9a28-4083-9c1d-bbbb5b0d28a4 req-ac8b788e-ac00-44ce-915b-a19cf5199b92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066098 Jul 26 20:23:55.217275 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3103/6287] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:55.789507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f07a5030-9d46-4343-848a-00311634d29f tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:55.790171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f07a5030-9d46-4343-848a-00311634d29f tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:55.802355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f07a5030-9d46-4343-848a-00311634d29f tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:55.808466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f07a5030-9d46-4343-848a-00311634d29f tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:55.809497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f07a5030-9d46-4343-848a-00311634d29f tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:55.810231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f07a5030-9d46-4343-848a-00311634d29f tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:55.984860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc01242b-8c38-42a9-be40-188a7faac97c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:55.985603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc01242b-8c38-42a9-be40-188a7faac97c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:55.987308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f07a5030-9d46-4343-848a-00311634d29f tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:55.994561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc01242b-8c38-42a9-be40-188a7faac97c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:55.995173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc01242b-8c38-42a9-be40-188a7faac97c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:55.997164 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f07a5030-9d46-4343-848a-00311634d29f tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1274 microversion: 2.1 time: 0.213256 Jul 26 20:23:56.001136 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3185/6288] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:55 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1274 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:56.001326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc01242b-8c38-42a9-be40-188a7faac97c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:56.001938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc01242b-8c38-42a9-be40-188a7faac97c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:56.006563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-76f204fa-8256-4dd4-a123-6f7a76291114 req-d792328f-3529-4bd9-9569-fd5b6d41a3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca8ed32-5be3-44c5-8d0c-13900e5afe97", "tag": "b7f3c859-eb49-45fd-af6c-a6f730444ba9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:56.037211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-76f204fa-8256-4dd4-a123-6f7a76291114 req-d792328f-3529-4bd9-9569-fd5b6d41a3dd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:56.042183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-76f204fa-8256-4dd4-a123-6f7a76291114 req-d792328f-3529-4bd9-9569-fd5b6d41a3dd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:56.067654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc01242b-8c38-42a9-be40-188a7faac97c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:23:56.073651 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-76f204fa-8256-4dd4-a123-6f7a76291114 req-d792328f-3529-4bd9-9569-fd5b6d41a3dd service nova] Creating event network-changed:b7f3c859-eb49-45fd-af6c-a6f730444ba9 for instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 on n-h1-708768-8 Jul 26 20:23:56.084510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-76f204fa-8256-4dd4-a123-6f7a76291114 req-d792328f-3529-4bd9-9569-fd5b6d41a3dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081392 Jul 26 20:23:56.086219 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3186/6289] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:56.209776 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc01242b-8c38-42a9-be40-188a7faac97c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 204 len: 0 microversion: 2.1 time: 0.231766 Jul 26 20:23:56.212446 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3104/6290] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:23:55 2022] DELETE /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:23:56.222351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7877eace-2ded-4f4d-a827-a75931543856 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:56.223073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7877eace-2ded-4f4d-a827-a75931543856 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:56.230182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7877eace-2ded-4f4d-a827-a75931543856 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:56.230639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7877eace-2ded-4f4d-a827-a75931543856 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:56.231458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7877eace-2ded-4f4d-a827-a75931543856 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:56.231927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7877eace-2ded-4f4d-a827-a75931543856 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:56.401722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7877eace-2ded-4f4d-a827-a75931543856 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:56.409652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7877eace-2ded-4f4d-a827-a75931543856 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1688 microversion: 2.1 time: 0.193353 Jul 26 20:23:56.410462 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3187/6291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:56 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:57.025498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8b5b3d06-7ed9-47c0-a05f-8d25556b56b9 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:57.026494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8b5b3d06-7ed9-47c0-a05f-8d25556b56b9 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:57.041347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b5b3d06-7ed9-47c0-a05f-8d25556b56b9 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:57.045235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b5b3d06-7ed9-47c0-a05f-8d25556b56b9 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:57.046370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b5b3d06-7ed9-47c0-a05f-8d25556b56b9 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:57.046987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b5b3d06-7ed9-47c0-a05f-8d25556b56b9 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:57.154218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8b5b3d06-7ed9-47c0-a05f-8d25556b56b9 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:57.167481 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8b5b3d06-7ed9-47c0-a05f-8d25556b56b9 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1272 microversion: 2.1 time: 0.149445 Jul 26 20:23:57.168297 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3105/6292] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:57 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:57.431387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:57.433463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:57.442019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:57.442845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:57.444181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:57.444916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:57.488207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:57.488930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:57.489546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lazy-loading 'fault' on Instance uuid 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:23:57.578502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:57.597830 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-987303e0-66ec-4c57-be8d-d3033c00dc1a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 200 len: 1355 microversion: 2.1 time: 0.170568 Jul 26 20:23:57.598600 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3188/6293] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:57 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 1355 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:58.177954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4ee8817d-3486-4675-a15b-4a00dfe50e9f req-d3d05336-7109-487b-bda7-4425c947fe7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca8ed32-5be3-44c5-8d0c-13900e5afe97", "name": "network-vif-deleted", "tag": "b7f3c859-eb49-45fd-af6c-a6f730444ba9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:58.189650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f95070f-b8a3-4078-90ce-40988407667a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:58.190988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f95070f-b8a3-4078-90ce-40988407667a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:58.191866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4ee8817d-3486-4675-a15b-4a00dfe50e9f req-d3d05336-7109-487b-bda7-4425c947fe7d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:58.192596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4ee8817d-3486-4675-a15b-4a00dfe50e9f req-d3d05336-7109-487b-bda7-4425c947fe7d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:58.200033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f95070f-b8a3-4078-90ce-40988407667a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:58.203438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f95070f-b8a3-4078-90ce-40988407667a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:58.205363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f95070f-b8a3-4078-90ce-40988407667a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:58.206324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f95070f-b8a3-4078-90ce-40988407667a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:58.219122 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-4ee8817d-3486-4675-a15b-4a00dfe50e9f req-d3d05336-7109-487b-bda7-4425c947fe7d service nova] Creating event network-vif-deleted:b7f3c859-eb49-45fd-af6c-a6f730444ba9 for instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 on n-h1-708768-8 Jul 26 20:23:58.224963 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4ee8817d-3486-4675-a15b-4a00dfe50e9f req-d3d05336-7109-487b-bda7-4425c947fe7d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050613 Jul 26 20:23:58.226140 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3106/6294] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:58.355268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f95070f-b8a3-4078-90ce-40988407667a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:58.362730 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f95070f-b8a3-4078-90ce-40988407667a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1314 microversion: 2.1 time: 0.176924 Jul 26 20:23:58.363873 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3189/6295] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:58 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:23:58.622228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:58.623099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 4ca8ed32-5be3-44c5-8d0c-13900e5afe97] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:58.635594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:58.636065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:58.637284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:58.637910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:58.658536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] HTTP exception thrown: Instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 could not be found. Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Request method failure captured: Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 HTTP/1.1 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4Ev0ii1kBGUjwonVMhglrcrFlU3ywjFoPd0j4-8Ft4EZjC2YdZCk_P7SzH0uKeOzNjC55zbxY6dmJY6OfLxELdx2TCM7IDW_K3LF0CPkmaPQwEIV-GCQklx3o29ilUs5O3xJoo-sekz8seqkI-Y14MIT1Hi5pSkJ3GaJ0NLv_CA6DXk Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: c6c35edbc1a1413c90d22de414aa71e6 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6c35edbc1a1413c90d22de414aa71e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6c35edbc1a1413c90d22de414aa71e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6c35edbc1a1413c90d22de414aa71e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6c35edbc1a1413c90d22de414aa71e6"}]}] Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: c6c35edbc1a1413c90d22de414aa71e6 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestNetworkAdvancedServerOps-357288115-project Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 65245c71525848afaf82742412b31a8a Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestNetworkAdvancedServerOps-357288115-project Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 could not be found. Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '4ca8ed32-5be3-44c5-8d0c-13900e5afe97'} Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 could not be found. Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 could not be found. Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:23:58.660392 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 could not be found. Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Returning 404 to user: Instance 4ca8ed32-5be3-44c5-8d0c-13900e5afe97 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3a4e9293-5239-4da7-86cc-20e939ae715c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97" status: 404 len: 111 microversion: 2.1 time: 0.046171 Jul 26 20:23:58.670058 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3107/6296] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:58 2022] GET /compute/v2.1/servers/4ca8ed32-5be3-44c5-8d0c-13900e5afe97 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:23:58.762211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2b6030d4-2cdc-44b1-ac0e-1b09eb11dde9 req-658e53ba-a19e-4be9-8aa3-528429136ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b59eac9-ef60-43c8-a69d-134adf618c45", "tag": "665b4949-90bc-4af8-86cf-6c245b92d74a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:23:58.791965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2b6030d4-2cdc-44b1-ac0e-1b09eb11dde9 req-658e53ba-a19e-4be9-8aa3-528429136ed5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:58.793228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2b6030d4-2cdc-44b1-ac0e-1b09eb11dde9 req-658e53ba-a19e-4be9-8aa3-528429136ed5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:58.808991 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2b6030d4-2cdc-44b1-ac0e-1b09eb11dde9 req-658e53ba-a19e-4be9-8aa3-528429136ed5 service nova] Creating event network-changed:665b4949-90bc-4af8-86cf-6c245b92d74a for instance 8b59eac9-ef60-43c8-a69d-134adf618c45 on n-h2-708768-8 Jul 26 20:23:58.816463 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2b6030d4-2cdc-44b1-ac0e-1b09eb11dde9 req-658e53ba-a19e-4be9-8aa3-528429136ed5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065484 Jul 26 20:23:58.817626 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3190/6297] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:23:59.384724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d62f1d3-9d99-41f9-85ca-5fc1fe0b9093 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:23:59.385349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d62f1d3-9d99-41f9-85ca-5fc1fe0b9093 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:23:59.392552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d62f1d3-9d99-41f9-85ca-5fc1fe0b9093 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:59.393010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d62f1d3-9d99-41f9-85ca-5fc1fe0b9093 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:59.393784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d62f1d3-9d99-41f9-85ca-5fc1fe0b9093 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:23:59.394494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d62f1d3-9d99-41f9-85ca-5fc1fe0b9093 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:23:59.540732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d62f1d3-9d99-41f9-85ca-5fc1fe0b9093 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:23:59.551517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d62f1d3-9d99-41f9-85ca-5fc1fe0b9093 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1314 microversion: 2.1 time: 0.170631 Jul 26 20:23:59.552386 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3108/6298] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:23:59 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:00.573896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1fce72b2-3406-4ab1-8ece-43b84ba59c66 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:00.574678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1fce72b2-3406-4ab1-8ece-43b84ba59c66 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:00.582022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fce72b2-3406-4ab1-8ece-43b84ba59c66 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:00.582717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fce72b2-3406-4ab1-8ece-43b84ba59c66 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:00.583778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fce72b2-3406-4ab1-8ece-43b84ba59c66 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:00.584404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1fce72b2-3406-4ab1-8ece-43b84ba59c66 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:00.810133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1fce72b2-3406-4ab1-8ece-43b84ba59c66 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:00.818312 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1fce72b2-3406-4ab1-8ece-43b84ba59c66 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1314 microversion: 2.1 time: 0.248497 Jul 26 20:24:00.831631 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3191/6299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:00 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:01.841582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-77672a61-802a-4a6b-b982-2cfbad28c22a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:01.843144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-77672a61-802a-4a6b-b982-2cfbad28c22a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:01.864585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77672a61-802a-4a6b-b982-2cfbad28c22a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:01.865101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77672a61-802a-4a6b-b982-2cfbad28c22a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:01.866263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77672a61-802a-4a6b-b982-2cfbad28c22a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:01.867063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-77672a61-802a-4a6b-b982-2cfbad28c22a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:02.060001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-77672a61-802a-4a6b-b982-2cfbad28c22a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:02.068593 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-77672a61-802a-4a6b-b982-2cfbad28c22a tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1314 microversion: 2.1 time: 0.231004 Jul 26 20:24:02.069853 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3109/6300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:01 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:02.588472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f9ed0a1-4f5a-4e60-b857-1756f481d535 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '.version_select at 0x7f8756f458b0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:02.604539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:02.620894 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f9ed0a1-4f5a-4e60-b857-1756f481d535 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1452605321" status: 202 len: 0 microversion: 2.1 time: 0.037596 Jul 26 20:24:02.624822 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3192/6301] 10.222.0.58 () {58 vars in 1284 bytes} [Tue Jul 26 20:24:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1452605321 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:24:02.656238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8918feed-de33-476e-bf93-f7aabff3008e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'create', calling method: .version_select at 0x7f875d81b280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-207115589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsxXVGFeUU1yqJhXEia2VIwU8b3blNY2nap1on5Yoa3QEO2Ge/6E7n6fuokLIKny6soBpzcvrARGX+YZ0ZeyzSswFPQDKtWNtwDpz/Mb6yZh2w8rXAqp6lURJDqLMVtpQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:02.672943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8918feed-de33-476e-bf93-f7aabff3008e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:24:02.678929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8918feed-de33-476e-bf93-f7aabff3008e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for user 65245c71525848afaf82742412b31a8a and project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:24:02.713102 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8918feed-de33-476e-bf93-f7aabff3008e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060650 Jul 26 20:24:02.713868 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3110/6302] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:24:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:24:03.091268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4c13e1e-482c-418a-86af-fc7fe8b3c81e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:03.092188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4c13e1e-482c-418a-86af-fc7fe8b3c81e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:03.117706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4c13e1e-482c-418a-86af-fc7fe8b3c81e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:03.119329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4c13e1e-482c-418a-86af-fc7fe8b3c81e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:03.120278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4c13e1e-482c-418a-86af-fc7fe8b3c81e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:03.120875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4c13e1e-482c-418a-86af-fc7fe8b3c81e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:03.311432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4c13e1e-482c-418a-86af-fc7fe8b3c81e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:03.325104 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4c13e1e-482c-418a-86af-fc7fe8b3c81e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1314 microversion: 2.1 time: 0.238701 Jul 26 20:24:03.327225 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3193/6303] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:03 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:04.350503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2bafd3b-2cf2-4d43-8b9b-22bc0b5cbe58 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:04.352877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b2bafd3b-2cf2-4d43-8b9b-22bc0b5cbe58 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:04.366935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2bafd3b-2cf2-4d43-8b9b-22bc0b5cbe58 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:04.368518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2bafd3b-2cf2-4d43-8b9b-22bc0b5cbe58 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:04.370533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2bafd3b-2cf2-4d43-8b9b-22bc0b5cbe58 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:04.371468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2bafd3b-2cf2-4d43-8b9b-22bc0b5cbe58 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:04.587696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:04.649223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b2bafd3b-2cf2-4d43-8b9b-22bc0b5cbe58 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:04.661696 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b2bafd3b-2cf2-4d43-8b9b-22bc0b5cbe58 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1314 microversion: 2.1 time: 0.317140 Jul 26 20:24:04.663244 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3111/6304] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:04 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:04.983520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ceb67802-5d21-4f50-b98c-390373d515a1 req-0d2285dd-b959-4608-9e0e-a6d3de2bb17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b59eac9-ef60-43c8-a69d-134adf618c45", "name": "network-vif-plugged", "status": "completed", "tag": "665b4949-90bc-4af8-86cf-6c245b92d74a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:04.995394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:05.004915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ceb67802-5d21-4f50-b98c-390373d515a1 req-0d2285dd-b959-4608-9e0e-a6d3de2bb17a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:05.005744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ceb67802-5d21-4f50-b98c-390373d515a1 req-0d2285dd-b959-4608-9e0e-a6d3de2bb17a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:05.029272 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ceb67802-5d21-4f50-b98c-390373d515a1 req-0d2285dd-b959-4608-9e0e-a6d3de2bb17a service nova] Creating event network-vif-plugged:665b4949-90bc-4af8-86cf-6c245b92d74a for instance 8b59eac9-ef60-43c8-a69d-134adf618c45 on n-h2-708768-8 Jul 26 20:24:05.036226 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ceb67802-5d21-4f50-b98c-390373d515a1 req-0d2285dd-b959-4608-9e0e-a6d3de2bb17a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056192 Jul 26 20:24:05.037460 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3194/6305] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:24:05.682718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-48587820-e5f7-4d1b-b9d7-79239ad63351 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:05.683361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-48587820-e5f7-4d1b-b9d7-79239ad63351 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:05.690475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48587820-e5f7-4d1b-b9d7-79239ad63351 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:05.691289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48587820-e5f7-4d1b-b9d7-79239ad63351 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:05.692133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48587820-e5f7-4d1b-b9d7-79239ad63351 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:05.692944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-48587820-e5f7-4d1b-b9d7-79239ad63351 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:06.214601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-48587820-e5f7-4d1b-b9d7-79239ad63351 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:06.222813 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-48587820-e5f7-4d1b-b9d7-79239ad63351 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1314 microversion: 2.1 time: 0.544342 Jul 26 20:24:06.235633 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3112/6306] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:05 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:07.246463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-14f1382d-ff80-402a-8fa7-9a9b7f9df8ee tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:07.247366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-14f1382d-ff80-402a-8fa7-9a9b7f9df8ee tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:07.255020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14f1382d-ff80-402a-8fa7-9a9b7f9df8ee tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:07.256267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14f1382d-ff80-402a-8fa7-9a9b7f9df8ee tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:07.257453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14f1382d-ff80-402a-8fa7-9a9b7f9df8ee tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:07.259531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-14f1382d-ff80-402a-8fa7-9a9b7f9df8ee tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:07.487881 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-14f1382d-ff80-402a-8fa7-9a9b7f9df8ee tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:07.510820 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-14f1382d-ff80-402a-8fa7-9a9b7f9df8ee tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1464 microversion: 2.1 time: 0.269458 Jul 26 20:24:07.524485 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3195/6307] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:07 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1464 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:07.533861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c630b6ea-013c-428e-8223-fbd770c6a853 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11078448-59cd-4f8d-9644-57d9cc3a8dfd", "device": "/dev/sdb"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:07.540307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c630b6ea-013c-428e-8223-fbd770c6a853 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:07.549814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c630b6ea-013c-428e-8223-fbd770c6a853 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:07.550668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c630b6ea-013c-428e-8223-fbd770c6a853 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:07.551725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c630b6ea-013c-428e-8223-fbd770c6a853 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:07.552396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c630b6ea-013c-428e-8223-fbd770c6a853 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:07.915970 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c630b6ea-013c-428e-8223-fbd770c6a853 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "POST /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385742 Jul 26 20:24:07.917326 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3113/6308] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:24:07 2022] POST /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:24:10.047431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1836528366", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "e9bda524-fbd2-4935-b9e8-965e12a9b674"}], "key_name": "tempest-TestNetworkAdvancedServerOps-207115589", "security_groups": [{"name": "tempest-secgroup-smoke-1251590711"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:10.301854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] validate_networks() for [('e9bda524-fbd2-4935-b9e8-965e12a9b674', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:24:11.211868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:24:11.212489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:24:11.213458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:24:11.214057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:24:11.216192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:24:11.246130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:11.246990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:11.248393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:11.252191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:11.305257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:24:11.326935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Getting quotas for user 65245c71525848afaf82742412b31a8a and project c6c35edbc1a1413c90d22de414aa71e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:24:11.367384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:24:11.376220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:24:11.504183 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9475d3f2-b3b6-4b7e-8579-457c39680f08 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.464644 Jul 26 20:24:11.515666 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3196/6309] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:24:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:24:11.519392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e5847c03-9262-42c0-b6d2-42a87a9a06d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:11.521415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e5847c03-9262-42c0-b6d2-42a87a9a06d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:11.695308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e5847c03-9262-42c0-b6d2-42a87a9a06d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:11.720128 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e5847c03-9262-42c0-b6d2-42a87a9a06d1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1266 microversion: 2.1 time: 0.197870 Jul 26 20:24:11.722186 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3114/6310] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:11 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:12.746182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-30ccf553-fde5-4cd2-8219-1e0a0a861998 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:12.754328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-30ccf553-fde5-4cd2-8219-1e0a0a861998 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:12.769531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30ccf553-fde5-4cd2-8219-1e0a0a861998 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:12.770264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30ccf553-fde5-4cd2-8219-1e0a0a861998 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:12.771737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30ccf553-fde5-4cd2-8219-1e0a0a861998 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:12.773693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-30ccf553-fde5-4cd2-8219-1e0a0a861998 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:12.908411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-30ccf553-fde5-4cd2-8219-1e0a0a861998 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:12.922006 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-30ccf553-fde5-4cd2-8219-1e0a0a861998 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1318 microversion: 2.1 time: 0.176971 Jul 26 20:24:12.937258 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3197/6311] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:12 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:13.949091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46fae60f-ebe1-4ff9-923e-87710f34c6b0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:13.949787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-46fae60f-ebe1-4ff9-923e-87710f34c6b0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:13.967929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46fae60f-ebe1-4ff9-923e-87710f34c6b0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:13.968421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46fae60f-ebe1-4ff9-923e-87710f34c6b0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:13.969248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46fae60f-ebe1-4ff9-923e-87710f34c6b0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:13.969724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46fae60f-ebe1-4ff9-923e-87710f34c6b0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:14.097455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-46fae60f-ebe1-4ff9-923e-87710f34c6b0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:14.106792 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-46fae60f-ebe1-4ff9-923e-87710f34c6b0 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1324 microversion: 2.1 time: 0.161816 Jul 26 20:24:14.107385 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3115/6312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:13 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:15.131968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-074d14af-c3a1-425b-981b-e3e63ddfc99a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:15.134675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-074d14af-c3a1-425b-981b-e3e63ddfc99a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:15.149382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-074d14af-c3a1-425b-981b-e3e63ddfc99a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:15.150078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-074d14af-c3a1-425b-981b-e3e63ddfc99a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:15.151602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-074d14af-c3a1-425b-981b-e3e63ddfc99a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:15.154522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-074d14af-c3a1-425b-981b-e3e63ddfc99a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:15.605923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-074d14af-c3a1-425b-981b-e3e63ddfc99a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:15.615752 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-074d14af-c3a1-425b-981b-e3e63ddfc99a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1392 microversion: 2.1 time: 0.488058 Jul 26 20:24:15.634541 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3198/6313] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:15 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1392 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:15.668889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-07b16d7d-8ac8-4f13-8b6e-69f456bb7b31 req-cfc5b3f7-4b12-4f1c-bc47-43128259c38c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85aa1647-e9f7-4993-bc2e-64f3fe26cad4", "tag": "60e9265c-1d8e-4a0f-986a-a7ff8f2e2489"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:15.697899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-07b16d7d-8ac8-4f13-8b6e-69f456bb7b31 req-cfc5b3f7-4b12-4f1c-bc47-43128259c38c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:15.699113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-07b16d7d-8ac8-4f13-8b6e-69f456bb7b31 req-cfc5b3f7-4b12-4f1c-bc47-43128259c38c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:15.727219 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-07b16d7d-8ac8-4f13-8b6e-69f456bb7b31 req-cfc5b3f7-4b12-4f1c-bc47-43128259c38c service nova] Creating event network-changed:60e9265c-1d8e-4a0f-986a-a7ff8f2e2489 for instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 on n-h1-708768-8 Jul 26 20:24:15.735409 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-07b16d7d-8ac8-4f13-8b6e-69f456bb7b31 req-cfc5b3f7-4b12-4f1c-bc47-43128259c38c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071073 Jul 26 20:24:15.736530 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3116/6314] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:24:16.642010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab6d3901-0e48-4fd0-9802-fc593d57c72f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:16.642776 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ab6d3901-0e48-4fd0-9802-fc593d57c72f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:16.650381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab6d3901-0e48-4fd0-9802-fc593d57c72f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:16.650830 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab6d3901-0e48-4fd0-9802-fc593d57c72f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:16.651636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab6d3901-0e48-4fd0-9802-fc593d57c72f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:16.652070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab6d3901-0e48-4fd0-9802-fc593d57c72f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:16.791185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ab6d3901-0e48-4fd0-9802-fc593d57c72f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:16.799274 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ab6d3901-0e48-4fd0-9802-fc593d57c72f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1392 microversion: 2.1 time: 0.161224 Jul 26 20:24:16.799911 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3199/6315] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:16 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:17.822814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33499a47-31ca-4edd-ad07-afcd2f1389e7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:17.823548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-33499a47-31ca-4edd-ad07-afcd2f1389e7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:17.830619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33499a47-31ca-4edd-ad07-afcd2f1389e7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:17.831058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33499a47-31ca-4edd-ad07-afcd2f1389e7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:17.831916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33499a47-31ca-4edd-ad07-afcd2f1389e7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:17.832381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33499a47-31ca-4edd-ad07-afcd2f1389e7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:17.991493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-33499a47-31ca-4edd-ad07-afcd2f1389e7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:18.000848 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-33499a47-31ca-4edd-ad07-afcd2f1389e7 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1392 microversion: 2.1 time: 0.183923 Jul 26 20:24:18.001853 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3117/6316] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:17 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:24:19.037836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9126e202-d6d7-4172-b75d-5b4d926a25c9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:19.038448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9126e202-d6d7-4172-b75d-5b4d926a25c9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:19.045252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9126e202-d6d7-4172-b75d-5b4d926a25c9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:19.045731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9126e202-d6d7-4172-b75d-5b4d926a25c9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:19.046520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9126e202-d6d7-4172-b75d-5b4d926a25c9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:19.046968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9126e202-d6d7-4172-b75d-5b4d926a25c9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:19.195043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9126e202-d6d7-4172-b75d-5b4d926a25c9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:19.205529 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9126e202-d6d7-4172-b75d-5b4d926a25c9 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1392 microversion: 2.1 time: 0.185868 Jul 26 20:24:19.206878 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3200/6317] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:19 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:20.230370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0ac039b-6682-4668-8b67-e1d09971430f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:20.231007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0ac039b-6682-4668-8b67-e1d09971430f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:20.238160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ac039b-6682-4668-8b67-e1d09971430f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:20.239491 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ac039b-6682-4668-8b67-e1d09971430f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:20.240316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ac039b-6682-4668-8b67-e1d09971430f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:20.240947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ac039b-6682-4668-8b67-e1d09971430f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:20.397671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0ac039b-6682-4668-8b67-e1d09971430f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:20.405263 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0ac039b-6682-4668-8b67-e1d09971430f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1392 microversion: 2.1 time: 0.179319 Jul 26 20:24:20.415920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3118/6318] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:20 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:21.428073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0fe29c7b-fecc-4464-bd85-bf4fa4cb81aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:21.428635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0fe29c7b-fecc-4464-bd85-bf4fa4cb81aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:21.431686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:21.432649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:21.439600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fe29c7b-fecc-4464-bd85-bf4fa4cb81aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:21.440381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fe29c7b-fecc-4464-bd85-bf4fa4cb81aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:21.441348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fe29c7b-fecc-4464-bd85-bf4fa4cb81aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:21.442754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0fe29c7b-fecc-4464-bd85-bf4fa4cb81aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:21.446725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=93 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:21.615985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0fe29c7b-fecc-4464-bd85-bf4fa4cb81aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:21.624356 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0fe29c7b-fecc-4464-bd85-bf4fa4cb81aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1392 microversion: 2.1 time: 0.201108 Jul 26 20:24:21.625118 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3201/6319] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:21 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:22.651004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-abcfc82d-be35-464c-8436-f499d40ad610 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:22.652340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-abcfc82d-be35-464c-8436-f499d40ad610 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:22.661392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:22.663655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abcfc82d-be35-464c-8436-f499d40ad610 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:22.664391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abcfc82d-be35-464c-8436-f499d40ad610 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:22.665193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abcfc82d-be35-464c-8436-f499d40ad610 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:22.665644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-abcfc82d-be35-464c-8436-f499d40ad610 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:22.669812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:22.815988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-abcfc82d-be35-464c-8436-f499d40ad610 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:22.824545 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-abcfc82d-be35-464c-8436-f499d40ad610 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1392 microversion: 2.1 time: 0.182237 Jul 26 20:24:22.825132 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3119/6320] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:22 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:23.230375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ef64d08e-4391-41e7-9a0e-72e99b1cea00 req-539fa628-2aa8-4c4b-805c-118c22fbe7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85aa1647-e9f7-4993-bc2e-64f3fe26cad4", "name": "network-vif-plugged", "status": "completed", "tag": "60e9265c-1d8e-4a0f-986a-a7ff8f2e2489"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:23.241445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ef64d08e-4391-41e7-9a0e-72e99b1cea00 req-539fa628-2aa8-4c4b-805c-118c22fbe7bc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:23.242102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ef64d08e-4391-41e7-9a0e-72e99b1cea00 req-539fa628-2aa8-4c4b-805c-118c22fbe7bc service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:23.256621 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ef64d08e-4391-41e7-9a0e-72e99b1cea00 req-539fa628-2aa8-4c4b-805c-118c22fbe7bc service nova] Creating event network-vif-plugged:60e9265c-1d8e-4a0f-986a-a7ff8f2e2489 for instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 on n-h1-708768-8 Jul 26 20:24:23.262024 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ef64d08e-4391-41e7-9a0e-72e99b1cea00 req-539fa628-2aa8-4c4b-805c-118c22fbe7bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035321 Jul 26 20:24:23.263129 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3202/6321] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:24:23.848782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8b5909db-e43f-4578-a70b-db2e1c20ff6f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:23.849417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8b5909db-e43f-4578-a70b-db2e1c20ff6f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:23.867755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b5909db-e43f-4578-a70b-db2e1c20ff6f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:23.872021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b5909db-e43f-4578-a70b-db2e1c20ff6f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:23.872614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b5909db-e43f-4578-a70b-db2e1c20ff6f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:23.873258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8b5909db-e43f-4578-a70b-db2e1c20ff6f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:24.041980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8b5909db-e43f-4578-a70b-db2e1c20ff6f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:24.050229 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8b5909db-e43f-4578-a70b-db2e1c20ff6f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1392 microversion: 2.1 time: 0.208172 Jul 26 20:24:24.051456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3120/6322] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:23 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:24:25.074925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-62f811c7-df9f-43a5-81ac-068fb96f9a96 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:25.075782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-62f811c7-df9f-43a5-81ac-068fb96f9a96 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:25.083705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62f811c7-df9f-43a5-81ac-068fb96f9a96 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:25.084174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62f811c7-df9f-43a5-81ac-068fb96f9a96 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:25.084999 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62f811c7-df9f-43a5-81ac-068fb96f9a96 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:25.085444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62f811c7-df9f-43a5-81ac-068fb96f9a96 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:25.258363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62f811c7-df9f-43a5-81ac-068fb96f9a96 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:25.268975 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-62f811c7-df9f-43a5-81ac-068fb96f9a96 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1564 microversion: 2.1 time: 0.198828 Jul 26 20:24:25.269613 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3203/6323] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:25 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:25.293928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-589e5303-52a7-4f73-b0bb-77980183ed72 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:25.294614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-589e5303-52a7-4f73-b0bb-77980183ed72 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:25.299128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:25.306448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-589e5303-52a7-4f73-b0bb-77980183ed72 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:25.306906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-589e5303-52a7-4f73-b0bb-77980183ed72 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:25.307760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-589e5303-52a7-4f73-b0bb-77980183ed72 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:25.308208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-589e5303-52a7-4f73-b0bb-77980183ed72 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:25.508337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-589e5303-52a7-4f73-b0bb-77980183ed72 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:25.516676 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-589e5303-52a7-4f73-b0bb-77980183ed72 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1564 microversion: 2.1 time: 0.226744 Jul 26 20:24:25.517267 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3121/6324] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:25 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1564 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:27.296613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b7ccfc8-a18b-452c-aca7-dc82477bbd8c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:27.297809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b7ccfc8-a18b-452c-aca7-dc82477bbd8c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:27.301621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-54961eef-d76b-44c2-8409-26ae5dc86ddc req-d094421f-1f56-45f5-890a-fe67ae11cb8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85aa1647-e9f7-4993-bc2e-64f3fe26cad4", "tag": "60e9265c-1d8e-4a0f-986a-a7ff8f2e2489"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:27.315053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-54961eef-d76b-44c2-8409-26ae5dc86ddc req-d094421f-1f56-45f5-890a-fe67ae11cb8a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:27.316346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-54961eef-d76b-44c2-8409-26ae5dc86ddc req-d094421f-1f56-45f5-890a-fe67ae11cb8a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:27.323503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b7ccfc8-a18b-452c-aca7-dc82477bbd8c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:27.326760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b7ccfc8-a18b-452c-aca7-dc82477bbd8c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:27.328066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b7ccfc8-a18b-452c-aca7-dc82477bbd8c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:27.330262 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b7ccfc8-a18b-452c-aca7-dc82477bbd8c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:27.331531 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-54961eef-d76b-44c2-8409-26ae5dc86ddc req-d094421f-1f56-45f5-890a-fe67ae11cb8a service nova] Creating event network-changed:60e9265c-1d8e-4a0f-986a-a7ff8f2e2489 for instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 on n-h1-708768-8 Jul 26 20:24:27.338014 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-54961eef-d76b-44c2-8409-26ae5dc86ddc req-d094421f-1f56-45f5-890a-fe67ae11cb8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040846 Jul 26 20:24:27.342415 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3122/6325] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 20:24:27.641936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b7ccfc8-a18b-452c-aca7-dc82477bbd8c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:27.662376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b7ccfc8-a18b-452c-aca7-dc82477bbd8c tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1564 microversion: 2.1 time: 0.369930 Jul 26 20:24:27.668997 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3204/6326] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:27 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1564 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:50.091245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46ea43ec-c8fb-41af-9209-8fe420c53dcc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:50.093887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-46ea43ec-c8fb-41af-9209-8fe420c53dcc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:50.103696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:50.104582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=19 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:50.106630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46ea43ec-c8fb-41af-9209-8fe420c53dcc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:50.107267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46ea43ec-c8fb-41af-9209-8fe420c53dcc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:50.108303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46ea43ec-c8fb-41af-9209-8fe420c53dcc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:50.109711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-46ea43ec-c8fb-41af-9209-8fe420c53dcc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:50.179878 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-46ea43ec-c8fb-41af-9209-8fe420c53dcc tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4/action" status: 200 len: 24572 microversion: 2.1 time: 0.093938 Jul 26 20:24:50.181212 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3123/6327] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:24:50 2022] POST /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4/action => generated 24572 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:24:56.636967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:24:56.639759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:56.642856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:56.643743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=19 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:24:56.658758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:56.659217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:56.660026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:56.660458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:56.762057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:24:56.762993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:24:56.763728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:24:56.764355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:24:56.764771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:24:56.833515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:56.839811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:56.840695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:56.841045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:56.841518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:56.875219 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-189543dc-acd9-4edd-bc35-48c2887f89c8 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4/action" status: 202 len: 1138 microversion: 2.1 time: 0.242273 Jul 26 20:24:56.877103 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3205/6328] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:24:56 2022] POST /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4/action => generated 1138 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 20:24:56.897077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0caff573-f705-43d5-81bf-1fdc88b0c62e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:56.898508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0caff573-f705-43d5-81bf-1fdc88b0c62e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:56.906983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0caff573-f705-43d5-81bf-1fdc88b0c62e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:56.907802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0caff573-f705-43d5-81bf-1fdc88b0c62e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:56.908656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0caff573-f705-43d5-81bf-1fdc88b0c62e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:56.909325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0caff573-f705-43d5-81bf-1fdc88b0c62e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:57.107431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0caff573-f705-43d5-81bf-1fdc88b0c62e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:57.116186 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0caff573-f705-43d5-81bf-1fdc88b0c62e tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.224643 Jul 26 20:24:57.116784 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3124/6329] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:56 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:58.159487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa6cd01b-8538-4acc-af91-4556f87098a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:58.163112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa6cd01b-8538-4acc-af91-4556f87098a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:58.178298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa6cd01b-8538-4acc-af91-4556f87098a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:58.179640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa6cd01b-8538-4acc-af91-4556f87098a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:58.181261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa6cd01b-8538-4acc-af91-4556f87098a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:58.182334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa6cd01b-8538-4acc-af91-4556f87098a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:58.351549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fa6cd01b-8538-4acc-af91-4556f87098a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:58.361951 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa6cd01b-8538-4acc-af91-4556f87098a1 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.226082 Jul 26 20:24:58.362538 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3206/6330] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:58 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:24:59.385066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9f8dddf5-aa6e-4657-b207-9c8cccd016be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:24:59.386373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9f8dddf5-aa6e-4657-b207-9c8cccd016be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:24:59.395302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f8dddf5-aa6e-4657-b207-9c8cccd016be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:59.395990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f8dddf5-aa6e-4657-b207-9c8cccd016be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:59.396987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f8dddf5-aa6e-4657-b207-9c8cccd016be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:24:59.397653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f8dddf5-aa6e-4657-b207-9c8cccd016be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:24:59.558868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9f8dddf5-aa6e-4657-b207-9c8cccd016be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:24:59.574863 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9f8dddf5-aa6e-4657-b207-9c8cccd016be tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.194365 Jul 26 20:24:59.575773 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3125/6331] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:24:59 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:00.610667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8199d710-8c73-4ee6-87e3-2d050e2868aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:00.611307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8199d710-8c73-4ee6-87e3-2d050e2868aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:00.627444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8199d710-8c73-4ee6-87e3-2d050e2868aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:00.628125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8199d710-8c73-4ee6-87e3-2d050e2868aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:00.629115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8199d710-8c73-4ee6-87e3-2d050e2868aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:00.629724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8199d710-8c73-4ee6-87e3-2d050e2868aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:00.789041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8199d710-8c73-4ee6-87e3-2d050e2868aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:00.803690 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8199d710-8c73-4ee6-87e3-2d050e2868aa tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.205548 Jul 26 20:25:00.804626 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3207/6332] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:00 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:01.825593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82b30df5-00ff-47a4-bee2-5927d2edad99 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:01.826222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-82b30df5-00ff-47a4-bee2-5927d2edad99 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:01.834360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82b30df5-00ff-47a4-bee2-5927d2edad99 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:01.834913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82b30df5-00ff-47a4-bee2-5927d2edad99 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:01.835743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82b30df5-00ff-47a4-bee2-5927d2edad99 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:01.836190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82b30df5-00ff-47a4-bee2-5927d2edad99 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:01.985681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-82b30df5-00ff-47a4-bee2-5927d2edad99 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:01.993849 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-82b30df5-00ff-47a4-bee2-5927d2edad99 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.172316 Jul 26 20:25:01.994983 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3126/6333] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:01 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:25:03.015984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-426c2939-ff77-453c-8205-6440596ae26d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:03.016803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-426c2939-ff77-453c-8205-6440596ae26d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:03.039185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-426c2939-ff77-453c-8205-6440596ae26d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:03.039754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-426c2939-ff77-453c-8205-6440596ae26d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:03.040619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-426c2939-ff77-453c-8205-6440596ae26d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:03.041137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-426c2939-ff77-453c-8205-6440596ae26d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:03.216792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-426c2939-ff77-453c-8205-6440596ae26d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:03.236751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-426c2939-ff77-453c-8205-6440596ae26d tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.224793 Jul 26 20:25:03.238097 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3208/6334] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:03 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:04.259058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b57f8c35-a9ba-485f-ad56-3643e5050741 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:04.260973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b57f8c35-a9ba-485f-ad56-3643e5050741 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:04.269323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b57f8c35-a9ba-485f-ad56-3643e5050741 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:04.269890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b57f8c35-a9ba-485f-ad56-3643e5050741 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:04.271096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b57f8c35-a9ba-485f-ad56-3643e5050741 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:04.271632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b57f8c35-a9ba-485f-ad56-3643e5050741 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:04.417338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b57f8c35-a9ba-485f-ad56-3643e5050741 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:04.426636 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b57f8c35-a9ba-485f-ad56-3643e5050741 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.171904 Jul 26 20:25:04.427496 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3127/6335] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:04 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:05.448029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7587fd72-08c0-4252-9703-9ab9ec9ce518 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:05.448639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7587fd72-08c0-4252-9703-9ab9ec9ce518 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:05.457444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7587fd72-08c0-4252-9703-9ab9ec9ce518 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:05.457892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7587fd72-08c0-4252-9703-9ab9ec9ce518 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:05.458663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7587fd72-08c0-4252-9703-9ab9ec9ce518 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:05.459098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7587fd72-08c0-4252-9703-9ab9ec9ce518 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:05.612726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7587fd72-08c0-4252-9703-9ab9ec9ce518 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:05.620845 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7587fd72-08c0-4252-9703-9ab9ec9ce518 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.176662 Jul 26 20:25:05.621509 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3209/6336] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:05 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:06.646557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e186b8e2-ac6e-46ae-93ab-4c92125c5c07 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:06.647967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e186b8e2-ac6e-46ae-93ab-4c92125c5c07 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:06.657035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e186b8e2-ac6e-46ae-93ab-4c92125c5c07 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:06.658475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e186b8e2-ac6e-46ae-93ab-4c92125c5c07 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:06.659497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e186b8e2-ac6e-46ae-93ab-4c92125c5c07 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:06.660166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e186b8e2-ac6e-46ae-93ab-4c92125c5c07 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:06.819764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e186b8e2-ac6e-46ae-93ab-4c92125c5c07 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:06.838278 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e186b8e2-ac6e-46ae-93ab-4c92125c5c07 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.196352 Jul 26 20:25:06.839297 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3128/6337] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:06 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:07.868240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e3bb3464-c732-4e2e-a699-d82cbffe9490 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:07.868871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e3bb3464-c732-4e2e-a699-d82cbffe9490 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:07.877348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3bb3464-c732-4e2e-a699-d82cbffe9490 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:07.877791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3bb3464-c732-4e2e-a699-d82cbffe9490 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:07.878621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3bb3464-c732-4e2e-a699-d82cbffe9490 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:07.879058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3bb3464-c732-4e2e-a699-d82cbffe9490 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:08.031704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e3bb3464-c732-4e2e-a699-d82cbffe9490 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:08.040842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e3bb3464-c732-4e2e-a699-d82cbffe9490 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1692 microversion: 2.1 time: 0.176567 Jul 26 20:25:08.041656 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3210/6338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:07 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:09.064788 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f7979fae-cd47-49c7-954a-d9bcc2abd816 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:09.066862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f7979fae-cd47-49c7-954a-d9bcc2abd816 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:09.074807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7979fae-cd47-49c7-954a-d9bcc2abd816 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:09.075537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7979fae-cd47-49c7-954a-d9bcc2abd816 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:09.076769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7979fae-cd47-49c7-954a-d9bcc2abd816 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:09.078202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f7979fae-cd47-49c7-954a-d9bcc2abd816 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:09.239038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f7979fae-cd47-49c7-954a-d9bcc2abd816 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:09.253565 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f7979fae-cd47-49c7-954a-d9bcc2abd816 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1698 microversion: 2.1 time: 0.193608 Jul 26 20:25:09.256200 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3129/6339] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:09 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:25:10.274629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-daa82197-191e-4e4b-8238-c3d919620b68 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:10.277307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-daa82197-191e-4e4b-8238-c3d919620b68 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:10.286645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daa82197-191e-4e4b-8238-c3d919620b68 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:10.287382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daa82197-191e-4e4b-8238-c3d919620b68 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:10.288198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daa82197-191e-4e4b-8238-c3d919620b68 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:10.288799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-daa82197-191e-4e4b-8238-c3d919620b68 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:10.442740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-daa82197-191e-4e4b-8238-c3d919620b68 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:10.451349 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-daa82197-191e-4e4b-8238-c3d919620b68 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1698 microversion: 2.1 time: 0.180710 Jul 26 20:25:10.453954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3211/6340] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:10 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:11.446383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1d7a54e2-9082-4230-aa7b-12181d7c1919 req-c7a238b6-7acb-4444-b677-687f7f907e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85aa1647-e9f7-4993-bc2e-64f3fe26cad4", "name": "network-vif-unplugged", "status": "completed", "tag": "60e9265c-1d8e-4a0f-986a-a7ff8f2e2489"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:25:11.467492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1d7a54e2-9082-4230-aa7b-12181d7c1919 req-c7a238b6-7acb-4444-b677-687f7f907e4e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:11.469982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1d7a54e2-9082-4230-aa7b-12181d7c1919 req-c7a238b6-7acb-4444-b677-687f7f907e4e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:11.474990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88517121-559f-4fcb-a366-cafa1cf3c41f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:11.475767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-88517121-559f-4fcb-a366-cafa1cf3c41f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:11.484155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88517121-559f-4fcb-a366-cafa1cf3c41f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:11.484613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88517121-559f-4fcb-a366-cafa1cf3c41f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:11.485500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88517121-559f-4fcb-a366-cafa1cf3c41f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:11.485942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88517121-559f-4fcb-a366-cafa1cf3c41f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:11.494031 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1d7a54e2-9082-4230-aa7b-12181d7c1919 req-c7a238b6-7acb-4444-b677-687f7f907e4e service nova] Creating event network-vif-unplugged:60e9265c-1d8e-4a0f-986a-a7ff8f2e2489 for instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 on n-h1-708768-8 Jul 26 20:25:11.505394 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1d7a54e2-9082-4230-aa7b-12181d7c1919 req-c7a238b6-7acb-4444-b677-687f7f907e4e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067380 Jul 26 20:25:11.507418 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3130/6341] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:25:11.674213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-88517121-559f-4fcb-a366-cafa1cf3c41f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:11.682783 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88517121-559f-4fcb-a366-cafa1cf3c41f tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1683 microversion: 2.1 time: 0.211577 Jul 26 20:25:11.683378 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3212/6342] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:11 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:25:13.535490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a1b37433-f541-4c29-b48e-2b4a9288b2a5 req-95b31716-1505-438f-b498-0ac653d7dbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85aa1647-e9f7-4993-bc2e-64f3fe26cad4", "name": "network-vif-plugged", "status": "completed", "tag": "60e9265c-1d8e-4a0f-986a-a7ff8f2e2489"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:25:13.548552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a1b37433-f541-4c29-b48e-2b4a9288b2a5 req-95b31716-1505-438f-b498-0ac653d7dbe0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:13.548917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a1b37433-f541-4c29-b48e-2b4a9288b2a5 req-95b31716-1505-438f-b498-0ac653d7dbe0 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:13.560595 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a1b37433-f541-4c29-b48e-2b4a9288b2a5 req-95b31716-1505-438f-b498-0ac653d7dbe0 service nova] Creating event network-vif-plugged:60e9265c-1d8e-4a0f-986a-a7ff8f2e2489 for instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 on n-h1-708768-8 Jul 26 20:25:13.567212 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a1b37433-f541-4c29-b48e-2b4a9288b2a5 req-95b31716-1505-438f-b498-0ac653d7dbe0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037295 Jul 26 20:25:13.571276 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3131/6343] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:25:17.388198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9ab06f63-c6e1-47cc-8883-2903e2b62b4d tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:17.388725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9ab06f63-c6e1-47cc-8883-2903e2b62b4d tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:17.396627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ab06f63-c6e1-47cc-8883-2903e2b62b4d tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:17.397077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ab06f63-c6e1-47cc-8883-2903e2b62b4d tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:17.397882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ab06f63-c6e1-47cc-8883-2903e2b62b4d tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:17.398323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ab06f63-c6e1-47cc-8883-2903e2b62b4d tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:17.485090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-9ab06f63-c6e1-47cc-8883-2903e2b62b4d tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lazy-loading 'services' on Instance uuid 8b59eac9-ef60-43c8-a69d-134adf618c45 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:25:17.565144 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9ab06f63-c6e1-47cc-8883-2903e2b62b4d tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45/os-volume_attachments/11078448-59cd-4f8d-9644-57d9cc3a8dfd" status: 202 len: 0 microversion: 2.1 time: 0.180787 Jul 26 20:25:17.566065 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3213/6344] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:25:17 2022] DELETE /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45/os-volume_attachments/11078448-59cd-4f8d-9644-57d9cc3a8dfd => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:25:22.950511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2155bac-7c43-4a5b-8edd-d20db1e124a7 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:22.951808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b2155bac-7c43-4a5b-8edd-d20db1e124a7 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:22.953728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=19 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:25:22.959397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2155bac-7c43-4a5b-8edd-d20db1e124a7 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:22.959880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2155bac-7c43-4a5b-8edd-d20db1e124a7 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:22.960660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2155bac-7c43-4a5b-8edd-d20db1e124a7 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:22.961101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2155bac-7c43-4a5b-8edd-d20db1e124a7 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:22.964106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=45 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:25:22.989121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b2155bac-7c43-4a5b-8edd-d20db1e124a7 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:25:23.070095 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b2155bac-7c43-4a5b-8edd-d20db1e124a7 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 204 len: 0 microversion: 2.1 time: 0.124377 Jul 26 20:25:23.070698 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3132/6345] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:25:22 2022] DELETE /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:25:23.082124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-42490797-8105-4a91-af77-b278b9a59f73 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:23.082850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-42490797-8105-4a91-af77-b278b9a59f73 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:23.089613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42490797-8105-4a91-af77-b278b9a59f73 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:23.090071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42490797-8105-4a91-af77-b278b9a59f73 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:23.090856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42490797-8105-4a91-af77-b278b9a59f73 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:23.091300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42490797-8105-4a91-af77-b278b9a59f73 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:23.233636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-42490797-8105-4a91-af77-b278b9a59f73 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:23.241430 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-42490797-8105-4a91-af77-b278b9a59f73 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1470 microversion: 2.1 time: 0.166065 Jul 26 20:25:23.242005 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3214/6346] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:23 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:24.264399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60cc1445-6f07-420c-abe0-7e2a2998c663 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:24.265244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60cc1445-6f07-420c-abe0-7e2a2998c663 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:24.273291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60cc1445-6f07-420c-abe0-7e2a2998c663 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:24.273766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60cc1445-6f07-420c-abe0-7e2a2998c663 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:24.274616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60cc1445-6f07-420c-abe0-7e2a2998c663 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:24.275249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60cc1445-6f07-420c-abe0-7e2a2998c663 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:24.446913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60cc1445-6f07-420c-abe0-7e2a2998c663 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:24.457149 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60cc1445-6f07-420c-abe0-7e2a2998c663 tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1470 microversion: 2.1 time: 0.198000 Jul 26 20:25:24.457758 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3133/6347] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:24 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:25.224770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ab3104cb-2a41-4443-8f2c-06fc6516dfaa req-af554bc0-6c5d-426a-a7e4-a07b050be3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b59eac9-ef60-43c8-a69d-134adf618c45", "name": "network-vif-deleted", "tag": "665b4949-90bc-4af8-86cf-6c245b92d74a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:25:25.236560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ab3104cb-2a41-4443-8f2c-06fc6516dfaa req-af554bc0-6c5d-426a-a7e4-a07b050be3a1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:25.237069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ab3104cb-2a41-4443-8f2c-06fc6516dfaa req-af554bc0-6c5d-426a-a7e4-a07b050be3a1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:25.250854 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ab3104cb-2a41-4443-8f2c-06fc6516dfaa req-af554bc0-6c5d-426a-a7e4-a07b050be3a1 service nova] Creating event network-vif-deleted:665b4949-90bc-4af8-86cf-6c245b92d74a for instance 8b59eac9-ef60-43c8-a69d-134adf618c45 on n-h2-708768-8 Jul 26 20:25:25.256053 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ab3104cb-2a41-4443-8f2c-06fc6516dfaa req-af554bc0-6c5d-426a-a7e4-a07b050be3a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035240 Jul 26 20:25:25.256941 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3215/6348] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:25:25.479583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:25.480255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:25.488524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:25.489011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:25.489745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:25.490508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:25.524116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:25.524664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:25.525193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lazy-loading 'fault' on Instance uuid 8b59eac9-ef60-43c8-a69d-134adf618c45 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:25:25.572116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3ef47784445a6b41da056d502526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ac213c66b4f7491b9c942aced759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:25.580621 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11a2433e-f7cd-464b-88cd-0dcf2a6d96fd tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 200 len: 1304 microversion: 2.1 time: 0.105326 Jul 26 20:25:25.581493 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3134/6349] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:25 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:26.604175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:26.604774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] [instance: 8b59eac9-ef60-43c8-a69d-134adf618c45] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:26.611338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:26.611831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:26.612599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:26.613043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:26.629144 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] HTTP exception thrown: Instance 8b59eac9-ef60-43c8-a69d-134adf618c45 could not be found. Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Request method failure captured: Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 HTTP/1.1 Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E1YOhLOn_JCqNuoziU_xxxr6grTSr0FuAASxECDWvQ2H6Fd6V_0pw9uuAXwDJwjWLj8xjGtrF8nqkTODkkTgbtashev20NbE8foglhL62tc7PS6WaUXfzL1uRkjMKrlaXLIzCOHy2gh0vokR-Nh8KdnNeevCVDVTg2Wsg8U9brJWF8 Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 0a2ac213c66b4f7491b9c942aced759a Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-VolumesBackupsTest-1445082682 Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0a2ac213c66b4f7491b9c942aced759a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0a2ac213c66b4f7491b9c942aced759a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0a2ac213c66b4f7491b9c942aced759a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0a2ac213c66b4f7491b9c942aced759a"}]}] Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-VolumesBackupsTest-1445082682 Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 0a2ac213c66b4f7491b9c942aced759a Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-VolumesBackupsTest-1445082682 Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-VolumesBackupsTest-1445082682-project Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 73f3ef47784445a6b41da056d502526b Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-VolumesBackupsTest-1445082682-project Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 8b59eac9-ef60-43c8-a69d-134adf618c45 could not be found. Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '8b59eac9-ef60-43c8-a69d-134adf618c45'} Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b59eac9-ef60-43c8-a69d-134adf618c45 could not be found. Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b59eac9-ef60-43c8-a69d-134adf618c45 could not be found. Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:25:26.630860 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b59eac9-ef60-43c8-a69d-134adf618c45 could not be found. Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] Returning 404 to user: Instance 8b59eac9-ef60-43c8-a69d-134adf618c45 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-677a1bab-340f-4f85-895b-6f8007973e4e tempest-VolumesBackupsTest-1445082682 tempest-VolumesBackupsTest-1445082682-project] 10.222.0.58 "GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45" status: 404 len: 111 microversion: 2.1 time: 0.033548 Jul 26 20:25:26.635427 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3216/6350] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:26 2022] GET /compute/v2.1/servers/8b59eac9-ef60-43c8-a69d-134adf618c45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:25:35.901449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9dd31229-8b7f-4da1-8d7e-83d1d00c899a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:25:35.905962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9dd31229-8b7f-4da1-8d7e-83d1d00c899a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:35.912090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:25:35.912930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:25:35.915153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dd31229-8b7f-4da1-8d7e-83d1d00c899a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:35.916207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dd31229-8b7f-4da1-8d7e-83d1d00c899a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:35.917359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dd31229-8b7f-4da1-8d7e-83d1d00c899a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:35.918017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9dd31229-8b7f-4da1-8d7e-83d1d00c899a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:35.983594 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9dd31229-8b7f-4da1-8d7e-83d1d00c899a tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "POST /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4/action" status: 200 len: 24567 microversion: 2.1 time: 0.086484 Jul 26 20:25:35.984820 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3135/6351] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:25:35 2022] POST /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4/action => generated 24567 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:25:45.082587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bfa3008-a7a2-4368-81af-2fad6f99efb5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:45.083817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5bfa3008-a7a2-4368-81af-2fad6f99efb5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:45.090522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-8f65b86f-4060-43b4-b780-ee1f562059f5 req-ca36d072-384b-4a14-81e1-ef03712d8d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85aa1647-e9f7-4993-bc2e-64f3fe26cad4", "tag": "60e9265c-1d8e-4a0f-986a-a7ff8f2e2489"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:25:45.091805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=28 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:25:45.092691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:25:45.096803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bfa3008-a7a2-4368-81af-2fad6f99efb5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:45.097466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bfa3008-a7a2-4368-81af-2fad6f99efb5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:45.100308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bfa3008-a7a2-4368-81af-2fad6f99efb5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:45.105868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bfa3008-a7a2-4368-81af-2fad6f99efb5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:45.117987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8f65b86f-4060-43b4-b780-ee1f562059f5 req-ca36d072-384b-4a14-81e1-ef03712d8d0f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:45.118806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-8f65b86f-4060-43b4-b780-ee1f562059f5 req-ca36d072-384b-4a14-81e1-ef03712d8d0f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:45.149871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-8f65b86f-4060-43b4-b780-ee1f562059f5 req-ca36d072-384b-4a14-81e1-ef03712d8d0f service nova] Creating event network-changed:60e9265c-1d8e-4a0f-986a-a7ff8f2e2489 for instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 on n-h1-708768-8 Jul 26 20:25:45.157933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-8f65b86f-4060-43b4-b780-ee1f562059f5 req-ca36d072-384b-4a14-81e1-ef03712d8d0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072750 Jul 26 20:25:45.161452 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3136/6352] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:25:45.165349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5bfa3008-a7a2-4368-81af-2fad6f99efb5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:25:45.310947 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5bfa3008-a7a2-4368-81af-2fad6f99efb5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 204 len: 0 microversion: 2.1 time: 0.230144 Jul 26 20:25:45.312308 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3217/6353] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:25:45 2022] DELETE /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:25:45.322030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a2d60230-9e62-48d0-a084-5da1dff8af56 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:45.322757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a2d60230-9e62-48d0-a084-5da1dff8af56 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:45.347820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2d60230-9e62-48d0-a084-5da1dff8af56 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:45.348201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2d60230-9e62-48d0-a084-5da1dff8af56 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:45.348994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2d60230-9e62-48d0-a084-5da1dff8af56 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:45.349443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2d60230-9e62-48d0-a084-5da1dff8af56 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:45.665238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a2d60230-9e62-48d0-a084-5da1dff8af56 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:45.682985 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a2d60230-9e62-48d0-a084-5da1dff8af56 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1689 microversion: 2.1 time: 0.365797 Jul 26 20:25:45.685368 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3137/6354] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:45 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1689 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:25:46.711631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-033b551d-f4fe-4dff-8338-b1574de40fd5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:46.712550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-033b551d-f4fe-4dff-8338-b1574de40fd5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:46.733483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-033b551d-f4fe-4dff-8338-b1574de40fd5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:46.737677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-033b551d-f4fe-4dff-8338-b1574de40fd5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:46.739811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-033b551d-f4fe-4dff-8338-b1574de40fd5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:46.742157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-033b551d-f4fe-4dff-8338-b1574de40fd5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:47.366643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-033b551d-f4fe-4dff-8338-b1574de40fd5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65245c71525848afaf82742412b31a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c35edbc1a1413c90d22de414aa71e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:47.388199 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-033b551d-f4fe-4dff-8338-b1574de40fd5 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 200 len: 1689 microversion: 2.1 time: 0.669010 Jul 26 20:25:47.403782 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3218/6355] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:46 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 1689 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:47.516004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-18d05ff3-f0a2-4d8d-b613-2ea7f91e7cc0 req-bf8832d8-4b30-4eec-8016-c829bd989d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85aa1647-e9f7-4993-bc2e-64f3fe26cad4", "name": "network-vif-deleted", "tag": "60e9265c-1d8e-4a0f-986a-a7ff8f2e2489"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:25:47.537818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-18d05ff3-f0a2-4d8d-b613-2ea7f91e7cc0 req-bf8832d8-4b30-4eec-8016-c829bd989d6c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:47.538362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-18d05ff3-f0a2-4d8d-b613-2ea7f91e7cc0 req-bf8832d8-4b30-4eec-8016-c829bd989d6c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:47.577165 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-18d05ff3-f0a2-4d8d-b613-2ea7f91e7cc0 req-bf8832d8-4b30-4eec-8016-c829bd989d6c service nova] Creating event network-vif-deleted:60e9265c-1d8e-4a0f-986a-a7ff8f2e2489 for instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 on n-h1-708768-8 Jul 26 20:25:47.599354 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-18d05ff3-f0a2-4d8d-b613-2ea7f91e7cc0 req-bf8832d8-4b30-4eec-8016-c829bd989d6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089816 Jul 26 20:25:47.605534 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3138/6356] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:25:48.412509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:48.413196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] [instance: 85aa1647-e9f7-4993-bc2e-64f3fe26cad4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:48.428569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:48.430218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:48.432149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:48.432768 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:48.476360 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] HTTP exception thrown: Instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 could not be found. Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Request method failure captured: Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 HTTP/1.1 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4Ev0ii1kBGUjwonVMhglrcrFlU3ywjFoPd0j4-8Ft4EZjC2YdZCk_P7SzH0uKeOzNjC55zbxY6dmJY6OfLxELdx2TCM7IDW_K3LF0CPkmaPQwEIV-GCQklx3o29ilUs5O3xJoo-sekz8seqkI-Y14MIT1Hi5pSkJ3GaJ0NLv_CA6DXk Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: c6c35edbc1a1413c90d22de414aa71e6 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6c35edbc1a1413c90d22de414aa71e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6c35edbc1a1413c90d22de414aa71e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6c35edbc1a1413c90d22de414aa71e6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6c35edbc1a1413c90d22de414aa71e6"}]}] Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: c6c35edbc1a1413c90d22de414aa71e6 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-357288115 Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestNetworkAdvancedServerOps-357288115-project Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 65245c71525848afaf82742412b31a8a Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestNetworkAdvancedServerOps-357288115-project Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 could not be found. Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '85aa1647-e9f7-4993-bc2e-64f3fe26cad4'} Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 could not be found. Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 could not be found. Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:25:48.478617 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:48.483744 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:25:48.483744 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:25:48.483744 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:25:48.483744 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:25:48.483744 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:25:48.483744 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 could not be found. Jul 26 20:25:48.483744 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:25:48.485405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Returning 404 to user: Instance 85aa1647-e9f7-4993-bc2e-64f3fe26cad4 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:25:48.486303 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f637abde-7daa-4720-b898-bd317e218065 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4" status: 404 len: 111 microversion: 2.1 time: 0.079773 Jul 26 20:25:48.486884 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3219/6357] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:48 2022] GET /compute/v2.1/servers/85aa1647-e9f7-4993-bc2e-64f3fe26cad4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:25:52.948869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9faca7f0-2725-4884-aeeb-5d8854b26813 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:52.949439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9faca7f0-2725-4884-aeeb-5d8854b26813 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:52.971679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9faca7f0-2725-4884-aeeb-5d8854b26813 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:52.975109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9faca7f0-2725-4884-aeeb-5d8854b26813 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:52.978679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9faca7f0-2725-4884-aeeb-5d8854b26813 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:52.985588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9faca7f0-2725-4884-aeeb-5d8854b26813 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:53.045696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9faca7f0-2725-4884-aeeb-5d8854b26813 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:25:53.250196 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9faca7f0-2725-4884-aeeb-5d8854b26813 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 204 len: 0 microversion: 2.1 time: 0.306041 Jul 26 20:25:53.256718 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3139/6358] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:25:52 2022] DELETE /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:25:53.262426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b46c3706-63a4-4d9c-abf1-a871eb203768 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:53.263176 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b46c3706-63a4-4d9c-abf1-a871eb203768 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:53.296946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b46c3706-63a4-4d9c-abf1-a871eb203768 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:53.300575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b46c3706-63a4-4d9c-abf1-a871eb203768 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:53.301564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b46c3706-63a4-4d9c-abf1-a871eb203768 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:53.308846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b46c3706-63a4-4d9c-abf1-a871eb203768 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:53.432166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-95f276bc-a529-4a9c-b557-2b3f66122d98 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] Calling method '.version_select at 0x7f875da0ec10>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:53.461221 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-95f276bc-a529-4a9c-b557-2b3f66122d98 tempest-TestNetworkAdvancedServerOps-357288115 tempest-TestNetworkAdvancedServerOps-357288115-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-207115589" status: 202 len: 0 microversion: 2.1 time: 0.034957 Jul 26 20:25:53.462360 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3140/6359] 10.222.0.58 () {58 vars in 1281 bytes} [Tue Jul 26 20:25:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-207115589 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:25:53.647950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b46c3706-63a4-4d9c-abf1-a871eb203768 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:53.661483 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b46c3706-63a4-4d9c-abf1-a871eb203768 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1573 microversion: 2.1 time: 0.402787 Jul 26 20:25:53.665651 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3220/6360] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:53 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1573 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:54.690259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-53fcc73f-07c9-4755-be8f-ff1a112dbf7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:54.691732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-53fcc73f-07c9-4755-be8f-ff1a112dbf7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:54.703280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53fcc73f-07c9-4755-be8f-ff1a112dbf7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:54.705913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53fcc73f-07c9-4755-be8f-ff1a112dbf7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:54.708494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53fcc73f-07c9-4755-be8f-ff1a112dbf7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:54.709862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-53fcc73f-07c9-4755-be8f-ff1a112dbf7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:54.976345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-53fcc73f-07c9-4755-be8f-ff1a112dbf7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:54.986025 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-53fcc73f-07c9-4755-be8f-ff1a112dbf7f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1573 microversion: 2.1 time: 0.301373 Jul 26 20:25:54.992138 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3141/6361] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:54 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1573 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:56.017624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6394f012-8536-4849-bde2-6e0727ad7224 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:56.018889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6394f012-8536-4849-bde2-6e0727ad7224 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:56.029719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6394f012-8536-4849-bde2-6e0727ad7224 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:56.031272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6394f012-8536-4849-bde2-6e0727ad7224 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:56.035119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6394f012-8536-4849-bde2-6e0727ad7224 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:56.037110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6394f012-8536-4849-bde2-6e0727ad7224 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:56.148746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6394f012-8536-4849-bde2-6e0727ad7224 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:56.162313 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6394f012-8536-4849-bde2-6e0727ad7224 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1507 microversion: 2.1 time: 0.149707 Jul 26 20:25:56.165996 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3221/6362] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:56 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:56.377200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-63be9725-02b5-4afe-83c7-d2c68608ea5a req-71045ac4-6ee9-4c43-ba17-5c0a95504933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0", "name": "network-vif-deleted", "tag": "370e64ab-409d-4a25-bd84-b4f3ad56385b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:25:56.410312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-63be9725-02b5-4afe-83c7-d2c68608ea5a req-71045ac4-6ee9-4c43-ba17-5c0a95504933 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:56.411834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-63be9725-02b5-4afe-83c7-d2c68608ea5a req-71045ac4-6ee9-4c43-ba17-5c0a95504933 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:56.433871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-63be9725-02b5-4afe-83c7-d2c68608ea5a req-71045ac4-6ee9-4c43-ba17-5c0a95504933 service nova] Creating event network-vif-deleted:370e64ab-409d-4a25-bd84-b4f3ad56385b for instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 on n-h1-708768-8 Jul 26 20:25:56.440604 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-63be9725-02b5-4afe-83c7-d2c68608ea5a req-71045ac4-6ee9-4c43-ba17-5c0a95504933 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070667 Jul 26 20:25:56.441445 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3142/6363] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:25:57.189311 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce7a6b89-f6a4-483a-b1d6-7cbb650efed8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:57.190209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ce7a6b89-f6a4-483a-b1d6-7cbb650efed8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:57.208107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce7a6b89-f6a4-483a-b1d6-7cbb650efed8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:57.208666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce7a6b89-f6a4-483a-b1d6-7cbb650efed8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:57.209573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce7a6b89-f6a4-483a-b1d6-7cbb650efed8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:57.210087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ce7a6b89-f6a4-483a-b1d6-7cbb650efed8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:57.360164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ce7a6b89-f6a4-483a-b1d6-7cbb650efed8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:57.372738 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce7a6b89-f6a4-483a-b1d6-7cbb650efed8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1224 microversion: 2.1 time: 0.189780 Jul 26 20:25:57.387362 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3222/6364] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:57 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1224 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:25:58.398132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3465321e-8891-4d23-b19c-3453e681655f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:25:58.399002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3465321e-8891-4d23-b19c-3453e681655f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:25:58.415711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3465321e-8891-4d23-b19c-3453e681655f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:58.417073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3465321e-8891-4d23-b19c-3453e681655f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:58.418295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3465321e-8891-4d23-b19c-3453e681655f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:25:58.418974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3465321e-8891-4d23-b19c-3453e681655f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:25:59.082660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3465321e-8891-4d23-b19c-3453e681655f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:25:59.096727 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3465321e-8891-4d23-b19c-3453e681655f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1224 microversion: 2.1 time: 0.705681 Jul 26 20:25:59.097792 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3143/6365] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:25:58 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1224 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:00.123355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45977114-3da7-487a-a169-4a6506adc9a2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:00.124543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45977114-3da7-487a-a169-4a6506adc9a2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:00.136961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45977114-3da7-487a-a169-4a6506adc9a2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:00.139963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45977114-3da7-487a-a169-4a6506adc9a2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:00.141660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45977114-3da7-487a-a169-4a6506adc9a2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:00.145415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45977114-3da7-487a-a169-4a6506adc9a2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:00.633523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45977114-3da7-487a-a169-4a6506adc9a2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:00.649650 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45977114-3da7-487a-a169-4a6506adc9a2 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1224 microversion: 2.1 time: 0.530381 Jul 26 20:26:00.654605 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3223/6366] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:00 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1224 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:01.674459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3aabed8e-e56a-4e0b-afe8-7f970930f418 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:01.675101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3aabed8e-e56a-4e0b-afe8-7f970930f418 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:01.685372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3aabed8e-e56a-4e0b-afe8-7f970930f418 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:01.689635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3aabed8e-e56a-4e0b-afe8-7f970930f418 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:01.690658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3aabed8e-e56a-4e0b-afe8-7f970930f418 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:01.691277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3aabed8e-e56a-4e0b-afe8-7f970930f418 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:01.832126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3aabed8e-e56a-4e0b-afe8-7f970930f418 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:01.852471 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3aabed8e-e56a-4e0b-afe8-7f970930f418 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1224 microversion: 2.1 time: 0.181929 Jul 26 20:26:01.853121 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3144/6367] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:01 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1224 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:02.878531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d73ce576-a76f-4bfc-953b-a6af42d3e51c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:02.879093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d73ce576-a76f-4bfc-953b-a6af42d3e51c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:02.895389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d73ce576-a76f-4bfc-953b-a6af42d3e51c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:02.896299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d73ce576-a76f-4bfc-953b-a6af42d3e51c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:02.896684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d73ce576-a76f-4bfc-953b-a6af42d3e51c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:02.902421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d73ce576-a76f-4bfc-953b-a6af42d3e51c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:03.085153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d73ce576-a76f-4bfc-953b-a6af42d3e51c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:03.096528 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d73ce576-a76f-4bfc-953b-a6af42d3e51c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1224 microversion: 2.1 time: 0.222697 Jul 26 20:26:03.097699 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3224/6368] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:02 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1224 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:04.119318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3dc5d536-6c6e-4c83-b312-e1e07b33f819 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:04.120173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3dc5d536-6c6e-4c83-b312-e1e07b33f819 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:04.137521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3dc5d536-6c6e-4c83-b312-e1e07b33f819 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:04.137998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3dc5d536-6c6e-4c83-b312-e1e07b33f819 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:04.138813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3dc5d536-6c6e-4c83-b312-e1e07b33f819 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:04.139260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3dc5d536-6c6e-4c83-b312-e1e07b33f819 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:04.240926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3dc5d536-6c6e-4c83-b312-e1e07b33f819 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:04.250165 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3dc5d536-6c6e-4c83-b312-e1e07b33f819 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1224 microversion: 2.1 time: 0.134800 Jul 26 20:26:04.252305 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3145/6369] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:04 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:05.272915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:05.274151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:05.287874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:05.290598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:05.295294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:05.295790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:05.364811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:05.368468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:05.370148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lazy-loading 'fault' on Instance uuid e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:26:05.434970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:05.455209 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f7f3b004-ded5-4300-a02a-153f5057dbcd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 200 len: 1229 microversion: 2.1 time: 0.183404 Jul 26 20:26:05.457144 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3225/6370] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:05 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 1229 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:06.480593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:06.481863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:06.485117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:06.491071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:06.491892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:06.493236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:06.493905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:06.502017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:06.518614 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 HTTP/1.1 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0'} Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:26:06.521480 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:06.526956 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:06.526956 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:26:06.526956 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:26:06.526956 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:26:06.526956 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:26:06.526956 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:26:06.526956 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:06.533499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:26:06.534810 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ec8c6b40-2940-4498-a3ef-c9ed8fefa900 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 404 len: 111 microversion: 2.1 time: 0.058977 Jul 26 20:26:06.535880 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3146/6371] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:06 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:26:06.682814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2055843621", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-82311540", "security_groups": [{"name": "tempest-secgroup-smoke-64409093"}], "block_device_mapping_v2": [{"uuid": "3f04678b-2157-43aa-8e03-6d550dfbc8c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8dd04748-e18a-4968-8aa4-c87b9f3665a7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:06.988263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] validate_networks() for [('8dd04748-e18a-4968-8aa4-c87b9f3665a7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:26:08.434839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:26:08.436281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:26:08.437587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:26:08.438161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:26:08.438743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:26:08.453838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:08.454921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:08.456091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:08.463310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:08.490700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:26:08.497440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:26:08.632785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:26:08.636585 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f04678b-2157-43aa-8e03-6d550dfbc8c9',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:26:08.985914 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5119d45-aaba-4da9-a78d-5bb42b5ffea3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.307449 Jul 26 20:26:08.986582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3226/6372] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:26:06 2022] POST /compute/v2.1/servers => generated 404 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:26:08.999000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-064d1177-a1a4-4806-a93b-f69572d77802 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:09.000308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-064d1177-a1a4-4806-a93b-f69572d77802 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:09.254652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-064d1177-a1a4-4806-a93b-f69572d77802 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:09.262424 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-064d1177-a1a4-4806-a93b-f69572d77802 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1093 microversion: 2.1 time: 0.268705 Jul 26 20:26:09.263011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3147/6373] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:08 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1093 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:10.283806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-627dbae4-bbbc-4301-8494-20d091846341 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:10.284573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-627dbae4-bbbc-4301-8494-20d091846341 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:10.551052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-627dbae4-bbbc-4301-8494-20d091846341 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:10.559821 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-627dbae4-bbbc-4301-8494-20d091846341 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1093 microversion: 2.1 time: 0.281087 Jul 26 20:26:10.560678 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3227/6374] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:10 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1093 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:11.583065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-06d289fc-1f5d-4fc6-879c-44fe22127619 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:11.583727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-06d289fc-1f5d-4fc6-879c-44fe22127619 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:11.836776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-06d289fc-1f5d-4fc6-879c-44fe22127619 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:11.846906 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-06d289fc-1f5d-4fc6-879c-44fe22127619 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1093 microversion: 2.1 time: 0.268586 Jul 26 20:26:11.860432 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3148/6375] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:11 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1093 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:12.874987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3c43e6e7-7b54-4885-9af1-9ffbcb6996f3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:12.879308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3c43e6e7-7b54-4885-9af1-9ffbcb6996f3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:12.896526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c43e6e7-7b54-4885-9af1-9ffbcb6996f3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:12.897085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c43e6e7-7b54-4885-9af1-9ffbcb6996f3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:12.897944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c43e6e7-7b54-4885-9af1-9ffbcb6996f3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:12.898459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3c43e6e7-7b54-4885-9af1-9ffbcb6996f3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:13.043220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3c43e6e7-7b54-4885-9af1-9ffbcb6996f3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:13.051041 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3c43e6e7-7b54-4885-9af1-9ffbcb6996f3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1199 microversion: 2.1 time: 0.185513 Jul 26 20:26:13.058711 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3228/6376] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:12 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1199 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:13.323305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3456eaa8-c84c-4f5b-a62d-209849b1d616 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:13.324476 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:26:13.324476 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 20:26:13.325623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3456eaa8-c84c-4f5b-a62d-209849b1d616 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:13.326083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3456eaa8-c84c-4f5b-a62d-209849b1d616 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:13.326893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3456eaa8-c84c-4f5b-a62d-209849b1d616 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:13.327342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3456eaa8-c84c-4f5b-a62d-209849b1d616 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:13.369242 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3456eaa8-c84c-4f5b-a62d-209849b1d616 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.258326 Jul 26 20:26:13.370547 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3149/6377] 10.222.0.58 () {58 vars in 1185 bytes} [Tue Jul 26 20:26:13 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:26:13.564131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1239649179", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "availability_zone": "nova:n-h2-708768-8", "networks": [{"uuid": "5496344c-6605-4494-8bea-907fb0054891"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:13.669667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] validate_networks() for [('5496344c-6605-4494-8bea-907fb0054891', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:26:14.080495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4990f13f-1430-4301-8c89-4406cb149f31 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:14.081243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4990f13f-1430-4301-8c89-4406cb149f31 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:14.093189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4990f13f-1430-4301-8c89-4406cb149f31 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:14.093696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4990f13f-1430-4301-8c89-4406cb149f31 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:14.096623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4990f13f-1430-4301-8c89-4406cb149f31 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:14.098722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4990f13f-1430-4301-8c89-4406cb149f31 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:14.566405 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4990f13f-1430-4301-8c89-4406cb149f31 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:14.572882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:26:14.573368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:26:14.573774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:26:14.574355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:26:14.574913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:26:14.583117 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4990f13f-1430-4301-8c89-4406cb149f31 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1275 microversion: 2.1 time: 0.502322 Jul 26 20:26:14.583960 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3150/6378] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:14 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1275 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:14.610335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:14.610794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:14.611630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:14.612109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:14.668514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Getting quotas for project a099fb107c28458293916bf2977285dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:26:14.682529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Getting quotas for user c9927ac9f2d5458f8c7e6f6d09bd455f and project a099fb107c28458293916bf2977285dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:26:14.715969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:26:14.718346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:26:14.803961 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa4e7897-9d1e-4849-9571-9db1d5e09634 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241679 Jul 26 20:26:14.804913 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3229/6379] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:26:14.816414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-71035518-ee20-407f-bf58-efad05409611 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:14.817755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-71035518-ee20-407f-bf58-efad05409611 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:14.941137 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-71035518-ee20-407f-bf58-efad05409611 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1329 microversion: 2.1 time: 0.128723 Jul 26 20:26:14.958394 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3151/6380] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:14 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1329 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:15.608533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61a2552f-a724-4398-bb4e-fe982e086513 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:15.609945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61a2552f-a724-4398-bb4e-fe982e086513 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:15.613942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:15.631759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61a2552f-a724-4398-bb4e-fe982e086513 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:15.633913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61a2552f-a724-4398-bb4e-fe982e086513 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:15.638439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61a2552f-a724-4398-bb4e-fe982e086513 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:15.639086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61a2552f-a724-4398-bb4e-fe982e086513 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:15.654061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:15.741190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-273ec59e-106b-4d36-965e-0992479746db req-53dddfc7-18e5-4ad7-b58d-1d4c05d85703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d07fdb-4a49-4d7c-b1c2-a2d79497efd8", "tag": "94182978-3419-4fa7-b6d8-db883a1bc03b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:15.765115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-273ec59e-106b-4d36-965e-0992479746db req-53dddfc7-18e5-4ad7-b58d-1d4c05d85703 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:15.765589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-273ec59e-106b-4d36-965e-0992479746db req-53dddfc7-18e5-4ad7-b58d-1d4c05d85703 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:15.861607 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-273ec59e-106b-4d36-965e-0992479746db req-53dddfc7-18e5-4ad7-b58d-1d4c05d85703 service nova] Creating event network-changed:94182978-3419-4fa7-b6d8-db883a1bc03b for instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 on n-h2-708768-8 Jul 26 20:26:15.880291 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-273ec59e-106b-4d36-965e-0992479746db req-53dddfc7-18e5-4ad7-b58d-1d4c05d85703 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147903 Jul 26 20:26:15.894148 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3152/6381] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:26:15.976467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-35a35c06-71e8-4e4b-94b7-13de138c2081 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:15.977149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-35a35c06-71e8-4e4b-94b7-13de138c2081 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:16.017877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61a2552f-a724-4398-bb4e-fe982e086513 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:16.046142 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61a2552f-a724-4398-bb4e-fe982e086513 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1275 microversion: 2.1 time: 0.442018 Jul 26 20:26:16.047000 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3230/6382] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:15 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1275 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:16.404619 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-35a35c06-71e8-4e4b-94b7-13de138c2081 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1329 microversion: 2.1 time: 0.442500 Jul 26 20:26:16.405219 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3153/6383] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:15 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1329 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:17.069981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34860073-b884-4a30-b347-1431e21c8a0d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:17.070514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34860073-b884-4a30-b347-1431e21c8a0d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:17.109745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34860073-b884-4a30-b347-1431e21c8a0d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:17.110117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34860073-b884-4a30-b347-1431e21c8a0d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:17.110938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34860073-b884-4a30-b347-1431e21c8a0d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:17.111350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34860073-b884-4a30-b347-1431e21c8a0d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:17.426282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fdb0cd6c-427b-45e9-bdb5-73f41242e2f3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:17.427640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fdb0cd6c-427b-45e9-bdb5-73f41242e2f3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:17.446603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdb0cd6c-427b-45e9-bdb5-73f41242e2f3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:17.447496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdb0cd6c-427b-45e9-bdb5-73f41242e2f3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:17.448595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdb0cd6c-427b-45e9-bdb5-73f41242e2f3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:17.449267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fdb0cd6c-427b-45e9-bdb5-73f41242e2f3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:17.475890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34860073-b884-4a30-b347-1431e21c8a0d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:17.493104 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34860073-b884-4a30-b347-1431e21c8a0d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1275 microversion: 2.1 time: 0.424901 Jul 26 20:26:17.498119 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3231/6384] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:17 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1275 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:17.648183 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fdb0cd6c-427b-45e9-bdb5-73f41242e2f3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1338 microversion: 2.1 time: 0.225777 Jul 26 20:26:17.648773 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3154/6385] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:17 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:26:18.527119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-05b632b4-b1a0-4321-ae19-a6b8ce35c9e7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:18.532731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-05b632b4-b1a0-4321-ae19-a6b8ce35c9e7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:18.591798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05b632b4-b1a0-4321-ae19-a6b8ce35c9e7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:18.592267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05b632b4-b1a0-4321-ae19-a6b8ce35c9e7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:18.593157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05b632b4-b1a0-4321-ae19-a6b8ce35c9e7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:18.593600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05b632b4-b1a0-4321-ae19-a6b8ce35c9e7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:18.685020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-575e4cde-8052-4136-9602-4ba913dc3066 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:18.695060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-575e4cde-8052-4136-9602-4ba913dc3066 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:18.755715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-575e4cde-8052-4136-9602-4ba913dc3066 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:18.783238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-575e4cde-8052-4136-9602-4ba913dc3066 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:18.789365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-575e4cde-8052-4136-9602-4ba913dc3066 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:18.791021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-575e4cde-8052-4136-9602-4ba913dc3066 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:19.084317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-575e4cde-8052-4136-9602-4ba913dc3066 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1422 microversion: 2.1 time: 0.412844 Jul 26 20:26:19.097125 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3155/6386] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:18 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1422 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:19.410597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05b632b4-b1a0-4321-ae19-a6b8ce35c9e7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:19.424745 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-05b632b4-b1a0-4321-ae19-a6b8ce35c9e7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1275 microversion: 2.1 time: 0.905692 Jul 26 20:26:19.449570 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3232/6387] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:18 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1275 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:20.121186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2a2c8880-0b0d-42c1-8c3d-3984eb59a9f1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:20.121815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2a2c8880-0b0d-42c1-8c3d-3984eb59a9f1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:20.134212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a2c8880-0b0d-42c1-8c3d-3984eb59a9f1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:20.136169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a2c8880-0b0d-42c1-8c3d-3984eb59a9f1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:20.137728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a2c8880-0b0d-42c1-8c3d-3984eb59a9f1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:20.139823 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a2c8880-0b0d-42c1-8c3d-3984eb59a9f1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:20.408881 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2a2c8880-0b0d-42c1-8c3d-3984eb59a9f1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1464 microversion: 2.1 time: 0.292313 Jul 26 20:26:20.428954 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3156/6388] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:20 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1464 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:20.452572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-691af441-ec73-4c04-8a1f-f66e795adae3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:20.453207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-691af441-ec73-4c04-8a1f-f66e795adae3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:20.477926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-691af441-ec73-4c04-8a1f-f66e795adae3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:20.478899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-691af441-ec73-4c04-8a1f-f66e795adae3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:20.479955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-691af441-ec73-4c04-8a1f-f66e795adae3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:20.481154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-691af441-ec73-4c04-8a1f-f66e795adae3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:20.721511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-c2c7a627-f930-4ee6-a937-df8c9b972e0d req-fceffabb-c3ba-45d0-a811-ded368116ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71e27b3-bc6b-4f41-a866-bf0053efac41", "tag": "9f87c4f2-3598-4562-9e55-eb1d71232ef9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:20.740473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c2c7a627-f930-4ee6-a937-df8c9b972e0d req-fceffabb-c3ba-45d0-a811-ded368116ec3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:20.740941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-c2c7a627-f930-4ee6-a937-df8c9b972e0d req-fceffabb-c3ba-45d0-a811-ded368116ec3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:20.757358 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-c2c7a627-f930-4ee6-a937-df8c9b972e0d req-fceffabb-c3ba-45d0-a811-ded368116ec3 service nova] Creating event network-changed:9f87c4f2-3598-4562-9e55-eb1d71232ef9 for instance b71e27b3-bc6b-4f41-a866-bf0053efac41 on n-h2-708768-8 Jul 26 20:26:20.767532 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-c2c7a627-f930-4ee6-a937-df8c9b972e0d req-fceffabb-c3ba-45d0-a811-ded368116ec3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049639 Jul 26 20:26:20.768764 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3157/6389] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:26:20.878786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-691af441-ec73-4c04-8a1f-f66e795adae3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:20.887317 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-691af441-ec73-4c04-8a1f-f66e795adae3 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1275 microversion: 2.1 time: 0.439964 Jul 26 20:26:20.887979 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3233/6390] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:20 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1275 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:21.439878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c0541e3-92c8-4e58-af4e-212da60dff70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:21.440711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8c0541e3-92c8-4e58-af4e-212da60dff70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:21.456340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c0541e3-92c8-4e58-af4e-212da60dff70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:21.459641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c0541e3-92c8-4e58-af4e-212da60dff70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:21.460435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c0541e3-92c8-4e58-af4e-212da60dff70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:21.462996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c0541e3-92c8-4e58-af4e-212da60dff70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:21.639244 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c0541e3-92c8-4e58-af4e-212da60dff70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1464 microversion: 2.1 time: 0.213048 Jul 26 20:26:21.641565 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3158/6391] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:21 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1464 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:21.909489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc360607-3617-4e8e-8d61-268de08359ca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:21.910158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fc360607-3617-4e8e-8d61-268de08359ca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:21.922932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc360607-3617-4e8e-8d61-268de08359ca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:21.923642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc360607-3617-4e8e-8d61-268de08359ca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:21.926061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc360607-3617-4e8e-8d61-268de08359ca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:21.926675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc360607-3617-4e8e-8d61-268de08359ca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:22.085660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fc360607-3617-4e8e-8d61-268de08359ca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:22.094813 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc360607-3617-4e8e-8d61-268de08359ca tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1275 microversion: 2.1 time: 0.189484 Jul 26 20:26:22.095519 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3234/6392] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:21 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:22.661912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7cd0aca-480f-4480-89b5-397c3d1e7de9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:22.663201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c7cd0aca-480f-4480-89b5-397c3d1e7de9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:22.671154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7cd0aca-480f-4480-89b5-397c3d1e7de9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:22.671644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7cd0aca-480f-4480-89b5-397c3d1e7de9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:22.672443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7cd0aca-480f-4480-89b5-397c3d1e7de9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:22.672894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7cd0aca-480f-4480-89b5-397c3d1e7de9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:22.825036 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c7cd0aca-480f-4480-89b5-397c3d1e7de9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1464 microversion: 2.1 time: 0.166816 Jul 26 20:26:22.839273 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3159/6393] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:22 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:23.116652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-97375446-c89a-493d-9ed8-3dc8aaaabcee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:23.117982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-97375446-c89a-493d-9ed8-3dc8aaaabcee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:23.126657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97375446-c89a-493d-9ed8-3dc8aaaabcee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:23.127212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97375446-c89a-493d-9ed8-3dc8aaaabcee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:23.128109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97375446-c89a-493d-9ed8-3dc8aaaabcee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:23.128810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-97375446-c89a-493d-9ed8-3dc8aaaabcee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:23.299120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-97375446-c89a-493d-9ed8-3dc8aaaabcee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:23.315281 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-97375446-c89a-493d-9ed8-3dc8aaaabcee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1263 microversion: 2.1 time: 0.202646 Jul 26 20:26:23.315912 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3235/6394] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:23 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1263 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:23.847554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-acb893fa-c195-4bf7-b586-b4c19dd034ab tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:23.848962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-acb893fa-c195-4bf7-b586-b4c19dd034ab tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:23.852265 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:23.859565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb893fa-c195-4bf7-b586-b4c19dd034ab tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:23.860332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb893fa-c195-4bf7-b586-b4c19dd034ab tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:23.861298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb893fa-c195-4bf7-b586-b4c19dd034ab tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:23.861906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-acb893fa-c195-4bf7-b586-b4c19dd034ab tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:24.069196 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-acb893fa-c195-4bf7-b586-b4c19dd034ab tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1464 microversion: 2.1 time: 0.226629 Jul 26 20:26:24.073170 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3160/6395] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:23 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1464 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:24.338590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cf06b163-5d54-4616-ab8e-9712d887b2ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:24.339184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cf06b163-5d54-4616-ab8e-9712d887b2ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:24.346470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf06b163-5d54-4616-ab8e-9712d887b2ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:24.346923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf06b163-5d54-4616-ab8e-9712d887b2ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:24.347720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf06b163-5d54-4616-ab8e-9712d887b2ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:24.348168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cf06b163-5d54-4616-ab8e-9712d887b2ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:24.518156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cf06b163-5d54-4616-ab8e-9712d887b2ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:24.541365 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cf06b163-5d54-4616-ab8e-9712d887b2ab tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1263 microversion: 2.1 time: 0.206825 Jul 26 20:26:24.542653 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3236/6396] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:24 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:24.673693 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:26:24.673895 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:26:25.093277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e760a97-06cd-48df-ba02-b1404bfb836e tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:25.093902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e760a97-06cd-48df-ba02-b1404bfb836e tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:25.102291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e760a97-06cd-48df-ba02-b1404bfb836e tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:25.102839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e760a97-06cd-48df-ba02-b1404bfb836e tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:25.103834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e760a97-06cd-48df-ba02-b1404bfb836e tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:25.104281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e760a97-06cd-48df-ba02-b1404bfb836e tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:25.236043 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e760a97-06cd-48df-ba02-b1404bfb836e tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1464 microversion: 2.1 time: 0.147046 Jul 26 20:26:25.236599 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3161/6397] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:25 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:26:25.591975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0015f8a7-67c1-42ce-8c6d-bfad8f9280c7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:25.593363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0015f8a7-67c1-42ce-8c6d-bfad8f9280c7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:25.600636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:25.602214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=14 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:25.605897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0015f8a7-67c1-42ce-8c6d-bfad8f9280c7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:25.606586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0015f8a7-67c1-42ce-8c6d-bfad8f9280c7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:25.607802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0015f8a7-67c1-42ce-8c6d-bfad8f9280c7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:25.608777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0015f8a7-67c1-42ce-8c6d-bfad8f9280c7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:25.682872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e83ccbd2-75ca-4e84-9d5e-51b1f83e559b req-5740ad5c-16d7-421d-8ff2-7edc13863ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71e27b3-bc6b-4f41-a866-bf0053efac41", "name": "network-vif-plugged", "status": "completed", "tag": "9f87c4f2-3598-4562-9e55-eb1d71232ef9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:25.694606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e83ccbd2-75ca-4e84-9d5e-51b1f83e559b req-5740ad5c-16d7-421d-8ff2-7edc13863ab8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:25.695443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e83ccbd2-75ca-4e84-9d5e-51b1f83e559b req-5740ad5c-16d7-421d-8ff2-7edc13863ab8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:25.710252 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e83ccbd2-75ca-4e84-9d5e-51b1f83e559b req-5740ad5c-16d7-421d-8ff2-7edc13863ab8 service nova] Creating event network-vif-plugged:9f87c4f2-3598-4562-9e55-eb1d71232ef9 for instance b71e27b3-bc6b-4f41-a866-bf0053efac41 on n-h2-708768-8 Jul 26 20:26:25.716944 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e83ccbd2-75ca-4e84-9d5e-51b1f83e559b req-5740ad5c-16d7-421d-8ff2-7edc13863ab8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151755 Jul 26 20:26:25.723507 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3162/6398] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:26:25.828681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0015f8a7-67c1-42ce-8c6d-bfad8f9280c7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:25.840050 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0015f8a7-67c1-42ce-8c6d-bfad8f9280c7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1263 microversion: 2.1 time: 0.281178 Jul 26 20:26:25.840634 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3237/6399] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:25 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1263 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:26.263498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a667bb10-ba06-444b-aead-1fdfb62d6143 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:26.264365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a667bb10-ba06-444b-aead-1fdfb62d6143 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:26.272967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a667bb10-ba06-444b-aead-1fdfb62d6143 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:26.274208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a667bb10-ba06-444b-aead-1fdfb62d6143 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:26.275282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a667bb10-ba06-444b-aead-1fdfb62d6143 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:26.275966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a667bb10-ba06-444b-aead-1fdfb62d6143 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:26.404014 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:26.423640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a667bb10-ba06-444b-aead-1fdfb62d6143 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1464 microversion: 2.1 time: 0.165593 Jul 26 20:26:26.424407 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3163/6400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:26 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:26.865386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d9c6aef5-ecba-4bc4-b3da-1adcb603905c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:26.865386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d9c6aef5-ecba-4bc4-b3da-1adcb603905c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:26.872861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9c6aef5-ecba-4bc4-b3da-1adcb603905c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:26.873729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9c6aef5-ecba-4bc4-b3da-1adcb603905c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:26.874514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9c6aef5-ecba-4bc4-b3da-1adcb603905c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:26.875005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d9c6aef5-ecba-4bc4-b3da-1adcb603905c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:27.045635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d9c6aef5-ecba-4bc4-b3da-1adcb603905c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:27.054298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d9c6aef5-ecba-4bc4-b3da-1adcb603905c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1263 microversion: 2.1 time: 0.195982 Jul 26 20:26:27.063868 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3238/6401] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:26 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1263 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:27.445968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-15de1ffa-08a3-4bf3-9187-358660360ebe tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:27.446587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-15de1ffa-08a3-4bf3-9187-358660360ebe tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:27.453733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15de1ffa-08a3-4bf3-9187-358660360ebe tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:27.454130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15de1ffa-08a3-4bf3-9187-358660360ebe tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:27.454900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15de1ffa-08a3-4bf3-9187-358660360ebe tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:27.455343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-15de1ffa-08a3-4bf3-9187-358660360ebe tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:27.588831 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-15de1ffa-08a3-4bf3-9187-358660360ebe tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1650 microversion: 2.1 time: 0.147097 Jul 26 20:26:27.589408 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3164/6402] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:27 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:27.608791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f6bf2d81-2516-409f-a1c8-076474e3ce91 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:27.609411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f6bf2d81-2516-409f-a1c8-076474e3ce91 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:27.615455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6bf2d81-2516-409f-a1c8-076474e3ce91 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:27.615957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6bf2d81-2516-409f-a1c8-076474e3ce91 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:27.616713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6bf2d81-2516-409f-a1c8-076474e3ce91 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:27.617691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f6bf2d81-2516-409f-a1c8-076474e3ce91 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:27.746977 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f6bf2d81-2516-409f-a1c8-076474e3ce91 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1650 microversion: 2.1 time: 0.141759 Jul 26 20:26:27.747567 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3239/6403] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:27 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1650 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:27.767739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0655068-7b15-45be-8ebd-fe7e94a8cf57 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:27.768370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0655068-7b15-45be-8ebd-fe7e94a8cf57 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:27.774507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0655068-7b15-45be-8ebd-fe7e94a8cf57 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:27.774968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0655068-7b15-45be-8ebd-fe7e94a8cf57 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:27.775951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0655068-7b15-45be-8ebd-fe7e94a8cf57 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:27.776408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0655068-7b15-45be-8ebd-fe7e94a8cf57 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:27.913823 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0655068-7b15-45be-8ebd-fe7e94a8cf57 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1650 microversion: 2.1 time: 0.149406 Jul 26 20:26:27.919959 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3165/6404] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:27 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1650 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:27.979344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2118588123", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "availability_zone": "nova:n-h1-708768-8", "networks": [{"uuid": "5496344c-6605-4494-8bea-907fb0054891"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:28.051715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] validate_networks() for [('5496344c-6605-4494-8bea-907fb0054891', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:26:28.076792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4893e938-5487-48fb-83dd-371f8ac5208f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:28.077755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4893e938-5487-48fb-83dd-371f8ac5208f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:28.084215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4893e938-5487-48fb-83dd-371f8ac5208f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:28.084959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4893e938-5487-48fb-83dd-371f8ac5208f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:28.086451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4893e938-5487-48fb-83dd-371f8ac5208f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:28.087121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4893e938-5487-48fb-83dd-371f8ac5208f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:28.264802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4893e938-5487-48fb-83dd-371f8ac5208f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:28.272753 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4893e938-5487-48fb-83dd-371f8ac5208f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1263 microversion: 2.1 time: 0.199714 Jul 26 20:26:28.290012 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3166/6405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:28 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1263 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:26:28.467344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:26:28.468876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:26:28.469933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:26:28.470599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:26:28.471463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:26:28.482512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:28.483150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:28.484891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:28.485513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:28.521100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Getting quotas for project a099fb107c28458293916bf2977285dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:26:28.526526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Getting quotas for user c9927ac9f2d5458f8c7e6f6d09bd455f and project a099fb107c28458293916bf2977285dd. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:26:28.539175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:26:28.541369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:26:28.591740 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-12b2f6d5-247c-4e9d-85c2-75fe928bf7e0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616698 Jul 26 20:26:28.592391 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3240/6406] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:26:28.603851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e5397a7-2d75-4be8-b864-fcabb8a3a1b0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:28.605001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e5397a7-2d75-4be8-b864-fcabb8a3a1b0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:28.685088 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e5397a7-2d75-4be8-b864-fcabb8a3a1b0 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1329 microversion: 2.1 time: 0.085563 Jul 26 20:26:28.685664 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3167/6407] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:28 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1329 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:26:29.303900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6e23ba34-095c-4c65-8c13-0a4f84e649c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:29.305003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6e23ba34-095c-4c65-8c13-0a4f84e649c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:29.313040 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e23ba34-095c-4c65-8c13-0a4f84e649c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:29.313609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e23ba34-095c-4c65-8c13-0a4f84e649c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:29.314459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e23ba34-095c-4c65-8c13-0a4f84e649c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:29.314970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6e23ba34-095c-4c65-8c13-0a4f84e649c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:29.477331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6e23ba34-095c-4c65-8c13-0a4f84e649c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:29.495930 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6e23ba34-095c-4c65-8c13-0a4f84e649c9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1263 microversion: 2.1 time: 0.196885 Jul 26 20:26:29.496690 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3241/6408] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:29 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1263 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:29.706436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-810e7f92-373e-41e3-83e5-a9637acdf48b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:29.713775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-810e7f92-373e-41e3-83e5-a9637acdf48b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:29.743221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-810e7f92-373e-41e3-83e5-a9637acdf48b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:29.744808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-810e7f92-373e-41e3-83e5-a9637acdf48b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:29.750295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-810e7f92-373e-41e3-83e5-a9637acdf48b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:29.750935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-810e7f92-373e-41e3-83e5-a9637acdf48b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:29.876914 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-810e7f92-373e-41e3-83e5-a9637acdf48b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1434 microversion: 2.1 time: 0.173171 Jul 26 20:26:29.878733 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3168/6409] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:29 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1434 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:30.518182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c32e25e-e2b3-4532-99bd-4aeb5a7f59a7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:30.520366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c32e25e-e2b3-4532-99bd-4aeb5a7f59a7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:30.538037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c32e25e-e2b3-4532-99bd-4aeb5a7f59a7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:30.538699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c32e25e-e2b3-4532-99bd-4aeb5a7f59a7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:30.539861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c32e25e-e2b3-4532-99bd-4aeb5a7f59a7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:30.540478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c32e25e-e2b3-4532-99bd-4aeb5a7f59a7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:30.800238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c32e25e-e2b3-4532-99bd-4aeb5a7f59a7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:30.812632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c32e25e-e2b3-4532-99bd-4aeb5a7f59a7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1263 microversion: 2.1 time: 0.298646 Jul 26 20:26:30.816710 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3242/6410] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:30 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1263 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:30.900590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-509a5ff6-ddb9-4b23-aab7-1d5ff11d8818 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:30.901227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-509a5ff6-ddb9-4b23-aab7-1d5ff11d8818 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:30.908235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-509a5ff6-ddb9-4b23-aab7-1d5ff11d8818 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:30.908881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-509a5ff6-ddb9-4b23-aab7-1d5ff11d8818 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:30.909824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-509a5ff6-ddb9-4b23-aab7-1d5ff11d8818 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:30.910435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-509a5ff6-ddb9-4b23-aab7-1d5ff11d8818 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:31.140154 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-509a5ff6-ddb9-4b23-aab7-1d5ff11d8818 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1464 microversion: 2.1 time: 0.243483 Jul 26 20:26:31.141497 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3169/6411] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:30 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:31.533723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d40329a8-e2d0-487c-b422-79c85fefb543 req-badefed3-2c16-48e6-9f7d-4f15a5f7cb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc5af0ba-8e12-4239-9785-b089ab629462", "tag": "9892132d-a4b9-4f11-a88e-58c77d8696c9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:31.587634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d40329a8-e2d0-487c-b422-79c85fefb543 req-badefed3-2c16-48e6-9f7d-4f15a5f7cb64 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:31.604394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d40329a8-e2d0-487c-b422-79c85fefb543 req-badefed3-2c16-48e6-9f7d-4f15a5f7cb64 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:31.623949 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d40329a8-e2d0-487c-b422-79c85fefb543 req-badefed3-2c16-48e6-9f7d-4f15a5f7cb64 service nova] Creating event network-changed:9892132d-a4b9-4f11-a88e-58c77d8696c9 for instance fc5af0ba-8e12-4239-9785-b089ab629462 on n-h1-708768-8 Jul 26 20:26:31.633459 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d40329a8-e2d0-487c-b422-79c85fefb543 req-badefed3-2c16-48e6-9f7d-4f15a5f7cb64 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103485 Jul 26 20:26:31.635337 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3243/6412] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:26:31.754726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-078c7ed1-f6e8-4038-ba84-a6ece9769c18 req-b2d2008e-b732-4a66-81ed-807b682229ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d07fdb-4a49-4d7c-b1c2-a2d79497efd8", "name": "network-vif-plugged", "status": "completed", "tag": "94182978-3419-4fa7-b6d8-db883a1bc03b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:31.783718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-078c7ed1-f6e8-4038-ba84-a6ece9769c18 req-b2d2008e-b732-4a66-81ed-807b682229ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:31.784179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-078c7ed1-f6e8-4038-ba84-a6ece9769c18 req-b2d2008e-b732-4a66-81ed-807b682229ca service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:31.811688 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-078c7ed1-f6e8-4038-ba84-a6ece9769c18 req-b2d2008e-b732-4a66-81ed-807b682229ca service nova] Creating event network-vif-plugged:94182978-3419-4fa7-b6d8-db883a1bc03b for instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 on n-h2-708768-8 Jul 26 20:26:31.819109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-078c7ed1-f6e8-4038-ba84-a6ece9769c18 req-b2d2008e-b732-4a66-81ed-807b682229ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068534 Jul 26 20:26:31.821140 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3170/6413] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:26:31.836161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5864272-2cf7-4c93-97c2-dfee0503eb1a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:31.837282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5864272-2cf7-4c93-97c2-dfee0503eb1a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:31.850058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5864272-2cf7-4c93-97c2-dfee0503eb1a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:31.851445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5864272-2cf7-4c93-97c2-dfee0503eb1a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:31.852516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5864272-2cf7-4c93-97c2-dfee0503eb1a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:31.853115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5864272-2cf7-4c93-97c2-dfee0503eb1a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:32.103731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5864272-2cf7-4c93-97c2-dfee0503eb1a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:32.111899 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5864272-2cf7-4c93-97c2-dfee0503eb1a tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1263 microversion: 2.1 time: 0.282056 Jul 26 20:26:32.113046 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3244/6414] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:31 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1263 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:32.164019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3caf082a-f3b8-4d6a-821b-3dd8d6a8dea9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:32.166230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3caf082a-f3b8-4d6a-821b-3dd8d6a8dea9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:32.173585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3caf082a-f3b8-4d6a-821b-3dd8d6a8dea9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:32.174192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3caf082a-f3b8-4d6a-821b-3dd8d6a8dea9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:32.175246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3caf082a-f3b8-4d6a-821b-3dd8d6a8dea9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:32.175864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3caf082a-f3b8-4d6a-821b-3dd8d6a8dea9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:32.313817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=100 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:32.322233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3caf082a-f3b8-4d6a-821b-3dd8d6a8dea9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1464 microversion: 2.1 time: 0.163615 Jul 26 20:26:32.324019 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3171/6415] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:32 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:33.133584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-13f86b8f-8b6d-4b59-a20d-47c50326fd23 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:33.134211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-13f86b8f-8b6d-4b59-a20d-47c50326fd23 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:33.145072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-13f86b8f-8b6d-4b59-a20d-47c50326fd23 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:33.145629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-13f86b8f-8b6d-4b59-a20d-47c50326fd23 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:33.146475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-13f86b8f-8b6d-4b59-a20d-47c50326fd23 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:33.147067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-13f86b8f-8b6d-4b59-a20d-47c50326fd23 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:33.323935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-13f86b8f-8b6d-4b59-a20d-47c50326fd23 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:33.334865 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-13f86b8f-8b6d-4b59-a20d-47c50326fd23 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1449 microversion: 2.1 time: 0.205760 Jul 26 20:26:33.335988 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3245/6416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:33 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1449 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:33.350146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a643785b-2399-4b31-ac48-0bdedf13ca70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:33.351577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a643785b-2399-4b31-ac48-0bdedf13ca70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:33.359374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a643785b-2399-4b31-ac48-0bdedf13ca70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:33.359554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a3db700-864a-49fb-8d21-5050cbe215e1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:33.360131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a3db700-864a-49fb-8d21-5050cbe215e1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:33.362657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a643785b-2399-4b31-ac48-0bdedf13ca70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:33.363564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a643785b-2399-4b31-ac48-0bdedf13ca70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:33.364322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a643785b-2399-4b31-ac48-0bdedf13ca70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:33.373134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a3db700-864a-49fb-8d21-5050cbe215e1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:33.373660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a3db700-864a-49fb-8d21-5050cbe215e1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:33.374527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a3db700-864a-49fb-8d21-5050cbe215e1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:33.377801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a3db700-864a-49fb-8d21-5050cbe215e1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:33.550478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4a3db700-864a-49fb-8d21-5050cbe215e1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:26:33.560889 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a3db700-864a-49fb-8d21-5050cbe215e1 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1449 microversion: 2.1 time: 0.206101 Jul 26 20:26:33.576558 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3246/6417] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:33 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1449 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:26:33.699322 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a643785b-2399-4b31-ac48-0bdedf13ca70 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1464 microversion: 2.1 time: 0.351979 Jul 26 20:26:33.700897 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3172/6418] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:33 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:34.721275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e3152cd0-283e-4477-ba69-37e48bac7f48 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:34.722533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e3152cd0-283e-4477-ba69-37e48bac7f48 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:34.730481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3152cd0-283e-4477-ba69-37e48bac7f48 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:34.731217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3152cd0-283e-4477-ba69-37e48bac7f48 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:34.732227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3152cd0-283e-4477-ba69-37e48bac7f48 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:34.732883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3152cd0-283e-4477-ba69-37e48bac7f48 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:35.021081 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e3152cd0-283e-4477-ba69-37e48bac7f48 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1464 microversion: 2.1 time: 0.303386 Jul 26 20:26:35.023446 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3247/6419] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:34 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1464 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:35.874936 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-659bd6a3-6e62-4d77-a415-a7155c9e8bc3 req-1a06e8e1-911d-44f4-8ea4-12230ca1d6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d07fdb-4a49-4d7c-b1c2-a2d79497efd8", "tag": "94182978-3419-4fa7-b6d8-db883a1bc03b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:35.900102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-659bd6a3-6e62-4d77-a415-a7155c9e8bc3 req-1a06e8e1-911d-44f4-8ea4-12230ca1d6f1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:35.903443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-659bd6a3-6e62-4d77-a415-a7155c9e8bc3 req-1a06e8e1-911d-44f4-8ea4-12230ca1d6f1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:35.925923 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-659bd6a3-6e62-4d77-a415-a7155c9e8bc3 req-1a06e8e1-911d-44f4-8ea4-12230ca1d6f1 service nova] Creating event network-changed:94182978-3419-4fa7-b6d8-db883a1bc03b for instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 on n-h2-708768-8 Jul 26 20:26:35.941140 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-659bd6a3-6e62-4d77-a415-a7155c9e8bc3 req-1a06e8e1-911d-44f4-8ea4-12230ca1d6f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077225 Jul 26 20:26:35.942347 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3173/6420] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:26:36.043480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-28597970-16cd-4632-9839-5435ca475ec9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:36.044659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-28597970-16cd-4632-9839-5435ca475ec9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:36.051908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28597970-16cd-4632-9839-5435ca475ec9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:36.052562 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28597970-16cd-4632-9839-5435ca475ec9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:36.053515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28597970-16cd-4632-9839-5435ca475ec9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:36.054139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-28597970-16cd-4632-9839-5435ca475ec9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:36.057077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:36.334295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-28597970-16cd-4632-9839-5435ca475ec9 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1464 microversion: 2.1 time: 0.294737 Jul 26 20:26:36.359867 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3248/6421] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:36 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:37.361601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-db28bdd1-cdd3-4ccb-9fff-c895b9ac46d3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:37.363094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-db28bdd1-cdd3-4ccb-9fff-c895b9ac46d3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:37.385582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=68 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:37.391211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db28bdd1-cdd3-4ccb-9fff-c895b9ac46d3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:37.391724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db28bdd1-cdd3-4ccb-9fff-c895b9ac46d3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:37.392540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db28bdd1-cdd3-4ccb-9fff-c895b9ac46d3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:37.392996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db28bdd1-cdd3-4ccb-9fff-c895b9ac46d3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:37.576913 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-db28bdd1-cdd3-4ccb-9fff-c895b9ac46d3 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1464 microversion: 2.1 time: 0.222619 Jul 26 20:26:37.578628 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3174/6422] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:37 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1464 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:37.767985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bb53c63b-cb18-4d65-a5ed-86ead46f9f8e req-c21d016a-4746-46e3-9fb0-0c653f13a985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc5af0ba-8e12-4239-9785-b089ab629462", "name": "network-vif-plugged", "status": "completed", "tag": "9892132d-a4b9-4f11-a88e-58c77d8696c9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:37.793548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bb53c63b-cb18-4d65-a5ed-86ead46f9f8e req-c21d016a-4746-46e3-9fb0-0c653f13a985 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:37.794393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bb53c63b-cb18-4d65-a5ed-86ead46f9f8e req-c21d016a-4746-46e3-9fb0-0c653f13a985 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:37.811420 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bb53c63b-cb18-4d65-a5ed-86ead46f9f8e req-c21d016a-4746-46e3-9fb0-0c653f13a985 service nova] Creating event network-vif-plugged:9892132d-a4b9-4f11-a88e-58c77d8696c9 for instance fc5af0ba-8e12-4239-9785-b089ab629462 on n-h1-708768-8 Jul 26 20:26:37.821846 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bb53c63b-cb18-4d65-a5ed-86ead46f9f8e req-c21d016a-4746-46e3-9fb0-0c653f13a985 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062047 Jul 26 20:26:37.823026 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3249/6423] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:26:38.602327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b9aa3f76-3d97-481d-a822-515b1b7ac35b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:38.602984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b9aa3f76-3d97-481d-a822-515b1b7ac35b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:38.610156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9aa3f76-3d97-481d-a822-515b1b7ac35b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:38.610619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9aa3f76-3d97-481d-a822-515b1b7ac35b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:38.611392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9aa3f76-3d97-481d-a822-515b1b7ac35b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:38.611875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9aa3f76-3d97-481d-a822-515b1b7ac35b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:38.682582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:38.752441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b9aa3f76-3d97-481d-a822-515b1b7ac35b tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1464 microversion: 2.1 time: 0.153879 Jul 26 20:26:38.753016 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3175/6424] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:38 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:39.775500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1e15c9c4-4c54-4039-af06-36ef6a7c8edf tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:39.776248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1e15c9c4-4c54-4039-af06-36ef6a7c8edf tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:39.778338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:39.779165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:26:39.786836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e15c9c4-4c54-4039-af06-36ef6a7c8edf tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:39.787286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e15c9c4-4c54-4039-af06-36ef6a7c8edf tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:39.788849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e15c9c4-4c54-4039-af06-36ef6a7c8edf tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:39.789278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e15c9c4-4c54-4039-af06-36ef6a7c8edf tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:39.947510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1e15c9c4-4c54-4039-af06-36ef6a7c8edf tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1650 microversion: 2.1 time: 0.176733 Jul 26 20:26:39.948297 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3250/6425] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:39 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1650 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:39.969331 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ce6f8818-c340-4edf-bfa6-6287d9b1900f tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:39.970554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ce6f8818-c340-4edf-bfa6-6287d9b1900f tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:39.979245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce6f8818-c340-4edf-bfa6-6287d9b1900f tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:39.979971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce6f8818-c340-4edf-bfa6-6287d9b1900f tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:39.980931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce6f8818-c340-4edf-bfa6-6287d9b1900f tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:39.981533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ce6f8818-c340-4edf-bfa6-6287d9b1900f tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:40.128043 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ce6f8818-c340-4edf-bfa6-6287d9b1900f tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1650 microversion: 2.1 time: 0.162345 Jul 26 20:26:40.136755 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3176/6426] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:39 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1650 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:40.149321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-993d8f5e-871d-4929-a6ad-a78354987789 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:40.150251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-993d8f5e-871d-4929-a6ad-a78354987789 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:40.159327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-993d8f5e-871d-4929-a6ad-a78354987789 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:40.160104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-993d8f5e-871d-4929-a6ad-a78354987789 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:40.161747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-993d8f5e-871d-4929-a6ad-a78354987789 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:40.162417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-993d8f5e-871d-4929-a6ad-a78354987789 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:40.301663 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-993d8f5e-871d-4929-a6ad-a78354987789 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1650 microversion: 2.1 time: 0.155812 Jul 26 20:26:40.302544 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3251/6427] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:40 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1650 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:40.322989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-52218266-14f1-400c-bc44-3b41287e66f7 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:40.323499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-52218266-14f1-400c-bc44-3b41287e66f7 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:40.329920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52218266-14f1-400c-bc44-3b41287e66f7 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:40.330381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52218266-14f1-400c-bc44-3b41287e66f7 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:40.331555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52218266-14f1-400c-bc44-3b41287e66f7 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:40.332346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-52218266-14f1-400c-bc44-3b41287e66f7 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:40.360964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-52218266-14f1-400c-bc44-3b41287e66f7 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:26:40.452298 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-52218266-14f1-400c-bc44-3b41287e66f7 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 204 len: 0 microversion: 2.1 time: 0.133353 Jul 26 20:26:40.453653 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3177/6428] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:26:40 2022] DELETE /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:26:40.463789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5f77a407-fa68-46df-9229-af16f40e4ee1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:40.464838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5f77a407-fa68-46df-9229-af16f40e4ee1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:40.472228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f77a407-fa68-46df-9229-af16f40e4ee1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:40.472960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f77a407-fa68-46df-9229-af16f40e4ee1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:40.474006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f77a407-fa68-46df-9229-af16f40e4ee1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:40.474792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5f77a407-fa68-46df-9229-af16f40e4ee1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:40.620541 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5f77a407-fa68-46df-9229-af16f40e4ee1 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1656 microversion: 2.1 time: 0.162226 Jul 26 20:26:40.621316 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3252/6429] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:40 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:26:41.641653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3829d9c2-1ea2-4ee7-b7a0-79aff77fbe8d tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:41.642359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3829d9c2-1ea2-4ee7-b7a0-79aff77fbe8d tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:41.649871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3829d9c2-1ea2-4ee7-b7a0-79aff77fbe8d tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:41.650328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3829d9c2-1ea2-4ee7-b7a0-79aff77fbe8d tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:41.651095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3829d9c2-1ea2-4ee7-b7a0-79aff77fbe8d tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:41.651537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3829d9c2-1ea2-4ee7-b7a0-79aff77fbe8d tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:41.816555 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3829d9c2-1ea2-4ee7-b7a0-79aff77fbe8d tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 200 len: 1656 microversion: 2.1 time: 0.178875 Jul 26 20:26:41.817624 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3178/6430] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:41 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 1656 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:42.361017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9c1cfbf4-7444-41d2-bad0-dc0d94b67c0c req-cfa549e2-60cb-4597-b094-75e094a365fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc5af0ba-8e12-4239-9785-b089ab629462", "name": "network-vif-deleted", "tag": "9892132d-a4b9-4f11-a88e-58c77d8696c9"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:42.391215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9c1cfbf4-7444-41d2-bad0-dc0d94b67c0c req-cfa549e2-60cb-4597-b094-75e094a365fd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:42.392230 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9c1cfbf4-7444-41d2-bad0-dc0d94b67c0c req-cfa549e2-60cb-4597-b094-75e094a365fd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:42.432622 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9c1cfbf4-7444-41d2-bad0-dc0d94b67c0c req-cfa549e2-60cb-4597-b094-75e094a365fd service nova] Creating event network-vif-deleted:9892132d-a4b9-4f11-a88e-58c77d8696c9 for instance fc5af0ba-8e12-4239-9785-b089ab629462 on n-h1-708768-8 Jul 26 20:26:42.444865 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9c1cfbf4-7444-41d2-bad0-dc0d94b67c0c req-cfa549e2-60cb-4597-b094-75e094a365fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098452 Jul 26 20:26:42.453626 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3253/6431] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:26:42.841343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:42.842622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: fc5af0ba-8e12-4239-9785-b089ab629462] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:42.851549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:42.852352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:42.853420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:42.855781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:42.871685 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] HTTP exception thrown: Instance fc5af0ba-8e12-4239-9785-b089ab629462 could not be found. Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Request method failure captured: Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 HTTP/1.1 Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E3kv29kUoYJXwT4Jwu_ig2zMMU40ZbAidFqOm2KZjjw-wzozWJnw3hVCy1e8e_evHa5yr5HDJKBz7lJy4s2hiPQCBfuNqPnAMNFxXfF7zhheGORGSGdcLndP75_4HBf7RlpXGnmF6rVlM22tDmpejCA_106rX9g436REj8IiKzAlww Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a099fb107c28458293916bf2977285dd Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestServerMultinode-803950646 Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a099fb107c28458293916bf2977285dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a099fb107c28458293916bf2977285dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a099fb107c28458293916bf2977285dd", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a099fb107c28458293916bf2977285dd"}]}] Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestServerMultinode-803950646 Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a099fb107c28458293916bf2977285dd Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestServerMultinode-803950646 Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestServerMultinode-803950646-project-admin Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c9927ac9f2d5458f8c7e6f6d09bd455f Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestServerMultinode-803950646-project-admin Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance fc5af0ba-8e12-4239-9785-b089ab629462 could not be found. Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'fc5af0ba-8e12-4239-9785-b089ab629462'} Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc5af0ba-8e12-4239-9785-b089ab629462 could not be found. Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc5af0ba-8e12-4239-9785-b089ab629462 could not be found. Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:26:42.873466 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:42.878882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:42.878882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:26:42.878882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:26:42.878882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:26:42.878882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:26:42.878882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc5af0ba-8e12-4239-9785-b089ab629462 could not be found. Jul 26 20:26:42.878882 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:42.878882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Returning 404 to user: Instance fc5af0ba-8e12-4239-9785-b089ab629462 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:26:42.879684 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ead00d17-6a3f-4f4b-9a87-2f918d7adf00 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462" status: 404 len: 111 microversion: 2.1 time: 0.041687 Jul 26 20:26:42.880548 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3179/6432] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:42 2022] GET /compute/v2.1/servers/fc5af0ba-8e12-4239-9785-b089ab629462 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:26:42.889542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad74224e-60cc-40c0-beea-9b290b97b5fb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:42.890157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad74224e-60cc-40c0-beea-9b290b97b5fb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:42.896582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad74224e-60cc-40c0-beea-9b290b97b5fb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:42.897537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad74224e-60cc-40c0-beea-9b290b97b5fb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:42.898400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad74224e-60cc-40c0-beea-9b290b97b5fb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:42.898840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad74224e-60cc-40c0-beea-9b290b97b5fb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:42.924866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad74224e-60cc-40c0-beea-9b290b97b5fb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:26:43.035250 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad74224e-60cc-40c0-beea-9b290b97b5fb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 204 len: 0 microversion: 2.1 time: 0.147776 Jul 26 20:26:43.039182 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3254/6433] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:26:42 2022] DELETE /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:26:43.044864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f47cd7ce-d8ca-41b6-9a47-580ad7f2c5eb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:43.045746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f47cd7ce-d8ca-41b6-9a47-580ad7f2c5eb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:43.052241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f47cd7ce-d8ca-41b6-9a47-580ad7f2c5eb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:43.053023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f47cd7ce-d8ca-41b6-9a47-580ad7f2c5eb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:43.054221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f47cd7ce-d8ca-41b6-9a47-580ad7f2c5eb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:43.054883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f47cd7ce-d8ca-41b6-9a47-580ad7f2c5eb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:43.196149 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f47cd7ce-d8ca-41b6-9a47-580ad7f2c5eb tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1656 microversion: 2.1 time: 0.155123 Jul 26 20:26:43.199652 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3180/6434] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:43 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:44.222687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b16b1f7-6f3f-4760-9eff-66dca611fe0c tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:44.223491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b16b1f7-6f3f-4760-9eff-66dca611fe0c tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:44.231168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b16b1f7-6f3f-4760-9eff-66dca611fe0c tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:44.231666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b16b1f7-6f3f-4760-9eff-66dca611fe0c tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:44.232677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b16b1f7-6f3f-4760-9eff-66dca611fe0c tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:44.233228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b16b1f7-6f3f-4760-9eff-66dca611fe0c tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:44.401657 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b16b1f7-6f3f-4760-9eff-66dca611fe0c tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1656 microversion: 2.1 time: 0.183350 Jul 26 20:26:44.402508 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3255/6435] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:44 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1656 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:45.080885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-eb2559ea-3143-47a7-aa6b-efdd23d642c1 req-573ee2e2-9ed3-46b2-9f6d-46f0c9a2ad41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71e27b3-bc6b-4f41-a866-bf0053efac41", "name": "network-vif-deleted", "tag": "9f87c4f2-3598-4562-9e55-eb1d71232ef9"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:26:45.108011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-eb2559ea-3143-47a7-aa6b-efdd23d642c1 req-573ee2e2-9ed3-46b2-9f6d-46f0c9a2ad41 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:45.108817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-eb2559ea-3143-47a7-aa6b-efdd23d642c1 req-573ee2e2-9ed3-46b2-9f6d-46f0c9a2ad41 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:45.128712 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-eb2559ea-3143-47a7-aa6b-efdd23d642c1 req-573ee2e2-9ed3-46b2-9f6d-46f0c9a2ad41 service nova] Creating event network-vif-deleted:9f87c4f2-3598-4562-9e55-eb1d71232ef9 for instance b71e27b3-bc6b-4f41-a866-bf0053efac41 on n-h2-708768-8 Jul 26 20:26:45.135977 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-eb2559ea-3143-47a7-aa6b-efdd23d642c1 req-573ee2e2-9ed3-46b2-9f6d-46f0c9a2ad41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193498 Jul 26 20:26:45.137123 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3181/6436] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:26:45.423241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:45.424619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:45.434859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:45.435416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:45.436323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:45.436882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:45.491127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:45.491742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:45.492401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lazy-loading 'fault' on Instance uuid b71e27b3-bc6b-4f41-a866-bf0053efac41 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:26:45.566861 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dbeb3fb9-4742-4354-96c7-3d2aaaf364b6 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 200 len: 1454 microversion: 2.1 time: 0.147222 Jul 26 20:26:45.567382 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3256/6437] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:45 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:26:46.591178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:26:46.591917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] [instance: b71e27b3-bc6b-4f41-a866-bf0053efac41] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:26:46.598609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:46.599017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:46.600563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:26:46.601390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:26:46.614248 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] HTTP exception thrown: Instance b71e27b3-bc6b-4f41-a866-bf0053efac41 could not be found. Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Request method failure captured: Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 HTTP/1.1 Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E3kv29kUoYJXwT4Jwu_ig2zMMU40ZbAidFqOm2KZjjw-wzozWJnw3hVCy1e8e_evHa5yr5HDJKBz7lJy4s2hiPQCBfuNqPnAMNFxXfF7zhheGORGSGdcLndP75_4HBf7RlpXGnmF6rVlM22tDmpejCA_106rX9g436REj8IiKzAlww Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a099fb107c28458293916bf2977285dd Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestServerMultinode-803950646 Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a099fb107c28458293916bf2977285dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a099fb107c28458293916bf2977285dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a099fb107c28458293916bf2977285dd", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a099fb107c28458293916bf2977285dd"}]}] Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestServerMultinode-803950646 Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a099fb107c28458293916bf2977285dd Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestServerMultinode-803950646 Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestServerMultinode-803950646-project-admin Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: c9927ac9f2d5458f8c7e6f6d09bd455f Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestServerMultinode-803950646-project-admin Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance b71e27b3-bc6b-4f41-a866-bf0053efac41 could not be found. Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'b71e27b3-bc6b-4f41-a866-bf0053efac41'} Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71e27b3-bc6b-4f41-a866-bf0053efac41 could not be found. Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71e27b3-bc6b-4f41-a866-bf0053efac41 could not be found. Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:26:46.615970 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71e27b3-bc6b-4f41-a866-bf0053efac41 could not be found. Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] Returning 404 to user: Instance b71e27b3-bc6b-4f41-a866-bf0053efac41 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:26:46.619992 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c82f155-dcd3-489b-a9a6-b020bb914e09 tempest-TestServerMultinode-803950646 tempest-TestServerMultinode-803950646-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41" status: 404 len: 111 microversion: 2.1 time: 0.031635 Jul 26 20:26:46.621416 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3182/6438] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:26:46 2022] GET /compute/v2.1/servers/b71e27b3-bc6b-4f41-a866-bf0053efac41 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:28:05.465013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:05.465778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:05.470541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-84ccdce4-1b5e-48ad-99e5-5972b5755d97 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Action: 'create', calling method: .version_select at 0x7f875600d820>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1784377754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuCKSaKCHK7ckQrwBbFiIFmV6rE7XR0SxhqFrBUD27CVoFNmMoOktPcgw2kc9Rm3wVgeRSvFB9oN4gbRv6p6ezlZSRpiV8oeeRCAy6iG4de/DcTywqt34gDcCYHtVyLog=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:05.490232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-84ccdce4-1b5e-48ad-99e5-5972b5755d97 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Getting quotas for project bf137fd628c74f2284c590101113b26b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:28:05.495369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-84ccdce4-1b5e-48ad-99e5-5972b5755d97 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Getting quotas for user de1f1fa48741471dac0bf3fae8f91293 and project bf137fd628c74f2284c590101113b26b. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:28:05.520746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-84ccdce4-1b5e-48ad-99e5-5972b5755d97 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057923 Jul 26 20:28:05.521367 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3257/6439] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:28:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:28:06.602198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:06.603134 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:06.607501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1392753722", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8b5f3e4b-a908-46f8-ba53-718fd6235871", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1784377754", "security_groups": [{"name": "tempest-secgroup-smoke-1206559086"}], "networks": [{"uuid": "0b794d0c-77c5-41b3-829c-84f1fa16912e"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:06.746173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] validate_networks() for [('0b794d0c-77c5-41b3-829c-84f1fa16912e', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:28:07.263278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:28:07.263744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:28:07.264233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:28:07.264678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:28:07.265691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:28:07.274562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:07.275021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:07.275855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:07.276309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:07.292806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Getting quotas for project bf137fd628c74f2284c590101113b26b. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:28:07.298096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Getting quotas for user de1f1fa48741471dac0bf3fae8f91293 and project bf137fd628c74f2284c590101113b26b. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:28:07.357155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:28:07.360146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b5f3e4b-a908-46f8-ba53-718fd6235871',volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:28:07.504461 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d4b11f55-ce2c-4479-9a9b-dccfbcaad92b tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.904355 Jul 26 20:28:07.505507 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3183/6440] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:28:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:28:07.516721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2506e469-8a03-423c-83ef-14540e4da5c5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:07.517605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2506e469-8a03-423c-83ef-14540e4da5c5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:07.597593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2506e469-8a03-423c-83ef-14540e4da5c5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:07.609328 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2506e469-8a03-423c-83ef-14540e4da5c5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1099 microversion: 2.1 time: 0.096364 Jul 26 20:28:07.610120 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3258/6441] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:07 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1099 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:08.632797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9c72ae60-f7c6-48e2-9d4d-2c6d10887332 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:08.633529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9c72ae60-f7c6-48e2-9d4d-2c6d10887332 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:08.641453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c72ae60-f7c6-48e2-9d4d-2c6d10887332 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:08.642127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c72ae60-f7c6-48e2-9d4d-2c6d10887332 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:08.643125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c72ae60-f7c6-48e2-9d4d-2c6d10887332 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:08.643660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c72ae60-f7c6-48e2-9d4d-2c6d10887332 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:08.760052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9c72ae60-f7c6-48e2-9d4d-2c6d10887332 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:08.770545 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9c72ae60-f7c6-48e2-9d4d-2c6d10887332 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1215 microversion: 2.1 time: 0.143465 Jul 26 20:28:08.771158 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3184/6442] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:08 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:09.794268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-00378622-4fda-46d3-b387-43c359cfc731 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:09.795019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-00378622-4fda-46d3-b387-43c359cfc731 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:09.815061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00378622-4fda-46d3-b387-43c359cfc731 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:09.819232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00378622-4fda-46d3-b387-43c359cfc731 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:09.820188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00378622-4fda-46d3-b387-43c359cfc731 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:09.820645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-00378622-4fda-46d3-b387-43c359cfc731 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:10.049702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-00378622-4fda-46d3-b387-43c359cfc731 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:10.063578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-00378622-4fda-46d3-b387-43c359cfc731 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1283 microversion: 2.1 time: 0.273902 Jul 26 20:28:10.064201 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3259/6443] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:09 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1283 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:10.186404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-231c9d1d-04a3-4b57-bb73-da1ee4aeb4ee req-eaa0a363-d594-436b-8536-e58a2c2f357b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80570a3-0cd8-40cb-9d87-cc4ee66387fd", "tag": "beb078c6-63e8-4155-ae32-b926902a3cfe"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:10.208599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-231c9d1d-04a3-4b57-bb73-da1ee4aeb4ee req-eaa0a363-d594-436b-8536-e58a2c2f357b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:10.209063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-231c9d1d-04a3-4b57-bb73-da1ee4aeb4ee req-eaa0a363-d594-436b-8536-e58a2c2f357b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:10.227818 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-231c9d1d-04a3-4b57-bb73-da1ee4aeb4ee req-eaa0a363-d594-436b-8536-e58a2c2f357b service nova] Creating event network-changed:beb078c6-63e8-4155-ae32-b926902a3cfe for instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd on n-h1-708768-8 Jul 26 20:28:10.236868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-231c9d1d-04a3-4b57-bb73-da1ee4aeb4ee req-eaa0a363-d594-436b-8536-e58a2c2f357b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063810 Jul 26 20:28:10.237806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3185/6444] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:28:11.085135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-018c009b-4dc6-4554-b6f1-574d498bf297 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:11.089031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-018c009b-4dc6-4554-b6f1-574d498bf297 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:11.098831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-018c009b-4dc6-4554-b6f1-574d498bf297 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:11.102834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-018c009b-4dc6-4554-b6f1-574d498bf297 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:11.104106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-018c009b-4dc6-4554-b6f1-574d498bf297 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:11.104791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-018c009b-4dc6-4554-b6f1-574d498bf297 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:11.285935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-018c009b-4dc6-4554-b6f1-574d498bf297 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:11.293983 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-018c009b-4dc6-4554-b6f1-574d498bf297 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1283 microversion: 2.1 time: 0.212862 Jul 26 20:28:11.294573 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3260/6445] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:11 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1283 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:12.317583 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0081eb0d-0b3d-4a81-a6f6-19b6b9db6de2 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:12.318313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0081eb0d-0b3d-4a81-a6f6-19b6b9db6de2 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:12.325088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0081eb0d-0b3d-4a81-a6f6-19b6b9db6de2 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:12.325552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0081eb0d-0b3d-4a81-a6f6-19b6b9db6de2 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:12.326346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0081eb0d-0b3d-4a81-a6f6-19b6b9db6de2 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:12.326795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0081eb0d-0b3d-4a81-a6f6-19b6b9db6de2 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:12.478101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0081eb0d-0b3d-4a81-a6f6-19b6b9db6de2 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:12.488067 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0081eb0d-0b3d-4a81-a6f6-19b6b9db6de2 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1283 microversion: 2.1 time: 0.175845 Jul 26 20:28:12.495652 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3186/6446] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:12 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:13.509809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a882fa20-7c00-4c96-a69b-c7fd7dec27fe tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:13.510368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a882fa20-7c00-4c96-a69b-c7fd7dec27fe tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:13.529614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a882fa20-7c00-4c96-a69b-c7fd7dec27fe tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:13.530072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a882fa20-7c00-4c96-a69b-c7fd7dec27fe tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:13.530947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a882fa20-7c00-4c96-a69b-c7fd7dec27fe tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:13.531394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a882fa20-7c00-4c96-a69b-c7fd7dec27fe tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:13.674498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a882fa20-7c00-4c96-a69b-c7fd7dec27fe tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:13.682995 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a882fa20-7c00-4c96-a69b-c7fd7dec27fe tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1283 microversion: 2.1 time: 0.177375 Jul 26 20:28:13.683691 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3261/6447] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:13 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1283 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:14.705482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32085087-aa2c-4a75-9e9e-c43a8f6ccd00 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:14.706130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32085087-aa2c-4a75-9e9e-c43a8f6ccd00 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:14.713226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32085087-aa2c-4a75-9e9e-c43a8f6ccd00 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:14.713677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32085087-aa2c-4a75-9e9e-c43a8f6ccd00 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:14.715322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32085087-aa2c-4a75-9e9e-c43a8f6ccd00 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:14.715322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32085087-aa2c-4a75-9e9e-c43a8f6ccd00 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:14.859297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-32085087-aa2c-4a75-9e9e-c43a8f6ccd00 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:14.866874 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32085087-aa2c-4a75-9e9e-c43a8f6ccd00 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.166296 Jul 26 20:28:14.867444 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3187/6448] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:14 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:15.890149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c31c2bae-b01a-400a-b458-b837a0f99044 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:15.891042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c31c2bae-b01a-400a-b458-b837a0f99044 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:15.898309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c31c2bae-b01a-400a-b458-b837a0f99044 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:15.899115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c31c2bae-b01a-400a-b458-b837a0f99044 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:15.900046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c31c2bae-b01a-400a-b458-b837a0f99044 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:15.900620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c31c2bae-b01a-400a-b458-b837a0f99044 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:16.053560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c31c2bae-b01a-400a-b458-b837a0f99044 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:16.063538 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c31c2bae-b01a-400a-b458-b837a0f99044 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.177804 Jul 26 20:28:16.064377 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3262/6449] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:15 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:17.093258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87e5446e-d9f7-4cd3-99ef-a1ccd407868a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:17.093902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87e5446e-d9f7-4cd3-99ef-a1ccd407868a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:17.100857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87e5446e-d9f7-4cd3-99ef-a1ccd407868a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:17.101323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87e5446e-d9f7-4cd3-99ef-a1ccd407868a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:17.102104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87e5446e-d9f7-4cd3-99ef-a1ccd407868a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:17.102555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87e5446e-d9f7-4cd3-99ef-a1ccd407868a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:17.240468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-87e5446e-d9f7-4cd3-99ef-a1ccd407868a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:17.248206 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87e5446e-d9f7-4cd3-99ef-a1ccd407868a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.159601 Jul 26 20:28:17.249000 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3188/6450] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:17 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:18.269383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fc8d1e4d-647c-4a5e-9b63-af092579bc31 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:18.281127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fc8d1e4d-647c-4a5e-9b63-af092579bc31 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:18.284432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:18.289480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc8d1e4d-647c-4a5e-9b63-af092579bc31 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:18.290093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc8d1e4d-647c-4a5e-9b63-af092579bc31 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:18.291098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc8d1e4d-647c-4a5e-9b63-af092579bc31 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:18.291545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fc8d1e4d-647c-4a5e-9b63-af092579bc31 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:18.444902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fc8d1e4d-647c-4a5e-9b63-af092579bc31 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:18.453455 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fc8d1e4d-647c-4a5e-9b63-af092579bc31 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.187909 Jul 26 20:28:18.454366 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3263/6451] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:18 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:19.476755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-796a5334-f83b-4ba9-bbd3-6d2025b65404 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:19.477482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-796a5334-f83b-4ba9-bbd3-6d2025b65404 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:19.479336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:19.480187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:19.492125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-796a5334-f83b-4ba9-bbd3-6d2025b65404 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:19.492832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-796a5334-f83b-4ba9-bbd3-6d2025b65404 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:19.493391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-796a5334-f83b-4ba9-bbd3-6d2025b65404 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:19.494812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-796a5334-f83b-4ba9-bbd3-6d2025b65404 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:19.644200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-796a5334-f83b-4ba9-bbd3-6d2025b65404 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:19.663152 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-796a5334-f83b-4ba9-bbd3-6d2025b65404 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.189813 Jul 26 20:28:19.663970 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3189/6452] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:19 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:20.684923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fefbb232-3127-44fd-96c8-fac10159dd2f tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:20.685483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fefbb232-3127-44fd-96c8-fac10159dd2f tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:20.693163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fefbb232-3127-44fd-96c8-fac10159dd2f tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:20.693626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fefbb232-3127-44fd-96c8-fac10159dd2f tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:20.694412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fefbb232-3127-44fd-96c8-fac10159dd2f tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:20.694855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fefbb232-3127-44fd-96c8-fac10159dd2f tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:20.838306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fefbb232-3127-44fd-96c8-fac10159dd2f tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:20.848005 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fefbb232-3127-44fd-96c8-fac10159dd2f tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.167160 Jul 26 20:28:20.848604 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3264/6453] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:20 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:21.869859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bbfc0037-6cf9-4fd9-a1c8-4b145cf6b054 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:21.870418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bbfc0037-6cf9-4fd9-a1c8-4b145cf6b054 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:21.878374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbfc0037-6cf9-4fd9-a1c8-4b145cf6b054 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:21.878834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbfc0037-6cf9-4fd9-a1c8-4b145cf6b054 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:21.879625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbfc0037-6cf9-4fd9-a1c8-4b145cf6b054 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:21.880084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbfc0037-6cf9-4fd9-a1c8-4b145cf6b054 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:22.082938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bbfc0037-6cf9-4fd9-a1c8-4b145cf6b054 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:22.093260 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bbfc0037-6cf9-4fd9-a1c8-4b145cf6b054 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.226617 Jul 26 20:28:22.093980 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3190/6454] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:21 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:23.123195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-02b74949-f986-465e-85eb-797d7478ba86 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:23.125267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-02b74949-f986-465e-85eb-797d7478ba86 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:23.141736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02b74949-f986-465e-85eb-797d7478ba86 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:23.142917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02b74949-f986-465e-85eb-797d7478ba86 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:23.145795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02b74949-f986-465e-85eb-797d7478ba86 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:23.146241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-02b74949-f986-465e-85eb-797d7478ba86 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:23.402505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-02b74949-f986-465e-85eb-797d7478ba86 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:23.421098 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-02b74949-f986-465e-85eb-797d7478ba86 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.305163 Jul 26 20:28:23.421846 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3265/6455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:23 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:24.361187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-65674425-66e9-420e-8f04-be70e719735c req-b4ad8d93-3b50-42cd-baf2-c6e3983e734a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80570a3-0cd8-40cb-9d87-cc4ee66387fd", "name": "network-vif-plugged", "status": "completed", "tag": "beb078c6-63e8-4155-ae32-b926902a3cfe"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:24.383601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-65674425-66e9-420e-8f04-be70e719735c req-b4ad8d93-3b50-42cd-baf2-c6e3983e734a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:24.384482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-65674425-66e9-420e-8f04-be70e719735c req-b4ad8d93-3b50-42cd-baf2-c6e3983e734a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:24.402464 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-65674425-66e9-420e-8f04-be70e719735c req-b4ad8d93-3b50-42cd-baf2-c6e3983e734a service nova] Creating event network-vif-plugged:beb078c6-63e8-4155-ae32-b926902a3cfe for instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd on n-h1-708768-8 Jul 26 20:28:24.408251 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-65674425-66e9-420e-8f04-be70e719735c req-b4ad8d93-3b50-42cd-baf2-c6e3983e734a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051339 Jul 26 20:28:24.409505 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3191/6456] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:28:24.443964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-41fff621-f9de-41ff-a0ef-9e522c59b2eb tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:24.445261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41fff621-f9de-41ff-a0ef-9e522c59b2eb tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:24.454953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41fff621-f9de-41ff-a0ef-9e522c59b2eb tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:24.456279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41fff621-f9de-41ff-a0ef-9e522c59b2eb tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:24.457263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41fff621-f9de-41ff-a0ef-9e522c59b2eb tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:24.457865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41fff621-f9de-41ff-a0ef-9e522c59b2eb tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:24.698469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-41fff621-f9de-41ff-a0ef-9e522c59b2eb tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:24.707404 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-41fff621-f9de-41ff-a0ef-9e522c59b2eb tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1271 microversion: 2.1 time: 0.267512 Jul 26 20:28:24.720535 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3266/6457] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:24 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:25.731923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b5616401-84fe-4f59-90a4-54971c14f4b9 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:25.733307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b5616401-84fe-4f59-90a4-54971c14f4b9 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:25.740435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5616401-84fe-4f59-90a4-54971c14f4b9 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:25.741126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5616401-84fe-4f59-90a4-54971c14f4b9 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:25.742097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5616401-84fe-4f59-90a4-54971c14f4b9 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:25.742716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5616401-84fe-4f59-90a4-54971c14f4b9 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:25.917941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5616401-84fe-4f59-90a4-54971c14f4b9 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:25.942884 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b5616401-84fe-4f59-90a4-54971c14f4b9 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1460 microversion: 2.1 time: 0.216103 Jul 26 20:28:25.944336 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3192/6458] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:25 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1460 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:28:25.971376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6c71e5ca-c4e3-4540-bdb5-b879c991bdf7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:25.972011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6c71e5ca-c4e3-4540-bdb5-b879c991bdf7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:25.978199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c71e5ca-c4e3-4540-bdb5-b879c991bdf7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:25.978852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c71e5ca-c4e3-4540-bdb5-b879c991bdf7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:25.979818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c71e5ca-c4e3-4540-bdb5-b879c991bdf7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:25.980407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c71e5ca-c4e3-4540-bdb5-b879c991bdf7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:26.165897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c71e5ca-c4e3-4540-bdb5-b879c991bdf7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:26.175107 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6c71e5ca-c4e3-4540-bdb5-b879c991bdf7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1460 microversion: 2.1 time: 0.209883 Jul 26 20:28:26.176333 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3267/6459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:25 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1460 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:27.167155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-424213734", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-82311540", "security_groups": [{"name": "tempest-secgroup-smoke-64409093"}], "block_device_mapping_v2": [{"uuid": "a6222f4c-3775-45e0-af8e-3fa0355c0881", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8dd04748-e18a-4968-8aa4-c87b9f3665a7"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:27.396065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] validate_networks() for [('8dd04748-e18a-4968-8aa4-c87b9f3665a7', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:28:27.946959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:28:27.947584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:28:27.948383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:28:27.948873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:28:27.949365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:28:27.963473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:27.972970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:27.972970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:27.972970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:27.986180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:28:27.992136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Getting quotas for user 931f606954894f54aa910706b783a501 and project fc2b529683214d7f8d39b58407e1b415. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:28:28.066278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:28:28.067784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6222f4c-3775-45e0-af8e-3fa0355c0881',volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:28:28.220606 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8ed72891-4d24-41db-8902-a1e4bc8e73ee tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.057392 Jul 26 20:28:28.221960 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3193/6460] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:28:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:28:28.234087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82b032f4-5d49-48d7-b854-e34e13e6bee4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:28.234707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82b032f4-5d49-48d7-b854-e34e13e6bee4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:28.262752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-25f3b8d5-7069-41bf-a934-e92452751f41 req-51c564a2-63ad-4d18-9518-4837801a8b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80570a3-0cd8-40cb-9d87-cc4ee66387fd", "tag": "beb078c6-63e8-4155-ae32-b926902a3cfe"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:28.276942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-25f3b8d5-7069-41bf-a934-e92452751f41 req-51c564a2-63ad-4d18-9518-4837801a8b5f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:28.277711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-25f3b8d5-7069-41bf-a934-e92452751f41 req-51c564a2-63ad-4d18-9518-4837801a8b5f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:28.298868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-25f3b8d5-7069-41bf-a934-e92452751f41 req-51c564a2-63ad-4d18-9518-4837801a8b5f service nova] Creating event network-changed:beb078c6-63e8-4155-ae32-b926902a3cfe for instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd on n-h1-708768-8 Jul 26 20:28:28.309275 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-25f3b8d5-7069-41bf-a934-e92452751f41 req-51c564a2-63ad-4d18-9518-4837801a8b5f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051124 Jul 26 20:28:28.315747 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3194/6461] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:28:28.331450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82b032f4-5d49-48d7-b854-e34e13e6bee4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:28.340288 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82b032f4-5d49-48d7-b854-e34e13e6bee4 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1092 microversion: 2.1 time: 0.110039 Jul 26 20:28:28.354893 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3268/6462] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:28 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1092 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:29.364468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3f9789f7-00ae-4d2b-814d-3c98003ff0b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:29.365562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3f9789f7-00ae-4d2b-814d-3c98003ff0b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:29.371791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f9789f7-00ae-4d2b-814d-3c98003ff0b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:29.376338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f9789f7-00ae-4d2b-814d-3c98003ff0b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:29.376338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f9789f7-00ae-4d2b-814d-3c98003ff0b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:29.376338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f9789f7-00ae-4d2b-814d-3c98003ff0b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:29.466450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3f9789f7-00ae-4d2b-814d-3c98003ff0b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:29.475234 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3f9789f7-00ae-4d2b-814d-3c98003ff0b5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1190 microversion: 2.1 time: 0.115833 Jul 26 20:28:29.479651 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3195/6463] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:29 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1190 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:30.499028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4d0dc26-5889-4137-98bd-aedb139cb5e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:30.499890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b4d0dc26-5889-4137-98bd-aedb139cb5e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:30.512710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc26-5889-4137-98bd-aedb139cb5e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:30.516801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc26-5889-4137-98bd-aedb139cb5e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:30.517733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc26-5889-4137-98bd-aedb139cb5e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:30.519247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc26-5889-4137-98bd-aedb139cb5e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:30.612756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-b621d529-c3a7-45e7-a368-b43af82a19a9 req-7e6aa327-8b2c-4070-9929-0fb0b460a688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80570a3-0cd8-40cb-9d87-cc4ee66387fd", "tag": "beb078c6-63e8-4155-ae32-b926902a3cfe"}, {"name": "network-changed", "server_uuid": "e80570a3-0cd8-40cb-9d87-cc4ee66387fd", "tag": "beb078c6-63e8-4155-ae32-b926902a3cfe"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:30.627349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b621d529-c3a7-45e7-a368-b43af82a19a9 req-7e6aa327-8b2c-4070-9929-0fb0b460a688 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:30.628145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-b621d529-c3a7-45e7-a368-b43af82a19a9 req-7e6aa327-8b2c-4070-9929-0fb0b460a688 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:30.641902 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b621d529-c3a7-45e7-a368-b43af82a19a9 req-7e6aa327-8b2c-4070-9929-0fb0b460a688 service nova] Creating event network-changed:beb078c6-63e8-4155-ae32-b926902a3cfe for instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd on n-h1-708768-8 Jul 26 20:28:30.642754 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-b621d529-c3a7-45e7-a368-b43af82a19a9 req-7e6aa327-8b2c-4070-9929-0fb0b460a688 service nova] Creating event network-changed:beb078c6-63e8-4155-ae32-b926902a3cfe for instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd on n-h1-708768-8 Jul 26 20:28:30.650417 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-b621d529-c3a7-45e7-a368-b43af82a19a9 req-7e6aa327-8b2c-4070-9929-0fb0b460a688 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041881 Jul 26 20:28:30.654016 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3196/6464] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:28:30.942345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b4d0dc26-5889-4137-98bd-aedb139cb5e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:30.950430 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4d0dc26-5889-4137-98bd-aedb139cb5e9 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1208 microversion: 2.1 time: 0.455949 Jul 26 20:28:30.954047 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3269/6465] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:30 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1208 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:31.979016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-61e9a1bf-c3b5-4039-bb2c-73178e0b70bb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:31.980748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-61e9a1bf-c3b5-4039-bb2c-73178e0b70bb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:31.993149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61e9a1bf-c3b5-4039-bb2c-73178e0b70bb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:31.994079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61e9a1bf-c3b5-4039-bb2c-73178e0b70bb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:31.995090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61e9a1bf-c3b5-4039-bb2c-73178e0b70bb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:31.995951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61e9a1bf-c3b5-4039-bb2c-73178e0b70bb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:32.458121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-61e9a1bf-c3b5-4039-bb2c-73178e0b70bb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:32.475846 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-61e9a1bf-c3b5-4039-bb2c-73178e0b70bb tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1274 microversion: 2.1 time: 0.496827 Jul 26 20:28:32.476524 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3197/6466] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:31 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1274 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:32.700752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e807492b-2faf-4805-a917-e50aff89ab38 req-48a317cd-1f06-44e9-a57f-f3c68cd9f334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09479a79-dee2-4c8a-bc27-1c3f1598dcac", "tag": "c42936f9-d2fa-4d35-ac0e-1dd19354c416"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:32.724530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e807492b-2faf-4805-a917-e50aff89ab38 req-48a317cd-1f06-44e9-a57f-f3c68cd9f334 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:32.725260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e807492b-2faf-4805-a917-e50aff89ab38 req-48a317cd-1f06-44e9-a57f-f3c68cd9f334 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:32.744527 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e807492b-2faf-4805-a917-e50aff89ab38 req-48a317cd-1f06-44e9-a57f-f3c68cd9f334 service nova] Creating event network-changed:c42936f9-d2fa-4d35-ac0e-1dd19354c416 for instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac on n-h2-708768-8 Jul 26 20:28:32.751769 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e807492b-2faf-4805-a917-e50aff89ab38 req-48a317cd-1f06-44e9-a57f-f3c68cd9f334 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055231 Jul 26 20:28:32.752394 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3270/6467] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:28:33.498619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a9def342-96f9-401b-a87d-b44ca892899c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:33.499956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a9def342-96f9-401b-a87d-b44ca892899c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:33.508969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9def342-96f9-401b-a87d-b44ca892899c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:33.509741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9def342-96f9-401b-a87d-b44ca892899c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:33.510537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9def342-96f9-401b-a87d-b44ca892899c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:33.511157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9def342-96f9-401b-a87d-b44ca892899c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:33.667747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a9def342-96f9-401b-a87d-b44ca892899c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:33.676085 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a9def342-96f9-401b-a87d-b44ca892899c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1274 microversion: 2.1 time: 0.181867 Jul 26 20:28:33.676835 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3198/6468] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:33 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:34.699442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9aac8334-07e9-41d7-a0f7-883b64e06eb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:34.700229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9aac8334-07e9-41d7-a0f7-883b64e06eb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:34.709037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aac8334-07e9-41d7-a0f7-883b64e06eb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:34.709509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aac8334-07e9-41d7-a0f7-883b64e06eb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:34.710309 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aac8334-07e9-41d7-a0f7-883b64e06eb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:34.710749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9aac8334-07e9-41d7-a0f7-883b64e06eb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:34.879167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9aac8334-07e9-41d7-a0f7-883b64e06eb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:34.886960 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9aac8334-07e9-41d7-a0f7-883b64e06eb7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1274 microversion: 2.1 time: 0.192698 Jul 26 20:28:34.887541 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3271/6469] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:34 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1274 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:35.915084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d7dc0e7-6424-42a6-a70c-633559e293d7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:35.916504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8d7dc0e7-6424-42a6-a70c-633559e293d7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:35.931442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d7dc0e7-6424-42a6-a70c-633559e293d7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:35.931828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d7dc0e7-6424-42a6-a70c-633559e293d7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:35.932942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d7dc0e7-6424-42a6-a70c-633559e293d7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:35.933524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d7dc0e7-6424-42a6-a70c-633559e293d7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:36.095868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8d7dc0e7-6424-42a6-a70c-633559e293d7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:36.104584 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d7dc0e7-6424-42a6-a70c-633559e293d7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1274 microversion: 2.1 time: 0.200013 Jul 26 20:28:36.105253 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3199/6470] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:35 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:37.128131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9ef4880c-7cf1-4864-8f8e-377ccc69ffef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:37.128833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9ef4880c-7cf1-4864-8f8e-377ccc69ffef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:37.132132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:37.139362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ef4880c-7cf1-4864-8f8e-377ccc69ffef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:37.139884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ef4880c-7cf1-4864-8f8e-377ccc69ffef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:37.140841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ef4880c-7cf1-4864-8f8e-377ccc69ffef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:37.141288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ef4880c-7cf1-4864-8f8e-377ccc69ffef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:37.145069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=69 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:37.298253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9ef4880c-7cf1-4864-8f8e-377ccc69ffef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:37.306172 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9ef4880c-7cf1-4864-8f8e-377ccc69ffef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.182742 Jul 26 20:28:37.307161 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3272/6471] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:37 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:38.329191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a86408eb-3b2c-4f45-8ee6-6e876e89179e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:38.329754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a86408eb-3b2c-4f45-8ee6-6e876e89179e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:38.332571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:38.333245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:38.333906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:38.340843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a86408eb-3b2c-4f45-8ee6-6e876e89179e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:38.341964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a86408eb-3b2c-4f45-8ee6-6e876e89179e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:38.343045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a86408eb-3b2c-4f45-8ee6-6e876e89179e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:38.343552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a86408eb-3b2c-4f45-8ee6-6e876e89179e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:38.346922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=79 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:38.482285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a86408eb-3b2c-4f45-8ee6-6e876e89179e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:38.490037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a86408eb-3b2c-4f45-8ee6-6e876e89179e tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.165702 Jul 26 20:28:38.490973 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3200/6472] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:38 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:39.512566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e4cc3942-c76c-402b-86e8-2d465465d3ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:39.513870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e4cc3942-c76c-402b-86e8-2d465465d3ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:39.516534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:28:39.522255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4cc3942-c76c-402b-86e8-2d465465d3ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:39.522701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4cc3942-c76c-402b-86e8-2d465465d3ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:39.523467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4cc3942-c76c-402b-86e8-2d465465d3ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:39.523928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4cc3942-c76c-402b-86e8-2d465465d3ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:39.661576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e4cc3942-c76c-402b-86e8-2d465465d3ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:39.669769 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e4cc3942-c76c-402b-86e8-2d465465d3ec tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.160633 Jul 26 20:28:39.670352 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3273/6473] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:39 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:40.692034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3f5ac0c-212b-4af8-b029-7816fc1a79e8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:40.692686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a3f5ac0c-212b-4af8-b029-7816fc1a79e8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:40.702897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3f5ac0c-212b-4af8-b029-7816fc1a79e8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:40.703345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3f5ac0c-212b-4af8-b029-7816fc1a79e8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:40.704158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3f5ac0c-212b-4af8-b029-7816fc1a79e8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:40.704607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3f5ac0c-212b-4af8-b029-7816fc1a79e8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:40.856973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3f5ac0c-212b-4af8-b029-7816fc1a79e8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:40.866451 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3f5ac0c-212b-4af8-b029-7816fc1a79e8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.179590 Jul 26 20:28:40.867043 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3201/6474] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:40 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:28:41.889233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e79e471f-827a-4a0a-a62f-b089b81007bf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:41.889854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e79e471f-827a-4a0a-a62f-b089b81007bf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:41.896801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e79e471f-827a-4a0a-a62f-b089b81007bf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:41.897247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e79e471f-827a-4a0a-a62f-b089b81007bf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:41.898006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e79e471f-827a-4a0a-a62f-b089b81007bf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:41.898435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e79e471f-827a-4a0a-a62f-b089b81007bf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:42.035216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e79e471f-827a-4a0a-a62f-b089b81007bf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:42.042984 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e79e471f-827a-4a0a-a62f-b089b81007bf tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.158148 Jul 26 20:28:42.043567 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3274/6475] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:41 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:43.065124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5ab3a6ec-40dc-4200-962f-15ec514aa301 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:43.065691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5ab3a6ec-40dc-4200-962f-15ec514aa301 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:43.072963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ab3a6ec-40dc-4200-962f-15ec514aa301 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:43.073419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ab3a6ec-40dc-4200-962f-15ec514aa301 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:43.074209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ab3a6ec-40dc-4200-962f-15ec514aa301 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:43.074655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5ab3a6ec-40dc-4200-962f-15ec514aa301 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:43.211821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5ab3a6ec-40dc-4200-962f-15ec514aa301 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:43.219401 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5ab3a6ec-40dc-4200-962f-15ec514aa301 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.158461 Jul 26 20:28:43.220024 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3202/6476] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:43 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:44.240688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9c20c1a0-0325-45aa-b1a1-f4698c541845 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:44.241298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9c20c1a0-0325-45aa-b1a1-f4698c541845 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:44.249254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c20c1a0-0325-45aa-b1a1-f4698c541845 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:44.249791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c20c1a0-0325-45aa-b1a1-f4698c541845 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:44.250669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c20c1a0-0325-45aa-b1a1-f4698c541845 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:44.251175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9c20c1a0-0325-45aa-b1a1-f4698c541845 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:44.397441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9c20c1a0-0325-45aa-b1a1-f4698c541845 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:44.405934 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9c20c1a0-0325-45aa-b1a1-f4698c541845 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.169151 Jul 26 20:28:44.406518 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3275/6477] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:44 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:45.426648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2044067-7480-4e1f-940b-66b8ff2fc07d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:45.427203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b2044067-7480-4e1f-940b-66b8ff2fc07d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:45.434890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2044067-7480-4e1f-940b-66b8ff2fc07d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:45.435351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2044067-7480-4e1f-940b-66b8ff2fc07d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:45.436162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2044067-7480-4e1f-940b-66b8ff2fc07d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:45.436611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2044067-7480-4e1f-940b-66b8ff2fc07d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:45.584802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b2044067-7480-4e1f-940b-66b8ff2fc07d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:45.593310 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b2044067-7480-4e1f-940b-66b8ff2fc07d tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.170573 Jul 26 20:28:45.593864 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3203/6478] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:45 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:45.852049 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:28:45.852275 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:28:46.344611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b9b335c5-82c1-420d-b4c0-9715380ab275 req-474b66e6-9eaa-4325-9007-c976f9c587a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09479a79-dee2-4c8a-bc27-1c3f1598dcac", "name": "network-vif-plugged", "status": "completed", "tag": "c42936f9-d2fa-4d35-ac0e-1dd19354c416"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:46.362902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b9b335c5-82c1-420d-b4c0-9715380ab275 req-474b66e6-9eaa-4325-9007-c976f9c587a1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:46.363673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b9b335c5-82c1-420d-b4c0-9715380ab275 req-474b66e6-9eaa-4325-9007-c976f9c587a1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:46.377179 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b9b335c5-82c1-420d-b4c0-9715380ab275 req-474b66e6-9eaa-4325-9007-c976f9c587a1 service nova] Creating event network-vif-plugged:c42936f9-d2fa-4d35-ac0e-1dd19354c416 for instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac on n-h2-708768-8 Jul 26 20:28:46.382756 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b9b335c5-82c1-420d-b4c0-9715380ab275 req-474b66e6-9eaa-4325-9007-c976f9c587a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043243 Jul 26 20:28:46.383598 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3276/6479] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:28:46.617493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b05ce18c-39f0-4d49-a6bc-5fdc7dfafaf7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:46.617493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b05ce18c-39f0-4d49-a6bc-5fdc7dfafaf7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:46.624964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b05ce18c-39f0-4d49-a6bc-5fdc7dfafaf7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:46.625426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b05ce18c-39f0-4d49-a6bc-5fdc7dfafaf7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:46.626215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b05ce18c-39f0-4d49-a6bc-5fdc7dfafaf7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:46.626664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b05ce18c-39f0-4d49-a6bc-5fdc7dfafaf7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:46.792817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b05ce18c-39f0-4d49-a6bc-5fdc7dfafaf7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:46.801179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b05ce18c-39f0-4d49-a6bc-5fdc7dfafaf7 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1262 microversion: 2.1 time: 0.190624 Jul 26 20:28:46.801796 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3204/6480] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:46 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1262 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:47.824329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-166fdc4e-41f6-4384-97a2-e5e0931a5aef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:47.825444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-166fdc4e-41f6-4384-97a2-e5e0931a5aef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:47.831974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-166fdc4e-41f6-4384-97a2-e5e0931a5aef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:47.832443 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-166fdc4e-41f6-4384-97a2-e5e0931a5aef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:47.833240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-166fdc4e-41f6-4384-97a2-e5e0931a5aef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:47.833684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-166fdc4e-41f6-4384-97a2-e5e0931a5aef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:47.993767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-166fdc4e-41f6-4384-97a2-e5e0931a5aef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:48.002289 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-166fdc4e-41f6-4384-97a2-e5e0931a5aef tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1449 microversion: 2.1 time: 0.183461 Jul 26 20:28:48.003089 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3277/6481] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:47 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1449 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:48.025870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5a828705-ba55-45b9-97ef-fc6de0fddc38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:28:48.026523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5a828705-ba55-45b9-97ef-fc6de0fddc38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:28:48.037340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a828705-ba55-45b9-97ef-fc6de0fddc38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:48.037877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a828705-ba55-45b9-97ef-fc6de0fddc38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:48.038974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a828705-ba55-45b9-97ef-fc6de0fddc38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:48.039594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5a828705-ba55-45b9-97ef-fc6de0fddc38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:48.377997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5a828705-ba55-45b9-97ef-fc6de0fddc38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:28:48.377997 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5a828705-ba55-45b9-97ef-fc6de0fddc38 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1449 microversion: 2.1 time: 0.180467 Jul 26 20:28:48.377997 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3205/6482] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:28:48 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1449 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:28:50.630098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bbf50f47-e598-4ec3-9b8d-b642198872ba req-fe776d7a-19c4-41e2-884d-ff7cd3e75908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09479a79-dee2-4c8a-bc27-1c3f1598dcac", "tag": "c42936f9-d2fa-4d35-ac0e-1dd19354c416"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:28:50.640919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bbf50f47-e598-4ec3-9b8d-b642198872ba req-fe776d7a-19c4-41e2-884d-ff7cd3e75908 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:28:50.641367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bbf50f47-e598-4ec3-9b8d-b642198872ba req-fe776d7a-19c4-41e2-884d-ff7cd3e75908 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:28:50.655239 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bbf50f47-e598-4ec3-9b8d-b642198872ba req-fe776d7a-19c4-41e2-884d-ff7cd3e75908 service nova] Creating event network-changed:c42936f9-d2fa-4d35-ac0e-1dd19354c416 for instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac on n-h2-708768-8 Jul 26 20:28:50.660984 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bbf50f47-e598-4ec3-9b8d-b642198872ba req-fe776d7a-19c4-41e2-884d-ff7cd3e75908 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121478 Jul 26 20:28:50.661904 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3278/6483] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:29:03.555437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a20ed833-d5a7-45c1-b3bf-5a4cc0cd0ab0 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:03.556106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a20ed833-d5a7-45c1-b3bf-5a4cc0cd0ab0 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:29:03.556210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=13 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:29:03.557252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=33 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:29:03.565092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0480ecef-63f6-47a3-9203-4dad6fdd64b3 req-4484c18c-dab4-4f19-9a61-11df958a9f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80570a3-0cd8-40cb-9d87-cc4ee66387fd", "tag": "beb078c6-63e8-4155-ae32-b926902a3cfe"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:29:03.568068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=11 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:29:03.569872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=35 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:29:03.575535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a20ed833-d5a7-45c1-b3bf-5a4cc0cd0ab0 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:03.576476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a20ed833-d5a7-45c1-b3bf-5a4cc0cd0ab0 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:03.577593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a20ed833-d5a7-45c1-b3bf-5a4cc0cd0ab0 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:03.578262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a20ed833-d5a7-45c1-b3bf-5a4cc0cd0ab0 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:03.579904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0480ecef-63f6-47a3-9203-4dad6fdd64b3 req-4484c18c-dab4-4f19-9a61-11df958a9f2e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:03.581191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0480ecef-63f6-47a3-9203-4dad6fdd64b3 req-4484c18c-dab4-4f19-9a61-11df958a9f2e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:03.595745 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0480ecef-63f6-47a3-9203-4dad6fdd64b3 req-4484c18c-dab4-4f19-9a61-11df958a9f2e service nova] Creating event network-changed:beb078c6-63e8-4155-ae32-b926902a3cfe for instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd on n-h1-708768-8 Jul 26 20:29:03.603067 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0480ecef-63f6-47a3-9203-4dad6fdd64b3 req-4484c18c-dab4-4f19-9a61-11df958a9f2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048876 Jul 26 20:29:03.604464 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3279/6484] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:29:03.618573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a20ed833-d5a7-45c1-b3bf-5a4cc0cd0ab0 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:29:03.707854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a20ed833-d5a7-45c1-b3bf-5a4cc0cd0ab0 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 204 len: 0 microversion: 2.1 time: 0.156600 Jul 26 20:29:03.711983 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3206/6485] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:29:03 2022] DELETE /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:29:03.720412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6107936e-2723-4638-b503-def6028d3fb5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:03.721397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6107936e-2723-4638-b503-def6028d3fb5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:29:03.729167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6107936e-2723-4638-b503-def6028d3fb5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:03.730633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6107936e-2723-4638-b503-def6028d3fb5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:03.731500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6107936e-2723-4638-b503-def6028d3fb5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:03.731978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6107936e-2723-4638-b503-def6028d3fb5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:03.879780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6107936e-2723-4638-b503-def6028d3fb5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:29:03.889783 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6107936e-2723-4638-b503-def6028d3fb5 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1584 microversion: 2.1 time: 0.175532 Jul 26 20:29:03.899899 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3280/6486] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:29:03 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1584 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:29:04.932039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12f49ef2-7c06-43ed-8065-9610d02ed9d7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:04.933369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-12f49ef2-7c06-43ed-8065-9610d02ed9d7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:29:04.957784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12f49ef2-7c06-43ed-8065-9610d02ed9d7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:04.959698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12f49ef2-7c06-43ed-8065-9610d02ed9d7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:04.962236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12f49ef2-7c06-43ed-8065-9610d02ed9d7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:04.964692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12f49ef2-7c06-43ed-8065-9610d02ed9d7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:05.237476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-12f49ef2-7c06-43ed-8065-9610d02ed9d7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:29:05.248299 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-12f49ef2-7c06-43ed-8065-9610d02ed9d7 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1584 microversion: 2.1 time: 0.336991 Jul 26 20:29:05.252756 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3207/6487] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:29:04 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1584 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:29:05.711601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a3bfd5de-520c-4dfb-962b-d3f8f310d147 req-4a755237-2622-4a19-bdc3-2f302db9ef8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80570a3-0cd8-40cb-9d87-cc4ee66387fd", "name": "network-vif-deleted", "tag": "beb078c6-63e8-4155-ae32-b926902a3cfe"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:29:05.723376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a3bfd5de-520c-4dfb-962b-d3f8f310d147 req-4a755237-2622-4a19-bdc3-2f302db9ef8f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:05.724127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a3bfd5de-520c-4dfb-962b-d3f8f310d147 req-4a755237-2622-4a19-bdc3-2f302db9ef8f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:05.738125 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a3bfd5de-520c-4dfb-962b-d3f8f310d147 req-4a755237-2622-4a19-bdc3-2f302db9ef8f service nova] Creating event network-vif-deleted:beb078c6-63e8-4155-ae32-b926902a3cfe for instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd on n-h1-708768-8 Jul 26 20:29:05.743313 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a3bfd5de-520c-4dfb-962b-d3f8f310d147 req-4a755237-2622-4a19-bdc3-2f302db9ef8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042838 Jul 26 20:29:05.744030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3281/6488] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:29:06.270546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e6c414de-a8f8-4299-93c8-d41ea5096057 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:06.271153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e6c414de-a8f8-4299-93c8-d41ea5096057 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:29:06.278997 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6c414de-a8f8-4299-93c8-d41ea5096057 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:06.279459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6c414de-a8f8-4299-93c8-d41ea5096057 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:06.280378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6c414de-a8f8-4299-93c8-d41ea5096057 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:06.280827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e6c414de-a8f8-4299-93c8-d41ea5096057 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:06.350978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e6c414de-a8f8-4299-93c8-d41ea5096057 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:29:06.359835 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e6c414de-a8f8-4299-93c8-d41ea5096057 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1230 microversion: 2.1 time: 0.093358 Jul 26 20:29:06.367970 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3208/6489] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:29:06 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:29:07.382919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b4a94d18-3c72-4f66-aa44-87e4b500513a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:07.384349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b4a94d18-3c72-4f66-aa44-87e4b500513a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:29:07.393133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4a94d18-3c72-4f66-aa44-87e4b500513a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:07.393591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4a94d18-3c72-4f66-aa44-87e4b500513a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:07.395016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4a94d18-3c72-4f66-aa44-87e4b500513a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:07.395680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b4a94d18-3c72-4f66-aa44-87e4b500513a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:07.473161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b4a94d18-3c72-4f66-aa44-87e4b500513a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:29:07.482867 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b4a94d18-3c72-4f66-aa44-87e4b500513a tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1230 microversion: 2.1 time: 0.105477 Jul 26 20:29:07.483968 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3282/6490] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:29:07 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:29:08.504471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a2614547-5b53-49f4-b9d1-440394828ba6 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:08.505098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a2614547-5b53-49f4-b9d1-440394828ba6 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:29:08.526245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2614547-5b53-49f4-b9d1-440394828ba6 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:08.527938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2614547-5b53-49f4-b9d1-440394828ba6 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:08.529009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2614547-5b53-49f4-b9d1-440394828ba6 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:08.530471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a2614547-5b53-49f4-b9d1-440394828ba6 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:08.624072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a2614547-5b53-49f4-b9d1-440394828ba6 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:29:08.637926 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a2614547-5b53-49f4-b9d1-440394828ba6 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1230 microversion: 2.1 time: 0.137023 Jul 26 20:29:08.655675 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3209/6491] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:29:08 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1230 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:29:09.660404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e32b87dc-f0f3-4fee-b40a-fa1d813a60f8 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:09.661280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e32b87dc-f0f3-4fee-b40a-fa1d813a60f8 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:29:09.669356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e32b87dc-f0f3-4fee-b40a-fa1d813a60f8 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:09.670053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e32b87dc-f0f3-4fee-b40a-fa1d813a60f8 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:09.671006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e32b87dc-f0f3-4fee-b40a-fa1d813a60f8 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:09.671990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e32b87dc-f0f3-4fee-b40a-fa1d813a60f8 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:09.752520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e32b87dc-f0f3-4fee-b40a-fa1d813a60f8 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1f1fa48741471dac0bf3fae8f91293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf137fd628c74f2284c590101113b26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:29:09.764749 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e32b87dc-f0f3-4fee-b40a-fa1d813a60f8 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 200 len: 1230 microversion: 2.1 time: 0.106716 Jul 26 20:29:09.765983 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3283/6492] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:29:09 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:29:10.787198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:10.787885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] [instance: e80570a3-0cd8-40cb-9d87-cc4ee66387fd] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:29:10.796798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:10.797387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:10.798279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:29:10.799236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:29:10.815962 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] HTTP exception thrown: Instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd could not be found. Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Request method failure captured: Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd HTTP/1.1 Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E3E2WgSirpkyQUUD3wzreQ9TFZYwQLpqeCmjVRNCyf2N2xbQfKZYhzxYF8QgedS34tzDu8dX7QDRJnrrcKu_V_b0eaoP2aJczSnS6Sq5G8otdBncKXYnfdi_8bhZQLN2RBywDBTy1XkcBYHWLyDtpeGzoT-Q8WlnubC5S0VrH0bmEw Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: bf137fd628c74f2284c590101113b26b Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBackupRestore-587162233 Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bf137fd628c74f2284c590101113b26b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf137fd628c74f2284c590101113b26b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bf137fd628c74f2284c590101113b26b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bf137fd628c74f2284c590101113b26b"}]}] Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBackupRestore-587162233 Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: bf137fd628c74f2284c590101113b26b Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBackupRestore-587162233 Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBackupRestore-587162233-project Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: de1f1fa48741471dac0bf3fae8f91293 Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBackupRestore-587162233-project Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd could not be found. Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e80570a3-0cd8-40cb-9d87-cc4ee66387fd'} Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd could not be found. Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd could not be found. Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:29:10.820677 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd could not be found. Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Returning 404 to user: Instance e80570a3-0cd8-40cb-9d87-cc4ee66387fd could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-87c1f544-fbf9-4466-b0a0-b64cad1e7a7e tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd" status: 404 len: 111 microversion: 2.1 time: 0.039563 Jul 26 20:29:10.827678 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3210/6493] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:29:10 2022] GET /compute/v2.1/servers/e80570a3-0cd8-40cb-9d87-cc4ee66387fd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:29:11.003759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c0d0974e-ae67-4bc6-aa3a-002a68cdec38 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] Calling method '.version_select at 0x7f8756007af0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:29:11.049610 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c0d0974e-ae67-4bc6-aa3a-002a68cdec38 tempest-TestVolumeBackupRestore-587162233 tempest-TestVolumeBackupRestore-587162233-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1784377754" status: 202 len: 0 microversion: 2.1 time: 0.049545 Jul 26 20:29:11.050982 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3284/6494] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 20:29:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1784377754 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:29:40.016036 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:29:40.016764 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 20:29:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:30:29.702140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:30:29.703530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:30:29.704295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=22 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:30:29.705340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:30:29.708943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6fb9a7a4-74c5-45fd-ad70-0d76c3b3a6d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:29.709382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6fb9a7a4-74c5-45fd-ad70-0d76c3b3a6d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:29.710282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-6103cec5-290f-4e6b-bb05-037288548ae9 req-fddf8a93-214e-464f-8e5e-071dd2ef979b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09479a79-dee2-4c8a-bc27-1c3f1598dcac", "tag": "c42936f9-d2fa-4d35-ac0e-1dd19354c416"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:30:29.716907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6fb9a7a4-74c5-45fd-ad70-0d76c3b3a6d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:29.717455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6fb9a7a4-74c5-45fd-ad70-0d76c3b3a6d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:29.718298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6fb9a7a4-74c5-45fd-ad70-0d76c3b3a6d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:29.718838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6fb9a7a4-74c5-45fd-ad70-0d76c3b3a6d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:29.722025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6103cec5-290f-4e6b-bb05-037288548ae9 req-fddf8a93-214e-464f-8e5e-071dd2ef979b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:29.722549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-6103cec5-290f-4e6b-bb05-037288548ae9 req-fddf8a93-214e-464f-8e5e-071dd2ef979b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:29.733859 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-6103cec5-290f-4e6b-bb05-037288548ae9 req-fddf8a93-214e-464f-8e5e-071dd2ef979b service nova] Creating event network-changed:c42936f9-d2fa-4d35-ac0e-1dd19354c416 for instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac on n-h2-708768-8 Jul 26 20:30:29.739016 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-6103cec5-290f-4e6b-bb05-037288548ae9 req-fddf8a93-214e-464f-8e5e-071dd2ef979b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037128 Jul 26 20:30:29.739816 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3285/6495] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:30:29.754390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6fb9a7a4-74c5-45fd-ad70-0d76c3b3a6d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:30:29.848008 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6fb9a7a4-74c5-45fd-ad70-0d76c3b3a6d0 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 204 len: 0 microversion: 2.1 time: 0.148760 Jul 26 20:30:29.848685 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3211/6496] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:30:29 2022] DELETE /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:30:29.857623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f326611-9da6-48ea-ba06-a6b91dbebb16 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:29.858631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2f326611-9da6-48ea-ba06-a6b91dbebb16 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:29.865043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f326611-9da6-48ea-ba06-a6b91dbebb16 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:29.865621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f326611-9da6-48ea-ba06-a6b91dbebb16 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:29.866507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f326611-9da6-48ea-ba06-a6b91dbebb16 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:29.867023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2f326611-9da6-48ea-ba06-a6b91dbebb16 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:30.015068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2f326611-9da6-48ea-ba06-a6b91dbebb16 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:30.023398 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f326611-9da6-48ea-ba06-a6b91dbebb16 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1574 microversion: 2.1 time: 0.169965 Jul 26 20:30:30.024399 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3286/6497] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:29 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:30:31.046909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d9d2e1f-caae-4c0c-8efe-35d94cd82333 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:31.047653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8d9d2e1f-caae-4c0c-8efe-35d94cd82333 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:31.054827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d9d2e1f-caae-4c0c-8efe-35d94cd82333 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:31.055291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d9d2e1f-caae-4c0c-8efe-35d94cd82333 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:31.056109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d9d2e1f-caae-4c0c-8efe-35d94cd82333 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:31.056569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d9d2e1f-caae-4c0c-8efe-35d94cd82333 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:31.202543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8d9d2e1f-caae-4c0c-8efe-35d94cd82333 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:31.210293 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d9d2e1f-caae-4c0c-8efe-35d94cd82333 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1574 microversion: 2.1 time: 0.168428 Jul 26 20:30:31.210857 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3212/6498] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:31 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:32.233154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc64f873-fff8-4773-b79f-188bb8a70c76 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:32.235808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bc64f873-fff8-4773-b79f-188bb8a70c76 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:32.241033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc64f873-fff8-4773-b79f-188bb8a70c76 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:32.241486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc64f873-fff8-4773-b79f-188bb8a70c76 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:32.242263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc64f873-fff8-4773-b79f-188bb8a70c76 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:32.242707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc64f873-fff8-4773-b79f-188bb8a70c76 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:32.376308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc64f873-fff8-4773-b79f-188bb8a70c76 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:32.384099 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc64f873-fff8-4773-b79f-188bb8a70c76 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1455 microversion: 2.1 time: 0.155614 Jul 26 20:30:32.384684 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3287/6499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:32 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:32.486632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e1b31fd5-3290-4f2b-8bd9-4ec6f3471ddc req-6025c6d5-ea34-4f71-a0f5-541d1fc320ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09479a79-dee2-4c8a-bc27-1c3f1598dcac", "name": "network-vif-deleted", "tag": "c42936f9-d2fa-4d35-ac0e-1dd19354c416"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:30:32.499096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e1b31fd5-3290-4f2b-8bd9-4ec6f3471ddc req-6025c6d5-ea34-4f71-a0f5-541d1fc320ec service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:32.499860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e1b31fd5-3290-4f2b-8bd9-4ec6f3471ddc req-6025c6d5-ea34-4f71-a0f5-541d1fc320ec service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:32.511829 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e1b31fd5-3290-4f2b-8bd9-4ec6f3471ddc req-6025c6d5-ea34-4f71-a0f5-541d1fc320ec service nova] Creating event network-vif-deleted:c42936f9-d2fa-4d35-ac0e-1dd19354c416 for instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac on n-h2-708768-8 Jul 26 20:30:32.518007 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e1b31fd5-3290-4f2b-8bd9-4ec6f3471ddc req-6025c6d5-ea34-4f71-a0f5-541d1fc320ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035263 Jul 26 20:30:32.518909 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3213/6500] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:30:33.404498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e1c1cb23-c888-4973-a020-4bd85eb47c1c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:33.405118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e1c1cb23-c888-4973-a020-4bd85eb47c1c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:33.412228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1c1cb23-c888-4973-a020-4bd85eb47c1c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:33.412685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1c1cb23-c888-4973-a020-4bd85eb47c1c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:33.413461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1c1cb23-c888-4973-a020-4bd85eb47c1c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:33.413907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e1c1cb23-c888-4973-a020-4bd85eb47c1c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:33.483862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e1c1cb23-c888-4973-a020-4bd85eb47c1c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:33.491564 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e1c1cb23-c888-4973-a020-4bd85eb47c1c tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1223 microversion: 2.1 time: 0.091065 Jul 26 20:30:33.492194 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3288/6501] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:33 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:34.514909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4fc48bc3-346c-416a-9d15-f22430336fc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:34.515648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4fc48bc3-346c-416a-9d15-f22430336fc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:34.521959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4fc48bc3-346c-416a-9d15-f22430336fc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:34.522419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4fc48bc3-346c-416a-9d15-f22430336fc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:34.523202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4fc48bc3-346c-416a-9d15-f22430336fc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:34.523676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4fc48bc3-346c-416a-9d15-f22430336fc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:34.588077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4fc48bc3-346c-416a-9d15-f22430336fc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:34.595802 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4fc48bc3-346c-416a-9d15-f22430336fc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1223 microversion: 2.1 time: 0.086830 Jul 26 20:30:34.596457 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3214/6502] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:34 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:35.619425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d547bab6-27c6-415e-a8ec-8a18bf306e99 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:35.620079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d547bab6-27c6-415e-a8ec-8a18bf306e99 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:35.627588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d547bab6-27c6-415e-a8ec-8a18bf306e99 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:35.628072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d547bab6-27c6-415e-a8ec-8a18bf306e99 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:35.628856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d547bab6-27c6-415e-a8ec-8a18bf306e99 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:35.629293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d547bab6-27c6-415e-a8ec-8a18bf306e99 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:35.695250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d547bab6-27c6-415e-a8ec-8a18bf306e99 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:35.703804 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d547bab6-27c6-415e-a8ec-8a18bf306e99 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1223 microversion: 2.1 time: 0.088339 Jul 26 20:30:35.704385 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3289/6503] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:35 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:36.724970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:36.725589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:36.733307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:36.733760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:36.734601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:36.735047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:36.766435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:36.766817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:36.767274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lazy-loading 'fault' on Instance uuid 09479a79-dee2-4c8a-bc27-1c3f1598dcac {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:30:36.811873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:36.819317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-333f4156-c404-429c-8760-48511182dfb5 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 200 len: 1228 microversion: 2.1 time: 0.098190 Jul 26 20:30:36.820006 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3215/6504] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:36 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 1228 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:37.842762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:37.843402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 09479a79-dee2-4c8a-bc27-1c3f1598dcac] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:37.850337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:37.850793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:37.851569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:37.852036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:37.865928 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac could not be found. Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac HTTP/1.1 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac could not be found. Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '09479a79-dee2-4c8a-bc27-1c3f1598dcac'} Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac could not be found. Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac could not be found. Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:30:37.867561 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac could not be found. Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 09479a79-dee2-4c8a-bc27-1c3f1598dcac could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aa1580b6-4fcf-4846-a2a0-918b14995eb6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac" status: 404 len: 111 microversion: 2.1 time: 0.030843 Jul 26 20:30:37.873695 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3290/6505] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:37 2022] GET /compute/v2.1/servers/09479a79-dee2-4c8a-bc27-1c3f1598dcac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:30:44.134877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d496c313-4512-4809-86c2-9605860e3d20 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:44.135952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d496c313-4512-4809-86c2-9605860e3d20 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:44.137509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f497983e-5960-4374-b409-005c0f227df0 req-90b450a1-8a44-4f5a-ad0f-56cd7fcd20de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d07fdb-4a49-4d7c-b1c2-a2d79497efd8", "tag": "94182978-3419-4fa7-b6d8-db883a1bc03b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:30:44.143948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d496c313-4512-4809-86c2-9605860e3d20 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:44.144511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d496c313-4512-4809-86c2-9605860e3d20 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:44.145506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d496c313-4512-4809-86c2-9605860e3d20 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:44.146125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d496c313-4512-4809-86c2-9605860e3d20 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:44.148386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f497983e-5960-4374-b409-005c0f227df0 req-90b450a1-8a44-4f5a-ad0f-56cd7fcd20de service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:44.148824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f497983e-5960-4374-b409-005c0f227df0 req-90b450a1-8a44-4f5a-ad0f-56cd7fcd20de service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:44.161565 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f497983e-5960-4374-b409-005c0f227df0 req-90b450a1-8a44-4f5a-ad0f-56cd7fcd20de service nova] Creating event network-changed:94182978-3419-4fa7-b6d8-db883a1bc03b for instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 on n-h2-708768-8 Jul 26 20:30:44.167461 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f497983e-5960-4374-b409-005c0f227df0 req-90b450a1-8a44-4f5a-ad0f-56cd7fcd20de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033525 Jul 26 20:30:44.169006 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3291/6506] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:30:44.174205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d496c313-4512-4809-86c2-9605860e3d20 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:30:44.267186 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d496c313-4512-4809-86c2-9605860e3d20 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 204 len: 0 microversion: 2.1 time: 0.135836 Jul 26 20:30:44.267809 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3216/6507] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:30:44 2022] DELETE /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:30:44.276941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-720ccfb4-0037-4f05-b1bc-fb72db8d0492 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:44.277827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-720ccfb4-0037-4f05-b1bc-fb72db8d0492 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:44.284150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-720ccfb4-0037-4f05-b1bc-fb72db8d0492 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:44.284596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-720ccfb4-0037-4f05-b1bc-fb72db8d0492 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:44.285507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-720ccfb4-0037-4f05-b1bc-fb72db8d0492 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:44.285940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-720ccfb4-0037-4f05-b1bc-fb72db8d0492 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:44.432684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-720ccfb4-0037-4f05-b1bc-fb72db8d0492 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:44.440765 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-720ccfb4-0037-4f05-b1bc-fb72db8d0492 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1574 microversion: 2.1 time: 0.168477 Jul 26 20:30:44.441364 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3292/6508] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:44 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:30:45.462922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6c98e550-f174-45b0-9531-177085f1b454 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:45.463637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6c98e550-f174-45b0-9531-177085f1b454 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:45.470674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c98e550-f174-45b0-9531-177085f1b454 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:45.471121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c98e550-f174-45b0-9531-177085f1b454 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:45.471945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c98e550-f174-45b0-9531-177085f1b454 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:45.472375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6c98e550-f174-45b0-9531-177085f1b454 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:45.629473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6c98e550-f174-45b0-9531-177085f1b454 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:45.637042 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6c98e550-f174-45b0-9531-177085f1b454 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1574 microversion: 2.1 time: 0.178420 Jul 26 20:30:45.637618 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3217/6509] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:45 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:46.221337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c2e99da7-ebaf-4068-a85a-d08fbb2e0c86 req-b475cf34-22c9-4b51-9f32-34c597c7b7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d07fdb-4a49-4d7c-b1c2-a2d79497efd8", "name": "network-vif-deleted", "tag": "94182978-3419-4fa7-b6d8-db883a1bc03b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:30:46.232512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c2e99da7-ebaf-4068-a85a-d08fbb2e0c86 req-b475cf34-22c9-4b51-9f32-34c597c7b7e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:46.232957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c2e99da7-ebaf-4068-a85a-d08fbb2e0c86 req-b475cf34-22c9-4b51-9f32-34c597c7b7e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:46.244104 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c2e99da7-ebaf-4068-a85a-d08fbb2e0c86 req-b475cf34-22c9-4b51-9f32-34c597c7b7e2 service nova] Creating event network-vif-deleted:94182978-3419-4fa7-b6d8-db883a1bc03b for instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 on n-h2-708768-8 Jul 26 20:30:46.249830 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c2e99da7-ebaf-4068-a85a-d08fbb2e0c86 req-b475cf34-22c9-4b51-9f32-34c597c7b7e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032487 Jul 26 20:30:46.250420 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3293/6510] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:30:46.659011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a9bf4a0c-309b-4edf-83aa-02d9a34cfdc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:46.659648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a9bf4a0c-309b-4edf-83aa-02d9a34cfdc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:46.666631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9bf4a0c-309b-4edf-83aa-02d9a34cfdc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:46.667091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9bf4a0c-309b-4edf-83aa-02d9a34cfdc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:46.667905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9bf4a0c-309b-4edf-83aa-02d9a34cfdc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:46.669291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a9bf4a0c-309b-4edf-83aa-02d9a34cfdc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:46.738622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a9bf4a0c-309b-4edf-83aa-02d9a34cfdc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:46.746565 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a9bf4a0c-309b-4edf-83aa-02d9a34cfdc8 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1224 microversion: 2.1 time: 0.091388 Jul 26 20:30:46.747147 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3218/6511] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:46 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:30:47.769122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5a9939f-6afd-4399-89ba-834c364f0c29 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:47.769951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5a9939f-6afd-4399-89ba-834c364f0c29 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:47.776350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5a9939f-6afd-4399-89ba-834c364f0c29 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:47.776876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5a9939f-6afd-4399-89ba-834c364f0c29 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:47.777786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5a9939f-6afd-4399-89ba-834c364f0c29 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:47.778437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5a9939f-6afd-4399-89ba-834c364f0c29 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:47.841930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5a9939f-6afd-4399-89ba-834c364f0c29 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:47.849815 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5a9939f-6afd-4399-89ba-834c364f0c29 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1224 microversion: 2.1 time: 0.085896 Jul 26 20:30:47.850487 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3294/6512] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:47 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:48.871101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cda01807-1602-4f34-9591-5f9c4695c4ce tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:48.871896 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cda01807-1602-4f34-9591-5f9c4695c4ce tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:48.879549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cda01807-1602-4f34-9591-5f9c4695c4ce tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:48.880056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cda01807-1602-4f34-9591-5f9c4695c4ce tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:48.880907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cda01807-1602-4f34-9591-5f9c4695c4ce tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:48.881422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cda01807-1602-4f34-9591-5f9c4695c4ce tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:48.945614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cda01807-1602-4f34-9591-5f9c4695c4ce tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:48.953245 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cda01807-1602-4f34-9591-5f9c4695c4ce tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1224 microversion: 2.1 time: 0.086104 Jul 26 20:30:48.954057 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3219/6513] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:48 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:49.974616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a139644e-4618-422b-aa41-cebbe1f0b3f6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:49.975237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a139644e-4618-422b-aa41-cebbe1f0b3f6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:49.982878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a139644e-4618-422b-aa41-cebbe1f0b3f6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:49.983329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a139644e-4618-422b-aa41-cebbe1f0b3f6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:49.984121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a139644e-4618-422b-aa41-cebbe1f0b3f6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:49.984560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a139644e-4618-422b-aa41-cebbe1f0b3f6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:50.048473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a139644e-4618-422b-aa41-cebbe1f0b3f6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931f606954894f54aa910706b783a501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2b529683214d7f8d39b58407e1b415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:30:50.056742 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a139644e-4618-422b-aa41-cebbe1f0b3f6 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 200 len: 1224 microversion: 2.1 time: 0.086056 Jul 26 20:30:50.057317 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3295/6514] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:49 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:30:51.078469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:51.079125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:51.086151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:51.086609 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:51.087380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:51.087860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:51.101532 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 could not be found. Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 HTTP/1.1 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 could not be found. Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '20d07fdb-4a49-4d7c-b1c2-a2d79497efd8'} Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 could not be found. Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 could not be found. Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:30:51.103163 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 could not be found. Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance 20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8b0b7e4-6779-44bc-8780-048cfb64954f tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8" status: 404 len: 111 microversion: 2.1 time: 0.030210 Jul 26 20:30:51.109360 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3220/6515] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:51 2022] GET /compute/v2.1/servers/20d07fdb-4a49-4d7c-b1c2-a2d79497efd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:30:51.542691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:51.543196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:51.551035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:51.551420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:51.552208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:51.552645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:51.568540 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 HTTP/1.1 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0'} Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:30:51.570273 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8cdba643-ddcf-4eac-9b2a-ea63994c21fc tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 404 len: 111 microversion: 2.1 time: 0.033007 Jul 26 20:30:51.575884 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3296/6516] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:30:51 2022] DELETE /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:30:51.581060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:51.581680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] [instance: e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:30:51.587691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:51.588152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:51.588909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:30:51.589350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:30:51.603179 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] HTTP exception thrown: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Request method failure captured: Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 HTTP/1.1 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4EwFM9oHCaEqEMMj-Hxv68hG79VmMqfpMbyQdNaf-7zlEy0dAvs6eaF3uHIcO9L_HKcdv8xXQyhbLrXq70FQEr9RApIuttx9ucLBQbHG_j9wOGjsYcVIigOnIDj_RJFGDwcA3m2JcHfnpItZpv_QNSd68GJGoCQZvY1MsDpp6ZlbAtQ Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc2b529683214d7f8d39b58407e1b415", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc2b529683214d7f8d39b58407e1b415"}]}] Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: fc2b529683214d7f8d39b58407e1b415 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestVolumeBootPattern-346383 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestVolumeBootPattern-346383-project Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 931f606954894f54aa910706b783a501 Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestVolumeBootPattern-346383-project Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0'} Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:30:51.604701 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Returning 404 to user: Instance e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-34979558-18eb-4acc-992a-1919341feefd tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0" status: 404 len: 111 microversion: 2.1 time: 0.028982 Jul 26 20:30:51.611571 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3221/6517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:30:51 2022] GET /compute/v2.1/servers/e0ce3254-1cc4-4c5c-acaa-0aa7453b3ee0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:30:55.026444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-af1addd0-7fb2-4be4-abc0-92526f1bb326 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] Calling method '.version_select at 0x7f8755fb8ca0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:30:55.052874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-af1addd0-7fb2-4be4-abc0-92526f1bb326 tempest-TestVolumeBootPattern-346383 tempest-TestVolumeBootPattern-346383-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-82311540" status: 202 len: 0 microversion: 2.1 time: 0.031437 Jul 26 20:30:55.053775 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3297/6518] 10.222.0.58 () {58 vars in 1257 bytes} [Tue Jul 26 20:30:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-82311540 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:31:13.221181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:13.221919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:13.336625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-367205567", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:13.389592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] validate_networks() for None {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:31:13.577699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:31:13.578124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:31:13.578603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:31:13.579016 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:31:13.579433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:31:13.588365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:13.588822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:13.589623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:13.590110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:13.606569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Getting quotas for project 1e735895f92947328dba0f708ad8d8b1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:31:13.612023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Getting quotas for user 27971b7459214d45aedb46d39889cb12 and project 1e735895f92947328dba0f708ad8d8b1. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:31:13.624735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:31:13.626949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:31:13.670653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c750ce70-3af3-4c71-b848-999b62bef07e tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454683 Jul 26 20:31:13.671297 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3222/6519] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:31:13.681921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=52 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:13.682878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:13.686943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a1d18e71-6a10-47f1-b61d-46e7c2b0c04a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:13.947765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a1d18e71-6a10-47f1-b61d-46e7c2b0c04a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:14.001725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a1d18e71-6a10-47f1-b61d-46e7c2b0c04a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:14.008373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a1d18e71-6a10-47f1-b61d-46e7c2b0c04a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1221 microversion: 2.1 time: 0.328377 Jul 26 20:31:14.008935 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3298/6520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:13 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1221 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:15.030786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f5989a55-b668-4877-b62f-ac6947621fde tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:15.031397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f5989a55-b668-4877-b62f-ac6947621fde tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:15.084328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f5989a55-b668-4877-b62f-ac6947621fde tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:15.091064 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f5989a55-b668-4877-b62f-ac6947621fde tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1221 microversion: 2.1 time: 0.065253 Jul 26 20:31:15.091679 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3223/6521] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:15 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:16.111940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a33c15a6-e9ed-422e-968c-2bbb254dea6b tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:16.112547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a33c15a6-e9ed-422e-968c-2bbb254dea6b tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:16.165877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a33c15a6-e9ed-422e-968c-2bbb254dea6b tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:16.173291 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a33c15a6-e9ed-422e-968c-2bbb254dea6b tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1221 microversion: 2.1 time: 0.065185 Jul 26 20:31:16.173770 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3299/6522] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:16 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:17.194344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73014098-b110-4bd3-ba51-b56931101492 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:17.195144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73014098-b110-4bd3-ba51-b56931101492 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:17.253017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-73014098-b110-4bd3-ba51-b56931101492 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:17.259733 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73014098-b110-4bd3-ba51-b56931101492 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1221 microversion: 2.1 time: 0.069283 Jul 26 20:31:17.260294 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3224/6523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:17 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:18.282295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-65d3178a-6f41-4514-a3f1-5b9098d03d3a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:18.282879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-65d3178a-6f41-4514-a3f1-5b9098d03d3a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:18.289922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65d3178a-6f41-4514-a3f1-5b9098d03d3a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:18.290378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65d3178a-6f41-4514-a3f1-5b9098d03d3a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:18.291165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65d3178a-6f41-4514-a3f1-5b9098d03d3a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:18.291625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-65d3178a-6f41-4514-a3f1-5b9098d03d3a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:18.356844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-65d3178a-6f41-4514-a3f1-5b9098d03d3a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:18.364648 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-65d3178a-6f41-4514-a3f1-5b9098d03d3a tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1225 microversion: 2.1 time: 0.087576 Jul 26 20:31:18.365223 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3300/6524] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:18 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:19.386029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60f6308d-6310-4644-b1e7-f83d4e0f887f tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:19.386686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60f6308d-6310-4644-b1e7-f83d4e0f887f tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:19.394219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60f6308d-6310-4644-b1e7-f83d4e0f887f tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:19.394679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60f6308d-6310-4644-b1e7-f83d4e0f887f tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:19.395462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60f6308d-6310-4644-b1e7-f83d4e0f887f tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:19.395943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60f6308d-6310-4644-b1e7-f83d4e0f887f tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:19.459637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60f6308d-6310-4644-b1e7-f83d4e0f887f tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:19.468657 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60f6308d-6310-4644-b1e7-f83d4e0f887f tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1279 microversion: 2.1 time: 0.086656 Jul 26 20:31:19.469454 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3225/6525] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:19 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:20.490284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34397e55-e007-42e6-a2ab-75e215830c44 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:20.490897 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34397e55-e007-42e6-a2ab-75e215830c44 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:20.498903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34397e55-e007-42e6-a2ab-75e215830c44 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:20.499318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34397e55-e007-42e6-a2ab-75e215830c44 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:20.500129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34397e55-e007-42e6-a2ab-75e215830c44 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:20.501031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34397e55-e007-42e6-a2ab-75e215830c44 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:20.503021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4acb8ff3-7cfd-44b9-9177-3f9111eb6bd7 req-b2f92b63-341d-4061-9ec0-af1fe3be1686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34060537-1f6d-4d4e-8d0a-0710e7f23851", "tag": "f2915290-bb4e-46f8-b7a8-a470910be09d"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:20.520013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4acb8ff3-7cfd-44b9-9177-3f9111eb6bd7 req-b2f92b63-341d-4061-9ec0-af1fe3be1686 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:20.520926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4acb8ff3-7cfd-44b9-9177-3f9111eb6bd7 req-b2f92b63-341d-4061-9ec0-af1fe3be1686 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:20.547946 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-4acb8ff3-7cfd-44b9-9177-3f9111eb6bd7 req-b2f92b63-341d-4061-9ec0-af1fe3be1686 service nova] Creating event network-changed:f2915290-bb4e-46f8-b7a8-a470910be09d for instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 on n-h1-708768-8 Jul 26 20:31:20.553601 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4acb8ff3-7cfd-44b9-9177-3f9111eb6bd7 req-b2f92b63-341d-4061-9ec0-af1fe3be1686 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057855 Jul 26 20:31:20.554686 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3226/6526] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:31:20.775543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34397e55-e007-42e6-a2ab-75e215830c44 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:20.784085 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34397e55-e007-42e6-a2ab-75e215830c44 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1321 microversion: 2.1 time: 0.297599 Jul 26 20:31:20.784662 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3301/6527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:20 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:21.805779 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c9b2f00-347f-483e-b239-ff69fb517a3c tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:21.806485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c9b2f00-347f-483e-b239-ff69fb517a3c tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:21.812959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c9b2f00-347f-483e-b239-ff69fb517a3c tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:21.813412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c9b2f00-347f-483e-b239-ff69fb517a3c tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:21.814172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c9b2f00-347f-483e-b239-ff69fb517a3c tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:21.814617 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c9b2f00-347f-483e-b239-ff69fb517a3c tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:21.948041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c9b2f00-347f-483e-b239-ff69fb517a3c tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:21.955456 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c9b2f00-347f-483e-b239-ff69fb517a3c tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1321 microversion: 2.1 time: 0.154719 Jul 26 20:31:21.956067 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3227/6528] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:21 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:22.976792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56568abd-8ad0-4485-b11d-fee8c50a4aa7 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:22.977416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56568abd-8ad0-4485-b11d-fee8c50a4aa7 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:22.986297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56568abd-8ad0-4485-b11d-fee8c50a4aa7 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:22.986763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56568abd-8ad0-4485-b11d-fee8c50a4aa7 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:22.987547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56568abd-8ad0-4485-b11d-fee8c50a4aa7 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:22.988024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56568abd-8ad0-4485-b11d-fee8c50a4aa7 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:23.123884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56568abd-8ad0-4485-b11d-fee8c50a4aa7 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:23.131419 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56568abd-8ad0-4485-b11d-fee8c50a4aa7 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1321 microversion: 2.1 time: 0.158633 Jul 26 20:31:23.132073 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3302/6529] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:22 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:24.152475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9625fee6-f66c-46bb-a5cd-ba703789d790 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:24.153100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9625fee6-f66c-46bb-a5cd-ba703789d790 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:24.155891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:24.161371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9625fee6-f66c-46bb-a5cd-ba703789d790 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:24.161830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9625fee6-f66c-46bb-a5cd-ba703789d790 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:24.162626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9625fee6-f66c-46bb-a5cd-ba703789d790 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:24.163079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9625fee6-f66c-46bb-a5cd-ba703789d790 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:24.299557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9625fee6-f66c-46bb-a5cd-ba703789d790 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:24.307746 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9625fee6-f66c-46bb-a5cd-ba703789d790 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1321 microversion: 2.1 time: 0.159119 Jul 26 20:31:24.309435 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3228/6530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:24 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:25.160619 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2702952a-7899-49e2-a1c6-be785895b551 req-1469aee6-012c-4656-a970-ec5759c3d49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34060537-1f6d-4d4e-8d0a-0710e7f23851", "name": "network-vif-plugged", "status": "completed", "tag": "f2915290-bb4e-46f8-b7a8-a470910be09d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:25.171867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2702952a-7899-49e2-a1c6-be785895b551 req-1469aee6-012c-4656-a970-ec5759c3d49e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:25.173128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2702952a-7899-49e2-a1c6-be785895b551 req-1469aee6-012c-4656-a970-ec5759c3d49e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:25.185113 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2702952a-7899-49e2-a1c6-be785895b551 req-1469aee6-012c-4656-a970-ec5759c3d49e service nova] Creating event network-vif-plugged:f2915290-bb4e-46f8-b7a8-a470910be09d for instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 on n-h1-708768-8 Jul 26 20:31:25.190312 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2702952a-7899-49e2-a1c6-be785895b551 req-1469aee6-012c-4656-a970-ec5759c3d49e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033802 Jul 26 20:31:25.190912 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3303/6531] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:31:25.329615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f35a8da3-4ad0-4df8-90e6-b42799b06867 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:25.330233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f35a8da3-4ad0-4df8-90e6-b42799b06867 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:25.337079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f35a8da3-4ad0-4df8-90e6-b42799b06867 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:25.337534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f35a8da3-4ad0-4df8-90e6-b42799b06867 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:25.338302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f35a8da3-4ad0-4df8-90e6-b42799b06867 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:25.338774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f35a8da3-4ad0-4df8-90e6-b42799b06867 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:25.466387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f35a8da3-4ad0-4df8-90e6-b42799b06867 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:25.474710 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f35a8da3-4ad0-4df8-90e6-b42799b06867 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1321 microversion: 2.1 time: 0.149007 Jul 26 20:31:25.475271 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3229/6532] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:25 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:26.494523 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 20:31:26.499114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f951475f-8ef0-4528-80ba-a6037947e380 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:26.499835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f951475f-8ef0-4528-80ba-a6037947e380 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:26.501688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:26.507232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f951475f-8ef0-4528-80ba-a6037947e380 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:26.507704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f951475f-8ef0-4528-80ba-a6037947e380 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:26.508465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f951475f-8ef0-4528-80ba-a6037947e380 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:26.508899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f951475f-8ef0-4528-80ba-a6037947e380 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:26.643831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f951475f-8ef0-4528-80ba-a6037947e380 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:26.651552 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f951475f-8ef0-4528-80ba-a6037947e380 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1471 microversion: 2.1 time: 0.158696 Jul 26 20:31:26.652153 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3304/6533] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:26 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:26.725109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d2790d24-61a0-4539-ad27-e3f111cf5642 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Calling method '.version_select at 0x7f875c767820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:26.792736 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d2790d24-61a0-4539-ad27-e3f111cf5642 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c81bd55918ff4833bcfd03e6a3ae381b" status: 200 len: 371 microversion: 2.1 time: 0.121822 Jul 26 20:31:26.793633 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3230/6534] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 20:31:26 2022] GET /compute/v2.1/os-quota-sets/c81bd55918ff4833bcfd03e6a3ae381b => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:31:26.805138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b27f2e2-791e-4b02-9beb-4746c80391f5 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1643371307", "id": 1036904989, "os-flavor-access:is_public": "True"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:26.808788 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:31:26.808788 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:31:26.824007 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b27f2e2-791e-4b02-9beb-4746c80391f5 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022415 Jul 26 20:31:26.824670 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3305/6535] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:31:26 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:31:26.836382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1036904989"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:26.838696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:26.844878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:26.845341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:26.846114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:26.846563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:26.933421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3c174e244ba544b4ac4f0b480ac95a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81bd55918ff4833bcfd03e6a3ae381b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:26.939701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1643371307 {{(pid=125963) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:31:26.945991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:26.946451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:26.947258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:26.947732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:26.967653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Getting quotas for project 1e735895f92947328dba0f708ad8d8b1. Resources: {'cores', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:31:26.972680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Getting quotas for user 27971b7459214d45aedb46d39889cb12 and project 1e735895f92947328dba0f708ad8d8b1. Resources: {'cores', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:31:26.984945 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.api [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] ram quota exceeded for c81bd55918ff4833bcfd03e6a3ae381b, tried to resize instance. Jul 26 20:31:26.985490 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Request method failure captured: Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851/action HTTP/1.1 Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 39 Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E8RDc-zdpt7D4YSJiER33oI-Vd_QtxK1vvjGptCm4l4aNqNnrgrsljfXwqP5BUTDoYteK09h-3KmJHw1BDE2-8MkcSIVItMS3h-tq1Ihrz1mFHsGNF9trh2kGkw_zYu_JFLub6u7tXIVZuQq3smEjPT2zYiGzhGlfhcY-cOdHpRDow Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: c81bd55918ff4833bcfd03e6a3ae381b Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1617239239 Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,admin,reader Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,admin,reader Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c81bd55918ff4833bcfd03e6a3ae381b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c81bd55918ff4833bcfd03e6a3ae381b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c81bd55918ff4833bcfd03e6a3ae381b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c81bd55918ff4833bcfd03e6a3ae381b"}]}] Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1617239239 Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: c81bd55918ff4833bcfd03e6a3ae381b Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1617239239 Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersAdminNegativeTestJSON-1617239239-project-admin Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 3c174e244ba544b4ac4f0b480ac95a08 Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1617239239-project-admin Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: {"resize": {"flavorRef": "1036904989"}} Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '34060537-1f6d-4d4e-8d0a-0710e7f23851', 'body': {'resize': {'flavorRef': '1036904989'}}} Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:31:26.996643 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e3f7367f-1304-4f4d-8d3b-666889ae0860 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851/action" status: 403 len: 118 microversion: 2.1 time: 0.165602 Jul 26 20:31:27.002219 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3231/6536] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:31:26 2022] POST /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851/action => generated 118 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:31:27.006844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d017e513-a6f2-4e7d-845f-bb3f24b72dd5 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:27.007676 n-d-708768-8 devstack@n-api.service[125964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:31:27.007676 n-d-708768-8 devstack@n-api.service[125964]: warnings.warn(msg) Jul 26 20:31:27.025675 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d017e513-a6f2-4e7d-845f-bb3f24b72dd5 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1036904989" status: 202 len: 0 microversion: 2.1 time: 0.022423 Jul 26 20:31:27.026280 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3306/6537] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 20:31:27 2022] DELETE /compute/v2.1/flavors/1036904989 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:31:27.034909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2847198-a926-4cca-84e7-68b98c7ead22 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:27.055603 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b2847198-a926-4cca-84e7-68b98c7ead22 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024252 Jul 26 20:31:27.056194 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3232/6538] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 20:31:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:27.075551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06430a80-878e-4e2e-8ebc-f274731f938f tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Calling method '.version_select at 0x7f8756007700>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:27.151418 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06430a80-878e-4e2e-8ebc-f274731f938f tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/c81bd55918ff4833bcfd03e6a3ae381b" status: 200 len: 371 microversion: 2.1 time: 0.079579 Jul 26 20:31:27.152827 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3307/6539] 10.222.0.58 () {58 vars in 1242 bytes} [Tue Jul 26 20:31:27 2022] GET /compute/v2.1/os-quota-sets/c81bd55918ff4833bcfd03e6a3ae381b => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:31:27.163933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cce154f0-61b1-4ac1-9fb2-f2b420c80cb8 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-170659929", "id": 1217613066, "os-flavor-access:is_public": "True"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:27.166806 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:31:27.166806 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 20:31:27.183104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cce154f0-61b1-4ac1-9fb2-f2b420c80cb8 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022528 Jul 26 20:31:27.185003 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3233/6540] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:31:27 2022] POST /compute/v2.1/flavors => generated 436 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:31:27.196992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1217613066"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:27.199440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:27.205692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:27.206153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:27.206924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:27.207368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:27.344294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3c174e244ba544b4ac4f0b480ac95a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81bd55918ff4833bcfd03e6a3ae381b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:27.350917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-170659929 {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:31:27.358191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:27.358649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:27.359459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:27.359936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:27.383738 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Getting quotas for project 1e735895f92947328dba0f708ad8d8b1. Resources: {'cores', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:31:27.389378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Getting quotas for user 27971b7459214d45aedb46d39889cb12 and project 1e735895f92947328dba0f708ad8d8b1. Resources: {'cores', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:31:27.402866 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.compute.api [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] cores quota exceeded for c81bd55918ff4833bcfd03e6a3ae381b, tried to resize instance. Jul 26 20:31:27.403420 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Request method failure captured: Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851/action HTTP/1.1 Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 39 Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E8RDc-zdpt7D4YSJiER33oI-Vd_QtxK1vvjGptCm4l4aNqNnrgrsljfXwqP5BUTDoYteK09h-3KmJHw1BDE2-8MkcSIVItMS3h-tq1Ihrz1mFHsGNF9trh2kGkw_zYu_JFLub6u7tXIVZuQq3smEjPT2zYiGzhGlfhcY-cOdHpRDow Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: c81bd55918ff4833bcfd03e6a3ae381b Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1617239239 Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,admin,reader Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,admin,reader Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c81bd55918ff4833bcfd03e6a3ae381b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c81bd55918ff4833bcfd03e6a3ae381b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c81bd55918ff4833bcfd03e6a3ae381b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c81bd55918ff4833bcfd03e6a3ae381b"}]}] Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1617239239 Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: c81bd55918ff4833bcfd03e6a3ae381b Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1617239239 Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersAdminNegativeTestJSON-1617239239-project-admin Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 3c174e244ba544b4ac4f0b480ac95a08 Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1617239239-project-admin Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: {"resize": {"flavorRef": "1217613066"}} Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '34060537-1f6d-4d4e-8d0a-0710e7f23851', 'body': {'resize': {'flavorRef': '1217613066'}}} Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:31:27.405571 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f512b72-267d-4ce4-ad10-1bb8805eb00c tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851/action" status: 403 len: 113 microversion: 2.1 time: 0.214018 Jul 26 20:31:27.410287 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3308/6541] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:31:27 2022] POST /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851/action => generated 113 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:31:27.415728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-88c06846-17b6-42fc-b14f-aaf0fe83f893 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:27.416488 n-d-708768-8 devstack@n-api.service[125963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 20:31:27.416488 n-d-708768-8 devstack@n-api.service[125963]: warnings.warn(msg) Jul 26 20:31:27.434147 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-88c06846-17b6-42fc-b14f-aaf0fe83f893 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1217613066" status: 202 len: 0 microversion: 2.1 time: 0.022192 Jul 26 20:31:27.434702 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3234/6542] 10.222.0.58 () {58 vars in 1161 bytes} [Tue Jul 26 20:31:27 2022] DELETE /compute/v2.1/flavors/1217613066 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:31:27.442491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c4d84525-ed0b-43b1-9913-f1853b841dd4 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:27.463419 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c4d84525-ed0b-43b1-9913-f1853b841dd4 tempest-ServersAdminNegativeTestJSON-1617239239 tempest-ServersAdminNegativeTestJSON-1617239239-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024571 Jul 26 20:31:27.464542 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3309/6543] 10.222.0.58 () {58 vars in 1146 bytes} [Tue Jul 26 20:31:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:27.483993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-89febc40-d058-4a11-9770-ebecf8863fbb tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:27.484498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-89febc40-d058-4a11-9770-ebecf8863fbb tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:27.490619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89febc40-d058-4a11-9770-ebecf8863fbb tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:27.491081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89febc40-d058-4a11-9770-ebecf8863fbb tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:27.491873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89febc40-d058-4a11-9770-ebecf8863fbb tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:27.492324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89febc40-d058-4a11-9770-ebecf8863fbb tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:27.517184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-89febc40-d058-4a11-9770-ebecf8863fbb tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:31:27.590263 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-89febc40-d058-4a11-9770-ebecf8863fbb tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "DELETE /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 204 len: 0 microversion: 2.1 time: 0.110413 Jul 26 20:31:27.590765 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3235/6544] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:31:27 2022] DELETE /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:31:27.600463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7bf2e310-fdc2-4681-a924-78bfb3727391 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:27.601077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7bf2e310-fdc2-4681-a924-78bfb3727391 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:27.611487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7bf2e310-fdc2-4681-a924-78bfb3727391 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:27.611968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7bf2e310-fdc2-4681-a924-78bfb3727391 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:27.612755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7bf2e310-fdc2-4681-a924-78bfb3727391 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:27.613196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7bf2e310-fdc2-4681-a924-78bfb3727391 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:27.621995 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41964. Jul 26 20:31:27.750066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7bf2e310-fdc2-4681-a924-78bfb3727391 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:27.757718 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7bf2e310-fdc2-4681-a924-78bfb3727391 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1477 microversion: 2.1 time: 0.162509 Jul 26 20:31:27.758282 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3310/6545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:27 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:28.779347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a315c009-c13e-47ab-8ece-71c256edd3d8 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:28.780113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a315c009-c13e-47ab-8ece-71c256edd3d8 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:28.786750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a315c009-c13e-47ab-8ece-71c256edd3d8 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:28.787205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a315c009-c13e-47ab-8ece-71c256edd3d8 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:28.788001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a315c009-c13e-47ab-8ece-71c256edd3d8 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:28.788443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a315c009-c13e-47ab-8ece-71c256edd3d8 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:28.923847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a315c009-c13e-47ab-8ece-71c256edd3d8 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27971b7459214d45aedb46d39889cb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e735895f92947328dba0f708ad8d8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:28.931727 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a315c009-c13e-47ab-8ece-71c256edd3d8 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 200 len: 1477 microversion: 2.1 time: 0.157144 Jul 26 20:31:28.932328 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3236/6546] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:28 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:29.325721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bd8a6dae-08f5-4bb9-af9b-92c259fd844f req-e8b88142-76c7-4866-9ec6-556bbbb674e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34060537-1f6d-4d4e-8d0a-0710e7f23851", "name": "network-vif-deleted", "tag": "f2915290-bb4e-46f8-b7a8-a470910be09d"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:29.340725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bd8a6dae-08f5-4bb9-af9b-92c259fd844f req-e8b88142-76c7-4866-9ec6-556bbbb674e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:29.341448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bd8a6dae-08f5-4bb9-af9b-92c259fd844f req-e8b88142-76c7-4866-9ec6-556bbbb674e2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:29.356882 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bd8a6dae-08f5-4bb9-af9b-92c259fd844f req-e8b88142-76c7-4866-9ec6-556bbbb674e2 service nova] Creating event network-vif-deleted:f2915290-bb4e-46f8-b7a8-a470910be09d for instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 on n-h1-708768-8 Jul 26 20:31:29.364558 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bd8a6dae-08f5-4bb9-af9b-92c259fd844f req-e8b88142-76c7-4866-9ec6-556bbbb674e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043249 Jul 26 20:31:29.365199 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3311/6547] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:31:29.954036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:29.954850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] [instance: 34060537-1f6d-4d4e-8d0a-0710e7f23851] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:29.957674 n-d-708768-8 devstack@n-api.service[125963]: ERROR oslo.messaging._drivers.impl_rabbit [-] [126f5d12-0094-4580-8dac-f2bd48a90f54] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 20:31:29.963157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:29.963633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:29.965019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:29.965476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:29.979386 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] HTTP exception thrown: Instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 could not be found. Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Request method failure captured: Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 HTTP/1.1 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E8QbOliH2CJYLnjwJB6rHa1aQhUbKjOB-ZiNDV1-u0TAB2K0c5rYAwyBCFG-aq51DkbD8N_fY5FKpfMpoibts57Tm3wcAsz3PvRj-0PXsOlRHWhbm5wCuhyDXITi9Gf26CV_JAs3N1hXCfrz7w4iKkzR8mwmKteVD_envHEE7ARHGY Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 1e735895f92947328dba0f708ad8d8b1 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1384471914 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1e735895f92947328dba0f708ad8d8b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1e735895f92947328dba0f708ad8d8b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1e735895f92947328dba0f708ad8d8b1", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1e735895f92947328dba0f708ad8d8b1"}]}] Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1384471914 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 1e735895f92947328dba0f708ad8d8b1 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1384471914 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersAdminNegativeTestJSON-1384471914-project Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 27971b7459214d45aedb46d39889cb12 Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1384471914-project Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 could not be found. Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '34060537-1f6d-4d4e-8d0a-0710e7f23851'} Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 could not be found. Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 could not be found. Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:29.981236 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 could not be found. Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] Returning 404 to user: Instance 34060537-1f6d-4d4e-8d0a-0710e7f23851 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8109080b-4235-4b4e-823b-9f495b190924 tempest-ServersAdminNegativeTestJSON-1384471914 tempest-ServersAdminNegativeTestJSON-1384471914-project] 10.222.0.58 "GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851" status: 404 len: 111 microversion: 2.1 time: 0.032934 Jul 26 20:31:29.986657 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3237/6548] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:29 2022] GET /compute/v2.1/servers/34060537-1f6d-4d4e-8d0a-0710e7f23851 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:31:36.651993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-390839684", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "fa586d65-ee11-461c-a498-ad8a09deb07b"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:36.718452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] validate_networks() for [('fa586d65-ee11-461c-a498-ad8a09deb07b', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:31:37.140962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:31:37.141388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:31:37.141863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:31:37.142277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:31:37.142687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:31:37.144858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:37.154056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:37.154387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:37.155224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:37.155687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:37.176938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Getting quotas for project a5536b79e5374aaf903aaff942e3a10f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:31:37.183288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Getting quotas for user 50c994a571a24f70b73c7b950bd292f4 and project a5536b79e5374aaf903aaff942e3a10f. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:31:37.196342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:31:37.198943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:31:37.250456 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4c2cfaa9-1246-4206-80ad-e5a6074f92a7 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745256 Jul 26 20:31:37.251440 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3312/6549] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:31:37.262031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3073a7de-5525-41a3-b59e-cfd4d151b044 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:37.262660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3073a7de-5525-41a3-b59e-cfd4d151b044 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:37.268897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:37.270056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:37.280672 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] [126f5d12-0094-4580-8dac-f2bd48a90f54] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42046. Jul 26 20:31:37.347919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3073a7de-5525-41a3-b59e-cfd4d151b044 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:37.355554 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3073a7de-5525-41a3-b59e-cfd4d151b044 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1214 microversion: 2.1 time: 0.097337 Jul 26 20:31:37.356345 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3238/6550] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:37 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:38.379945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-60b37822-8e0b-46c8-936f-fd43660be7f6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:38.381235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-60b37822-8e0b-46c8-936f-fd43660be7f6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:38.389054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60b37822-8e0b-46c8-936f-fd43660be7f6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:38.389832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60b37822-8e0b-46c8-936f-fd43660be7f6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:38.390868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60b37822-8e0b-46c8-936f-fd43660be7f6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:38.391570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-60b37822-8e0b-46c8-936f-fd43660be7f6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:38.485351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-60b37822-8e0b-46c8-936f-fd43660be7f6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:38.493327 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-60b37822-8e0b-46c8-936f-fd43660be7f6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1284 microversion: 2.1 time: 0.119823 Jul 26 20:31:38.493910 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3313/6551] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:38 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:39.514964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fd3cb2a9-b788-4e14-bbee-e8794832bcc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:39.515652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd3cb2a9-b788-4e14-bbee-e8794832bcc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:39.524169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd3cb2a9-b788-4e14-bbee-e8794832bcc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:39.524634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd3cb2a9-b788-4e14-bbee-e8794832bcc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:39.525434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd3cb2a9-b788-4e14-bbee-e8794832bcc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:39.527521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd3cb2a9-b788-4e14-bbee-e8794832bcc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:39.993381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fd3cb2a9-b788-4e14-bbee-e8794832bcc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:39.994196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-efa1d27b-7d1d-4028-9a79-a72ac57f9b66 req-4fdee1b6-64d3-40b4-8da2-11a3e1033c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e433dd77-47b4-447b-837a-0dd2cbb7c03f", "tag": "37e57a96-5116-4e1a-aa5c-f8b2416a1e48"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:40.003257 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fd3cb2a9-b788-4e14-bbee-e8794832bcc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1314 microversion: 2.1 time: 0.492715 Jul 26 20:31:40.013490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-efa1d27b-7d1d-4028-9a79-a72ac57f9b66 req-4fdee1b6-64d3-40b4-8da2-11a3e1033c21 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:40.016131 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3239/6552] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:39 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:40.016529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-efa1d27b-7d1d-4028-9a79-a72ac57f9b66 req-4fdee1b6-64d3-40b4-8da2-11a3e1033c21 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:40.039322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-efa1d27b-7d1d-4028-9a79-a72ac57f9b66 req-4fdee1b6-64d3-40b4-8da2-11a3e1033c21 service nova] Creating event network-changed:37e57a96-5116-4e1a-aa5c-f8b2416a1e48 for instance e433dd77-47b4-447b-837a-0dd2cbb7c03f on n-h1-708768-8 Jul 26 20:31:40.045745 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-efa1d27b-7d1d-4028-9a79-a72ac57f9b66 req-4fdee1b6-64d3-40b4-8da2-11a3e1033c21 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055249 Jul 26 20:31:40.046938 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3314/6553] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:31:41.025711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0ab42d1-bcdf-4e4f-b156-d2d408129483 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:41.027120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0ab42d1-bcdf-4e4f-b156-d2d408129483 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:41.034230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0ab42d1-bcdf-4e4f-b156-d2d408129483 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:41.034692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0ab42d1-bcdf-4e4f-b156-d2d408129483 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:41.035477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0ab42d1-bcdf-4e4f-b156-d2d408129483 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:41.035951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0ab42d1-bcdf-4e4f-b156-d2d408129483 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:41.163472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e0ab42d1-bcdf-4e4f-b156-d2d408129483 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:41.171104 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0ab42d1-bcdf-4e4f-b156-d2d408129483 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1314 microversion: 2.1 time: 0.149302 Jul 26 20:31:41.171695 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3240/6554] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:41 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:42.193908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-09237900-10ca-4d84-be2f-09e3976bbb16 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:42.194618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-09237900-10ca-4d84-be2f-09e3976bbb16 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:42.201060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09237900-10ca-4d84-be2f-09e3976bbb16 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:42.201512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09237900-10ca-4d84-be2f-09e3976bbb16 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:42.202278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09237900-10ca-4d84-be2f-09e3976bbb16 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:42.202714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09237900-10ca-4d84-be2f-09e3976bbb16 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:42.336496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-09237900-10ca-4d84-be2f-09e3976bbb16 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:42.344015 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-09237900-10ca-4d84-be2f-09e3976bbb16 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1314 microversion: 2.1 time: 0.155214 Jul 26 20:31:42.344597 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3315/6555] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:42 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:43.365018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-831c25da-013f-4387-bdba-e4f3bfbd4557 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:43.365670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-831c25da-013f-4387-bdba-e4f3bfbd4557 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:43.368544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:43.373978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-831c25da-013f-4387-bdba-e4f3bfbd4557 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:43.374433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-831c25da-013f-4387-bdba-e4f3bfbd4557 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:43.375205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-831c25da-013f-4387-bdba-e4f3bfbd4557 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:43.375678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-831c25da-013f-4387-bdba-e4f3bfbd4557 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:43.379232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:43.798573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-831c25da-013f-4387-bdba-e4f3bfbd4557 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:43.806335 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-831c25da-013f-4387-bdba-e4f3bfbd4557 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1314 microversion: 2.1 time: 0.445223 Jul 26 20:31:43.806920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3241/6556] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:43 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:44.826807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f82286a-acc8-4da4-9368-ce56c22f7db4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:44.827419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f82286a-acc8-4da4-9368-ce56c22f7db4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:44.830260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:44.835782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f82286a-acc8-4da4-9368-ce56c22f7db4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:44.836239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f82286a-acc8-4da4-9368-ce56c22f7db4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:44.837020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f82286a-acc8-4da4-9368-ce56c22f7db4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:44.837466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f82286a-acc8-4da4-9368-ce56c22f7db4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:44.842779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=64 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:44.966497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1f82286a-acc8-4da4-9368-ce56c22f7db4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:44.974321 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f82286a-acc8-4da4-9368-ce56c22f7db4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1314 microversion: 2.1 time: 0.151548 Jul 26 20:31:44.974896 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3316/6557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:44 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:45.398755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a3c165a9-9b8d-4c88-9422-0ebaf86d1af1 req-8c3af479-f22d-44e5-92fb-0bece1d40480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e433dd77-47b4-447b-837a-0dd2cbb7c03f", "name": "network-vif-plugged", "status": "completed", "tag": "37e57a96-5116-4e1a-aa5c-f8b2416a1e48"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:45.413639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a3c165a9-9b8d-4c88-9422-0ebaf86d1af1 req-8c3af479-f22d-44e5-92fb-0bece1d40480 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:45.414095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a3c165a9-9b8d-4c88-9422-0ebaf86d1af1 req-8c3af479-f22d-44e5-92fb-0bece1d40480 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:45.429342 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a3c165a9-9b8d-4c88-9422-0ebaf86d1af1 req-8c3af479-f22d-44e5-92fb-0bece1d40480 service nova] Creating event network-vif-plugged:37e57a96-5116-4e1a-aa5c-f8b2416a1e48 for instance e433dd77-47b4-447b-837a-0dd2cbb7c03f on n-h1-708768-8 Jul 26 20:31:45.435035 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a3c165a9-9b8d-4c88-9422-0ebaf86d1af1 req-8c3af479-f22d-44e5-92fb-0bece1d40480 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125431 Jul 26 20:31:45.435656 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3242/6558] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:31:45.996909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f01371d-ba6d-4bf0-9dfc-4d7d36fb1601 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:45.997487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f01371d-ba6d-4bf0-9dfc-4d7d36fb1601 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:46.004389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f01371d-ba6d-4bf0-9dfc-4d7d36fb1601 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:46.004843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f01371d-ba6d-4bf0-9dfc-4d7d36fb1601 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:46.005614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f01371d-ba6d-4bf0-9dfc-4d7d36fb1601 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:46.006057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f01371d-ba6d-4bf0-9dfc-4d7d36fb1601 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:46.135967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f01371d-ba6d-4bf0-9dfc-4d7d36fb1601 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:46.143494 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f01371d-ba6d-4bf0-9dfc-4d7d36fb1601 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1314 microversion: 2.1 time: 0.151466 Jul 26 20:31:46.144095 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3317/6559] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:45 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:31:47.166210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-051f7499-dfc6-439f-b94a-39f6aa74adc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:47.167082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-051f7499-dfc6-439f-b94a-39f6aa74adc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:47.173346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-051f7499-dfc6-439f-b94a-39f6aa74adc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:47.173808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-051f7499-dfc6-439f-b94a-39f6aa74adc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:47.174850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-051f7499-dfc6-439f-b94a-39f6aa74adc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:47.175300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-051f7499-dfc6-439f-b94a-39f6aa74adc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:47.305789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-051f7499-dfc6-439f-b94a-39f6aa74adc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:47.313792 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-051f7499-dfc6-439f-b94a-39f6aa74adc2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1501 microversion: 2.1 time: 0.152761 Jul 26 20:31:47.314348 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3243/6560] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:47 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:47.334804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:31:47.337240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:47.339920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=5 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:47.340716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:47.348198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:47.348653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:47.349430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:47.349873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:47.379497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:47.386609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Old instance type m1.heat2, new instance type m1.heat {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:31:47.393180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:31:47.393609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:31:47.394092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:31:47.394505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:31:47.394919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:31:47.457073 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-767252fe-1b6a-487c-a79b-07d7b23f541c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "POST /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f/action" status: 202 len: 0 microversion: 2.1 time: 0.126196 Jul 26 20:31:47.457875 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3318/6561] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:31:47 2022] POST /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:31:47.466870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-69be9ee5-3c15-4f04-9a94-091ba9632fb6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:47.467494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-69be9ee5-3c15-4f04-9a94-091ba9632fb6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:47.469473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:31:47.475193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69be9ee5-3c15-4f04-9a94-091ba9632fb6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:47.475678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69be9ee5-3c15-4f04-9a94-091ba9632fb6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:47.476473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69be9ee5-3c15-4f04-9a94-091ba9632fb6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:47.477031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69be9ee5-3c15-4f04-9a94-091ba9632fb6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:47.647445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-69be9ee5-3c15-4f04-9a94-091ba9632fb6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:47.655483 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-69be9ee5-3c15-4f04-9a94-091ba9632fb6 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1510 microversion: 2.1 time: 0.193039 Jul 26 20:31:47.665190 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3244/6562] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:47 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:48.678106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5ea6322-ca4d-4fa6-9618-771cf755b4cd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:48.678858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5ea6322-ca4d-4fa6-9618-771cf755b4cd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:48.689610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5ea6322-ca4d-4fa6-9618-771cf755b4cd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:48.690069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5ea6322-ca4d-4fa6-9618-771cf755b4cd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:48.690852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5ea6322-ca4d-4fa6-9618-771cf755b4cd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:48.691302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5ea6322-ca4d-4fa6-9618-771cf755b4cd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:48.820211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5ea6322-ca4d-4fa6-9618-771cf755b4cd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:48.829031 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5ea6322-ca4d-4fa6-9618-771cf755b4cd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1510 microversion: 2.1 time: 0.156051 Jul 26 20:31:48.829627 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3319/6563] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:48 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:49.850218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cab801c4-8083-4b86-8bea-8e6a4e337716 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:49.850841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cab801c4-8083-4b86-8bea-8e6a4e337716 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:49.858639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cab801c4-8083-4b86-8bea-8e6a4e337716 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:49.859102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cab801c4-8083-4b86-8bea-8e6a4e337716 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:49.859898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cab801c4-8083-4b86-8bea-8e6a4e337716 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:49.860392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cab801c4-8083-4b86-8bea-8e6a4e337716 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:49.991295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cab801c4-8083-4b86-8bea-8e6a4e337716 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:49.998934 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cab801c4-8083-4b86-8bea-8e6a4e337716 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.152649 Jul 26 20:31:49.999500 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3245/6564] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:49 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:51.019755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-956b55da-c324-431f-952e-d12b0786b349 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:51.020377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-956b55da-c324-431f-952e-d12b0786b349 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:51.028042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-956b55da-c324-431f-952e-d12b0786b349 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:51.028500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-956b55da-c324-431f-952e-d12b0786b349 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:51.029289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-956b55da-c324-431f-952e-d12b0786b349 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:51.029730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-956b55da-c324-431f-952e-d12b0786b349 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:51.162618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-956b55da-c324-431f-952e-d12b0786b349 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:51.170887 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-956b55da-c324-431f-952e-d12b0786b349 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.155149 Jul 26 20:31:51.171470 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3320/6565] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:51 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:52.192621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-359e3aaa-445b-4cdd-ac44-40600d035926 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:52.193296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-359e3aaa-445b-4cdd-ac44-40600d035926 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:52.201453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-359e3aaa-445b-4cdd-ac44-40600d035926 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:52.201980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-359e3aaa-445b-4cdd-ac44-40600d035926 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:52.202848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-359e3aaa-445b-4cdd-ac44-40600d035926 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:52.203314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-359e3aaa-445b-4cdd-ac44-40600d035926 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:52.333809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-359e3aaa-445b-4cdd-ac44-40600d035926 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:52.342218 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-359e3aaa-445b-4cdd-ac44-40600d035926 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.154086 Jul 26 20:31:52.342784 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3246/6566] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:52 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:53.363523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5d75e43-2d5b-4b6a-baba-25d39c628a82 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:53.364094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5d75e43-2d5b-4b6a-baba-25d39c628a82 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:53.371295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5d75e43-2d5b-4b6a-baba-25d39c628a82 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:53.371783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5d75e43-2d5b-4b6a-baba-25d39c628a82 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:53.372559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5d75e43-2d5b-4b6a-baba-25d39c628a82 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:53.373033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5d75e43-2d5b-4b6a-baba-25d39c628a82 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:53.500057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5d75e43-2d5b-4b6a-baba-25d39c628a82 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:53.507581 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5d75e43-2d5b-4b6a-baba-25d39c628a82 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.148045 Jul 26 20:31:53.508195 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3321/6567] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:53 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:54.528321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4c70d9bc-728d-49ad-b62e-1c2d1aee5400 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:54.528951 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4c70d9bc-728d-49ad-b62e-1c2d1aee5400 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:54.535902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c70d9bc-728d-49ad-b62e-1c2d1aee5400 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:54.536362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c70d9bc-728d-49ad-b62e-1c2d1aee5400 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:54.537147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c70d9bc-728d-49ad-b62e-1c2d1aee5400 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:54.537596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4c70d9bc-728d-49ad-b62e-1c2d1aee5400 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:54.668678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4c70d9bc-728d-49ad-b62e-1c2d1aee5400 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:54.676667 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4c70d9bc-728d-49ad-b62e-1c2d1aee5400 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.152577 Jul 26 20:31:54.677167 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3247/6568] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:54 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:55.698449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47b6b279-81d8-432e-84e0-27daa79d2ef4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:55.699122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47b6b279-81d8-432e-84e0-27daa79d2ef4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:55.705815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47b6b279-81d8-432e-84e0-27daa79d2ef4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:55.706266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47b6b279-81d8-432e-84e0-27daa79d2ef4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:55.707025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47b6b279-81d8-432e-84e0-27daa79d2ef4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:55.707462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47b6b279-81d8-432e-84e0-27daa79d2ef4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:55.838222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47b6b279-81d8-432e-84e0-27daa79d2ef4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:55.846281 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47b6b279-81d8-432e-84e0-27daa79d2ef4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.151817 Jul 26 20:31:55.846852 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3322/6569] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:55 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:56.868529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bab86a0f-ee35-48e2-8d26-fc037e0db14f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:56.869186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bab86a0f-ee35-48e2-8d26-fc037e0db14f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:56.876833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bab86a0f-ee35-48e2-8d26-fc037e0db14f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:56.877302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bab86a0f-ee35-48e2-8d26-fc037e0db14f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:56.878077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bab86a0f-ee35-48e2-8d26-fc037e0db14f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:56.878533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bab86a0f-ee35-48e2-8d26-fc037e0db14f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:57.010883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bab86a0f-ee35-48e2-8d26-fc037e0db14f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:57.018446 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bab86a0f-ee35-48e2-8d26-fc037e0db14f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.153876 Jul 26 20:31:57.019039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3248/6570] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:56 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:31:58.040068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-63dc8605-d40e-4c55-a10c-402e77d7e3b1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:58.040687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-63dc8605-d40e-4c55-a10c-402e77d7e3b1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:58.047896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63dc8605-d40e-4c55-a10c-402e77d7e3b1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:58.048347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63dc8605-d40e-4c55-a10c-402e77d7e3b1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:58.049361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63dc8605-d40e-4c55-a10c-402e77d7e3b1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:58.049798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-63dc8605-d40e-4c55-a10c-402e77d7e3b1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:58.178155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-63dc8605-d40e-4c55-a10c-402e77d7e3b1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:58.185874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-63dc8605-d40e-4c55-a10c-402e77d7e3b1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.149721 Jul 26 20:31:58.186459 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3323/6571] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:58 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:31:59.207452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-55d25430-fd97-49f6-8446-906285a64a8a tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:31:59.208100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-55d25430-fd97-49f6-8446-906285a64a8a tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:31:59.215421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d25430-fd97-49f6-8446-906285a64a8a tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:59.215794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d25430-fd97-49f6-8446-906285a64a8a tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:59.216573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d25430-fd97-49f6-8446-906285a64a8a tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:31:59.217049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-55d25430-fd97-49f6-8446-906285a64a8a tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:31:59.346781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-55d25430-fd97-49f6-8446-906285a64a8a tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:31:59.354275 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-55d25430-fd97-49f6-8446-906285a64a8a tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.150867 Jul 26 20:31:59.354910 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3249/6572] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:31:59 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:00.376714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08bcb54f-9351-4126-8249-2e807c13457c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:00.377314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-08bcb54f-9351-4126-8249-2e807c13457c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:00.384182 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08bcb54f-9351-4126-8249-2e807c13457c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:00.384636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08bcb54f-9351-4126-8249-2e807c13457c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:00.385401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08bcb54f-9351-4126-8249-2e807c13457c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:00.385846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08bcb54f-9351-4126-8249-2e807c13457c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:00.524725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-08bcb54f-9351-4126-8249-2e807c13457c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:00.532370 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-08bcb54f-9351-4126-8249-2e807c13457c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.159686 Jul 26 20:32:00.532944 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3324/6573] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:00 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:01.553490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-083a2d84-ff65-43b8-a876-5099a1e3ecaa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:01.554108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-083a2d84-ff65-43b8-a876-5099a1e3ecaa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:01.561902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-083a2d84-ff65-43b8-a876-5099a1e3ecaa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:01.562358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-083a2d84-ff65-43b8-a876-5099a1e3ecaa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:01.563129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-083a2d84-ff65-43b8-a876-5099a1e3ecaa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:01.563575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-083a2d84-ff65-43b8-a876-5099a1e3ecaa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:01.696069 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-083a2d84-ff65-43b8-a876-5099a1e3ecaa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:01.704159 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-083a2d84-ff65-43b8-a876-5099a1e3ecaa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.154902 Jul 26 20:32:01.704720 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3250/6574] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:01 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:02.725381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4f503ae9-aaac-4c3c-8cb2-dbdca9e74973 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:02.726009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4f503ae9-aaac-4c3c-8cb2-dbdca9e74973 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:02.733308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f503ae9-aaac-4c3c-8cb2-dbdca9e74973 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:02.733765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f503ae9-aaac-4c3c-8cb2-dbdca9e74973 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:02.734533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f503ae9-aaac-4c3c-8cb2-dbdca9e74973 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:02.734976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4f503ae9-aaac-4c3c-8cb2-dbdca9e74973 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:02.872179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4f503ae9-aaac-4c3c-8cb2-dbdca9e74973 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:02.879891 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4f503ae9-aaac-4c3c-8cb2-dbdca9e74973 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.158645 Jul 26 20:32:02.880528 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3325/6575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:02 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:03.900632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4f4b6f46-56f2-4636-80ca-3ffb9b3b4dde tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:03.901323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4f4b6f46-56f2-4636-80ca-3ffb9b3b4dde tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:03.909641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f4b6f46-56f2-4636-80ca-3ffb9b3b4dde tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:03.910107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f4b6f46-56f2-4636-80ca-3ffb9b3b4dde tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:03.910900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f4b6f46-56f2-4636-80ca-3ffb9b3b4dde tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:03.911350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4f4b6f46-56f2-4636-80ca-3ffb9b3b4dde tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:04.041166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4f4b6f46-56f2-4636-80ca-3ffb9b3b4dde tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:04.049552 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4f4b6f46-56f2-4636-80ca-3ffb9b3b4dde tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.152591 Jul 26 20:32:04.050126 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3251/6576] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:03 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:05.069931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-22df3ae2-9416-4eeb-ae9d-4c57b8214c1f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:05.070554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-22df3ae2-9416-4eeb-ae9d-4c57b8214c1f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:05.078472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22df3ae2-9416-4eeb-ae9d-4c57b8214c1f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:05.078929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22df3ae2-9416-4eeb-ae9d-4c57b8214c1f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:05.079732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22df3ae2-9416-4eeb-ae9d-4c57b8214c1f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:05.080177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-22df3ae2-9416-4eeb-ae9d-4c57b8214c1f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:05.209972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-22df3ae2-9416-4eeb-ae9d-4c57b8214c1f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:05.217795 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-22df3ae2-9416-4eeb-ae9d-4c57b8214c1f tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.151776 Jul 26 20:32:05.218371 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3326/6577] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:05 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:05.861185 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:32:05.861782 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:32:06.238683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa732487-e137-4f9c-bb7d-5ea4b5df5b8c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:06.239315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fa732487-e137-4f9c-bb7d-5ea4b5df5b8c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:06.247224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa732487-e137-4f9c-bb7d-5ea4b5df5b8c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:06.247721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa732487-e137-4f9c-bb7d-5ea4b5df5b8c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:06.248858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa732487-e137-4f9c-bb7d-5ea4b5df5b8c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:06.249384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa732487-e137-4f9c-bb7d-5ea4b5df5b8c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:06.383162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fa732487-e137-4f9c-bb7d-5ea4b5df5b8c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:06.391256 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa732487-e137-4f9c-bb7d-5ea4b5df5b8c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.156480 Jul 26 20:32:06.391857 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3252/6578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:06 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:07.413330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cdab07e3-7eef-4b4f-a174-b9b5387fea65 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:07.413905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cdab07e3-7eef-4b4f-a174-b9b5387fea65 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:07.421485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdab07e3-7eef-4b4f-a174-b9b5387fea65 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:07.421937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdab07e3-7eef-4b4f-a174-b9b5387fea65 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:07.422697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdab07e3-7eef-4b4f-a174-b9b5387fea65 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:07.423138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cdab07e3-7eef-4b4f-a174-b9b5387fea65 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:07.555756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cdab07e3-7eef-4b4f-a174-b9b5387fea65 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:07.563716 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cdab07e3-7eef-4b4f-a174-b9b5387fea65 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.154445 Jul 26 20:32:07.564299 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3327/6579] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:07 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:08.585327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f45f7190-f3a6-4bda-8a08-33a7f12daa3c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:08.585983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f45f7190-f3a6-4bda-8a08-33a7f12daa3c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:08.592627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f45f7190-f3a6-4bda-8a08-33a7f12daa3c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:08.593088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f45f7190-f3a6-4bda-8a08-33a7f12daa3c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:08.593859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f45f7190-f3a6-4bda-8a08-33a7f12daa3c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:08.594308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f45f7190-f3a6-4bda-8a08-33a7f12daa3c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:08.722728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f45f7190-f3a6-4bda-8a08-33a7f12daa3c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:08.730820 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f45f7190-f3a6-4bda-8a08-33a7f12daa3c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.149333 Jul 26 20:32:08.731385 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3253/6580] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:08 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:09.752128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6519622d-597d-4484-a65c-62d4bc850dcd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:09.752673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6519622d-597d-4484-a65c-62d4bc850dcd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:09.759926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6519622d-597d-4484-a65c-62d4bc850dcd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:09.760388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6519622d-597d-4484-a65c-62d4bc850dcd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:09.761166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6519622d-597d-4484-a65c-62d4bc850dcd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:09.761641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6519622d-597d-4484-a65c-62d4bc850dcd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:09.894641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6519622d-597d-4484-a65c-62d4bc850dcd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:09.902219 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6519622d-597d-4484-a65c-62d4bc850dcd tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.154263 Jul 26 20:32:09.903002 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3328/6581] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:09 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:10.923089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bc8248e1-583f-4fd1-8cac-e3adc18cfecf tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:10.923678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bc8248e1-583f-4fd1-8cac-e3adc18cfecf tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:10.931029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc8248e1-583f-4fd1-8cac-e3adc18cfecf tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:10.931495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc8248e1-583f-4fd1-8cac-e3adc18cfecf tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:10.932304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc8248e1-583f-4fd1-8cac-e3adc18cfecf tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:10.932759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bc8248e1-583f-4fd1-8cac-e3adc18cfecf tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:11.064877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bc8248e1-583f-4fd1-8cac-e3adc18cfecf tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:11.072410 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bc8248e1-583f-4fd1-8cac-e3adc18cfecf tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.153411 Jul 26 20:32:11.072976 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3254/6582] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:10 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:12.093967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3058ff1-9a0c-4c2b-9024-9a3ea816280c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:12.094593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3058ff1-9a0c-4c2b-9024-9a3ea816280c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:12.101618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3058ff1-9a0c-4c2b-9024-9a3ea816280c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:12.102072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3058ff1-9a0c-4c2b-9024-9a3ea816280c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:12.102843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3058ff1-9a0c-4c2b-9024-9a3ea816280c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:12.103282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3058ff1-9a0c-4c2b-9024-9a3ea816280c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:12.234056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3058ff1-9a0c-4c2b-9024-9a3ea816280c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:12.241591 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3058ff1-9a0c-4c2b-9024-9a3ea816280c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.151583 Jul 26 20:32:12.242170 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3329/6583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:12 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:13.263550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9448ad0a-e3a5-49ad-8534-0cfd79fdd103 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:13.264243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9448ad0a-e3a5-49ad-8534-0cfd79fdd103 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:13.271128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9448ad0a-e3a5-49ad-8534-0cfd79fdd103 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:13.271592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9448ad0a-e3a5-49ad-8534-0cfd79fdd103 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:13.272414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9448ad0a-e3a5-49ad-8534-0cfd79fdd103 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:13.272854 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9448ad0a-e3a5-49ad-8534-0cfd79fdd103 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:13.405381 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9448ad0a-e3a5-49ad-8534-0cfd79fdd103 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:13.412814 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9448ad0a-e3a5-49ad-8534-0cfd79fdd103 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.153812 Jul 26 20:32:13.413381 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3255/6584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:13 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:14.434941 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5265d1a6-3bc5-49d9-9193-bad997e61f8b tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:14.435495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5265d1a6-3bc5-49d9-9193-bad997e61f8b tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:14.442410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5265d1a6-3bc5-49d9-9193-bad997e61f8b tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:14.442860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5265d1a6-3bc5-49d9-9193-bad997e61f8b tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:14.443648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5265d1a6-3bc5-49d9-9193-bad997e61f8b tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:14.444093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5265d1a6-3bc5-49d9-9193-bad997e61f8b tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:14.571595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5265d1a6-3bc5-49d9-9193-bad997e61f8b tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:14.579946 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5265d1a6-3bc5-49d9-9193-bad997e61f8b tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.149510 Jul 26 20:32:14.580520 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3330/6585] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:14 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:15.600903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2e6b5900-d91e-49c4-ba26-4c4eedc8146e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:15.601533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2e6b5900-d91e-49c4-ba26-4c4eedc8146e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:15.604283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=30 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:15.609679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e6b5900-d91e-49c4-ba26-4c4eedc8146e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:15.610144 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e6b5900-d91e-49c4-ba26-4c4eedc8146e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:15.610962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e6b5900-d91e-49c4-ba26-4c4eedc8146e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:15.611419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2e6b5900-d91e-49c4-ba26-4c4eedc8146e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:15.615520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=86 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:15.739408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2e6b5900-d91e-49c4-ba26-4c4eedc8146e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:15.747570 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2e6b5900-d91e-49c4-ba26-4c4eedc8146e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1515 microversion: 2.1 time: 0.150619 Jul 26 20:32:15.748155 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3256/6586] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:15 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:16.768298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d2ac4c91-04a9-4b3c-b1d7-183d68c0a1d2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:16.768926 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d2ac4c91-04a9-4b3c-b1d7-183d68c0a1d2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:16.771682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=34 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:16.778392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2ac4c91-04a9-4b3c-b1d7-183d68c0a1d2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:16.778877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2ac4c91-04a9-4b3c-b1d7-183d68c0a1d2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:16.779720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2ac4c91-04a9-4b3c-b1d7-183d68c0a1d2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:16.780150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d2ac4c91-04a9-4b3c-b1d7-183d68c0a1d2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:16.784789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:16.998158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d2ac4c91-04a9-4b3c-b1d7-183d68c0a1d2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:17.005787 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d2ac4c91-04a9-4b3c-b1d7-183d68c0a1d2 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1514 microversion: 2.1 time: 0.241517 Jul 26 20:32:17.006386 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3331/6587] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:16 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:17.182542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-9e05a0d5-eb33-4992-beee-4f04a7592db5 req-cbb8d199-7da6-4a14-80dc-6cb69dc7da40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e433dd77-47b4-447b-837a-0dd2cbb7c03f", "name": "network-vif-unplugged", "status": "completed", "tag": "37e57a96-5116-4e1a-aa5c-f8b2416a1e48"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:17.194346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9e05a0d5-eb33-4992-beee-4f04a7592db5 req-cbb8d199-7da6-4a14-80dc-6cb69dc7da40 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:17.194808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9e05a0d5-eb33-4992-beee-4f04a7592db5 req-cbb8d199-7da6-4a14-80dc-6cb69dc7da40 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:17.207567 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-9e05a0d5-eb33-4992-beee-4f04a7592db5 req-cbb8d199-7da6-4a14-80dc-6cb69dc7da40 service nova] Creating event network-vif-unplugged:37e57a96-5116-4e1a-aa5c-f8b2416a1e48 for instance e433dd77-47b4-447b-837a-0dd2cbb7c03f on n-h2-708768-8 Jul 26 20:32:17.213692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-9e05a0d5-eb33-4992-beee-4f04a7592db5 req-cbb8d199-7da6-4a14-80dc-6cb69dc7da40 service nova] Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:32:17.228000 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-9e05a0d5-eb33-4992-beee-4f04a7592db5 req-cbb8d199-7da6-4a14-80dc-6cb69dc7da40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131274 Jul 26 20:32:17.229136 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3257/6588] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:32:18.028030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-40878d47-efca-4abd-bfa0-2a518c956a2d tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:18.028670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-40878d47-efca-4abd-bfa0-2a518c956a2d tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:18.036844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40878d47-efca-4abd-bfa0-2a518c956a2d tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:18.037300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40878d47-efca-4abd-bfa0-2a518c956a2d tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:18.038280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40878d47-efca-4abd-bfa0-2a518c956a2d tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:18.038732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-40878d47-efca-4abd-bfa0-2a518c956a2d tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:18.176379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-40878d47-efca-4abd-bfa0-2a518c956a2d tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:18.185147 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-40878d47-efca-4abd-bfa0-2a518c956a2d tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1512 microversion: 2.1 time: 0.162611 Jul 26 20:32:18.185781 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3332/6589] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:18 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:19.208075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3df37343-0959-4958-a85a-c85c10dc6502 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:19.208992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3df37343-0959-4958-a85a-c85c10dc6502 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:19.216142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3df37343-0959-4958-a85a-c85c10dc6502 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:19.216610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3df37343-0959-4958-a85a-c85c10dc6502 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:19.217410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3df37343-0959-4958-a85a-c85c10dc6502 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:19.217864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3df37343-0959-4958-a85a-c85c10dc6502 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:19.244974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a2671bdc-8880-4811-a217-96041686bf95 req-24e8b78c-6e58-48c2-8649-6d64dc21c998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e433dd77-47b4-447b-837a-0dd2cbb7c03f", "tag": "37e57a96-5116-4e1a-aa5c-f8b2416a1e48"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:19.255901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a2671bdc-8880-4811-a217-96041686bf95 req-24e8b78c-6e58-48c2-8649-6d64dc21c998 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:19.256644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a2671bdc-8880-4811-a217-96041686bf95 req-24e8b78c-6e58-48c2-8649-6d64dc21c998 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:19.270383 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a2671bdc-8880-4811-a217-96041686bf95 req-24e8b78c-6e58-48c2-8649-6d64dc21c998 service nova] Creating event network-changed:37e57a96-5116-4e1a-aa5c-f8b2416a1e48 for instance e433dd77-47b4-447b-837a-0dd2cbb7c03f on n-h2-708768-8 Jul 26 20:32:19.276054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-a2671bdc-8880-4811-a217-96041686bf95 req-24e8b78c-6e58-48c2-8649-6d64dc21c998 service nova] Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:32:19.289167 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a2671bdc-8880-4811-a217-96041686bf95 req-24e8b78c-6e58-48c2-8649-6d64dc21c998 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048014 Jul 26 20:32:19.290231 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3333/6590] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:32:19.408308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3df37343-0959-4958-a85a-c85c10dc6502 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:19.419873 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3df37343-0959-4958-a85a-c85c10dc6502 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1512 microversion: 2.1 time: 0.216805 Jul 26 20:32:19.421164 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3258/6591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:19 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:20.444337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5ceb12b-2071-494a-a904-6e38b4e08719 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:20.445020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5ceb12b-2071-494a-a904-6e38b4e08719 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:20.452304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5ceb12b-2071-494a-a904-6e38b4e08719 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:20.452757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5ceb12b-2071-494a-a904-6e38b4e08719 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:20.453521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5ceb12b-2071-494a-a904-6e38b4e08719 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:20.453956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5ceb12b-2071-494a-a904-6e38b4e08719 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:20.584886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c5ceb12b-2071-494a-a904-6e38b4e08719 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:20.593176 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5ceb12b-2071-494a-a904-6e38b4e08719 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1509 microversion: 2.1 time: 0.153271 Jul 26 20:32:20.593757 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3334/6592] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:20 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:20.613005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:20.613519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:20.620525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:20.620987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:20.621771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:20.622225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:20.647800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:32:20.697616 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.api [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Found an unconfirmed migration during delete, id: 16, status: finished Jul 26 20:32:21.334956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4c041a1a-57d6-48cd-8d89-2dc8a956216e req-6524b58a-b4cf-48f9-89a2-45077f310226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e433dd77-47b4-447b-837a-0dd2cbb7c03f", "name": "network-vif-plugged", "status": "completed", "tag": "37e57a96-5116-4e1a-aa5c-f8b2416a1e48"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:21.344626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4c041a1a-57d6-48cd-8d89-2dc8a956216e req-6524b58a-b4cf-48f9-89a2-45077f310226 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:21.345223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4c041a1a-57d6-48cd-8d89-2dc8a956216e req-6524b58a-b4cf-48f9-89a2-45077f310226 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:21.358211 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4c041a1a-57d6-48cd-8d89-2dc8a956216e req-6524b58a-b4cf-48f9-89a2-45077f310226 service nova] Creating event network-vif-plugged:37e57a96-5116-4e1a-aa5c-f8b2416a1e48 for instance e433dd77-47b4-447b-837a-0dd2cbb7c03f on n-h2-708768-8 Jul 26 20:32:21.364780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-4c041a1a-57d6-48cd-8d89-2dc8a956216e req-6524b58a-b4cf-48f9-89a2-45077f310226 service nova] Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:32:21.378367 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4c041a1a-57d6-48cd-8d89-2dc8a956216e req-6524b58a-b4cf-48f9-89a2-45077f310226 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046997 Jul 26 20:32:21.379321 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3335/6593] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:32:22.249041 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1c62d27-a16c-4230-94c2-418f5b6daea1 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 204 len: 0 microversion: 2.1 time: 1.639534 Jul 26 20:32:22.249752 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3259/6594] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:32:20 2022] DELETE /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 0 bytes in 1641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:32:22.259433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fad79fbb-f415-4619-a42b-d7c1a4f0f0fa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:22.260191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fad79fbb-f415-4619-a42b-d7c1a4f0f0fa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:22.266611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fad79fbb-f415-4619-a42b-d7c1a4f0f0fa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:22.267067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fad79fbb-f415-4619-a42b-d7c1a4f0f0fa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:22.267874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fad79fbb-f415-4619-a42b-d7c1a4f0f0fa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:22.268318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fad79fbb-f415-4619-a42b-d7c1a4f0f0fa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:22.402146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fad79fbb-f415-4619-a42b-d7c1a4f0f0fa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:22.409794 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fad79fbb-f415-4619-a42b-d7c1a4f0f0fa tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1501 microversion: 2.1 time: 0.155513 Jul 26 20:32:22.410377 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3336/6595] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:22 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:23.432905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8b56020-508e-43e6-a823-6850d055cb1c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:23.433555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8b56020-508e-43e6-a823-6850d055cb1c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:23.440520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b56020-508e-43e6-a823-6850d055cb1c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:23.440990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b56020-508e-43e6-a823-6850d055cb1c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:23.441773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b56020-508e-43e6-a823-6850d055cb1c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:23.442228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8b56020-508e-43e6-a823-6850d055cb1c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:23.579524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8b56020-508e-43e6-a823-6850d055cb1c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c994a571a24f70b73c7b950bd292f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5536b79e5374aaf903aaff942e3a10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:23.587119 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8b56020-508e-43e6-a823-6850d055cb1c tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 200 len: 1501 microversion: 2.1 time: 0.158912 Jul 26 20:32:23.587708 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3260/6596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:23 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:24.045958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bec99971-c184-4cd0-9d33-c219dc89d49b req-985dda2c-a6c3-496d-aeda-bda2a1631af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e433dd77-47b4-447b-837a-0dd2cbb7c03f", "name": "network-vif-deleted", "tag": "37e57a96-5116-4e1a-aa5c-f8b2416a1e48"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:24.059938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bec99971-c184-4cd0-9d33-c219dc89d49b req-985dda2c-a6c3-496d-aeda-bda2a1631af1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:24.060849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bec99971-c184-4cd0-9d33-c219dc89d49b req-985dda2c-a6c3-496d-aeda-bda2a1631af1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:24.075549 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bec99971-c184-4cd0-9d33-c219dc89d49b req-985dda2c-a6c3-496d-aeda-bda2a1631af1 service nova] Creating event network-vif-deleted:37e57a96-5116-4e1a-aa5c-f8b2416a1e48 for instance e433dd77-47b4-447b-837a-0dd2cbb7c03f on n-h2-708768-8 Jul 26 20:32:24.081902 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bec99971-c184-4cd0-9d33-c219dc89d49b req-985dda2c-a6c3-496d-aeda-bda2a1631af1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039727 Jul 26 20:32:24.082520 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3337/6597] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:32:24.609078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:24.609633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:24.616552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:24.617017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:24.617793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:24.618239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:24.631585 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] HTTP exception thrown: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Request method failure captured: Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f HTTP/1.1 Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E8oBZTDUZFeBTSP7hiByBymKUiMnjuRU474j1D3huUDa-fvdG8WZJbPFoCqq3I_33SUs8k6FiEXF8L0N_MP_0spE0WCJreWrNzunYXvAXWC6Mgy1-al2NM49mdXIZnSBPAcQp9ql6GJ1W0kDI9Zb7Rvke8LqeCqZAyMMjE1m1WpNNs Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a5536b79e5374aaf903aaff942e3a10f Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a5536b79e5374aaf903aaff942e3a10f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5536b79e5374aaf903aaff942e3a10f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a5536b79e5374aaf903aaff942e3a10f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5536b79e5374aaf903aaff942e3a10f"}]}] Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a5536b79e5374aaf903aaff942e3a10f Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersTestJSON-784312348-project Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 50c994a571a24f70b73c7b950bd292f4 Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersTestJSON-784312348-project Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e433dd77-47b4-447b-837a-0dd2cbb7c03f'} Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:32:24.633261 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Returning 404 to user: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f77157d3-68e9-43c7-9688-2bb7fd3a501e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 404 len: 111 microversion: 2.1 time: 0.029670 Jul 26 20:32:24.639813 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3261/6598] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:24 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:32:24.650240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:24.650959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:24.658042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:24.658505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:24.659281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:24.659762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:24.674350 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] HTTP exception thrown: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Request method failure captured: Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f HTTP/1.1 Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E8oBZTDUZFeBTSP7hiByBymKUiMnjuRU474j1D3huUDa-fvdG8WZJbPFoCqq3I_33SUs8k6FiEXF8L0N_MP_0spE0WCJreWrNzunYXvAXWC6Mgy1-al2NM49mdXIZnSBPAcQp9ql6GJ1W0kDI9Zb7Rvke8LqeCqZAyMMjE1m1WpNNs Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: a5536b79e5374aaf903aaff942e3a10f Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a5536b79e5374aaf903aaff942e3a10f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5536b79e5374aaf903aaff942e3a10f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a5536b79e5374aaf903aaff942e3a10f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5536b79e5374aaf903aaff942e3a10f"}]}] Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: a5536b79e5374aaf903aaff942e3a10f Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-DeleteServersTestJSON-784312348-project Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 50c994a571a24f70b73c7b950bd292f4 Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-DeleteServersTestJSON-784312348-project Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'e433dd77-47b4-447b-837a-0dd2cbb7c03f'} Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:32:24.676143 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Returning 404 to user: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba879b43-cb82-41d7-be2c-53e6d6c07d5e tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 404 len: 111 microversion: 2.1 time: 0.031650 Jul 26 20:32:24.681368 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3338/6599] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:32:24 2022] DELETE /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:32:24.686632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:24.687259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] [instance: e433dd77-47b4-447b-837a-0dd2cbb7c03f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:24.693413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:24.693871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:24.694652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:24.695099 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:24.709205 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] HTTP exception thrown: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Request method failure captured: Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f HTTP/1.1 Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E8oBZTDUZFeBTSP7hiByBymKUiMnjuRU474j1D3huUDa-fvdG8WZJbPFoCqq3I_33SUs8k6FiEXF8L0N_MP_0spE0WCJreWrNzunYXvAXWC6Mgy1-al2NM49mdXIZnSBPAcQp9ql6GJ1W0kDI9Zb7Rvke8LqeCqZAyMMjE1m1WpNNs Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: a5536b79e5374aaf903aaff942e3a10f Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a5536b79e5374aaf903aaff942e3a10f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5536b79e5374aaf903aaff942e3a10f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a5536b79e5374aaf903aaff942e3a10f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5536b79e5374aaf903aaff942e3a10f"}]}] Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: a5536b79e5374aaf903aaff942e3a10f Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-DeleteServersTestJSON-784312348 Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-DeleteServersTestJSON-784312348-project Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 50c994a571a24f70b73c7b950bd292f4 Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-DeleteServersTestJSON-784312348-project Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'e433dd77-47b4-447b-837a-0dd2cbb7c03f'} Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:32:24.710728 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] Returning 404 to user: Instance e433dd77-47b4-447b-837a-0dd2cbb7c03f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1d853abc-aeee-40e1-a09a-dd1fa232afd4 tempest-DeleteServersTestJSON-784312348 tempest-DeleteServersTestJSON-784312348-project] 10.222.0.58 "GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f" status: 404 len: 111 microversion: 2.1 time: 0.030807 Jul 26 20:32:24.716851 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3262/6600] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:24 2022] GET /compute/v2.1/servers/e433dd77-47b4-447b-837a-0dd2cbb7c03f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:32:33.415631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-863736627", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "2cc40d91-ea97-4588-831d-ec42dc6fb17f"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:33.471987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] validate_networks() for [('2cc40d91-ea97-4588-831d-ec42dc6fb17f', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:32:33.854517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:32:33.854952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:32:33.855434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:32:33.855884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:32:33.856308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:32:33.865647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:33.866099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:33.866913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:33.867358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:33.887043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Getting quotas for project 9bc2259895a24a41b39ab0edff290b70. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:32:33.892549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Getting quotas for user e75db331ed77478b84e26c244c0fc5f9 and project 9bc2259895a24a41b39ab0edff290b70. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:32:33.906518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:32:33.909146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:32:33.956381 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2204e429-2da9-419f-b240-46c20fc29c0a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667880 Jul 26 20:32:33.962832 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3339/6601] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:32:33.969182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f93b9535-570d-4626-a8e2-abd2fb65dca1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:33.969803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f93b9535-570d-4626-a8e2-abd2fb65dca1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:34.024438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f93b9535-570d-4626-a8e2-abd2fb65dca1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:34.032728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f93b9535-570d-4626-a8e2-abd2fb65dca1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1217 microversion: 2.1 time: 0.068305 Jul 26 20:32:34.033306 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3263/6602] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:33 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:35.055574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68f62366-1786-4859-9431-a7c19b1cfe69 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:35.057227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68f62366-1786-4859-9431-a7c19b1cfe69 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:35.064596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68f62366-1786-4859-9431-a7c19b1cfe69 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:35.065061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68f62366-1786-4859-9431-a7c19b1cfe69 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:35.065910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68f62366-1786-4859-9431-a7c19b1cfe69 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:35.066360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68f62366-1786-4859-9431-a7c19b1cfe69 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:35.165902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68f62366-1786-4859-9431-a7c19b1cfe69 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:35.175747 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68f62366-1786-4859-9431-a7c19b1cfe69 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1275 microversion: 2.1 time: 0.125685 Jul 26 20:32:35.177110 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3340/6603] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:35 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:36.199136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9bfc69bc-292e-4b9c-893e-bd3f3001032d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:36.200062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9bfc69bc-292e-4b9c-893e-bd3f3001032d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:36.211204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:36.215454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bfc69bc-292e-4b9c-893e-bd3f3001032d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:36.216344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bfc69bc-292e-4b9c-893e-bd3f3001032d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:36.217206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bfc69bc-292e-4b9c-893e-bd3f3001032d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:36.217833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9bfc69bc-292e-4b9c-893e-bd3f3001032d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:36.392113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9bfc69bc-292e-4b9c-893e-bd3f3001032d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:36.400286 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9bfc69bc-292e-4b9c-893e-bd3f3001032d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1317 microversion: 2.1 time: 0.206047 Jul 26 20:32:36.400968 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3264/6604] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:36 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:36.507866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0849f471-adbe-4c1c-9ba0-4e443a3ad513 req-052dfb52-72ea-48a0-8230-6c9689833053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bb8762-7943-4658-b1db-1547a48381bb", "tag": "5c59afe4-5fbf-430c-903e-5318c9cb824b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:36.536945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0849f471-adbe-4c1c-9ba0-4e443a3ad513 req-052dfb52-72ea-48a0-8230-6c9689833053 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:36.537402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0849f471-adbe-4c1c-9ba0-4e443a3ad513 req-052dfb52-72ea-48a0-8230-6c9689833053 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:36.560915 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0849f471-adbe-4c1c-9ba0-4e443a3ad513 req-052dfb52-72ea-48a0-8230-6c9689833053 service nova] Creating event network-changed:5c59afe4-5fbf-430c-903e-5318c9cb824b for instance f8bb8762-7943-4658-b1db-1547a48381bb on n-h1-708768-8 Jul 26 20:32:36.571510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0849f471-adbe-4c1c-9ba0-4e443a3ad513 req-052dfb52-72ea-48a0-8230-6c9689833053 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067871 Jul 26 20:32:36.572512 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3341/6605] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:32:37.421924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-354dc20a-b15a-4fd4-a064-d4a5f87d3e29 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:37.422543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-354dc20a-b15a-4fd4-a064-d4a5f87d3e29 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:37.429804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-354dc20a-b15a-4fd4-a064-d4a5f87d3e29 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:37.430260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-354dc20a-b15a-4fd4-a064-d4a5f87d3e29 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:37.431054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-354dc20a-b15a-4fd4-a064-d4a5f87d3e29 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:37.431498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-354dc20a-b15a-4fd4-a064-d4a5f87d3e29 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:37.563107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-354dc20a-b15a-4fd4-a064-d4a5f87d3e29 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:37.570700 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-354dc20a-b15a-4fd4-a064-d4a5f87d3e29 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1317 microversion: 2.1 time: 0.153359 Jul 26 20:32:37.571278 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3265/6606] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:37 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:38.593545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-57a74945-7c2b-4970-97ce-a0b5592d454d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:38.594256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-57a74945-7c2b-4970-97ce-a0b5592d454d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:38.600630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57a74945-7c2b-4970-97ce-a0b5592d454d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:38.601081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57a74945-7c2b-4970-97ce-a0b5592d454d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:38.601848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57a74945-7c2b-4970-97ce-a0b5592d454d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:38.602288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-57a74945-7c2b-4970-97ce-a0b5592d454d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:38.734774 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-57a74945-7c2b-4970-97ce-a0b5592d454d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:38.742301 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-57a74945-7c2b-4970-97ce-a0b5592d454d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1317 microversion: 2.1 time: 0.154055 Jul 26 20:32:38.742871 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3342/6607] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:38 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:39.763768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-72586ae0-a4ee-4fc6-898c-5931eadbb118 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:39.764397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-72586ae0-a4ee-4fc6-898c-5931eadbb118 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:39.771467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72586ae0-a4ee-4fc6-898c-5931eadbb118 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:39.771989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72586ae0-a4ee-4fc6-898c-5931eadbb118 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:39.772752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72586ae0-a4ee-4fc6-898c-5931eadbb118 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:39.773202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-72586ae0-a4ee-4fc6-898c-5931eadbb118 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:39.910087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-72586ae0-a4ee-4fc6-898c-5931eadbb118 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:39.918187 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-72586ae0-a4ee-4fc6-898c-5931eadbb118 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1317 microversion: 2.1 time: 0.158317 Jul 26 20:32:39.918857 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3266/6608] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:39 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:40.940865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-36d88e31-87a3-4ecd-81f6-90e32db09d37 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:40.941409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-36d88e31-87a3-4ecd-81f6-90e32db09d37 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:40.948474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36d88e31-87a3-4ecd-81f6-90e32db09d37 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:40.948929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36d88e31-87a3-4ecd-81f6-90e32db09d37 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:40.949700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36d88e31-87a3-4ecd-81f6-90e32db09d37 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:40.950140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-36d88e31-87a3-4ecd-81f6-90e32db09d37 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:41.083051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-36d88e31-87a3-4ecd-81f6-90e32db09d37 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:41.090604 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-36d88e31-87a3-4ecd-81f6-90e32db09d37 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1317 microversion: 2.1 time: 0.153730 Jul 26 20:32:41.091246 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3343/6609] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:40 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:32:41.568042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-9d6e67ac-d1d6-4b49-9c6e-2b5cc1165f43 req-8f48c514-fbfd-4c7f-9acc-d620093d3c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb8762-7943-4658-b1db-1547a48381bb", "name": "network-vif-plugged", "status": "completed", "tag": "5c59afe4-5fbf-430c-903e-5318c9cb824b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:41.579241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9d6e67ac-d1d6-4b49-9c6e-2b5cc1165f43 req-8f48c514-fbfd-4c7f-9acc-d620093d3c5e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:41.579725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9d6e67ac-d1d6-4b49-9c6e-2b5cc1165f43 req-8f48c514-fbfd-4c7f-9acc-d620093d3c5e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:41.590796 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-9d6e67ac-d1d6-4b49-9c6e-2b5cc1165f43 req-8f48c514-fbfd-4c7f-9acc-d620093d3c5e service nova] Creating event network-vif-plugged:5c59afe4-5fbf-430c-903e-5318c9cb824b for instance f8bb8762-7943-4658-b1db-1547a48381bb on n-h1-708768-8 Jul 26 20:32:41.596576 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-9d6e67ac-d1d6-4b49-9c6e-2b5cc1165f43 req-8f48c514-fbfd-4c7f-9acc-d620093d3c5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032559 Jul 26 20:32:41.597364 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3267/6610] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:32:42.110527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d723b557-b55d-4933-9789-7c3232348ee0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:42.111141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d723b557-b55d-4933-9789-7c3232348ee0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:42.118085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d723b557-b55d-4933-9789-7c3232348ee0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:42.118534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d723b557-b55d-4933-9789-7c3232348ee0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:42.119294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d723b557-b55d-4933-9789-7c3232348ee0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:42.119760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d723b557-b55d-4933-9789-7c3232348ee0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:42.252592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d723b557-b55d-4933-9789-7c3232348ee0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:42.260130 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d723b557-b55d-4933-9789-7c3232348ee0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1317 microversion: 2.1 time: 0.153684 Jul 26 20:32:42.260703 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3344/6611] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:42 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:43.283267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b5f18df6-d2b9-428f-95da-5dbfe9a0db4b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:43.283940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b5f18df6-d2b9-428f-95da-5dbfe9a0db4b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:43.290120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5f18df6-d2b9-428f-95da-5dbfe9a0db4b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.290594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5f18df6-d2b9-428f-95da-5dbfe9a0db4b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.291355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5f18df6-d2b9-428f-95da-5dbfe9a0db4b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.291839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b5f18df6-d2b9-428f-95da-5dbfe9a0db4b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.426670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b5f18df6-d2b9-428f-95da-5dbfe9a0db4b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:43.434480 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b5f18df6-d2b9-428f-95da-5dbfe9a0db4b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1506 microversion: 2.1 time: 0.157385 Jul 26 20:32:43.436267 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3268/6612] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:43 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:43.457209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec9826f3-56de-4d1e-86e4-6c00fe128081 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:43.457856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ec9826f3-56de-4d1e-86e4-6c00fe128081 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:43.464829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec9826f3-56de-4d1e-86e4-6c00fe128081 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.465278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec9826f3-56de-4d1e-86e4-6c00fe128081 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.466070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec9826f3-56de-4d1e-86e4-6c00fe128081 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.466520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec9826f3-56de-4d1e-86e4-6c00fe128081 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.594491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ec9826f3-56de-4d1e-86e4-6c00fe128081 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:43.602070 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ec9826f3-56de-4d1e-86e4-6c00fe128081 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1506 microversion: 2.1 time: 0.148801 Jul 26 20:32:43.602645 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3345/6613] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:43 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:43.622102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-214db0c3-ffb3-4f38-9d6e-f332cfcd7d68 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:43.625966 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-214db0c3-ffb3-4f38-9d6e-f332cfcd7d68 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:43.632084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-214db0c3-ffb3-4f38-9d6e-f332cfcd7d68 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.632549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-214db0c3-ffb3-4f38-9d6e-f332cfcd7d68 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.633324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-214db0c3-ffb3-4f38-9d6e-f332cfcd7d68 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.633772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-214db0c3-ffb3-4f38-9d6e-f332cfcd7d68 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.695801 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-214db0c3-ffb3-4f38-9d6e-f332cfcd7d68 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "PUT /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1078 microversion: 2.1 time: 0.077486 Jul 26 20:32:43.696410 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3269/6614] 10.222.0.58 () {60 vars in 1256 bytes} [Tue Jul 26 20:32:43 2022] PUT /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1078 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:43.713773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a436bb88-19fc-4467-a52e-6c4243119e88 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:43.714393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a436bb88-19fc-4467-a52e-6c4243119e88 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:43.720612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a436bb88-19fc-4467-a52e-6c4243119e88 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.721064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a436bb88-19fc-4467-a52e-6c4243119e88 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.721829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a436bb88-19fc-4467-a52e-6c4243119e88 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.722271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a436bb88-19fc-4467-a52e-6c4243119e88 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.856398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a436bb88-19fc-4467-a52e-6c4243119e88 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:43.864809 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a436bb88-19fc-4467-a52e-6c4243119e88 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1504 microversion: 2.1 time: 0.154905 Jul 26 20:32:43.865393 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3346/6615] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:43 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:43.885358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08dd5e09-5955-4635-849a-bcca3d2879da tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:43.886018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08dd5e09-5955-4635-849a-bcca3d2879da tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:43.892889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08dd5e09-5955-4635-849a-bcca3d2879da tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.893358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08dd5e09-5955-4635-849a-bcca3d2879da tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:43.894139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08dd5e09-5955-4635-849a-bcca3d2879da tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:43.894593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08dd5e09-5955-4635-849a-bcca3d2879da tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:44.023452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-08dd5e09-5955-4635-849a-bcca3d2879da tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:44.032139 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08dd5e09-5955-4635-849a-bcca3d2879da tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1504 microversion: 2.1 time: 0.150594 Jul 26 20:32:44.032721 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3270/6616] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:43 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:44.052520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:32:44.054739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:44.056725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:44.057398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:44.063304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:44.063784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:44.064556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:44.064993 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:44.094016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:44.099815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Old instance type m1.heat2, new instance type m1.heat {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:32:44.106020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:32:44.106446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:32:44.106952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:32:44.107913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:32:44.107913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:32:44.168972 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb951cbd-3628-4555-8ad5-b1a9edb3e529 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "POST /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb/action" status: 202 len: 0 microversion: 2.1 time: 0.120654 Jul 26 20:32:44.169730 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3347/6617] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:32:44 2022] POST /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:32:44.178009 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ccf1aba-f657-4c6b-92ec-10ec936392cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:44.178639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ccf1aba-f657-4c6b-92ec-10ec936392cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:44.180624 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:44.187001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ccf1aba-f657-4c6b-92ec-10ec936392cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:44.187645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ccf1aba-f657-4c6b-92ec-10ec936392cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:44.188288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ccf1aba-f657-4c6b-92ec-10ec936392cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:44.188738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ccf1aba-f657-4c6b-92ec-10ec936392cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:44.351819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ccf1aba-f657-4c6b-92ec-10ec936392cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:44.359811 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ccf1aba-f657-4c6b-92ec-10ec936392cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1515 microversion: 2.1 time: 0.185569 Jul 26 20:32:44.360379 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3271/6618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:44 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:45.382141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8515e502-0ef0-4036-a3be-df599dd41982 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:45.382722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8515e502-0ef0-4036-a3be-df599dd41982 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:45.389409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8515e502-0ef0-4036-a3be-df599dd41982 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:45.389855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8515e502-0ef0-4036-a3be-df599dd41982 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:45.390614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8515e502-0ef0-4036-a3be-df599dd41982 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:45.391048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8515e502-0ef0-4036-a3be-df599dd41982 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:45.568191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8515e502-0ef0-4036-a3be-df599dd41982 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:45.576259 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8515e502-0ef0-4036-a3be-df599dd41982 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1515 microversion: 2.1 time: 0.198932 Jul 26 20:32:45.576849 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3348/6619] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:45 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:46.597550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd2223c6-5f77-4a17-8d6a-62873df111d1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:46.598094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd2223c6-5f77-4a17-8d6a-62873df111d1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:46.600780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:46.606100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd2223c6-5f77-4a17-8d6a-62873df111d1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:46.606590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd2223c6-5f77-4a17-8d6a-62873df111d1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:46.607432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd2223c6-5f77-4a17-8d6a-62873df111d1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:46.607898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd2223c6-5f77-4a17-8d6a-62873df111d1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:46.744615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd2223c6-5f77-4a17-8d6a-62873df111d1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:46.752995 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd2223c6-5f77-4a17-8d6a-62873df111d1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.159279 Jul 26 20:32:46.753572 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3272/6620] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:46 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:47.780301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a9f0ff2-3cb5-4914-b29d-7d08fda6c40e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:47.780933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a9f0ff2-3cb5-4914-b29d-7d08fda6c40e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:47.783818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:47.789907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a9f0ff2-3cb5-4914-b29d-7d08fda6c40e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:47.790356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a9f0ff2-3cb5-4914-b29d-7d08fda6c40e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:47.791134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a9f0ff2-3cb5-4914-b29d-7d08fda6c40e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:47.791649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a9f0ff2-3cb5-4914-b29d-7d08fda6c40e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:47.797045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:32:47.933249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4a9f0ff2-3cb5-4914-b29d-7d08fda6c40e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:47.941499 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a9f0ff2-3cb5-4914-b29d-7d08fda6c40e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.170941 Jul 26 20:32:47.942076 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3349/6621] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:47 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:48.962304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6cd4ed43-afd0-40f3-b2ca-53c7c50fdb17 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:48.962930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6cd4ed43-afd0-40f3-b2ca-53c7c50fdb17 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:48.970562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cd4ed43-afd0-40f3-b2ca-53c7c50fdb17 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:48.971022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cd4ed43-afd0-40f3-b2ca-53c7c50fdb17 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:48.971834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cd4ed43-afd0-40f3-b2ca-53c7c50fdb17 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:48.972292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6cd4ed43-afd0-40f3-b2ca-53c7c50fdb17 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:49.105061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6cd4ed43-afd0-40f3-b2ca-53c7c50fdb17 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:49.112830 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6cd4ed43-afd0-40f3-b2ca-53c7c50fdb17 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.154447 Jul 26 20:32:49.113402 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3273/6622] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:48 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:50.134340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-afc3c341-4fc5-470e-be9a-ba206f894355 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:50.134952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-afc3c341-4fc5-470e-be9a-ba206f894355 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:50.142314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afc3c341-4fc5-470e-be9a-ba206f894355 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:50.142758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afc3c341-4fc5-470e-be9a-ba206f894355 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:50.143519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afc3c341-4fc5-470e-be9a-ba206f894355 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:50.143977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-afc3c341-4fc5-470e-be9a-ba206f894355 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:50.278609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-afc3c341-4fc5-470e-be9a-ba206f894355 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:50.286469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-afc3c341-4fc5-470e-be9a-ba206f894355 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.156040 Jul 26 20:32:50.287041 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3350/6623] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:50 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:51.308681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-699b4d33-d821-4a54-a385-99e4396c0b1a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:51.309242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-699b4d33-d821-4a54-a385-99e4396c0b1a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:51.316860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-699b4d33-d821-4a54-a385-99e4396c0b1a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:51.317322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-699b4d33-d821-4a54-a385-99e4396c0b1a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:51.318084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-699b4d33-d821-4a54-a385-99e4396c0b1a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:51.318528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-699b4d33-d821-4a54-a385-99e4396c0b1a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:51.444981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-699b4d33-d821-4a54-a385-99e4396c0b1a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:51.452653 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-699b4d33-d821-4a54-a385-99e4396c0b1a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.148005 Jul 26 20:32:51.453229 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3274/6624] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:51 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:52.473839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2e4f454c-de9f-49f8-8b18-a75b0031acd0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:52.474521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2e4f454c-de9f-49f8-8b18-a75b0031acd0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:52.481672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e4f454c-de9f-49f8-8b18-a75b0031acd0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:52.482237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e4f454c-de9f-49f8-8b18-a75b0031acd0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:52.483000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e4f454c-de9f-49f8-8b18-a75b0031acd0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:52.483438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e4f454c-de9f-49f8-8b18-a75b0031acd0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:52.612045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2e4f454c-de9f-49f8-8b18-a75b0031acd0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:52.619563 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2e4f454c-de9f-49f8-8b18-a75b0031acd0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.149634 Jul 26 20:32:52.620165 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3351/6625] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:52 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:53.641771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2123157a-d8ff-4c0f-a923-91bc4bc8b25f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:53.642445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2123157a-d8ff-4c0f-a923-91bc4bc8b25f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:53.649396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2123157a-d8ff-4c0f-a923-91bc4bc8b25f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:53.649853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2123157a-d8ff-4c0f-a923-91bc4bc8b25f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:53.650618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2123157a-d8ff-4c0f-a923-91bc4bc8b25f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:53.651063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2123157a-d8ff-4c0f-a923-91bc4bc8b25f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:53.782805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2123157a-d8ff-4c0f-a923-91bc4bc8b25f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:53.790307 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2123157a-d8ff-4c0f-a923-91bc4bc8b25f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.153088 Jul 26 20:32:53.790872 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3275/6626] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:53 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:54.811462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-82a9da5b-d7f6-41fd-b61b-094a3d62958c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:54.812351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-82a9da5b-d7f6-41fd-b61b-094a3d62958c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:54.819791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82a9da5b-d7f6-41fd-b61b-094a3d62958c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:54.820294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82a9da5b-d7f6-41fd-b61b-094a3d62958c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:54.821069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82a9da5b-d7f6-41fd-b61b-094a3d62958c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:54.821511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-82a9da5b-d7f6-41fd-b61b-094a3d62958c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:54.954552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-82a9da5b-d7f6-41fd-b61b-094a3d62958c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:54.962041 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-82a9da5b-d7f6-41fd-b61b-094a3d62958c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.154717 Jul 26 20:32:54.962682 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3352/6627] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:54 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:55.985776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c2b99df-61be-40fc-865e-97f50ddb571b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:55.986431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c2b99df-61be-40fc-865e-97f50ddb571b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:55.993456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c2b99df-61be-40fc-865e-97f50ddb571b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:55.993924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c2b99df-61be-40fc-865e-97f50ddb571b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:55.994706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c2b99df-61be-40fc-865e-97f50ddb571b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:55.995161 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c2b99df-61be-40fc-865e-97f50ddb571b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:56.122917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c2b99df-61be-40fc-865e-97f50ddb571b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:56.130492 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c2b99df-61be-40fc-865e-97f50ddb571b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.149536 Jul 26 20:32:56.131200 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3276/6628] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:55 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:57.152217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a3dc3c6e-6088-46e9-ba5d-7ecb0ba89c84 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:57.152839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a3dc3c6e-6088-46e9-ba5d-7ecb0ba89c84 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:57.160138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3dc3c6e-6088-46e9-ba5d-7ecb0ba89c84 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:57.173097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3dc3c6e-6088-46e9-ba5d-7ecb0ba89c84 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:57.173097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3dc3c6e-6088-46e9-ba5d-7ecb0ba89c84 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:57.173097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a3dc3c6e-6088-46e9-ba5d-7ecb0ba89c84 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:57.305586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a3dc3c6e-6088-46e9-ba5d-7ecb0ba89c84 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:57.313295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a3dc3c6e-6088-46e9-ba5d-7ecb0ba89c84 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.165164 Jul 26 20:32:57.313873 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3353/6629] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:57 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:58.334420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a57c33b4-5c6b-4351-b683-518fe9358837 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:58.334988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a57c33b4-5c6b-4351-b683-518fe9358837 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:58.341706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a57c33b4-5c6b-4351-b683-518fe9358837 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:58.342165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a57c33b4-5c6b-4351-b683-518fe9358837 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:58.343588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a57c33b4-5c6b-4351-b683-518fe9358837 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:58.344073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a57c33b4-5c6b-4351-b683-518fe9358837 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:58.476030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a57c33b4-5c6b-4351-b683-518fe9358837 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:58.484146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a57c33b4-5c6b-4351-b683-518fe9358837 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.153080 Jul 26 20:32:58.484879 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3277/6630] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:58 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:32:59.505736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6471187c-3449-4797-af0d-05b78f596e83 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:32:59.506362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6471187c-3449-4797-af0d-05b78f596e83 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:32:59.513263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6471187c-3449-4797-af0d-05b78f596e83 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:59.513714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6471187c-3449-4797-af0d-05b78f596e83 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:59.514498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6471187c-3449-4797-af0d-05b78f596e83 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:32:59.514943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6471187c-3449-4797-af0d-05b78f596e83 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:32:59.648587 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6471187c-3449-4797-af0d-05b78f596e83 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:32:59.656158 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6471187c-3449-4797-af0d-05b78f596e83 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.154184 Jul 26 20:32:59.656617 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3354/6631] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:32:59 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:00.677285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fec0ab8b-ca5e-45f2-b2cb-9afa7a871fda tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:00.677910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fec0ab8b-ca5e-45f2-b2cb-9afa7a871fda tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:00.684904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fec0ab8b-ca5e-45f2-b2cb-9afa7a871fda tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:00.685402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fec0ab8b-ca5e-45f2-b2cb-9afa7a871fda tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:00.686178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fec0ab8b-ca5e-45f2-b2cb-9afa7a871fda tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:00.687119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fec0ab8b-ca5e-45f2-b2cb-9afa7a871fda tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:00.818574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fec0ab8b-ca5e-45f2-b2cb-9afa7a871fda tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:00.826047 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fec0ab8b-ca5e-45f2-b2cb-9afa7a871fda tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.152996 Jul 26 20:33:00.826622 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3278/6632] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:00 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:01.848586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-05312877-4f85-48bd-b0f6-8a42d46d0b14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:01.849187 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-05312877-4f85-48bd-b0f6-8a42d46d0b14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:01.856113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05312877-4f85-48bd-b0f6-8a42d46d0b14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:01.856565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05312877-4f85-48bd-b0f6-8a42d46d0b14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:01.857339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05312877-4f85-48bd-b0f6-8a42d46d0b14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:01.857780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05312877-4f85-48bd-b0f6-8a42d46d0b14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:01.990694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05312877-4f85-48bd-b0f6-8a42d46d0b14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:01.998201 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-05312877-4f85-48bd-b0f6-8a42d46d0b14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.153523 Jul 26 20:33:01.998775 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3355/6633] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:01 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:03.019474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f583ca11-4150-4864-9407-4eb71c5049fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:03.020151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f583ca11-4150-4864-9407-4eb71c5049fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:03.027215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f583ca11-4150-4864-9407-4eb71c5049fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:03.027715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f583ca11-4150-4864-9407-4eb71c5049fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:03.028498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f583ca11-4150-4864-9407-4eb71c5049fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:03.028955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f583ca11-4150-4864-9407-4eb71c5049fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:03.159215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f583ca11-4150-4864-9407-4eb71c5049fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:03.166894 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f583ca11-4150-4864-9407-4eb71c5049fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.151345 Jul 26 20:33:03.167625 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3279/6634] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:03 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:04.189770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7bb451fc-6046-4a42-a40e-29201d5b57e7 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:04.190394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7bb451fc-6046-4a42-a40e-29201d5b57e7 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:04.197359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7bb451fc-6046-4a42-a40e-29201d5b57e7 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:04.197814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7bb451fc-6046-4a42-a40e-29201d5b57e7 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:04.198582 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7bb451fc-6046-4a42-a40e-29201d5b57e7 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:04.199025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7bb451fc-6046-4a42-a40e-29201d5b57e7 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:04.330612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7bb451fc-6046-4a42-a40e-29201d5b57e7 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:04.338152 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7bb451fc-6046-4a42-a40e-29201d5b57e7 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.152515 Jul 26 20:33:04.338729 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3356/6635] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:04 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:05.359309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e2c8751-d1bc-4d19-bb33-d116eb91eae3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:05.359940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e2c8751-d1bc-4d19-bb33-d116eb91eae3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:05.367187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e2c8751-d1bc-4d19-bb33-d116eb91eae3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:05.367675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e2c8751-d1bc-4d19-bb33-d116eb91eae3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:05.368457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e2c8751-d1bc-4d19-bb33-d116eb91eae3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:05.368902 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e2c8751-d1bc-4d19-bb33-d116eb91eae3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:05.387083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:05.505042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e2c8751-d1bc-4d19-bb33-d116eb91eae3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:05.512615 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e2c8751-d1bc-4d19-bb33-d116eb91eae3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.157349 Jul 26 20:33:05.513183 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3280/6636] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:05 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:06.539643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d721614-807d-4419-87f1-bb050eb892b3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:06.540257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d721614-807d-4419-87f1-bb050eb892b3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:06.550685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d721614-807d-4419-87f1-bb050eb892b3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:06.551144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d721614-807d-4419-87f1-bb050eb892b3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:06.554057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d721614-807d-4419-87f1-bb050eb892b3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:06.554539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6d721614-807d-4419-87f1-bb050eb892b3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:06.690832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6d721614-807d-4419-87f1-bb050eb892b3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:06.699066 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d721614-807d-4419-87f1-bb050eb892b3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.169458 Jul 26 20:33:06.699660 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3357/6637] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:06 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:07.720636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-44db0172-7f5d-4ef1-9234-84a1ac329ef1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:07.721271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-44db0172-7f5d-4ef1-9234-84a1ac329ef1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:07.728213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44db0172-7f5d-4ef1-9234-84a1ac329ef1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:07.728682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44db0172-7f5d-4ef1-9234-84a1ac329ef1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:07.729474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44db0172-7f5d-4ef1-9234-84a1ac329ef1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:07.729990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44db0172-7f5d-4ef1-9234-84a1ac329ef1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:07.862376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-44db0172-7f5d-4ef1-9234-84a1ac329ef1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:07.869892 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-44db0172-7f5d-4ef1-9234-84a1ac329ef1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.153994 Jul 26 20:33:07.870462 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3281/6638] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:07 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:08.891883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-53d45cdb-a2fd-4b19-8167-d1611ea88d41 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:08.892487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-53d45cdb-a2fd-4b19-8167-d1611ea88d41 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:08.899741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53d45cdb-a2fd-4b19-8167-d1611ea88d41 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:08.900201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53d45cdb-a2fd-4b19-8167-d1611ea88d41 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:08.900974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53d45cdb-a2fd-4b19-8167-d1611ea88d41 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:08.901408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-53d45cdb-a2fd-4b19-8167-d1611ea88d41 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:09.039010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-53d45cdb-a2fd-4b19-8167-d1611ea88d41 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:09.047283 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-53d45cdb-a2fd-4b19-8167-d1611ea88d41 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.159475 Jul 26 20:33:09.047876 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3358/6639] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:08 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:10.068528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90ba37b2-e451-4004-b18f-579a4fa905ea tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:10.069155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90ba37b2-e451-4004-b18f-579a4fa905ea tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:10.076180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90ba37b2-e451-4004-b18f-579a4fa905ea tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:10.076688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90ba37b2-e451-4004-b18f-579a4fa905ea tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:10.077635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90ba37b2-e451-4004-b18f-579a4fa905ea tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:10.078097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90ba37b2-e451-4004-b18f-579a4fa905ea tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:10.217066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-90ba37b2-e451-4004-b18f-579a4fa905ea tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:10.225228 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90ba37b2-e451-4004-b18f-579a4fa905ea tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.160599 Jul 26 20:33:10.225797 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3282/6640] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:10 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:11.247206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-de8bb9e7-e512-4b6b-ad4e-b79388d3e75e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:11.247855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-de8bb9e7-e512-4b6b-ad4e-b79388d3e75e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:11.254809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de8bb9e7-e512-4b6b-ad4e-b79388d3e75e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:11.255261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de8bb9e7-e512-4b6b-ad4e-b79388d3e75e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:11.256059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de8bb9e7-e512-4b6b-ad4e-b79388d3e75e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:11.256498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-de8bb9e7-e512-4b6b-ad4e-b79388d3e75e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:11.386537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-de8bb9e7-e512-4b6b-ad4e-b79388d3e75e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:11.394181 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-de8bb9e7-e512-4b6b-ad4e-b79388d3e75e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.150989 Jul 26 20:33:11.394751 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3359/6641] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:11 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:12.415875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-528a3268-0e10-4c40-b866-15af2f94c718 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:12.416439 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-528a3268-0e10-4c40-b866-15af2f94c718 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:12.424260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528a3268-0e10-4c40-b866-15af2f94c718 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:12.424729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528a3268-0e10-4c40-b866-15af2f94c718 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:12.425513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528a3268-0e10-4c40-b866-15af2f94c718 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:12.425965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-528a3268-0e10-4c40-b866-15af2f94c718 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:12.554704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-528a3268-0e10-4c40-b866-15af2f94c718 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:12.563204 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-528a3268-0e10-4c40-b866-15af2f94c718 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.151327 Jul 26 20:33:12.563806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3283/6642] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:12 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:13.584318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d1dd3b71-ecbf-48b4-8024-7bb77fbd10fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:13.584938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d1dd3b71-ecbf-48b4-8024-7bb77fbd10fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:13.592498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1dd3b71-ecbf-48b4-8024-7bb77fbd10fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:13.593028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1dd3b71-ecbf-48b4-8024-7bb77fbd10fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:13.593925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1dd3b71-ecbf-48b4-8024-7bb77fbd10fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:13.594367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d1dd3b71-ecbf-48b4-8024-7bb77fbd10fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:13.726811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d1dd3b71-ecbf-48b4-8024-7bb77fbd10fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:13.734480 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d1dd3b71-ecbf-48b4-8024-7bb77fbd10fe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.154107 Jul 26 20:33:13.735059 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3360/6643] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:13 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:14.760796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-67a7207b-ad69-472c-a977-4d2426730f36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:14.760796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-67a7207b-ad69-472c-a977-4d2426730f36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:14.763387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67a7207b-ad69-472c-a977-4d2426730f36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:14.764434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67a7207b-ad69-472c-a977-4d2426730f36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:14.765281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67a7207b-ad69-472c-a977-4d2426730f36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:14.765731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67a7207b-ad69-472c-a977-4d2426730f36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:14.896749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-67a7207b-ad69-472c-a977-4d2426730f36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:14.904284 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-67a7207b-ad69-472c-a977-4d2426730f36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.152630 Jul 26 20:33:14.905297 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3284/6644] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:14 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:15.926850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-776fb15f-446b-4dec-9607-25993eb3dab0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:15.927460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-776fb15f-446b-4dec-9607-25993eb3dab0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:15.934495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-776fb15f-446b-4dec-9607-25993eb3dab0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:15.934954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-776fb15f-446b-4dec-9607-25993eb3dab0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:15.935760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-776fb15f-446b-4dec-9607-25993eb3dab0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:15.936214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-776fb15f-446b-4dec-9607-25993eb3dab0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:16.067527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-776fb15f-446b-4dec-9607-25993eb3dab0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:16.075139 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-776fb15f-446b-4dec-9607-25993eb3dab0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.152551 Jul 26 20:33:16.075736 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3361/6645] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:15 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:17.095968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-61a18fbd-c8b3-4d82-aac2-617b3c03aaa4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:17.096592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-61a18fbd-c8b3-4d82-aac2-617b3c03aaa4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:17.099298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=26 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:17.104743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61a18fbd-c8b3-4d82-aac2-617b3c03aaa4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:17.105198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61a18fbd-c8b3-4d82-aac2-617b3c03aaa4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:17.105968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61a18fbd-c8b3-4d82-aac2-617b3c03aaa4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:17.106410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-61a18fbd-c8b3-4d82-aac2-617b3c03aaa4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:17.236666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-61a18fbd-c8b3-4d82-aac2-617b3c03aaa4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:17.244230 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-61a18fbd-c8b3-4d82-aac2-617b3c03aaa4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1520 microversion: 2.1 time: 0.152370 Jul 26 20:33:17.244800 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3285/6646] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:17 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:18.266623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-92f26571-5c39-4a70-9b80-3694b13892a3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:18.267245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-92f26571-5c39-4a70-9b80-3694b13892a3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:18.270086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=26 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:18.275095 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92f26571-5c39-4a70-9b80-3694b13892a3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:18.275553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92f26571-5c39-4a70-9b80-3694b13892a3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:18.276780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92f26571-5c39-4a70-9b80-3694b13892a3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:18.276780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-92f26571-5c39-4a70-9b80-3694b13892a3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:18.280808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=78 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:18.361411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-1aa337fa-b5fd-4f33-9434-102a1ae21d1d req-90a8aa86-5c2b-4ca5-85e9-3b0e0d82fc9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb8762-7943-4658-b1db-1547a48381bb", "name": "network-vif-unplugged", "status": "completed", "tag": "5c59afe4-5fbf-430c-903e-5318c9cb824b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:18.380812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1aa337fa-b5fd-4f33-9434-102a1ae21d1d req-90a8aa86-5c2b-4ca5-85e9-3b0e0d82fc9d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:18.381611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-1aa337fa-b5fd-4f33-9434-102a1ae21d1d req-90a8aa86-5c2b-4ca5-85e9-3b0e0d82fc9d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:18.395412 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-1aa337fa-b5fd-4f33-9434-102a1ae21d1d req-90a8aa86-5c2b-4ca5-85e9-3b0e0d82fc9d service nova] Creating event network-vif-unplugged:5c59afe4-5fbf-430c-903e-5318c9cb824b for instance f8bb8762-7943-4658-b1db-1547a48381bb on n-h2-708768-8 Jul 26 20:33:18.401903 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-1aa337fa-b5fd-4f33-9434-102a1ae21d1d req-90a8aa86-5c2b-4ca5-85e9-3b0e0d82fc9d service nova] Instance f8bb8762-7943-4658-b1db-1547a48381bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:33:18.426893 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-1aa337fa-b5fd-4f33-9434-102a1ae21d1d req-90a8aa86-5c2b-4ca5-85e9-3b0e0d82fc9d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069526 Jul 26 20:33:18.428038 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3286/6647] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:33:18.442764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-92f26571-5c39-4a70-9b80-3694b13892a3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:18.451683 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-92f26571-5c39-4a70-9b80-3694b13892a3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1519 microversion: 2.1 time: 0.189026 Jul 26 20:33:18.452743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3362/6648] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:18 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:19.474566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ff9dfc6c-e2e9-4b99-a582-5731c5410de4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:19.475283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ff9dfc6c-e2e9-4b99-a582-5731c5410de4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:19.481726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff9dfc6c-e2e9-4b99-a582-5731c5410de4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:19.482189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff9dfc6c-e2e9-4b99-a582-5731c5410de4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:19.483013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff9dfc6c-e2e9-4b99-a582-5731c5410de4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:19.483474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff9dfc6c-e2e9-4b99-a582-5731c5410de4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:19.613999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ff9dfc6c-e2e9-4b99-a582-5731c5410de4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:19.621563 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ff9dfc6c-e2e9-4b99-a582-5731c5410de4 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1517 microversion: 2.1 time: 0.152092 Jul 26 20:33:19.622141 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3287/6649] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:19 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:20.448004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9d47f115-ade6-4971-b8ff-0a048cd05ce4 req-0d637b90-ec27-42ca-ad86-8c7441bcfd64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bb8762-7943-4658-b1db-1547a48381bb", "tag": "5c59afe4-5fbf-430c-903e-5318c9cb824b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:20.459003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9d47f115-ade6-4971-b8ff-0a048cd05ce4 req-0d637b90-ec27-42ca-ad86-8c7441bcfd64 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:20.459447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9d47f115-ade6-4971-b8ff-0a048cd05ce4 req-0d637b90-ec27-42ca-ad86-8c7441bcfd64 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:20.471884 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9d47f115-ade6-4971-b8ff-0a048cd05ce4 req-0d637b90-ec27-42ca-ad86-8c7441bcfd64 service nova] Creating event network-changed:5c59afe4-5fbf-430c-903e-5318c9cb824b for instance f8bb8762-7943-4658-b1db-1547a48381bb on n-h2-708768-8 Jul 26 20:33:20.477133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-9d47f115-ade6-4971-b8ff-0a048cd05ce4 req-0d637b90-ec27-42ca-ad86-8c7441bcfd64 service nova] Instance f8bb8762-7943-4658-b1db-1547a48381bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:33:20.488137 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9d47f115-ade6-4971-b8ff-0a048cd05ce4 req-0d637b90-ec27-42ca-ad86-8c7441bcfd64 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043775 Jul 26 20:33:20.488743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3363/6650] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:33:20.643038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d0924b39-258f-44b0-9f06-2d402eee418b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:20.643693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d0924b39-258f-44b0-9f06-2d402eee418b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:20.661960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0924b39-258f-44b0-9f06-2d402eee418b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:20.662642 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0924b39-258f-44b0-9f06-2d402eee418b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:20.663688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0924b39-258f-44b0-9f06-2d402eee418b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:20.664253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d0924b39-258f-44b0-9f06-2d402eee418b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:20.925863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d0924b39-258f-44b0-9f06-2d402eee418b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:20.933956 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d0924b39-258f-44b0-9f06-2d402eee418b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1517 microversion: 2.1 time: 0.295354 Jul 26 20:33:20.934698 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3288/6651] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:20 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1517 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:21.957439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7e1d22f3-7bf2-4eea-a2d0-1fce2aebb1a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:21.958032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7e1d22f3-7bf2-4eea-a2d0-1fce2aebb1a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:21.964276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e1d22f3-7bf2-4eea-a2d0-1fce2aebb1a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:21.964725 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e1d22f3-7bf2-4eea-a2d0-1fce2aebb1a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:21.965486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e1d22f3-7bf2-4eea-a2d0-1fce2aebb1a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:21.965920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7e1d22f3-7bf2-4eea-a2d0-1fce2aebb1a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:22.098487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7e1d22f3-7bf2-4eea-a2d0-1fce2aebb1a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:22.105946 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7e1d22f3-7bf2-4eea-a2d0-1fce2aebb1a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1514 microversion: 2.1 time: 0.153836 Jul 26 20:33:22.106530 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3364/6652] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:21 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:22.127534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-65ee67a0-4acf-458d-8633-6977a31d2f3a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:22.128119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-65ee67a0-4acf-458d-8633-6977a31d2f3a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:22.134992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65ee67a0-4acf-458d-8633-6977a31d2f3a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:22.135458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65ee67a0-4acf-458d-8633-6977a31d2f3a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:22.136308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65ee67a0-4acf-458d-8633-6977a31d2f3a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:22.136769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-65ee67a0-4acf-458d-8633-6977a31d2f3a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:22.194062 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-65ee67a0-4acf-458d-8633-6977a31d2f3a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "POST /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb/action" status: 204 len: 0 microversion: 2.1 time: 0.070849 Jul 26 20:33:22.194894 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3289/6653] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:33:22 2022] POST /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:33:22.204152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b764ebe2-b484-46ec-a210-be8c69f30128 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:22.204769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b764ebe2-b484-46ec-a210-be8c69f30128 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:22.210974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b764ebe2-b484-46ec-a210-be8c69f30128 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:22.211536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b764ebe2-b484-46ec-a210-be8c69f30128 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:22.212556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b764ebe2-b484-46ec-a210-be8c69f30128 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:22.213015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b764ebe2-b484-46ec-a210-be8c69f30128 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:22.431675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b764ebe2-b484-46ec-a210-be8c69f30128 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:22.440416 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b764ebe2-b484-46ec-a210-be8c69f30128 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1514 microversion: 2.1 time: 0.241171 Jul 26 20:33:22.441601 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3365/6654] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:22 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:23.463776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-40d61a43-07ed-4d97-99be-330845110377 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:23.465163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40d61a43-07ed-4d97-99be-330845110377 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:23.474533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40d61a43-07ed-4d97-99be-330845110377 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:23.475002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40d61a43-07ed-4d97-99be-330845110377 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:23.475837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40d61a43-07ed-4d97-99be-330845110377 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:23.476296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40d61a43-07ed-4d97-99be-330845110377 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:23.611374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-40d61a43-07ed-4d97-99be-330845110377 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:23.619040 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-40d61a43-07ed-4d97-99be-330845110377 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1506 microversion: 2.1 time: 0.160723 Jul 26 20:33:23.631631 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3290/6655] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:23 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:23.641895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-198209d9-dafa-48a1-9762-c3ee270dba3b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:23.642531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-198209d9-dafa-48a1-9762-c3ee270dba3b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:23.649583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-198209d9-dafa-48a1-9762-c3ee270dba3b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:23.650038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-198209d9-dafa-48a1-9762-c3ee270dba3b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:23.650811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-198209d9-dafa-48a1-9762-c3ee270dba3b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:23.651247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-198209d9-dafa-48a1-9762-c3ee270dba3b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:23.785826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-198209d9-dafa-48a1-9762-c3ee270dba3b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:23.793421 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-198209d9-dafa-48a1-9762-c3ee270dba3b tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1506 microversion: 2.1 time: 0.156374 Jul 26 20:33:23.794014 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3366/6656] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:23 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:33:23.817980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a41a38d-08ee-4e27-a05d-56e2a77e09ff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Action: 'create', calling method: .version_select at 0x7f875c74b670>, body: {"keypair": {"name": "tempest-keypair-1844410585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARhxrqZZ5cADvfyIwTpgGTs7eqt5guehOF9po8IcG3h4x186G9ev2w/STL420OGlW1/XCbMepVhNL1Ub27SOF2lFN1kkbr/8B87QFTSN3VlrbnUGPEFYQgh93LbSTYCCQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:23.834420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7a41a38d-08ee-4e27-a05d-56e2a77e09ff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Getting quotas for project 9bc2259895a24a41b39ab0edff290b70. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:33:23.839671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-7a41a38d-08ee-4e27-a05d-56e2a77e09ff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Getting quotas for user e75db331ed77478b84e26c244c0fc5f9 and project 9bc2259895a24a41b39ab0edff290b70. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:33:23.868802 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a41a38d-08ee-4e27-a05d-56e2a77e09ff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054822 Jul 26 20:33:23.869419 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3291/6657] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:33:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:33:25.058299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06c86669-a1a6-4df6-a75f-965514d328ce tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:25.059138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06c86669-a1a6-4df6-a75f-965514d328ce tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:25.065948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06c86669-a1a6-4df6-a75f-965514d328ce tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:25.066401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06c86669-a1a6-4df6-a75f-965514d328ce tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:25.067163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06c86669-a1a6-4df6-a75f-965514d328ce tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:25.067599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06c86669-a1a6-4df6-a75f-965514d328ce tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:25.199088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-06c86669-a1a6-4df6-a75f-965514d328ce tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:25.207300 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06c86669-a1a6-4df6-a75f-965514d328ce tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 200 len: 1506 microversion: 2.1 time: 0.152902 Jul 26 20:33:25.207913 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3367/6658] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:25 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:33:25.228409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7eb2fa53-1ce4-4d0e-a4b3-789001d0b773 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:25.228948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7eb2fa53-1ce4-4d0e-a4b3-789001d0b773 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:25.236302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7eb2fa53-1ce4-4d0e-a4b3-789001d0b773 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:25.236775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7eb2fa53-1ce4-4d0e-a4b3-789001d0b773 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:25.237559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7eb2fa53-1ce4-4d0e-a4b3-789001d0b773 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:25.238013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7eb2fa53-1ce4-4d0e-a4b3-789001d0b773 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:25.262550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7eb2fa53-1ce4-4d0e-a4b3-789001d0b773 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:33:25.338315 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7eb2fa53-1ce4-4d0e-a4b3-789001d0b773 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 204 len: 0 microversion: 2.1 time: 0.114404 Jul 26 20:33:25.339052 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3292/6659] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:33:25 2022] DELETE /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:33:25.398315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-658201567", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "2cc40d91-ea97-4588-831d-ec42dc6fb17f"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:25.459259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] validate_networks() for [('2cc40d91-ea97-4588-831d-ec42dc6fb17f', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:33:25.559394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-347b85d3-26c2-4450-a40e-a75eaa69734e req-60a9f218-81cc-4414-b3ee-c0004a6c5d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb8762-7943-4658-b1db-1547a48381bb", "name": "network-vif-plugged", "status": "completed", "tag": "5c59afe4-5fbf-430c-903e-5318c9cb824b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:25.572697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-347b85d3-26c2-4450-a40e-a75eaa69734e req-60a9f218-81cc-4414-b3ee-c0004a6c5d79 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:25.573166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-347b85d3-26c2-4450-a40e-a75eaa69734e req-60a9f218-81cc-4414-b3ee-c0004a6c5d79 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:25.586206 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-347b85d3-26c2-4450-a40e-a75eaa69734e req-60a9f218-81cc-4414-b3ee-c0004a6c5d79 service nova] Creating event network-vif-plugged:5c59afe4-5fbf-430c-903e-5318c9cb824b for instance f8bb8762-7943-4658-b1db-1547a48381bb on n-h2-708768-8 Jul 26 20:33:25.591837 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-347b85d3-26c2-4450-a40e-a75eaa69734e req-60a9f218-81cc-4414-b3ee-c0004a6c5d79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037274 Jul 26 20:33:25.592608 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3293/6660] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:33:25.836736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:33:25.837166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:33:25.837656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:33:25.838071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:33:25.838516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:33:25.847452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:25.847945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:25.848758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:25.849204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:25.866441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Getting quotas for project 9bc2259895a24a41b39ab0edff290b70. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:33:25.871759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Getting quotas for user e75db331ed77478b84e26c244c0fc5f9 and project 9bc2259895a24a41b39ab0edff290b70. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:33:25.884670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:33:25.886929 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:33:25.938964 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-17e45b86-4bab-48bf-bc3a-fcf3c785842a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544592 Jul 26 20:33:25.939625 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3368/6661] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:33:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:33:25.950880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-469eaee1-d045-444d-953c-9e3a0e9cc4f6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:25.951587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-469eaee1-d045-444d-953c-9e3a0e9cc4f6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:26.012004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-469eaee1-d045-444d-953c-9e3a0e9cc4f6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:26.019089 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-469eaee1-d045-444d-953c-9e3a0e9cc4f6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1217 microversion: 2.1 time: 0.072290 Jul 26 20:33:26.019676 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3294/6662] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:25 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:27.040487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1b39ebda-8e57-45a0-82f3-ef8f296073a1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:27.041758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1b39ebda-8e57-45a0-82f3-ef8f296073a1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:27.051186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b39ebda-8e57-45a0-82f3-ef8f296073a1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:27.051948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b39ebda-8e57-45a0-82f3-ef8f296073a1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:27.052953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b39ebda-8e57-45a0-82f3-ef8f296073a1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:27.053646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1b39ebda-8e57-45a0-82f3-ef8f296073a1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:27.140504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1b39ebda-8e57-45a0-82f3-ef8f296073a1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:27.148933 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1b39ebda-8e57-45a0-82f3-ef8f296073a1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1277 microversion: 2.1 time: 0.113285 Jul 26 20:33:27.150760 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3369/6663] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:27 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:27.385473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3c2292ed-757a-4849-a319-42bbafc1e33b req-b780185c-cd82-4d17-b896-e233daa632ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bb8762-7943-4658-b1db-1547a48381bb", "name": "network-vif-deleted", "tag": "5c59afe4-5fbf-430c-903e-5318c9cb824b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:27.403525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3c2292ed-757a-4849-a319-42bbafc1e33b req-b780185c-cd82-4d17-b896-e233daa632ec service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:27.404831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3c2292ed-757a-4849-a319-42bbafc1e33b req-b780185c-cd82-4d17-b896-e233daa632ec service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:27.421059 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3c2292ed-757a-4849-a319-42bbafc1e33b req-b780185c-cd82-4d17-b896-e233daa632ec service nova] Creating event network-vif-deleted:5c59afe4-5fbf-430c-903e-5318c9cb824b for instance f8bb8762-7943-4658-b1db-1547a48381bb on n-h2-708768-8 Jul 26 20:33:27.427576 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3c2292ed-757a-4849-a319-42bbafc1e33b req-b780185c-cd82-4d17-b896-e233daa632ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048979 Jul 26 20:33:27.428456 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3295/6664] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:33:28.171253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d760e4fe-4622-42de-adc9-f80018e7a8b6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:28.171857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d760e4fe-4622-42de-adc9-f80018e7a8b6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:28.178519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d760e4fe-4622-42de-adc9-f80018e7a8b6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:28.178968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d760e4fe-4622-42de-adc9-f80018e7a8b6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:28.180071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d760e4fe-4622-42de-adc9-f80018e7a8b6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:28.180183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d760e4fe-4622-42de-adc9-f80018e7a8b6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:28.408824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d760e4fe-4622-42de-adc9-f80018e7a8b6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:28.417341 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d760e4fe-4622-42de-adc9-f80018e7a8b6 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1317 microversion: 2.1 time: 0.250801 Jul 26 20:33:28.417948 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3370/6665] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:28 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:28.566037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-52e73022-6e5d-4116-99eb-ae0c0b492429 req-815e8893-e4a6-4428-90af-4f85b00108ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdec11f8-6530-4780-adf6-b3c79b9ab7af", "tag": "eb52260c-fc7d-4834-8d91-883809cd4c00"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:28.590188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-52e73022-6e5d-4116-99eb-ae0c0b492429 req-815e8893-e4a6-4428-90af-4f85b00108ea service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:28.590650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-52e73022-6e5d-4116-99eb-ae0c0b492429 req-815e8893-e4a6-4428-90af-4f85b00108ea service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:28.603814 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-52e73022-6e5d-4116-99eb-ae0c0b492429 req-815e8893-e4a6-4428-90af-4f85b00108ea service nova] Creating event network-changed:eb52260c-fc7d-4834-8d91-883809cd4c00 for instance bdec11f8-6530-4780-adf6-b3c79b9ab7af on n-h2-708768-8 Jul 26 20:33:28.611504 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-52e73022-6e5d-4116-99eb-ae0c0b492429 req-815e8893-e4a6-4428-90af-4f85b00108ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052922 Jul 26 20:33:28.612280 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3296/6666] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:33:29.439786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8c38f337-0d5c-4280-a845-969f94113922 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:29.440419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8c38f337-0d5c-4280-a845-969f94113922 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:29.447381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c38f337-0d5c-4280-a845-969f94113922 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:29.447885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c38f337-0d5c-4280-a845-969f94113922 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:29.448664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c38f337-0d5c-4280-a845-969f94113922 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:29.449111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8c38f337-0d5c-4280-a845-969f94113922 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:29.579475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8c38f337-0d5c-4280-a845-969f94113922 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:29.586974 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8c38f337-0d5c-4280-a845-969f94113922 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1317 microversion: 2.1 time: 0.151171 Jul 26 20:33:29.587547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3371/6667] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:29 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:30.610589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1dec028e-e4d6-4c05-a5e9-4deb54e6aac0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:30.611289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1dec028e-e4d6-4c05-a5e9-4deb54e6aac0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:30.617533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dec028e-e4d6-4c05-a5e9-4deb54e6aac0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:30.617990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dec028e-e4d6-4c05-a5e9-4deb54e6aac0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:30.618757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dec028e-e4d6-4c05-a5e9-4deb54e6aac0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:30.619202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1dec028e-e4d6-4c05-a5e9-4deb54e6aac0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:30.751914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1dec028e-e4d6-4c05-a5e9-4deb54e6aac0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:30.759448 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1dec028e-e4d6-4c05-a5e9-4deb54e6aac0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1317 microversion: 2.1 time: 0.154572 Jul 26 20:33:30.760054 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3297/6668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:30 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:31.780487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3000dc4c-1835-48d8-8313-0160eaa99e5f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:31.781110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3000dc4c-1835-48d8-8313-0160eaa99e5f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:31.788248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3000dc4c-1835-48d8-8313-0160eaa99e5f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:31.788705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3000dc4c-1835-48d8-8313-0160eaa99e5f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:31.789484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3000dc4c-1835-48d8-8313-0160eaa99e5f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:31.789923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3000dc4c-1835-48d8-8313-0160eaa99e5f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:32.004623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3000dc4c-1835-48d8-8313-0160eaa99e5f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:32.013308 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3000dc4c-1835-48d8-8313-0160eaa99e5f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1317 microversion: 2.1 time: 0.236817 Jul 26 20:33:32.013907 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3372/6669] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:31 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:33.034125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-227ba7c5-92ed-4760-8f96-5bc3146c9149 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:33.034754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-227ba7c5-92ed-4760-8f96-5bc3146c9149 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:33.041777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-227ba7c5-92ed-4760-8f96-5bc3146c9149 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:33.042241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-227ba7c5-92ed-4760-8f96-5bc3146c9149 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:33.043018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-227ba7c5-92ed-4760-8f96-5bc3146c9149 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:33.043469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-227ba7c5-92ed-4760-8f96-5bc3146c9149 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:33.230040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-227ba7c5-92ed-4760-8f96-5bc3146c9149 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:33.232622 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:33.239493 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-227ba7c5-92ed-4760-8f96-5bc3146c9149 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1317 microversion: 2.1 time: 0.209417 Jul 26 20:33:33.240027 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3298/6670] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:33 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:33.592770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-63f3bb80-5781-4e91-871d-f7ae084e2f7e req-185f06d5-46b4-4334-ad81-5b88ae94206b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdec11f8-6530-4780-adf6-b3c79b9ab7af", "name": "network-vif-plugged", "status": "completed", "tag": "eb52260c-fc7d-4834-8d91-883809cd4c00"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:33.603604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-63f3bb80-5781-4e91-871d-f7ae084e2f7e req-185f06d5-46b4-4334-ad81-5b88ae94206b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:33.604652 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-63f3bb80-5781-4e91-871d-f7ae084e2f7e req-185f06d5-46b4-4334-ad81-5b88ae94206b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:33.617069 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-63f3bb80-5781-4e91-871d-f7ae084e2f7e req-185f06d5-46b4-4334-ad81-5b88ae94206b service nova] Creating event network-vif-plugged:eb52260c-fc7d-4834-8d91-883809cd4c00 for instance bdec11f8-6530-4780-adf6-b3c79b9ab7af on n-h2-708768-8 Jul 26 20:33:33.622146 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-63f3bb80-5781-4e91-871d-f7ae084e2f7e req-185f06d5-46b4-4334-ad81-5b88ae94206b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Jul 26 20:33:33.622798 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3373/6671] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:33:34.260400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf5b5a14-d2c1-4566-85d2-42f100c1d111 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:34.261024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf5b5a14-d2c1-4566-85d2-42f100c1d111 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:34.269637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf5b5a14-d2c1-4566-85d2-42f100c1d111 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:34.270101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf5b5a14-d2c1-4566-85d2-42f100c1d111 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:34.270877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf5b5a14-d2c1-4566-85d2-42f100c1d111 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:34.271328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf5b5a14-d2c1-4566-85d2-42f100c1d111 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:34.398110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cf5b5a14-d2c1-4566-85d2-42f100c1d111 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:34.405576 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf5b5a14-d2c1-4566-85d2-42f100c1d111 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1317 microversion: 2.1 time: 0.149096 Jul 26 20:33:34.406150 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3299/6672] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:34 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:35.428049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-df67352e-06db-450b-8368-5a85a59b8f6f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:35.428673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-df67352e-06db-450b-8368-5a85a59b8f6f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:35.434925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df67352e-06db-450b-8368-5a85a59b8f6f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:35.435377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df67352e-06db-450b-8368-5a85a59b8f6f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:35.436290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df67352e-06db-450b-8368-5a85a59b8f6f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:35.436755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-df67352e-06db-450b-8368-5a85a59b8f6f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:35.574921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-df67352e-06db-450b-8368-5a85a59b8f6f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:35.583209 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-df67352e-06db-450b-8368-5a85a59b8f6f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1506 microversion: 2.1 time: 0.160680 Jul 26 20:33:35.583857 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3374/6673] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:35 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:35.604930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8be72763-2c7b-4c17-91b5-5963c5547453 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:35.605563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8be72763-2c7b-4c17-91b5-5963c5547453 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:35.612832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8be72763-2c7b-4c17-91b5-5963c5547453 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:35.613374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8be72763-2c7b-4c17-91b5-5963c5547453 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:35.614165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8be72763-2c7b-4c17-91b5-5963c5547453 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:35.614627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8be72763-2c7b-4c17-91b5-5963c5547453 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:35.749024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8be72763-2c7b-4c17-91b5-5963c5547453 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:35.756612 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8be72763-2c7b-4c17-91b5-5963c5547453 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1506 microversion: 2.1 time: 0.155659 Jul 26 20:33:35.757182 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3300/6674] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:35 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:35.777122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:33:35.780227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:35.786370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:35.786828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:35.787603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:35.788070 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:35.816523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:35.822346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Old instance type m1.heat2, new instance type m1.heat {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:33:35.829181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:33:35.829708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:33:35.830193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:33:35.830609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:33:35.831025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:33:35.856873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:35.880621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:35.897632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cb0777e-0467-4506-a97e-902e427743de tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "POST /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af/action" status: 202 len: 0 microversion: 2.1 time: 0.123742 Jul 26 20:33:35.898406 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3375/6675] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:33:35 2022] POST /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:33:35.906483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ef286263-7b12-4452-89ea-82740bf5a970 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:35.907462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ef286263-7b12-4452-89ea-82740bf5a970 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:35.914275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef286263-7b12-4452-89ea-82740bf5a970 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:35.914841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef286263-7b12-4452-89ea-82740bf5a970 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:35.915739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef286263-7b12-4452-89ea-82740bf5a970 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:35.916268 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef286263-7b12-4452-89ea-82740bf5a970 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:36.016249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:36.088721 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ef286263-7b12-4452-89ea-82740bf5a970 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:36.096851 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ef286263-7b12-4452-89ea-82740bf5a970 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1513 microversion: 2.1 time: 0.194438 Jul 26 20:33:36.097451 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3301/6676] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:35 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:37.118684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a267bc0e-09f2-4c68-a137-91ca8cdf38a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:37.120093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a267bc0e-09f2-4c68-a137-91ca8cdf38a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:37.127965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a267bc0e-09f2-4c68-a137-91ca8cdf38a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:37.128642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a267bc0e-09f2-4c68-a137-91ca8cdf38a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:37.129723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a267bc0e-09f2-4c68-a137-91ca8cdf38a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:37.130171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a267bc0e-09f2-4c68-a137-91ca8cdf38a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:37.638118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a267bc0e-09f2-4c68-a137-91ca8cdf38a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:37.646462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a267bc0e-09f2-4c68-a137-91ca8cdf38a8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1513 microversion: 2.1 time: 0.532768 Jul 26 20:33:37.647084 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3376/6677] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:37 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1513 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:38.667434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0f96623-5268-4395-bc3d-d64fbc769dc0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:38.668072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0f96623-5268-4395-bc3d-d64fbc769dc0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:38.676056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0f96623-5268-4395-bc3d-d64fbc769dc0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:38.676512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0f96623-5268-4395-bc3d-d64fbc769dc0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:38.677282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0f96623-5268-4395-bc3d-d64fbc769dc0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:38.677731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0f96623-5268-4395-bc3d-d64fbc769dc0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:38.810371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b0f96623-5268-4395-bc3d-d64fbc769dc0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:38.817874 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0f96623-5268-4395-bc3d-d64fbc769dc0 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.154347 Jul 26 20:33:38.818448 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3302/6678] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:38 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:39.839512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0a8bd72-375a-4791-9a00-775f5f0dc54f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:39.840117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0a8bd72-375a-4791-9a00-775f5f0dc54f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:39.847166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a8bd72-375a-4791-9a00-775f5f0dc54f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:39.847635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a8bd72-375a-4791-9a00-775f5f0dc54f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:39.848424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a8bd72-375a-4791-9a00-775f5f0dc54f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:39.848864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0a8bd72-375a-4791-9a00-775f5f0dc54f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:39.978594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0a8bd72-375a-4791-9a00-775f5f0dc54f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:39.986650 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0a8bd72-375a-4791-9a00-775f5f0dc54f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.151178 Jul 26 20:33:39.987226 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3377/6679] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:39 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:41.008285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d3f150c0-c0dd-4905-9247-1ee1b4a04623 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:41.008846 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d3f150c0-c0dd-4905-9247-1ee1b4a04623 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:41.016433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3f150c0-c0dd-4905-9247-1ee1b4a04623 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:41.016906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3f150c0-c0dd-4905-9247-1ee1b4a04623 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:41.017713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3f150c0-c0dd-4905-9247-1ee1b4a04623 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:41.018175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d3f150c0-c0dd-4905-9247-1ee1b4a04623 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:41.151150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d3f150c0-c0dd-4905-9247-1ee1b4a04623 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:41.158774 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d3f150c0-c0dd-4905-9247-1ee1b4a04623 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.154470 Jul 26 20:33:41.159352 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3303/6680] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:41 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:42.179808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9da37995-3c2d-42e0-b36c-16ebed9ab039 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:42.180418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9da37995-3c2d-42e0-b36c-16ebed9ab039 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:42.188224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9da37995-3c2d-42e0-b36c-16ebed9ab039 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:42.188676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9da37995-3c2d-42e0-b36c-16ebed9ab039 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:42.189437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9da37995-3c2d-42e0-b36c-16ebed9ab039 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:42.189872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9da37995-3c2d-42e0-b36c-16ebed9ab039 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:42.320921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9da37995-3c2d-42e0-b36c-16ebed9ab039 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:42.328857 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9da37995-3c2d-42e0-b36c-16ebed9ab039 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.152943 Jul 26 20:33:42.329429 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3378/6681] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:42 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:43.349579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f652b63b-8a3b-43e8-967a-9cc84c99fe21 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:43.350135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f652b63b-8a3b-43e8-967a-9cc84c99fe21 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:43.357173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f652b63b-8a3b-43e8-967a-9cc84c99fe21 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:43.357636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f652b63b-8a3b-43e8-967a-9cc84c99fe21 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:43.358566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f652b63b-8a3b-43e8-967a-9cc84c99fe21 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:43.359018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f652b63b-8a3b-43e8-967a-9cc84c99fe21 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:43.487204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f652b63b-8a3b-43e8-967a-9cc84c99fe21 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:43.494805 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f652b63b-8a3b-43e8-967a-9cc84c99fe21 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.149214 Jul 26 20:33:43.495381 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3304/6682] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:43 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:44.516492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f0fcf1e5-a7ed-48ae-9fcb-e7f9aeb626f8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:44.517107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f0fcf1e5-a7ed-48ae-9fcb-e7f9aeb626f8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:44.524090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0fcf1e5-a7ed-48ae-9fcb-e7f9aeb626f8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:44.524536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0fcf1e5-a7ed-48ae-9fcb-e7f9aeb626f8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:44.525297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0fcf1e5-a7ed-48ae-9fcb-e7f9aeb626f8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:44.525731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f0fcf1e5-a7ed-48ae-9fcb-e7f9aeb626f8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:44.528300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:44.657533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f0fcf1e5-a7ed-48ae-9fcb-e7f9aeb626f8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:44.665066 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f0fcf1e5-a7ed-48ae-9fcb-e7f9aeb626f8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.152810 Jul 26 20:33:44.665646 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3379/6683] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:44 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:45.686811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-39a7a2bb-6b1e-4551-9e01-22f7157669cf tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:45.687431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-39a7a2bb-6b1e-4551-9e01-22f7157669cf tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:45.694403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39a7a2bb-6b1e-4551-9e01-22f7157669cf tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:45.694864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39a7a2bb-6b1e-4551-9e01-22f7157669cf tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:45.695656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39a7a2bb-6b1e-4551-9e01-22f7157669cf tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:45.696108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39a7a2bb-6b1e-4551-9e01-22f7157669cf tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:45.822706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-39a7a2bb-6b1e-4551-9e01-22f7157669cf tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:45.831308 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-39a7a2bb-6b1e-4551-9e01-22f7157669cf tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.148873 Jul 26 20:33:45.831908 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3305/6684] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:45 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:46.853140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f918906b-60f3-4642-8c54-cf5c99a66e36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:46.853763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f918906b-60f3-4642-8c54-cf5c99a66e36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:46.861154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f918906b-60f3-4642-8c54-cf5c99a66e36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:46.861607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f918906b-60f3-4642-8c54-cf5c99a66e36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:46.862383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f918906b-60f3-4642-8c54-cf5c99a66e36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:46.862826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f918906b-60f3-4642-8c54-cf5c99a66e36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:46.994039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f918906b-60f3-4642-8c54-cf5c99a66e36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:47.002192 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f918906b-60f3-4642-8c54-cf5c99a66e36 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.153033 Jul 26 20:33:47.002763 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3380/6685] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:46 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:48.024262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-70f38d15-b48e-4ca3-b181-5bbaf3ff6eff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:48.024895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-70f38d15-b48e-4ca3-b181-5bbaf3ff6eff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:48.027684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:48.033374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-70f38d15-b48e-4ca3-b181-5bbaf3ff6eff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:48.033842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-70f38d15-b48e-4ca3-b181-5bbaf3ff6eff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:48.034634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-70f38d15-b48e-4ca3-b181-5bbaf3ff6eff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:48.035086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-70f38d15-b48e-4ca3-b181-5bbaf3ff6eff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:48.170066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-70f38d15-b48e-4ca3-b181-5bbaf3ff6eff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:48.178396 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-70f38d15-b48e-4ca3-b181-5bbaf3ff6eff tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.158125 Jul 26 20:33:48.178974 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3306/6686] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:48 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:49.200477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a115c17-2140-4d06-ab7f-1f8f2ac63f80 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:49.201131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a115c17-2140-4d06-ab7f-1f8f2ac63f80 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:49.204349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:33:49.210761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a115c17-2140-4d06-ab7f-1f8f2ac63f80 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:49.211215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a115c17-2140-4d06-ab7f-1f8f2ac63f80 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:49.212016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a115c17-2140-4d06-ab7f-1f8f2ac63f80 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:49.212467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a115c17-2140-4d06-ab7f-1f8f2ac63f80 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:49.345565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9a115c17-2140-4d06-ab7f-1f8f2ac63f80 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:49.354072 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a115c17-2140-4d06-ab7f-1f8f2ac63f80 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.157740 Jul 26 20:33:49.354659 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3381/6687] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:49 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:50.376466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-037d1b4b-2fe5-4f57-ba2a-a0171f06215a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:50.377010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-037d1b4b-2fe5-4f57-ba2a-a0171f06215a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:50.384032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-037d1b4b-2fe5-4f57-ba2a-a0171f06215a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:50.384493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-037d1b4b-2fe5-4f57-ba2a-a0171f06215a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:50.385271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-037d1b4b-2fe5-4f57-ba2a-a0171f06215a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:50.385713 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-037d1b4b-2fe5-4f57-ba2a-a0171f06215a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:50.517097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-037d1b4b-2fe5-4f57-ba2a-a0171f06215a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:50.524757 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-037d1b4b-2fe5-4f57-ba2a-a0171f06215a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.152843 Jul 26 20:33:50.525350 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3307/6688] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:50 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:51.546659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-158ec378-b63a-419d-9d3c-6fbe8831fbf5 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:51.547281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-158ec378-b63a-419d-9d3c-6fbe8831fbf5 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:51.554579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-158ec378-b63a-419d-9d3c-6fbe8831fbf5 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:51.555036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-158ec378-b63a-419d-9d3c-6fbe8831fbf5 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:51.555855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-158ec378-b63a-419d-9d3c-6fbe8831fbf5 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:51.556297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-158ec378-b63a-419d-9d3c-6fbe8831fbf5 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:51.686044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-158ec378-b63a-419d-9d3c-6fbe8831fbf5 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:51.693717 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-158ec378-b63a-419d-9d3c-6fbe8831fbf5 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.151623 Jul 26 20:33:51.694303 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3382/6689] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:51 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:52.715650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0f31cc24-bf54-4a0e-a650-53ab36f1159c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:52.716348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0f31cc24-bf54-4a0e-a650-53ab36f1159c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:52.723247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f31cc24-bf54-4a0e-a650-53ab36f1159c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:52.723747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f31cc24-bf54-4a0e-a650-53ab36f1159c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:52.724548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f31cc24-bf54-4a0e-a650-53ab36f1159c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:52.724973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0f31cc24-bf54-4a0e-a650-53ab36f1159c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:52.855952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0f31cc24-bf54-4a0e-a650-53ab36f1159c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:52.867942 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0f31cc24-bf54-4a0e-a650-53ab36f1159c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.156252 Jul 26 20:33:52.868523 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3308/6690] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:52 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:53.889632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a20570a5-f748-4fa5-82e8-b695705f8466 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:53.890237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a20570a5-f748-4fa5-82e8-b695705f8466 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:53.897238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a20570a5-f748-4fa5-82e8-b695705f8466 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:53.897692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a20570a5-f748-4fa5-82e8-b695705f8466 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:53.898486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a20570a5-f748-4fa5-82e8-b695705f8466 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:53.898924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a20570a5-f748-4fa5-82e8-b695705f8466 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:54.035909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a20570a5-f748-4fa5-82e8-b695705f8466 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:54.043599 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a20570a5-f748-4fa5-82e8-b695705f8466 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.157917 Jul 26 20:33:54.044210 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3383/6691] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:53 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:55.065882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-27761f46-3d57-4add-85c5-d2a9d4b1bbb8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:55.066505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-27761f46-3d57-4add-85c5-d2a9d4b1bbb8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:55.073472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27761f46-3d57-4add-85c5-d2a9d4b1bbb8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:55.073931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27761f46-3d57-4add-85c5-d2a9d4b1bbb8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:55.074704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27761f46-3d57-4add-85c5-d2a9d4b1bbb8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:55.075151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27761f46-3d57-4add-85c5-d2a9d4b1bbb8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:55.207264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-27761f46-3d57-4add-85c5-d2a9d4b1bbb8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:55.214943 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-27761f46-3d57-4add-85c5-d2a9d4b1bbb8 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.152970 Jul 26 20:33:55.215524 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3309/6692] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:55 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:56.237616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b52f011c-95c9-4a7e-9187-d63ff2156f5a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:56.238240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b52f011c-95c9-4a7e-9187-d63ff2156f5a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:56.244978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b52f011c-95c9-4a7e-9187-d63ff2156f5a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:56.245435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b52f011c-95c9-4a7e-9187-d63ff2156f5a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:56.246201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b52f011c-95c9-4a7e-9187-d63ff2156f5a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:56.246641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b52f011c-95c9-4a7e-9187-d63ff2156f5a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:56.376497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b52f011c-95c9-4a7e-9187-d63ff2156f5a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:56.384310 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b52f011c-95c9-4a7e-9187-d63ff2156f5a tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.150618 Jul 26 20:33:56.384891 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3384/6693] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:56 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:57.406792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22e8e40a-a3e6-435d-8dfa-e4d3574e1cfc tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:57.407375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-22e8e40a-a3e6-435d-8dfa-e4d3574e1cfc tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:57.414253 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e8e40a-a3e6-435d-8dfa-e4d3574e1cfc tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:57.414710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e8e40a-a3e6-435d-8dfa-e4d3574e1cfc tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:57.415478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e8e40a-a3e6-435d-8dfa-e4d3574e1cfc tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:57.415943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22e8e40a-a3e6-435d-8dfa-e4d3574e1cfc tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:57.550720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22e8e40a-a3e6-435d-8dfa-e4d3574e1cfc tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:57.558186 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22e8e40a-a3e6-435d-8dfa-e4d3574e1cfc tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.156037 Jul 26 20:33:57.558754 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3310/6694] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:57 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:58.580351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3531436c-9ba2-4010-811a-1c28452fb95f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:58.580982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3531436c-9ba2-4010-811a-1c28452fb95f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:58.587690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3531436c-9ba2-4010-811a-1c28452fb95f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:58.589016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3531436c-9ba2-4010-811a-1c28452fb95f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:58.590146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3531436c-9ba2-4010-811a-1c28452fb95f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:58.590593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3531436c-9ba2-4010-811a-1c28452fb95f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:58.728797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3531436c-9ba2-4010-811a-1c28452fb95f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:58.736849 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3531436c-9ba2-4010-811a-1c28452fb95f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.160682 Jul 26 20:33:58.737426 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3385/6695] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:58 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:33:59.758513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dbf349bb-7f41-485b-a406-2307e2798798 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:33:59.759141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dbf349bb-7f41-485b-a406-2307e2798798 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:33:59.766050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbf349bb-7f41-485b-a406-2307e2798798 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:59.766493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbf349bb-7f41-485b-a406-2307e2798798 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:59.767270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbf349bb-7f41-485b-a406-2307e2798798 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:33:59.767749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dbf349bb-7f41-485b-a406-2307e2798798 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:33:59.894862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dbf349bb-7f41-485b-a406-2307e2798798 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:33:59.902460 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dbf349bb-7f41-485b-a406-2307e2798798 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.148038 Jul 26 20:33:59.903037 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3311/6696] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:33:59 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:00.924937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9938b52b-cc02-498e-af57-ef989c3d78ae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:00.925554 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9938b52b-cc02-498e-af57-ef989c3d78ae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:00.931668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9938b52b-cc02-498e-af57-ef989c3d78ae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:00.932121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9938b52b-cc02-498e-af57-ef989c3d78ae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:00.932884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9938b52b-cc02-498e-af57-ef989c3d78ae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:00.933320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9938b52b-cc02-498e-af57-ef989c3d78ae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:01.064152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9938b52b-cc02-498e-af57-ef989c3d78ae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:01.071487 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9938b52b-cc02-498e-af57-ef989c3d78ae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.151707 Jul 26 20:34:01.072094 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3386/6697] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:00 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:02.094483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-134d28e5-4ec4-4668-8fe4-84c083adccac tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:02.095115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-134d28e5-4ec4-4668-8fe4-84c083adccac tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:02.102196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-134d28e5-4ec4-4668-8fe4-84c083adccac tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:02.102660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-134d28e5-4ec4-4668-8fe4-84c083adccac tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:02.103442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-134d28e5-4ec4-4668-8fe4-84c083adccac tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:02.103930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-134d28e5-4ec4-4668-8fe4-84c083adccac tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:02.234324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-134d28e5-4ec4-4668-8fe4-84c083adccac tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:02.241948 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-134d28e5-4ec4-4668-8fe4-84c083adccac tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.152427 Jul 26 20:34:02.242523 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3312/6698] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:02 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:03.262304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6ae26ec6-5715-46b4-bd92-a57371f9f65f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:03.262927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6ae26ec6-5715-46b4-bd92-a57371f9f65f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:03.270583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ae26ec6-5715-46b4-bd92-a57371f9f65f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:03.271031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ae26ec6-5715-46b4-bd92-a57371f9f65f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:03.271841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ae26ec6-5715-46b4-bd92-a57371f9f65f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:03.272280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6ae26ec6-5715-46b4-bd92-a57371f9f65f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:03.400287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6ae26ec6-5715-46b4-bd92-a57371f9f65f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:03.408644 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6ae26ec6-5715-46b4-bd92-a57371f9f65f tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.150288 Jul 26 20:34:03.409230 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3387/6699] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:03 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:04.430416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c90640f8-a87c-4d7d-ace0-dc4b57abddb3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:04.430992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c90640f8-a87c-4d7d-ace0-dc4b57abddb3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:04.438631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c90640f8-a87c-4d7d-ace0-dc4b57abddb3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:04.439100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c90640f8-a87c-4d7d-ace0-dc4b57abddb3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:04.439913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c90640f8-a87c-4d7d-ace0-dc4b57abddb3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:04.440374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c90640f8-a87c-4d7d-ace0-dc4b57abddb3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:04.444417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=86 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:04.577687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c90640f8-a87c-4d7d-ace0-dc4b57abddb3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:04.585186 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c90640f8-a87c-4d7d-ace0-dc4b57abddb3 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1518 microversion: 2.1 time: 0.158799 Jul 26 20:34:04.585770 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3313/6700] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:04 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:05.406299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-0659da96-29f9-4087-8272-ea993c823e0d req-e13e3149-6de0-4db4-a72d-a54b3b31437a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdec11f8-6530-4780-adf6-b3c79b9ab7af", "name": "network-vif-unplugged", "status": "completed", "tag": "eb52260c-fc7d-4834-8d91-883809cd4c00"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:05.417822 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0659da96-29f9-4087-8272-ea993c823e0d req-e13e3149-6de0-4db4-a72d-a54b3b31437a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:05.418284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-0659da96-29f9-4087-8272-ea993c823e0d req-e13e3149-6de0-4db4-a72d-a54b3b31437a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:05.431778 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-0659da96-29f9-4087-8272-ea993c823e0d req-e13e3149-6de0-4db4-a72d-a54b3b31437a service nova] Creating event network-vif-unplugged:eb52260c-fc7d-4834-8d91-883809cd4c00 for instance bdec11f8-6530-4780-adf6-b3c79b9ab7af on n-h1-708768-8 Jul 26 20:34:05.438092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-0659da96-29f9-4087-8272-ea993c823e0d req-e13e3149-6de0-4db4-a72d-a54b3b31437a service nova] Instance bdec11f8-6530-4780-adf6-b3c79b9ab7af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:34:05.450338 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-0659da96-29f9-4087-8272-ea993c823e0d req-e13e3149-6de0-4db4-a72d-a54b3b31437a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047981 Jul 26 20:34:05.451487 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3388/6701] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:34:05.606694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-246216d3-46b5-4c54-9783-3dd8d17bb399 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:05.608672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-246216d3-46b5-4c54-9783-3dd8d17bb399 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:05.616662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-246216d3-46b5-4c54-9783-3dd8d17bb399 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:05.617407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-246216d3-46b5-4c54-9783-3dd8d17bb399 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:05.618446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-246216d3-46b5-4c54-9783-3dd8d17bb399 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:05.618970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-246216d3-46b5-4c54-9783-3dd8d17bb399 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:05.793855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-246216d3-46b5-4c54-9783-3dd8d17bb399 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:05.803292 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-246216d3-46b5-4c54-9783-3dd8d17bb399 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1517 microversion: 2.1 time: 0.200541 Jul 26 20:34:05.818412 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3314/6702] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:05 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:06.828324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eaeca726-6d93-4cb7-b5ca-62ff7baadebe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:06.829067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eaeca726-6d93-4cb7-b5ca-62ff7baadebe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:06.835358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eaeca726-6d93-4cb7-b5ca-62ff7baadebe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:06.835857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eaeca726-6d93-4cb7-b5ca-62ff7baadebe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:06.836629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eaeca726-6d93-4cb7-b5ca-62ff7baadebe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:06.837074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eaeca726-6d93-4cb7-b5ca-62ff7baadebe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:06.972142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eaeca726-6d93-4cb7-b5ca-62ff7baadebe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:06.979695 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eaeca726-6d93-4cb7-b5ca-62ff7baadebe tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1515 microversion: 2.1 time: 0.157228 Jul 26 20:34:06.980271 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3389/6703] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:06 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:07.468503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5cba31c9-f981-4100-b05f-6eb74718ce19 req-60aa3fbb-48a3-4854-82aa-d2d46746cd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdec11f8-6530-4780-adf6-b3c79b9ab7af", "tag": "eb52260c-fc7d-4834-8d91-883809cd4c00"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:07.478366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cba31c9-f981-4100-b05f-6eb74718ce19 req-60aa3fbb-48a3-4854-82aa-d2d46746cd29 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:07.478815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cba31c9-f981-4100-b05f-6eb74718ce19 req-60aa3fbb-48a3-4854-82aa-d2d46746cd29 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:07.491045 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5cba31c9-f981-4100-b05f-6eb74718ce19 req-60aa3fbb-48a3-4854-82aa-d2d46746cd29 service nova] Creating event network-changed:eb52260c-fc7d-4834-8d91-883809cd4c00 for instance bdec11f8-6530-4780-adf6-b3c79b9ab7af on n-h1-708768-8 Jul 26 20:34:07.496257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-5cba31c9-f981-4100-b05f-6eb74718ce19 req-60aa3fbb-48a3-4854-82aa-d2d46746cd29 service nova] Instance bdec11f8-6530-4780-adf6-b3c79b9ab7af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:34:07.507569 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5cba31c9-f981-4100-b05f-6eb74718ce19 req-60aa3fbb-48a3-4854-82aa-d2d46746cd29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043783 Jul 26 20:34:07.508295 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3315/6704] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:34:08.003073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c77d0629-e776-47b1-a92d-9e53f55f43cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:08.003808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c77d0629-e776-47b1-a92d-9e53f55f43cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:08.010454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c77d0629-e776-47b1-a92d-9e53f55f43cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:08.010986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c77d0629-e776-47b1-a92d-9e53f55f43cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:08.011890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c77d0629-e776-47b1-a92d-9e53f55f43cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:08.012417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c77d0629-e776-47b1-a92d-9e53f55f43cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:08.317438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c77d0629-e776-47b1-a92d-9e53f55f43cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:08.325185 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c77d0629-e776-47b1-a92d-9e53f55f43cd tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1512 microversion: 2.1 time: 0.327413 Jul 26 20:34:08.326522 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3390/6705] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:07 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:08.347792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-89c8a2e2-82de-452f-9e7a-b90c81adabae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:08.348855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-89c8a2e2-82de-452f-9e7a-b90c81adabae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:08.355363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89c8a2e2-82de-452f-9e7a-b90c81adabae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:08.355845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89c8a2e2-82de-452f-9e7a-b90c81adabae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:08.356625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89c8a2e2-82de-452f-9e7a-b90c81adabae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:08.357735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89c8a2e2-82de-452f-9e7a-b90c81adabae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:08.417793 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-89c8a2e2-82de-452f-9e7a-b90c81adabae tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "POST /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af/action" status: 204 len: 0 microversion: 2.1 time: 0.074105 Jul 26 20:34:08.418372 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3316/6706] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:34:08 2022] POST /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:34:08.427560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd53e1e4-5b2e-43d9-8d08-bf615ef6cf15 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:08.428269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd53e1e4-5b2e-43d9-8d08-bf615ef6cf15 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:08.436102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd53e1e4-5b2e-43d9-8d08-bf615ef6cf15 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:08.436610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd53e1e4-5b2e-43d9-8d08-bf615ef6cf15 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:08.437390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd53e1e4-5b2e-43d9-8d08-bf615ef6cf15 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:08.438010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd53e1e4-5b2e-43d9-8d08-bf615ef6cf15 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:08.651447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd53e1e4-5b2e-43d9-8d08-bf615ef6cf15 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:08.659632 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd53e1e4-5b2e-43d9-8d08-bf615ef6cf15 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1512 microversion: 2.1 time: 0.236108 Jul 26 20:34:08.660251 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3391/6707] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:08 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:09.683626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cd9c91e6-c7ad-46ee-96ad-0a14a433118c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:09.684358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cd9c91e6-c7ad-46ee-96ad-0a14a433118c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:09.691665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd9c91e6-c7ad-46ee-96ad-0a14a433118c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:09.692140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd9c91e6-c7ad-46ee-96ad-0a14a433118c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:09.692928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd9c91e6-c7ad-46ee-96ad-0a14a433118c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:09.693387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cd9c91e6-c7ad-46ee-96ad-0a14a433118c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:09.839759 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cd9c91e6-c7ad-46ee-96ad-0a14a433118c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:09.847922 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cd9c91e6-c7ad-46ee-96ad-0a14a433118c tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1512 microversion: 2.1 time: 0.169045 Jul 26 20:34:09.849806 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3317/6708] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:09 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:09.967753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-af30bfe9-43d0-4341-afc4-4ab16b7bc16c req-65a32acc-db98-4b2c-bc82-e7909636a0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdec11f8-6530-4780-adf6-b3c79b9ab7af", "name": "network-vif-plugged", "status": "completed", "tag": "eb52260c-fc7d-4834-8d91-883809cd4c00"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:09.984793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-af30bfe9-43d0-4341-afc4-4ab16b7bc16c req-65a32acc-db98-4b2c-bc82-e7909636a0a1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:09.985454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-af30bfe9-43d0-4341-afc4-4ab16b7bc16c req-65a32acc-db98-4b2c-bc82-e7909636a0a1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:10.001334 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-af30bfe9-43d0-4341-afc4-4ab16b7bc16c req-65a32acc-db98-4b2c-bc82-e7909636a0a1 service nova] Creating event network-vif-plugged:eb52260c-fc7d-4834-8d91-883809cd4c00 for instance bdec11f8-6530-4780-adf6-b3c79b9ab7af on n-h1-708768-8 Jul 26 20:34:10.007913 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-af30bfe9-43d0-4341-afc4-4ab16b7bc16c req-65a32acc-db98-4b2c-bc82-e7909636a0a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046663 Jul 26 20:34:10.009280 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3392/6709] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:34:10.870466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-92cad9fa-3e71-49c4-895b-0ca34c536bf1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:10.871097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-92cad9fa-3e71-49c4-895b-0ca34c536bf1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:10.878764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92cad9fa-3e71-49c4-895b-0ca34c536bf1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:10.879234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92cad9fa-3e71-49c4-895b-0ca34c536bf1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:10.880048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92cad9fa-3e71-49c4-895b-0ca34c536bf1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:10.880502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-92cad9fa-3e71-49c4-895b-0ca34c536bf1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.008250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-92cad9fa-3e71-49c4-895b-0ca34c536bf1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:11.016509 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-92cad9fa-3e71-49c4-895b-0ca34c536bf1 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1504 microversion: 2.1 time: 0.150034 Jul 26 20:34:11.017082 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3318/6710] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:10 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:11.046001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1802a458-c64c-41ec-b4bd-d4b52bec94f9 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:11.046712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1802a458-c64c-41ec-b4bd-d4b52bec94f9 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:11.054200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1802a458-c64c-41ec-b4bd-d4b52bec94f9 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.054651 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1802a458-c64c-41ec-b4bd-d4b52bec94f9 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.055428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1802a458-c64c-41ec-b4bd-d4b52bec94f9 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.055892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1802a458-c64c-41ec-b4bd-d4b52bec94f9 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.183486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1802a458-c64c-41ec-b4bd-d4b52bec94f9 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:11.191386 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1802a458-c64c-41ec-b4bd-d4b52bec94f9 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1504 microversion: 2.1 time: 0.150306 Jul 26 20:34:11.191997 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3393/6711] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:11 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:11.211158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-40adec3c-e7f9-4263-914b-64f117bd3d46 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:11.211824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40adec3c-e7f9-4263-914b-64f117bd3d46 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:11.218368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40adec3c-e7f9-4263-914b-64f117bd3d46 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.218828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40adec3c-e7f9-4263-914b-64f117bd3d46 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.219632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40adec3c-e7f9-4263-914b-64f117bd3d46 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.220080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40adec3c-e7f9-4263-914b-64f117bd3d46 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.346347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-40adec3c-e7f9-4263-914b-64f117bd3d46 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:11.353897 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-40adec3c-e7f9-4263-914b-64f117bd3d46 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1504 microversion: 2.1 time: 0.146578 Jul 26 20:34:11.354475 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3319/6712] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:11 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:11.375376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-27271ab8-54c8-4b61-a11f-373ae5bd5016 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:11.376004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-27271ab8-54c8-4b61-a11f-373ae5bd5016 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:11.382201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27271ab8-54c8-4b61-a11f-373ae5bd5016 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.382649 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27271ab8-54c8-4b61-a11f-373ae5bd5016 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.383442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27271ab8-54c8-4b61-a11f-373ae5bd5016 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.383956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-27271ab8-54c8-4b61-a11f-373ae5bd5016 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.409325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-27271ab8-54c8-4b61-a11f-373ae5bd5016 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:34:11.481621 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-27271ab8-54c8-4b61-a11f-373ae5bd5016 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 204 len: 0 microversion: 2.1 time: 0.109804 Jul 26 20:34:11.482332 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3394/6713] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:34:11 2022] DELETE /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:34:11.499401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:11.499947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:11.506035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.506492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.507258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.507727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.535709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:34:11.582943 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.compute.api [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Instance is already in deleting state, ignoring this request Jul 26 20:34:11.583737 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ed1357e-0e04-44bc-a26b-c31cc730ec55 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 204 len: 0 microversion: 2.1 time: 0.088625 Jul 26 20:34:11.584290 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3320/6714] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:34:11 2022] DELETE /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:34:11.593797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a34519c6-bbe2-4312-9b79-3cd117530183 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:11.594509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a34519c6-bbe2-4312-9b79-3cd117530183 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:11.600636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a34519c6-bbe2-4312-9b79-3cd117530183 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.601090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a34519c6-bbe2-4312-9b79-3cd117530183 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.601862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a34519c6-bbe2-4312-9b79-3cd117530183 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:11.602299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a34519c6-bbe2-4312-9b79-3cd117530183 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:11.606347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:11.732203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a34519c6-bbe2-4312-9b79-3cd117530183 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:11.739781 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a34519c6-bbe2-4312-9b79-3cd117530183 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1510 microversion: 2.1 time: 0.150978 Jul 26 20:34:11.740361 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3395/6715] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:11 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:12.761339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6de902f7-5204-49ec-9e3d-8232f8dded64 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:12.761974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6de902f7-5204-49ec-9e3d-8232f8dded64 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:12.769761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6de902f7-5204-49ec-9e3d-8232f8dded64 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:12.770230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6de902f7-5204-49ec-9e3d-8232f8dded64 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:12.771035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6de902f7-5204-49ec-9e3d-8232f8dded64 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:12.771508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6de902f7-5204-49ec-9e3d-8232f8dded64 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:12.909975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6de902f7-5204-49ec-9e3d-8232f8dded64 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75db331ed77478b84e26c244c0fc5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc2259895a24a41b39ab0edff290b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:12.917622 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6de902f7-5204-49ec-9e3d-8232f8dded64 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 200 len: 1510 microversion: 2.1 time: 0.160271 Jul 26 20:34:12.918207 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3321/6716] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:12 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:13.256760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bddd5fe8-855f-46e0-bcc8-c843a9227add req-2e17ebc3-5c59-464c-bb92-08ccbf64abdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdec11f8-6530-4780-adf6-b3c79b9ab7af", "name": "network-vif-deleted", "tag": "eb52260c-fc7d-4834-8d91-883809cd4c00"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:13.276951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bddd5fe8-855f-46e0-bcc8-c843a9227add req-2e17ebc3-5c59-464c-bb92-08ccbf64abdb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:13.277675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bddd5fe8-855f-46e0-bcc8-c843a9227add req-2e17ebc3-5c59-464c-bb92-08ccbf64abdb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:13.294805 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bddd5fe8-855f-46e0-bcc8-c843a9227add req-2e17ebc3-5c59-464c-bb92-08ccbf64abdb service nova] Creating event network-vif-deleted:eb52260c-fc7d-4834-8d91-883809cd4c00 for instance bdec11f8-6530-4780-adf6-b3c79b9ab7af on n-h1-708768-8 Jul 26 20:34:13.300418 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bddd5fe8-855f-46e0-bcc8-c843a9227add req-2e17ebc3-5c59-464c-bb92-08ccbf64abdb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053049 Jul 26 20:34:13.301115 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3396/6717] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:34:13.939419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:13.940028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: bdec11f8-6530-4780-adf6-b3c79b9ab7af] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:13.946941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:13.947408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:13.948215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:13.948668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:13.961777 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] HTTP exception thrown: Instance bdec11f8-6530-4780-adf6-b3c79b9ab7af could not be found. Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Request method failure captured: Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af HTTP/1.1 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E9hP2Nsj2CF-xFzfmH7A7elOF1EZ_HisKiL4WNEEJ1pDkuwwH_v-MazQ8uyIJkx7IH6K3sz3SWT97Q-ZfwxoyzRDe6jHbG2OZsUvvcq0NNSGxvfvWrQqjNc84ecdDkibmbNmyFI8OLc3UoAMr_d47nhn9QnZF2571TejEWUViPytJs Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 9bc2259895a24a41b39ab0edff290b70 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9bc2259895a24a41b39ab0edff290b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9bc2259895a24a41b39ab0edff290b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9bc2259895a24a41b39ab0edff290b70", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9bc2259895a24a41b39ab0edff290b70"}]}] Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 9bc2259895a24a41b39ab0edff290b70 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiskConfigTestJSON-719459905-project Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e75db331ed77478b84e26c244c0fc5f9 Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiskConfigTestJSON-719459905-project Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance bdec11f8-6530-4780-adf6-b3c79b9ab7af could not be found. Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'bdec11f8-6530-4780-adf6-b3c79b9ab7af'} Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdec11f8-6530-4780-adf6-b3c79b9ab7af could not be found. Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdec11f8-6530-4780-adf6-b3c79b9ab7af could not be found. Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:34:13.963418 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdec11f8-6530-4780-adf6-b3c79b9ab7af could not be found. Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Returning 404 to user: Instance bdec11f8-6530-4780-adf6-b3c79b9ab7af could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c54405df-2c37-4b5a-9470-67b9b28d911e tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af" status: 404 len: 111 microversion: 2.1 time: 0.030328 Jul 26 20:34:13.967187 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3322/6718] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:13 2022] GET /compute/v2.1/servers/bdec11f8-6530-4780-adf6-b3c79b9ab7af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:34:13.974419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b064db3e-8af4-4fd5-8111-4a77f22e9e14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '.version_select at 0x7f87567a94c0>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:13.994649 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b064db3e-8af4-4fd5-8111-4a77f22e9e14 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844410585" status: 202 len: 0 microversion: 2.1 time: 0.024537 Jul 26 20:34:13.995230 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3397/6719] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Jul 26 20:34:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844410585 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:34:14.595155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:14.595765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:14.601853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:14.602308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:14.603076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:14.603525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:14.617322 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] HTTP exception thrown: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Request method failure captured: Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb HTTP/1.1 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E9hP2Nsj2CF-xFzfmH7A7elOF1EZ_HisKiL4WNEEJ1pDkuwwH_v-MazQ8uyIJkx7IH6K3sz3SWT97Q-ZfwxoyzRDe6jHbG2OZsUvvcq0NNSGxvfvWrQqjNc84ecdDkibmbNmyFI8OLc3UoAMr_d47nhn9QnZF2571TejEWUViPytJs Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 9bc2259895a24a41b39ab0edff290b70 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9bc2259895a24a41b39ab0edff290b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9bc2259895a24a41b39ab0edff290b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9bc2259895a24a41b39ab0edff290b70", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9bc2259895a24a41b39ab0edff290b70"}]}] Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 9bc2259895a24a41b39ab0edff290b70 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerDiskConfigTestJSON-719459905-project Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: e75db331ed77478b84e26c244c0fc5f9 Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerDiskConfigTestJSON-719459905-project Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f8bb8762-7943-4658-b1db-1547a48381bb'} Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:34:14.618855 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Returning 404 to user: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bafe5d48-f579-4be7-a220-15380f4fde93 tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 404 len: 111 microversion: 2.1 time: 0.029092 Jul 26 20:34:14.623115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3323/6720] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:34:14 2022] DELETE /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:34:14.630477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:14.631228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] [instance: f8bb8762-7943-4658-b1db-1547a48381bb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:14.638212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:14.638672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:14.639446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:14.639920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:14.653159 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] HTTP exception thrown: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Request method failure captured: Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb HTTP/1.1 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E9hP2Nsj2CF-xFzfmH7A7elOF1EZ_HisKiL4WNEEJ1pDkuwwH_v-MazQ8uyIJkx7IH6K3sz3SWT97Q-ZfwxoyzRDe6jHbG2OZsUvvcq0NNSGxvfvWrQqjNc84ecdDkibmbNmyFI8OLc3UoAMr_d47nhn9QnZF2571TejEWUViPytJs Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 9bc2259895a24a41b39ab0edff290b70 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9bc2259895a24a41b39ab0edff290b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9bc2259895a24a41b39ab0edff290b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9bc2259895a24a41b39ab0edff290b70", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9bc2259895a24a41b39ab0edff290b70"}]}] Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 9bc2259895a24a41b39ab0edff290b70 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-719459905 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerDiskConfigTestJSON-719459905-project Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: e75db331ed77478b84e26c244c0fc5f9 Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerDiskConfigTestJSON-719459905-project Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'f8bb8762-7943-4658-b1db-1547a48381bb'} Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:34:14.654828 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] Returning 404 to user: Instance f8bb8762-7943-4658-b1db-1547a48381bb could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e3981515-b3bb-45bf-bc91-e8fdf8ed983d tempest-ServerDiskConfigTestJSON-719459905 tempest-ServerDiskConfigTestJSON-719459905-project] 10.222.0.58 "GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb" status: 404 len: 111 microversion: 2.1 time: 0.030630 Jul 26 20:34:14.658513 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3398/6721] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:14 2022] GET /compute/v2.1/servers/f8bb8762-7943-4658-b1db-1547a48381bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:34:23.196831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9003c207-99a4-40f1-a94a-c6d829ff345b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'create', calling method: .version_select at 0x7f875d90b820>, body: {"keypair": {"name": "tempest-keypair-800196711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIbHF1vpo/JvhUBwswpkID7QC88jloTXGEC7glRn4/BRF9XxX11qgPycgpQhH2mLTpxaadAXTEicTIokHxj6aavfKG52nEAcNalanAx7alLZ0rpVU7UpOBFndokDMgdAA=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:23.203068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=36 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:23.215400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9003c207-99a4-40f1-a94a-c6d829ff345b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:34:23.222861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9003c207-99a4-40f1-a94a-c6d829ff345b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for user a6d13710ea1a4204bb0b70c1964c4d09 and project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:34:23.249949 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9003c207-99a4-40f1-a94a-c6d829ff345b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184603 Jul 26 20:34:23.250626 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3324/6722] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:34:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:34:24.542682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1653274227", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1af22061-3ea1-493f-92b0-f1e5d7a4cdaf"}], "security_groups": [{"name": "tempest-securitygroup--234704078"}], "key_name": "tempest-keypair-800196711", "user_data": "}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:24.553277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:24.645231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=9 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:24.654870 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] validate_networks() for [('1af22061-3ea1-493f-92b0-f1e5d7a4cdaf', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:34:25.325254 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:34:25.325660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:34:25.326144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:34:25.326708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:34:25.327132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:34:25.336606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:25.337062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:25.338045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:25.338490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:25.358302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:34:25.364680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for user a6d13710ea1a4204bb0b70c1964c4d09 and project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:34:25.379379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:34:25.382927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:34:25.440909 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b496a066-9fc7-449a-8743-182e0c61a077 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.902619 Jul 26 20:34:25.442109 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3399/6723] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:34:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:34:25.453466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:25.459159 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0834e0b0-616c-4b79-b4b9-a6167ff9d31f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:25.459828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0834e0b0-616c-4b79-b4b9-a6167ff9d31f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:25.538799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0834e0b0-616c-4b79-b4b9-a6167ff9d31f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:25.547467 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0834e0b0-616c-4b79-b4b9-a6167ff9d31f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1238 microversion: 2.1 time: 0.098160 Jul 26 20:34:25.550359 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3325/6724] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:25 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:26.574354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5994e1c-2c25-4e33-81f0-42059405d672 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:26.577164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5994e1c-2c25-4e33-81f0-42059405d672 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:26.585371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5994e1c-2c25-4e33-81f0-42059405d672 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:26.586110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5994e1c-2c25-4e33-81f0-42059405d672 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:26.587939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5994e1c-2c25-4e33-81f0-42059405d672 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:26.588622 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5994e1c-2c25-4e33-81f0-42059405d672 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:26.683772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5994e1c-2c25-4e33-81f0-42059405d672 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:26.692935 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5994e1c-2c25-4e33-81f0-42059405d672 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1298 microversion: 2.1 time: 0.123974 Jul 26 20:34:26.693511 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3400/6725] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:26 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:27.714524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7698a6b5-e334-4cd3-b569-0c7da9bf40eb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:27.715348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7698a6b5-e334-4cd3-b569-0c7da9bf40eb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:27.724011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7698a6b5-e334-4cd3-b569-0c7da9bf40eb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:27.724556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7698a6b5-e334-4cd3-b569-0c7da9bf40eb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:27.725363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7698a6b5-e334-4cd3-b569-0c7da9bf40eb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:27.725820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7698a6b5-e334-4cd3-b569-0c7da9bf40eb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:27.893324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7698a6b5-e334-4cd3-b569-0c7da9bf40eb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:27.901751 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7698a6b5-e334-4cd3-b569-0c7da9bf40eb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1363 microversion: 2.1 time: 0.191095 Jul 26 20:34:27.902339 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3326/6726] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:27 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:28.015472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-503385d4-0f56-46a6-b224-449c06202c32 req-f7782f72-d496-4f95-a4f0-7c302cb35988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edabf07-d1e9-4f4d-9c16-7b6ce30147b5", "tag": "234571c2-6668-4d63-bfdf-baff5db2c3d2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:28.027136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-503385d4-0f56-46a6-b224-449c06202c32 req-f7782f72-d496-4f95-a4f0-7c302cb35988 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:28.028325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-503385d4-0f56-46a6-b224-449c06202c32 req-f7782f72-d496-4f95-a4f0-7c302cb35988 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:28.046200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-503385d4-0f56-46a6-b224-449c06202c32 req-f7782f72-d496-4f95-a4f0-7c302cb35988 service nova] Creating event network-changed:234571c2-6668-4d63-bfdf-baff5db2c3d2 for instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 on n-h2-708768-8 Jul 26 20:34:28.051804 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-503385d4-0f56-46a6-b224-449c06202c32 req-f7782f72-d496-4f95-a4f0-7c302cb35988 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040955 Jul 26 20:34:28.052645 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3401/6727] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:34:28.923399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6aa3822d-ae9a-4010-bd12-d5bc8a602793 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:28.924046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6aa3822d-ae9a-4010-bd12-d5bc8a602793 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:28.930298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aa3822d-ae9a-4010-bd12-d5bc8a602793 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:28.930757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aa3822d-ae9a-4010-bd12-d5bc8a602793 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:28.931521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aa3822d-ae9a-4010-bd12-d5bc8a602793 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:28.931995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6aa3822d-ae9a-4010-bd12-d5bc8a602793 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:29.062233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6aa3822d-ae9a-4010-bd12-d5bc8a602793 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:29.069732 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6aa3822d-ae9a-4010-bd12-d5bc8a602793 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1363 microversion: 2.1 time: 0.151337 Jul 26 20:34:29.070314 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3327/6728] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:28 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:30.093011 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-abcf5312-3c76-4313-b1d6-87881dc4b2ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:30.093728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-abcf5312-3c76-4313-b1d6-87881dc4b2ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:30.100024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abcf5312-3c76-4313-b1d6-87881dc4b2ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:30.100471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abcf5312-3c76-4313-b1d6-87881dc4b2ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:30.101232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abcf5312-3c76-4313-b1d6-87881dc4b2ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:30.101668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-abcf5312-3c76-4313-b1d6-87881dc4b2ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:30.231259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-abcf5312-3c76-4313-b1d6-87881dc4b2ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:30.238904 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-abcf5312-3c76-4313-b1d6-87881dc4b2ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1363 microversion: 2.1 time: 0.151599 Jul 26 20:34:30.239496 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3402/6729] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:30 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:31.259043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-166893da-fbe3-40fa-8bd9-e361c2254625 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:31.259696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-166893da-fbe3-40fa-8bd9-e361c2254625 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:31.266714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-166893da-fbe3-40fa-8bd9-e361c2254625 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:31.267182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-166893da-fbe3-40fa-8bd9-e361c2254625 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:31.267998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-166893da-fbe3-40fa-8bd9-e361c2254625 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:31.268453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-166893da-fbe3-40fa-8bd9-e361c2254625 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:31.408565 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-166893da-fbe3-40fa-8bd9-e361c2254625 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:31.416017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-166893da-fbe3-40fa-8bd9-e361c2254625 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1363 microversion: 2.1 time: 0.160813 Jul 26 20:34:31.416611 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3328/6730] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:31 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:34:32.438190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-62ffd086-2136-47a6-9579-33cd075a616a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:32.438819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-62ffd086-2136-47a6-9579-33cd075a616a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:32.445757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62ffd086-2136-47a6-9579-33cd075a616a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:32.446208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62ffd086-2136-47a6-9579-33cd075a616a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:32.446975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62ffd086-2136-47a6-9579-33cd075a616a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:32.447414 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-62ffd086-2136-47a6-9579-33cd075a616a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:32.578876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-62ffd086-2136-47a6-9579-33cd075a616a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:32.586498 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-62ffd086-2136-47a6-9579-33cd075a616a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1363 microversion: 2.1 time: 0.152797 Jul 26 20:34:32.587068 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3403/6731] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:32 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:33.606496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8831a00c-430a-4488-89d4-978b38a01b13 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:33.607129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8831a00c-430a-4488-89d4-978b38a01b13 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:33.614272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8831a00c-430a-4488-89d4-978b38a01b13 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:33.614741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8831a00c-430a-4488-89d4-978b38a01b13 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:33.615526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8831a00c-430a-4488-89d4-978b38a01b13 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:33.616007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8831a00c-430a-4488-89d4-978b38a01b13 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:33.748926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8831a00c-430a-4488-89d4-978b38a01b13 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:33.756932 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8831a00c-430a-4488-89d4-978b38a01b13 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1363 microversion: 2.1 time: 0.154403 Jul 26 20:34:33.757495 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3329/6732] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:33 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:33.853593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-8629550c-5715-42f4-b5af-49ad25142753 req-da1d7a8f-6227-43fe-a781-e8be4ff40417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edabf07-d1e9-4f4d-9c16-7b6ce30147b5", "name": "network-vif-plugged", "status": "completed", "tag": "234571c2-6668-4d63-bfdf-baff5db2c3d2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:33.864131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8629550c-5715-42f4-b5af-49ad25142753 req-da1d7a8f-6227-43fe-a781-e8be4ff40417 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:33.864560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8629550c-5715-42f4-b5af-49ad25142753 req-da1d7a8f-6227-43fe-a781-e8be4ff40417 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:33.876580 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-8629550c-5715-42f4-b5af-49ad25142753 req-da1d7a8f-6227-43fe-a781-e8be4ff40417 service nova] Creating event network-vif-plugged:234571c2-6668-4d63-bfdf-baff5db2c3d2 for instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 on n-h2-708768-8 Jul 26 20:34:33.881584 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-8629550c-5715-42f4-b5af-49ad25142753 req-da1d7a8f-6227-43fe-a781-e8be4ff40417 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031730 Jul 26 20:34:33.882336 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3404/6733] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:34:34.779244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9626be09-7148-4226-a531-e5b048373379 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:34.779845 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9626be09-7148-4226-a531-e5b048373379 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:34.786789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9626be09-7148-4226-a531-e5b048373379 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:34.787256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9626be09-7148-4226-a531-e5b048373379 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:34.788088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9626be09-7148-4226-a531-e5b048373379 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:34.788543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9626be09-7148-4226-a531-e5b048373379 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:34.919157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9626be09-7148-4226-a531-e5b048373379 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:34.927193 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9626be09-7148-4226-a531-e5b048373379 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1363 microversion: 2.1 time: 0.152709 Jul 26 20:34:34.927815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3330/6734] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:34 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:35.947223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:35.948018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:35.952489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-258788d9-f862-4bfc-ac93-0d75fcc122d8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:35.953198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-258788d9-f862-4bfc-ac93-0d75fcc122d8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:35.960638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-258788d9-f862-4bfc-ac93-0d75fcc122d8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:35.961100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-258788d9-f862-4bfc-ac93-0d75fcc122d8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:35.961876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-258788d9-f862-4bfc-ac93-0d75fcc122d8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:35.962323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-258788d9-f862-4bfc-ac93-0d75fcc122d8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:36.097889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-258788d9-f862-4bfc-ac93-0d75fcc122d8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:34:36.105576 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-258788d9-f862-4bfc-ac93-0d75fcc122d8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1550 microversion: 2.1 time: 0.160139 Jul 26 20:34:36.106748 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3405/6735] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:34:35 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:34:36.127015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-02693665-cd83-4c54-afed-973f66f93733 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:34:36.127513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-02693665-cd83-4c54-afed-973f66f93733 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:34:36.129440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:34:36.135839 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02693665-cd83-4c54-afed-973f66f93733 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:36.136310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02693665-cd83-4c54-afed-973f66f93733 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:36.137634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02693665-cd83-4c54-afed-973f66f93733 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:36.138094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-02693665-cd83-4c54-afed-973f66f93733 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:36.218644 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-02693665-cd83-4c54-afed-973f66f93733 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095585 Jul 26 20:34:36.219276 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3331/6736] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:34:36 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:34:37.235164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-afe2408d-59e4-4aba-aa43-81d54dbee810 req-63580dd3-e672-42da-97e6-037f5a1a3e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edabf07-d1e9-4f4d-9c16-7b6ce30147b5", "tag": "234571c2-6668-4d63-bfdf-baff5db2c3d2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:34:37.244729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-afe2408d-59e4-4aba-aa43-81d54dbee810 req-63580dd3-e672-42da-97e6-037f5a1a3e2c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:34:37.245181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-afe2408d-59e4-4aba-aa43-81d54dbee810 req-63580dd3-e672-42da-97e6-037f5a1a3e2c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:34:37.257054 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-afe2408d-59e4-4aba-aa43-81d54dbee810 req-63580dd3-e672-42da-97e6-037f5a1a3e2c service nova] Creating event network-changed:234571c2-6668-4d63-bfdf-baff5db2c3d2 for instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 on n-h2-708768-8 Jul 26 20:34:37.262810 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-afe2408d-59e4-4aba-aa43-81d54dbee810 req-63580dd3-e672-42da-97e6-037f5a1a3e2c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097957 Jul 26 20:34:37.263242 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3406/6737] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:35:13.361937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:13.362724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=34 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:13.367102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4cca68e2-7fed-454f-a927-9c34e9d0aa64 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:13.367789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4cca68e2-7fed-454f-a927-9c34e9d0aa64 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:13.375385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cca68e2-7fed-454f-a927-9c34e9d0aa64 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:13.376130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cca68e2-7fed-454f-a927-9c34e9d0aa64 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:13.377142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cca68e2-7fed-454f-a927-9c34e9d0aa64 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:13.377747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cca68e2-7fed-454f-a927-9c34e9d0aa64 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:13.512991 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cca68e2-7fed-454f-a927-9c34e9d0aa64 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:13.520696 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4cca68e2-7fed-454f-a927-9c34e9d0aa64 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1669 microversion: 2.1 time: 0.160885 Jul 26 20:35:13.521278 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3332/6738] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:13 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:13.539763 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:13.540514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=32 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:13.545748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-400dc4db-8688-482d-8b3a-abd82b16296a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:13.546464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-400dc4db-8688-482d-8b3a-abd82b16296a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:13.554841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-400dc4db-8688-482d-8b3a-abd82b16296a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:13.555296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-400dc4db-8688-482d-8b3a-abd82b16296a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:13.556103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-400dc4db-8688-482d-8b3a-abd82b16296a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:13.556549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-400dc4db-8688-482d-8b3a-abd82b16296a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:13.691858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-400dc4db-8688-482d-8b3a-abd82b16296a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:13.700118 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-400dc4db-8688-482d-8b3a-abd82b16296a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1669 microversion: 2.1 time: 0.162684 Jul 26 20:35:13.700687 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3407/6739] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:13 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:13.720468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d0d4e7b-42d4-4840-9bed-fb468e15b947 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:13.721096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d0d4e7b-42d4-4840-9bed-fb468e15b947 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:13.727122 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d0d4e7b-42d4-4840-9bed-fb468e15b947 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:13.727580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d0d4e7b-42d4-4840-9bed-fb468e15b947 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:13.728391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d0d4e7b-42d4-4840-9bed-fb468e15b947 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:13.728838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d0d4e7b-42d4-4840-9bed-fb468e15b947 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:13.860559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4d0d4e7b-42d4-4840-9bed-fb468e15b947 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:13.868024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d0d4e7b-42d4-4840-9bed-fb468e15b947 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1669 microversion: 2.1 time: 0.151380 Jul 26 20:35:13.868592 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3333/6740] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:13 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:13.888960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:13.891279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:13.897371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:13.897829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:13.898594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:13.899032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:13.928726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:13.934901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Old instance type m1.heat2, new instance type m1.heat {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:35:13.941069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:35:13.941489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:35:13.941959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:35:13.942365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:35:13.942773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:35:14.004604 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c7266c2c-d535-4013-9db9-96680f3f014e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5/action" status: 202 len: 0 microversion: 2.1 time: 0.120591 Jul 26 20:35:14.005412 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3408/6741] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:35:13 2022] POST /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:35:14.014255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a211702a-6c1f-4dd6-a0b6-8abd613ae74a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:14.014883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a211702a-6c1f-4dd6-a0b6-8abd613ae74a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:14.021086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a211702a-6c1f-4dd6-a0b6-8abd613ae74a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:14.021597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a211702a-6c1f-4dd6-a0b6-8abd613ae74a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:14.022393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a211702a-6c1f-4dd6-a0b6-8abd613ae74a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:14.023232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a211702a-6c1f-4dd6-a0b6-8abd613ae74a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:14.189019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a211702a-6c1f-4dd6-a0b6-8abd613ae74a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:14.196806 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a211702a-6c1f-4dd6-a0b6-8abd613ae74a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1678 microversion: 2.1 time: 0.187061 Jul 26 20:35:14.197404 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3334/6742] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:14 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:35:15.220166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5cb8d657-5fac-41c7-98a1-6493db962c09 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:15.220779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5cb8d657-5fac-41c7-98a1-6493db962c09 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:15.226877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cb8d657-5fac-41c7-98a1-6493db962c09 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:15.227324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cb8d657-5fac-41c7-98a1-6493db962c09 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:15.228107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cb8d657-5fac-41c7-98a1-6493db962c09 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:15.228542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5cb8d657-5fac-41c7-98a1-6493db962c09 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:15.398678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5cb8d657-5fac-41c7-98a1-6493db962c09 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:15.407094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5cb8d657-5fac-41c7-98a1-6493db962c09 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1678 microversion: 2.1 time: 0.192308 Jul 26 20:35:15.407710 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3409/6743] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:15 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:16.428703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-110ac82b-5cf8-476d-b35e-e62dc2a4a9e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:16.429291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-110ac82b-5cf8-476d-b35e-e62dc2a4a9e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:16.436795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-110ac82b-5cf8-476d-b35e-e62dc2a4a9e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:16.437260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-110ac82b-5cf8-476d-b35e-e62dc2a4a9e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:16.438042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-110ac82b-5cf8-476d-b35e-e62dc2a4a9e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:16.438497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-110ac82b-5cf8-476d-b35e-e62dc2a4a9e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:16.566012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-110ac82b-5cf8-476d-b35e-e62dc2a4a9e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:16.573654 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-110ac82b-5cf8-476d-b35e-e62dc2a4a9e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.148933 Jul 26 20:35:16.574229 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3335/6744] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:16 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:17.596681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cfb307c0-f8de-443b-8167-e6809e16b7f1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:17.597298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cfb307c0-f8de-443b-8167-e6809e16b7f1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:17.604295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfb307c0-f8de-443b-8167-e6809e16b7f1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:17.604747 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfb307c0-f8de-443b-8167-e6809e16b7f1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:17.605513 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfb307c0-f8de-443b-8167-e6809e16b7f1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:17.605952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cfb307c0-f8de-443b-8167-e6809e16b7f1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:17.733383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cfb307c0-f8de-443b-8167-e6809e16b7f1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:17.740992 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cfb307c0-f8de-443b-8167-e6809e16b7f1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.148283 Jul 26 20:35:17.741569 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3410/6745] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:17 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:18.762559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f18e2356-4c05-44a8-9931-2a23222f4af0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:18.763210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f18e2356-4c05-44a8-9931-2a23222f4af0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:18.770348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f18e2356-4c05-44a8-9931-2a23222f4af0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:18.770811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f18e2356-4c05-44a8-9931-2a23222f4af0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:18.771587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f18e2356-4c05-44a8-9931-2a23222f4af0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:18.772056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f18e2356-4c05-44a8-9931-2a23222f4af0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:18.916119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f18e2356-4c05-44a8-9931-2a23222f4af0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:18.924826 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f18e2356-4c05-44a8-9931-2a23222f4af0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.166141 Jul 26 20:35:18.925674 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3336/6746] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:18 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:19.946722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd069610-fa47-4d10-9ebe-6a032209b592 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:19.947247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd069610-fa47-4d10-9ebe-6a032209b592 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:19.954284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd069610-fa47-4d10-9ebe-6a032209b592 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:19.954745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd069610-fa47-4d10-9ebe-6a032209b592 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:19.955518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd069610-fa47-4d10-9ebe-6a032209b592 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:19.955991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd069610-fa47-4d10-9ebe-6a032209b592 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:20.093168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd069610-fa47-4d10-9ebe-6a032209b592 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:20.100767 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd069610-fa47-4d10-9ebe-6a032209b592 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.158148 Jul 26 20:35:20.101347 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3411/6747] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:19 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:21.124017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68976bb8-1ac3-461b-9779-c97e6195f276 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:21.124639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68976bb8-1ac3-461b-9779-c97e6195f276 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:21.131542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68976bb8-1ac3-461b-9779-c97e6195f276 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:21.132032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68976bb8-1ac3-461b-9779-c97e6195f276 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:21.132806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68976bb8-1ac3-461b-9779-c97e6195f276 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:21.133254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68976bb8-1ac3-461b-9779-c97e6195f276 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:21.261062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68976bb8-1ac3-461b-9779-c97e6195f276 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:21.269980 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68976bb8-1ac3-461b-9779-c97e6195f276 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.150743 Jul 26 20:35:21.270546 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3337/6748] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:21 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:22.290552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9ba21f18-24a0-47c0-a66d-f00c238566f2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:22.291101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9ba21f18-24a0-47c0-a66d-f00c238566f2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:22.298599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ba21f18-24a0-47c0-a66d-f00c238566f2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:22.299057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ba21f18-24a0-47c0-a66d-f00c238566f2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:22.299856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ba21f18-24a0-47c0-a66d-f00c238566f2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:22.300293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9ba21f18-24a0-47c0-a66d-f00c238566f2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:22.429800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9ba21f18-24a0-47c0-a66d-f00c238566f2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:22.437825 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9ba21f18-24a0-47c0-a66d-f00c238566f2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.151322 Jul 26 20:35:22.438399 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3412/6749] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:22 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:23.459737 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a423c7d-4ab4-41fa-b353-438f546a54f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:23.460378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a423c7d-4ab4-41fa-b353-438f546a54f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:23.468477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a423c7d-4ab4-41fa-b353-438f546a54f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:23.468933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a423c7d-4ab4-41fa-b353-438f546a54f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:23.469703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a423c7d-4ab4-41fa-b353-438f546a54f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:23.470153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a423c7d-4ab4-41fa-b353-438f546a54f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:23.610940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a423c7d-4ab4-41fa-b353-438f546a54f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:23.618488 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a423c7d-4ab4-41fa-b353-438f546a54f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.162812 Jul 26 20:35:23.619059 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3338/6750] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:23 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:24.639315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a11ee592-3a8d-491c-9942-14ec3d42d180 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:24.639954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a11ee592-3a8d-491c-9942-14ec3d42d180 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:24.646949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a11ee592-3a8d-491c-9942-14ec3d42d180 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:24.647392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a11ee592-3a8d-491c-9942-14ec3d42d180 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:24.648193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a11ee592-3a8d-491c-9942-14ec3d42d180 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:24.648729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a11ee592-3a8d-491c-9942-14ec3d42d180 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:24.784438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a11ee592-3a8d-491c-9942-14ec3d42d180 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:24.792067 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a11ee592-3a8d-491c-9942-14ec3d42d180 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.156945 Jul 26 20:35:24.792648 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3413/6751] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:24 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:25.815247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-44343c86-73a9-41e1-afb1-e0f106acb727 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:25.815932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-44343c86-73a9-41e1-afb1-e0f106acb727 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:25.823244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44343c86-73a9-41e1-afb1-e0f106acb727 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:25.823743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44343c86-73a9-41e1-afb1-e0f106acb727 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:25.824771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44343c86-73a9-41e1-afb1-e0f106acb727 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:25.825226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-44343c86-73a9-41e1-afb1-e0f106acb727 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:25.955174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-44343c86-73a9-41e1-afb1-e0f106acb727 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:25.962743 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-44343c86-73a9-41e1-afb1-e0f106acb727 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.151614 Jul 26 20:35:25.963320 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3339/6752] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:25 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:35:26.984543 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9bfe80a0-821a-4ce5-b14c-8af6f19cbd21 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:26.985156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9bfe80a0-821a-4ce5-b14c-8af6f19cbd21 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:26.991855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bfe80a0-821a-4ce5-b14c-8af6f19cbd21 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:26.992296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bfe80a0-821a-4ce5-b14c-8af6f19cbd21 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:26.993053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bfe80a0-821a-4ce5-b14c-8af6f19cbd21 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:26.993489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bfe80a0-821a-4ce5-b14c-8af6f19cbd21 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:27.123237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9bfe80a0-821a-4ce5-b14c-8af6f19cbd21 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:27.130786 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9bfe80a0-821a-4ce5-b14c-8af6f19cbd21 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1683 microversion: 2.1 time: 0.150249 Jul 26 20:35:27.131356 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3414/6753] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:26 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:28.152613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6b60f262-74a6-4c37-80b5-a53d90cdb00c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:28.153842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6b60f262-74a6-4c37-80b5-a53d90cdb00c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:28.161278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b60f262-74a6-4c37-80b5-a53d90cdb00c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:28.161739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b60f262-74a6-4c37-80b5-a53d90cdb00c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:28.162522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b60f262-74a6-4c37-80b5-a53d90cdb00c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:28.162969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6b60f262-74a6-4c37-80b5-a53d90cdb00c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:28.279935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-09a0e824-784d-44b4-8439-7b84208082b2 req-fd843f9b-9f6c-4a83-8a63-4810b4318501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edabf07-d1e9-4f4d-9c16-7b6ce30147b5", "name": "network-vif-unplugged", "status": "completed", "tag": "234571c2-6668-4d63-bfdf-baff5db2c3d2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:28.291278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-09a0e824-784d-44b4-8439-7b84208082b2 req-fd843f9b-9f6c-4a83-8a63-4810b4318501 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:28.291815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-09a0e824-784d-44b4-8439-7b84208082b2 req-fd843f9b-9f6c-4a83-8a63-4810b4318501 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:28.305998 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-09a0e824-784d-44b4-8439-7b84208082b2 req-fd843f9b-9f6c-4a83-8a63-4810b4318501 service nova] Creating event network-vif-unplugged:234571c2-6668-4d63-bfdf-baff5db2c3d2 for instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 on n-h1-708768-8 Jul 26 20:35:28.312457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-09a0e824-784d-44b4-8439-7b84208082b2 req-fd843f9b-9f6c-4a83-8a63-4810b4318501 service nova] Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:35:28.324417 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-09a0e824-784d-44b4-8439-7b84208082b2 req-fd843f9b-9f6c-4a83-8a63-4810b4318501 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048685 Jul 26 20:35:28.326809 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3415/6754] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:35:28.343636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6b60f262-74a6-4c37-80b5-a53d90cdb00c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:28.352112 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6b60f262-74a6-4c37-80b5-a53d90cdb00c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1682 microversion: 2.1 time: 0.203754 Jul 26 20:35:28.367716 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3340/6755] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:28 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:29.376583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a4b46358-57ab-4890-bd89-c5994fd8d53e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:29.377441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a4b46358-57ab-4890-bd89-c5994fd8d53e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:29.383923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4b46358-57ab-4890-bd89-c5994fd8d53e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:29.384372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4b46358-57ab-4890-bd89-c5994fd8d53e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:29.385137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4b46358-57ab-4890-bd89-c5994fd8d53e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:29.385583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a4b46358-57ab-4890-bd89-c5994fd8d53e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:29.607211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a4b46358-57ab-4890-bd89-c5994fd8d53e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:29.615093 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a4b46358-57ab-4890-bd89-c5994fd8d53e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1682 microversion: 2.1 time: 0.244559 Jul 26 20:35:29.615682 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3416/6756] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:29 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:30.340477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-dc1ce80b-d536-4841-a94d-c6ab767f9d6e req-c94a331e-6133-4764-8621-9703e4b336c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edabf07-d1e9-4f4d-9c16-7b6ce30147b5", "tag": "234571c2-6668-4d63-bfdf-baff5db2c3d2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:30.350782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dc1ce80b-d536-4841-a94d-c6ab767f9d6e req-c94a331e-6133-4764-8621-9703e4b336c4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:30.351232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dc1ce80b-d536-4841-a94d-c6ab767f9d6e req-c94a331e-6133-4764-8621-9703e4b336c4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:30.363216 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-dc1ce80b-d536-4841-a94d-c6ab767f9d6e req-c94a331e-6133-4764-8621-9703e4b336c4 service nova] Creating event network-changed:234571c2-6668-4d63-bfdf-baff5db2c3d2 for instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 on n-h1-708768-8 Jul 26 20:35:30.368422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-dc1ce80b-d536-4841-a94d-c6ab767f9d6e req-c94a331e-6133-4764-8621-9703e4b336c4 service nova] Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:35:30.380350 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-dc1ce80b-d536-4841-a94d-c6ab767f9d6e req-c94a331e-6133-4764-8621-9703e4b336c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043497 Jul 26 20:35:30.380960 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3341/6757] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:35:30.637667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7583884c-1efd-4c07-bf7d-6f93e842210e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:30.638291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7583884c-1efd-4c07-bf7d-6f93e842210e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:30.645295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7583884c-1efd-4c07-bf7d-6f93e842210e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:30.645753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7583884c-1efd-4c07-bf7d-6f93e842210e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:30.646538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7583884c-1efd-4c07-bf7d-6f93e842210e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:30.646981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7583884c-1efd-4c07-bf7d-6f93e842210e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:30.788618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7583884c-1efd-4c07-bf7d-6f93e842210e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:30.798133 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7583884c-1efd-4c07-bf7d-6f93e842210e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1680 microversion: 2.1 time: 0.164451 Jul 26 20:35:30.798730 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3417/6758] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:30 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:31.821152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e780e6ae-57e4-4264-b6a8-539933ec5643 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:31.821875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e780e6ae-57e4-4264-b6a8-539933ec5643 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:31.828310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e780e6ae-57e4-4264-b6a8-539933ec5643 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:31.828768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e780e6ae-57e4-4264-b6a8-539933ec5643 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:31.829544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e780e6ae-57e4-4264-b6a8-539933ec5643 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:31.829995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e780e6ae-57e4-4264-b6a8-539933ec5643 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:31.964098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e780e6ae-57e4-4264-b6a8-539933ec5643 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:31.972377 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e780e6ae-57e4-4264-b6a8-539933ec5643 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1677 microversion: 2.1 time: 0.156482 Jul 26 20:35:31.972960 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3342/6759] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:31 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:31.993899 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-25edd082-e146-48db-80a4-5ba5a0080ba6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:31.994441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-25edd082-e146-48db-80a4-5ba5a0080ba6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:32.002238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25edd082-e146-48db-80a4-5ba5a0080ba6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:32.002696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25edd082-e146-48db-80a4-5ba5a0080ba6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:32.003536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25edd082-e146-48db-80a4-5ba5a0080ba6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:32.004014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25edd082-e146-48db-80a4-5ba5a0080ba6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:32.066080 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-25edd082-e146-48db-80a4-5ba5a0080ba6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5/action" status: 204 len: 0 microversion: 2.1 time: 0.075876 Jul 26 20:35:32.067061 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3418/6760] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:35:31 2022] POST /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:35:32.075693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d20ce324-bfa8-4edd-9e41-e50335530070 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:32.076552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d20ce324-bfa8-4edd-9e41-e50335530070 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:32.082787 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d20ce324-bfa8-4edd-9e41-e50335530070 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:32.083245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d20ce324-bfa8-4edd-9e41-e50335530070 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:32.084387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d20ce324-bfa8-4edd-9e41-e50335530070 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:32.084832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d20ce324-bfa8-4edd-9e41-e50335530070 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:32.349342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d20ce324-bfa8-4edd-9e41-e50335530070 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:32.357509 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d20ce324-bfa8-4edd-9e41-e50335530070 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1677 microversion: 2.1 time: 0.286009 Jul 26 20:35:32.358110 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3343/6761] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:32 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:33.382243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1e6201e4-78bd-46db-86a5-aebffd5f22d9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:33.382984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1e6201e4-78bd-46db-86a5-aebffd5f22d9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:33.390446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e6201e4-78bd-46db-86a5-aebffd5f22d9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:33.390962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e6201e4-78bd-46db-86a5-aebffd5f22d9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:33.391842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e6201e4-78bd-46db-86a5-aebffd5f22d9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:33.392303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1e6201e4-78bd-46db-86a5-aebffd5f22d9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:33.531161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1e6201e4-78bd-46db-86a5-aebffd5f22d9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:33.538800 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1e6201e4-78bd-46db-86a5-aebffd5f22d9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1669 microversion: 2.1 time: 0.161118 Jul 26 20:35:33.539373 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3419/6762] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:33 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:33.560356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-41554e74-b7e8-4367-bbda-d6cf9edc0cc4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:33.560982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-41554e74-b7e8-4367-bbda-d6cf9edc0cc4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:33.568473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41554e74-b7e8-4367-bbda-d6cf9edc0cc4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:33.568939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41554e74-b7e8-4367-bbda-d6cf9edc0cc4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:33.569728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41554e74-b7e8-4367-bbda-d6cf9edc0cc4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:33.570181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-41554e74-b7e8-4367-bbda-d6cf9edc0cc4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:33.702032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-41554e74-b7e8-4367-bbda-d6cf9edc0cc4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:33.709648 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-41554e74-b7e8-4367-bbda-d6cf9edc0cc4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1669 microversion: 2.1 time: 0.153185 Jul 26 20:35:33.710223 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3344/6763] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:33 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:35:33.730246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8afba30b-16e4-4f38-9b76-e70ad516dfd4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:33.730868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8afba30b-16e4-4f38-9b76-e70ad516dfd4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:33.737803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8afba30b-16e4-4f38-9b76-e70ad516dfd4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:33.738260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8afba30b-16e4-4f38-9b76-e70ad516dfd4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:33.739037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8afba30b-16e4-4f38-9b76-e70ad516dfd4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:33.739478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8afba30b-16e4-4f38-9b76-e70ad516dfd4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:33.944924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8afba30b-16e4-4f38-9b76-e70ad516dfd4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:33.954058 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8afba30b-16e4-4f38-9b76-e70ad516dfd4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1669 microversion: 2.1 time: 0.227682 Jul 26 20:35:33.954860 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3420/6764] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:33 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1669 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:33.975879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e526d10-50d7-4ba9-a551-b0d622c02210 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:33.976645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e526d10-50d7-4ba9-a551-b0d622c02210 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:33.983818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e526d10-50d7-4ba9-a551-b0d622c02210 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:33.984333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e526d10-50d7-4ba9-a551-b0d622c02210 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:33.985341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e526d10-50d7-4ba9-a551-b0d622c02210 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:33.985793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e526d10-50d7-4ba9-a551-b0d622c02210 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:34.017018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e526d10-50d7-4ba9-a551-b0d622c02210 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:35:34.113213 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e526d10-50d7-4ba9-a551-b0d622c02210 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 204 len: 0 microversion: 2.1 time: 0.141100 Jul 26 20:35:34.113798 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3345/6765] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:35:33 2022] DELETE /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:35:34.122887 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-05e47c35-124e-4083-a5bc-59d803ff403f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:34.123511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-05e47c35-124e-4083-a5bc-59d803ff403f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:34.129910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05e47c35-124e-4083-a5bc-59d803ff403f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:34.130591 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05e47c35-124e-4083-a5bc-59d803ff403f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:34.131369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05e47c35-124e-4083-a5bc-59d803ff403f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:34.132016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05e47c35-124e-4083-a5bc-59d803ff403f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:34.148347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:34.201849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d1111bfa-06ce-4168-a1da-13474f076eef req-845574b7-0245-48be-bfc4-60f38c541d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edabf07-d1e9-4f4d-9c16-7b6ce30147b5", "name": "network-vif-plugged", "status": "completed", "tag": "234571c2-6668-4d63-bfdf-baff5db2c3d2"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:34.212482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d1111bfa-06ce-4168-a1da-13474f076eef req-845574b7-0245-48be-bfc4-60f38c541d45 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:34.213090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d1111bfa-06ce-4168-a1da-13474f076eef req-845574b7-0245-48be-bfc4-60f38c541d45 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:34.226939 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d1111bfa-06ce-4168-a1da-13474f076eef req-845574b7-0245-48be-bfc4-60f38c541d45 service nova] Creating event network-vif-plugged:234571c2-6668-4d63-bfdf-baff5db2c3d2 for instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 on n-h1-708768-8 Jul 26 20:35:34.233839 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d1111bfa-06ce-4168-a1da-13474f076eef req-845574b7-0245-48be-bfc4-60f38c541d45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037125 Jul 26 20:35:34.234719 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3346/6766] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:35:34.295465 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05e47c35-124e-4083-a5bc-59d803ff403f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:34.303187 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-05e47c35-124e-4083-a5bc-59d803ff403f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1675 microversion: 2.1 time: 0.185046 Jul 26 20:35:34.303765 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3421/6767] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:34 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:35:35.326514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a5299ff-ceaf-412f-aa26-bf008c222587 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:35.327167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a5299ff-ceaf-412f-aa26-bf008c222587 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:35.334676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a5299ff-ceaf-412f-aa26-bf008c222587 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:35.335142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a5299ff-ceaf-412f-aa26-bf008c222587 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:35.335960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a5299ff-ceaf-412f-aa26-bf008c222587 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:35.336412 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a5299ff-ceaf-412f-aa26-bf008c222587 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:35.479653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1a5299ff-ceaf-412f-aa26-bf008c222587 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:35.483202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:35.488214 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a5299ff-ceaf-412f-aa26-bf008c222587 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1675 microversion: 2.1 time: 0.166720 Jul 26 20:35:35.488804 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3347/6768] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:35 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:36.408539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-87bcf7a5-d4c4-4563-867a-ea054d2dcda8 req-430af868-3bab-40e2-8833-9a10b4787306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edabf07-d1e9-4f4d-9c16-7b6ce30147b5", "name": "network-vif-deleted", "tag": "234571c2-6668-4d63-bfdf-baff5db2c3d2"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:36.423732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-87bcf7a5-d4c4-4563-867a-ea054d2dcda8 req-430af868-3bab-40e2-8833-9a10b4787306 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:36.424192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-87bcf7a5-d4c4-4563-867a-ea054d2dcda8 req-430af868-3bab-40e2-8833-9a10b4787306 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:36.438701 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-87bcf7a5-d4c4-4563-867a-ea054d2dcda8 req-430af868-3bab-40e2-8833-9a10b4787306 service nova] Creating event network-vif-deleted:234571c2-6668-4d63-bfdf-baff5db2c3d2 for instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 on n-h1-708768-8 Jul 26 20:35:36.445322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-87bcf7a5-d4c4-4563-867a-ea054d2dcda8 req-430af868-3bab-40e2-8833-9a10b4787306 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042387 Jul 26 20:35:36.445894 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3422/6769] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:35:36.510849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:36.511399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:36.519693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:36.520533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:36.521548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:36.522142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:36.560173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:36.560646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:36.561115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lazy-loading 'fault' on Instance uuid 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:35:36.608618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:36.616267 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fd25d449-47ad-4072-9b9c-4501128138b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 200 len: 1328 microversion: 2.1 time: 0.110780 Jul 26 20:35:36.616857 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3348/6770] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:36 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:37.638497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:37.639224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:37.646690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:37.647132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:37.647969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:37.648434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:37.662148 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 HTTP/1.1 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '0edabf07-d1e9-4f4d-9c16-7b6ce30147b5'} Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:35:37.663825 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9828df2-0f7d-4b07-b91f-63b6e66c3be6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 404 len: 111 microversion: 2.1 time: 0.031433 Jul 26 20:35:37.667518 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3423/6771] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:37 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:35:37.679394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:37.680053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:37.687490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:37.688021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:37.688798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:37.689267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:37.702520 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 HTTP/1.1 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '0edabf07-d1e9-4f4d-9c16-7b6ce30147b5'} Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:35:37.704202 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f39809e8-4b5b-4da2-b9c5-2bf4df611b10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 404 len: 111 microversion: 2.1 time: 0.030278 Jul 26 20:35:37.707996 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3349/6772] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:37 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:35:37.753657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-296851208", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "1af22061-3ea1-493f-92b0-f1e5d7a4cdaf"}], "security_groups": [{"name": "tempest-securitygroup--234704078"}], "key_name": "tempest-keypair-800196711", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:37.859561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] validate_networks() for [('1af22061-3ea1-493f-92b0-f1e5d7a4cdaf', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:35:38.223901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:35:38.224331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:35:38.224809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:35:38.225223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:35:38.225635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:35:38.235501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:38.235991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:38.236796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:38.237237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:38.253693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:35:38.258917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for user a6d13710ea1a4204bb0b70c1964c4d09 and project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:35:38.271257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:35:38.273572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:35:38.319630 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66d02c62-c9a3-4c00-836b-51b503b6b580 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.569889 Jul 26 20:35:38.320308 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3424/6773] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:35:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:35:38.332062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c181e295-0936-4713-9010-77cec33fda96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:38.332691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c181e295-0936-4713-9010-77cec33fda96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:38.388825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c181e295-0936-4713-9010-77cec33fda96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:38.395730 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c181e295-0936-4713-9010-77cec33fda96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1237 microversion: 2.1 time: 0.067537 Jul 26 20:35:38.396505 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3350/6774] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:38 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:39.419287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1ac8d497-6ea3-47ef-a1a0-a0011d5222bb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:39.420062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1ac8d497-6ea3-47ef-a1a0-a0011d5222bb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:39.427266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ac8d497-6ea3-47ef-a1a0-a0011d5222bb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:39.427858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ac8d497-6ea3-47ef-a1a0-a0011d5222bb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:39.428701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ac8d497-6ea3-47ef-a1a0-a0011d5222bb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:39.429212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ac8d497-6ea3-47ef-a1a0-a0011d5222bb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:39.495859 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ac8d497-6ea3-47ef-a1a0-a0011d5222bb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:39.515001 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1ac8d497-6ea3-47ef-a1a0-a0011d5222bb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1295 microversion: 2.1 time: 0.089723 Jul 26 20:35:39.515869 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3425/6775] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:39 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:40.538481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-753d9028-b00d-4ca5-b3a3-205c734135c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:40.539254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-753d9028-b00d-4ca5-b3a3-205c734135c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:40.548093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-753d9028-b00d-4ca5-b3a3-205c734135c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:40.548559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-753d9028-b00d-4ca5-b3a3-205c734135c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:40.549378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-753d9028-b00d-4ca5-b3a3-205c734135c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:40.549829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-753d9028-b00d-4ca5-b3a3-205c734135c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:40.589975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e23dddfb-90f6-4b85-8692-229673248b6a req-0156e83f-0633-426e-9268-602778514657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660271a7-1058-47f3-b4e3-62fef3cc675b", "tag": "162eab6e-241f-43c4-8b6a-4a5143acf628"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:40.614770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e23dddfb-90f6-4b85-8692-229673248b6a req-0156e83f-0633-426e-9268-602778514657 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:40.615448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e23dddfb-90f6-4b85-8692-229673248b6a req-0156e83f-0633-426e-9268-602778514657 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:40.630947 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e23dddfb-90f6-4b85-8692-229673248b6a req-0156e83f-0633-426e-9268-602778514657 service nova] Creating event network-changed:162eab6e-241f-43c4-8b6a-4a5143acf628 for instance 660271a7-1058-47f3-b4e3-62fef3cc675b on n-h2-708768-8 Jul 26 20:35:40.636301 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e23dddfb-90f6-4b85-8692-229673248b6a req-0156e83f-0633-426e-9268-602778514657 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050282 Jul 26 20:35:40.637445 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3426/6776] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:35:40.808363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-753d9028-b00d-4ca5-b3a3-205c734135c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:40.817109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-753d9028-b00d-4ca5-b3a3-205c734135c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1362 microversion: 2.1 time: 0.282392 Jul 26 20:35:40.818698 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3351/6777] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:40 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:41.842438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e035e430-2125-42d2-9f9b-50901f8d7e23 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:41.843151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e035e430-2125-42d2-9f9b-50901f8d7e23 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:41.849612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e035e430-2125-42d2-9f9b-50901f8d7e23 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:41.850071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e035e430-2125-42d2-9f9b-50901f8d7e23 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:41.850848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e035e430-2125-42d2-9f9b-50901f8d7e23 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:41.851294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e035e430-2125-42d2-9f9b-50901f8d7e23 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:41.982772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e035e430-2125-42d2-9f9b-50901f8d7e23 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:41.990354 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e035e430-2125-42d2-9f9b-50901f8d7e23 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1362 microversion: 2.1 time: 0.153714 Jul 26 20:35:41.990926 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3427/6778] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:41 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:43.013540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e1e4e36b-977e-4716-af9b-da089718139b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:43.014173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e1e4e36b-977e-4716-af9b-da089718139b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:43.021361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1e4e36b-977e-4716-af9b-da089718139b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:43.021838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1e4e36b-977e-4716-af9b-da089718139b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:43.022631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1e4e36b-977e-4716-af9b-da089718139b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:43.023097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e1e4e36b-977e-4716-af9b-da089718139b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:43.151433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e1e4e36b-977e-4716-af9b-da089718139b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:43.159914 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e1e4e36b-977e-4716-af9b-da089718139b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1362 microversion: 2.1 time: 0.151045 Jul 26 20:35:43.160482 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3352/6779] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:43 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:35:44.180904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-99389a9e-fc07-4a97-8652-d79d3fd093e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:44.181655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-99389a9e-fc07-4a97-8652-d79d3fd093e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:44.185500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:44.190788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99389a9e-fc07-4a97-8652-d79d3fd093e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:44.191243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99389a9e-fc07-4a97-8652-d79d3fd093e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:44.192054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99389a9e-fc07-4a97-8652-d79d3fd093e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:44.192495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-99389a9e-fc07-4a97-8652-d79d3fd093e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:44.327754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-99389a9e-fc07-4a97-8652-d79d3fd093e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:44.335240 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-99389a9e-fc07-4a97-8652-d79d3fd093e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1362 microversion: 2.1 time: 0.158320 Jul 26 20:35:44.335842 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3428/6780] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:44 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:45.357212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b4d6d343-e683-498f-8c51-9ee0c6ba2abd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:45.357869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b4d6d343-e683-498f-8c51-9ee0c6ba2abd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:45.360733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:45.366096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4d6d343-e683-498f-8c51-9ee0c6ba2abd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:45.366564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4d6d343-e683-498f-8c51-9ee0c6ba2abd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:45.367345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4d6d343-e683-498f-8c51-9ee0c6ba2abd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:45.367840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b4d6d343-e683-498f-8c51-9ee0c6ba2abd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:45.501221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b4d6d343-e683-498f-8c51-9ee0c6ba2abd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:45.508712 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b4d6d343-e683-498f-8c51-9ee0c6ba2abd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1362 microversion: 2.1 time: 0.155524 Jul 26 20:35:45.509291 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3353/6781] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:45 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:46.130777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-99f1a390-679c-4560-b88e-521bb750ae65 req-9f95c906-b42c-44e9-ba76-9dbc918a446d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660271a7-1058-47f3-b4e3-62fef3cc675b", "name": "network-vif-plugged", "status": "completed", "tag": "162eab6e-241f-43c4-8b6a-4a5143acf628"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:46.143816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-99f1a390-679c-4560-b88e-521bb750ae65 req-9f95c906-b42c-44e9-ba76-9dbc918a446d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:46.145631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-99f1a390-679c-4560-b88e-521bb750ae65 req-9f95c906-b42c-44e9-ba76-9dbc918a446d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:46.156348 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-99f1a390-679c-4560-b88e-521bb750ae65 req-9f95c906-b42c-44e9-ba76-9dbc918a446d service nova] Creating event network-vif-plugged:162eab6e-241f-43c4-8b6a-4a5143acf628 for instance 660271a7-1058-47f3-b4e3-62fef3cc675b on n-h2-708768-8 Jul 26 20:35:46.161479 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-99f1a390-679c-4560-b88e-521bb750ae65 req-9f95c906-b42c-44e9-ba76-9dbc918a446d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034421 Jul 26 20:35:46.162520 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3429/6782] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:35:46.531029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4107af82-8cfc-438f-8e19-cf2f505bff96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:46.531579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4107af82-8cfc-438f-8e19-cf2f505bff96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:46.538549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4107af82-8cfc-438f-8e19-cf2f505bff96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:46.539013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4107af82-8cfc-438f-8e19-cf2f505bff96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:46.539824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4107af82-8cfc-438f-8e19-cf2f505bff96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:46.540278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4107af82-8cfc-438f-8e19-cf2f505bff96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:46.670560 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4107af82-8cfc-438f-8e19-cf2f505bff96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:46.678536 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4107af82-8cfc-438f-8e19-cf2f505bff96 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1362 microversion: 2.1 time: 0.152069 Jul 26 20:35:46.679154 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3354/6783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:46 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:47.701181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3bf8428-b467-46ee-84d5-a32eabb7648a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:47.701803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3bf8428-b467-46ee-84d5-a32eabb7648a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:47.709243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3bf8428-b467-46ee-84d5-a32eabb7648a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:47.709692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3bf8428-b467-46ee-84d5-a32eabb7648a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:47.710454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3bf8428-b467-46ee-84d5-a32eabb7648a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:47.710890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3bf8428-b467-46ee-84d5-a32eabb7648a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:47.844882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c3bf8428-b467-46ee-84d5-a32eabb7648a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:35:47.852635 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3bf8428-b467-46ee-84d5-a32eabb7648a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1549 microversion: 2.1 time: 0.156291 Jul 26 20:35:47.853206 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3430/6784] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:35:47 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:35:47.874988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2284d787-988b-4334-a3ec-944bc08fcd34 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:35:47.875498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2284d787-988b-4334-a3ec-944bc08fcd34 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:35:47.882462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2284d787-988b-4334-a3ec-944bc08fcd34 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:47.882927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2284d787-988b-4334-a3ec-944bc08fcd34 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:47.883734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2284d787-988b-4334-a3ec-944bc08fcd34 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:47.884188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2284d787-988b-4334-a3ec-944bc08fcd34 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:47.960171 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2284d787-988b-4334-a3ec-944bc08fcd34 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089587 Jul 26 20:35:47.960796 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3355/6785] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:35:47 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:35:48.883968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-616124ae-94c4-4aa8-98bc-682ec8be49e0 req-39c0f1ba-be7f-49d8-af2f-756a32fde3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660271a7-1058-47f3-b4e3-62fef3cc675b", "tag": "162eab6e-241f-43c4-8b6a-4a5143acf628"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:35:48.889643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:48.890447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:35:48.899169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-616124ae-94c4-4aa8-98bc-682ec8be49e0 req-39c0f1ba-be7f-49d8-af2f-756a32fde3ee service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:35:48.899647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-616124ae-94c4-4aa8-98bc-682ec8be49e0 req-39c0f1ba-be7f-49d8-af2f-756a32fde3ee service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:35:48.910097 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-616124ae-94c4-4aa8-98bc-682ec8be49e0 req-39c0f1ba-be7f-49d8-af2f-756a32fde3ee service nova] Creating event network-changed:162eab6e-241f-43c4-8b6a-4a5143acf628 for instance 660271a7-1058-47f3-b4e3-62fef3cc675b on n-h2-708768-8 Jul 26 20:35:48.916796 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-616124ae-94c4-4aa8-98bc-682ec8be49e0 req-39c0f1ba-be7f-49d8-af2f-756a32fde3ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036486 Jul 26 20:35:48.917579 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3431/6786] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:36:24.213023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:24.215210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=5 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:24.215970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=38 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:24.220928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9205ff86-fe66-48a4-9c12-4c06c36d9017 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:24.228548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9205ff86-fe66-48a4-9c12-4c06c36d9017 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:24.229013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9205ff86-fe66-48a4-9c12-4c06c36d9017 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:24.253108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9205ff86-fe66-48a4-9c12-4c06c36d9017 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Going to try to stop instance {{(pid=125963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:36:24.295147 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9205ff86-fe66-48a4-9c12-4c06c36d9017 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/action" status: 202 len: 0 microversion: 2.1 time: 0.082452 Jul 26 20:36:24.295720 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3356/6787] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:36:24 2022] POST /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:36:24.302600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=7 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:24.303580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=39 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:24.307595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-135a8d0d-64b5-4579-b1e9-973217dfa55f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:24.308323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-135a8d0d-64b5-4579-b1e9-973217dfa55f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:24.315686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-135a8d0d-64b5-4579-b1e9-973217dfa55f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:24.316124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-135a8d0d-64b5-4579-b1e9-973217dfa55f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:24.316902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-135a8d0d-64b5-4579-b1e9-973217dfa55f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:24.317342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-135a8d0d-64b5-4579-b1e9-973217dfa55f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:24.452385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-135a8d0d-64b5-4579-b1e9-973217dfa55f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:24.460321 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-135a8d0d-64b5-4579-b1e9-973217dfa55f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.159509 Jul 26 20:36:24.460889 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3432/6788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:24 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:36:24.691975 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:36:24.692161 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:36:25.483844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a637e841-110b-4f32-b3e3-71e138ecab35 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:25.484567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a637e841-110b-4f32-b3e3-71e138ecab35 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:25.490898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a637e841-110b-4f32-b3e3-71e138ecab35 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:25.491360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a637e841-110b-4f32-b3e3-71e138ecab35 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:25.492169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a637e841-110b-4f32-b3e3-71e138ecab35 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:25.492623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a637e841-110b-4f32-b3e3-71e138ecab35 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:25.626755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a637e841-110b-4f32-b3e3-71e138ecab35 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:25.634222 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a637e841-110b-4f32-b3e3-71e138ecab35 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.156408 Jul 26 20:36:25.634787 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3357/6789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:25 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:26.658130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8045ac6e-4916-4911-a081-3909eaf45f78 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:26.658756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8045ac6e-4916-4911-a081-3909eaf45f78 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:26.665417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8045ac6e-4916-4911-a081-3909eaf45f78 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:26.665871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8045ac6e-4916-4911-a081-3909eaf45f78 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:26.666643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8045ac6e-4916-4911-a081-3909eaf45f78 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:26.667089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8045ac6e-4916-4911-a081-3909eaf45f78 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:26.799009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8045ac6e-4916-4911-a081-3909eaf45f78 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:26.806594 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8045ac6e-4916-4911-a081-3909eaf45f78 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.153133 Jul 26 20:36:26.807189 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3433/6790] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:26 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:27.828189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c006f552-84bb-4227-add1-0e07a38c9f10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:27.828821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c006f552-84bb-4227-add1-0e07a38c9f10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:27.835972 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c006f552-84bb-4227-add1-0e07a38c9f10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:27.836465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c006f552-84bb-4227-add1-0e07a38c9f10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:27.837285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c006f552-84bb-4227-add1-0e07a38c9f10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:27.837741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c006f552-84bb-4227-add1-0e07a38c9f10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:28.038942 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c006f552-84bb-4227-add1-0e07a38c9f10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:28.047089 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c006f552-84bb-4227-add1-0e07a38c9f10 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.223110 Jul 26 20:36:28.047972 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3358/6791] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:27 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:29.070110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96ec6285-2f79-47ab-b759-a7ec1e352a80 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:29.070634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-96ec6285-2f79-47ab-b759-a7ec1e352a80 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:29.077865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96ec6285-2f79-47ab-b759-a7ec1e352a80 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:29.078314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96ec6285-2f79-47ab-b759-a7ec1e352a80 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:29.079081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96ec6285-2f79-47ab-b759-a7ec1e352a80 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:29.079520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-96ec6285-2f79-47ab-b759-a7ec1e352a80 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:29.210076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-96ec6285-2f79-47ab-b759-a7ec1e352a80 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:29.217801 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96ec6285-2f79-47ab-b759-a7ec1e352a80 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.151894 Jul 26 20:36:29.218376 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3434/6792] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:29 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:30.239008 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3c68b864-eb25-4065-95d4-6088a1f22844 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:30.239654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3c68b864-eb25-4065-95d4-6088a1f22844 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:30.246586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c68b864-eb25-4065-95d4-6088a1f22844 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:30.247048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c68b864-eb25-4065-95d4-6088a1f22844 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:30.247875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c68b864-eb25-4065-95d4-6088a1f22844 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:30.248332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3c68b864-eb25-4065-95d4-6088a1f22844 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:30.379891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3c68b864-eb25-4065-95d4-6088a1f22844 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:30.388365 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3c68b864-eb25-4065-95d4-6088a1f22844 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.153343 Jul 26 20:36:30.389472 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3359/6793] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:30 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:31.410613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-93b01837-10b7-4d9f-acba-e10d8fed2230 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:31.411233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-93b01837-10b7-4d9f-acba-e10d8fed2230 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:31.418225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93b01837-10b7-4d9f-acba-e10d8fed2230 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:31.418682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93b01837-10b7-4d9f-acba-e10d8fed2230 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:31.419454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93b01837-10b7-4d9f-acba-e10d8fed2230 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:31.419925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-93b01837-10b7-4d9f-acba-e10d8fed2230 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:31.549459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-93b01837-10b7-4d9f-acba-e10d8fed2230 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:31.557094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-93b01837-10b7-4d9f-acba-e10d8fed2230 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.150446 Jul 26 20:36:31.557669 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3435/6794] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:31 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:32.578272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8631bde-38ca-4189-a85c-2d030e79117c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:32.578888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8631bde-38ca-4189-a85c-2d030e79117c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:32.586191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8631bde-38ca-4189-a85c-2d030e79117c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:32.586664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8631bde-38ca-4189-a85c-2d030e79117c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:32.587447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8631bde-38ca-4189-a85c-2d030e79117c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:32.587930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8631bde-38ca-4189-a85c-2d030e79117c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:32.715974 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b8631bde-38ca-4189-a85c-2d030e79117c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:32.724384 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8631bde-38ca-4189-a85c-2d030e79117c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.150109 Jul 26 20:36:32.725082 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3360/6795] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:32 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:33.746432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-586a887c-69af-4108-87d0-f4f335598cd1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:33.747047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-586a887c-69af-4108-87d0-f4f335598cd1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:33.754656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-586a887c-69af-4108-87d0-f4f335598cd1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:33.755109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-586a887c-69af-4108-87d0-f4f335598cd1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:33.755902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-586a887c-69af-4108-87d0-f4f335598cd1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:33.756350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-586a887c-69af-4108-87d0-f4f335598cd1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:33.889805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-586a887c-69af-4108-87d0-f4f335598cd1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:33.897355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-586a887c-69af-4108-87d0-f4f335598cd1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.154927 Jul 26 20:36:33.897931 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3436/6796] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:33 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:34.918683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1719d620-615d-4528-898b-69aadce082ff tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:34.919303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1719d620-615d-4528-898b-69aadce082ff tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:34.926795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1719d620-615d-4528-898b-69aadce082ff tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:34.927250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1719d620-615d-4528-898b-69aadce082ff tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:34.928048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1719d620-615d-4528-898b-69aadce082ff tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:34.928493 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1719d620-615d-4528-898b-69aadce082ff tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:35.056340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1719d620-615d-4528-898b-69aadce082ff tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:35.064611 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1719d620-615d-4528-898b-69aadce082ff tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.149887 Jul 26 20:36:35.065181 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3361/6797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:34 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:36.088493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-55475702-6f93-436c-bb91-8a0b928ec7f7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:36.089124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-55475702-6f93-436c-bb91-8a0b928ec7f7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:36.096390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55475702-6f93-436c-bb91-8a0b928ec7f7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:36.096845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55475702-6f93-436c-bb91-8a0b928ec7f7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:36.097613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55475702-6f93-436c-bb91-8a0b928ec7f7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:36.098055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-55475702-6f93-436c-bb91-8a0b928ec7f7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:36.228367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-55475702-6f93-436c-bb91-8a0b928ec7f7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:36.236406 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-55475702-6f93-436c-bb91-8a0b928ec7f7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.151763 Jul 26 20:36:36.236989 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3437/6798] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:36 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:36:37.258113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-723ab02b-ce6f-40bb-9567-8cd8d419ce87 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:37.258746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-723ab02b-ce6f-40bb-9567-8cd8d419ce87 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:37.265812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-723ab02b-ce6f-40bb-9567-8cd8d419ce87 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:37.266280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-723ab02b-ce6f-40bb-9567-8cd8d419ce87 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:37.267060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-723ab02b-ce6f-40bb-9567-8cd8d419ce87 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:37.267513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-723ab02b-ce6f-40bb-9567-8cd8d419ce87 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:37.405332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-723ab02b-ce6f-40bb-9567-8cd8d419ce87 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:37.412992 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-723ab02b-ce6f-40bb-9567-8cd8d419ce87 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.158908 Jul 26 20:36:37.413571 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3362/6799] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:37 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:38.436340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eab0abb9-9e72-4fdc-85cb-48abdc555afb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:38.436992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eab0abb9-9e72-4fdc-85cb-48abdc555afb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:38.443937 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eab0abb9-9e72-4fdc-85cb-48abdc555afb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:38.444394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eab0abb9-9e72-4fdc-85cb-48abdc555afb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:38.445165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eab0abb9-9e72-4fdc-85cb-48abdc555afb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:38.445608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eab0abb9-9e72-4fdc-85cb-48abdc555afb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:38.572174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eab0abb9-9e72-4fdc-85cb-48abdc555afb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:38.579974 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eab0abb9-9e72-4fdc-85cb-48abdc555afb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.148157 Jul 26 20:36:38.580556 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3438/6800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:38 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:39.601398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5899b2d-4370-41bc-a6b2-a890c743a6ba tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:39.602013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c5899b2d-4370-41bc-a6b2-a890c743a6ba tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:39.609214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5899b2d-4370-41bc-a6b2-a890c743a6ba tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:39.609679 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5899b2d-4370-41bc-a6b2-a890c743a6ba tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:39.610467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5899b2d-4370-41bc-a6b2-a890c743a6ba tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:39.610923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5899b2d-4370-41bc-a6b2-a890c743a6ba tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:39.740879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c5899b2d-4370-41bc-a6b2-a890c743a6ba tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:39.749069 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c5899b2d-4370-41bc-a6b2-a890c743a6ba tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1655 microversion: 2.1 time: 0.151893 Jul 26 20:36:39.749676 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3363/6801] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:39 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:39.770212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:39.772515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:39.779521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:39.780026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:39.780835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:39.781310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:39.813125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:39.822014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Old instance type m1.heat2, new instance type m1.heat {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:36:39.828478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:36:39.828904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:36:39.829382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:36:39.829792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:36:39.830204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:36:39.893347 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21977cb0-e385-40e0-9279-d62dd5bf0991 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/action" status: 202 len: 0 microversion: 2.1 time: 0.127101 Jul 26 20:36:39.893979 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3439/6802] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:36:39 2022] POST /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:36:39.902390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7ec2aa5d-cfc9-4662-9ad2-7a4b879a4e7f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:39.903023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7ec2aa5d-cfc9-4662-9ad2-7a4b879a4e7f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:39.909584 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ec2aa5d-cfc9-4662-9ad2-7a4b879a4e7f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:39.910050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ec2aa5d-cfc9-4662-9ad2-7a4b879a4e7f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:39.910843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ec2aa5d-cfc9-4662-9ad2-7a4b879a4e7f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:39.911300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7ec2aa5d-cfc9-4662-9ad2-7a4b879a4e7f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:40.072800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7ec2aa5d-cfc9-4662-9ad2-7a4b879a4e7f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:40.081028 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7ec2aa5d-cfc9-4662-9ad2-7a4b879a4e7f tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.182611 Jul 26 20:36:40.081687 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3364/6803] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:39 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:41.104710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8bb29b9c-fc74-4d61-8e83-72eed6b9e3f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:41.106177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8bb29b9c-fc74-4d61-8e83-72eed6b9e3f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:41.114002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8bb29b9c-fc74-4d61-8e83-72eed6b9e3f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:41.114458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8bb29b9c-fc74-4d61-8e83-72eed6b9e3f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:41.115840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8bb29b9c-fc74-4d61-8e83-72eed6b9e3f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:41.116687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8bb29b9c-fc74-4d61-8e83-72eed6b9e3f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:41.252560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8bb29b9c-fc74-4d61-8e83-72eed6b9e3f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:41.260235 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8bb29b9c-fc74-4d61-8e83-72eed6b9e3f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1678 microversion: 2.1 time: 0.161712 Jul 26 20:36:41.260859 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3440/6804] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:41 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:42.282166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-93e1e91e-a6b3-482f-a207-3d690252fd58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:42.282702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-93e1e91e-a6b3-482f-a207-3d690252fd58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:42.289838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93e1e91e-a6b3-482f-a207-3d690252fd58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:42.290300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93e1e91e-a6b3-482f-a207-3d690252fd58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:42.291075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93e1e91e-a6b3-482f-a207-3d690252fd58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:42.291530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93e1e91e-a6b3-482f-a207-3d690252fd58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:42.424347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-93e1e91e-a6b3-482f-a207-3d690252fd58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:42.431850 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-93e1e91e-a6b3-482f-a207-3d690252fd58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1683 microversion: 2.1 time: 0.153699 Jul 26 20:36:42.432424 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3365/6805] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:42 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:43.454793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2505ed01-0243-4523-b487-896aa1aa526d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:43.455390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2505ed01-0243-4523-b487-896aa1aa526d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:43.462318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2505ed01-0243-4523-b487-896aa1aa526d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:43.462772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2505ed01-0243-4523-b487-896aa1aa526d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:43.463539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2505ed01-0243-4523-b487-896aa1aa526d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:43.464016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2505ed01-0243-4523-b487-896aa1aa526d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:43.609501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2505ed01-0243-4523-b487-896aa1aa526d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:43.617230 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2505ed01-0243-4523-b487-896aa1aa526d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1683 microversion: 2.1 time: 0.167064 Jul 26 20:36:43.627943 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3441/6806] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:43 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:44.302723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7695ad74-05b9-4e0e-8301-47f664512bae req-8b509b8a-e493-4b5e-b093-03c879c624b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660271a7-1058-47f3-b4e3-62fef3cc675b", "name": "network-vif-unplugged", "status": "completed", "tag": "162eab6e-241f-43c4-8b6a-4a5143acf628"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:44.314496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7695ad74-05b9-4e0e-8301-47f664512bae req-8b509b8a-e493-4b5e-b093-03c879c624b9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:44.314949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7695ad74-05b9-4e0e-8301-47f664512bae req-8b509b8a-e493-4b5e-b093-03c879c624b9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:44.327794 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7695ad74-05b9-4e0e-8301-47f664512bae req-8b509b8a-e493-4b5e-b093-03c879c624b9 service nova] Creating event network-vif-unplugged:162eab6e-241f-43c4-8b6a-4a5143acf628 for instance 660271a7-1058-47f3-b4e3-62fef3cc675b on n-h1-708768-8 Jul 26 20:36:44.333270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-7695ad74-05b9-4e0e-8301-47f664512bae req-8b509b8a-e493-4b5e-b093-03c879c624b9 service nova] Instance 660271a7-1058-47f3-b4e3-62fef3cc675b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:36:44.345391 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7695ad74-05b9-4e0e-8301-47f664512bae req-8b509b8a-e493-4b5e-b093-03c879c624b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046347 Jul 26 20:36:44.346194 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3366/6807] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:36:44.639751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b0d65ee0-d216-4159-980a-079a314829a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:44.640274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b0d65ee0-d216-4159-980a-079a314829a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:44.647273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0d65ee0-d216-4159-980a-079a314829a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:44.647759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0d65ee0-d216-4159-980a-079a314829a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:44.648538 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0d65ee0-d216-4159-980a-079a314829a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:44.648977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b0d65ee0-d216-4159-980a-079a314829a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:44.877889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b0d65ee0-d216-4159-980a-079a314829a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:44.892258 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b0d65ee0-d216-4159-980a-079a314829a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1682 microversion: 2.1 time: 0.256125 Jul 26 20:36:44.893439 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3442/6808] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:44 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:45.916370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c15dd63-2038-4de2-89c9-4245f164227e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:45.917089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c15dd63-2038-4de2-89c9-4245f164227e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:45.924595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c15dd63-2038-4de2-89c9-4245f164227e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:45.925061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c15dd63-2038-4de2-89c9-4245f164227e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:45.925835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c15dd63-2038-4de2-89c9-4245f164227e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:45.926286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c15dd63-2038-4de2-89c9-4245f164227e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:46.058116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0c15dd63-2038-4de2-89c9-4245f164227e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:46.065966 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c15dd63-2038-4de2-89c9-4245f164227e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1680 microversion: 2.1 time: 0.154896 Jul 26 20:36:46.066543 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3367/6809] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:45 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:46.360430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1e7cdad9-a795-414b-9c71-1410cb5df19c req-40bc0cf1-2d44-49be-8f2b-842df4923617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660271a7-1058-47f3-b4e3-62fef3cc675b", "tag": "162eab6e-241f-43c4-8b6a-4a5143acf628"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:46.370618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1e7cdad9-a795-414b-9c71-1410cb5df19c req-40bc0cf1-2d44-49be-8f2b-842df4923617 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:46.371122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1e7cdad9-a795-414b-9c71-1410cb5df19c req-40bc0cf1-2d44-49be-8f2b-842df4923617 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:46.382545 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1e7cdad9-a795-414b-9c71-1410cb5df19c req-40bc0cf1-2d44-49be-8f2b-842df4923617 service nova] Creating event network-changed:162eab6e-241f-43c4-8b6a-4a5143acf628 for instance 660271a7-1058-47f3-b4e3-62fef3cc675b on n-h1-708768-8 Jul 26 20:36:46.388737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-1e7cdad9-a795-414b-9c71-1410cb5df19c req-40bc0cf1-2d44-49be-8f2b-842df4923617 service nova] Instance 660271a7-1058-47f3-b4e3-62fef3cc675b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:36:46.400111 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1e7cdad9-a795-414b-9c71-1410cb5df19c req-40bc0cf1-2d44-49be-8f2b-842df4923617 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043308 Jul 26 20:36:46.400743 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3443/6810] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:36:47.088277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa4f4d53-c58e-4753-8de7-fd9edf31fb2a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:47.088895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa4f4d53-c58e-4753-8de7-fd9edf31fb2a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:47.095874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa4f4d53-c58e-4753-8de7-fd9edf31fb2a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:47.096330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa4f4d53-c58e-4753-8de7-fd9edf31fb2a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:47.097109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa4f4d53-c58e-4753-8de7-fd9edf31fb2a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:47.097554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa4f4d53-c58e-4753-8de7-fd9edf31fb2a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:47.510554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa4f4d53-c58e-4753-8de7-fd9edf31fb2a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:47.518019 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa4f4d53-c58e-4753-8de7-fd9edf31fb2a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1676 microversion: 2.1 time: 0.433957 Jul 26 20:36:47.518588 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3368/6811] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:47 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1676 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:47.541106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cca1c592-b832-4fb7-addd-dc9682b710a7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:47.541762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cca1c592-b832-4fb7-addd-dc9682b710a7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:47.549017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cca1c592-b832-4fb7-addd-dc9682b710a7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:47.549468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cca1c592-b832-4fb7-addd-dc9682b710a7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:47.550233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cca1c592-b832-4fb7-addd-dc9682b710a7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:47.550674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cca1c592-b832-4fb7-addd-dc9682b710a7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:47.608767 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cca1c592-b832-4fb7-addd-dc9682b710a7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/action" status: 204 len: 0 microversion: 2.1 time: 0.072688 Jul 26 20:36:47.609394 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3444/6812] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:36:47 2022] POST /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:36:47.617675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-19a4ceb8-25be-47fc-98ed-f15afcfe5bdf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:47.618317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-19a4ceb8-25be-47fc-98ed-f15afcfe5bdf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:47.624848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19a4ceb8-25be-47fc-98ed-f15afcfe5bdf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:47.625441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19a4ceb8-25be-47fc-98ed-f15afcfe5bdf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:47.626496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19a4ceb8-25be-47fc-98ed-f15afcfe5bdf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:47.627061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-19a4ceb8-25be-47fc-98ed-f15afcfe5bdf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:47.837638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-19a4ceb8-25be-47fc-98ed-f15afcfe5bdf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:47.846274 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-19a4ceb8-25be-47fc-98ed-f15afcfe5bdf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1676 microversion: 2.1 time: 0.232587 Jul 26 20:36:47.846853 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3369/6813] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:47 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:48.869503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5d0e428b-dde9-4ee6-8116-6e7a0fa1469d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:48.870218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5d0e428b-dde9-4ee6-8116-6e7a0fa1469d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:48.877240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d0e428b-dde9-4ee6-8116-6e7a0fa1469d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:48.877709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d0e428b-dde9-4ee6-8116-6e7a0fa1469d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:48.878505 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d0e428b-dde9-4ee6-8116-6e7a0fa1469d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:48.878942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5d0e428b-dde9-4ee6-8116-6e7a0fa1469d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:49.018694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5d0e428b-dde9-4ee6-8116-6e7a0fa1469d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:49.026506 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5d0e428b-dde9-4ee6-8116-6e7a0fa1469d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1655 microversion: 2.1 time: 0.162303 Jul 26 20:36:49.026963 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3445/6814] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:48 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:49.048605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c07e2651-d8e0-433c-a987-898954a4cde6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:49.049243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c07e2651-d8e0-433c-a987-898954a4cde6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:49.056298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c07e2651-d8e0-433c-a987-898954a4cde6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:49.056762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c07e2651-d8e0-433c-a987-898954a4cde6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:49.057532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c07e2651-d8e0-433c-a987-898954a4cde6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:49.057981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c07e2651-d8e0-433c-a987-898954a4cde6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:49.188220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c07e2651-d8e0-433c-a987-898954a4cde6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:49.195847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c07e2651-d8e0-433c-a987-898954a4cde6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1655 microversion: 2.1 time: 0.151940 Jul 26 20:36:49.196423 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3370/6815] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:49 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:49.217348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed3dfaf2-309b-492c-80da-9c00078c39fb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:49.223409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed3dfaf2-309b-492c-80da-9c00078c39fb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:49.223894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed3dfaf2-309b-492c-80da-9c00078c39fb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:49.237493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:49.246942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed3dfaf2-309b-492c-80da-9c00078c39fb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Going to try to start instance {{(pid=125964) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 20:36:49.287766 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed3dfaf2-309b-492c-80da-9c00078c39fb tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/action" status: 202 len: 0 microversion: 2.1 time: 0.074886 Jul 26 20:36:49.288362 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3446/6816] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:36:49 2022] POST /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:36:49.296505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f8cefa33-a835-4507-a2fb-bd5e6a932806 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:49.297394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f8cefa33-a835-4507-a2fb-bd5e6a932806 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:49.303587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8cefa33-a835-4507-a2fb-bd5e6a932806 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:49.304215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8cefa33-a835-4507-a2fb-bd5e6a932806 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:49.305056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8cefa33-a835-4507-a2fb-bd5e6a932806 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:49.305540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f8cefa33-a835-4507-a2fb-bd5e6a932806 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:49.443404 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f8cefa33-a835-4507-a2fb-bd5e6a932806 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:49.447118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:49.453021 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f8cefa33-a835-4507-a2fb-bd5e6a932806 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1664 microversion: 2.1 time: 0.160356 Jul 26 20:36:49.453704 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3371/6817] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:49 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:50.474613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8638db3c-e123-4862-b20d-8b9d51a4c17e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:50.475326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8638db3c-e123-4862-b20d-8b9d51a4c17e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:50.485355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8638db3c-e123-4862-b20d-8b9d51a4c17e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:50.485964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8638db3c-e123-4862-b20d-8b9d51a4c17e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:50.486772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8638db3c-e123-4862-b20d-8b9d51a4c17e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:50.487230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8638db3c-e123-4862-b20d-8b9d51a4c17e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:50.518883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a2c45cec-3047-4e08-ae8f-2cbe745a6ccd req-6d32d32e-45f2-4cc6-82b7-0aec1630ffa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660271a7-1058-47f3-b4e3-62fef3cc675b", "name": "network-vif-plugged", "status": "completed", "tag": "162eab6e-241f-43c4-8b6a-4a5143acf628"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:50.537705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a2c45cec-3047-4e08-ae8f-2cbe745a6ccd req-6d32d32e-45f2-4cc6-82b7-0aec1630ffa8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:50.538154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a2c45cec-3047-4e08-ae8f-2cbe745a6ccd req-6d32d32e-45f2-4cc6-82b7-0aec1630ffa8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:50.550651 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a2c45cec-3047-4e08-ae8f-2cbe745a6ccd req-6d32d32e-45f2-4cc6-82b7-0aec1630ffa8 service nova] Creating event network-vif-plugged:162eab6e-241f-43c4-8b6a-4a5143acf628 for instance 660271a7-1058-47f3-b4e3-62fef3cc675b on n-h1-708768-8 Jul 26 20:36:50.555921 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a2c45cec-3047-4e08-ae8f-2cbe745a6ccd req-6d32d32e-45f2-4cc6-82b7-0aec1630ffa8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111952 Jul 26 20:36:50.556826 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3447/6818] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:36:50.623113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8638db3c-e123-4862-b20d-8b9d51a4c17e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:50.630640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8638db3c-e123-4862-b20d-8b9d51a4c17e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1668 microversion: 2.1 time: 0.159913 Jul 26 20:36:50.631223 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3372/6819] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:50 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:36:50.651669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a0ae7ef-0021-46ee-abdd-ac25e006d76b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:50.652261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a0ae7ef-0021-46ee-abdd-ac25e006d76b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:50.659025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a0ae7ef-0021-46ee-abdd-ac25e006d76b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:50.659475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a0ae7ef-0021-46ee-abdd-ac25e006d76b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:50.660306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a0ae7ef-0021-46ee-abdd-ac25e006d76b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:50.660745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a0ae7ef-0021-46ee-abdd-ac25e006d76b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:50.686135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a0ae7ef-0021-46ee-abdd-ac25e006d76b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:36:50.761029 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a0ae7ef-0021-46ee-abdd-ac25e006d76b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 204 len: 0 microversion: 2.1 time: 0.113001 Jul 26 20:36:50.761668 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3448/6820] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:36:50 2022] DELETE /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:36:50.771071 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0812d025-61f2-4f94-8221-7ba752a0116c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:50.771732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0812d025-61f2-4f94-8221-7ba752a0116c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:50.777871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0812d025-61f2-4f94-8221-7ba752a0116c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:50.778259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0812d025-61f2-4f94-8221-7ba752a0116c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:50.779793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0812d025-61f2-4f94-8221-7ba752a0116c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:50.780251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0812d025-61f2-4f94-8221-7ba752a0116c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:50.913124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0812d025-61f2-4f94-8221-7ba752a0116c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:50.920628 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0812d025-61f2-4f94-8221-7ba752a0116c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1674 microversion: 2.1 time: 0.153597 Jul 26 20:36:50.921198 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3373/6821] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:50 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:51.943934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3f96d5a0-b1c4-45fa-b058-8fc7dee39e7c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:51.944590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3f96d5a0-b1c4-45fa-b058-8fc7dee39e7c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:51.952251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f96d5a0-b1c4-45fa-b058-8fc7dee39e7c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:51.952709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f96d5a0-b1c4-45fa-b058-8fc7dee39e7c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:51.953491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f96d5a0-b1c4-45fa-b058-8fc7dee39e7c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:51.953935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f96d5a0-b1c4-45fa-b058-8fc7dee39e7c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:52.095202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f96d5a0-b1c4-45fa-b058-8fc7dee39e7c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:52.102887 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3f96d5a0-b1c4-45fa-b058-8fc7dee39e7c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 200 len: 1674 microversion: 2.1 time: 0.164059 Jul 26 20:36:52.103471 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3449/6822] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:51 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:52.901443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7ec7ae3d-cfcf-4562-a9f3-b979321ad5dd req-24031d46-5b3e-4e10-83af-27d33cb238bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660271a7-1058-47f3-b4e3-62fef3cc675b", "name": "network-vif-deleted", "tag": "162eab6e-241f-43c4-8b6a-4a5143acf628"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:52.915485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7ec7ae3d-cfcf-4562-a9f3-b979321ad5dd req-24031d46-5b3e-4e10-83af-27d33cb238bf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:52.916149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7ec7ae3d-cfcf-4562-a9f3-b979321ad5dd req-24031d46-5b3e-4e10-83af-27d33cb238bf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:52.930474 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7ec7ae3d-cfcf-4562-a9f3-b979321ad5dd req-24031d46-5b3e-4e10-83af-27d33cb238bf service nova] Creating event network-vif-deleted:162eab6e-241f-43c4-8b6a-4a5143acf628 for instance 660271a7-1058-47f3-b4e3-62fef3cc675b on n-h1-708768-8 Jul 26 20:36:52.937123 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7ec7ae3d-cfcf-4562-a9f3-b979321ad5dd req-24031d46-5b3e-4e10-83af-27d33cb238bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039896 Jul 26 20:36:52.937741 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3374/6823] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:36:53.124642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:53.125553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:53.133480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:53.133985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:53.135138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:53.135884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:53.150976 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b HTTP/1.1 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '660271a7-1058-47f3-b4e3-62fef3cc675b'} Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:36:53.152731 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4fe02524-a281-453d-979c-a508a2be6ef1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 404 len: 111 microversion: 2.1 time: 0.034262 Jul 26 20:36:53.157444 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3450/6824] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:53 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:36:53.172849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:53.173665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:53.180270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:53.180748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:53.181542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:53.182000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:53.195842 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b HTTP/1.1 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '660271a7-1058-47f3-b4e3-62fef3cc675b'} Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:36:53.197650 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aed471b0-e1cf-44d5-a4a4-c17a8fd0230c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 404 len: 111 microversion: 2.1 time: 0.031123 Jul 26 20:36:53.201946 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3375/6825] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:53 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:36:53.249483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1249068904", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "1af22061-3ea1-493f-92b0-f1e5d7a4cdaf"}], "security_groups": [{"name": "tempest-securitygroup--234704078"}], "key_name": "tempest-keypair-800196711", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:53.354509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] validate_networks() for [('1af22061-3ea1-493f-92b0-f1e5d7a4cdaf', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:36:53.796948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:36:53.797713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:36:53.798234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:36:53.798650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:36:53.799066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:36:53.808407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:53.808860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:53.809673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:53.810749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:53.828079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:36:53.833405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for user a6d13710ea1a4204bb0b70c1964c4d09 and project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:36:53.845933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:36:53.848268 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:36:53.895411 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c42214e3-3572-45b3-b793-7d314b6e573b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.649788 Jul 26 20:36:53.899652 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3451/6826] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:36:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 20:36:53.907105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-27fff4be-683b-4f17-8ca1-e6e837178eef tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:53.907750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-27fff4be-683b-4f17-8ca1-e6e837178eef tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:53.969424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-27fff4be-683b-4f17-8ca1-e6e837178eef tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:53.977327 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-27fff4be-683b-4f17-8ca1-e6e837178eef tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1238 microversion: 2.1 time: 0.074164 Jul 26 20:36:53.977900 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3376/6827] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:53 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:55.000811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8d54093d-cbb6-498f-8341-c5c4cae6ce0d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:55.001549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8d54093d-cbb6-498f-8341-c5c4cae6ce0d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:55.004524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:55.010018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d54093d-cbb6-498f-8341-c5c4cae6ce0d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:55.010542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d54093d-cbb6-498f-8341-c5c4cae6ce0d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:55.011378 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d54093d-cbb6-498f-8341-c5c4cae6ce0d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:55.011919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8d54093d-cbb6-498f-8341-c5c4cae6ce0d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:55.083761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8d54093d-cbb6-498f-8341-c5c4cae6ce0d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:55.091600 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8d54093d-cbb6-498f-8341-c5c4cae6ce0d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1296 microversion: 2.1 time: 0.096487 Jul 26 20:36:55.092219 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3452/6828] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:54 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:56.114958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-550b8ea1-4b3c-4438-8080-5aa9b798a0e1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:56.115648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-550b8ea1-4b3c-4438-8080-5aa9b798a0e1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:56.118537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=45 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:36:56.125244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-550b8ea1-4b3c-4438-8080-5aa9b798a0e1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:56.125913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-550b8ea1-4b3c-4438-8080-5aa9b798a0e1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:56.126720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-550b8ea1-4b3c-4438-8080-5aa9b798a0e1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:56.127352 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-550b8ea1-4b3c-4438-8080-5aa9b798a0e1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:56.332343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-8cb7de01-f08f-4a71-87b9-a4bbe2a49c22 req-9ba2c3e8-5d97-4530-aa3d-82101f13f312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:36:56.354400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8cb7de01-f08f-4a71-87b9-a4bbe2a49c22 req-9ba2c3e8-5d97-4530-aa3d-82101f13f312 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:56.354949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-8cb7de01-f08f-4a71-87b9-a4bbe2a49c22 req-9ba2c3e8-5d97-4530-aa3d-82101f13f312 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:56.357373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-550b8ea1-4b3c-4438-8080-5aa9b798a0e1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:56.367445 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-8cb7de01-f08f-4a71-87b9-a4bbe2a49c22 req-9ba2c3e8-5d97-4530-aa3d-82101f13f312 service nova] Creating event network-changed:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h2-708768-8 Jul 26 20:36:56.372014 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-550b8ea1-4b3c-4438-8080-5aa9b798a0e1 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1363 microversion: 2.1 time: 0.262190 Jul 26 20:36:56.374276 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-8cb7de01-f08f-4a71-87b9-a4bbe2a49c22 req-9ba2c3e8-5d97-4530-aa3d-82101f13f312 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046209 Jul 26 20:36:56.374884 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3453/6829] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:36:56.389132 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3377/6830] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:56 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:57.398243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-25548536-d96c-45c1-8b37-db5e569fe5b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:57.399137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-25548536-d96c-45c1-8b37-db5e569fe5b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:57.406474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25548536-d96c-45c1-8b37-db5e569fe5b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:57.406930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25548536-d96c-45c1-8b37-db5e569fe5b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:57.407739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25548536-d96c-45c1-8b37-db5e569fe5b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:57.408183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25548536-d96c-45c1-8b37-db5e569fe5b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:57.537737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-25548536-d96c-45c1-8b37-db5e569fe5b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:57.546231 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-25548536-d96c-45c1-8b37-db5e569fe5b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1363 microversion: 2.1 time: 0.153497 Jul 26 20:36:57.546846 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3454/6831] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:57 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:58.568547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ff61a5c9-2f16-40c2-a722-94d8d7aa2412 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:58.569212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ff61a5c9-2f16-40c2-a722-94d8d7aa2412 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:58.583393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff61a5c9-2f16-40c2-a722-94d8d7aa2412 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:58.583925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff61a5c9-2f16-40c2-a722-94d8d7aa2412 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:58.584747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff61a5c9-2f16-40c2-a722-94d8d7aa2412 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:58.585205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff61a5c9-2f16-40c2-a722-94d8d7aa2412 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:58.719124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ff61a5c9-2f16-40c2-a722-94d8d7aa2412 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:58.726546 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ff61a5c9-2f16-40c2-a722-94d8d7aa2412 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1363 microversion: 2.1 time: 0.162160 Jul 26 20:36:58.727109 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3378/6832] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:58 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:36:59.748895 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-52627f45-79dc-4313-8a72-c106d97e0099 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:36:59.749504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-52627f45-79dc-4313-8a72-c106d97e0099 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:36:59.756495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52627f45-79dc-4313-8a72-c106d97e0099 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:59.756945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52627f45-79dc-4313-8a72-c106d97e0099 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:59.757714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52627f45-79dc-4313-8a72-c106d97e0099 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:36:59.758150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-52627f45-79dc-4313-8a72-c106d97e0099 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:36:59.887821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-52627f45-79dc-4313-8a72-c106d97e0099 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:36:59.895628 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-52627f45-79dc-4313-8a72-c106d97e0099 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1363 microversion: 2.1 time: 0.151198 Jul 26 20:36:59.896219 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3455/6833] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:36:59 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:00.916500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1a5c1d1-d3e0-4812-9560-0d2ac396220c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:00.917203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1a5c1d1-d3e0-4812-9560-0d2ac396220c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:00.924570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1a5c1d1-d3e0-4812-9560-0d2ac396220c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:00.925784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1a5c1d1-d3e0-4812-9560-0d2ac396220c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:00.927101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1a5c1d1-d3e0-4812-9560-0d2ac396220c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:00.927567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1a5c1d1-d3e0-4812-9560-0d2ac396220c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:01.057001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1a5c1d1-d3e0-4812-9560-0d2ac396220c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:01.065169 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1a5c1d1-d3e0-4812-9560-0d2ac396220c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1363 microversion: 2.1 time: 0.152619 Jul 26 20:37:01.065748 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3379/6834] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:00 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:02.087549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-41916e9f-a4fa-4dd2-841a-c19b1816f7c2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:02.088194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-41916e9f-a4fa-4dd2-841a-c19b1816f7c2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:02.095949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41916e9f-a4fa-4dd2-841a-c19b1816f7c2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:02.096409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41916e9f-a4fa-4dd2-841a-c19b1816f7c2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:02.097186 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41916e9f-a4fa-4dd2-841a-c19b1816f7c2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:02.097633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-41916e9f-a4fa-4dd2-841a-c19b1816f7c2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:02.228015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-41916e9f-a4fa-4dd2-841a-c19b1816f7c2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:02.236564 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-41916e9f-a4fa-4dd2-841a-c19b1816f7c2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1363 microversion: 2.1 time: 0.152946 Jul 26 20:37:02.237145 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3456/6835] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:02 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:02.581392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-365b97bf-b7cb-4b2d-bbed-03337411204b req-f1371970-1292-42a9-a845-e1a55e598759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "name": "network-vif-plugged", "status": "completed", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:37:02.593369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-365b97bf-b7cb-4b2d-bbed-03337411204b req-f1371970-1292-42a9-a845-e1a55e598759 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:02.593836 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-365b97bf-b7cb-4b2d-bbed-03337411204b req-f1371970-1292-42a9-a845-e1a55e598759 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:02.605535 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-365b97bf-b7cb-4b2d-bbed-03337411204b req-f1371970-1292-42a9-a845-e1a55e598759 service nova] Creating event network-vif-plugged:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h2-708768-8 Jul 26 20:37:02.610749 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-365b97bf-b7cb-4b2d-bbed-03337411204b req-f1371970-1292-42a9-a845-e1a55e598759 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033045 Jul 26 20:37:02.611716 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3380/6836] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:37:03.258573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e901582d-1032-4f20-b5ce-7900fe993d39 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:03.259118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e901582d-1032-4f20-b5ce-7900fe993d39 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:03.266287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e901582d-1032-4f20-b5ce-7900fe993d39 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:03.266745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e901582d-1032-4f20-b5ce-7900fe993d39 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:03.267519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e901582d-1032-4f20-b5ce-7900fe993d39 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:03.267994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e901582d-1032-4f20-b5ce-7900fe993d39 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:03.397105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e901582d-1032-4f20-b5ce-7900fe993d39 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:03.405920 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e901582d-1032-4f20-b5ce-7900fe993d39 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1363 microversion: 2.1 time: 0.151120 Jul 26 20:37:03.406499 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3457/6837] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:03 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:04.429547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d1c719f-a71b-4f8e-b32f-1b05d2203add tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:04.430260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d1c719f-a71b-4f8e-b32f-1b05d2203add tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:04.433101 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:37:04.439330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d1c719f-a71b-4f8e-b32f-1b05d2203add tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:04.439813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d1c719f-a71b-4f8e-b32f-1b05d2203add tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:04.440587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d1c719f-a71b-4f8e-b32f-1b05d2203add tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:04.441029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d1c719f-a71b-4f8e-b32f-1b05d2203add tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:04.571742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d1c719f-a71b-4f8e-b32f-1b05d2203add tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:04.579465 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d1c719f-a71b-4f8e-b32f-1b05d2203add tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1551 microversion: 2.1 time: 0.154216 Jul 26 20:37:04.580066 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3381/6838] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:04 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:04.600839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c5d79c07-621f-4d41-80e2-e858da1e5ae8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:04.601346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c5d79c07-621f-4d41-80e2-e858da1e5ae8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:04.603288 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:37:04.604099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:37:04.611627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5d79c07-621f-4d41-80e2-e858da1e5ae8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:04.612076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5d79c07-621f-4d41-80e2-e858da1e5ae8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:04.612851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5d79c07-621f-4d41-80e2-e858da1e5ae8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:04.613292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c5d79c07-621f-4d41-80e2-e858da1e5ae8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:04.691408 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c5d79c07-621f-4d41-80e2-e858da1e5ae8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094399 Jul 26 20:37:04.692051 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3458/6839] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:37:04 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:37:05.889215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-27c80451-4b67-48e7-b553-df59f835b2af req-fcb30a85-aaa8-4d03-9190-932af3b5f42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:37:05.899822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-27c80451-4b67-48e7-b553-df59f835b2af req-fcb30a85-aaa8-4d03-9190-932af3b5f42a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:05.900280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-27c80451-4b67-48e7-b553-df59f835b2af req-fcb30a85-aaa8-4d03-9190-932af3b5f42a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:05.911695 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-27c80451-4b67-48e7-b553-df59f835b2af req-fcb30a85-aaa8-4d03-9190-932af3b5f42a service nova] Creating event network-changed:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h2-708768-8 Jul 26 20:37:05.917054 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-27c80451-4b67-48e7-b553-df59f835b2af req-fcb30a85-aaa8-4d03-9190-932af3b5f42a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031666 Jul 26 20:37:05.917848 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3382/6840] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:37:40.758969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=13 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:37:40.759875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:37:40.764009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:37:40.766255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:40.773493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:40.773934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:40.774708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:40.775153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:40.807753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:40.813701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Old instance type m1.heat2, new instance type m1.heat {{(pid=125964) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:37:40.819949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:37:40.820361 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:37:40.820838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:37:40.821251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:37:40.821662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:37:40.883897 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5425d9da-dc9f-4038-b796-136a21459b27 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e/action" status: 202 len: 0 microversion: 2.1 time: 0.126721 Jul 26 20:37:40.884700 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3459/6841] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:37:40 2022] POST /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:37:40.892056 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=11 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:37:40.892838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=44 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:37:40.896908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7b3bce63-c345-4ea3-983b-214a20d382c5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:40.897615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7b3bce63-c345-4ea3-983b-214a20d382c5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:40.905441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b3bce63-c345-4ea3-983b-214a20d382c5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:40.905926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b3bce63-c345-4ea3-983b-214a20d382c5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:40.906683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b3bce63-c345-4ea3-983b-214a20d382c5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:40.907171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7b3bce63-c345-4ea3-983b-214a20d382c5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:41.073756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7b3bce63-c345-4ea3-983b-214a20d382c5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:41.082806 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7b3bce63-c345-4ea3-983b-214a20d382c5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1679 microversion: 2.1 time: 0.193853 Jul 26 20:37:41.083695 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3383/6842] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:40 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:42.106194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c9c08291-8e6e-42ab-bc82-db16854aad6b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:42.106719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c9c08291-8e6e-42ab-bc82-db16854aad6b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:42.112892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c9c08291-8e6e-42ab-bc82-db16854aad6b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:42.113335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c9c08291-8e6e-42ab-bc82-db16854aad6b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:42.114093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c9c08291-8e6e-42ab-bc82-db16854aad6b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:42.114525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c9c08291-8e6e-42ab-bc82-db16854aad6b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:42.256539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c9c08291-8e6e-42ab-bc82-db16854aad6b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:42.264897 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c9c08291-8e6e-42ab-bc82-db16854aad6b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1679 microversion: 2.1 time: 0.163594 Jul 26 20:37:42.265472 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3460/6843] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:42 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:43.286366 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3f511a45-8a12-4923-82a7-dc35c67ef92b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:43.286999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3f511a45-8a12-4923-82a7-dc35c67ef92b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:43.294100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f511a45-8a12-4923-82a7-dc35c67ef92b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:43.294561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f511a45-8a12-4923-82a7-dc35c67ef92b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:43.295365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f511a45-8a12-4923-82a7-dc35c67ef92b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:43.295856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f511a45-8a12-4923-82a7-dc35c67ef92b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:43.428315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3f511a45-8a12-4923-82a7-dc35c67ef92b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:43.435912 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3f511a45-8a12-4923-82a7-dc35c67ef92b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.153478 Jul 26 20:37:43.436491 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3384/6844] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:43 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:44.457812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff784e2b-5548-45f2-8c47-83d09be5ff83 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:44.458335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff784e2b-5548-45f2-8c47-83d09be5ff83 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:44.465299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff784e2b-5548-45f2-8c47-83d09be5ff83 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:44.465759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff784e2b-5548-45f2-8c47-83d09be5ff83 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:44.467055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff784e2b-5548-45f2-8c47-83d09be5ff83 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:44.467498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff784e2b-5548-45f2-8c47-83d09be5ff83 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:44.597558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff784e2b-5548-45f2-8c47-83d09be5ff83 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:44.605157 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff784e2b-5548-45f2-8c47-83d09be5ff83 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.151358 Jul 26 20:37:44.605735 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3461/6845] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:44 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:45.627590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7a86219b-0c17-4087-b590-ee42a1fed636 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:45.628239 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7a86219b-0c17-4087-b590-ee42a1fed636 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:45.635365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a86219b-0c17-4087-b590-ee42a1fed636 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:45.635861 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a86219b-0c17-4087-b590-ee42a1fed636 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:45.636665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a86219b-0c17-4087-b590-ee42a1fed636 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:45.637115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7a86219b-0c17-4087-b590-ee42a1fed636 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:45.769077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7a86219b-0c17-4087-b590-ee42a1fed636 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:45.776611 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7a86219b-0c17-4087-b590-ee42a1fed636 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.153796 Jul 26 20:37:45.777193 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3385/6846] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:45 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:46.798623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b758e685-621f-495a-a92d-c5ad35471949 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:46.799236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b758e685-621f-495a-a92d-c5ad35471949 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:46.806165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b758e685-621f-495a-a92d-c5ad35471949 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:46.806609 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b758e685-621f-495a-a92d-c5ad35471949 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:46.807369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b758e685-621f-495a-a92d-c5ad35471949 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:46.807838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b758e685-621f-495a-a92d-c5ad35471949 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:46.941868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b758e685-621f-495a-a92d-c5ad35471949 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:46.949345 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b758e685-621f-495a-a92d-c5ad35471949 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.154994 Jul 26 20:37:46.949913 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3462/6847] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:46 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:47.971247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f6aa1388-fc1c-4e58-8ad5-7e56d982e3c0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:47.971907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f6aa1388-fc1c-4e58-8ad5-7e56d982e3c0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:47.978813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f6aa1388-fc1c-4e58-8ad5-7e56d982e3c0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:47.979304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f6aa1388-fc1c-4e58-8ad5-7e56d982e3c0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:47.980108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f6aa1388-fc1c-4e58-8ad5-7e56d982e3c0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:47.980562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f6aa1388-fc1c-4e58-8ad5-7e56d982e3c0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:48.111139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f6aa1388-fc1c-4e58-8ad5-7e56d982e3c0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:48.118824 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f6aa1388-fc1c-4e58-8ad5-7e56d982e3c0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.152213 Jul 26 20:37:48.119408 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3386/6848] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:47 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:49.140564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03895272-0c74-43dd-be01-f44a7fd93e45 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:49.141102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03895272-0c74-43dd-be01-f44a7fd93e45 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:49.148026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03895272-0c74-43dd-be01-f44a7fd93e45 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:49.148471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03895272-0c74-43dd-be01-f44a7fd93e45 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:49.149233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03895272-0c74-43dd-be01-f44a7fd93e45 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:49.149686 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03895272-0c74-43dd-be01-f44a7fd93e45 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:49.279938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03895272-0c74-43dd-be01-f44a7fd93e45 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:49.287466 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03895272-0c74-43dd-be01-f44a7fd93e45 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.151690 Jul 26 20:37:49.288096 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3463/6849] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:49 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:50.309040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-32b6c61e-7a4c-4135-8d7b-7de39f855709 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:50.309580 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-32b6c61e-7a4c-4135-8d7b-7de39f855709 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:50.316535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32b6c61e-7a4c-4135-8d7b-7de39f855709 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:50.316994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32b6c61e-7a4c-4135-8d7b-7de39f855709 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:50.317768 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32b6c61e-7a4c-4135-8d7b-7de39f855709 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:50.318209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-32b6c61e-7a4c-4135-8d7b-7de39f855709 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:50.448685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-32b6c61e-7a4c-4135-8d7b-7de39f855709 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:50.456487 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-32b6c61e-7a4c-4135-8d7b-7de39f855709 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.151555 Jul 26 20:37:50.457066 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3387/6850] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:50 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:51.478198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21340e32-6e6e-4c05-8b9b-565d6a9088b4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:51.478806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21340e32-6e6e-4c05-8b9b-565d6a9088b4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:51.486516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21340e32-6e6e-4c05-8b9b-565d6a9088b4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:51.486961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21340e32-6e6e-4c05-8b9b-565d6a9088b4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:51.487746 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21340e32-6e6e-4c05-8b9b-565d6a9088b4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:51.488181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21340e32-6e6e-4c05-8b9b-565d6a9088b4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:51.623349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21340e32-6e6e-4c05-8b9b-565d6a9088b4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:51.630970 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21340e32-6e6e-4c05-8b9b-565d6a9088b4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.156608 Jul 26 20:37:51.631554 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3464/6851] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:51 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:52.655073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab242a78-50d6-44bb-9656-e0108bd600c8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:52.655731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab242a78-50d6-44bb-9656-e0108bd600c8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:52.665481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab242a78-50d6-44bb-9656-e0108bd600c8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:52.665946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab242a78-50d6-44bb-9656-e0108bd600c8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:52.666736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab242a78-50d6-44bb-9656-e0108bd600c8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:52.667186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab242a78-50d6-44bb-9656-e0108bd600c8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:52.816147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab242a78-50d6-44bb-9656-e0108bd600c8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:52.824052 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab242a78-50d6-44bb-9656-e0108bd600c8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.173829 Jul 26 20:37:52.824631 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3388/6852] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:52 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:53.846442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-04ec77b1-78e2-4ee0-9a1e-49b54de547b8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:53.847061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-04ec77b1-78e2-4ee0-9a1e-49b54de547b8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:53.854116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04ec77b1-78e2-4ee0-9a1e-49b54de547b8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:53.854572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04ec77b1-78e2-4ee0-9a1e-49b54de547b8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:53.855347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04ec77b1-78e2-4ee0-9a1e-49b54de547b8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:53.855828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04ec77b1-78e2-4ee0-9a1e-49b54de547b8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:53.990962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-04ec77b1-78e2-4ee0-9a1e-49b54de547b8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:53.999434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-04ec77b1-78e2-4ee0-9a1e-49b54de547b8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.156818 Jul 26 20:37:54.000047 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3465/6853] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:53 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:55.021528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2a48a9f2-eb9c-4baf-8e0e-b730f081fa11 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:55.022162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2a48a9f2-eb9c-4baf-8e0e-b730f081fa11 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:55.030227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a48a9f2-eb9c-4baf-8e0e-b730f081fa11 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:55.030697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a48a9f2-eb9c-4baf-8e0e-b730f081fa11 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:55.031494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a48a9f2-eb9c-4baf-8e0e-b730f081fa11 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:55.031979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2a48a9f2-eb9c-4baf-8e0e-b730f081fa11 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:55.166032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2a48a9f2-eb9c-4baf-8e0e-b730f081fa11 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:55.173851 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2a48a9f2-eb9c-4baf-8e0e-b730f081fa11 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.156824 Jul 26 20:37:55.174434 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3389/6854] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:55 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:56.195017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a43542df-b844-4d9c-90ad-368e862daf3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:56.195648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a43542df-b844-4d9c-90ad-368e862daf3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:56.202603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a43542df-b844-4d9c-90ad-368e862daf3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:56.203057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a43542df-b844-4d9c-90ad-368e862daf3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:56.203850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a43542df-b844-4d9c-90ad-368e862daf3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:56.204294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a43542df-b844-4d9c-90ad-368e862daf3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:56.339981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a43542df-b844-4d9c-90ad-368e862daf3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:56.348520 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a43542df-b844-4d9c-90ad-368e862daf3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.157392 Jul 26 20:37:56.349099 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3466/6855] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:56 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:57.370562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-56b1c52f-aa55-42a7-b3db-d48dfa9eca8b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:57.371193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-56b1c52f-aa55-42a7-b3db-d48dfa9eca8b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:57.378277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56b1c52f-aa55-42a7-b3db-d48dfa9eca8b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:57.378739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56b1c52f-aa55-42a7-b3db-d48dfa9eca8b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:57.379515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56b1c52f-aa55-42a7-b3db-d48dfa9eca8b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:57.379992 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-56b1c52f-aa55-42a7-b3db-d48dfa9eca8b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:57.509164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-56b1c52f-aa55-42a7-b3db-d48dfa9eca8b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:57.517456 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-56b1c52f-aa55-42a7-b3db-d48dfa9eca8b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.150819 Jul 26 20:37:57.518041 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3390/6856] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:57 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:58.539167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3df06e24-6d30-410c-87db-e1efd45da240 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:58.539905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3df06e24-6d30-410c-87db-e1efd45da240 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:58.547517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3df06e24-6d30-410c-87db-e1efd45da240 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:58.548010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3df06e24-6d30-410c-87db-e1efd45da240 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:58.548794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3df06e24-6d30-410c-87db-e1efd45da240 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:58.549237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3df06e24-6d30-410c-87db-e1efd45da240 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:58.681744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3df06e24-6d30-410c-87db-e1efd45da240 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:58.689418 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3df06e24-6d30-410c-87db-e1efd45da240 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.154423 Jul 26 20:37:58.689993 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3467/6857] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:58 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:37:59.710579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cc5cd6a5-94ea-4a91-b2a6-19855c110139 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:37:59.711197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cc5cd6a5-94ea-4a91-b2a6-19855c110139 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:37:59.718010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc5cd6a5-94ea-4a91-b2a6-19855c110139 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:59.719305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc5cd6a5-94ea-4a91-b2a6-19855c110139 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:59.720286 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc5cd6a5-94ea-4a91-b2a6-19855c110139 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:37:59.720765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cc5cd6a5-94ea-4a91-b2a6-19855c110139 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:37:59.897732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cc5cd6a5-94ea-4a91-b2a6-19855c110139 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:37:59.905692 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cc5cd6a5-94ea-4a91-b2a6-19855c110139 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1684 microversion: 2.1 time: 0.199260 Jul 26 20:37:59.906540 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3391/6858] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:37:59 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1684 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:00.510773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4eacc21d-fab7-47d2-a5c2-357fd517c0ac req-1a09f0ce-9397-496b-af8b-5a0e601eb31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "name": "network-vif-unplugged", "status": "completed", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:00.521711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4eacc21d-fab7-47d2-a5c2-357fd517c0ac req-1a09f0ce-9397-496b-af8b-5a0e601eb31e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:00.522159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4eacc21d-fab7-47d2-a5c2-357fd517c0ac req-1a09f0ce-9397-496b-af8b-5a0e601eb31e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:00.536740 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4eacc21d-fab7-47d2-a5c2-357fd517c0ac req-1a09f0ce-9397-496b-af8b-5a0e601eb31e service nova] Creating event network-vif-unplugged:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h1-708768-8 Jul 26 20:38:00.543275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-4eacc21d-fab7-47d2-a5c2-357fd517c0ac req-1a09f0ce-9397-496b-af8b-5a0e601eb31e service nova] Instance 64c18902-f403-4bfa-b959-c377c62cbf0e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:38:00.557104 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4eacc21d-fab7-47d2-a5c2-357fd517c0ac req-1a09f0ce-9397-496b-af8b-5a0e601eb31e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115277 Jul 26 20:38:00.557931 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3468/6859] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:00.927273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f92a892c-697f-4741-b55d-ea1e2925a747 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:00.928342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f92a892c-697f-4741-b55d-ea1e2925a747 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:00.936311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f92a892c-697f-4741-b55d-ea1e2925a747 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:00.936811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f92a892c-697f-4741-b55d-ea1e2925a747 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:00.937594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f92a892c-697f-4741-b55d-ea1e2925a747 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:00.938043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f92a892c-697f-4741-b55d-ea1e2925a747 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:01.084825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f92a892c-697f-4741-b55d-ea1e2925a747 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:01.092516 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f92a892c-697f-4741-b55d-ea1e2925a747 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1683 microversion: 2.1 time: 0.169253 Jul 26 20:38:01.093181 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3392/6860] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:00 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:02.115604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f963c865-f774-4b31-ad51-5a5e66243a3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:02.116340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f963c865-f774-4b31-ad51-5a5e66243a3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:02.123934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f963c865-f774-4b31-ad51-5a5e66243a3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:02.124383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f963c865-f774-4b31-ad51-5a5e66243a3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:02.125647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f963c865-f774-4b31-ad51-5a5e66243a3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:02.126088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f963c865-f774-4b31-ad51-5a5e66243a3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:02.261892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f963c865-f774-4b31-ad51-5a5e66243a3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:02.269395 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f963c865-f774-4b31-ad51-5a5e66243a3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1681 microversion: 2.1 time: 0.158028 Jul 26 20:38:02.269969 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3469/6861] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:02 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:02.572116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-68e9294b-cba7-414d-a7ae-ba2aae02573f req-a5f8ce9f-aada-4d51-981b-88c5c50d2c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:02.583005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-68e9294b-cba7-414d-a7ae-ba2aae02573f req-a5f8ce9f-aada-4d51-981b-88c5c50d2c61 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:02.583466 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-68e9294b-cba7-414d-a7ae-ba2aae02573f req-a5f8ce9f-aada-4d51-981b-88c5c50d2c61 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:02.595146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-68e9294b-cba7-414d-a7ae-ba2aae02573f req-a5f8ce9f-aada-4d51-981b-88c5c50d2c61 service nova] Creating event network-changed:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h1-708768-8 Jul 26 20:38:02.600829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-68e9294b-cba7-414d-a7ae-ba2aae02573f req-a5f8ce9f-aada-4d51-981b-88c5c50d2c61 service nova] Instance 64c18902-f403-4bfa-b959-c377c62cbf0e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:38:02.612755 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-68e9294b-cba7-414d-a7ae-ba2aae02573f req-a5f8ce9f-aada-4d51-981b-88c5c50d2c61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044285 Jul 26 20:38:02.613370 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3393/6862] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:03.291087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-31476ad4-7407-44a2-b539-42e72aad959c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:03.291721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-31476ad4-7407-44a2-b539-42e72aad959c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:03.299522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31476ad4-7407-44a2-b539-42e72aad959c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:03.299992 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31476ad4-7407-44a2-b539-42e72aad959c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:03.300751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31476ad4-7407-44a2-b539-42e72aad959c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:03.301184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-31476ad4-7407-44a2-b539-42e72aad959c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:03.431305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-31476ad4-7407-44a2-b539-42e72aad959c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:03.439891 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-31476ad4-7407-44a2-b539-42e72aad959c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1678 microversion: 2.1 time: 0.152637 Jul 26 20:38:03.440469 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3470/6863] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:03 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:03.461284 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:03.461920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:03.468256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:03.468723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:03.469499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:03.469977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:03.507589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:03.508072 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:03.508880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:03.509330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:03.529464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:38:03.534987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for user a6d13710ea1a4204bb0b70c1964c4d09 and project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:38:03.633584 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-08871334-23cb-48fa-a415-023a17bf4260 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e/action" status: 202 len: 0 microversion: 2.1 time: 0.176571 Jul 26 20:38:03.634208 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3394/6864] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:38:03 2022] POST /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:38:03.643498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f3acbc44-da79-40bd-be75-ec8f7fe8d345 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:03.644149 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f3acbc44-da79-40bd-be75-ec8f7fe8d345 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:03.650542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3acbc44-da79-40bd-be75-ec8f7fe8d345 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:03.650995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3acbc44-da79-40bd-be75-ec8f7fe8d345 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:03.651819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3acbc44-da79-40bd-be75-ec8f7fe8d345 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:03.652312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f3acbc44-da79-40bd-be75-ec8f7fe8d345 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:03.857654 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f3acbc44-da79-40bd-be75-ec8f7fe8d345 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:03.866583 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f3acbc44-da79-40bd-be75-ec8f7fe8d345 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1677 microversion: 2.1 time: 0.228063 Jul 26 20:38:03.867189 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3471/6865] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:03 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:04.721408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bd7a588b-5358-4d80-a9b0-734a6ab99706 req-500de6d6-50ef-4c9f-9408-6fd838c68c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "name": "network-vif-plugged", "status": "completed", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:04.732322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bd7a588b-5358-4d80-a9b0-734a6ab99706 req-500de6d6-50ef-4c9f-9408-6fd838c68c08 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:04.732784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bd7a588b-5358-4d80-a9b0-734a6ab99706 req-500de6d6-50ef-4c9f-9408-6fd838c68c08 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:04.744487 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bd7a588b-5358-4d80-a9b0-734a6ab99706 req-500de6d6-50ef-4c9f-9408-6fd838c68c08 service nova] Creating event network-vif-plugged:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h1-708768-8 Jul 26 20:38:04.749790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-bd7a588b-5358-4d80-a9b0-734a6ab99706 req-500de6d6-50ef-4c9f-9408-6fd838c68c08 service nova] Instance 64c18902-f403-4bfa-b959-c377c62cbf0e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:38:04.760613 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bd7a588b-5358-4d80-a9b0-734a6ab99706 req-500de6d6-50ef-4c9f-9408-6fd838c68c08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044938 Jul 26 20:38:04.761226 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3395/6866] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:04.887925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-357196c3-ce80-4aa8-8e65-2274a0b6a35d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:04.888475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-357196c3-ce80-4aa8-8e65-2274a0b6a35d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:04.896626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-357196c3-ce80-4aa8-8e65-2274a0b6a35d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:04.897073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-357196c3-ce80-4aa8-8e65-2274a0b6a35d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:04.897834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-357196c3-ce80-4aa8-8e65-2274a0b6a35d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:04.898272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-357196c3-ce80-4aa8-8e65-2274a0b6a35d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:05.033412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-357196c3-ce80-4aa8-8e65-2274a0b6a35d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:05.041018 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-357196c3-ce80-4aa8-8e65-2274a0b6a35d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1677 microversion: 2.1 time: 0.157076 Jul 26 20:38:05.041589 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3472/6867] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:04 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:06.064557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5dac4337-2078-4ea6-b316-e98aab9c3e15 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:06.065272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5dac4337-2078-4ea6-b316-e98aab9c3e15 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:06.071591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dac4337-2078-4ea6-b316-e98aab9c3e15 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:06.072082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dac4337-2078-4ea6-b316-e98aab9c3e15 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:06.072859 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dac4337-2078-4ea6-b316-e98aab9c3e15 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:06.073313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dac4337-2078-4ea6-b316-e98aab9c3e15 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:06.214746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5dac4337-2078-4ea6-b316-e98aab9c3e15 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:06.222744 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5dac4337-2078-4ea6-b316-e98aab9c3e15 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1677 microversion: 2.1 time: 0.163808 Jul 26 20:38:06.223326 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3396/6868] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:06 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:06.888487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-829885ba-ace6-4f70-8892-c4098dc17da9 req-1a0510b1-8b2e-4059-bdc8-e9e9b251586c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "name": "network-vif-unplugged", "status": "completed", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:06.899694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-829885ba-ace6-4f70-8892-c4098dc17da9 req-1a0510b1-8b2e-4059-bdc8-e9e9b251586c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:06.900217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-829885ba-ace6-4f70-8892-c4098dc17da9 req-1a0510b1-8b2e-4059-bdc8-e9e9b251586c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:06.912536 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-829885ba-ace6-4f70-8892-c4098dc17da9 req-1a0510b1-8b2e-4059-bdc8-e9e9b251586c service nova] Creating event network-vif-unplugged:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h2-708768-8 Jul 26 20:38:06.917984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-829885ba-ace6-4f70-8892-c4098dc17da9 req-1a0510b1-8b2e-4059-bdc8-e9e9b251586c service nova] Instance 64c18902-f403-4bfa-b959-c377c62cbf0e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:38:06.930827 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-829885ba-ace6-4f70-8892-c4098dc17da9 req-1a0510b1-8b2e-4059-bdc8-e9e9b251586c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046252 Jul 26 20:38:06.931829 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3473/6869] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:07.243917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cfbdf74b-94a9-4f74-a976-403a4e27d617 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:07.244666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cfbdf74b-94a9-4f74-a976-403a4e27d617 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:07.251758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfbdf74b-94a9-4f74-a976-403a4e27d617 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:07.252220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfbdf74b-94a9-4f74-a976-403a4e27d617 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:07.253003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfbdf74b-94a9-4f74-a976-403a4e27d617 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:07.253445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cfbdf74b-94a9-4f74-a976-403a4e27d617 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:07.257643 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:07.500709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cfbdf74b-94a9-4f74-a976-403a4e27d617 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:07.508644 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cfbdf74b-94a9-4f74-a976-403a4e27d617 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1677 microversion: 2.1 time: 0.268679 Jul 26 20:38:07.509261 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3397/6870] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:07 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:08.531778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-88c7bdf8-5e2f-4090-b772-1671d5234653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:08.532533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-88c7bdf8-5e2f-4090-b772-1671d5234653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:08.538778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88c7bdf8-5e2f-4090-b772-1671d5234653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:08.539243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88c7bdf8-5e2f-4090-b772-1671d5234653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:08.540042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88c7bdf8-5e2f-4090-b772-1671d5234653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:08.540486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-88c7bdf8-5e2f-4090-b772-1671d5234653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:08.669508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-88c7bdf8-5e2f-4090-b772-1671d5234653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:08.673934 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:08.678991 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-88c7bdf8-5e2f-4090-b772-1671d5234653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1677 microversion: 2.1 time: 0.152398 Jul 26 20:38:08.679587 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3474/6871] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:08 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:08.946370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a666a5af-9086-47ab-8923-e70653e9af01 req-c465da32-43d0-4eab-88bf-4377c6998c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:08.957326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a666a5af-9086-47ab-8923-e70653e9af01 req-c465da32-43d0-4eab-88bf-4377c6998c73 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:08.957777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a666a5af-9086-47ab-8923-e70653e9af01 req-c465da32-43d0-4eab-88bf-4377c6998c73 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:08.972793 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a666a5af-9086-47ab-8923-e70653e9af01 req-c465da32-43d0-4eab-88bf-4377c6998c73 service nova] Creating event network-changed:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h2-708768-8 Jul 26 20:38:08.978058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-a666a5af-9086-47ab-8923-e70653e9af01 req-c465da32-43d0-4eab-88bf-4377c6998c73 service nova] Instance 64c18902-f403-4bfa-b959-c377c62cbf0e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:38:08.989497 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a666a5af-9086-47ab-8923-e70653e9af01 req-c465da32-43d0-4eab-88bf-4377c6998c73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046849 Jul 26 20:38:08.990116 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3398/6872] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:09.701404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4e376fdb-d8c1-4f91-8d6f-2eb348a8dec3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:09.701931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4e376fdb-d8c1-4f91-8d6f-2eb348a8dec3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:09.710136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4e376fdb-d8c1-4f91-8d6f-2eb348a8dec3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:09.710590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4e376fdb-d8c1-4f91-8d6f-2eb348a8dec3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:09.711368 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4e376fdb-d8c1-4f91-8d6f-2eb348a8dec3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:09.711839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4e376fdb-d8c1-4f91-8d6f-2eb348a8dec3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:09.847745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4e376fdb-d8c1-4f91-8d6f-2eb348a8dec3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:09.855417 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4e376fdb-d8c1-4f91-8d6f-2eb348a8dec3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1670 microversion: 2.1 time: 0.158638 Jul 26 20:38:09.856012 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3475/6873] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:09 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:09.877429 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2970581c-478f-4a6e-847e-67e2ba324c38 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:09.878073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2970581c-478f-4a6e-847e-67e2ba324c38 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:09.884650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2970581c-478f-4a6e-847e-67e2ba324c38 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:09.885117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2970581c-478f-4a6e-847e-67e2ba324c38 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:09.885893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2970581c-478f-4a6e-847e-67e2ba324c38 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:09.886339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2970581c-478f-4a6e-847e-67e2ba324c38 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:10.018958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2970581c-478f-4a6e-847e-67e2ba324c38 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:10.027530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2970581c-478f-4a6e-847e-67e2ba324c38 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1670 microversion: 2.1 time: 0.154712 Jul 26 20:38:10.039641 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3399/6874] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:09 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:10.049121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-83bb81c8-e1b8-47b4-9846-be75cb987460 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:10.049732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83bb81c8-e1b8-47b4-9846-be75cb987460 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:10.055889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83bb81c8-e1b8-47b4-9846-be75cb987460 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:10.056338 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83bb81c8-e1b8-47b4-9846-be75cb987460 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:10.057125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83bb81c8-e1b8-47b4-9846-be75cb987460 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:10.057542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83bb81c8-e1b8-47b4-9846-be75cb987460 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:10.187482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83bb81c8-e1b8-47b4-9846-be75cb987460 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:10.195763 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-83bb81c8-e1b8-47b4-9846-be75cb987460 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1670 microversion: 2.1 time: 0.150690 Jul 26 20:38:10.196350 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3476/6875] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:10 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:10.217832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c1ccfdb1-6f0f-4ca1-a18d-ae92daa4c858 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:10.218364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1ccfdb1-6f0f-4ca1-a18d-ae92daa4c858 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:10.225116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1ccfdb1-6f0f-4ca1-a18d-ae92daa4c858 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:10.225576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1ccfdb1-6f0f-4ca1-a18d-ae92daa4c858 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:10.226363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1ccfdb1-6f0f-4ca1-a18d-ae92daa4c858 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:10.226811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c1ccfdb1-6f0f-4ca1-a18d-ae92daa4c858 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:10.253929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c1ccfdb1-6f0f-4ca1-a18d-ae92daa4c858 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:38:10.335062 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c1ccfdb1-6f0f-4ca1-a18d-ae92daa4c858 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 204 len: 0 microversion: 2.1 time: 0.121451 Jul 26 20:38:10.336069 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3400/6876] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:38:10 2022] DELETE /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:38:10.345346 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-01d5a038-4bdb-4d80-ba3f-c204cc860995 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:10.346208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-01d5a038-4bdb-4d80-ba3f-c204cc860995 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:10.352643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01d5a038-4bdb-4d80-ba3f-c204cc860995 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:10.353263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01d5a038-4bdb-4d80-ba3f-c204cc860995 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:10.354320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01d5a038-4bdb-4d80-ba3f-c204cc860995 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:10.354795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01d5a038-4bdb-4d80-ba3f-c204cc860995 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:10.492579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-01d5a038-4bdb-4d80-ba3f-c204cc860995 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:10.501221 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-01d5a038-4bdb-4d80-ba3f-c204cc860995 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1676 microversion: 2.1 time: 0.160146 Jul 26 20:38:10.502390 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3477/6877] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:10 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:38:11.523702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdd6c20e-a1ac-4fe5-aeff-51a155976bc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:11.524383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cdd6c20e-a1ac-4fe5-aeff-51a155976bc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:11.527153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:11.533586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdd6c20e-a1ac-4fe5-aeff-51a155976bc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:11.534046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdd6c20e-a1ac-4fe5-aeff-51a155976bc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:11.534828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdd6c20e-a1ac-4fe5-aeff-51a155976bc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:11.535276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdd6c20e-a1ac-4fe5-aeff-51a155976bc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:11.668042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cdd6c20e-a1ac-4fe5-aeff-51a155976bc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:11.676186 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cdd6c20e-a1ac-4fe5-aeff-51a155976bc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1676 microversion: 2.1 time: 0.156887 Jul 26 20:38:11.676776 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3401/6878] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:11 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:12.495854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5846d527-f090-4cf4-8da8-807f5f5364d5 req-98906198-cf10-43aa-b113-d6b6464e1298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c18902-f403-4bfa-b959-c377c62cbf0e", "name": "network-vif-deleted", "tag": "ed4369c4-4d48-471e-a061-41e931debdf0"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:12.506467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=43 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:12.511237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5846d527-f090-4cf4-8da8-807f5f5364d5 req-98906198-cf10-43aa-b113-d6b6464e1298 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:12.512312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5846d527-f090-4cf4-8da8-807f5f5364d5 req-98906198-cf10-43aa-b113-d6b6464e1298 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:12.527760 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5846d527-f090-4cf4-8da8-807f5f5364d5 req-98906198-cf10-43aa-b113-d6b6464e1298 service nova] Creating event network-vif-deleted:ed4369c4-4d48-471e-a061-41e931debdf0 for instance 64c18902-f403-4bfa-b959-c377c62cbf0e on n-h2-708768-8 Jul 26 20:38:12.534199 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5846d527-f090-4cf4-8da8-807f5f5364d5 req-98906198-cf10-43aa-b113-d6b6464e1298 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042193 Jul 26 20:38:12.535134 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3478/6879] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:12.697570 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:12.698217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:12.705214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:12.705678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:12.706472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:12.706925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:12.739541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:12.740027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:12.740481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lazy-loading 'fault' on Instance uuid 64c18902-f403-4bfa-b959-c377c62cbf0e {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:38:12.784979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:12.792779 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab452888-e46d-4aef-828d-e1bc0c221817 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 200 len: 1328 microversion: 2.1 time: 0.099218 Jul 26 20:38:12.793370 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3402/6880] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:12 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:13.815861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:13.816484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:13.823657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:13.824107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:13.824867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:13.825303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:13.838879 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e HTTP/1.1 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '64c18902-f403-4bfa-b959-c377c62cbf0e'} Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:38:13.840528 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad6dbe57-ee38-4cac-88fd-2b7b9d698aaf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 404 len: 111 microversion: 2.1 time: 0.031276 Jul 26 20:38:13.845469 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3479/6881] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:13 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:38:13.861199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:13.861855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:13.863826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:13.869925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:13.870382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:13.871152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:13.871600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:13.884933 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e HTTP/1.1 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '64c18902-f403-4bfa-b959-c377c62cbf0e'} Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:38:13.886610 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-82ee5d09-8b8f-4be3-b635-b65a0583f8a8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 404 len: 111 microversion: 2.1 time: 0.031465 Jul 26 20:38:13.890756 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3403/6882] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:13 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:38:13.997026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-895306440", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "1af22061-3ea1-493f-92b0-f1e5d7a4cdaf"}], "security_groups": [{"name": "tempest-securitygroup--234704078"}], "key_name": "tempest-keypair-800196711", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:14.103462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] validate_networks() for [('1af22061-3ea1-493f-92b0-f1e5d7a4cdaf', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:38:14.481813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:38:14.482240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:38:14.482717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:38:14.483317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:38:14.483769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:38:14.492697 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:14.493203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:14.494005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:14.494450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:14.510826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:38:14.516692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for user a6d13710ea1a4204bb0b70c1964c4d09 and project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:38:14.528826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:38:14.531082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:38:14.577679 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd257f2f-a4be-4ec7-bd54-a777191dc5f3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.584622 Jul 26 20:38:14.578346 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3480/6883] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:38:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:38:14.589669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0752ee89-e0c1-4281-9991-b3ddff52b440 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:14.590283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0752ee89-e0c1-4281-9991-b3ddff52b440 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:14.644735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0752ee89-e0c1-4281-9991-b3ddff52b440 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:14.651693 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0752ee89-e0c1-4281-9991-b3ddff52b440 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1237 microversion: 2.1 time: 0.065997 Jul 26 20:38:14.652262 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3404/6884] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:14 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:15.675327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0923647-fcde-4ff8-8211-6bd06bc8a2b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:15.675994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0923647-fcde-4ff8-8211-6bd06bc8a2b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:15.683065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0923647-fcde-4ff8-8211-6bd06bc8a2b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:15.683534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0923647-fcde-4ff8-8211-6bd06bc8a2b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:15.684327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0923647-fcde-4ff8-8211-6bd06bc8a2b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:15.684773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0923647-fcde-4ff8-8211-6bd06bc8a2b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:15.757015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0923647-fcde-4ff8-8211-6bd06bc8a2b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:15.764437 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0923647-fcde-4ff8-8211-6bd06bc8a2b7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1295 microversion: 2.1 time: 0.094347 Jul 26 20:38:15.765012 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3481/6885] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:15 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:16.787509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-749b66a4-54a4-4590-87b7-834bee949329 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:16.788135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-749b66a4-54a4-4590-87b7-834bee949329 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:16.796792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-749b66a4-54a4-4590-87b7-834bee949329 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:16.797911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-749b66a4-54a4-4590-87b7-834bee949329 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:16.799032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-749b66a4-54a4-4590-87b7-834bee949329 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:16.799660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-749b66a4-54a4-4590-87b7-834bee949329 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:16.853856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-85d098e6-614a-46c1-b45a-8c39f58d1808 req-fff09eaa-db98-4fb7-b6bd-0f302c8a7a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:16.890979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-85d098e6-614a-46c1-b45a-8c39f58d1808 req-fff09eaa-db98-4fb7-b6bd-0f302c8a7a33 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:16.891639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-85d098e6-614a-46c1-b45a-8c39f58d1808 req-fff09eaa-db98-4fb7-b6bd-0f302c8a7a33 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:16.925101 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-85d098e6-614a-46c1-b45a-8c39f58d1808 req-fff09eaa-db98-4fb7-b6bd-0f302c8a7a33 service nova] Creating event network-changed:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h1-708768-8 Jul 26 20:38:16.939507 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-85d098e6-614a-46c1-b45a-8c39f58d1808 req-fff09eaa-db98-4fb7-b6bd-0f302c8a7a33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088435 Jul 26 20:38:16.940700 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3482/6886] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:16.954844 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-749b66a4-54a4-4590-87b7-834bee949329 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:16.963451 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-749b66a4-54a4-4590-87b7-834bee949329 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1362 microversion: 2.1 time: 0.180229 Jul 26 20:38:16.964115 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3405/6887] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:16 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:17.987104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4bfcef6b-7121-46c8-9eae-80014d25cbe5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:17.987844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4bfcef6b-7121-46c8-9eae-80014d25cbe5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:17.994140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bfcef6b-7121-46c8-9eae-80014d25cbe5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:17.994594 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bfcef6b-7121-46c8-9eae-80014d25cbe5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:17.995365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bfcef6b-7121-46c8-9eae-80014d25cbe5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:17.995844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4bfcef6b-7121-46c8-9eae-80014d25cbe5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:18.212151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4bfcef6b-7121-46c8-9eae-80014d25cbe5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:18.220389 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4bfcef6b-7121-46c8-9eae-80014d25cbe5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1362 microversion: 2.1 time: 0.238514 Jul 26 20:38:18.220982 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3483/6888] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:17 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:19.241696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2193d20-8027-4d61-84fd-076c0bedf407 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:19.242318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e2193d20-8027-4d61-84fd-076c0bedf407 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:19.249310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2193d20-8027-4d61-84fd-076c0bedf407 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:19.249773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2193d20-8027-4d61-84fd-076c0bedf407 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:19.251125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2193d20-8027-4d61-84fd-076c0bedf407 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:19.251578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2193d20-8027-4d61-84fd-076c0bedf407 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:19.657340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e2193d20-8027-4d61-84fd-076c0bedf407 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:19.664929 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e2193d20-8027-4d61-84fd-076c0bedf407 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1362 microversion: 2.1 time: 0.427210 Jul 26 20:38:19.665877 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3406/6889] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:19 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:20.687284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ff6d9c75-441d-42f5-9092-119ff913ceb2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:20.688589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ff6d9c75-441d-42f5-9092-119ff913ceb2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:20.695530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff6d9c75-441d-42f5-9092-119ff913ceb2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:20.696019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff6d9c75-441d-42f5-9092-119ff913ceb2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:20.696808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff6d9c75-441d-42f5-9092-119ff913ceb2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:20.697255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ff6d9c75-441d-42f5-9092-119ff913ceb2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:20.803960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-0b00abd0-baac-42a8-b700-2e7b9da55d9e req-aef0d310-a268-46dd-a5e4-7f1a75ee8c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "name": "network-vif-plugged", "status": "completed", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:20.815789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0b00abd0-baac-42a8-b700-2e7b9da55d9e req-aef0d310-a268-46dd-a5e4-7f1a75ee8c83 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:20.816455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-0b00abd0-baac-42a8-b700-2e7b9da55d9e req-aef0d310-a268-46dd-a5e4-7f1a75ee8c83 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:20.830792 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-0b00abd0-baac-42a8-b700-2e7b9da55d9e req-aef0d310-a268-46dd-a5e4-7f1a75ee8c83 service nova] Creating event network-vif-plugged:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h1-708768-8 Jul 26 20:38:20.835847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ff6d9c75-441d-42f5-9092-119ff913ceb2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:20.842752 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-0b00abd0-baac-42a8-b700-2e7b9da55d9e req-aef0d310-a268-46dd-a5e4-7f1a75ee8c83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042338 Jul 26 20:38:20.843382 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3407/6890] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:38:20.844754 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ff6d9c75-441d-42f5-9092-119ff913ceb2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1362 microversion: 2.1 time: 0.161283 Jul 26 20:38:20.845525 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3484/6891] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:20 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:21.868368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-014c5094-20f6-4290-b842-a88657efc651 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:21.869081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-014c5094-20f6-4290-b842-a88657efc651 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:21.875389 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-014c5094-20f6-4290-b842-a88657efc651 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:21.875881 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-014c5094-20f6-4290-b842-a88657efc651 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:21.876680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-014c5094-20f6-4290-b842-a88657efc651 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:21.877158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-014c5094-20f6-4290-b842-a88657efc651 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:22.007515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-014c5094-20f6-4290-b842-a88657efc651 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:22.015024 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-014c5094-20f6-4290-b842-a88657efc651 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1362 microversion: 2.1 time: 0.152033 Jul 26 20:38:22.015597 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3408/6892] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:21 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:23.037571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eef370de-93d9-4a46-b87f-5bc3063c2d2d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:23.038189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-eef370de-93d9-4a46-b87f-5bc3063c2d2d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:23.045140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eef370de-93d9-4a46-b87f-5bc3063c2d2d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:23.045596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eef370de-93d9-4a46-b87f-5bc3063c2d2d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:23.046358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eef370de-93d9-4a46-b87f-5bc3063c2d2d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:23.046796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-eef370de-93d9-4a46-b87f-5bc3063c2d2d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:23.183045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-eef370de-93d9-4a46-b87f-5bc3063c2d2d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:23.190636 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eef370de-93d9-4a46-b87f-5bc3063c2d2d tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1549 microversion: 2.1 time: 0.157610 Jul 26 20:38:23.191223 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3485/6893] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:23 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:23.212111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac8823ba-20d9-4255-83b6-854db9d6cf7e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:23.212618 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ac8823ba-20d9-4255-83b6-854db9d6cf7e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:23.219529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac8823ba-20d9-4255-83b6-854db9d6cf7e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:23.220054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac8823ba-20d9-4255-83b6-854db9d6cf7e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:23.221569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac8823ba-20d9-4255-83b6-854db9d6cf7e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:23.222021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac8823ba-20d9-4255-83b6-854db9d6cf7e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:23.299017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ac8823ba-20d9-4255-83b6-854db9d6cf7e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090735 Jul 26 20:38:23.299664 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3409/6894] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:38:23 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:24.219940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2a13ffca-bd5a-4865-8271-6bbdb31c1e3f req-f9bf080d-b3ab-421e-b74e-8f9abd2d6faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:24.231019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2a13ffca-bd5a-4865-8271-6bbdb31c1e3f req-f9bf080d-b3ab-421e-b74e-8f9abd2d6faf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:24.231533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2a13ffca-bd5a-4865-8271-6bbdb31c1e3f req-f9bf080d-b3ab-421e-b74e-8f9abd2d6faf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:24.243925 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2a13ffca-bd5a-4865-8271-6bbdb31c1e3f req-f9bf080d-b3ab-421e-b74e-8f9abd2d6faf service nova] Creating event network-changed:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h1-708768-8 Jul 26 20:38:24.250169 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2a13ffca-bd5a-4865-8271-6bbdb31c1e3f req-f9bf080d-b3ab-421e-b74e-8f9abd2d6faf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033604 Jul 26 20:38:24.251208 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3486/6895] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:38:58.458715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:58.459569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=21 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:58.460355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:58.464616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-301d037c-5ba9-456f-84df-cfe3792c2164 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:38:58.465247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-301d037c-5ba9-456f-84df-cfe3792c2164 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:58.473232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-301d037c-5ba9-456f-84df-cfe3792c2164 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:58.473697 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-301d037c-5ba9-456f-84df-cfe3792c2164 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:58.474484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-301d037c-5ba9-456f-84df-cfe3792c2164 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:58.474940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-301d037c-5ba9-456f-84df-cfe3792c2164 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:58.669537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-301d037c-5ba9-456f-84df-cfe3792c2164 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:38:58.677832 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-301d037c-5ba9-456f-84df-cfe3792c2164 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1668 microversion: 2.1 time: 0.221223 Jul 26 20:38:58.678414 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3410/6896] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:38:58 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:38:58.699178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f5074b1-7026-4bd8-b759-434d2d611a29 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1114cd98-8b43-407c-b6bc-cd695848feba"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:38:58.701675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f5074b1-7026-4bd8-b759-434d2d611a29 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:38:58.704058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:58.704729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:58.705448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:58.706055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=52 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:38:58.713093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f5074b1-7026-4bd8-b759-434d2d611a29 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:58.713547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f5074b1-7026-4bd8-b759-434d2d611a29 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:58.714320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f5074b1-7026-4bd8-b759-434d2d611a29 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:38:58.714760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f5074b1-7026-4bd8-b759-434d2d611a29 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:38:59.123957 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f5074b1-7026-4bd8-b759-434d2d611a29 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428951 Jul 26 20:38:59.124811 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3487/6897] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:38:58 2022] POST /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:39:09.826801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:39:09.829108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:09.831729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:09.832409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:09.839115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:09.839574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:09.840382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:09.840830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:09.918488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:09.924732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Old instance type m1.heat2, new instance type m1.heat {{(pid=125963) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:39:09.931430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:39:09.931887 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:39:09.932368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:39:09.932783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:39:09.933204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:39:10.044294 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d4687066-16bc-48e5-afc0-2009417bd667 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/action" status: 202 len: 0 microversion: 2.1 time: 0.221173 Jul 26 20:39:10.045099 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3411/6898] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:39:09 2022] POST /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:39:10.054398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-89cc8c07-3b34-4463-99ed-5682c9eb4a73 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:10.055803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-89cc8c07-3b34-4463-99ed-5682c9eb4a73 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:10.062943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:10.064099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:10.066232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cc8c07-3b34-4463-99ed-5682c9eb4a73 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:10.066980 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cc8c07-3b34-4463-99ed-5682c9eb4a73 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:10.068369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cc8c07-3b34-4463-99ed-5682c9eb4a73 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:10.069310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-89cc8c07-3b34-4463-99ed-5682c9eb4a73 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:10.213400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-89cc8c07-3b34-4463-99ed-5682c9eb4a73 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:10.222260 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-89cc8c07-3b34-4463-99ed-5682c9eb4a73 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1723 microversion: 2.1 time: 0.172318 Jul 26 20:39:10.222700 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3488/6899] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:10 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:11.243568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4b8d4b62-a558-4ba5-aceb-b69ef2686184 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:11.244219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4b8d4b62-a558-4ba5-aceb-b69ef2686184 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:11.251975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b8d4b62-a558-4ba5-aceb-b69ef2686184 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:11.252375 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b8d4b62-a558-4ba5-aceb-b69ef2686184 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:11.253142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b8d4b62-a558-4ba5-aceb-b69ef2686184 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:11.253587 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b8d4b62-a558-4ba5-aceb-b69ef2686184 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:11.385261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4b8d4b62-a558-4ba5-aceb-b69ef2686184 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:11.394302 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4b8d4b62-a558-4ba5-aceb-b69ef2686184 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1723 microversion: 2.1 time: 0.154499 Jul 26 20:39:11.394945 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3412/6900] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:11 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:12.416534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-213137cd-ba66-4b9b-8e7f-af490a445896 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:12.417180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-213137cd-ba66-4b9b-8e7f-af490a445896 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:12.424438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-213137cd-ba66-4b9b-8e7f-af490a445896 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:12.424902 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-213137cd-ba66-4b9b-8e7f-af490a445896 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:12.425677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-213137cd-ba66-4b9b-8e7f-af490a445896 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:12.426123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-213137cd-ba66-4b9b-8e7f-af490a445896 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:12.558214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-213137cd-ba66-4b9b-8e7f-af490a445896 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:12.566724 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-213137cd-ba66-4b9b-8e7f-af490a445896 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.154180 Jul 26 20:39:12.567298 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3489/6901] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:12 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:13.588752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b2b18662-c38c-4a0e-b752-f4eda24a9e26 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:13.589402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b2b18662-c38c-4a0e-b752-f4eda24a9e26 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:13.596362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2b18662-c38c-4a0e-b752-f4eda24a9e26 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:13.596822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2b18662-c38c-4a0e-b752-f4eda24a9e26 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:13.597597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2b18662-c38c-4a0e-b752-f4eda24a9e26 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:13.598046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b2b18662-c38c-4a0e-b752-f4eda24a9e26 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:13.728029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b2b18662-c38c-4a0e-b752-f4eda24a9e26 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:13.735927 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b2b18662-c38c-4a0e-b752-f4eda24a9e26 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.151113 Jul 26 20:39:13.736501 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3413/6902] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:13 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:39:14.757224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7313ab05-1bf6-4fcc-b893-342a4b7521ee tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:14.757829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7313ab05-1bf6-4fcc-b893-342a4b7521ee tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:14.764735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7313ab05-1bf6-4fcc-b893-342a4b7521ee tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:14.765178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7313ab05-1bf6-4fcc-b893-342a4b7521ee tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:14.765935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7313ab05-1bf6-4fcc-b893-342a4b7521ee tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:14.766367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7313ab05-1bf6-4fcc-b893-342a4b7521ee tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:14.897724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7313ab05-1bf6-4fcc-b893-342a4b7521ee tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:14.905760 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7313ab05-1bf6-4fcc-b893-342a4b7521ee tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.152489 Jul 26 20:39:14.906338 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3490/6903] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:14 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:15.928644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3864d810-051c-4afc-9602-6d8a4dfbacd7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:15.929275 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3864d810-051c-4afc-9602-6d8a4dfbacd7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:15.936243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3864d810-051c-4afc-9602-6d8a4dfbacd7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:15.936706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3864d810-051c-4afc-9602-6d8a4dfbacd7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:15.937483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3864d810-051c-4afc-9602-6d8a4dfbacd7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:15.937933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3864d810-051c-4afc-9602-6d8a4dfbacd7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:16.066953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3864d810-051c-4afc-9602-6d8a4dfbacd7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:16.075133 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3864d810-051c-4afc-9602-6d8a4dfbacd7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.151083 Jul 26 20:39:16.075725 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3414/6904] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:15 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:17.096908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9e085ac0-abb2-4642-9284-7784f35dc84e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:17.097531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9e085ac0-abb2-4642-9284-7784f35dc84e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:17.105276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e085ac0-abb2-4642-9284-7784f35dc84e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:17.105734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e085ac0-abb2-4642-9284-7784f35dc84e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:17.106512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e085ac0-abb2-4642-9284-7784f35dc84e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:17.106961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9e085ac0-abb2-4642-9284-7784f35dc84e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:17.238018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9e085ac0-abb2-4642-9284-7784f35dc84e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:17.246046 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9e085ac0-abb2-4642-9284-7784f35dc84e tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.153198 Jul 26 20:39:17.246783 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3491/6905] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:17 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:18.268023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-714dbe60-4fce-4b73-ac86-68085797c19c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:18.268650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-714dbe60-4fce-4b73-ac86-68085797c19c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:18.276294 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-714dbe60-4fce-4b73-ac86-68085797c19c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:18.276757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-714dbe60-4fce-4b73-ac86-68085797c19c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:18.277693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-714dbe60-4fce-4b73-ac86-68085797c19c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:18.278146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-714dbe60-4fce-4b73-ac86-68085797c19c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:18.413705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-714dbe60-4fce-4b73-ac86-68085797c19c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:18.421685 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-714dbe60-4fce-4b73-ac86-68085797c19c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.157720 Jul 26 20:39:18.422250 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3415/6906] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:18 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:19.443867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-17fcf2a0-ae8d-4a38-98b2-4c211d4842f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:19.444488 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-17fcf2a0-ae8d-4a38-98b2-4c211d4842f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:19.451431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17fcf2a0-ae8d-4a38-98b2-4c211d4842f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:19.451911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17fcf2a0-ae8d-4a38-98b2-4c211d4842f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:19.452681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17fcf2a0-ae8d-4a38-98b2-4c211d4842f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:19.453124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-17fcf2a0-ae8d-4a38-98b2-4c211d4842f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:19.584502 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-17fcf2a0-ae8d-4a38-98b2-4c211d4842f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:19.592529 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-17fcf2a0-ae8d-4a38-98b2-4c211d4842f8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.152910 Jul 26 20:39:19.593108 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3492/6907] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:19 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:20.614103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aab9fdb6-0e76-4391-92a2-039a88275732 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:20.614718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aab9fdb6-0e76-4391-92a2-039a88275732 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:20.621800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aab9fdb6-0e76-4391-92a2-039a88275732 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:20.622266 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aab9fdb6-0e76-4391-92a2-039a88275732 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:20.623048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aab9fdb6-0e76-4391-92a2-039a88275732 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:20.623494 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aab9fdb6-0e76-4391-92a2-039a88275732 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:20.752712 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aab9fdb6-0e76-4391-92a2-039a88275732 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:20.761764 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aab9fdb6-0e76-4391-92a2-039a88275732 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.151582 Jul 26 20:39:20.762341 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3416/6908] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:20 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:21.783817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a13b4fa0-a773-4e5b-a4dc-78f542e5bcaa tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:21.784439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a13b4fa0-a773-4e5b-a4dc-78f542e5bcaa tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:21.792364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a13b4fa0-a773-4e5b-a4dc-78f542e5bcaa tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:21.792820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a13b4fa0-a773-4e5b-a4dc-78f542e5bcaa tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:21.793600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a13b4fa0-a773-4e5b-a4dc-78f542e5bcaa tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:21.794051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a13b4fa0-a773-4e5b-a4dc-78f542e5bcaa tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:21.926626 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a13b4fa0-a773-4e5b-a4dc-78f542e5bcaa tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:21.935239 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a13b4fa0-a773-4e5b-a4dc-78f542e5bcaa tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.155446 Jul 26 20:39:21.935869 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3493/6909] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:21 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:22.956853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-29672ba7-fe4e-4125-a795-99dba805c381 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:22.957477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-29672ba7-fe4e-4125-a795-99dba805c381 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:22.965523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29672ba7-fe4e-4125-a795-99dba805c381 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:22.965981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29672ba7-fe4e-4125-a795-99dba805c381 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:22.966746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29672ba7-fe4e-4125-a795-99dba805c381 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:22.967190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-29672ba7-fe4e-4125-a795-99dba805c381 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:23.105324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-29672ba7-fe4e-4125-a795-99dba805c381 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:23.113370 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-29672ba7-fe4e-4125-a795-99dba805c381 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.160408 Jul 26 20:39:23.113940 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3417/6910] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:22 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:24.184784 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-69a32b96-853b-484b-b104-cc16b335004b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:24.185395 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-69a32b96-853b-484b-b104-cc16b335004b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:24.191326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69a32b96-853b-484b-b104-cc16b335004b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:24.192736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69a32b96-853b-484b-b104-cc16b335004b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:24.193762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69a32b96-853b-484b-b104-cc16b335004b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:24.194197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-69a32b96-853b-484b-b104-cc16b335004b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:24.327959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-69a32b96-853b-484b-b104-cc16b335004b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:24.337038 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-69a32b96-853b-484b-b104-cc16b335004b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.205242 Jul 26 20:39:24.337729 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3494/6911] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:24 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:25.358626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe7d9be8-b277-46e3-a508-991e86ae6b1c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:25.359258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe7d9be8-b277-46e3-a508-991e86ae6b1c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:25.366219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe7d9be8-b277-46e3-a508-991e86ae6b1c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:25.366685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe7d9be8-b277-46e3-a508-991e86ae6b1c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:25.367462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe7d9be8-b277-46e3-a508-991e86ae6b1c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:25.367943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe7d9be8-b277-46e3-a508-991e86ae6b1c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:25.495298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fe7d9be8-b277-46e3-a508-991e86ae6b1c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:25.503305 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe7d9be8-b277-46e3-a508-991e86ae6b1c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.148637 Jul 26 20:39:25.503909 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3418/6912] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:25 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:26.525091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e031c9c-5052-4b64-a1c2-a63f65c75770 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:26.525709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e031c9c-5052-4b64-a1c2-a63f65c75770 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:26.532277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e031c9c-5052-4b64-a1c2-a63f65c75770 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:26.532728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e031c9c-5052-4b64-a1c2-a63f65c75770 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:26.533495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e031c9c-5052-4b64-a1c2-a63f65c75770 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:26.533938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e031c9c-5052-4b64-a1c2-a63f65c75770 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:26.661766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e031c9c-5052-4b64-a1c2-a63f65c75770 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:26.669860 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e031c9c-5052-4b64-a1c2-a63f65c75770 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.148911 Jul 26 20:39:26.670443 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3495/6913] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:26 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:27.692533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f80e5c41-9ccd-4f9d-b661-252223a1becf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:27.693073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f80e5c41-9ccd-4f9d-b661-252223a1becf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:27.700738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f80e5c41-9ccd-4f9d-b661-252223a1becf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:27.701204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f80e5c41-9ccd-4f9d-b661-252223a1becf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:27.701999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f80e5c41-9ccd-4f9d-b661-252223a1becf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:27.702452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f80e5c41-9ccd-4f9d-b661-252223a1becf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:27.831321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f80e5c41-9ccd-4f9d-b661-252223a1becf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:27.839561 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f80e5c41-9ccd-4f9d-b661-252223a1becf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.151370 Jul 26 20:39:27.840164 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3419/6914] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:27 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:28.861047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-95e7822f-2491-4138-a98a-33c8f6de295c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:28.861662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-95e7822f-2491-4138-a98a-33c8f6de295c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:28.868860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95e7822f-2491-4138-a98a-33c8f6de295c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:28.869319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95e7822f-2491-4138-a98a-33c8f6de295c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:28.870089 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95e7822f-2491-4138-a98a-33c8f6de295c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:28.870529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-95e7822f-2491-4138-a98a-33c8f6de295c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:29.003183 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-95e7822f-2491-4138-a98a-33c8f6de295c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:29.011912 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-95e7822f-2491-4138-a98a-33c8f6de295c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.154739 Jul 26 20:39:29.012472 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3496/6915] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:28 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:30.034658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e251072-5e9d-4d6a-99f3-4744648c50c7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:30.035288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e251072-5e9d-4d6a-99f3-4744648c50c7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:30.042923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e251072-5e9d-4d6a-99f3-4744648c50c7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:30.043376 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e251072-5e9d-4d6a-99f3-4744648c50c7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:30.044195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e251072-5e9d-4d6a-99f3-4744648c50c7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:30.044644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e251072-5e9d-4d6a-99f3-4744648c50c7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:30.182208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e251072-5e9d-4d6a-99f3-4744648c50c7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:30.190401 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e251072-5e9d-4d6a-99f3-4744648c50c7 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1728 microversion: 2.1 time: 0.159798 Jul 26 20:39:30.190979 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3420/6916] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:30 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:31.213601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c2fe811-2eb1-4685-8d27-9e957a0d3c48 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:31.214352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2c2fe811-2eb1-4685-8d27-9e957a0d3c48 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:31.221703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c2fe811-2eb1-4685-8d27-9e957a0d3c48 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:31.222158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c2fe811-2eb1-4685-8d27-9e957a0d3c48 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:31.222939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c2fe811-2eb1-4685-8d27-9e957a0d3c48 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:31.223440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c2fe811-2eb1-4685-8d27-9e957a0d3c48 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:31.356781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c2fe811-2eb1-4685-8d27-9e957a0d3c48 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:31.366388 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c2fe811-2eb1-4685-8d27-9e957a0d3c48 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1727 microversion: 2.1 time: 0.156825 Jul 26 20:39:31.366983 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3497/6917] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:31 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:39:31.584588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-165c345f-a207-463d-9f53-f1b4c2d9765e req-4ff6ac9d-95d3-4989-9eb5-abafb43738b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "name": "network-vif-unplugged", "status": "completed", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:39:31.595602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-165c345f-a207-463d-9f53-f1b4c2d9765e req-4ff6ac9d-95d3-4989-9eb5-abafb43738b8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:31.596185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-165c345f-a207-463d-9f53-f1b4c2d9765e req-4ff6ac9d-95d3-4989-9eb5-abafb43738b8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:31.608502 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-165c345f-a207-463d-9f53-f1b4c2d9765e req-4ff6ac9d-95d3-4989-9eb5-abafb43738b8 service nova] Creating event network-vif-unplugged:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h2-708768-8 Jul 26 20:39:31.614394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-165c345f-a207-463d-9f53-f1b4c2d9765e req-4ff6ac9d-95d3-4989-9eb5-abafb43738b8 service nova] Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:39:31.625859 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-165c345f-a207-463d-9f53-f1b4c2d9765e req-4ff6ac9d-95d3-4989-9eb5-abafb43738b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045085 Jul 26 20:39:31.626826 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3421/6918] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:39:32.388526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c365b707-d3b2-4b92-8558-937b47bdfeda tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:32.389166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c365b707-d3b2-4b92-8558-937b47bdfeda tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:32.397029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c365b707-d3b2-4b92-8558-937b47bdfeda tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:32.397516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c365b707-d3b2-4b92-8558-937b47bdfeda tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:32.398469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c365b707-d3b2-4b92-8558-937b47bdfeda tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:32.398948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c365b707-d3b2-4b92-8558-937b47bdfeda tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:32.533874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c365b707-d3b2-4b92-8558-937b47bdfeda tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:32.542939 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c365b707-d3b2-4b92-8558-937b47bdfeda tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1727 microversion: 2.1 time: 0.158298 Jul 26 20:39:32.543544 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3498/6919] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:32 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:39:33.567179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09e69457-fded-4210-bf4d-2c1c278c6e50 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:33.567807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-09e69457-fded-4210-bf4d-2c1c278c6e50 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:33.574042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09e69457-fded-4210-bf4d-2c1c278c6e50 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:33.574503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09e69457-fded-4210-bf4d-2c1c278c6e50 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:33.575279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09e69457-fded-4210-bf4d-2c1c278c6e50 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:33.575770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09e69457-fded-4210-bf4d-2c1c278c6e50 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:33.650326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-b2c07422-10e3-4102-8a52-160a699b846b req-3e1339be-586a-484b-a0c4-de39f903f4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:39:33.661495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b2c07422-10e3-4102-8a52-160a699b846b req-3e1339be-586a-484b-a0c4-de39f903f4d5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:33.661943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-b2c07422-10e3-4102-8a52-160a699b846b req-3e1339be-586a-484b-a0c4-de39f903f4d5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:33.674189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-b2c07422-10e3-4102-8a52-160a699b846b req-3e1339be-586a-484b-a0c4-de39f903f4d5 service nova] Creating event network-changed:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h2-708768-8 Jul 26 20:39:33.680105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-b2c07422-10e3-4102-8a52-160a699b846b req-3e1339be-586a-484b-a0c4-de39f903f4d5 service nova] Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:39:33.691208 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-b2c07422-10e3-4102-8a52-160a699b846b req-3e1339be-586a-484b-a0c4-de39f903f4d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044626 Jul 26 20:39:33.691850 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3499/6920] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:39:33.764664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09e69457-fded-4210-bf4d-2c1c278c6e50 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:33.774173 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09e69457-fded-4210-bf4d-2c1c278c6e50 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.212079 Jul 26 20:39:33.776373 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3422/6921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:33 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:34.798300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-631d2d67-24cf-4e13-9aa9-15acb779c32b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:34.799048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-631d2d67-24cf-4e13-9aa9-15acb779c32b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:34.806658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-631d2d67-24cf-4e13-9aa9-15acb779c32b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:34.807106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-631d2d67-24cf-4e13-9aa9-15acb779c32b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:34.807908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-631d2d67-24cf-4e13-9aa9-15acb779c32b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:34.808342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-631d2d67-24cf-4e13-9aa9-15acb779c32b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:34.952719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-631d2d67-24cf-4e13-9aa9-15acb779c32b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:34.961783 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-631d2d67-24cf-4e13-9aa9-15acb779c32b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.168804 Jul 26 20:39:34.962383 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3500/6922] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:34 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:35.983026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-74ce7d85-4e4a-4a66-ba6f-8216f243c731 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:35.983685 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-74ce7d85-4e4a-4a66-ba6f-8216f243c731 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:35.990948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74ce7d85-4e4a-4a66-ba6f-8216f243c731 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:35.991418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74ce7d85-4e4a-4a66-ba6f-8216f243c731 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:35.992232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74ce7d85-4e4a-4a66-ba6f-8216f243c731 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:35.992693 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-74ce7d85-4e4a-4a66-ba6f-8216f243c731 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:36.127894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-74ce7d85-4e4a-4a66-ba6f-8216f243c731 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:36.136894 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-74ce7d85-4e4a-4a66-ba6f-8216f243c731 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.157820 Jul 26 20:39:36.137479 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3423/6923] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:35 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:37.158446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-91c4c058-ee9d-40d2-b6b7-ee2929dcad30 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:37.159063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-91c4c058-ee9d-40d2-b6b7-ee2929dcad30 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:37.166273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91c4c058-ee9d-40d2-b6b7-ee2929dcad30 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:37.166729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91c4c058-ee9d-40d2-b6b7-ee2929dcad30 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:37.167497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91c4c058-ee9d-40d2-b6b7-ee2929dcad30 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:37.167963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91c4c058-ee9d-40d2-b6b7-ee2929dcad30 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:37.312472 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-91c4c058-ee9d-40d2-b6b7-ee2929dcad30 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:37.321367 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-91c4c058-ee9d-40d2-b6b7-ee2929dcad30 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.166816 Jul 26 20:39:37.321915 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3501/6924] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:37 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:38.342660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-633665fc-b899-44f3-b409-4f3db8171287 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:38.343201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-633665fc-b899-44f3-b409-4f3db8171287 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:38.350473 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-633665fc-b899-44f3-b409-4f3db8171287 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:38.350935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-633665fc-b899-44f3-b409-4f3db8171287 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:38.351745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-633665fc-b899-44f3-b409-4f3db8171287 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:38.352196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-633665fc-b899-44f3-b409-4f3db8171287 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:38.482723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-633665fc-b899-44f3-b409-4f3db8171287 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:38.490826 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-633665fc-b899-44f3-b409-4f3db8171287 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.152422 Jul 26 20:39:38.491403 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3424/6925] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:38 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:39:39.512567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1bb8ce02-9742-4072-b5e7-50c8db125a31 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:39.513178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1bb8ce02-9742-4072-b5e7-50c8db125a31 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:39.520620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1bb8ce02-9742-4072-b5e7-50c8db125a31 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:39.521111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1bb8ce02-9742-4072-b5e7-50c8db125a31 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:39.521871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1bb8ce02-9742-4072-b5e7-50c8db125a31 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:39.522308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1bb8ce02-9742-4072-b5e7-50c8db125a31 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:39.653332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1bb8ce02-9742-4072-b5e7-50c8db125a31 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:39.661941 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1bb8ce02-9742-4072-b5e7-50c8db125a31 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.153314 Jul 26 20:39:39.662513 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3502/6926] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:39 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:39.982612 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:39:39.982812 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 20:39:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:39:40.683636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2bfe4c66-be06-488e-930b-34eb56673366 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:40.684272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2bfe4c66-be06-488e-930b-34eb56673366 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:40.687066 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=33 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:40.693110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bfe4c66-be06-488e-930b-34eb56673366 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:40.693569 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bfe4c66-be06-488e-930b-34eb56673366 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:40.694343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bfe4c66-be06-488e-930b-34eb56673366 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:40.694791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2bfe4c66-be06-488e-930b-34eb56673366 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:40.698895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:40.828410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2bfe4c66-be06-488e-930b-34eb56673366 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:40.837219 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2bfe4c66-be06-488e-930b-34eb56673366 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.157430 Jul 26 20:39:40.837833 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3425/6927] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:40 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:39:41.858420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7c3bdb7e-44fc-4224-bc0d-f52fe5034628 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:41.859076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7c3bdb7e-44fc-4224-bc0d-f52fe5034628 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:41.861848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=31 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:41.867161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c3bdb7e-44fc-4224-bc0d-f52fe5034628 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:41.867636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c3bdb7e-44fc-4224-bc0d-f52fe5034628 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:41.868418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c3bdb7e-44fc-4224-bc0d-f52fe5034628 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:41.868865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7c3bdb7e-44fc-4224-bc0d-f52fe5034628 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:41.871954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=89 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:42.004018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7c3bdb7e-44fc-4224-bc0d-f52fe5034628 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:42.013094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7c3bdb7e-44fc-4224-bc0d-f52fe5034628 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.158656 Jul 26 20:39:42.013796 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3503/6928] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:41 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:43.034336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7971137a-a8ff-4e65-b4f0-58bb7f7f4c84 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:43.034971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7971137a-a8ff-4e65-b4f0-58bb7f7f4c84 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:43.042283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7971137a-a8ff-4e65-b4f0-58bb7f7f4c84 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:43.042748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7971137a-a8ff-4e65-b4f0-58bb7f7f4c84 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:43.043532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7971137a-a8ff-4e65-b4f0-58bb7f7f4c84 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:43.044049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7971137a-a8ff-4e65-b4f0-58bb7f7f4c84 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:43.176526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7971137a-a8ff-4e65-b4f0-58bb7f7f4c84 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:43.184586 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7971137a-a8ff-4e65-b4f0-58bb7f7f4c84 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.154152 Jul 26 20:39:43.185163 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3426/6929] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:43 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:44.206458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-555e9e08-f71c-4739-87e8-dfed90f85f6a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:44.207091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-555e9e08-f71c-4739-87e8-dfed90f85f6a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:44.214894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-555e9e08-f71c-4739-87e8-dfed90f85f6a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:44.215353 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-555e9e08-f71c-4739-87e8-dfed90f85f6a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:44.216152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-555e9e08-f71c-4739-87e8-dfed90f85f6a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:44.216597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-555e9e08-f71c-4739-87e8-dfed90f85f6a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:44.354287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-555e9e08-f71c-4739-87e8-dfed90f85f6a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:44.362456 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-555e9e08-f71c-4739-87e8-dfed90f85f6a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1725 microversion: 2.1 time: 0.159891 Jul 26 20:39:44.363024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3504/6930] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:44 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:45.385760 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-193477b2-935d-4439-9bbd-2f9bcbf14047 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:45.386383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-193477b2-935d-4439-9bbd-2f9bcbf14047 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:45.393271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-193477b2-935d-4439-9bbd-2f9bcbf14047 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:45.393730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-193477b2-935d-4439-9bbd-2f9bcbf14047 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:45.394602 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-193477b2-935d-4439-9bbd-2f9bcbf14047 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:45.395249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-193477b2-935d-4439-9bbd-2f9bcbf14047 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:45.529637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-193477b2-935d-4439-9bbd-2f9bcbf14047 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:45.538166 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-193477b2-935d-4439-9bbd-2f9bcbf14047 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1722 microversion: 2.1 time: 0.157652 Jul 26 20:39:45.538740 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3427/6931] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:45 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:45.561166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:39:45.561679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:45.569313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:45.569791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:45.570583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:45.571018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:45.607246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:45.607719 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:45.608517 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:45.608949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:45.629630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:39:45.635549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Getting quotas for user a6d13710ea1a4204bb0b70c1964c4d09 and project 900b25bc067d42fcb9ce8d5637b814c5. Resources: {'cores', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:39:45.742687 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03bd143b-5685-4507-9e43-108891ed1dcf tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "POST /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/action" status: 202 len: 0 microversion: 2.1 time: 0.185309 Jul 26 20:39:45.743409 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3505/6932] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:39:45 2022] POST /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:39:45.751993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-58e4cd18-f632-45a6-9193-e21aa4236d3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:45.752757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-58e4cd18-f632-45a6-9193-e21aa4236d3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:45.759162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58e4cd18-f632-45a6-9193-e21aa4236d3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:45.759741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58e4cd18-f632-45a6-9193-e21aa4236d3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:45.760556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58e4cd18-f632-45a6-9193-e21aa4236d3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:45.760969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58e4cd18-f632-45a6-9193-e21aa4236d3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:45.962113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-58e4cd18-f632-45a6-9193-e21aa4236d3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:45.970549 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-58e4cd18-f632-45a6-9193-e21aa4236d3c tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.222529 Jul 26 20:39:45.971145 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3428/6933] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:45 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:46.994437 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5302c352-4b5a-45ed-bbaf-d15d9903725b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:46.995157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5302c352-4b5a-45ed-bbaf-d15d9903725b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:47.001466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5302c352-4b5a-45ed-bbaf-d15d9903725b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:47.001917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5302c352-4b5a-45ed-bbaf-d15d9903725b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:47.002690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5302c352-4b5a-45ed-bbaf-d15d9903725b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:47.003127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5302c352-4b5a-45ed-bbaf-d15d9903725b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:47.132965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5302c352-4b5a-45ed-bbaf-d15d9903725b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:47.140898 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5302c352-4b5a-45ed-bbaf-d15d9903725b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.152387 Jul 26 20:39:47.141463 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3506/6934] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:46 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:47.345636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-47bb847d-ed65-47cb-aad6-901246daf544 req-3ddbb3a9-f5c1-4104-b4cf-a75e068322a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "name": "network-vif-plugged", "status": "completed", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:39:47.356653 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-47bb847d-ed65-47cb-aad6-901246daf544 req-3ddbb3a9-f5c1-4104-b4cf-a75e068322a8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:47.357106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-47bb847d-ed65-47cb-aad6-901246daf544 req-3ddbb3a9-f5c1-4104-b4cf-a75e068322a8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:47.369828 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-47bb847d-ed65-47cb-aad6-901246daf544 req-3ddbb3a9-f5c1-4104-b4cf-a75e068322a8 service nova] Creating event network-vif-plugged:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h2-708768-8 Jul 26 20:39:47.375217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-47bb847d-ed65-47cb-aad6-901246daf544 req-3ddbb3a9-f5c1-4104-b4cf-a75e068322a8 service nova] Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:39:47.386816 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-47bb847d-ed65-47cb-aad6-901246daf544 req-3ddbb3a9-f5c1-4104-b4cf-a75e068322a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044911 Jul 26 20:39:47.387452 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3429/6935] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:39:48.163082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5da140e2-572b-4174-a0f5-bb65889369c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:48.163766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5da140e2-572b-4174-a0f5-bb65889369c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:48.170690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5da140e2-572b-4174-a0f5-bb65889369c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:48.171147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5da140e2-572b-4174-a0f5-bb65889369c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:48.171957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5da140e2-572b-4174-a0f5-bb65889369c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:48.172405 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5da140e2-572b-4174-a0f5-bb65889369c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:48.305945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5da140e2-572b-4174-a0f5-bb65889369c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:48.314093 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5da140e2-572b-4174-a0f5-bb65889369c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.155656 Jul 26 20:39:48.314667 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3507/6936] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:48 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:49.337639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-556527ca-ce52-44c3-a4a5-4ae4b4695b37 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:49.338361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-556527ca-ce52-44c3-a4a5-4ae4b4695b37 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:49.344758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-556527ca-ce52-44c3-a4a5-4ae4b4695b37 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:49.345252 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-556527ca-ce52-44c3-a4a5-4ae4b4695b37 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:49.346037 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-556527ca-ce52-44c3-a4a5-4ae4b4695b37 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:49.346666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-556527ca-ce52-44c3-a4a5-4ae4b4695b37 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:49.484327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-556527ca-ce52-44c3-a4a5-4ae4b4695b37 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:49.493122 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-556527ca-ce52-44c3-a4a5-4ae4b4695b37 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.161316 Jul 26 20:39:49.493707 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3430/6937] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:49 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:50.514968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3f4d43f1-3716-409f-a838-31f246be8d41 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:50.515636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3f4d43f1-3716-409f-a838-31f246be8d41 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:50.523059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f4d43f1-3716-409f-a838-31f246be8d41 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:50.523525 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f4d43f1-3716-409f-a838-31f246be8d41 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:50.524334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f4d43f1-3716-409f-a838-31f246be8d41 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:50.524778 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f4d43f1-3716-409f-a838-31f246be8d41 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:50.658384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f4d43f1-3716-409f-a838-31f246be8d41 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:50.666430 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3f4d43f1-3716-409f-a838-31f246be8d41 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.155459 Jul 26 20:39:50.667002 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3508/6938] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:50 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:51.123212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-dda467c4-2f62-4c99-b683-16ca97baa8ae req-77d5a00d-ba40-4274-a05b-854a2b98b8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "name": "network-vif-unplugged", "status": "completed", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:39:51.134573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dda467c4-2f62-4c99-b683-16ca97baa8ae req-77d5a00d-ba40-4274-a05b-854a2b98b8ab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:51.135060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-dda467c4-2f62-4c99-b683-16ca97baa8ae req-77d5a00d-ba40-4274-a05b-854a2b98b8ab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:51.147129 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-dda467c4-2f62-4c99-b683-16ca97baa8ae req-77d5a00d-ba40-4274-a05b-854a2b98b8ab service nova] Creating event network-vif-unplugged:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h1-708768-8 Jul 26 20:39:51.152612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-dda467c4-2f62-4c99-b683-16ca97baa8ae req-77d5a00d-ba40-4274-a05b-854a2b98b8ab service nova] Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:39:51.164064 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-dda467c4-2f62-4c99-b683-16ca97baa8ae req-77d5a00d-ba40-4274-a05b-854a2b98b8ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044900 Jul 26 20:39:51.164818 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3431/6939] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:39:51.688330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a48147bb-189d-4086-8116-6e332a9b5e54 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:51.688942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a48147bb-189d-4086-8116-6e332a9b5e54 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:51.696927 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a48147bb-189d-4086-8116-6e332a9b5e54 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:51.698678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a48147bb-189d-4086-8116-6e332a9b5e54 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:51.699761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a48147bb-189d-4086-8116-6e332a9b5e54 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:51.700429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a48147bb-189d-4086-8116-6e332a9b5e54 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:51.912819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a48147bb-189d-4086-8116-6e332a9b5e54 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:51.921283 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a48147bb-189d-4086-8116-6e332a9b5e54 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.236929 Jul 26 20:39:51.921878 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3509/6940] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:51 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:52.944688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ae5d8d6e-f9d2-41de-8308-604cdb6459c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:52.945524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ae5d8d6e-f9d2-41de-8308-604cdb6459c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:52.951918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae5d8d6e-f9d2-41de-8308-604cdb6459c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:52.952385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae5d8d6e-f9d2-41de-8308-604cdb6459c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:52.953167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae5d8d6e-f9d2-41de-8308-604cdb6459c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:52.953623 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ae5d8d6e-f9d2-41de-8308-604cdb6459c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:53.096346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ae5d8d6e-f9d2-41de-8308-604cdb6459c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:53.106124 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ae5d8d6e-f9d2-41de-8308-604cdb6459c4 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.167420 Jul 26 20:39:53.106704 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3432/6941] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:52 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:53.182180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-13c51215-2c8c-473e-a61a-1997bf968468 req-06bed530-51f0-468f-9e69-8cb8370ea5de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:39:53.194124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-13c51215-2c8c-473e-a61a-1997bf968468 req-06bed530-51f0-468f-9e69-8cb8370ea5de service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:53.194566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-13c51215-2c8c-473e-a61a-1997bf968468 req-06bed530-51f0-468f-9e69-8cb8370ea5de service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:53.208803 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-13c51215-2c8c-473e-a61a-1997bf968468 req-06bed530-51f0-468f-9e69-8cb8370ea5de service nova] Creating event network-changed:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h1-708768-8 Jul 26 20:39:53.220782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-13c51215-2c8c-473e-a61a-1997bf968468 req-06bed530-51f0-468f-9e69-8cb8370ea5de service nova] Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:39:53.236513 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-13c51215-2c8c-473e-a61a-1997bf968468 req-06bed530-51f0-468f-9e69-8cb8370ea5de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058269 Jul 26 20:39:53.238919 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3510/6942] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:39:54.127895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c6952a61-1d82-40ec-878d-5fa0853523f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:54.128521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c6952a61-1d82-40ec-878d-5fa0853523f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:54.136026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6952a61-1d82-40ec-878d-5fa0853523f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:54.136489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6952a61-1d82-40ec-878d-5fa0853523f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:54.137297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6952a61-1d82-40ec-878d-5fa0853523f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:54.137744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6952a61-1d82-40ec-878d-5fa0853523f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:54.276029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c6952a61-1d82-40ec-878d-5fa0853523f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:54.284207 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c6952a61-1d82-40ec-878d-5fa0853523f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.160171 Jul 26 20:39:54.284725 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3433/6943] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:54 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:55.307200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe1a74c2-5721-4c4f-8eb9-8a922b29ebcd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:55.307932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fe1a74c2-5721-4c4f-8eb9-8a922b29ebcd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:55.314234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe1a74c2-5721-4c4f-8eb9-8a922b29ebcd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:55.314685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe1a74c2-5721-4c4f-8eb9-8a922b29ebcd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:55.315454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe1a74c2-5721-4c4f-8eb9-8a922b29ebcd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:55.315915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe1a74c2-5721-4c4f-8eb9-8a922b29ebcd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:55.447831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fe1a74c2-5721-4c4f-8eb9-8a922b29ebcd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:55.456032 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe1a74c2-5721-4c4f-8eb9-8a922b29ebcd tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.154220 Jul 26 20:39:55.456617 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3511/6944] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:55 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:56.478444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ac0b166-0858-4bbb-9e15-08248c5c720a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:56.479080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ac0b166-0858-4bbb-9e15-08248c5c720a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:56.486092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ac0b166-0858-4bbb-9e15-08248c5c720a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:56.486559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ac0b166-0858-4bbb-9e15-08248c5c720a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:56.487341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ac0b166-0858-4bbb-9e15-08248c5c720a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:56.487901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ac0b166-0858-4bbb-9e15-08248c5c720a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:56.618872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3ac0b166-0858-4bbb-9e15-08248c5c720a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:56.627100 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ac0b166-0858-4bbb-9e15-08248c5c720a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.153210 Jul 26 20:39:56.627705 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3434/6945] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:56 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:57.649241 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47f2034e-68ce-4cdd-99ec-f81d75233812 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:57.649855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47f2034e-68ce-4cdd-99ec-f81d75233812 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:57.652000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:39:57.658043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47f2034e-68ce-4cdd-99ec-f81d75233812 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:57.658494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47f2034e-68ce-4cdd-99ec-f81d75233812 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:57.659265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47f2034e-68ce-4cdd-99ec-f81d75233812 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:57.659736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47f2034e-68ce-4cdd-99ec-f81d75233812 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:57.792269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47f2034e-68ce-4cdd-99ec-f81d75233812 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:57.800559 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47f2034e-68ce-4cdd-99ec-f81d75233812 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.155806 Jul 26 20:39:57.801152 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3512/6946] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:57 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:58.823311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cde6e6e8-41e0-4c47-bd87-057fa828c8ae tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:39:58.824050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cde6e6e8-41e0-4c47-bd87-057fa828c8ae tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:39:58.836372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cde6e6e8-41e0-4c47-bd87-057fa828c8ae tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:58.837225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cde6e6e8-41e0-4c47-bd87-057fa828c8ae tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:58.838435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cde6e6e8-41e0-4c47-bd87-057fa828c8ae tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:39:58.839108 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cde6e6e8-41e0-4c47-bd87-057fa828c8ae tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:39:58.970228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cde6e6e8-41e0-4c47-bd87-057fa828c8ae tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:39:58.978530 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cde6e6e8-41e0-4c47-bd87-057fa828c8ae tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.159212 Jul 26 20:39:58.979119 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3435/6947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:58 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:39:59.999757 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d18ff609-328c-4c7c-8bc8-36c4c976a4c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:00.000369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d18ff609-328c-4c7c-8bc8-36c4c976a4c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:00.007621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d18ff609-328c-4c7c-8bc8-36c4c976a4c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:00.008139 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d18ff609-328c-4c7c-8bc8-36c4c976a4c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:00.008953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d18ff609-328c-4c7c-8bc8-36c4c976a4c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:00.009393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d18ff609-328c-4c7c-8bc8-36c4c976a4c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:00.140497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d18ff609-328c-4c7c-8bc8-36c4c976a4c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:00.149537 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d18ff609-328c-4c7c-8bc8-36c4c976a4c6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.153703 Jul 26 20:40:00.150125 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3513/6948] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:39:59 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:01.171043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-addda57f-17eb-41fe-bb92-a11c92132101 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:01.171659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-addda57f-17eb-41fe-bb92-a11c92132101 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:01.179536 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-addda57f-17eb-41fe-bb92-a11c92132101 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:01.180026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-addda57f-17eb-41fe-bb92-a11c92132101 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:01.180811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-addda57f-17eb-41fe-bb92-a11c92132101 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:01.181267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-addda57f-17eb-41fe-bb92-a11c92132101 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:01.313464 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-addda57f-17eb-41fe-bb92-a11c92132101 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:01.321627 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-addda57f-17eb-41fe-bb92-a11c92132101 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.154602 Jul 26 20:40:01.322204 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3436/6949] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:01 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:02.343461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e6c3227-f376-419c-8ecf-15afbd97a8d0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:02.344086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e6c3227-f376-419c-8ecf-15afbd97a8d0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:02.351583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e6c3227-f376-419c-8ecf-15afbd97a8d0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:02.352064 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e6c3227-f376-419c-8ecf-15afbd97a8d0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:02.352840 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e6c3227-f376-419c-8ecf-15afbd97a8d0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:02.353285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e6c3227-f376-419c-8ecf-15afbd97a8d0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:02.482436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e6c3227-f376-419c-8ecf-15afbd97a8d0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:02.491159 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e6c3227-f376-419c-8ecf-15afbd97a8d0 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.151702 Jul 26 20:40:02.491757 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3514/6950] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:02 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:03.512646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03361b6f-c9fa-4701-a2f6-8a3da33ff71a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:03.513278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03361b6f-c9fa-4701-a2f6-8a3da33ff71a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:03.520427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03361b6f-c9fa-4701-a2f6-8a3da33ff71a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:03.520897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03361b6f-c9fa-4701-a2f6-8a3da33ff71a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:03.521822 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03361b6f-c9fa-4701-a2f6-8a3da33ff71a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:03.522274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03361b6f-c9fa-4701-a2f6-8a3da33ff71a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:03.658214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03361b6f-c9fa-4701-a2f6-8a3da33ff71a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:03.666830 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03361b6f-c9fa-4701-a2f6-8a3da33ff71a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1721 microversion: 2.1 time: 0.158107 Jul 26 20:40:03.667414 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3437/6951] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:03 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:04.689613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d08d619c-9a07-4344-b928-c2b3a5ecf5a5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:04.690229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d08d619c-9a07-4344-b928-c2b3a5ecf5a5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:04.697987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d08d619c-9a07-4344-b928-c2b3a5ecf5a5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:04.698444 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d08d619c-9a07-4344-b928-c2b3a5ecf5a5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:04.699227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d08d619c-9a07-4344-b928-c2b3a5ecf5a5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:04.699712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d08d619c-9a07-4344-b928-c2b3a5ecf5a5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:04.831372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d08d619c-9a07-4344-b928-c2b3a5ecf5a5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:04.839555 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d08d619c-9a07-4344-b928-c2b3a5ecf5a5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1714 microversion: 2.1 time: 0.153922 Jul 26 20:40:04.840157 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3515/6952] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:04 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:04.860739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-831b38f4-efcc-4ea1-b03b-dedae86f86e8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:04.861474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-831b38f4-efcc-4ea1-b03b-dedae86f86e8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:04.869559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-831b38f4-efcc-4ea1-b03b-dedae86f86e8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:04.870019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-831b38f4-efcc-4ea1-b03b-dedae86f86e8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:04.870804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-831b38f4-efcc-4ea1-b03b-dedae86f86e8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:04.871256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-831b38f4-efcc-4ea1-b03b-dedae86f86e8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:05.003209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-831b38f4-efcc-4ea1-b03b-dedae86f86e8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:05.011491 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-831b38f4-efcc-4ea1-b03b-dedae86f86e8 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1714 microversion: 2.1 time: 0.154910 Jul 26 20:40:05.012101 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3438/6953] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:04 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:05.032601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4ebbd6a4-0098-4236-a06c-160149bb3764 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:05.033233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4ebbd6a4-0098-4236-a06c-160149bb3764 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:05.040174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ebbd6a4-0098-4236-a06c-160149bb3764 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:05.040631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ebbd6a4-0098-4236-a06c-160149bb3764 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:05.041406 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ebbd6a4-0098-4236-a06c-160149bb3764 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:05.041852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4ebbd6a4-0098-4236-a06c-160149bb3764 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:05.170347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4ebbd6a4-0098-4236-a06c-160149bb3764 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:05.178644 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4ebbd6a4-0098-4236-a06c-160149bb3764 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1714 microversion: 2.1 time: 0.149922 Jul 26 20:40:05.179215 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3516/6954] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:05 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:05.198690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a6892964-a416-4de5-a4cf-ec23a226e522 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:05.199207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a6892964-a416-4de5-a4cf-ec23a226e522 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:05.205311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6892964-a416-4de5-a4cf-ec23a226e522 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:05.205770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6892964-a416-4de5-a4cf-ec23a226e522 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:05.206550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6892964-a416-4de5-a4cf-ec23a226e522 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:05.207002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6892964-a416-4de5-a4cf-ec23a226e522 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:05.233700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a6892964-a416-4de5-a4cf-ec23a226e522 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:40:05.314343 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a6892964-a416-4de5-a4cf-ec23a226e522 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 204 len: 0 microversion: 2.1 time: 0.119134 Jul 26 20:40:05.315214 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3439/6955] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:40:05 2022] DELETE /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:40:05.323625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ac02f936-56fd-402e-be04-698e0deebf97 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:05.325310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ac02f936-56fd-402e-be04-698e0deebf97 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:05.330348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac02f936-56fd-402e-be04-698e0deebf97 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:05.330806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac02f936-56fd-402e-be04-698e0deebf97 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:05.331580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac02f936-56fd-402e-be04-698e0deebf97 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:05.332045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ac02f936-56fd-402e-be04-698e0deebf97 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:05.336679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:05.471259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ac02f936-56fd-402e-be04-698e0deebf97 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:05.479397 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ac02f936-56fd-402e-be04-698e0deebf97 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1720 microversion: 2.1 time: 0.159666 Jul 26 20:40:05.480008 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3517/6956] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:05 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:06.501219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ef4a5e8b-7cdc-486a-a959-240b047e76e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:06.501927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ef4a5e8b-7cdc-486a-a959-240b047e76e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:06.509326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e8b-7cdc-486a-a959-240b047e76e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:06.509790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e8b-7cdc-486a-a959-240b047e76e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:06.510564 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e8b-7cdc-486a-a959-240b047e76e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:06.511010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e8b-7cdc-486a-a959-240b047e76e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:06.643490 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ef4a5e8b-7cdc-486a-a959-240b047e76e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:06.645843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:06.653472 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ef4a5e8b-7cdc-486a-a959-240b047e76e6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1720 microversion: 2.1 time: 0.156505 Jul 26 20:40:06.654064 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3440/6957] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:06 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:40:07.676387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-90471256-18ea-401c-adff-e0f0592d811a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:07.677114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-90471256-18ea-401c-adff-e0f0592d811a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:07.685412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90471256-18ea-401c-adff-e0f0592d811a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:07.686020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90471256-18ea-401c-adff-e0f0592d811a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:07.686872 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90471256-18ea-401c-adff-e0f0592d811a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:07.687315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-90471256-18ea-401c-adff-e0f0592d811a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:07.924113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-90471256-18ea-401c-adff-e0f0592d811a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:07.933274 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-90471256-18ea-401c-adff-e0f0592d811a tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1653 microversion: 2.1 time: 0.261292 Jul 26 20:40:07.934064 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3518/6958] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:07 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1653 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:07.999878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-3b2362f0-915a-4476-9d8e-f8befb9d03f7 req-f2fae36c-308a-4f83-9e37-6d13b188f1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f736522-aa94-4b36-a3c4-8061e1691dc7", "name": "network-vif-deleted", "tag": "c322a55f-2973-4da9-b21f-625b3701ce7b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:08.014877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3b2362f0-915a-4476-9d8e-f8befb9d03f7 req-f2fae36c-308a-4f83-9e37-6d13b188f1cd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:08.015338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-3b2362f0-915a-4476-9d8e-f8befb9d03f7 req-f2fae36c-308a-4f83-9e37-6d13b188f1cd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:08.028755 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-3b2362f0-915a-4476-9d8e-f8befb9d03f7 req-f2fae36c-308a-4f83-9e37-6d13b188f1cd service nova] Creating event network-vif-deleted:c322a55f-2973-4da9-b21f-625b3701ce7b for instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 on n-h1-708768-8 Jul 26 20:40:08.035100 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-3b2362f0-915a-4476-9d8e-f8befb9d03f7 req-f2fae36c-308a-4f83-9e37-6d13b188f1cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039821 Jul 26 20:40:08.035947 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3441/6959] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:40:08.954424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-11aa3d35-22ad-43c8-b845-fb5b694685a9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:08.955194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-11aa3d35-22ad-43c8-b845-fb5b694685a9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:08.963433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11aa3d35-22ad-43c8-b845-fb5b694685a9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:08.964038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11aa3d35-22ad-43c8-b845-fb5b694685a9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:08.964901 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11aa3d35-22ad-43c8-b845-fb5b694685a9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:08.965421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-11aa3d35-22ad-43c8-b845-fb5b694685a9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:09.047426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-11aa3d35-22ad-43c8-b845-fb5b694685a9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:09.057032 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-11aa3d35-22ad-43c8-b845-fb5b694685a9 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1368 microversion: 2.1 time: 0.106449 Jul 26 20:40:09.058321 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3519/6960] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:08 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:10.080042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7745d9a3-d951-44d1-8c4d-af398c7a8449 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:10.081064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7745d9a3-d951-44d1-8c4d-af398c7a8449 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:10.088515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7745d9a3-d951-44d1-8c4d-af398c7a8449 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:10.089053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7745d9a3-d951-44d1-8c4d-af398c7a8449 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:10.090010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7745d9a3-d951-44d1-8c4d-af398c7a8449 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:10.090540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7745d9a3-d951-44d1-8c4d-af398c7a8449 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:10.159384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7745d9a3-d951-44d1-8c4d-af398c7a8449 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:10.168883 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7745d9a3-d951-44d1-8c4d-af398c7a8449 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1368 microversion: 2.1 time: 0.094112 Jul 26 20:40:10.169478 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3442/6961] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:10 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:11.191291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b17c2343-9d87-4b53-b901-61f9ad38a3e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:11.191945 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b17c2343-9d87-4b53-b901-61f9ad38a3e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:11.199542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b17c2343-9d87-4b53-b901-61f9ad38a3e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:11.200017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b17c2343-9d87-4b53-b901-61f9ad38a3e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:11.200775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b17c2343-9d87-4b53-b901-61f9ad38a3e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:11.201207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b17c2343-9d87-4b53-b901-61f9ad38a3e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:11.264925 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b17c2343-9d87-4b53-b901-61f9ad38a3e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:11.273431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b17c2343-9d87-4b53-b901-61f9ad38a3e5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1368 microversion: 2.1 time: 0.085999 Jul 26 20:40:11.274012 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3520/6962] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:11 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:12.294482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:12.295700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:12.298923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:12.304909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:12.305367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:12.306141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:12.306585 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:12.339187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:12.339662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:12.340123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lazy-loading 'fault' on Instance uuid 2f736522-aa94-4b36-a3c4-8061e1691dc7 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:40:12.386615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d13710ea1a4204bb0b70c1964c4d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900b25bc067d42fcb9ce8d5637b814c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:12.393793 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1c5c499b-1cc7-4b3b-910c-38ce7233c285 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 200 len: 1327 microversion: 2.1 time: 0.103354 Jul 26 20:40:12.394360 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3443/6963] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:12 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:13.416723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:13.417328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:13.420115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:13.426569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:13.427025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:13.428344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:13.428910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:13.442442 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 HTTP/1.1 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '2f736522-aa94-4b36-a3c4-8061e1691dc7'} Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:13.444874 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f36197a-8235-4ca3-97cb-a796ff7d4c58 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 404 len: 111 microversion: 2.1 time: 0.033909 Jul 26 20:40:13.452408 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3521/6964] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:13 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:13.505176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:13.508319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:13.515058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:13.515514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:13.516308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:13.516755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:13.529603 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/os-volume_attachments HTTP/1.1 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '2f736522-aa94-4b36-a3c4-8061e1691dc7'} Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:13.531270 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab13e7ee-0409-46e6-96d9-5981bf646f3b tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031487 Jul 26 20:40:13.535497 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3444/6965] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:40:13 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:16.846148 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:16.846646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:16.853833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:16.854290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:16.855066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:16.855509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:16.869968 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 HTTP/1.1 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '2f736522-aa94-4b36-a3c4-8061e1691dc7'} Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:16.871516 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56ccf2fe-4b4e-43c4-8ac8-bc0b17d31ad2 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 404 len: 111 microversion: 2.1 time: 0.030798 Jul 26 20:40:16.875572 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3522/6966] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:40:16 2022] DELETE /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:16.882236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:16.882865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 2f736522-aa94-4b36-a3c4-8061e1691dc7] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:16.889937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:16.890434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:16.891226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:16.891706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:16.907370 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 HTTP/1.1 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '2f736522-aa94-4b36-a3c4-8061e1691dc7'} Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:16.909002 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 2f736522-aa94-4b36-a3c4-8061e1691dc7 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-11ff3770-b9c9-4274-b446-6266c251a1b6 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7" status: 404 len: 111 microversion: 2.1 time: 0.032874 Jul 26 20:40:16.913354 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3445/6967] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:16 2022] GET /compute/v2.1/servers/2f736522-aa94-4b36-a3c4-8061e1691dc7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:40:16.919912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:16.920428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:16.926987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:16.927447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:16.928322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:16.928767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:16.943849 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e HTTP/1.1 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '64c18902-f403-4bfa-b959-c377c62cbf0e'} Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:16.945460 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-570e6808-4f9c-406e-ac69-aade167accc3 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 404 len: 111 microversion: 2.1 time: 0.031041 Jul 26 20:40:16.949792 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3523/6968] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:40:16 2022] DELETE /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:16.955850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:16.956483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 64c18902-f403-4bfa-b959-c377c62cbf0e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:16.963628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:16.964105 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:16.964908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:16.965363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:16.981393 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e HTTP/1.1 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '64c18902-f403-4bfa-b959-c377c62cbf0e'} Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:16.982672 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 64c18902-f403-4bfa-b959-c377c62cbf0e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c7eb8040-8e4c-4f1b-b07c-927f34c645ed tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e" status: 404 len: 111 microversion: 2.1 time: 0.032266 Jul 26 20:40:16.987116 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3446/6969] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:16 2022] GET /compute/v2.1/servers/64c18902-f403-4bfa-b959-c377c62cbf0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:16.994673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:16.995180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:17.001335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:17.001788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:17.002570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:17.003009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:17.017182 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b HTTP/1.1 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '660271a7-1058-47f3-b4e3-62fef3cc675b'} Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:17.018749 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-08fc3145-7852-4526-9f61-6bc33c5002f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 404 len: 111 microversion: 2.1 time: 0.030511 Jul 26 20:40:17.022963 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3524/6970] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:40:16 2022] DELETE /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:17.029673 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:17.030519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 660271a7-1058-47f3-b4e3-62fef3cc675b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:17.037126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:17.037586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:17.038370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:17.038817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:17.053615 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b HTTP/1.1 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '660271a7-1058-47f3-b4e3-62fef3cc675b'} Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:17.055170 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 660271a7-1058-47f3-b4e3-62fef3cc675b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-329e5805-22a4-42bb-a154-0172de0553f5 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b" status: 404 len: 111 microversion: 2.1 time: 0.030854 Jul 26 20:40:17.059417 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3447/6971] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:17 2022] GET /compute/v2.1/servers/660271a7-1058-47f3-b4e3-62fef3cc675b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:17.065233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:17.065737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:17.072557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:17.072960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:17.073739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:17.074185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:17.088042 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 HTTP/1.1 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '0edabf07-d1e9-4f4d-9c16-7b6ce30147b5'} Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:17.089647 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-44645258-719a-4739-8dc3-206b7a9af653 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 404 len: 111 microversion: 2.1 time: 0.029739 Jul 26 20:40:17.093363 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3525/6972] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:40:17 2022] DELETE /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 20:40:17.100665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:17.101496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] [instance: 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:17.107830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:17.108297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:17.109079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:17.109534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:17.123640 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] HTTP exception thrown: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Request method failure captured: Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 HTTP/1.1 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4E_OWUML_YMuWF1CG_TQNKB95mzKVcL_xShDhp7mGJS5kSmNsWFDBLf7Wf9ALgghP5sO4_Ko_yRNgiJlpoRFLGbShnsD0P9xNDpk8u12JcK_wVYxUHsi_5HoS1xJ_YiH7KFs5fnMHB56hzmXgk4NMWr8VJaAYnJsvFU8pcaRfg-4gVg Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_900b25bc067d42fcb9ce8d5637b814c5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/900b25bc067d42fcb9ce8d5637b814c5"}]}] Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 900b25bc067d42fcb9ce8d5637b814c5 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServerActionsTestJSON-361962582 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a6d13710ea1a4204bb0b70c1964c4d09 Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServerActionsTestJSON-361962582-project Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '0edabf07-d1e9-4f4d-9c16-7b6ce30147b5'} Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:17.125193 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Returning 404 to user: Instance 0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-01d21e18-b001-4605-973f-b0e4b122f822 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5" status: 404 len: 111 microversion: 2.1 time: 0.029990 Jul 26 20:40:17.129313 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3448/6973] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:17 2022] GET /compute/v2.1/servers/0edabf07-d1e9-4f4d-9c16-7b6ce30147b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:17.135962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b56d033c-b061-4de3-ad94-554c3076f579 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] Calling method '.version_select at 0x7f87682eec10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:17.159481 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b56d033c-b061-4de3-ad94-554c3076f579 tempest-ServerActionsTestJSON-361962582 tempest-ServerActionsTestJSON-361962582-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-800196711" status: 202 len: 0 microversion: 2.1 time: 0.027233 Jul 26 20:40:17.160270 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3526/6974] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Jul 26 20:40:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-800196711 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:40:25.875177 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:40:25.876058 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:40:26.186023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1741070041", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "222577fb-bbd0-4d9c-92da-a36994d7994f"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:26.243201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] validate_networks() for [('222577fb-bbd0-4d9c-92da-a36994d7994f', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:40:26.685542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:40:26.685975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:40:26.686457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:40:26.686880 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:40:26.687301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:40:26.697081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:26.697535 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:26.698346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:26.698792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:26.715747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Getting quotas for project aebd7c76f8f148f089c368103aba5c49. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:40:26.721505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Getting quotas for user a30ed3e724b940d6a6e97c8f9b04906a and project aebd7c76f8f148f089c368103aba5c49. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:40:26.734100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:40:26.736416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:40:26.782443 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9acb2a3b-54aa-4e42-bd83-271788f013a9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717745 Jul 26 20:40:26.783093 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3449/6975] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:40:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:40:26.794020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ce7935ff-d370-4ef4-bc31-c3fadff2c7a7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:26.795129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ce7935ff-d370-4ef4-bc31-c3fadff2c7a7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:26.852403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ce7935ff-d370-4ef4-bc31-c3fadff2c7a7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:26.859461 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ce7935ff-d370-4ef4-bc31-c3fadff2c7a7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1217 microversion: 2.1 time: 0.069244 Jul 26 20:40:26.860084 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3527/6976] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:26 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:40:27.884930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18537ec8-a5e5-447c-9d16-0a248f109d57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:27.886672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18537ec8-a5e5-447c-9d16-0a248f109d57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:27.952604 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18537ec8-a5e5-447c-9d16-0a248f109d57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:27.961901 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18537ec8-a5e5-447c-9d16-0a248f109d57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1217 microversion: 2.1 time: 0.084247 Jul 26 20:40:27.963156 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3450/6977] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:27 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:28.982726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-96ac3cad-b2cc-4e49-aab5-9a42b831e573 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:28.983469 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-96ac3cad-b2cc-4e49-aab5-9a42b831e573 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:28.985514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=33 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:29.051036 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-96ac3cad-b2cc-4e49-aab5-9a42b831e573 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:29.065355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-96ac3cad-b2cc-4e49-aab5-9a42b831e573 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1217 microversion: 2.1 time: 0.086474 Jul 26 20:40:29.066242 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3528/6978] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:28 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:30.086299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b3d3d0d8-254c-49c6-8997-a8a40eba2e26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:30.086917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b3d3d0d8-254c-49c6-8997-a8a40eba2e26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:30.139909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b3d3d0d8-254c-49c6-8997-a8a40eba2e26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:30.146690 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b3d3d0d8-254c-49c6-8997-a8a40eba2e26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1217 microversion: 2.1 time: 0.064227 Jul 26 20:40:30.147392 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3451/6979] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:30 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:31.168438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7ca43dee-f76f-46b3-ae33-5fe0b6440e47 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:31.169043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7ca43dee-f76f-46b3-ae33-5fe0b6440e47 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:31.177130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ca43dee-f76f-46b3-ae33-5fe0b6440e47 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:31.177497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ca43dee-f76f-46b3-ae33-5fe0b6440e47 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:31.178894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ca43dee-f76f-46b3-ae33-5fe0b6440e47 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:31.179477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7ca43dee-f76f-46b3-ae33-5fe0b6440e47 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:31.244271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7ca43dee-f76f-46b3-ae33-5fe0b6440e47 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:31.251698 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7ca43dee-f76f-46b3-ae33-5fe0b6440e47 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1221 microversion: 2.1 time: 0.087535 Jul 26 20:40:31.252275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3529/6980] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:31 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:32.272801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e4ea684-8a94-48f4-9e33-23532740eb8b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:32.273591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e4ea684-8a94-48f4-9e33-23532740eb8b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:32.281173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e4ea684-8a94-48f4-9e33-23532740eb8b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:32.281636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e4ea684-8a94-48f4-9e33-23532740eb8b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:32.282422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e4ea684-8a94-48f4-9e33-23532740eb8b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:32.282874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e4ea684-8a94-48f4-9e33-23532740eb8b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:32.357634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e4ea684-8a94-48f4-9e33-23532740eb8b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:32.364707 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e4ea684-8a94-48f4-9e33-23532740eb8b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1275 microversion: 2.1 time: 0.095859 Jul 26 20:40:32.365290 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3452/6981] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:32 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:40:33.315325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e64fd606-6b09-4d36-95bc-bdffcac05c70 req-cd1b4a90-83a1-4346-9293-91869dadcb53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af1240f-b46e-4b24-a548-7d4867ccdf9c", "tag": "27c518ac-6822-4a95-88af-9ae7e8a02a79"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:33.326627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e64fd606-6b09-4d36-95bc-bdffcac05c70 req-cd1b4a90-83a1-4346-9293-91869dadcb53 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:33.327069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e64fd606-6b09-4d36-95bc-bdffcac05c70 req-cd1b4a90-83a1-4346-9293-91869dadcb53 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:33.339510 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e64fd606-6b09-4d36-95bc-bdffcac05c70 req-cd1b4a90-83a1-4346-9293-91869dadcb53 service nova] Creating event network-changed:27c518ac-6822-4a95-88af-9ae7e8a02a79 for instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c on n-h2-708768-8 Jul 26 20:40:33.344679 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e64fd606-6b09-4d36-95bc-bdffcac05c70 req-cd1b4a90-83a1-4346-9293-91869dadcb53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121302 Jul 26 20:40:33.345597 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3530/6982] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:40:33.388682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0562fc8-5c8c-4dd1-922c-457b0565ed39 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:33.389932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0562fc8-5c8c-4dd1-922c-457b0565ed39 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:33.397320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0562fc8-5c8c-4dd1-922c-457b0565ed39 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:33.397978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0562fc8-5c8c-4dd1-922c-457b0565ed39 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:33.399927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0562fc8-5c8c-4dd1-922c-457b0565ed39 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:33.400454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0562fc8-5c8c-4dd1-922c-457b0565ed39 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:33.622322 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e0562fc8-5c8c-4dd1-922c-457b0565ed39 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:33.629909 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0562fc8-5c8c-4dd1-922c-457b0565ed39 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1317 microversion: 2.1 time: 0.247473 Jul 26 20:40:33.630496 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3453/6983] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:33 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:34.652558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f3c4457-fe4c-469d-a49b-390a1d68123a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:34.653301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f3c4457-fe4c-469d-a49b-390a1d68123a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:34.659593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f3c4457-fe4c-469d-a49b-390a1d68123a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:34.660076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f3c4457-fe4c-469d-a49b-390a1d68123a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:34.660848 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f3c4457-fe4c-469d-a49b-390a1d68123a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:34.661290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f3c4457-fe4c-469d-a49b-390a1d68123a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:34.796027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9f3c4457-fe4c-469d-a49b-390a1d68123a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:34.804044 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f3c4457-fe4c-469d-a49b-390a1d68123a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1317 microversion: 2.1 time: 0.157276 Jul 26 20:40:34.804692 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3531/6984] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:34 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:35.824291 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-796cc4ae-91d6-4aa7-948c-d5170abcd806 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:35.824920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-796cc4ae-91d6-4aa7-948c-d5170abcd806 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:35.831963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-796cc4ae-91d6-4aa7-948c-d5170abcd806 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:35.832426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-796cc4ae-91d6-4aa7-948c-d5170abcd806 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:35.833202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-796cc4ae-91d6-4aa7-948c-d5170abcd806 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:35.833655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-796cc4ae-91d6-4aa7-948c-d5170abcd806 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:35.962683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-796cc4ae-91d6-4aa7-948c-d5170abcd806 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:35.970759 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-796cc4ae-91d6-4aa7-948c-d5170abcd806 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1317 microversion: 2.1 time: 0.150595 Jul 26 20:40:35.971333 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3454/6985] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:35 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:36.992833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7684140d-463d-4e71-ace4-c6d2f6b3f594 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:36.993412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7684140d-463d-4e71-ace4-c6d2f6b3f594 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:37.000419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7684140d-463d-4e71-ace4-c6d2f6b3f594 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:37.000873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7684140d-463d-4e71-ace4-c6d2f6b3f594 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:37.001667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7684140d-463d-4e71-ace4-c6d2f6b3f594 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:37.002105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7684140d-463d-4e71-ace4-c6d2f6b3f594 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:37.139118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7684140d-463d-4e71-ace4-c6d2f6b3f594 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:37.146695 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7684140d-463d-4e71-ace4-c6d2f6b3f594 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1317 microversion: 2.1 time: 0.158332 Jul 26 20:40:37.147271 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3532/6986] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:36 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:38.168682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4bed8930-320a-4ef4-b934-8d874b525b00 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:38.169212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4bed8930-320a-4ef4-b934-8d874b525b00 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:38.171165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:38.177367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bed8930-320a-4ef4-b934-8d874b525b00 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:38.178204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bed8930-320a-4ef4-b934-8d874b525b00 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:38.179889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bed8930-320a-4ef4-b934-8d874b525b00 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:38.180446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4bed8930-320a-4ef4-b934-8d874b525b00 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:38.184358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=48 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:38.314539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4bed8930-320a-4ef4-b934-8d874b525b00 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:38.322168 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4bed8930-320a-4ef4-b934-8d874b525b00 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1317 microversion: 2.1 time: 0.157607 Jul 26 20:40:38.322740 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3455/6987] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:38 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:39.342692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-56b90833-2b67-40e9-9f05-b86086e5fa26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:39.344243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-56b90833-2b67-40e9-9f05-b86086e5fa26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:39.347366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:39.353509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56b90833-2b67-40e9-9f05-b86086e5fa26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:39.353958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56b90833-2b67-40e9-9f05-b86086e5fa26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:39.354720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56b90833-2b67-40e9-9f05-b86086e5fa26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:39.355152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-56b90833-2b67-40e9-9f05-b86086e5fa26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:39.488564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-56b90833-2b67-40e9-9f05-b86086e5fa26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:39.496793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-56b90833-2b67-40e9-9f05-b86086e5fa26 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1317 microversion: 2.1 time: 0.158217 Jul 26 20:40:39.497379 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3533/6988] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:39 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:39.568232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5239b0d3-8749-40fc-a72a-3179196799a0 req-80b547ed-dd2e-41f8-bb68-4de4ee9275fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af1240f-b46e-4b24-a548-7d4867ccdf9c", "name": "network-vif-plugged", "status": "completed", "tag": "27c518ac-6822-4a95-88af-9ae7e8a02a79"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:39.578878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5239b0d3-8749-40fc-a72a-3179196799a0 req-80b547ed-dd2e-41f8-bb68-4de4ee9275fa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:39.579335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5239b0d3-8749-40fc-a72a-3179196799a0 req-80b547ed-dd2e-41f8-bb68-4de4ee9275fa service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:39.591070 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5239b0d3-8749-40fc-a72a-3179196799a0 req-80b547ed-dd2e-41f8-bb68-4de4ee9275fa service nova] Creating event network-vif-plugged:27c518ac-6822-4a95-88af-9ae7e8a02a79 for instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c on n-h2-708768-8 Jul 26 20:40:39.596137 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5239b0d3-8749-40fc-a72a-3179196799a0 req-80b547ed-dd2e-41f8-bb68-4de4ee9275fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032181 Jul 26 20:40:39.596930 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3456/6989] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:40:40.517274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4506feb6-2340-475e-8a0d-2f44d84d0e03 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:40.517885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4506feb6-2340-475e-8a0d-2f44d84d0e03 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:40.524773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4506feb6-2340-475e-8a0d-2f44d84d0e03 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:40.525221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4506feb6-2340-475e-8a0d-2f44d84d0e03 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:40.525986 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4506feb6-2340-475e-8a0d-2f44d84d0e03 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:40.526419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4506feb6-2340-475e-8a0d-2f44d84d0e03 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:40.653731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4506feb6-2340-475e-8a0d-2f44d84d0e03 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:40.661134 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4506feb6-2340-475e-8a0d-2f44d84d0e03 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1317 microversion: 2.1 time: 0.147799 Jul 26 20:40:40.661703 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3534/6990] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:40 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:41.680549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=10 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:41.685683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c619a622-71b7-4e51-9f48-59878bff9687 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:41.686399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c619a622-71b7-4e51-9f48-59878bff9687 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:41.693070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c619a622-71b7-4e51-9f48-59878bff9687 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:41.693471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c619a622-71b7-4e51-9f48-59878bff9687 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:41.694249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c619a622-71b7-4e51-9f48-59878bff9687 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:41.695263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c619a622-71b7-4e51-9f48-59878bff9687 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:41.834769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c619a622-71b7-4e51-9f48-59878bff9687 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:41.842968 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c619a622-71b7-4e51-9f48-59878bff9687 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1506 microversion: 2.1 time: 0.163945 Jul 26 20:40:41.843744 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3457/6991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:41 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:41.903401 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839098691", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "222577fb-bbd0-4d9c-92da-a36994d7994f"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:41.957820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] validate_networks() for [('222577fb-bbd0-4d9c-92da-a36994d7994f', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:40:42.324189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:40:42.324611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:40:42.325083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:40:42.325520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:40:42.325923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:40:42.335066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:42.336065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:42.336871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:42.337303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:42.354953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Getting quotas for project aebd7c76f8f148f089c368103aba5c49. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:40:42.360194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Getting quotas for user a30ed3e724b940d6a6e97c8f9b04906a and project aebd7c76f8f148f089c368103aba5c49. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:40:42.373363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:40:42.375586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:40:42.420342 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [d9c29890-be1b-42cd-aa5e-1486c6deda58] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 20:40:43.429702 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [d9c29890-be1b-42cd-aa5e-1486c6deda58] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 43674. Jul 26 20:40:43.433823 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c3421b79-6c19-4c72-b9e9-d16ed1e915ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534358 Jul 26 20:40:43.434494 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3535/6992] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:40:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:40:43.445978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8aaaca92-6f9b-4fb8-9124-04bea87e27b8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:43.446599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8aaaca92-6f9b-4fb8-9124-04bea87e27b8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:43.450813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:43.503549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8aaaca92-6f9b-4fb8-9124-04bea87e27b8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:43.511320 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8aaaca92-6f9b-4fb8-9124-04bea87e27b8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1217 microversion: 2.1 time: 0.069913 Jul 26 20:40:43.511938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3458/6993] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:43 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:44.532755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-54c70589-3ebc-43d6-ada9-3347065bc865 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:44.533373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-54c70589-3ebc-43d6-ada9-3347065bc865 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:44.535298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:44.542180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54c70589-3ebc-43d6-ada9-3347065bc865 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:44.542638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54c70589-3ebc-43d6-ada9-3347065bc865 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:44.543417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54c70589-3ebc-43d6-ada9-3347065bc865 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:44.543883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-54c70589-3ebc-43d6-ada9-3347065bc865 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:44.622930 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-54c70589-3ebc-43d6-ada9-3347065bc865 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:44.630725 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-54c70589-3ebc-43d6-ada9-3347065bc865 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1275 microversion: 2.1 time: 0.102943 Jul 26 20:40:44.631316 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3536/6994] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:44 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:45.652960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-aa9ba105-3fd9-420d-8b11-bbd7db920c15 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:45.653594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-aa9ba105-3fd9-420d-8b11-bbd7db920c15 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:45.662409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa9ba105-3fd9-420d-8b11-bbd7db920c15 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:45.662871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa9ba105-3fd9-420d-8b11-bbd7db920c15 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:45.664816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa9ba105-3fd9-420d-8b11-bbd7db920c15 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:45.665282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-aa9ba105-3fd9-420d-8b11-bbd7db920c15 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:45.687396 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bcb33a2b-e374-4aac-b1d5-49767e4f6f9d req-b4a51fac-8c2d-4056-b5d3-b4bf614e6f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7e2350-6628-4c08-b418-cf44e4152c3b", "tag": "f974fa59-6fea-4774-a26a-a772e0a1237e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:45.705894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bcb33a2b-e374-4aac-b1d5-49767e4f6f9d req-b4a51fac-8c2d-4056-b5d3-b4bf614e6f17 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:45.706369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bcb33a2b-e374-4aac-b1d5-49767e4f6f9d req-b4a51fac-8c2d-4056-b5d3-b4bf614e6f17 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:45.738751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bcb33a2b-e374-4aac-b1d5-49767e4f6f9d req-b4a51fac-8c2d-4056-b5d3-b4bf614e6f17 service nova] Creating event network-changed:f974fa59-6fea-4774-a26a-a772e0a1237e for instance 7b7e2350-6628-4c08-b418-cf44e4152c3b on n-h1-708768-8 Jul 26 20:40:45.745915 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bcb33a2b-e374-4aac-b1d5-49767e4f6f9d req-b4a51fac-8c2d-4056-b5d3-b4bf614e6f17 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061869 Jul 26 20:40:45.746545 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3537/6995] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:40:45.848118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-aa9ba105-3fd9-420d-8b11-bbd7db920c15 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:45.857358 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-aa9ba105-3fd9-420d-8b11-bbd7db920c15 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1317 microversion: 2.1 time: 0.209077 Jul 26 20:40:45.857954 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3459/6996] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:45 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:46.878783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cc962588-cb9e-4840-8c57-c54c95b24c85 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:46.879489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc962588-cb9e-4840-8c57-c54c95b24c85 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:46.886729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc962588-cb9e-4840-8c57-c54c95b24c85 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:46.887173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc962588-cb9e-4840-8c57-c54c95b24c85 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:46.887966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc962588-cb9e-4840-8c57-c54c95b24c85 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:46.888399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc962588-cb9e-4840-8c57-c54c95b24c85 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:47.020919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cc962588-cb9e-4840-8c57-c54c95b24c85 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:47.030191 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cc962588-cb9e-4840-8c57-c54c95b24c85 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1317 microversion: 2.1 time: 0.155626 Jul 26 20:40:47.030789 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3538/6997] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:46 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:48.050628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-22d81e96-41e5-49ea-9d2f-88ad6e3115ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:48.051259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-22d81e96-41e5-49ea-9d2f-88ad6e3115ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:48.059038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22d81e96-41e5-49ea-9d2f-88ad6e3115ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:48.059502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22d81e96-41e5-49ea-9d2f-88ad6e3115ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:48.060311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22d81e96-41e5-49ea-9d2f-88ad6e3115ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:48.060763 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-22d81e96-41e5-49ea-9d2f-88ad6e3115ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:48.474441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-22d81e96-41e5-49ea-9d2f-88ad6e3115ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:48.482428 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-22d81e96-41e5-49ea-9d2f-88ad6e3115ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1317 microversion: 2.1 time: 0.435940 Jul 26 20:40:48.483034 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3460/6998] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:48 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:49.504571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7a763a38-8e41-4a73-8cdd-a92144efa640 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:49.505397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7a763a38-8e41-4a73-8cdd-a92144efa640 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:49.513481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a763a38-8e41-4a73-8cdd-a92144efa640 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:49.513938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a763a38-8e41-4a73-8cdd-a92144efa640 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:49.514741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a763a38-8e41-4a73-8cdd-a92144efa640 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:49.515150 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7a763a38-8e41-4a73-8cdd-a92144efa640 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:49.650906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7a763a38-8e41-4a73-8cdd-a92144efa640 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:49.658512 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7a763a38-8e41-4a73-8cdd-a92144efa640 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1317 microversion: 2.1 time: 0.157961 Jul 26 20:40:49.659081 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3539/6999] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:49 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:50.679944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b7531495-9314-4f21-9367-de57e5525ca6 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:50.680567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b7531495-9314-4f21-9367-de57e5525ca6 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:50.687463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7531495-9314-4f21-9367-de57e5525ca6 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:50.687947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7531495-9314-4f21-9367-de57e5525ca6 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:50.688711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7531495-9314-4f21-9367-de57e5525ca6 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:50.689201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b7531495-9314-4f21-9367-de57e5525ca6 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:50.815575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b7531495-9314-4f21-9367-de57e5525ca6 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:50.823708 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b7531495-9314-4f21-9367-de57e5525ca6 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1317 microversion: 2.1 time: 0.147960 Jul 26 20:40:50.824279 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3461/7000] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:50 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:51.494425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-49ad6834-9e7e-4cd5-8cc9-b0e3faa6287a req-d83e3577-84c6-4f57-b923-d350cb44bc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7e2350-6628-4c08-b418-cf44e4152c3b", "name": "network-vif-plugged", "status": "completed", "tag": "f974fa59-6fea-4774-a26a-a772e0a1237e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:51.504844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-49ad6834-9e7e-4cd5-8cc9-b0e3faa6287a req-d83e3577-84c6-4f57-b923-d350cb44bc11 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:51.505272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-49ad6834-9e7e-4cd5-8cc9-b0e3faa6287a req-d83e3577-84c6-4f57-b923-d350cb44bc11 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:51.517351 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-49ad6834-9e7e-4cd5-8cc9-b0e3faa6287a req-d83e3577-84c6-4f57-b923-d350cb44bc11 service nova] Creating event network-vif-plugged:f974fa59-6fea-4774-a26a-a772e0a1237e for instance 7b7e2350-6628-4c08-b418-cf44e4152c3b on n-h1-708768-8 Jul 26 20:40:51.522488 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-49ad6834-9e7e-4cd5-8cc9-b0e3faa6287a req-d83e3577-84c6-4f57-b923-d350cb44bc11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031932 Jul 26 20:40:51.523646 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3540/7001] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:40:51.845520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0d0001a-8ef6-4479-ada4-8a07048a2a3d tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:51.846149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a0d0001a-8ef6-4479-ada4-8a07048a2a3d tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:51.853341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0d0001a-8ef6-4479-ada4-8a07048a2a3d tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:51.853802 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0d0001a-8ef6-4479-ada4-8a07048a2a3d tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:51.854575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0d0001a-8ef6-4479-ada4-8a07048a2a3d tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:51.855023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0d0001a-8ef6-4479-ada4-8a07048a2a3d tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:51.985897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a0d0001a-8ef6-4479-ada4-8a07048a2a3d tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:51.993880 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0d0001a-8ef6-4479-ada4-8a07048a2a3d tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1317 microversion: 2.1 time: 0.152282 Jul 26 20:40:51.994457 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3462/7002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:51 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:53.012007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:53.013442 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:53.019046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b82daf0-aeb8-4b73-959e-6af505acc5c9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:53.019814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b82daf0-aeb8-4b73-959e-6af505acc5c9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:53.028109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b82daf0-aeb8-4b73-959e-6af505acc5c9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:53.028512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b82daf0-aeb8-4b73-959e-6af505acc5c9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:53.029299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b82daf0-aeb8-4b73-959e-6af505acc5c9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:53.029743 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b82daf0-aeb8-4b73-959e-6af505acc5c9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:53.171486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b82daf0-aeb8-4b73-959e-6af505acc5c9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:53.179585 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b82daf0-aeb8-4b73-959e-6af505acc5c9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1506 microversion: 2.1 time: 0.168653 Jul 26 20:40:53.180179 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3541/7003] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:53 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:53.201999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ff0c0f45-5b76-4b5f-b8b6-d4537f5d48c2 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:53.203562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ff0c0f45-5b76-4b5f-b8b6-d4537f5d48c2 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:53.211132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff0c0f45-5b76-4b5f-b8b6-d4537f5d48c2 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:53.211600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff0c0f45-5b76-4b5f-b8b6-d4537f5d48c2 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:53.212749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff0c0f45-5b76-4b5f-b8b6-d4537f5d48c2 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:53.213230 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ff0c0f45-5b76-4b5f-b8b6-d4537f5d48c2 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:53.240715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ff0c0f45-5b76-4b5f-b8b6-d4537f5d48c2 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:40:53.325436 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ff0c0f45-5b76-4b5f-b8b6-d4537f5d48c2 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 204 len: 0 microversion: 2.1 time: 0.126809 Jul 26 20:40:53.326448 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3463/7004] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:40:53 2022] DELETE /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:40:53.338047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f1741b9-6d03-41ad-bb74-fc48608accd9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:53.338672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7f1741b9-6d03-41ad-bb74-fc48608accd9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:53.345112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f1741b9-6d03-41ad-bb74-fc48608accd9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:53.345583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f1741b9-6d03-41ad-bb74-fc48608accd9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:53.346339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f1741b9-6d03-41ad-bb74-fc48608accd9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:53.346781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f1741b9-6d03-41ad-bb74-fc48608accd9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:53.494971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7f1741b9-6d03-41ad-bb74-fc48608accd9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:53.502729 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f1741b9-6d03-41ad-bb74-fc48608accd9 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1512 microversion: 2.1 time: 0.169302 Jul 26 20:40:53.503331 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3542/7005] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:53 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:54.524864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-230c99e4-29d8-4082-bdc2-599146c87fa7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:54.525582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-230c99e4-29d8-4082-bdc2-599146c87fa7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:54.527510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:54.534600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230c99e4-29d8-4082-bdc2-599146c87fa7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:54.535054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230c99e4-29d8-4082-bdc2-599146c87fa7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:54.535860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230c99e4-29d8-4082-bdc2-599146c87fa7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:54.536308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-230c99e4-29d8-4082-bdc2-599146c87fa7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:54.666733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-230c99e4-29d8-4082-bdc2-599146c87fa7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:54.674745 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-230c99e4-29d8-4082-bdc2-599146c87fa7 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 200 len: 1512 microversion: 2.1 time: 0.154297 Jul 26 20:40:54.675335 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3464/7006] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:54 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:40:55.046878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-35c5fb43-75a4-46e2-90be-c87fc152be80 req-f25aed6f-a5be-4d3b-a722-8882e04e83d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7e2350-6628-4c08-b418-cf44e4152c3b", "name": "network-vif-deleted", "tag": "f974fa59-6fea-4774-a26a-a772e0a1237e"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:55.062202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-35c5fb43-75a4-46e2-90be-c87fc152be80 req-f25aed6f-a5be-4d3b-a722-8882e04e83d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:55.062665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-35c5fb43-75a4-46e2-90be-c87fc152be80 req-f25aed6f-a5be-4d3b-a722-8882e04e83d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:55.079538 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-35c5fb43-75a4-46e2-90be-c87fc152be80 req-f25aed6f-a5be-4d3b-a722-8882e04e83d1 service nova] Creating event network-vif-deleted:f974fa59-6fea-4774-a26a-a772e0a1237e for instance 7b7e2350-6628-4c08-b418-cf44e4152c3b on n-h1-708768-8 Jul 26 20:40:55.087539 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-35c5fb43-75a4-46e2-90be-c87fc152be80 req-f25aed6f-a5be-4d3b-a722-8882e04e83d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043853 Jul 26 20:40:55.088225 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3543/7007] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:40:55.695830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:55.696384 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:55.703245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:55.703732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:55.704503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:55.704948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:55.718871 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] HTTP exception thrown: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Request method failure captured: Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b HTTP/1.1 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FE52MWMvgJxoowa0BBs1peMPgVWMLE2Ju5gIHwKLeMxtQL3ZvjazeWkdpo7fSOGOQGp_NQEnCKJbWXYq-X0SsUUjshCxL1P8WAd1-emYCZeAXOSyH5LeFSmwzzc6mS0xx9mq3XmOpPCPHNO-NnxzEApA5PGZ_U709THgI5vLe2PrNo Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aebd7c76f8f148f089c368103aba5c49", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}] Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a30ed3e724b940d6a6e97c8f9b04906a Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7b7e2350-6628-4c08-b418-cf44e4152c3b'} Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:55.720552 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Returning 404 to user: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ec8a12e-d748-4423-9a5e-fa1cad9bb0ff tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 404 len: 111 microversion: 2.1 time: 0.030219 Jul 26 20:40:55.724959 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3465/7008] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:55 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:55.732265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-91f9aaba-2d07-47ba-a5e6-5d94d43726f8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:55.733004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-91f9aaba-2d07-47ba-a5e6-5d94d43726f8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:55.739452 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91f9aaba-2d07-47ba-a5e6-5d94d43726f8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:55.739939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91f9aaba-2d07-47ba-a5e6-5d94d43726f8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:55.740708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91f9aaba-2d07-47ba-a5e6-5d94d43726f8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:55.741226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91f9aaba-2d07-47ba-a5e6-5d94d43726f8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:55.875829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-91f9aaba-2d07-47ba-a5e6-5d94d43726f8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:55.883841 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-91f9aaba-2d07-47ba-a5e6-5d94d43726f8 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1506 microversion: 2.1 time: 0.155805 Jul 26 20:40:55.884421 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3544/7009] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:55 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:55.904770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-518a755e-ac7a-460e-b7e6-9f6dfab8ce71 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:55.907023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-518a755e-ac7a-460e-b7e6-9f6dfab8ce71 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: a83a3137-a666-407b-9b08-d1837b651e21] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:55.912588 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-518a755e-ac7a-460e-b7e6-9f6dfab8ce71 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] HTTP exception thrown: Instance a83a3137-a666-407b-9b08-d1837b651e21 could not be found. Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-518a755e-ac7a-460e-b7e6-9f6dfab8ce71 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Request method failure captured: Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/a83a3137-a666-407b-9b08-d1837b651e21/action HTTP/1.1 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 32 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FE52MWMvgJxoowa0BBs1peMPgVWMLE2Ju5gIHwKLeMxtQL3ZvjazeWkdpo7fSOGOQGp_NQEnCKJbWXYq-X0SsUUjshCxL1P8WAd1-emYCZeAXOSyH5LeFSmwzzc6mS0xx9mq3XmOpPCPHNO-NnxzEApA5PGZ_U709THgI5vLe2PrNo Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aebd7c76f8f148f089c368103aba5c49", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}] Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a30ed3e724b940d6a6e97c8f9b04906a Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: {"resize": {"flavorRef": "452"}} Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance a83a3137-a666-407b-9b08-d1837b651e21 could not be found. Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a83a3137-a666-407b-9b08-d1837b651e21', 'body': {'resize': {'flavorRef': '452'}}} Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83a3137-a666-407b-9b08-d1837b651e21 could not be found. Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:55.914433 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83a3137-a666-407b-9b08-d1837b651e21 could not be found. Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83a3137-a666-407b-9b08-d1837b651e21 could not be found. Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-518a755e-ac7a-460e-b7e6-9f6dfab8ce71 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Returning 404 to user: Instance a83a3137-a666-407b-9b08-d1837b651e21 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-518a755e-ac7a-460e-b7e6-9f6dfab8ce71 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "POST /compute/v2.1/servers/a83a3137-a666-407b-9b08-d1837b651e21/action" status: 404 len: 111 microversion: 2.1 time: 0.015605 Jul 26 20:40:55.919805 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3466/7010] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:40:55 2022] POST /compute/v2.1/servers/a83a3137-a666-407b-9b08-d1837b651e21/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:55.925045 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b15cd407-cc6c-417b-8e8e-aca941096a88 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:55.925663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b15cd407-cc6c-417b-8e8e-aca941096a88 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:55.931779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b15cd407-cc6c-417b-8e8e-aca941096a88 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:55.932229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b15cd407-cc6c-417b-8e8e-aca941096a88 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:55.932994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b15cd407-cc6c-417b-8e8e-aca941096a88 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:55.933431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b15cd407-cc6c-417b-8e8e-aca941096a88 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.061871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b15cd407-cc6c-417b-8e8e-aca941096a88 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:56.070489 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b15cd407-cc6c-417b-8e8e-aca941096a88 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1506 microversion: 2.1 time: 0.149406 Jul 26 20:40:56.071066 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3545/7011] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:55 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:56.091885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f23c616-bdcf-4a5c-b42f-ca82744d4a40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:56.092507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f23c616-bdcf-4a5c-b42f-ca82744d4a40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:56.102588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f23c616-bdcf-4a5c-b42f-ca82744d4a40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.103051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f23c616-bdcf-4a5c-b42f-ca82744d4a40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.103897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f23c616-bdcf-4a5c-b42f-ca82744d4a40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.104354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f23c616-bdcf-4a5c-b42f-ca82744d4a40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.236551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6f23c616-bdcf-4a5c-b42f-ca82744d4a40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:56.244107 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f23c616-bdcf-4a5c-b42f-ca82744d4a40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1506 microversion: 2.1 time: 0.156064 Jul 26 20:40:56.244674 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3467/7012] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:56 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:56.264841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d884d024-d3cc-4258-ad3b-e472bab54f95"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:56.267022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:56.274227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.274674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.275436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.275891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.304466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:56.309616 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] HTTP exception thrown: Flavor d884d024-d3cc-4258-ad3b-e472bab54f95 could not be found. Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Request method failure captured: Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: request: POST /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c/action HTTP/1.1 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 65 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FE52MWMvgJxoowa0BBs1peMPgVWMLE2Ju5gIHwKLeMxtQL3ZvjazeWkdpo7fSOGOQGp_NQEnCKJbWXYq-X0SsUUjshCxL1P8WAd1-emYCZeAXOSyH5LeFSmwzzc6mS0xx9mq3XmOpPCPHNO-NnxzEApA5PGZ_U709THgI5vLe2PrNo Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aebd7c76f8f148f089c368103aba5c49", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}] Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a30ed3e724b940d6a6e97c8f9b04906a Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: {"resize": {"flavorRef": "d884d024-d3cc-4258-ad3b-e472bab54f95"}} Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: exception: Flavor d884d024-d3cc-4258-ad3b-e472bab54f95 could not be found. Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '8af1240f-b46e-4b24-a548-7d4867ccdf9c', 'body': {'resize': {'flavorRef': 'd884d024-d3cc-4258-ad3b-e472bab54f95'}}} Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 20:40:56.311512 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d884d024-d3cc-4258-ad3b-e472bab54f95 could not be found. Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d884d024-d3cc-4258-ad3b-e472bab54f95 could not be found. Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d884d024-d3cc-4258-ad3b-e472bab54f95 could not be found. Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Returning 400 to user: Flavor d884d024-d3cc-4258-ad3b-e472bab54f95 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef275435-318a-4fc8-a749-3e6fdc5d276b tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "POST /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c/action" status: 400 len: 107 microversion: 2.1 time: 0.052198 Jul 26 20:40:56.315947 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3546/7013] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:40:56 2022] POST /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c/action => generated 107 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 20:40:56.322581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ad577f6-0cf7-4ff1-92e2-e2c295f36d84 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:56.323215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ad577f6-0cf7-4ff1-92e2-e2c295f36d84 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:56.329496 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ad577f6-0cf7-4ff1-92e2-e2c295f36d84 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.329978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ad577f6-0cf7-4ff1-92e2-e2c295f36d84 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.330742 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ad577f6-0cf7-4ff1-92e2-e2c295f36d84 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.331192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ad577f6-0cf7-4ff1-92e2-e2c295f36d84 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.462124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ad577f6-0cf7-4ff1-92e2-e2c295f36d84 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:56.469630 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ad577f6-0cf7-4ff1-92e2-e2c295f36d84 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1506 microversion: 2.1 time: 0.151667 Jul 26 20:40:56.470206 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3468/7014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:56 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:56.492328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5030c878-217a-49f0-8329-e885b351fb40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:56.492933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5030c878-217a-49f0-8329-e885b351fb40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:56.499026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5030c878-217a-49f0-8329-e885b351fb40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.499470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5030c878-217a-49f0-8329-e885b351fb40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.500271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5030c878-217a-49f0-8329-e885b351fb40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.500705 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5030c878-217a-49f0-8329-e885b351fb40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.632343 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5030c878-217a-49f0-8329-e885b351fb40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:56.639797 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5030c878-217a-49f0-8329-e885b351fb40 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1506 microversion: 2.1 time: 0.151492 Jul 26 20:40:56.640360 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3547/7015] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:56 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:56.660603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3512da12-c5cc-4d1b-9e8a-df4f95ab2152 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3512da12-c5cc-4d1b-9e8a-df4f95ab2152 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Request method failure captured: Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: request: POST /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c/action HTTP/1.1 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 29 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FE52MWMvgJxoowa0BBs1peMPgVWMLE2Ju5gIHwKLeMxtQL3ZvjazeWkdpo7fSOGOQGp_NQEnCKJbWXYq-X0SsUUjshCxL1P8WAd1-emYCZeAXOSyH5LeFSmwzzc6mS0xx9mq3XmOpPCPHNO-NnxzEApA5PGZ_U709THgI5vLe2PrNo Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aebd7c76f8f148f089c368103aba5c49", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}] Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a30ed3e724b940d6a6e97c8f9b04906a Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: {"resize": {"flavorRef": ""}} Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8af1240f-b46e-4b24-a548-7d4867ccdf9c', 'body': {'resize': {'flavorRef': ''}}} Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise error Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi '' Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.665129 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3512da12-c5cc-4d1b-9e8a-df4f95ab2152 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3512da12-c5cc-4d1b-9e8a-df4f95ab2152 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "POST /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c/action" status: 400 len: 113 microversion: 2.1 time: 0.009841 Jul 26 20:40:56.669620 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3469/7016] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:40:56 2022] POST /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 20:40:56.674750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a926edfa-69d3-4f56-9028-5b4e4b6a1674 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:56.675366 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a926edfa-69d3-4f56-9028-5b4e4b6a1674 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:56.681510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a926edfa-69d3-4f56-9028-5b4e4b6a1674 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.681960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a926edfa-69d3-4f56-9028-5b4e4b6a1674 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.682727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a926edfa-69d3-4f56-9028-5b4e4b6a1674 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.683167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a926edfa-69d3-4f56-9028-5b4e4b6a1674 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.810208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a926edfa-69d3-4f56-9028-5b4e4b6a1674 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:56.817743 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a926edfa-69d3-4f56-9028-5b4e4b6a1674 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1506 microversion: 2.1 time: 0.146929 Jul 26 20:40:56.818319 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3548/7017] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:56 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:56.843142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:56.843671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:56.851045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.851511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.852317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.852770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.865607 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] HTTP exception thrown: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Request method failure captured: Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b HTTP/1.1 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FE52MWMvgJxoowa0BBs1peMPgVWMLE2Ju5gIHwKLeMxtQL3ZvjazeWkdpo7fSOGOQGp_NQEnCKJbWXYq-X0SsUUjshCxL1P8WAd1-emYCZeAXOSyH5LeFSmwzzc6mS0xx9mq3XmOpPCPHNO-NnxzEApA5PGZ_U709THgI5vLe2PrNo Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aebd7c76f8f148f089c368103aba5c49", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}] Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a30ed3e724b940d6a6e97c8f9b04906a Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '7b7e2350-6628-4c08-b418-cf44e4152c3b'} Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:56.867706 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Returning 404 to user: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-57320774-3d0b-4fe6-a271-341f632ebd57 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 404 len: 111 microversion: 2.1 time: 0.030685 Jul 26 20:40:56.872005 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3470/7018] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:40:56 2022] DELETE /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:56.877507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:56.878126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 7b7e2350-6628-4c08-b418-cf44e4152c3b] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:56.884912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.885362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.886132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.886572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.890636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=100 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:40:56.901670 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] HTTP exception thrown: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Request method failure captured: Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b HTTP/1.1 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FE52MWMvgJxoowa0BBs1peMPgVWMLE2Ju5gIHwKLeMxtQL3ZvjazeWkdpo7fSOGOQGp_NQEnCKJbWXYq-X0SsUUjshCxL1P8WAd1-emYCZeAXOSyH5LeFSmwzzc6mS0xx9mq3XmOpPCPHNO-NnxzEApA5PGZ_U709THgI5vLe2PrNo Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aebd7c76f8f148f089c368103aba5c49", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}] Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: a30ed3e724b940d6a6e97c8f9b04906a Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '7b7e2350-6628-4c08-b418-cf44e4152c3b'} Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:56.903198 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Returning 404 to user: Instance 7b7e2350-6628-4c08-b418-cf44e4152c3b could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:56.907308 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a351b244-f65a-44e9-ba97-5f6bdc068c0a tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b" status: 404 len: 111 microversion: 2.1 time: 0.031025 Jul 26 20:40:56.908253 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3549/7019] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:56 2022] GET /compute/v2.1/servers/7b7e2350-6628-4c08-b418-cf44e4152c3b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:40:56.913201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e34ca833-548a-4949-93fd-4a76a4fed571 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:56.913813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e34ca833-548a-4949-93fd-4a76a4fed571 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:56.919833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e34ca833-548a-4949-93fd-4a76a4fed571 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.920321 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e34ca833-548a-4949-93fd-4a76a4fed571 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.921094 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e34ca833-548a-4949-93fd-4a76a4fed571 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:56.921542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e34ca833-548a-4949-93fd-4a76a4fed571 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:56.947187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e34ca833-548a-4949-93fd-4a76a4fed571 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:40:57.022345 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e34ca833-548a-4949-93fd-4a76a4fed571 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 204 len: 0 microversion: 2.1 time: 0.112668 Jul 26 20:40:57.023909 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3471/7020] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:40:56 2022] DELETE /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:40:57.032674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad47c2b5-678d-4f8d-8a16-31a16ca949ac tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:57.033291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad47c2b5-678d-4f8d-8a16-31a16ca949ac tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:57.041315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad47c2b5-678d-4f8d-8a16-31a16ca949ac tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:57.041760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad47c2b5-678d-4f8d-8a16-31a16ca949ac tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:57.042524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad47c2b5-678d-4f8d-8a16-31a16ca949ac tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:57.042959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad47c2b5-678d-4f8d-8a16-31a16ca949ac tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:57.175271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad47c2b5-678d-4f8d-8a16-31a16ca949ac tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:57.182808 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad47c2b5-678d-4f8d-8a16-31a16ca949ac tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1512 microversion: 2.1 time: 0.154305 Jul 26 20:40:57.183372 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3550/7021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:57 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:58.204651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ab14ae29-cccb-4583-b3b3-f2ad05fe5eca tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:58.205355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ab14ae29-cccb-4583-b3b3-f2ad05fe5eca tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:58.214509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab14ae29-cccb-4583-b3b3-f2ad05fe5eca tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:58.214969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab14ae29-cccb-4583-b3b3-f2ad05fe5eca tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:58.215792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab14ae29-cccb-4583-b3b3-f2ad05fe5eca tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:58.216237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ab14ae29-cccb-4583-b3b3-f2ad05fe5eca tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:58.445892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ab14ae29-cccb-4583-b3b3-f2ad05fe5eca tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30ed3e724b940d6a6e97c8f9b04906a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aebd7c76f8f148f089c368103aba5c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:40:58.453543 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ab14ae29-cccb-4583-b3b3-f2ad05fe5eca tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 200 len: 1512 microversion: 2.1 time: 0.253197 Jul 26 20:40:58.454140 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3472/7022] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:58 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:40:58.893066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-74f1578c-8daa-40d6-a481-e4d44c77b914 req-3fca6d8a-31b4-465e-bd70-c03fa0164d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af1240f-b46e-4b24-a548-7d4867ccdf9c", "name": "network-vif-deleted", "tag": "27c518ac-6822-4a95-88af-9ae7e8a02a79"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:40:58.905153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-74f1578c-8daa-40d6-a481-e4d44c77b914 req-3fca6d8a-31b4-465e-bd70-c03fa0164d36 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:58.905942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-74f1578c-8daa-40d6-a481-e4d44c77b914 req-3fca6d8a-31b4-465e-bd70-c03fa0164d36 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:58.919473 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-74f1578c-8daa-40d6-a481-e4d44c77b914 req-3fca6d8a-31b4-465e-bd70-c03fa0164d36 service nova] Creating event network-vif-deleted:27c518ac-6822-4a95-88af-9ae7e8a02a79 for instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c on n-h2-708768-8 Jul 26 20:40:58.925023 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-74f1578c-8daa-40d6-a481-e4d44c77b914 req-3fca6d8a-31b4-465e-bd70-c03fa0164d36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036303 Jul 26 20:40:58.925739 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3551/7023] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:40:59.474510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:40:59.475057 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] [instance: 8af1240f-b46e-4b24-a548-7d4867ccdf9c] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:40:59.482188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:59.482655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:59.483441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:40:59.483916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:40:59.498325 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] HTTP exception thrown: Instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c could not be found. Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Request method failure captured: Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c HTTP/1.1 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FE52MWMvgJxoowa0BBs1peMPgVWMLE2Ju5gIHwKLeMxtQL3ZvjazeWkdpo7fSOGOQGp_NQEnCKJbWXYq-X0SsUUjshCxL1P8WAd1-emYCZeAXOSyH5LeFSmwzzc6mS0xx9mq3XmOpPCPHNO-NnxzEApA5PGZ_U709THgI5vLe2PrNo Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_aebd7c76f8f148f089c368103aba5c49", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/aebd7c76f8f148f089c368103aba5c49"}]}] Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: aebd7c76f8f148f089c368103aba5c49 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-ServersNegativeTestJSON-696399078 Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: a30ed3e724b940d6a6e97c8f9b04906a Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-ServersNegativeTestJSON-696399078-project Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c could not be found. Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '8af1240f-b46e-4b24-a548-7d4867ccdf9c'} Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c could not be found. Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c could not be found. Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:40:59.500023 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c could not be found. Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] Returning 404 to user: Instance 8af1240f-b46e-4b24-a548-7d4867ccdf9c could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ff5748e-b737-471e-83ed-e7d14b6315c3 tempest-ServersNegativeTestJSON-696399078 tempest-ServersNegativeTestJSON-696399078-project] 10.222.0.58 "GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c" status: 404 len: 111 microversion: 2.1 time: 0.030994 Jul 26 20:40:59.504258 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3473/7024] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:40:59 2022] GET /compute/v2.1/servers/8af1240f-b46e-4b24-a548-7d4867ccdf9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:41:31.245829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=33 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:31.247143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:31.462700 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6306ffe-fc31-4e19-899c-a42e3f6109ca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: .version_select at 0x7f875644a040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-358776966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+qIEJuRzA9hG0oNWIJPC1ddhNEWMIrSye+04nIWMNbncYOPHKx7Id6jg571p0CdoEkFnC4RXjRtwSDrrunk+f4zo9HD1TTudK+qx11bcXM7T5aLC34959IaCOJdmVf3Q=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:41:31.478604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-b6306ffe-fc31-4e19-899c-a42e3f6109ca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for project e005249c8fc54874a84e27e90e4ac46e. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:41:31.483640 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-b6306ffe-fc31-4e19-899c-a42e3f6109ca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for user 376a9969c4db412dbae516c4d1faf426 and project e005249c8fc54874a84e27e90e4ac46e. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:41:31.509378 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b6306ffe-fc31-4e19-899c-a42e3f6109ca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.265816 Jul 26 20:41:31.510027 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3552/7025] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:41:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:41:31.568348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1825384498", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-358776966", "networks": [{"uuid": "6b47dfd7-2553-432e-b436-4a18f44fffd7"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:41:31.580023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:31.580745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:31.846135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] validate_networks() for [('6b47dfd7-2553-432e-b436-4a18f44fffd7', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:41:32.431688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:41:32.432127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:41:32.432611 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:41:32.433051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:41:32.433669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:41:32.442898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:32.443357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:32.444277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:32.444718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:32.463898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for project e005249c8fc54874a84e27e90e4ac46e. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:41:32.469442 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for user 376a9969c4db412dbae516c4d1faf426 and project e005249c8fc54874a84e27e90e4ac46e. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:41:32.483348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:41:32.485786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:41:32.534086 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8f344d8-be89-4eb4-9b91-5f8b03d01208 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969572 Jul 26 20:41:32.534927 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3474/7026] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:41:32.545996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3343a1f0-7813-430b-9148-f129bf61415f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:32.547313 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3343a1f0-7813-430b-9148-f129bf61415f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:32.705779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3343a1f0-7813-430b-9148-f129bf61415f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:32.714109 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3343a1f0-7813-430b-9148-f129bf61415f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1262 microversion: 2.1 time: 0.171739 Jul 26 20:41:32.715662 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3553/7027] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:32 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1262 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:33.735545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d094ffa3-5ab0-4c6d-a0fa-fead55748a28 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:33.736588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d094ffa3-5ab0-4c6d-a0fa-fead55748a28 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:33.747334 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d094ffa3-5ab0-4c6d-a0fa-fead55748a28 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:33.747918 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d094ffa3-5ab0-4c6d-a0fa-fead55748a28 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:33.748805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d094ffa3-5ab0-4c6d-a0fa-fead55748a28 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:33.749315 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d094ffa3-5ab0-4c6d-a0fa-fead55748a28 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:33.820301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d094ffa3-5ab0-4c6d-a0fa-fead55748a28 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:33.829053 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d094ffa3-5ab0-4c6d-a0fa-fead55748a28 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1332 microversion: 2.1 time: 0.098563 Jul 26 20:41:33.830373 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3475/7028] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:33 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:34.852431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-337c1619-d2a6-48e6-8b40-f6106dc7c511 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:34.853645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-337c1619-d2a6-48e6-8b40-f6106dc7c511 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:34.861249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-337c1619-d2a6-48e6-8b40-f6106dc7c511 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:34.861873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-337c1619-d2a6-48e6-8b40-f6106dc7c511 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:34.862668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-337c1619-d2a6-48e6-8b40-f6106dc7c511 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:34.863105 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-337c1619-d2a6-48e6-8b40-f6106dc7c511 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:35.080703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-337c1619-d2a6-48e6-8b40-f6106dc7c511 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:35.090110 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-337c1619-d2a6-48e6-8b40-f6106dc7c511 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1362 microversion: 2.1 time: 0.242058 Jul 26 20:41:35.092174 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3554/7029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:34 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:35.446102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bcdf9e1f-d151-43f0-9f80-341dda3f5f87 req-3bf5267e-1663-42a2-8f6f-cc43ccd024bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f00951-07b7-42a2-85f1-e357d73bfa14", "tag": "b0d16ecd-9299-4b5f-b163-651faab62a20"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:41:35.462109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bcdf9e1f-d151-43f0-9f80-341dda3f5f87 req-3bf5267e-1663-42a2-8f6f-cc43ccd024bd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:35.462562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bcdf9e1f-d151-43f0-9f80-341dda3f5f87 req-3bf5267e-1663-42a2-8f6f-cc43ccd024bd service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:35.488447 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bcdf9e1f-d151-43f0-9f80-341dda3f5f87 req-3bf5267e-1663-42a2-8f6f-cc43ccd024bd service nova] Creating event network-changed:b0d16ecd-9299-4b5f-b163-651faab62a20 for instance 59f00951-07b7-42a2-85f1-e357d73bfa14 on n-h1-708768-8 Jul 26 20:41:35.503289 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bcdf9e1f-d151-43f0-9f80-341dda3f5f87 req-3bf5267e-1663-42a2-8f6f-cc43ccd024bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157000 Jul 26 20:41:35.504650 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3476/7030] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:41:36.114429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68aa20d4-21b2-43e0-b94f-850438132f98 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:36.115048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68aa20d4-21b2-43e0-b94f-850438132f98 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:36.123143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68aa20d4-21b2-43e0-b94f-850438132f98 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:36.123593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68aa20d4-21b2-43e0-b94f-850438132f98 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:36.124398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68aa20d4-21b2-43e0-b94f-850438132f98 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:36.124839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68aa20d4-21b2-43e0-b94f-850438132f98 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:36.260602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68aa20d4-21b2-43e0-b94f-850438132f98 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:36.268553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68aa20d4-21b2-43e0-b94f-850438132f98 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1362 microversion: 2.1 time: 0.157982 Jul 26 20:41:36.269147 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3555/7031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:36 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:41:37.292501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9c11b702-361c-407c-8141-2e853e53afa2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:37.293228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9c11b702-361c-407c-8141-2e853e53afa2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:37.299959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c11b702-361c-407c-8141-2e853e53afa2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:37.300426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c11b702-361c-407c-8141-2e853e53afa2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:37.301212 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c11b702-361c-407c-8141-2e853e53afa2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:37.301664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9c11b702-361c-407c-8141-2e853e53afa2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:37.728049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9c11b702-361c-407c-8141-2e853e53afa2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:37.735638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9c11b702-361c-407c-8141-2e853e53afa2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1362 microversion: 2.1 time: 0.449298 Jul 26 20:41:37.736201 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3477/7032] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:37 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1362 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:38.758019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-71d6b10c-b082-4541-8491-333082fadf07 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:38.758638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-71d6b10c-b082-4541-8491-333082fadf07 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:38.765691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71d6b10c-b082-4541-8491-333082fadf07 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:38.766144 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71d6b10c-b082-4541-8491-333082fadf07 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:38.766920 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71d6b10c-b082-4541-8491-333082fadf07 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:38.767357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71d6b10c-b082-4541-8491-333082fadf07 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:38.902310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-71d6b10c-b082-4541-8491-333082fadf07 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:38.909755 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-71d6b10c-b082-4541-8491-333082fadf07 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1362 microversion: 2.1 time: 0.156546 Jul 26 20:41:38.910323 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3556/7033] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:38 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:39.930909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe9e7450-c72d-4bce-902d-7317c9c1c849 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:39.931547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe9e7450-c72d-4bce-902d-7317c9c1c849 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:39.938453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe9e7450-c72d-4bce-902d-7317c9c1c849 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:39.938908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe9e7450-c72d-4bce-902d-7317c9c1c849 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:39.939731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe9e7450-c72d-4bce-902d-7317c9c1c849 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:39.940182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe9e7450-c72d-4bce-902d-7317c9c1c849 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:40.089133 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fe9e7450-c72d-4bce-902d-7317c9c1c849 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:40.096587 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe9e7450-c72d-4bce-902d-7317c9c1c849 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1362 microversion: 2.1 time: 0.169805 Jul 26 20:41:40.097157 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3478/7034] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:39 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:41.118665 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34f2ea39-e847-42d7-b39d-8387846a8709 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:41.119307 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34f2ea39-e847-42d7-b39d-8387846a8709 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:41.126235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f2ea39-e847-42d7-b39d-8387846a8709 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:41.126680 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f2ea39-e847-42d7-b39d-8387846a8709 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:41.127439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f2ea39-e847-42d7-b39d-8387846a8709 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:41.128024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34f2ea39-e847-42d7-b39d-8387846a8709 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:41.257971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-34f2ea39-e847-42d7-b39d-8387846a8709 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:41.265458 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34f2ea39-e847-42d7-b39d-8387846a8709 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1362 microversion: 2.1 time: 0.151352 Jul 26 20:41:41.266040 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3557/7035] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:41 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:41.753558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-455c3da5-9d43-4598-8962-d9c337827d61 req-31a4c216-c104-48ae-9428-ab7616ee56f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f00951-07b7-42a2-85f1-e357d73bfa14", "name": "network-vif-plugged", "status": "completed", "tag": "b0d16ecd-9299-4b5f-b163-651faab62a20"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:41:41.763930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-455c3da5-9d43-4598-8962-d9c337827d61 req-31a4c216-c104-48ae-9428-ab7616ee56f8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:41.764393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-455c3da5-9d43-4598-8962-d9c337827d61 req-31a4c216-c104-48ae-9428-ab7616ee56f8 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:41.776073 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-455c3da5-9d43-4598-8962-d9c337827d61 req-31a4c216-c104-48ae-9428-ab7616ee56f8 service nova] Creating event network-vif-plugged:b0d16ecd-9299-4b5f-b163-651faab62a20 for instance 59f00951-07b7-42a2-85f1-e357d73bfa14 on n-h1-708768-8 Jul 26 20:41:41.780995 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-455c3da5-9d43-4598-8962-d9c337827d61 req-31a4c216-c104-48ae-9428-ab7616ee56f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081887 Jul 26 20:41:41.781583 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3479/7036] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:41:42.287219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aba0e4b9-f3a2-4379-9718-09b3d953df7c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:42.288477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aba0e4b9-f3a2-4379-9718-09b3d953df7c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:42.295320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aba0e4b9-f3a2-4379-9718-09b3d953df7c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:42.295803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aba0e4b9-f3a2-4379-9718-09b3d953df7c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:42.296570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aba0e4b9-f3a2-4379-9718-09b3d953df7c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:42.297001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aba0e4b9-f3a2-4379-9718-09b3d953df7c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:42.426005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-aba0e4b9-f3a2-4379-9718-09b3d953df7c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:42.433517 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aba0e4b9-f3a2-4379-9718-09b3d953df7c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1362 microversion: 2.1 time: 0.150356 Jul 26 20:41:42.434088 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3558/7037] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:42 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:43.452834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:43.453525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:43.459081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8814c77f-d2f0-4139-b283-e48017da1950 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:43.459949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8814c77f-d2f0-4139-b283-e48017da1950 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:43.466998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8814c77f-d2f0-4139-b283-e48017da1950 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:43.467463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8814c77f-d2f0-4139-b283-e48017da1950 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:43.468278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8814c77f-d2f0-4139-b283-e48017da1950 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:43.468730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8814c77f-d2f0-4139-b283-e48017da1950 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:43.602828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8814c77f-d2f0-4139-b283-e48017da1950 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:43.610340 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8814c77f-d2f0-4139-b283-e48017da1950 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1554 microversion: 2.1 time: 0.158630 Jul 26 20:41:43.610918 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3480/7038] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:43 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:43.631556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-559772af-1018-4f70-85a3-7885ad7f6db2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:43.632224 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-559772af-1018-4f70-85a3-7885ad7f6db2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:43.634067 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:43.640172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-559772af-1018-4f70-85a3-7885ad7f6db2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:43.640615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-559772af-1018-4f70-85a3-7885ad7f6db2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:43.641376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-559772af-1018-4f70-85a3-7885ad7f6db2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:43.641811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-559772af-1018-4f70-85a3-7885ad7f6db2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:43.771035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-559772af-1018-4f70-85a3-7885ad7f6db2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:41:43.779229 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-559772af-1018-4f70-85a3-7885ad7f6db2 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1554 microversion: 2.1 time: 0.151672 Jul 26 20:41:43.779847 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3559/7039] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:41:43 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:41:45.386332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-69ef19ff-fd25-47dd-8af4-df07edb5fad1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2303082-1f5e-43fc-b884-73c6a42a32a9"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:41:45.388807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-69ef19ff-fd25-47dd-8af4-df07edb5fad1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:45.395783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69ef19ff-fd25-47dd-8af4-df07edb5fad1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:45.396244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69ef19ff-fd25-47dd-8af4-df07edb5fad1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:45.397054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69ef19ff-fd25-47dd-8af4-df07edb5fad1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:45.397498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69ef19ff-fd25-47dd-8af4-df07edb5fad1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:45.638109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-69ef19ff-fd25-47dd-8af4-df07edb5fad1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255559 Jul 26 20:41:45.638736 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3481/7040] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:41:45 2022] POST /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:41:56.333125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf9f2cd3-c293-4b09-8d39-a1e081cd1721 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:56.333638 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf9f2cd3-c293-4b09-8d39-a1e081cd1721 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:56.336289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:56.337007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=36 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:56.342801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf9f2cd3-c293-4b09-8d39-a1e081cd1721 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:56.343251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf9f2cd3-c293-4b09-8d39-a1e081cd1721 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:56.344051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf9f2cd3-c293-4b09-8d39-a1e081cd1721 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:56.344490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf9f2cd3-c293-4b09-8d39-a1e081cd1721 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:56.426692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-bf9f2cd3-c293-4b09-8d39-a1e081cd1721 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lazy-loading 'services' on Instance uuid 59f00951-07b7-42a2-85f1-e357d73bfa14 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:41:56.499349 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf9f2cd3-c293-4b09-8d39-a1e081cd1721 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments/f2303082-1f5e-43fc-b884-73c6a42a32a9" status: 202 len: 0 microversion: 2.1 time: 0.170020 Jul 26 20:41:56.500008 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3560/7041] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:41:56 2022] DELETE /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments/f2303082-1f5e-43fc-b884-73c6a42a32a9 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:41:56.506427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:56.507223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:41:56.512397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-daf7d126-ab4f-47c9-b522-3952c86f3da7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:56.514781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-daf7d126-ab4f-47c9-b522-3952c86f3da7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:56.523450 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-daf7d126-ab4f-47c9-b522-3952c86f3da7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:56.523950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-daf7d126-ab4f-47c9-b522-3952c86f3da7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:56.524761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-daf7d126-ab4f-47c9-b522-3952c86f3da7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:56.525235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-daf7d126-ab4f-47c9-b522-3952c86f3da7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:56.557278 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-daf7d126-ab4f-47c9-b522-3952c86f3da7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052678 Jul 26 20:41:56.557853 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3482/7042] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:41:56 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:41:57.571753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e689f8c3-b90e-4438-9a12-aa71e26aa12f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:57.574248 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e689f8c3-b90e-4438-9a12-aa71e26aa12f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:57.580857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e689f8c3-b90e-4438-9a12-aa71e26aa12f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:57.581310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e689f8c3-b90e-4438-9a12-aa71e26aa12f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:57.582091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e689f8c3-b90e-4438-9a12-aa71e26aa12f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:57.582534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e689f8c3-b90e-4438-9a12-aa71e26aa12f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:57.613336 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e689f8c3-b90e-4438-9a12-aa71e26aa12f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047347 Jul 26 20:41:57.613911 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3561/7043] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:41:57 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:41:58.625950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d28382a9-1b56-4b31-beb0-b2c8a86281c6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:58.628173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d28382a9-1b56-4b31-beb0-b2c8a86281c6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:58.635166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d28382a9-1b56-4b31-beb0-b2c8a86281c6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:58.635651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d28382a9-1b56-4b31-beb0-b2c8a86281c6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:58.636440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d28382a9-1b56-4b31-beb0-b2c8a86281c6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:58.636893 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d28382a9-1b56-4b31-beb0-b2c8a86281c6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:58.667667 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d28382a9-1b56-4b31-beb0-b2c8a86281c6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Jul 26 20:41:58.668246 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3483/7044] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:41:58 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:41:59.681212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e4f2461a-7ccd-4877-960b-d2e49fbe8c47 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:41:59.683341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e4f2461a-7ccd-4877-960b-d2e49fbe8c47 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:41:59.689975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4f2461a-7ccd-4877-960b-d2e49fbe8c47 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:59.690420 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4f2461a-7ccd-4877-960b-d2e49fbe8c47 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:59.691184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4f2461a-7ccd-4877-960b-d2e49fbe8c47 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:41:59.691627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4f2461a-7ccd-4877-960b-d2e49fbe8c47 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:41:59.720587 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e4f2461a-7ccd-4877-960b-d2e49fbe8c47 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Jul 26 20:41:59.721145 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3562/7045] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:41:59 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:00.732901 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-946e5395-4542-47b6-9a49-4b4f18cc1aca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:00.735075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-946e5395-4542-47b6-9a49-4b4f18cc1aca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:00.742683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-946e5395-4542-47b6-9a49-4b4f18cc1aca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:00.743145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-946e5395-4542-47b6-9a49-4b4f18cc1aca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:00.744167 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-946e5395-4542-47b6-9a49-4b4f18cc1aca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:00.744631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-946e5395-4542-47b6-9a49-4b4f18cc1aca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:00.775006 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-946e5395-4542-47b6-9a49-4b4f18cc1aca tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046080 Jul 26 20:42:00.775581 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3484/7046] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:42:00 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:01.787110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-75d6e9c4-b3db-4735-ad56-4a1154463ad8 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:01.789375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-75d6e9c4-b3db-4735-ad56-4a1154463ad8 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:01.796227 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75d6e9c4-b3db-4735-ad56-4a1154463ad8 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:01.796673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75d6e9c4-b3db-4735-ad56-4a1154463ad8 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:01.797426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75d6e9c4-b3db-4735-ad56-4a1154463ad8 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:01.797860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-75d6e9c4-b3db-4735-ad56-4a1154463ad8 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:01.827314 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-75d6e9c4-b3db-4735-ad56-4a1154463ad8 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044136 Jul 26 20:42:01.827912 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3563/7047] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:42:01 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:42:01.838533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:01.839070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:01.846082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:01.846546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:01.847325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:01.847805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:01.923927 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] HTTP exception thrown: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 is not attached to volume f2303082-1f5e-43fc-b884-73c6a42a32a9 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Request method failure captured: Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments/f2303082-1f5e-43fc-b884-73c6a42a32a9 HTTP/1.1 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FF2eKi91LXIdyiorKFBSG2AuXptwPYILGnYwuPOWVoPhWH81KJokPPpmbd0BWy4LX3mvO9QAHbElgJRu37cGpNBHXqwALqrunMam49W6Zff22DnAMkZ4ZKeJ0QhBvu9hvabO-wWaUYBsgWW3fMz_wmhPMqcgJwUxLiWug_kx6t9ILQ Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e005249c8fc54874a84e27e90e4ac46e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}] Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 376a9969c4db412dbae516c4d1faf426 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 is not attached to volume f2303082-1f5e-43fc-b884-73c6a42a32a9 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '59f00951-07b7-42a2-85f1-e357d73bfa14', 'id': 'f2303082-1f5e-43fc-b884-73c6a42a32a9'} Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f2303082-1f5e-43fc-b884-73c6a42a32a9. Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 is not attached to volume f2303082-1f5e-43fc-b884-73c6a42a32a9 Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:42:01.930950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:42:01.934967 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:42:01.934967 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:42:01.934967 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 is not attached to volume f2303082-1f5e-43fc-b884-73c6a42a32a9 Jul 26 20:42:01.934967 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:01.934967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Returning 404 to user: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 is not attached to volume f2303082-1f5e-43fc-b884-73c6a42a32a9 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:42:01.934967 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9007b2e1-16b8-4cb4-97e7-935cf44e0076 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments/f2303082-1f5e-43fc-b884-73c6a42a32a9" status: 404 len: 154 microversion: 2.1 time: 0.097967 Jul 26 20:42:01.934967 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3485/7048] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:42:01 2022] DELETE /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14/os-volume_attachments/f2303082-1f5e-43fc-b884-73c6a42a32a9 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:42:05.279723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-01e8b7f5-5c9b-4e7e-b717-b57bbc9d2c36 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:05.280265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-01e8b7f5-5c9b-4e7e-b717-b57bbc9d2c36 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:05.287411 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01e8b7f5-5c9b-4e7e-b717-b57bbc9d2c36 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:05.287983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01e8b7f5-5c9b-4e7e-b717-b57bbc9d2c36 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:05.289275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01e8b7f5-5c9b-4e7e-b717-b57bbc9d2c36 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:05.289924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-01e8b7f5-5c9b-4e7e-b717-b57bbc9d2c36 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:05.318484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-01e8b7f5-5c9b-4e7e-b717-b57bbc9d2c36 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:42:05.397191 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-01e8b7f5-5c9b-4e7e-b717-b57bbc9d2c36 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 204 len: 0 microversion: 2.1 time: 0.121119 Jul 26 20:42:05.398076 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3564/7049] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:42:05 2022] DELETE /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:42:05.407422 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b8175776-cf5d-4a82-a197-6524a19d5744 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:05.408283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b8175776-cf5d-4a82-a197-6524a19d5744 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:05.416300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8175776-cf5d-4a82-a197-6524a19d5744 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:05.416851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8175776-cf5d-4a82-a197-6524a19d5744 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:05.417710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8175776-cf5d-4a82-a197-6524a19d5744 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:05.418243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b8175776-cf5d-4a82-a197-6524a19d5744 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:05.556472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b8175776-cf5d-4a82-a197-6524a19d5744 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:05.564281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b8175776-cf5d-4a82-a197-6524a19d5744 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1560 microversion: 2.1 time: 0.161380 Jul 26 20:42:05.564863 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3486/7050] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:05 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:42:06.585424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f42e90ee-0dd7-4c8e-8b71-88a2ce4b4b4c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:06.586145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f42e90ee-0dd7-4c8e-8b71-88a2ce4b4b4c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:06.593285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f42e90ee-0dd7-4c8e-8b71-88a2ce4b4b4c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:06.593740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f42e90ee-0dd7-4c8e-8b71-88a2ce4b4b4c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:06.594520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f42e90ee-0dd7-4c8e-8b71-88a2ce4b4b4c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:06.594964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f42e90ee-0dd7-4c8e-8b71-88a2ce4b4b4c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:06.730430 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f42e90ee-0dd7-4c8e-8b71-88a2ce4b4b4c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:06.737958 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f42e90ee-0dd7-4c8e-8b71-88a2ce4b4b4c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1560 microversion: 2.1 time: 0.156843 Jul 26 20:42:06.738547 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3565/7051] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:06 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:07.398316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a24e1d2a-87f8-4d22-9251-d482ee92652b req-45b07721-c8af-4729-83f5-4ffe7e297c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f00951-07b7-42a2-85f1-e357d73bfa14", "name": "network-vif-deleted", "tag": "b0d16ecd-9299-4b5f-b163-651faab62a20"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:07.410299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a24e1d2a-87f8-4d22-9251-d482ee92652b req-45b07721-c8af-4729-83f5-4ffe7e297c2a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:07.410752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a24e1d2a-87f8-4d22-9251-d482ee92652b req-45b07721-c8af-4729-83f5-4ffe7e297c2a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:07.423228 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a24e1d2a-87f8-4d22-9251-d482ee92652b req-45b07721-c8af-4729-83f5-4ffe7e297c2a service nova] Creating event network-vif-deleted:b0d16ecd-9299-4b5f-b163-651faab62a20 for instance 59f00951-07b7-42a2-85f1-e357d73bfa14 on n-h1-708768-8 Jul 26 20:42:07.429108 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a24e1d2a-87f8-4d22-9251-d482ee92652b req-45b07721-c8af-4729-83f5-4ffe7e297c2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035140 Jul 26 20:42:07.429770 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3487/7052] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:07.761304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:07.762228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:07.770703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:07.771212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:07.772049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:07.772485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:07.809834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:07.810539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:07.811014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lazy-loading 'fault' on Instance uuid 59f00951-07b7-42a2-85f1-e357d73bfa14 {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:42:07.863723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:07.871791 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-04b36bc8-339b-4ff6-a653-2be4a9c763fb tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 200 len: 1352 microversion: 2.1 time: 0.115860 Jul 26 20:42:07.872372 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3566/7053] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:07 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:08.893610 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:08.894454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 59f00951-07b7-42a2-85f1-e357d73bfa14] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:08.900695 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:08.901160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:08.901937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:08.902385 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:08.915399 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] HTTP exception thrown: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 could not be found. Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Request method failure captured: Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 HTTP/1.1 Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FF2eKi91LXIdyiorKFBSG2AuXptwPYILGnYwuPOWVoPhWH81KJokPPpmbd0BWy4LX3mvO9QAHbElgJRu37cGpNBHXqwALqrunMam49W6Zff22DnAMkZ4ZKeJ0QhBvu9hvabO-wWaUYBsgWW3fMz_wmhPMqcgJwUxLiWug_kx6t9ILQ Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e005249c8fc54874a84e27e90e4ac46e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}] Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 376a9969c4db412dbae516c4d1faf426 Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 could not be found. Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '59f00951-07b7-42a2-85f1-e357d73bfa14'} Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 could not be found. Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 could not be found. Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:42:08.917067 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 could not be found. Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Returning 404 to user: Instance 59f00951-07b7-42a2-85f1-e357d73bfa14 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-886f8337-c024-4b21-b8d9-2de203cf9bef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14" status: 404 len: 111 microversion: 2.1 time: 0.030037 Jul 26 20:42:08.921327 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3488/7054] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:08 2022] GET /compute/v2.1/servers/59f00951-07b7-42a2-85f1-e357d73bfa14 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:42:08.927321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0e4100c7-4938-48b9-ae80-e778552f1cf0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '.version_select at 0x7f8756e3f310>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:08.948357 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0e4100c7-4938-48b9-ae80-e778552f1cf0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-358776966" status: 202 len: 0 microversion: 2.1 time: 0.025089 Jul 26 20:42:08.948932 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3567/7055] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-358776966 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:42:08.965875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8615abd2-13a2-4c02-8f83-ae0aac76c724 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: .version_select at 0x7f875ee0f5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-366360388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB93VH5INY2vYD9Hz5sj93D8kK0wjJbrDYuVh6vkBB7ct2RjQsgMmLewWG2rU3zC3i8lG8bXQqGUqTobBlI232UGkNFgOqbdJdP8UKmIUA9oY5Pm9CT8ajTVAbp4ewsnKg=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:08.981049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8615abd2-13a2-4c02-8f83-ae0aac76c724 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for project e005249c8fc54874a84e27e90e4ac46e. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:42:08.986995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8615abd2-13a2-4c02-8f83-ae0aac76c724 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for user 376a9969c4db412dbae516c4d1faf426 and project e005249c8fc54874a84e27e90e4ac46e. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:42:09.013797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8615abd2-13a2-4c02-8f83-ae0aac76c724 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051833 Jul 26 20:42:09.014391 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3489/7056] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:42:08 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:09.064666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-587232275", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-366360388", "networks": [{"uuid": "6b47dfd7-2553-432e-b436-4a18f44fffd7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:09.122189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] validate_networks() for [('6b47dfd7-2553-432e-b436-4a18f44fffd7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:42:09.541868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:42:09.542316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:42:09.542788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:42:09.543221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:42:09.543647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:42:09.552981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:09.553426 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:09.554274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:09.554707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:09.572521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for project e005249c8fc54874a84e27e90e4ac46e. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:42:09.578165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for user 376a9969c4db412dbae516c4d1faf426 and project e005249c8fc54874a84e27e90e4ac46e. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:42:09.591111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:42:09.593445 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:42:09.642988 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f904b1aa-8fb3-4282-bb2c-6128d27dbb8b tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582147 Jul 26 20:42:09.644305 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3568/7057] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:42:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:42:09.656409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-14ed79c4-af74-4ccd-aa16-c548c8d1d8d6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:09.657813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-14ed79c4-af74-4ccd-aa16-c548c8d1d8d6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:09.719030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-14ed79c4-af74-4ccd-aa16-c548c8d1d8d6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:09.727293 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-14ed79c4-af74-4ccd-aa16-c548c8d1d8d6 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1261 microversion: 2.1 time: 0.075144 Jul 26 20:42:09.731650 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3490/7058] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:09 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1261 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:42:10.750164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a7d88598-d216-4457-b3c2-9a926ea52ef5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:10.750785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a7d88598-d216-4457-b3c2-9a926ea52ef5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:10.758828 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7d88598-d216-4457-b3c2-9a926ea52ef5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:10.759278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7d88598-d216-4457-b3c2-9a926ea52ef5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:10.760180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7d88598-d216-4457-b3c2-9a926ea52ef5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:10.760615 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7d88598-d216-4457-b3c2-9a926ea52ef5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:11.062486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a7d88598-d216-4457-b3c2-9a926ea52ef5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:11.070763 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a7d88598-d216-4457-b3c2-9a926ea52ef5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1319 microversion: 2.1 time: 0.325710 Jul 26 20:42:11.071345 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3569/7059] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:10 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:12.092303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2729ff07-2f2f-4234-8135-4dbb064e2a09 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:12.093941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2729ff07-2f2f-4234-8135-4dbb064e2a09 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:12.101638 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2729ff07-2f2f-4234-8135-4dbb064e2a09 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:12.102196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2729ff07-2f2f-4234-8135-4dbb064e2a09 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:12.103063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2729ff07-2f2f-4234-8135-4dbb064e2a09 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:12.103776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2729ff07-2f2f-4234-8135-4dbb064e2a09 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:12.184074 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-1cde0bd7-5613-4182-a189-59c701e8f9b4 req-0acdff17-3a41-488f-a522-6e3d7fc69822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1a14a2-c8f1-41bc-8081-1dc4a0267190", "tag": "f2bfee6c-8696-4fd4-883e-8f6920403165"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:12.207025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1cde0bd7-5613-4182-a189-59c701e8f9b4 req-0acdff17-3a41-488f-a522-6e3d7fc69822 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:12.207479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-1cde0bd7-5613-4182-a189-59c701e8f9b4 req-0acdff17-3a41-488f-a522-6e3d7fc69822 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:12.239800 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-1cde0bd7-5613-4182-a189-59c701e8f9b4 req-0acdff17-3a41-488f-a522-6e3d7fc69822 service nova] Creating event network-changed:f2bfee6c-8696-4fd4-883e-8f6920403165 for instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 on n-h1-708768-8 Jul 26 20:42:12.252046 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-1cde0bd7-5613-4182-a189-59c701e8f9b4 req-0acdff17-3a41-488f-a522-6e3d7fc69822 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075485 Jul 26 20:42:12.253289 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3570/7060] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:42:12.266968 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2729ff07-2f2f-4234-8135-4dbb064e2a09 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:12.276363 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2729ff07-2f2f-4234-8135-4dbb064e2a09 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1361 microversion: 2.1 time: 0.187931 Jul 26 20:42:12.277694 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3491/7061] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:12 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:13.298568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-edf9d0e8-f1cb-47ec-a332-071e2121ac96 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:13.299473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-edf9d0e8-f1cb-47ec-a332-071e2121ac96 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:13.308892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edf9d0e8-f1cb-47ec-a332-071e2121ac96 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:13.309350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edf9d0e8-f1cb-47ec-a332-071e2121ac96 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:13.310124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edf9d0e8-f1cb-47ec-a332-071e2121ac96 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:13.310568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edf9d0e8-f1cb-47ec-a332-071e2121ac96 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:13.503702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edf9d0e8-f1cb-47ec-a332-071e2121ac96 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:13.511715 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-edf9d0e8-f1cb-47ec-a332-071e2121ac96 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1361 microversion: 2.1 time: 0.217510 Jul 26 20:42:13.512291 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3571/7062] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:13 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:14.533599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e000c281-d309-4fbd-9c7d-cb0d57cf2e0d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:14.534228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e000c281-d309-4fbd-9c7d-cb0d57cf2e0d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:14.541857 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e000c281-d309-4fbd-9c7d-cb0d57cf2e0d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:14.542323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e000c281-d309-4fbd-9c7d-cb0d57cf2e0d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:14.543100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e000c281-d309-4fbd-9c7d-cb0d57cf2e0d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:14.543549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e000c281-d309-4fbd-9c7d-cb0d57cf2e0d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:14.673250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e000c281-d309-4fbd-9c7d-cb0d57cf2e0d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:14.681322 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e000c281-d309-4fbd-9c7d-cb0d57cf2e0d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1361 microversion: 2.1 time: 0.151697 Jul 26 20:42:14.681900 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3492/7063] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:14 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:15.702471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a344c05c-db6a-43e1-846c-0c3f5eea8ca1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:15.703663 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a344c05c-db6a-43e1-846c-0c3f5eea8ca1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:15.710696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a344c05c-db6a-43e1-846c-0c3f5eea8ca1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:15.711154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a344c05c-db6a-43e1-846c-0c3f5eea8ca1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:15.711957 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a344c05c-db6a-43e1-846c-0c3f5eea8ca1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:15.712402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a344c05c-db6a-43e1-846c-0c3f5eea8ca1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:15.841729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a344c05c-db6a-43e1-846c-0c3f5eea8ca1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:15.849479 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a344c05c-db6a-43e1-846c-0c3f5eea8ca1 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1361 microversion: 2.1 time: 0.150822 Jul 26 20:42:15.850257 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3572/7064] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:15 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:16.872281 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-20275a51-994f-4338-a1ab-39b4208c84fd tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:16.872891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-20275a51-994f-4338-a1ab-39b4208c84fd tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:16.882592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20275a51-994f-4338-a1ab-39b4208c84fd tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:16.883131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20275a51-994f-4338-a1ab-39b4208c84fd tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:16.883932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20275a51-994f-4338-a1ab-39b4208c84fd tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:16.884377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-20275a51-994f-4338-a1ab-39b4208c84fd tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:17.018574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-20275a51-994f-4338-a1ab-39b4208c84fd tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:17.026596 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-20275a51-994f-4338-a1ab-39b4208c84fd tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1361 microversion: 2.1 time: 0.158302 Jul 26 20:42:17.027439 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3493/7065] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:16 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:17.830304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-9a74d996-c5b2-4020-89d2-b2a3ea0260c0 req-8a10136c-c43c-4914-b18a-58c6d7b47cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1a14a2-c8f1-41bc-8081-1dc4a0267190", "name": "network-vif-plugged", "status": "completed", "tag": "f2bfee6c-8696-4fd4-883e-8f6920403165"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:17.842867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9a74d996-c5b2-4020-89d2-b2a3ea0260c0 req-8a10136c-c43c-4914-b18a-58c6d7b47cc3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:17.843965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-9a74d996-c5b2-4020-89d2-b2a3ea0260c0 req-8a10136c-c43c-4914-b18a-58c6d7b47cc3 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:17.856462 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-9a74d996-c5b2-4020-89d2-b2a3ea0260c0 req-8a10136c-c43c-4914-b18a-58c6d7b47cc3 service nova] Creating event network-vif-plugged:f2bfee6c-8696-4fd4-883e-8f6920403165 for instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 on n-h1-708768-8 Jul 26 20:42:17.861955 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-9a74d996-c5b2-4020-89d2-b2a3ea0260c0 req-8a10136c-c43c-4914-b18a-58c6d7b47cc3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Jul 26 20:42:17.862563 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3573/7066] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:18.048200 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a739c172-cad8-441f-89af-82e1c3ae60de tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:18.048834 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a739c172-cad8-441f-89af-82e1c3ae60de tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:18.056766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a739c172-cad8-441f-89af-82e1c3ae60de tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:18.057233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a739c172-cad8-441f-89af-82e1c3ae60de tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:18.058043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a739c172-cad8-441f-89af-82e1c3ae60de tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:18.058498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a739c172-cad8-441f-89af-82e1c3ae60de tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:18.188690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a739c172-cad8-441f-89af-82e1c3ae60de tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:18.197316 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a739c172-cad8-441f-89af-82e1c3ae60de tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1361 microversion: 2.1 time: 0.153039 Jul 26 20:42:18.197898 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3494/7067] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:18 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:19.218845 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d6f2764-b083-40fd-b76f-aa4f1c298a03 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:19.219541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d6f2764-b083-40fd-b76f-aa4f1c298a03 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:19.226637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d6f2764-b083-40fd-b76f-aa4f1c298a03 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:19.227085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d6f2764-b083-40fd-b76f-aa4f1c298a03 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:19.227868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d6f2764-b083-40fd-b76f-aa4f1c298a03 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:19.228303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d6f2764-b083-40fd-b76f-aa4f1c298a03 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:19.360003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1d6f2764-b083-40fd-b76f-aa4f1c298a03 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:19.367911 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d6f2764-b083-40fd-b76f-aa4f1c298a03 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1553 microversion: 2.1 time: 0.153278 Jul 26 20:42:19.368505 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3574/7068] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:19 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:19.389613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2d2a624-b472-4b13-90c4-0ee5d7e37b73 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:19.390242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e2d2a624-b472-4b13-90c4-0ee5d7e37b73 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:19.397129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2d2a624-b472-4b13-90c4-0ee5d7e37b73 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:19.398343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2d2a624-b472-4b13-90c4-0ee5d7e37b73 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:19.398962 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2d2a624-b472-4b13-90c4-0ee5d7e37b73 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:19.399416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2d2a624-b472-4b13-90c4-0ee5d7e37b73 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:19.528794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e2d2a624-b472-4b13-90c4-0ee5d7e37b73 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:19.540117 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e2d2a624-b472-4b13-90c4-0ee5d7e37b73 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1553 microversion: 2.1 time: 0.153647 Jul 26 20:42:19.540709 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3495/7069] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:19 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:21.023348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7808a63c-b978-418e-a8d2-17c22118c9e9 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8b80c30-9a76-4980-b598-e6a5e47dbd54"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:21.026331 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7808a63c-b978-418e-a8d2-17c22118c9e9 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:21.028482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:42:21.029166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:42:21.036035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7808a63c-b978-418e-a8d2-17c22118c9e9 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:21.036485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7808a63c-b978-418e-a8d2-17c22118c9e9 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:21.037274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7808a63c-b978-418e-a8d2-17c22118c9e9 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:21.037713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7808a63c-b978-418e-a8d2-17c22118c9e9 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:21.252685 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:42:21.270293 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7808a63c-b978-418e-a8d2-17c22118c9e9 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250986 Jul 26 20:42:21.270921 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3575/7070] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:42:21 2022] POST /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:31.965409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dd3397a5-c496-451a-a610-43030197487e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:31.965914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dd3397a5-c496-451a-a610-43030197487e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:31.968110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:42:31.969451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:42:31.970250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=64 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:42:31.977870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd3397a5-c496-451a-a610-43030197487e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:31.978345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd3397a5-c496-451a-a610-43030197487e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:31.979132 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd3397a5-c496-451a-a610-43030197487e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:31.979588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dd3397a5-c496-451a-a610-43030197487e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:32.061179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-dd3397a5-c496-451a-a610-43030197487e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lazy-loading 'services' on Instance uuid 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:42:32.130646 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dd3397a5-c496-451a-a610-43030197487e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments/e8b80c30-9a76-4980-b598-e6a5e47dbd54" status: 202 len: 0 microversion: 2.1 time: 0.169830 Jul 26 20:42:32.131244 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3496/7071] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:42:31 2022] DELETE /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments/e8b80c30-9a76-4980-b598-e6a5e47dbd54 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:42:32.138727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:42:32.143578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d417a29a-ff92-4d9e-9872-a6665b1d4e7f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:32.146145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d417a29a-ff92-4d9e-9872-a6665b1d4e7f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:32.154922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d417a29a-ff92-4d9e-9872-a6665b1d4e7f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:32.155370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d417a29a-ff92-4d9e-9872-a6665b1d4e7f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:32.156168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d417a29a-ff92-4d9e-9872-a6665b1d4e7f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:32.156603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d417a29a-ff92-4d9e-9872-a6665b1d4e7f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:32.188630 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d417a29a-ff92-4d9e-9872-a6665b1d4e7f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051905 Jul 26 20:42:32.189188 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3576/7072] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:42:32 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:33.203035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bb446452-9f6c-4565-9030-8a8d8b644a02 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:33.205406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb446452-9f6c-4565-9030-8a8d8b644a02 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:33.212311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb446452-9f6c-4565-9030-8a8d8b644a02 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:33.212771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb446452-9f6c-4565-9030-8a8d8b644a02 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:33.213551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb446452-9f6c-4565-9030-8a8d8b644a02 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:33.214001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb446452-9f6c-4565-9030-8a8d8b644a02 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:33.246979 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bb446452-9f6c-4565-9030-8a8d8b644a02 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049109 Jul 26 20:42:33.247598 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3497/7073] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:42:33 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:34.258599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0a81fcb5-b76f-4833-bc2d-c837955c7bf5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:34.260832 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0a81fcb5-b76f-4833-bc2d-c837955c7bf5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:34.268583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a81fcb5-b76f-4833-bc2d-c837955c7bf5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:34.269039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a81fcb5-b76f-4833-bc2d-c837955c7bf5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:34.269823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a81fcb5-b76f-4833-bc2d-c837955c7bf5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:34.270263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0a81fcb5-b76f-4833-bc2d-c837955c7bf5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:34.302847 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0a81fcb5-b76f-4833-bc2d-c837955c7bf5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 Jul 26 20:42:34.303035 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3577/7074] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:42:34 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:35.315169 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4b322fbe-00b2-48d1-899d-a6275c45b847 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:35.317296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4b322fbe-00b2-48d1-899d-a6275c45b847 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:35.325083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b322fbe-00b2-48d1-899d-a6275c45b847 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:35.325544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b322fbe-00b2-48d1-899d-a6275c45b847 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:35.326324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b322fbe-00b2-48d1-899d-a6275c45b847 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:35.326773 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b322fbe-00b2-48d1-899d-a6275c45b847 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:35.357480 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4b322fbe-00b2-48d1-899d-a6275c45b847 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Jul 26 20:42:35.358055 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3498/7075] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:42:35 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:36.370424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-77b3a554-6140-4cf0-b3e4-b42019c5b5ce tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:36.372629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-77b3a554-6140-4cf0-b3e4-b42019c5b5ce tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:36.379815 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77b3a554-6140-4cf0-b3e4-b42019c5b5ce tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:36.380267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77b3a554-6140-4cf0-b3e4-b42019c5b5ce tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:36.381033 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77b3a554-6140-4cf0-b3e4-b42019c5b5ce tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:36.381463 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-77b3a554-6140-4cf0-b3e4-b42019c5b5ce tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:36.416295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-77b3a554-6140-4cf0-b3e4-b42019c5b5ce tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050365 Jul 26 20:42:36.416875 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3578/7076] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:42:36 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:37.430308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-04de9819-0ba7-4294-a733-b1ee79903d0a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:37.432800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-04de9819-0ba7-4294-a733-b1ee79903d0a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:37.439411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04de9819-0ba7-4294-a733-b1ee79903d0a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:37.439909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04de9819-0ba7-4294-a733-b1ee79903d0a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:37.440688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04de9819-0ba7-4294-a733-b1ee79903d0a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:37.441142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04de9819-0ba7-4294-a733-b1ee79903d0a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:37.469361 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-04de9819-0ba7-4294-a733-b1ee79903d0a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044545 Jul 26 20:42:37.469923 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3499/7077] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:42:37 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:42:37.481348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:37.481843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:37.488803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:37.489258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:37.490024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:37.490468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:37.567316 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] HTTP exception thrown: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 is not attached to volume e8b80c30-9a76-4980-b598-e6a5e47dbd54 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Request method failure captured: Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments/e8b80c30-9a76-4980-b598-e6a5e47dbd54 HTTP/1.1 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FF2eKi91LXIdyiorKFBSG2AuXptwPYILGnYwuPOWVoPhWH81KJokPPpmbd0BWy4LX3mvO9QAHbElgJRu37cGpNBHXqwALqrunMam49W6Zff22DnAMkZ4ZKeJ0QhBvu9hvabO-wWaUYBsgWW3fMz_wmhPMqcgJwUxLiWug_kx6t9ILQ Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e005249c8fc54874a84e27e90e4ac46e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}] Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 376a9969c4db412dbae516c4d1faf426 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 is not attached to volume e8b80c30-9a76-4980-b598-e6a5e47dbd54 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'server_id': '3a1a14a2-c8f1-41bc-8081-1dc4a0267190', 'id': 'e8b80c30-9a76-4980-b598-e6a5e47dbd54'} Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e8b80c30-9a76-4980-b598-e6a5e47dbd54. Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 is not attached to volume e8b80c30-9a76-4980-b598-e6a5e47dbd54 Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:42:37.569257 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:42:37.573299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:42:37.573299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:42:37.573299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 is not attached to volume e8b80c30-9a76-4980-b598-e6a5e47dbd54 Jul 26 20:42:37.573299 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:37.573299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Returning 404 to user: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 is not attached to volume e8b80c30-9a76-4980-b598-e6a5e47dbd54 {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:42:37.573299 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-06ce3689-89e9-448c-bed0-61026f6b2b8c tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments/e8b80c30-9a76-4980-b598-e6a5e47dbd54" status: 404 len: 154 microversion: 2.1 time: 0.093965 Jul 26 20:42:37.573299 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3579/7078] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:42:37 2022] DELETE /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190/os-volume_attachments/e8b80c30-9a76-4980-b598-e6a5e47dbd54 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:42:40.911551 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f067e52-e180-4f2b-87d6-97b6cdd34305 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:40.912165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f067e52-e180-4f2b-87d6-97b6cdd34305 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:40.920307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f067e52-e180-4f2b-87d6-97b6cdd34305 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:40.920771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f067e52-e180-4f2b-87d6-97b6cdd34305 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:40.921572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f067e52-e180-4f2b-87d6-97b6cdd34305 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:40.922021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f067e52-e180-4f2b-87d6-97b6cdd34305 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:40.950293 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f067e52-e180-4f2b-87d6-97b6cdd34305 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:42:41.033131 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f067e52-e180-4f2b-87d6-97b6cdd34305 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 204 len: 0 microversion: 2.1 time: 0.125183 Jul 26 20:42:41.034274 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3500/7079] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:42:40 2022] DELETE /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:42:41.043334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15fb3aea-b95c-445a-9173-7eff702fdffe tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:41.044048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15fb3aea-b95c-445a-9173-7eff702fdffe tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:41.055216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15fb3aea-b95c-445a-9173-7eff702fdffe tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:41.055699 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15fb3aea-b95c-445a-9173-7eff702fdffe tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:41.056518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15fb3aea-b95c-445a-9173-7eff702fdffe tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:41.056960 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15fb3aea-b95c-445a-9173-7eff702fdffe tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:41.194341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-15fb3aea-b95c-445a-9173-7eff702fdffe tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:41.202110 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15fb3aea-b95c-445a-9173-7eff702fdffe tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1559 microversion: 2.1 time: 0.162867 Jul 26 20:42:41.202689 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3580/7080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:41 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:42.223632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fc7557fe-d21d-4495-a9e3-1d3f7f2a2c82 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:42.224380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fc7557fe-d21d-4495-a9e3-1d3f7f2a2c82 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:42.231421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc7557fe-d21d-4495-a9e3-1d3f7f2a2c82 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:42.231922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc7557fe-d21d-4495-a9e3-1d3f7f2a2c82 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:42.232702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc7557fe-d21d-4495-a9e3-1d3f7f2a2c82 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:42.233155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fc7557fe-d21d-4495-a9e3-1d3f7f2a2c82 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:42.370396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fc7557fe-d21d-4495-a9e3-1d3f7f2a2c82 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:42.378031 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fc7557fe-d21d-4495-a9e3-1d3f7f2a2c82 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1559 microversion: 2.1 time: 0.158698 Jul 26 20:42:42.378639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3501/7081] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:42 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:43.037574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2b5e89c8-3e4c-40d4-876d-b694d460432b req-360e48a7-61ae-4ac1-a4a9-9100eb748185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1a14a2-c8f1-41bc-8081-1dc4a0267190", "name": "network-vif-deleted", "tag": "f2bfee6c-8696-4fd4-883e-8f6920403165"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:43.054383 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2b5e89c8-3e4c-40d4-876d-b694d460432b req-360e48a7-61ae-4ac1-a4a9-9100eb748185 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:43.055301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2b5e89c8-3e4c-40d4-876d-b694d460432b req-360e48a7-61ae-4ac1-a4a9-9100eb748185 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:43.072444 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2b5e89c8-3e4c-40d4-876d-b694d460432b req-360e48a7-61ae-4ac1-a4a9-9100eb748185 service nova] Creating event network-vif-deleted:f2bfee6c-8696-4fd4-883e-8f6920403165 for instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 on n-h1-708768-8 Jul 26 20:42:43.079441 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2b5e89c8-3e4c-40d4-876d-b694d460432b req-360e48a7-61ae-4ac1-a4a9-9100eb748185 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046784 Jul 26 20:42:43.080263 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3581/7082] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:43.399940 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:43.400582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:43.407538 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:43.408035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:43.408832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:43.409303 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:43.442856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:43.443240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:43.443725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lazy-loading 'fault' on Instance uuid 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:42:43.486790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:43.494494 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f9c62523-8c8d-4e64-bc07-a374bb1ffdc3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 200 len: 1351 microversion: 2.1 time: 0.099140 Jul 26 20:42:43.495384 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3502/7083] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:43 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:42:44.517583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:44.518296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 3a1a14a2-c8f1-41bc-8081-1dc4a0267190] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:44.525975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:44.526428 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:44.527200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:44.527661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:44.541713 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] HTTP exception thrown: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 could not be found. Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Request method failure captured: Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 HTTP/1.1 Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FF2eKi91LXIdyiorKFBSG2AuXptwPYILGnYwuPOWVoPhWH81KJokPPpmbd0BWy4LX3mvO9QAHbElgJRu37cGpNBHXqwALqrunMam49W6Zff22DnAMkZ4ZKeJ0QhBvu9hvabO-wWaUYBsgWW3fMz_wmhPMqcgJwUxLiWug_kx6t9ILQ Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e005249c8fc54874a84e27e90e4ac46e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}] Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 376a9969c4db412dbae516c4d1faf426 Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 could not be found. Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '3a1a14a2-c8f1-41bc-8081-1dc4a0267190'} Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 could not be found. Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 could not be found. Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:42:44.543341 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 could not be found. Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Returning 404 to user: Instance 3a1a14a2-c8f1-41bc-8081-1dc4a0267190 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5ddd1ddc-9095-4856-b7d8-6ee652ce22b3 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190" status: 404 len: 111 microversion: 2.1 time: 0.031475 Jul 26 20:42:44.547846 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3582/7084] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:44 2022] GET /compute/v2.1/servers/3a1a14a2-c8f1-41bc-8081-1dc4a0267190 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:42:44.553710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f7b9acee-6f3e-46e7-bf7f-7ed2faa72fef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '.version_select at 0x7f875e200a60>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:44.574177 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f7b9acee-6f3e-46e7-bf7f-7ed2faa72fef tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-366360388" status: 202 len: 0 microversion: 2.1 time: 0.024424 Jul 26 20:42:44.574761 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3503/7085] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Jul 26 20:42:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-366360388 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:42:44.591959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7706f34a-6bd4-4bf9-abc8-51a18c7ed76f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: .version_select at 0x7f87564d6310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1899123078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuKY0Zqv0YfL7xyIvf7cpJAGjvhZw5m+E3Km9MnU5qWsVSwLGDqdGrCFXM7J/QRNyLDuVZVLcOi1spqXuL/KzXPvXA2VIaGwTufsEi7DpnITNTtZpf0xQ2NclOnM2HeCQ=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:44.609917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-7706f34a-6bd4-4bf9-abc8-51a18c7ed76f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for project e005249c8fc54874a84e27e90e4ac46e. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:42:44.615005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-7706f34a-6bd4-4bf9-abc8-51a18c7ed76f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for user 376a9969c4db412dbae516c4d1faf426 and project e005249c8fc54874a84e27e90e4ac46e. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:42:44.638212 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7706f34a-6bd4-4bf9-abc8-51a18c7ed76f tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050141 Jul 26 20:42:44.638817 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3583/7086] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:42:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:42:44.687848 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1438307319", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1899123078", "networks": [{"uuid": "6b47dfd7-2553-432e-b436-4a18f44fffd7"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:44.740640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] validate_networks() for [('6b47dfd7-2553-432e-b436-4a18f44fffd7', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:42:45.106905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:42:45.107348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:42:45.107867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:42:45.108320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:42:45.108746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:42:45.120310 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:45.120769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:45.121577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:45.122026 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:45.140995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for project e005249c8fc54874a84e27e90e4ac46e. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:42:45.146201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Getting quotas for user 376a9969c4db412dbae516c4d1faf426 and project e005249c8fc54874a84e27e90e4ac46e. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:42:45.158827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:42:45.161204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:42:45.211638 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8a9e10d1-a9de-4813-a0a8-c6686fc21e80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527406 Jul 26 20:42:45.212387 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3504/7087] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:42:45.223155 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2cf10b3e-894a-4b12-a5e5-9447f6a10ba0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:45.223797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2cf10b3e-894a-4b12-a5e5-9447f6a10ba0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:45.279673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2cf10b3e-894a-4b12-a5e5-9447f6a10ba0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:45.289184 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2cf10b3e-894a-4b12-a5e5-9447f6a10ba0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1263 microversion: 2.1 time: 0.069422 Jul 26 20:42:45.289753 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3584/7088] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:45 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:46.310916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4cf0eab9-2dc9-4aca-b1a0-278769394640 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:46.311581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4cf0eab9-2dc9-4aca-b1a0-278769394640 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:46.319460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cf0eab9-2dc9-4aca-b1a0-278769394640 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:46.320199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cf0eab9-2dc9-4aca-b1a0-278769394640 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:46.320877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cf0eab9-2dc9-4aca-b1a0-278769394640 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:46.321300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4cf0eab9-2dc9-4aca-b1a0-278769394640 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:46.423492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4cf0eab9-2dc9-4aca-b1a0-278769394640 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:46.432256 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4cf0eab9-2dc9-4aca-b1a0-278769394640 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1333 microversion: 2.1 time: 0.125430 Jul 26 20:42:46.432832 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3505/7089] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:46 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1333 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:47.453376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fed17c3a-3854-4c2f-a1ae-01f9f9091e88 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:47.454867 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fed17c3a-3854-4c2f-a1ae-01f9f9091e88 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:47.464318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fed17c3a-3854-4c2f-a1ae-01f9f9091e88 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:47.465130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fed17c3a-3854-4c2f-a1ae-01f9f9091e88 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:47.466014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fed17c3a-3854-4c2f-a1ae-01f9f9091e88 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:47.466854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fed17c3a-3854-4c2f-a1ae-01f9f9091e88 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:47.623019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fed17c3a-3854-4c2f-a1ae-01f9f9091e88 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:47.632778 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fed17c3a-3854-4c2f-a1ae-01f9f9091e88 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1363 microversion: 2.1 time: 0.182997 Jul 26 20:42:47.633588 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3585/7090] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:47 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:47.831756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-aa8d6e41-e7a0-48c9-b2b9-d0c92a15b80d req-98843c43-96cb-4246-b786-9746d8e55b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178b0e33-6e5f-4857-aaeb-4c08eba5c142", "tag": "91569167-a391-4129-b3cc-f6ab4d20e107"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:47.842139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aa8d6e41-e7a0-48c9-b2b9-d0c92a15b80d req-98843c43-96cb-4246-b786-9746d8e55b61 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:47.842704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-aa8d6e41-e7a0-48c9-b2b9-d0c92a15b80d req-98843c43-96cb-4246-b786-9746d8e55b61 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:47.855282 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-aa8d6e41-e7a0-48c9-b2b9-d0c92a15b80d req-98843c43-96cb-4246-b786-9746d8e55b61 service nova] Creating event network-changed:91569167-a391-4129-b3cc-f6ab4d20e107 for instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 on n-h2-708768-8 Jul 26 20:42:47.861085 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-aa8d6e41-e7a0-48c9-b2b9-d0c92a15b80d req-98843c43-96cb-4246-b786-9746d8e55b61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088670 Jul 26 20:42:47.861773 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3506/7091] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:48.653409 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-38ee3816-5842-41fe-b7c4-c93cbaa0ba64 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:48.654018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-38ee3816-5842-41fe-b7c4-c93cbaa0ba64 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:48.660967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38ee3816-5842-41fe-b7c4-c93cbaa0ba64 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:48.661424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38ee3816-5842-41fe-b7c4-c93cbaa0ba64 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:48.662199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38ee3816-5842-41fe-b7c4-c93cbaa0ba64 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:48.662643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-38ee3816-5842-41fe-b7c4-c93cbaa0ba64 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:48.791909 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-38ee3816-5842-41fe-b7c4-c93cbaa0ba64 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:48.799371 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-38ee3816-5842-41fe-b7c4-c93cbaa0ba64 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1363 microversion: 2.1 time: 0.149914 Jul 26 20:42:48.800241 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3586/7092] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:48 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:49.822482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3bb44fe5-600d-4091-b400-2e13546c22b5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:49.823193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3bb44fe5-600d-4091-b400-2e13546c22b5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:49.830249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bb44fe5-600d-4091-b400-2e13546c22b5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:49.830706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bb44fe5-600d-4091-b400-2e13546c22b5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:49.831485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bb44fe5-600d-4091-b400-2e13546c22b5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:49.831941 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3bb44fe5-600d-4091-b400-2e13546c22b5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:49.965394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3bb44fe5-600d-4091-b400-2e13546c22b5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:49.972858 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3bb44fe5-600d-4091-b400-2e13546c22b5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1363 microversion: 2.1 time: 0.155332 Jul 26 20:42:49.973430 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3507/7093] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:49 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:50.994767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f23614be-106c-43c2-9c4f-5196d7c1056e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:50.995391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f23614be-106c-43c2-9c4f-5196d7c1056e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:51.002315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f23614be-106c-43c2-9c4f-5196d7c1056e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:51.002775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f23614be-106c-43c2-9c4f-5196d7c1056e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:51.003551 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f23614be-106c-43c2-9c4f-5196d7c1056e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:51.004019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f23614be-106c-43c2-9c4f-5196d7c1056e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:51.136130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f23614be-106c-43c2-9c4f-5196d7c1056e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:51.143555 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f23614be-106c-43c2-9c4f-5196d7c1056e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1363 microversion: 2.1 time: 0.153266 Jul 26 20:42:51.144161 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3587/7094] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:50 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:52.163650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45b67dcf-c3c1-4f96-a9ab-02f45e8383b7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:52.164800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-45b67dcf-c3c1-4f96-a9ab-02f45e8383b7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:52.172312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45b67dcf-c3c1-4f96-a9ab-02f45e8383b7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:52.172771 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45b67dcf-c3c1-4f96-a9ab-02f45e8383b7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:52.173557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45b67dcf-c3c1-4f96-a9ab-02f45e8383b7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:52.174007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45b67dcf-c3c1-4f96-a9ab-02f45e8383b7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:52.313511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-45b67dcf-c3c1-4f96-a9ab-02f45e8383b7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:52.321854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45b67dcf-c3c1-4f96-a9ab-02f45e8383b7 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1363 microversion: 2.1 time: 0.162090 Jul 26 20:42:52.322452 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3508/7095] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:52 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:52.464234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ba682102-d821-4738-8c64-4942138b2b00 req-4e2d5d32-afa6-49e2-a385-a57f41de570f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178b0e33-6e5f-4857-aaeb-4c08eba5c142", "name": "network-vif-plugged", "status": "completed", "tag": "91569167-a391-4129-b3cc-f6ab4d20e107"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:52.475519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ba682102-d821-4738-8c64-4942138b2b00 req-4e2d5d32-afa6-49e2-a385-a57f41de570f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:52.477949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ba682102-d821-4738-8c64-4942138b2b00 req-4e2d5d32-afa6-49e2-a385-a57f41de570f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:52.487180 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ba682102-d821-4738-8c64-4942138b2b00 req-4e2d5d32-afa6-49e2-a385-a57f41de570f service nova] Creating event network-vif-plugged:91569167-a391-4129-b3cc-f6ab4d20e107 for instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 on n-h2-708768-8 Jul 26 20:42:52.492835 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ba682102-d821-4738-8c64-4942138b2b00 req-4e2d5d32-afa6-49e2-a385-a57f41de570f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033511 Jul 26 20:42:52.493821 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3588/7096] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:42:53.343035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d0666eb-e449-44a1-997e-292d2a71a682 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:53.343579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1d0666eb-e449-44a1-997e-292d2a71a682 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:53.351351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d0666eb-e449-44a1-997e-292d2a71a682 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:53.352999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d0666eb-e449-44a1-997e-292d2a71a682 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:53.353799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d0666eb-e449-44a1-997e-292d2a71a682 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:53.354251 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d0666eb-e449-44a1-997e-292d2a71a682 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:53.484038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1d0666eb-e449-44a1-997e-292d2a71a682 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:53.491532 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1d0666eb-e449-44a1-997e-292d2a71a682 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1363 microversion: 2.1 time: 0.152506 Jul 26 20:42:53.492301 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3509/7097] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:53 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:54.516453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-083c5869-eb62-47e2-860e-90aa91544324 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:54.517308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-083c5869-eb62-47e2-860e-90aa91544324 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:54.524966 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-083c5869-eb62-47e2-860e-90aa91544324 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:54.525410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-083c5869-eb62-47e2-860e-90aa91544324 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:54.526177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-083c5869-eb62-47e2-860e-90aa91544324 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:54.526617 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-083c5869-eb62-47e2-860e-90aa91544324 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:54.684702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-083c5869-eb62-47e2-860e-90aa91544324 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:54.694029 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-083c5869-eb62-47e2-860e-90aa91544324 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1555 microversion: 2.1 time: 0.185680 Jul 26 20:42:54.694631 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3589/7098] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:54 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:54.717843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6360ea87-f46f-441a-87b6-950a771eb62e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:42:54.718472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6360ea87-f46f-441a-87b6-950a771eb62e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:54.727718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6360ea87-f46f-441a-87b6-950a771eb62e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:54.727909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6360ea87-f46f-441a-87b6-950a771eb62e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:54.728692 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6360ea87-f46f-441a-87b6-950a771eb62e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:54.729256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6360ea87-f46f-441a-87b6-950a771eb62e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:54.874588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6360ea87-f46f-441a-87b6-950a771eb62e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:42:54.882255 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6360ea87-f46f-441a-87b6-950a771eb62e tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1555 microversion: 2.1 time: 0.168422 Jul 26 20:42:54.883466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3510/7099] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:42:54 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:42:56.366131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5197043-841f-4e15-b7f8-8dfab1a15ea5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94927a63-4931-464e-9368-d84ef01ec7ad"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:42:56.369035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f5197043-841f-4e15-b7f8-8dfab1a15ea5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:42:56.371015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:42:56.376754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5197043-841f-4e15-b7f8-8dfab1a15ea5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:56.377205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5197043-841f-4e15-b7f8-8dfab1a15ea5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:56.377972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5197043-841f-4e15-b7f8-8dfab1a15ea5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:42:56.378408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5197043-841f-4e15-b7f8-8dfab1a15ea5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:42:56.613200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5197043-841f-4e15-b7f8-8dfab1a15ea5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "POST /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251011 Jul 26 20:42:56.613969 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3590/7100] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:42:56 2022] POST /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:07.481850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-34a39b08-f7b4-44f4-8abe-4ddad72b1f4a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:07.482390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-34a39b08-f7b4-44f4-8abe-4ddad72b1f4a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:07.484659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:07.485402 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:07.486090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:07.486703 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:07.494534 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34a39b08-f7b4-44f4-8abe-4ddad72b1f4a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:07.494994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34a39b08-f7b4-44f4-8abe-4ddad72b1f4a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:07.495811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34a39b08-f7b4-44f4-8abe-4ddad72b1f4a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:07.496262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-34a39b08-f7b4-44f4-8abe-4ddad72b1f4a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:07.579682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-34a39b08-f7b4-44f4-8abe-4ddad72b1f4a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lazy-loading 'services' on Instance uuid 178b0e33-6e5f-4857-aaeb-4c08eba5c142 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:43:07.650209 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-34a39b08-f7b4-44f4-8abe-4ddad72b1f4a tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments/94927a63-4931-464e-9368-d84ef01ec7ad" status: 202 len: 0 microversion: 2.1 time: 0.172163 Jul 26 20:43:07.650840 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3511/7101] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:43:07 2022] DELETE /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments/94927a63-4931-464e-9368-d84ef01ec7ad => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:43:07.659712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fe23a890-4ff1-4d03-8106-979235033133 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:07.662293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fe23a890-4ff1-4d03-8106-979235033133 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:07.666213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:07.667096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:07.673676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe23a890-4ff1-4d03-8106-979235033133 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:07.674133 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe23a890-4ff1-4d03-8106-979235033133 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:07.675365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe23a890-4ff1-4d03-8106-979235033133 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:07.675847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fe23a890-4ff1-4d03-8106-979235033133 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:07.711776 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fe23a890-4ff1-4d03-8106-979235033133 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056292 Jul 26 20:43:07.712361 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3591/7102] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:43:07 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:08.725440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-146859cc-af7e-49bd-9907-d78905a1de57 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:08.727928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-146859cc-af7e-49bd-9907-d78905a1de57 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:08.734256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-146859cc-af7e-49bd-9907-d78905a1de57 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:08.734718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-146859cc-af7e-49bd-9907-d78905a1de57 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:08.735492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-146859cc-af7e-49bd-9907-d78905a1de57 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:08.735963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-146859cc-af7e-49bd-9907-d78905a1de57 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:08.766098 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-146859cc-af7e-49bd-9907-d78905a1de57 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045823 Jul 26 20:43:08.766668 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3512/7103] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:43:08 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:09.779101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-76652e00-2788-4c40-a358-79711939ac2d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:09.781485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-76652e00-2788-4c40-a358-79711939ac2d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:09.791632 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76652e00-2788-4c40-a358-79711939ac2d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:09.792220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76652e00-2788-4c40-a358-79711939ac2d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:09.792997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76652e00-2788-4c40-a358-79711939ac2d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:09.793433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76652e00-2788-4c40-a358-79711939ac2d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:09.824659 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-76652e00-2788-4c40-a358-79711939ac2d tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049531 Jul 26 20:43:09.825444 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3592/7104] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:43:09 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:10.837437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-45f3aad7-9390-4c52-ba71-5d47ce6ca0a4 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:10.839663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-45f3aad7-9390-4c52-ba71-5d47ce6ca0a4 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:10.846694 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45f3aad7-9390-4c52-ba71-5d47ce6ca0a4 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:10.847158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45f3aad7-9390-4c52-ba71-5d47ce6ca0a4 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:10.847980 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45f3aad7-9390-4c52-ba71-5d47ce6ca0a4 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:10.848432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-45f3aad7-9390-4c52-ba71-5d47ce6ca0a4 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:10.878573 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-45f3aad7-9390-4c52-ba71-5d47ce6ca0a4 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Jul 26 20:43:10.879150 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3513/7105] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:43:10 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:11.891130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aebf5c31-07a7-4b0a-80bc-6d547bf04ca5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:11.893373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aebf5c31-07a7-4b0a-80bc-6d547bf04ca5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:11.900889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aebf5c31-07a7-4b0a-80bc-6d547bf04ca5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:11.901339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aebf5c31-07a7-4b0a-80bc-6d547bf04ca5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:11.902112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aebf5c31-07a7-4b0a-80bc-6d547bf04ca5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:11.902545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aebf5c31-07a7-4b0a-80bc-6d547bf04ca5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:11.932295 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aebf5c31-07a7-4b0a-80bc-6d547bf04ca5 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Jul 26 20:43:11.932863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3593/7106] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:43:11 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:12.944662 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cbe195b0-0cd6-46d2-b848-f2309d376177 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:12.946866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cbe195b0-0cd6-46d2-b848-f2309d376177 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:12.953717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbe195b0-0cd6-46d2-b848-f2309d376177 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:12.954173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbe195b0-0cd6-46d2-b848-f2309d376177 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:12.954938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbe195b0-0cd6-46d2-b848-f2309d376177 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:12.955378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cbe195b0-0cd6-46d2-b848-f2309d376177 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:12.985265 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cbe195b0-0cd6-46d2-b848-f2309d376177 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044648 Jul 26 20:43:12.985829 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3514/7107] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:43:12 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 20:43:12.996295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:12.996792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:13.003603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:13.004088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:13.004858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:13.005294 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:13.087709 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] HTTP exception thrown: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 is not attached to volume 94927a63-4931-464e-9368-d84ef01ec7ad Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Request method failure captured: Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: request: DELETE /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments/94927a63-4931-464e-9368-d84ef01ec7ad HTTP/1.1 Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FF2eKi91LXIdyiorKFBSG2AuXptwPYILGnYwuPOWVoPhWH81KJokPPpmbd0BWy4LX3mvO9QAHbElgJRu37cGpNBHXqwALqrunMam49W6Zff22DnAMkZ4ZKeJ0QhBvu9hvabO-wWaUYBsgWW3fMz_wmhPMqcgJwUxLiWug_kx6t9ILQ Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e005249c8fc54874a84e27e90e4ac46e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}] Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 376a9969c4db412dbae516c4d1faf426 Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 is not attached to volume 94927a63-4931-464e-9368-d84ef01ec7ad Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'server_id': '178b0e33-6e5f-4857-aaeb-4c08eba5c142', 'id': '94927a63-4931-464e-9368-d84ef01ec7ad'} Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 94927a63-4931-464e-9368-d84ef01ec7ad. Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 is not attached to volume 94927a63-4931-464e-9368-d84ef01ec7ad Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:43:13.089319 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:43:13.093387 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:43:13.093387 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:43:13.093387 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 is not attached to volume 94927a63-4931-464e-9368-d84ef01ec7ad Jul 26 20:43:13.093387 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:13.093387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Returning 404 to user: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 is not attached to volume 94927a63-4931-464e-9368-d84ef01ec7ad {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:43:13.093387 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ec201363-082a-48ec-9e0b-4f11c5f57887 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments/94927a63-4931-464e-9368-d84ef01ec7ad" status: 404 len: 154 microversion: 2.1 time: 0.098614 Jul 26 20:43:13.093387 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3594/7108] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:43:12 2022] DELETE /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142/os-volume_attachments/94927a63-4931-464e-9368-d84ef01ec7ad => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:43:16.435545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d5a0b603-e92d-48fc-8571-ad5be19b8a43 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:16.436151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d5a0b603-e92d-48fc-8571-ad5be19b8a43 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:16.442332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d5a0b603-e92d-48fc-8571-ad5be19b8a43 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:16.442791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d5a0b603-e92d-48fc-8571-ad5be19b8a43 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:16.443574 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d5a0b603-e92d-48fc-8571-ad5be19b8a43 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:16.444042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d5a0b603-e92d-48fc-8571-ad5be19b8a43 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:16.471323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d5a0b603-e92d-48fc-8571-ad5be19b8a43 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:43:16.545975 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d5a0b603-e92d-48fc-8571-ad5be19b8a43 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 204 len: 0 microversion: 2.1 time: 0.115010 Jul 26 20:43:16.546643 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3515/7109] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:43:16 2022] DELETE /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:43:16.555736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-43ac0273-c110-463e-a0c2-f66a82129165 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:16.556520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-43ac0273-c110-463e-a0c2-f66a82129165 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:16.567044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43ac0273-c110-463e-a0c2-f66a82129165 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:16.567553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43ac0273-c110-463e-a0c2-f66a82129165 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:16.568454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43ac0273-c110-463e-a0c2-f66a82129165 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:16.568962 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43ac0273-c110-463e-a0c2-f66a82129165 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:16.705352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-43ac0273-c110-463e-a0c2-f66a82129165 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:16.713757 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-43ac0273-c110-463e-a0c2-f66a82129165 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1561 microversion: 2.1 time: 0.162414 Jul 26 20:43:16.714416 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3595/7110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:16 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:17.735529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-af27a8c5-7501-40ca-a877-7a9c7dd1d5b0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:17.736312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-af27a8c5-7501-40ca-a877-7a9c7dd1d5b0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:17.743566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af27a8c5-7501-40ca-a877-7a9c7dd1d5b0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:17.744065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af27a8c5-7501-40ca-a877-7a9c7dd1d5b0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:17.744841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af27a8c5-7501-40ca-a877-7a9c7dd1d5b0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:17.745283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-af27a8c5-7501-40ca-a877-7a9c7dd1d5b0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:17.884130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-af27a8c5-7501-40ca-a877-7a9c7dd1d5b0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:17.891668 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-af27a8c5-7501-40ca-a877-7a9c7dd1d5b0 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1561 microversion: 2.1 time: 0.160379 Jul 26 20:43:17.892238 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3516/7111] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:17 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:18.591086 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-520f2e55-f581-4ead-895b-da6f22a0004e req-a8fc4c8c-abc1-41f6-980a-128ca7517817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178b0e33-6e5f-4857-aaeb-4c08eba5c142", "name": "network-vif-deleted", "tag": "91569167-a391-4129-b3cc-f6ab4d20e107"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:43:18.603841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-520f2e55-f581-4ead-895b-da6f22a0004e req-a8fc4c8c-abc1-41f6-980a-128ca7517817 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:18.604287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-520f2e55-f581-4ead-895b-da6f22a0004e req-a8fc4c8c-abc1-41f6-980a-128ca7517817 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:18.617308 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-520f2e55-f581-4ead-895b-da6f22a0004e req-a8fc4c8c-abc1-41f6-980a-128ca7517817 service nova] Creating event network-vif-deleted:91569167-a391-4129-b3cc-f6ab4d20e107 for instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 on n-h2-708768-8 Jul 26 20:43:18.623456 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-520f2e55-f581-4ead-895b-da6f22a0004e req-a8fc4c8c-abc1-41f6-980a-128ca7517817 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036139 Jul 26 20:43:18.624102 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3596/7112] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:18.915296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:18.915849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:18.922171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:18.922636 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:18.923425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:18.923905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:18.958463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:18.958925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:18.959392 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lazy-loading 'fault' on Instance uuid 178b0e33-6e5f-4857-aaeb-4c08eba5c142 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:43:19.002399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376a9969c4db412dbae516c4d1faf426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e005249c8fc54874a84e27e90e4ac46e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:19.011017 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe1a4972-5e6e-46a9-a4ff-0228201e5a45 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 200 len: 1353 microversion: 2.1 time: 0.101453 Jul 26 20:43:19.011602 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3517/7113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:18 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 1353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:20.034876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:20.035627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] [instance: 178b0e33-6e5f-4857-aaeb-4c08eba5c142] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:20.042154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:20.042604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:20.043370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:20.043831 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:20.057516 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] HTTP exception thrown: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 could not be found. Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Request method failure captured: Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 HTTP/1.1 Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FF2eKi91LXIdyiorKFBSG2AuXptwPYILGnYwuPOWVoPhWH81KJokPPpmbd0BWy4LX3mvO9QAHbElgJRu37cGpNBHXqwALqrunMam49W6Zff22DnAMkZ4ZKeJ0QhBvu9hvabO-wWaUYBsgWW3fMz_wmhPMqcgJwUxLiWug_kx6t9ILQ Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e005249c8fc54874a84e27e90e4ac46e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e005249c8fc54874a84e27e90e4ac46e"}]}] Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: e005249c8fc54874a84e27e90e4ac46e Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-91303343 Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 376a9969c4db412dbae516c4d1faf426 Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestEncryptedCinderVolumes-91303343-project Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 could not be found. Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '178b0e33-6e5f-4857-aaeb-4c08eba5c142'} Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 could not be found. Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 could not be found. Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:43:20.059119 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 could not be found. Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Returning 404 to user: Instance 178b0e33-6e5f-4857-aaeb-4c08eba5c142 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef87502d-dc8c-4f80-80c1-365fc627f341 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142" status: 404 len: 111 microversion: 2.1 time: 0.030866 Jul 26 20:43:20.063497 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3597/7114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:20 2022] GET /compute/v2.1/servers/178b0e33-6e5f-4857-aaeb-4c08eba5c142 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:43:20.069543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0dbb22be-5df1-4075-89c1-00fdbb63cd80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] Calling method '.version_select at 0x7f875e9cd280>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:20.089981 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0dbb22be-5df1-4075-89c1-00fdbb63cd80 tempest-TestEncryptedCinderVolumes-91303343 tempest-TestEncryptedCinderVolumes-91303343-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1899123078" status: 202 len: 0 microversion: 2.1 time: 0.024328 Jul 26 20:43:20.090564 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3518/7115] 10.222.0.58 () {58 vars in 1278 bytes} [Tue Jul 26 20:43:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1899123078 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:43:46.873728 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c14e0608-517f-4df6-a0b4-20cec178fadc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'create', calling method: .version_select at 0x7f8768411040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-212254311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZLa8O70V30xCF9O+rO8iz9scpKWBg3aJxuvHR62yzDR+HL5WPiDGFuQ3eo+REuoP0nvBCvs9NVVwLksxAswHVzIL244jTMDJNck/et175ep0i0IIODCXdYGOs0NkwuAg=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:43:46.879197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=14 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:46.879890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=34 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:46.892098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c14e0608-517f-4df6-a0b4-20cec178fadc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Getting quotas for project af17484fbafb4e9b85d49a463933e298. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:43:46.898106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-c14e0608-517f-4df6-a0b4-20cec178fadc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Getting quotas for user 1c37a6e94cb241d48d52d1b4af7e359c and project af17484fbafb4e9b85d49a463933e298. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:43:46.921967 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c14e0608-517f-4df6-a0b4-20cec178fadc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052372 Jul 26 20:43:46.922565 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3598/7116] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:43:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:46.971061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:46.971792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:46.977157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-255078278", "imageRef": "2e8ec421-ad00-4b54-b93b-a3ad9cc93365", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-212254311", "networks": [{"uuid": "61e647bc-bcde-48bd-9a94-12092ce718f7"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:43:47.035708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] validate_networks() for [('61e647bc-bcde-48bd-9a94-12092ce718f7', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:43:47.412506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:43:47.412935 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:43:47.413471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:43:47.414470 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:43:47.414938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:43:47.424027 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:47.424483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:47.425547 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:47.425989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:47.443213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Getting quotas for project af17484fbafb4e9b85d49a463933e298. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:43:47.448363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Getting quotas for user 1c37a6e94cb241d48d52d1b4af7e359c and project af17484fbafb4e9b85d49a463933e298. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:43:47.460318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:43:47.463175 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e8ec421-ad00-4b54-b93b-a3ad9cc93365',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:43:47.506870 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ca1c3c0b-5989-4884-9796-b7ca714300bb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537748 Jul 26 20:43:47.507703 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3519/7117] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:43:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:43:47.518238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8fc80a10-c358-44fb-ac69-f25fae80c9bc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:47.518864 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8fc80a10-c358-44fb-ac69-f25fae80c9bc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:47.577051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8fc80a10-c358-44fb-ac69-f25fae80c9bc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:47.584711 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8fc80a10-c358-44fb-ac69-f25fae80c9bc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1257 microversion: 2.1 time: 0.070407 Jul 26 20:43:47.585271 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3599/7118] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:47 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:48.607109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-78aaf0fd-fd44-4bf2-bf57-ca972f7b6c10 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:48.607957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-78aaf0fd-fd44-4bf2-bf57-ca972f7b6c10 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:48.614863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78aaf0fd-fd44-4bf2-bf57-ca972f7b6c10 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:48.615324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78aaf0fd-fd44-4bf2-bf57-ca972f7b6c10 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:48.616842 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78aaf0fd-fd44-4bf2-bf57-ca972f7b6c10 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:48.617312 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78aaf0fd-fd44-4bf2-bf57-ca972f7b6c10 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:48.684278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-78aaf0fd-fd44-4bf2-bf57-ca972f7b6c10 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:48.692198 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-78aaf0fd-fd44-4bf2-bf57-ca972f7b6c10 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1317 microversion: 2.1 time: 0.090440 Jul 26 20:43:48.703876 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3520/7119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:48 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:49.714856 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0b6c5bc5-2990-4b51-b8da-c670c447c280 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:49.715510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0b6c5bc5-2990-4b51-b8da-c670c447c280 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:49.723184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b6c5bc5-2990-4b51-b8da-c670c447c280 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:49.723658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b6c5bc5-2990-4b51-b8da-c670c447c280 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:49.724475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b6c5bc5-2990-4b51-b8da-c670c447c280 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:49.724921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0b6c5bc5-2990-4b51-b8da-c670c447c280 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:49.864833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0b6c5bc5-2990-4b51-b8da-c670c447c280 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:49.872842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0b6c5bc5-2990-4b51-b8da-c670c447c280 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.162823 Jul 26 20:43:49.873514 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3600/7120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:49 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:50.894661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3e0e05de-44f3-4efb-bd0e-a06566495c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:50.895507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3e0e05de-44f3-4efb-bd0e-a06566495c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:50.903724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e0e05de-44f3-4efb-bd0e-a06566495c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:50.904301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e0e05de-44f3-4efb-bd0e-a06566495c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:50.905163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e0e05de-44f3-4efb-bd0e-a06566495c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:50.905711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3e0e05de-44f3-4efb-bd0e-a06566495c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:51.051559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3e0e05de-44f3-4efb-bd0e-a06566495c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:51.059999 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3e0e05de-44f3-4efb-bd0e-a06566495c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.169348 Jul 26 20:43:51.060516 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3521/7121] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:50 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:52.083573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fddb5aa5-dcfb-4f89-9274-696d039fc882 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:52.084304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fddb5aa5-dcfb-4f89-9274-696d039fc882 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:52.092291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fddb5aa5-dcfb-4f89-9274-696d039fc882 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:52.092745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fddb5aa5-dcfb-4f89-9274-696d039fc882 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:52.093523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fddb5aa5-dcfb-4f89-9274-696d039fc882 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:52.093958 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fddb5aa5-dcfb-4f89-9274-696d039fc882 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:52.243310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fddb5aa5-dcfb-4f89-9274-696d039fc882 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:52.251454 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fddb5aa5-dcfb-4f89-9274-696d039fc882 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.172753 Jul 26 20:43:52.252071 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3601/7122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:52 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:53.273792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ecc15671-307d-487f-8fdc-1d0e7e0ebdfb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:53.274452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ecc15671-307d-487f-8fdc-1d0e7e0ebdfb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:53.281686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecc15671-307d-487f-8fdc-1d0e7e0ebdfb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:53.282082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecc15671-307d-487f-8fdc-1d0e7e0ebdfb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:53.282875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecc15671-307d-487f-8fdc-1d0e7e0ebdfb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:53.283326 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecc15671-307d-487f-8fdc-1d0e7e0ebdfb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:53.426394 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ecc15671-307d-487f-8fdc-1d0e7e0ebdfb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:53.434881 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ecc15671-307d-487f-8fdc-1d0e7e0ebdfb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.165064 Jul 26 20:43:53.436292 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3522/7123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:53 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:54.458342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a971e85-9d71-4419-9d6a-9944d044f119 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:54.459079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a971e85-9d71-4419-9d6a-9944d044f119 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:54.466946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a971e85-9d71-4419-9d6a-9944d044f119 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:54.467402 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a971e85-9d71-4419-9d6a-9944d044f119 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:54.468228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a971e85-9d71-4419-9d6a-9944d044f119 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:54.468674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a971e85-9d71-4419-9d6a-9944d044f119 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:54.627563 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9a971e85-9d71-4419-9d6a-9944d044f119 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:54.637376 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a971e85-9d71-4419-9d6a-9944d044f119 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.182737 Jul 26 20:43:54.639674 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3602/7124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:54 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:55.659860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b519cb47-b7dd-4474-9079-f9b3fbdee42a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:55.660489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b519cb47-b7dd-4474-9079-f9b3fbdee42a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:55.668073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b519cb47-b7dd-4474-9079-f9b3fbdee42a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:55.668550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b519cb47-b7dd-4474-9079-f9b3fbdee42a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:55.669368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b519cb47-b7dd-4474-9079-f9b3fbdee42a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:55.669824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b519cb47-b7dd-4474-9079-f9b3fbdee42a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:55.812616 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b519cb47-b7dd-4474-9079-f9b3fbdee42a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:55.821559 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b519cb47-b7dd-4474-9079-f9b3fbdee42a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.165599 Jul 26 20:43:55.822201 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3523/7125] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:55 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:56.842386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4846b383-33f8-42f7-b310-3d2ab15ec941 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:56.843053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4846b383-33f8-42f7-b310-3d2ab15ec941 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:56.850339 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4846b383-33f8-42f7-b310-3d2ab15ec941 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:56.850801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4846b383-33f8-42f7-b310-3d2ab15ec941 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:56.852161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4846b383-33f8-42f7-b310-3d2ab15ec941 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:56.852610 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4846b383-33f8-42f7-b310-3d2ab15ec941 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:57.009195 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4846b383-33f8-42f7-b310-3d2ab15ec941 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:57.016916 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4846b383-33f8-42f7-b310-3d2ab15ec941 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.178600 Jul 26 20:43:57.017487 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3603/7126] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:56 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:43:58.012130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-2cb01211-f533-4567-9ddb-4a2f70b1922f req-96fcefd7-f5a9-41fa-a053-b9a76633796b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a452df56-8d85-4576-a866-e39262a1a7fe", "tag": "b7c2b5a1-8853-4b91-b7b5-c877390243dc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:43:58.020454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:58.021250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:58.034354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2cb01211-f533-4567-9ddb-4a2f70b1922f req-96fcefd7-f5a9-41fa-a053-b9a76633796b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:58.036777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2cb01211-f533-4567-9ddb-4a2f70b1922f req-96fcefd7-f5a9-41fa-a053-b9a76633796b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:58.042623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5763e4ea-6cf6-4a45-b2ea-399c7da947cd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:58.043247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5763e4ea-6cf6-4a45-b2ea-399c7da947cd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:58.047344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:43:58.056765 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2cb01211-f533-4567-9ddb-4a2f70b1922f req-96fcefd7-f5a9-41fa-a053-b9a76633796b service nova] Creating event network-changed:b7c2b5a1-8853-4b91-b7b5-c877390243dc for instance a452df56-8d85-4576-a866-e39262a1a7fe on n-h1-708768-8 Jul 26 20:43:58.059023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5763e4ea-6cf6-4a45-b2ea-399c7da947cd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:58.059481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5763e4ea-6cf6-4a45-b2ea-399c7da947cd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:58.060509 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5763e4ea-6cf6-4a45-b2ea-399c7da947cd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:58.060959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5763e4ea-6cf6-4a45-b2ea-399c7da947cd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:58.062468 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-2cb01211-f533-4567-9ddb-4a2f70b1922f req-96fcefd7-f5a9-41fa-a053-b9a76633796b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057777 Jul 26 20:43:58.063140 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3524/7127] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:43:58.278231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5763e4ea-6cf6-4a45-b2ea-399c7da947cd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:58.287662 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5763e4ea-6cf6-4a45-b2ea-399c7da947cd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.248793 Jul 26 20:43:58.287662 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3604/7128] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:58 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:43:59.309495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9edb928b-d18c-48f7-98b5-02bc5a6feac9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:43:59.310141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9edb928b-d18c-48f7-98b5-02bc5a6feac9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:43:59.316407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9edb928b-d18c-48f7-98b5-02bc5a6feac9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:59.316871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9edb928b-d18c-48f7-98b5-02bc5a6feac9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:59.317654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9edb928b-d18c-48f7-98b5-02bc5a6feac9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:43:59.318112 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9edb928b-d18c-48f7-98b5-02bc5a6feac9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:43:59.447588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9edb928b-d18c-48f7-98b5-02bc5a6feac9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:43:59.455097 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9edb928b-d18c-48f7-98b5-02bc5a6feac9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.151292 Jul 26 20:43:59.455694 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3525/7129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:43:59 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:00.476092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a8d8b00-d9fb-4c03-8dce-9364a4e95306 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:00.476731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8a8d8b00-d9fb-4c03-8dce-9364a4e95306 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:00.483624 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a8d8b00-d9fb-4c03-8dce-9364a4e95306 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:00.484092 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a8d8b00-d9fb-4c03-8dce-9364a4e95306 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:00.484863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a8d8b00-d9fb-4c03-8dce-9364a4e95306 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:00.485296 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a8d8b00-d9fb-4c03-8dce-9364a4e95306 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:00.613459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a8d8b00-d9fb-4c03-8dce-9364a4e95306 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:00.621118 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a8d8b00-d9fb-4c03-8dce-9364a4e95306 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.149003 Jul 26 20:44:00.621706 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3605/7130] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:00 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:01.642507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b0254b5-0851-4597-8693-a12c920b7e99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:01.643131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b0254b5-0851-4597-8693-a12c920b7e99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:01.650775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b0254b5-0851-4597-8693-a12c920b7e99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:01.651237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b0254b5-0851-4597-8693-a12c920b7e99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:01.652052 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b0254b5-0851-4597-8693-a12c920b7e99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:01.652508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b0254b5-0851-4597-8693-a12c920b7e99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:01.782795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2b0254b5-0851-4597-8693-a12c920b7e99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:01.791185 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b0254b5-0851-4597-8693-a12c920b7e99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.152571 Jul 26 20:44:01.791793 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3526/7131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:01 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:02.812072 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-424d69a1-a2dd-4617-acb5-efea6fdbf46c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:02.812673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-424d69a1-a2dd-4617-acb5-efea6fdbf46c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:02.819483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424d69a1-a2dd-4617-acb5-efea6fdbf46c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:02.819968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424d69a1-a2dd-4617-acb5-efea6fdbf46c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:02.820814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424d69a1-a2dd-4617-acb5-efea6fdbf46c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:02.821250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-424d69a1-a2dd-4617-acb5-efea6fdbf46c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:02.947303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-424d69a1-a2dd-4617-acb5-efea6fdbf46c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:02.954920 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-424d69a1-a2dd-4617-acb5-efea6fdbf46c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.146733 Jul 26 20:44:02.955497 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3606/7132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:02 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:03.975632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d8d2e1b7-0973-4e9b-b9ff-b92872b9f11e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:03.976380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d8d2e1b7-0973-4e9b-b9ff-b92872b9f11e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:03.984024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8d2e1b7-0973-4e9b-b9ff-b92872b9f11e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:03.984476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8d2e1b7-0973-4e9b-b9ff-b92872b9f11e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:03.985194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8d2e1b7-0973-4e9b-b9ff-b92872b9f11e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:03.985646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d8d2e1b7-0973-4e9b-b9ff-b92872b9f11e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:04.113667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d8d2e1b7-0973-4e9b-b9ff-b92872b9f11e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:04.121251 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d8d2e1b7-0973-4e9b-b9ff-b92872b9f11e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.149551 Jul 26 20:44:04.121825 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3527/7133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:03 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:04.434643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-37dd2cd0-e074-4f84-b6e5-9b96f4a71e57 req-671eb778-9c11-4f9c-ae21-2147531005b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a452df56-8d85-4576-a866-e39262a1a7fe", "name": "network-vif-plugged", "status": "completed", "tag": "b7c2b5a1-8853-4b91-b7b5-c877390243dc"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:44:04.445448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-37dd2cd0-e074-4f84-b6e5-9b96f4a71e57 req-671eb778-9c11-4f9c-ae21-2147531005b5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:04.445879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-37dd2cd0-e074-4f84-b6e5-9b96f4a71e57 req-671eb778-9c11-4f9c-ae21-2147531005b5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:04.456956 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-37dd2cd0-e074-4f84-b6e5-9b96f4a71e57 req-671eb778-9c11-4f9c-ae21-2147531005b5 service nova] Creating event network-vif-plugged:b7c2b5a1-8853-4b91-b7b5-c877390243dc for instance a452df56-8d85-4576-a866-e39262a1a7fe on n-h1-708768-8 Jul 26 20:44:04.462410 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-37dd2cd0-e074-4f84-b6e5-9b96f4a71e57 req-671eb778-9c11-4f9c-ae21-2147531005b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031443 Jul 26 20:44:04.463179 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3607/7134] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:44:05.142438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-222fe33e-d1ff-40fd-aa37-69d27139eafd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:05.143084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-222fe33e-d1ff-40fd-aa37-69d27139eafd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:05.150978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-222fe33e-d1ff-40fd-aa37-69d27139eafd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:05.151431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-222fe33e-d1ff-40fd-aa37-69d27139eafd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:05.152222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-222fe33e-d1ff-40fd-aa37-69d27139eafd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:05.152666 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-222fe33e-d1ff-40fd-aa37-69d27139eafd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:05.284262 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-222fe33e-d1ff-40fd-aa37-69d27139eafd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:05.291995 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-222fe33e-d1ff-40fd-aa37-69d27139eafd tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1357 microversion: 2.1 time: 0.153421 Jul 26 20:44:05.292564 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3528/7135] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:05 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:06.315140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ed9ff79-f917-4d18-8888-302206432e21 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:06.315795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ed9ff79-f917-4d18-8888-302206432e21 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:06.322216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed9ff79-f917-4d18-8888-302206432e21 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:06.322670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed9ff79-f917-4d18-8888-302206432e21 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:06.323432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed9ff79-f917-4d18-8888-302206432e21 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:06.323896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed9ff79-f917-4d18-8888-302206432e21 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:06.452522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ed9ff79-f917-4d18-8888-302206432e21 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:06.460636 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ed9ff79-f917-4d18-8888-302206432e21 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1546 microversion: 2.1 time: 0.150105 Jul 26 20:44:06.461197 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3608/7136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:06 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:06.481346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-84f86301-b93e-49de-8610-bce9b1edc67b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:06.481977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-84f86301-b93e-49de-8610-bce9b1edc67b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:06.488904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84f86301-b93e-49de-8610-bce9b1edc67b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:06.489371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84f86301-b93e-49de-8610-bce9b1edc67b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:06.490153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84f86301-b93e-49de-8610-bce9b1edc67b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:06.490606 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-84f86301-b93e-49de-8610-bce9b1edc67b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:06.619399 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-84f86301-b93e-49de-8610-bce9b1edc67b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:06.627037 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-84f86301-b93e-49de-8610-bce9b1edc67b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1546 microversion: 2.1 time: 0.149561 Jul 26 20:44:06.627744 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3529/7137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:06 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:44:06.646655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:06.651883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:06.652684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Searching by: {'deleted': False, 'project_id': 'af17484fbafb4e9b85d49a463933e298'} {{(pid=125964) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:44:06.658024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:06.658471 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:06.659324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:06.659800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:06.686637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.multi_cell_list [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125964) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:44:06.713396 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5b76b269-0f19-42fa-91ec-c5e2c5af6d3f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070591 Jul 26 20:44:06.713977 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3609/7138] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 20:44:06 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:44:06.725177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28463d11-19d1-4222-bd46-c468d42dcf79 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:06.726477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-28463d11-19d1-4222-bd46-c468d42dcf79 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:06.732641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28463d11-19d1-4222-bd46-c468d42dcf79 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:06.733109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28463d11-19d1-4222-bd46-c468d42dcf79 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:06.733890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28463d11-19d1-4222-bd46-c468d42dcf79 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:06.734341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28463d11-19d1-4222-bd46-c468d42dcf79 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:06.870930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-28463d11-19d1-4222-bd46-c468d42dcf79 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:06.878601 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-28463d11-19d1-4222-bd46-c468d42dcf79 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1546 microversion: 2.1 time: 0.157282 Jul 26 20:44:06.879190 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3530/7139] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:06 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:08.416189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-adf45817-2f7a-4da0-a3ea-e32cd5b7d8d0 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:44:08.419446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-adf45817-2f7a-4da0-a3ea-e32cd5b7d8d0 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:08.427180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-adf45817-2f7a-4da0-a3ea-e32cd5b7d8d0 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:08.427650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-adf45817-2f7a-4da0-a3ea-e32cd5b7d8d0 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:08.428416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-adf45817-2f7a-4da0-a3ea-e32cd5b7d8d0 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:08.429614 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-adf45817-2f7a-4da0-a3ea-e32cd5b7d8d0 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:08.662918 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-adf45817-2f7a-4da0-a3ea-e32cd5b7d8d0 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251504 Jul 26 20:44:08.664277 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3610/7140] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:44:08 2022] POST /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:44:21.682065 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f2f358e9-b0d3-4928-9e4f-39ee72f6bccc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:21.682699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f2f358e9-b0d3-4928-9e4f-39ee72f6bccc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:21.685530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:44:21.686222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=64 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:44:21.693316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2f358e9-b0d3-4928-9e4f-39ee72f6bccc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:21.693790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2f358e9-b0d3-4928-9e4f-39ee72f6bccc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:21.694637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2f358e9-b0d3-4928-9e4f-39ee72f6bccc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:21.695115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f2f358e9-b0d3-4928-9e4f-39ee72f6bccc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:21.825757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f2f358e9-b0d3-4928-9e4f-39ee72f6bccc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:21.833861 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f2f358e9-b0d3-4928-9e4f-39ee72f6bccc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1592 microversion: 2.1 time: 0.155740 Jul 26 20:44:21.834441 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3531/7141] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:21 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1592 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:23.514252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:44:23.515796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:44:23.516713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:44:23.521320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e061cf3f-66e9-4afd-bce3-4a7b630ce892 req-cbab4063-b1c8-44be-93e9-2d950dbb4c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a452df56-8d85-4576-a866-e39262a1a7fe", "tag": "b7c2b5a1-8853-4b91-b7b5-c877390243dc"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:44:23.534726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e061cf3f-66e9-4afd-bce3-4a7b630ce892 req-cbab4063-b1c8-44be-93e9-2d950dbb4c4d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:23.535481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e061cf3f-66e9-4afd-bce3-4a7b630ce892 req-cbab4063-b1c8-44be-93e9-2d950dbb4c4d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:23.550320 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e061cf3f-66e9-4afd-bce3-4a7b630ce892 req-cbab4063-b1c8-44be-93e9-2d950dbb4c4d service nova] Creating event network-changed:b7c2b5a1-8853-4b91-b7b5-c877390243dc for instance a452df56-8d85-4576-a866-e39262a1a7fe on n-h1-708768-8 Jul 26 20:44:23.556249 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e061cf3f-66e9-4afd-bce3-4a7b630ce892 req-cbab4063-b1c8-44be-93e9-2d950dbb4c4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043601 Jul 26 20:44:23.556847 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3611/7142] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:44:24.813458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9446047c-290a-4714-a731-f8f1a8ba18e2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-792576093"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:44:24.814013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9446047c-290a-4714-a731-f8f1a8ba18e2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:24.821667 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9446047c-290a-4714-a731-f8f1a8ba18e2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:24.822129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9446047c-290a-4714-a731-f8f1a8ba18e2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:24.822898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9446047c-290a-4714-a731-f8f1a8ba18e2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:24.823350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9446047c-290a-4714-a731-f8f1a8ba18e2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:24.948233 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.security_group_api [None req-9446047c-290a-4714-a731-f8f1a8ba18e2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Adding security group 8c266880-f910-48b4-bc68-651757118835 to port b7c2b5a1-8853-4b91-b7b5-c877390243dc Jul 26 20:44:25.301408 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9446047c-290a-4714-a731-f8f1a8ba18e2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.491666 Jul 26 20:44:25.302244 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3532/7143] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:44:24 2022] POST /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:44:25.312048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bb96262b-7eae-4513-a7f9-c9c16d28bc0e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:44:25.314318 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bb96262b-7eae-4513-a7f9-c9c16d28bc0e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:44:25.322850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb96262b-7eae-4513-a7f9-c9c16d28bc0e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:25.323310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb96262b-7eae-4513-a7f9-c9c16d28bc0e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:25.324192 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb96262b-7eae-4513-a7f9-c9c16d28bc0e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:25.324633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bb96262b-7eae-4513-a7f9-c9c16d28bc0e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:25.486108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bb96262b-7eae-4513-a7f9-c9c16d28bc0e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:44:25.495721 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bb96262b-7eae-4513-a7f9-c9c16d28bc0e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1756 microversion: 2.1 time: 0.187955 Jul 26 20:44:25.496778 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3612/7144] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:44:25 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:44:25.570862 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-9d2cae8d-3790-4977-ad3f-90423dd4daf5 req-f689131f-bbb0-4097-a6bd-6ea7bf4f0b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a452df56-8d85-4576-a866-e39262a1a7fe", "tag": "b7c2b5a1-8853-4b91-b7b5-c877390243dc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:44:25.581601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9d2cae8d-3790-4977-ad3f-90423dd4daf5 req-f689131f-bbb0-4097-a6bd-6ea7bf4f0b3d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:44:25.582145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-9d2cae8d-3790-4977-ad3f-90423dd4daf5 req-f689131f-bbb0-4097-a6bd-6ea7bf4f0b3d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:44:25.593688 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-9d2cae8d-3790-4977-ad3f-90423dd4daf5 req-f689131f-bbb0-4097-a6bd-6ea7bf4f0b3d service nova] Creating event network-changed:b7c2b5a1-8853-4b91-b7b5-c877390243dc for instance a452df56-8d85-4576-a866-e39262a1a7fe on n-h1-708768-8 Jul 26 20:44:25.598964 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-9d2cae8d-3790-4977-ad3f-90423dd4daf5 req-f689131f-bbb0-4097-a6bd-6ea7bf4f0b3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032001 Jul 26 20:44:25.599580 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3533/7145] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:45:25.888945 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:45:25.889640 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:46:02.963005 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 20:46:02.963764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:46:02.964500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=8 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:46:02.969185 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-16834966-5179-48b4-85e5-bbb97b856730 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:46:02.971367 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-16834966-5179-48b4-85e5-bbb97b856730 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:46:02.978491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16834966-5179-48b4-85e5-bbb97b856730 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:46:02.978931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16834966-5179-48b4-85e5-bbb97b856730 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:46:02.979724 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16834966-5179-48b4-85e5-bbb97b856730 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:46:02.980613 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-16834966-5179-48b4-85e5-bbb97b856730 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:46:03.055530 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-16834966-5179-48b4-85e5-bbb97b856730 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.095140 Jul 26 20:46:03.056222 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3613/7146] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:46:02 2022] POST /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:46:03.063231 n-d-708768-8 devstack@n-api.service[125963]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2aaae370-da13-49b4-9123-d72edfc530d8] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 20:46:03.063829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:46:03.064579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:46:03.069632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d15131e1-e623-4fd2-a0e6-6c432d2dac1d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:46:03.070578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d15131e1-e623-4fd2-a0e6-6c432d2dac1d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:46:03.078011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d15131e1-e623-4fd2-a0e6-6c432d2dac1d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:46:03.078468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d15131e1-e623-4fd2-a0e6-6c432d2dac1d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:46:03.079362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d15131e1-e623-4fd2-a0e6-6c432d2dac1d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:46:03.079856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d15131e1-e623-4fd2-a0e6-6c432d2dac1d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:46:03.229988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d15131e1-e623-4fd2-a0e6-6c432d2dac1d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:46:03.238095 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d15131e1-e623-4fd2-a0e6-6c432d2dac1d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1758 microversion: 2.1 time: 0.177420 Jul 26 20:46:03.238940 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3534/7147] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:46:03 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:46:04.261579 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e4ea8790-da9e-4e86-a3a3-28afba465d27 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:46:04.262279 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e4ea8790-da9e-4e86-a3a3-28afba465d27 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:46:04.269120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4ea8790-da9e-4e86-a3a3-28afba465d27 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:46:04.269566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4ea8790-da9e-4e86-a3a3-28afba465d27 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:46:04.270320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4ea8790-da9e-4e86-a3a3-28afba465d27 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:46:04.270754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e4ea8790-da9e-4e86-a3a3-28afba465d27 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:46:04.277502 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 44912. Jul 26 20:46:04.417589 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e4ea8790-da9e-4e86-a3a3-28afba465d27 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:46:04.425908 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e4ea8790-da9e-4e86-a3a3-28afba465d27 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1756 microversion: 2.1 time: 0.170056 Jul 26 20:46:04.426485 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3614/7148] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:46:04 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:46:24.707401 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:46:24.708120 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:46:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:46:55.161063 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:46:55.161732 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:46:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:47:17.194674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:17.195545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:17.199593 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a1cc761-5b03-434e-a1bf-c708ad986058 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-792576093"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:47:17.200160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a1cc761-5b03-434e-a1bf-c708ad986058 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:17.209378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a1cc761-5b03-434e-a1bf-c708ad986058 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:17.209831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a1cc761-5b03-434e-a1bf-c708ad986058 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:17.210601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a1cc761-5b03-434e-a1bf-c708ad986058 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:17.211043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a1cc761-5b03-434e-a1bf-c708ad986058 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:17.216036 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] [2aaae370-da13-49b4-9123-d72edfc530d8] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 44946. Jul 26 20:47:17.470362 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.security_group_api [None req-1a1cc761-5b03-434e-a1bf-c708ad986058 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Removing security group 8c266880-f910-48b4-bc68-651757118835 from port b7c2b5a1-8853-4b91-b7b5-c877390243dc Jul 26 20:47:17.805184 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a1cc761-5b03-434e-a1bf-c708ad986058 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/action" status: 202 len: 0 microversion: 2.1 time: 0.612276 Jul 26 20:47:17.808891 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3535/7149] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:47:17 2022] POST /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:47:17.810983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:17.811785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:17.819363 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e923f488-cbeb-4777-bb61-01eb3205f780 req-7d15921e-9c21-4851-8cc8-50e032940171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a452df56-8d85-4576-a866-e39262a1a7fe", "tag": "b7c2b5a1-8853-4b91-b7b5-c877390243dc"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:47:17.835434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e923f488-cbeb-4777-bb61-01eb3205f780 req-7d15921e-9c21-4851-8cc8-50e032940171 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:17.836365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e923f488-cbeb-4777-bb61-01eb3205f780 req-7d15921e-9c21-4851-8cc8-50e032940171 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:17.860314 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e923f488-cbeb-4777-bb61-01eb3205f780 req-7d15921e-9c21-4851-8cc8-50e032940171 service nova] Creating event network-changed:b7c2b5a1-8853-4b91-b7b5-c877390243dc for instance a452df56-8d85-4576-a866-e39262a1a7fe on n-h1-708768-8 Jul 26 20:47:17.866258 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e923f488-cbeb-4777-bb61-01eb3205f780 req-7d15921e-9c21-4851-8cc8-50e032940171 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057252 Jul 26 20:47:17.868019 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3615/7150] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:19.529799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28f98d28-ba2c-40d6-9b62-cf00707dd35d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:19.530302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-28f98d28-ba2c-40d6-9b62-cf00707dd35d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:19.537410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28f98d28-ba2c-40d6-9b62-cf00707dd35d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:19.537878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28f98d28-ba2c-40d6-9b62-cf00707dd35d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:19.538654 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28f98d28-ba2c-40d6-9b62-cf00707dd35d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:19.539102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-28f98d28-ba2c-40d6-9b62-cf00707dd35d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:19.620098 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-28f98d28-ba2c-40d6-9b62-cf00707dd35d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lazy-loading 'services' on Instance uuid a452df56-8d85-4576-a866-e39262a1a7fe {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:47:19.694272 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-28f98d28-ba2c-40d6-9b62-cf00707dd35d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments/5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2" status: 202 len: 0 microversion: 2.1 time: 0.168794 Jul 26 20:47:19.695348 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3536/7151] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:47:19 2022] DELETE /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments/5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:47:19.705267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3a463e0e-9d0e-4600-a4cf-7a1c3c089e38 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:19.708130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3a463e0e-9d0e-4600-a4cf-7a1c3c089e38 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:19.717478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a463e0e-9d0e-4600-a4cf-7a1c3c089e38 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:19.718240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a463e0e-9d0e-4600-a4cf-7a1c3c089e38 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:19.719487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a463e0e-9d0e-4600-a4cf-7a1c3c089e38 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:19.720038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3a463e0e-9d0e-4600-a4cf-7a1c3c089e38 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:19.755340 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3a463e0e-9d0e-4600-a4cf-7a1c3c089e38 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055757 Jul 26 20:47:19.755951 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3616/7152] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:47:19 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:19.884043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-560561fc-7018-4729-aece-f59ab49f51a0 req-5a43e4db-2eaf-4cbb-a8f2-6b5c4f91ef12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a452df56-8d85-4576-a866-e39262a1a7fe", "tag": "b7c2b5a1-8853-4b91-b7b5-c877390243dc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:47:19.894554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-560561fc-7018-4729-aece-f59ab49f51a0 req-5a43e4db-2eaf-4cbb-a8f2-6b5c4f91ef12 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:19.895004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-560561fc-7018-4729-aece-f59ab49f51a0 req-5a43e4db-2eaf-4cbb-a8f2-6b5c4f91ef12 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:19.905689 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-560561fc-7018-4729-aece-f59ab49f51a0 req-5a43e4db-2eaf-4cbb-a8f2-6b5c4f91ef12 service nova] Creating event network-changed:b7c2b5a1-8853-4b91-b7b5-c877390243dc for instance a452df56-8d85-4576-a866-e39262a1a7fe on n-h1-708768-8 Jul 26 20:47:19.910858 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-560561fc-7018-4729-aece-f59ab49f51a0 req-5a43e4db-2eaf-4cbb-a8f2-6b5c4f91ef12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030835 Jul 26 20:47:19.911457 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3537/7153] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:20.769024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7b008c1b-2d07-4b70-89f3-7a487d8ae432 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:20.771184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7b008c1b-2d07-4b70-89f3-7a487d8ae432 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:20.778153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b008c1b-2d07-4b70-89f3-7a487d8ae432 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:20.778634 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b008c1b-2d07-4b70-89f3-7a487d8ae432 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:20.779407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b008c1b-2d07-4b70-89f3-7a487d8ae432 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:20.779889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7b008c1b-2d07-4b70-89f3-7a487d8ae432 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:20.809656 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7b008c1b-2d07-4b70-89f3-7a487d8ae432 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Jul 26 20:47:20.810213 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3617/7154] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:47:20 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:21.826283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-386cbcac-bc66-43c4-8441-a7fe06d7b9b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:21.829271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-386cbcac-bc66-43c4-8441-a7fe06d7b9b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:21.835684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-386cbcac-bc66-43c4-8441-a7fe06d7b9b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:21.836151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-386cbcac-bc66-43c4-8441-a7fe06d7b9b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:21.836944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-386cbcac-bc66-43c4-8441-a7fe06d7b9b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:21.837400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-386cbcac-bc66-43c4-8441-a7fe06d7b9b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:21.868902 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-386cbcac-bc66-43c4-8441-a7fe06d7b9b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047705 Jul 26 20:47:21.869470 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3538/7155] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:47:21 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:22.881380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-34c80e14-b30b-4e72-99d5-f60926442c42 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:22.883473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-34c80e14-b30b-4e72-99d5-f60926442c42 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:22.891863 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c80e14-b30b-4e72-99d5-f60926442c42 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:22.892323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c80e14-b30b-4e72-99d5-f60926442c42 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:22.893097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c80e14-b30b-4e72-99d5-f60926442c42 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:22.893536 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-34c80e14-b30b-4e72-99d5-f60926442c42 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:22.922944 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-34c80e14-b30b-4e72-99d5-f60926442c42 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Jul 26 20:47:22.923507 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3618/7156] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:47:22 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:23.935406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-172cc32a-6fb2-45a4-81f3-ab5989e154a9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:23.938391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-172cc32a-6fb2-45a4-81f3-ab5989e154a9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:23.945483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-172cc32a-6fb2-45a4-81f3-ab5989e154a9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:23.945948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-172cc32a-6fb2-45a4-81f3-ab5989e154a9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:23.946734 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-172cc32a-6fb2-45a4-81f3-ab5989e154a9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:23.947182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-172cc32a-6fb2-45a4-81f3-ab5989e154a9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:23.975879 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-172cc32a-6fb2-45a4-81f3-ab5989e154a9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Jul 26 20:47:23.976448 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3539/7157] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:47:23 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:24.988265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-faabbef6-8966-4b84-9190-f8422f743dc6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:24.990456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-faabbef6-8966-4b84-9190-f8422f743dc6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:24.997328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faabbef6-8966-4b84-9190-f8422f743dc6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:24.997800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faabbef6-8966-4b84-9190-f8422f743dc6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:24.998557 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faabbef6-8966-4b84-9190-f8422f743dc6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:24.998990 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-faabbef6-8966-4b84-9190-f8422f743dc6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:25.027948 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-faabbef6-8966-4b84-9190-f8422f743dc6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043674 Jul 26 20:47:25.028520 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3619/7158] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:47:24 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:47:25.039469 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:25.040010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:25.047532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:25.048011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:25.048780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:25.049243 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:25.122301 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] HTTP exception thrown: Instance a452df56-8d85-4576-a866-e39262a1a7fe is not attached to volume 5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Request method failure captured: Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments/5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2 HTTP/1.1 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FH0GHRauTnvWm0kjHQjafD3JFStrPn1qmX2xN47KkfKeISg9w5PrgqVjsbNSGzZ0SolsJ73H0UTQcCtj3UfEPOieyc95nIB7QEYH3uxMmEmizUvk_ScZYgAuDG-EDREEag8E7-zvC79QzHX-TiUzfMXIpSTncPTy4FV8Qnsi08f_oQ Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: af17484fbafb4e9b85d49a463933e298 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/af17484fbafb4e9b85d49a463933e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/af17484fbafb4e9b85d49a463933e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_af17484fbafb4e9b85d49a463933e298", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/af17484fbafb4e9b85d49a463933e298"}]}] Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: af17484fbafb4e9b85d49a463933e298 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestMinimumBasicScenario-186414633-project Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 1c37a6e94cb241d48d52d1b4af7e359c Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestMinimumBasicScenario-186414633-project Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance a452df56-8d85-4576-a866-e39262a1a7fe is not attached to volume 5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': 'a452df56-8d85-4576-a866-e39262a1a7fe', 'id': '5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2'} Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2. Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a452df56-8d85-4576-a866-e39262a1a7fe is not attached to volume 5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2 Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:47:25.123929 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:47:25.127811 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:47:25.127811 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:47:25.127811 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a452df56-8d85-4576-a866-e39262a1a7fe is not attached to volume 5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2 Jul 26 20:47:25.127811 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:25.127811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Returning 404 to user: Instance a452df56-8d85-4576-a866-e39262a1a7fe is not attached to volume 5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2 {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:47:25.127811 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-394d1b2a-53da-48c1-8c7a-5b398ca7a6c7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments/5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2" status: 404 len: 154 microversion: 2.1 time: 0.089963 Jul 26 20:47:25.127811 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3540/7159] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:47:25 2022] DELETE /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe/os-volume_attachments/5a7d5cf5-b594-45ef-8ca9-6c3e0bf02ed2 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:47:28.368916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7f25a78e-76e3-4f69-9782-f9a89d4154c6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:28.369427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7f25a78e-76e3-4f69-9782-f9a89d4154c6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:28.376234 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f25a78e-76e3-4f69-9782-f9a89d4154c6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:28.376693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f25a78e-76e3-4f69-9782-f9a89d4154c6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:28.377461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f25a78e-76e3-4f69-9782-f9a89d4154c6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:28.377904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7f25a78e-76e3-4f69-9782-f9a89d4154c6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:28.402372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7f25a78e-76e3-4f69-9782-f9a89d4154c6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:47:28.484869 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7f25a78e-76e3-4f69-9782-f9a89d4154c6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 204 len: 0 microversion: 2.1 time: 0.119643 Jul 26 20:47:28.485498 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3620/7160] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:47:28 2022] DELETE /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 20:47:28.494225 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-50fca8d3-6680-4932-ad1d-d831961d281c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:28.494856 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-50fca8d3-6680-4932-ad1d-d831961d281c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:28.503483 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50fca8d3-6680-4932-ad1d-d831961d281c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:28.503939 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50fca8d3-6680-4932-ad1d-d831961d281c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:28.504728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50fca8d3-6680-4932-ad1d-d831961d281c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:28.505194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-50fca8d3-6680-4932-ad1d-d831961d281c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:28.636828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-50fca8d3-6680-4932-ad1d-d831961d281c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:28.644716 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-50fca8d3-6680-4932-ad1d-d831961d281c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1552 microversion: 2.1 time: 0.154629 Jul 26 20:47:28.645403 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3541/7161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:28 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:29.667535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a943e3d1-23d8-4806-be08-0b12e15b9270 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:29.668180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a943e3d1-23d8-4806-be08-0b12e15b9270 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:29.675721 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a943e3d1-23d8-4806-be08-0b12e15b9270 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:29.676175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a943e3d1-23d8-4806-be08-0b12e15b9270 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:29.676946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a943e3d1-23d8-4806-be08-0b12e15b9270 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:29.677384 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a943e3d1-23d8-4806-be08-0b12e15b9270 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:29.857675 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a943e3d1-23d8-4806-be08-0b12e15b9270 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:29.865394 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a943e3d1-23d8-4806-be08-0b12e15b9270 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1552 microversion: 2.1 time: 0.202176 Jul 26 20:47:29.865974 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3621/7162] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:29 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1552 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:30.587367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-2f70acf5-a910-4c7d-962b-e08183775b6e req-55d66122-db3c-4483-8bec-ac4ac677961c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a452df56-8d85-4576-a866-e39262a1a7fe", "name": "network-vif-deleted", "tag": "b7c2b5a1-8853-4b91-b7b5-c877390243dc"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:47:30.597373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2f70acf5-a910-4c7d-962b-e08183775b6e req-55d66122-db3c-4483-8bec-ac4ac677961c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:30.597817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-2f70acf5-a910-4c7d-962b-e08183775b6e req-55d66122-db3c-4483-8bec-ac4ac677961c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:30.610265 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-2f70acf5-a910-4c7d-962b-e08183775b6e req-55d66122-db3c-4483-8bec-ac4ac677961c service nova] Creating event network-vif-deleted:b7c2b5a1-8853-4b91-b7b5-c877390243dc for instance a452df56-8d85-4576-a866-e39262a1a7fe on n-h1-708768-8 Jul 26 20:47:30.615544 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-2f70acf5-a910-4c7d-962b-e08183775b6e req-55d66122-db3c-4483-8bec-ac4ac677961c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092896 Jul 26 20:47:30.616181 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3542/7163] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:30.888855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:30.889671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:30.898434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:30.898894 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:30.899714 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:30.900184 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:30.935841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:30.936710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:30.937482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lazy-loading 'fault' on Instance uuid a452df56-8d85-4576-a866-e39262a1a7fe {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:47:30.987358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:30.994401 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-46913d8d-c3d3-40a1-aff3-92e4321fd5b5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 200 len: 1347 microversion: 2.1 time: 0.111594 Jul 26 20:47:30.994971 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3622/7164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:30 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 1347 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:32.016811 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:32.017524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: a452df56-8d85-4576-a866-e39262a1a7fe] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:32.023898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:32.024362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:32.025143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:32.025594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:32.039265 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] HTTP exception thrown: Instance a452df56-8d85-4576-a866-e39262a1a7fe could not be found. Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Request method failure captured: Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe HTTP/1.1 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FH0GHRauTnvWm0kjHQjafD3JFStrPn1qmX2xN47KkfKeISg9w5PrgqVjsbNSGzZ0SolsJ73H0UTQcCtj3UfEPOieyc95nIB7QEYH3uxMmEmizUvk_ScZYgAuDG-EDREEag8E7-zvC79QzHX-TiUzfMXIpSTncPTy4FV8Qnsi08f_oQ Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: af17484fbafb4e9b85d49a463933e298 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/af17484fbafb4e9b85d49a463933e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/af17484fbafb4e9b85d49a463933e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_af17484fbafb4e9b85d49a463933e298", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/af17484fbafb4e9b85d49a463933e298"}]}] Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: af17484fbafb4e9b85d49a463933e298 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestMinimumBasicScenario-186414633-project Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 1c37a6e94cb241d48d52d1b4af7e359c Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestMinimumBasicScenario-186414633-project Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance a452df56-8d85-4576-a866-e39262a1a7fe could not be found. Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'a452df56-8d85-4576-a866-e39262a1a7fe'} Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a452df56-8d85-4576-a866-e39262a1a7fe could not be found. Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a452df56-8d85-4576-a866-e39262a1a7fe could not be found. Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:47:32.040950 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a452df56-8d85-4576-a866-e39262a1a7fe could not be found. Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Returning 404 to user: Instance a452df56-8d85-4576-a866-e39262a1a7fe could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9b3fbb9c-54a7-44ad-8d22-64d5ec17b55e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe" status: 404 len: 111 microversion: 2.1 time: 0.030743 Jul 26 20:47:32.045372 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3543/7165] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:32 2022] GET /compute/v2.1/servers/a452df56-8d85-4576-a866-e39262a1a7fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:47:32.051698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c8030ae5-1035-4c6c-bea6-fdbdccbcc9e3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '.version_select at 0x7f875608fc10>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:32.073695 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c8030ae5-1035-4c6c-bea6-fdbdccbcc9e3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-212254311" status: 202 len: 0 microversion: 2.1 time: 0.025803 Jul 26 20:47:32.074279 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3623/7166] 10.222.0.58 () {58 vars in 1269 bytes} [Tue Jul 26 20:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-212254311 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:47:41.078994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fd4da7ec-ef10-4b7d-a1be-6e09d16a3ea3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'create', calling method: .version_select at 0x7f875d9dbd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1030065093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1owX1eW5P23hMAg8Z2IYwPD2wJztj4l7wtM6vOy4Xd2MsnKyN8h3a8GV0zIVuRPdYN7bna+8Bhkj0Z8Z9cjniooWjcUvyEZ3SS2MR9aiT3yZYIkzwK9HDOx9Yv1iFyA=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:47:41.094852 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fd4da7ec-ef10-4b7d-a1be-6e09d16a3ea3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Getting quotas for project af17484fbafb4e9b85d49a463933e298. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:47:41.100577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-fd4da7ec-ef10-4b7d-a1be-6e09d16a3ea3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Getting quotas for user 1c37a6e94cb241d48d52d1b4af7e359c and project af17484fbafb4e9b85d49a463933e298. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:47:41.127438 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fd4da7ec-ef10-4b7d-a1be-6e09d16a3ea3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052411 Jul 26 20:47:41.127992 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3544/7167] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:47:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:41.179744 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1101033868", "imageRef": "01ca857f-923f-45ce-8f15-9e26a1514e46", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1030065093", "networks": [{"uuid": "61e647bc-bcde-48bd-9a94-12092ce718f7"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:47:41.190077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:41.235314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] validate_networks() for [('61e647bc-bcde-48bd-9a94-12092ce718f7', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:47:41.691044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:47:41.691490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:47:41.692010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:47:41.692440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:47:41.692851 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:47:41.701520 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:41.701968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:41.702912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:41.703347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:41.720215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Getting quotas for project af17484fbafb4e9b85d49a463933e298. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:47:41.725336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Getting quotas for user 1c37a6e94cb241d48d52d1b4af7e359c and project af17484fbafb4e9b85d49a463933e298. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:47:41.738114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:47:41.740302 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='01ca857f-923f-45ce-8f15-9e26a1514e46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:47:41.784083 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [d9c29890-be1b-42cd-aa5e-1486c6deda58] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 20:47:42.792312 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [d9c29890-be1b-42cd-aa5e-1486c6deda58] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 45122. Jul 26 20:47:42.796431 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-099f1ccf-d824-44e1-b39a-7b9644262071 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620982 Jul 26 20:47:42.797092 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3624/7168] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:47:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:47:42.804850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:42.809637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e75850f8-2cd2-4e69-a029-a01908bcfef3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:42.810264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e75850f8-2cd2-4e69-a029-a01908bcfef3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:42.868625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e75850f8-2cd2-4e69-a029-a01908bcfef3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:42.876124 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e75850f8-2cd2-4e69-a029-a01908bcfef3 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1259 microversion: 2.1 time: 0.072393 Jul 26 20:47:42.876690 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3545/7169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:42 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:43.897544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6d42ee45-7e4b-451d-90ed-348bd5fda820 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:43.898173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6d42ee45-7e4b-451d-90ed-348bd5fda820 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:43.955515 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6d42ee45-7e4b-451d-90ed-348bd5fda820 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:43.962262 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6d42ee45-7e4b-451d-90ed-348bd5fda820 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1259 microversion: 2.1 time: 0.069435 Jul 26 20:47:43.962839 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3625/7170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:43 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:44.984070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0562a69-da79-4685-be94-591d73a10c98 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:44.984897 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c0562a69-da79-4685-be94-591d73a10c98 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:45.040827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c0562a69-da79-4685-be94-591d73a10c98 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:45.048373 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c0562a69-da79-4685-be94-591d73a10c98 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1259 microversion: 2.1 time: 0.068676 Jul 26 20:47:45.049185 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3546/7171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:44 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:46.070306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-823d0c34-24ef-4af0-89c0-0a496acc888f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:46.070915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-823d0c34-24ef-4af0-89c0-0a496acc888f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:46.128892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-823d0c34-24ef-4af0-89c0-0a496acc888f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:46.135992 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-823d0c34-24ef-4af0-89c0-0a496acc888f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1259 microversion: 2.1 time: 0.069561 Jul 26 20:47:46.136582 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3626/7172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:46 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:47.157435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f3852744-548e-43d1-9edb-f9cdff83fb6b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:47.158062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f3852744-548e-43d1-9edb-f9cdff83fb6b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:47.168748 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f3852744-548e-43d1-9edb-f9cdff83fb6b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:47.169600 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f3852744-548e-43d1-9edb-f9cdff83fb6b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:47.171561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f3852744-548e-43d1-9edb-f9cdff83fb6b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:47.172409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f3852744-548e-43d1-9edb-f9cdff83fb6b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:47.237380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f3852744-548e-43d1-9edb-f9cdff83fb6b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:47.247716 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f3852744-548e-43d1-9edb-f9cdff83fb6b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1263 microversion: 2.1 time: 0.094391 Jul 26 20:47:47.248510 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3547/7173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:47 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1263 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:48.271948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bc56fc1b-d623-4c90-8798-8f6d80eda448 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:48.272568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bc56fc1b-d623-4c90-8798-8f6d80eda448 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:48.275716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:48.283710 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc56fc1b-d623-4c90-8798-8f6d80eda448 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:48.285143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc56fc1b-d623-4c90-8798-8f6d80eda448 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:48.286301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc56fc1b-d623-4c90-8798-8f6d80eda448 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:48.286982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bc56fc1b-d623-4c90-8798-8f6d80eda448 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:48.359200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bc56fc1b-d623-4c90-8798-8f6d80eda448 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:48.367907 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bc56fc1b-d623-4c90-8798-8f6d80eda448 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1317 microversion: 2.1 time: 0.100189 Jul 26 20:47:48.368506 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3627/7174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:48 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:49.390480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-64a84930-8f1d-4a9c-9823-47a1706fb463 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:49.391150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-64a84930-8f1d-4a9c-9823-47a1706fb463 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:49.393988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:49.401131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64a84930-8f1d-4a9c-9823-47a1706fb463 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:49.401955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64a84930-8f1d-4a9c-9823-47a1706fb463 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:49.402995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64a84930-8f1d-4a9c-9823-47a1706fb463 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:49.403663 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-64a84930-8f1d-4a9c-9823-47a1706fb463 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:49.556632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-64a84930-8f1d-4a9c-9823-47a1706fb463 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:49.566726 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-64a84930-8f1d-4a9c-9823-47a1706fb463 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.180690 Jul 26 20:47:49.567435 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3548/7175] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:49 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:50.588051 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5bb07217-dc10-4a29-a493-2073ece0ceeb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:50.588690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5bb07217-dc10-4a29-a493-2073ece0ceeb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:50.598049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bb07217-dc10-4a29-a493-2073ece0ceeb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:50.598866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bb07217-dc10-4a29-a493-2073ece0ceeb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:50.599919 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bb07217-dc10-4a29-a493-2073ece0ceeb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:50.600584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5bb07217-dc10-4a29-a493-2073ece0ceeb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:50.741521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5bb07217-dc10-4a29-a493-2073ece0ceeb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:50.750938 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5bb07217-dc10-4a29-a493-2073ece0ceeb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.166819 Jul 26 20:47:50.751831 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3628/7176] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:50 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:51.772377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0422464b-60a2-467e-b1be-0d082f5a0fe7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:51.772987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0422464b-60a2-467e-b1be-0d082f5a0fe7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:51.780627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0422464b-60a2-467e-b1be-0d082f5a0fe7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:51.781226 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0422464b-60a2-467e-b1be-0d082f5a0fe7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:51.782043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0422464b-60a2-467e-b1be-0d082f5a0fe7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:51.782495 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0422464b-60a2-467e-b1be-0d082f5a0fe7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:51.917302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0422464b-60a2-467e-b1be-0d082f5a0fe7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:51.926002 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0422464b-60a2-467e-b1be-0d082f5a0fe7 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.157484 Jul 26 20:47:51.926512 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3549/7177] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:51 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:52.950427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f1c04f7d-f95a-473b-affe-fdf97bc2acdf tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:52.952355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f1c04f7d-f95a-473b-affe-fdf97bc2acdf tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:52.955707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:52.961316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1c04f7d-f95a-473b-affe-fdf97bc2acdf tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:52.961764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1c04f7d-f95a-473b-affe-fdf97bc2acdf tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:52.962532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1c04f7d-f95a-473b-affe-fdf97bc2acdf tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:52.962996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f1c04f7d-f95a-473b-affe-fdf97bc2acdf tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:53.132305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f1c04f7d-f95a-473b-affe-fdf97bc2acdf tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:53.142842 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f1c04f7d-f95a-473b-affe-fdf97bc2acdf tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.196270 Jul 26 20:47:53.143529 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3629/7178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:52 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:54.164553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df4583f3-f35b-4b4c-a505-0fb8597c1559 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:54.165276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-df4583f3-f35b-4b4c-a505-0fb8597c1559 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:54.172558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df4583f3-f35b-4b4c-a505-0fb8597c1559 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:54.173019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df4583f3-f35b-4b4c-a505-0fb8597c1559 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:54.174079 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df4583f3-f35b-4b4c-a505-0fb8597c1559 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:54.174660 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df4583f3-f35b-4b4c-a505-0fb8597c1559 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:54.329628 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-df4583f3-f35b-4b4c-a505-0fb8597c1559 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:54.337358 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df4583f3-f35b-4b4c-a505-0fb8597c1559 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.176798 Jul 26 20:47:54.338111 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3550/7179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:54 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:55.359921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5fed1919-a06e-48f5-913f-f3858cd24357 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:55.360547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5fed1919-a06e-48f5-913f-f3858cd24357 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:55.372397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5fed1919-a06e-48f5-913f-f3858cd24357 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:55.373290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5fed1919-a06e-48f5-913f-f3858cd24357 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:55.375287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5fed1919-a06e-48f5-913f-f3858cd24357 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:55.376122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5fed1919-a06e-48f5-913f-f3858cd24357 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:55.522911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5fed1919-a06e-48f5-913f-f3858cd24357 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:55.531940 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5fed1919-a06e-48f5-913f-f3858cd24357 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.176819 Jul 26 20:47:55.532554 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3630/7180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:55 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:56.553153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a65cbb31-d0f7-4fc3-a07c-bb8423da708b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:56.553988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a65cbb31-d0f7-4fc3-a07c-bb8423da708b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:56.556474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:56.562867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a65cbb31-d0f7-4fc3-a07c-bb8423da708b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:56.563319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a65cbb31-d0f7-4fc3-a07c-bb8423da708b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:56.564127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a65cbb31-d0f7-4fc3-a07c-bb8423da708b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:56.564575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a65cbb31-d0f7-4fc3-a07c-bb8423da708b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:56.814203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a65cbb31-d0f7-4fc3-a07c-bb8423da708b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:56.821917 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a65cbb31-d0f7-4fc3-a07c-bb8423da708b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.272734 Jul 26 20:47:56.822513 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3551/7181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:56 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:56.964332 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:47:57.042829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-f16f36ec-ed36-4a4a-b917-059390aee2b9 req-01181b6a-10c2-4db1-a33c-8d600b8022d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eab8121-d5b0-469b-9004-a146355c4780", "tag": "c5b1de0a-f0c8-4438-8eec-3851336a8975"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:47:57.054020 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f16f36ec-ed36-4a4a-b917-059390aee2b9 req-01181b6a-10c2-4db1-a33c-8d600b8022d2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:57.054399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-f16f36ec-ed36-4a4a-b917-059390aee2b9 req-01181b6a-10c2-4db1-a33c-8d600b8022d2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:57.066396 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-f16f36ec-ed36-4a4a-b917-059390aee2b9 req-01181b6a-10c2-4db1-a33c-8d600b8022d2 service nova] Creating event network-changed:c5b1de0a-f0c8-4438-8eec-3851336a8975 for instance 5eab8121-d5b0-469b-9004-a146355c4780 on n-h2-708768-8 Jul 26 20:47:57.071557 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-f16f36ec-ed36-4a4a-b917-059390aee2b9 req-01181b6a-10c2-4db1-a33c-8d600b8022d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112946 Jul 26 20:47:57.072532 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3631/7182] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:47:57.843204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f4df2391-cfa4-4dda-8aee-315f7c6e73d4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:57.843850 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f4df2391-cfa4-4dda-8aee-315f7c6e73d4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:57.850780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4df2391-cfa4-4dda-8aee-315f7c6e73d4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:57.851236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4df2391-cfa4-4dda-8aee-315f7c6e73d4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:57.852060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4df2391-cfa4-4dda-8aee-315f7c6e73d4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:57.852501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f4df2391-cfa4-4dda-8aee-315f7c6e73d4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:57.978911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f4df2391-cfa4-4dda-8aee-315f7c6e73d4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:57.986810 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f4df2391-cfa4-4dda-8aee-315f7c6e73d4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.147473 Jul 26 20:47:57.987204 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3552/7183] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:57 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:47:59.010135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a8391b5-0efd-4b90-8c8d-4a8a0490e8c9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:47:59.010841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a8391b5-0efd-4b90-8c8d-4a8a0490e8c9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:47:59.017892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a8391b5-0efd-4b90-8c8d-4a8a0490e8c9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:59.018340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a8391b5-0efd-4b90-8c8d-4a8a0490e8c9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:59.019110 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a8391b5-0efd-4b90-8c8d-4a8a0490e8c9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:47:59.019547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a8391b5-0efd-4b90-8c8d-4a8a0490e8c9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:47:59.151522 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9a8391b5-0efd-4b90-8c8d-4a8a0490e8c9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:47:59.159694 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a8391b5-0efd-4b90-8c8d-4a8a0490e8c9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.154683 Jul 26 20:47:59.160266 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3632/7184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:47:59 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:00.181104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-42e1e7b2-79e6-4b29-b910-a5d7dbb86bc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:00.181765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-42e1e7b2-79e6-4b29-b910-a5d7dbb86bc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:00.188800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42e1e7b2-79e6-4b29-b910-a5d7dbb86bc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:00.189264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42e1e7b2-79e6-4b29-b910-a5d7dbb86bc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:00.190048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42e1e7b2-79e6-4b29-b910-a5d7dbb86bc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:00.190502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-42e1e7b2-79e6-4b29-b910-a5d7dbb86bc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:00.324360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-42e1e7b2-79e6-4b29-b910-a5d7dbb86bc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:00.331948 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-42e1e7b2-79e6-4b29-b910-a5d7dbb86bc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.155102 Jul 26 20:48:00.332540 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3553/7185] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:00 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:01.353552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ace0f88e-b759-46f5-b992-f53d2ae1e6fc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:01.354091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ace0f88e-b759-46f5-b992-f53d2ae1e6fc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:01.361607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace0f88e-b759-46f5-b992-f53d2ae1e6fc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:01.362053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace0f88e-b759-46f5-b992-f53d2ae1e6fc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:01.362816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace0f88e-b759-46f5-b992-f53d2ae1e6fc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:01.363252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ace0f88e-b759-46f5-b992-f53d2ae1e6fc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:01.494998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ace0f88e-b759-46f5-b992-f53d2ae1e6fc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:01.502613 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ace0f88e-b759-46f5-b992-f53d2ae1e6fc tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.153016 Jul 26 20:48:01.503193 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3633/7186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:01 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:01.835853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-4075170c-bf66-48b9-a42f-8ca0103c0c86 req-3899b74a-4558-4299-8cfc-a1ca04a08146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eab8121-d5b0-469b-9004-a146355c4780", "name": "network-vif-plugged", "status": "completed", "tag": "c5b1de0a-f0c8-4438-8eec-3851336a8975"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:48:01.845869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4075170c-bf66-48b9-a42f-8ca0103c0c86 req-3899b74a-4558-4299-8cfc-a1ca04a08146 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:01.846323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-4075170c-bf66-48b9-a42f-8ca0103c0c86 req-3899b74a-4558-4299-8cfc-a1ca04a08146 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:01.857431 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-4075170c-bf66-48b9-a42f-8ca0103c0c86 req-3899b74a-4558-4299-8cfc-a1ca04a08146 service nova] Creating event network-vif-plugged:c5b1de0a-f0c8-4438-8eec-3851336a8975 for instance 5eab8121-d5b0-469b-9004-a146355c4780 on n-h2-708768-8 Jul 26 20:48:01.862856 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-4075170c-bf66-48b9-a42f-8ca0103c0c86 req-3899b74a-4558-4299-8cfc-a1ca04a08146 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089945 Jul 26 20:48:01.863449 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3554/7187] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:48:02.523975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29daac13-ce2b-4559-a23e-a55ca1410547 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:02.524597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-29daac13-ce2b-4559-a23e-a55ca1410547 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:02.532819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29daac13-ce2b-4559-a23e-a55ca1410547 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:02.533270 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29daac13-ce2b-4559-a23e-a55ca1410547 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:02.534039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29daac13-ce2b-4559-a23e-a55ca1410547 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:02.534473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29daac13-ce2b-4559-a23e-a55ca1410547 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:02.688486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-29daac13-ce2b-4559-a23e-a55ca1410547 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:02.696718 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29daac13-ce2b-4559-a23e-a55ca1410547 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1359 microversion: 2.1 time: 0.176832 Jul 26 20:48:02.697300 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3634/7188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:02 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:03.720361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e110648f-f2c0-4269-b982-84fecb9d01b6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:03.721093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e110648f-f2c0-4269-b982-84fecb9d01b6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:03.727301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e110648f-f2c0-4269-b982-84fecb9d01b6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:03.727813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e110648f-f2c0-4269-b982-84fecb9d01b6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:03.728591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e110648f-f2c0-4269-b982-84fecb9d01b6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:03.729045 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e110648f-f2c0-4269-b982-84fecb9d01b6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:03.855971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e110648f-f2c0-4269-b982-84fecb9d01b6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:03.863667 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e110648f-f2c0-4269-b982-84fecb9d01b6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1548 microversion: 2.1 time: 0.149195 Jul 26 20:48:03.864261 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3555/7189] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:03 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:03.884499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e58b74a8-0531-4a3d-9a93-f5debc02faa2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:03.885120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e58b74a8-0531-4a3d-9a93-f5debc02faa2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:03.892905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e58b74a8-0531-4a3d-9a93-f5debc02faa2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:03.893360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e58b74a8-0531-4a3d-9a93-f5debc02faa2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:03.894132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e58b74a8-0531-4a3d-9a93-f5debc02faa2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:03.894578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e58b74a8-0531-4a3d-9a93-f5debc02faa2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:04.022761 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e58b74a8-0531-4a3d-9a93-f5debc02faa2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:04.031205 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e58b74a8-0531-4a3d-9a93-f5debc02faa2 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1548 microversion: 2.1 time: 0.150509 Jul 26 20:48:04.031809 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3635/7190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:03 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:04.050607 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:04.055541 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:04.056356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Searching by: {'deleted': False, 'project_id': 'af17484fbafb4e9b85d49a463933e298'} {{(pid=125963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 20:48:04.062648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:04.063107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:04.063953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:04.064401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:04.088196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.multi_cell_list [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 20:48:04.114667 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-75e6258b-1cf7-47ea-824f-e697a1f7da2c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067757 Jul 26 20:48:04.115256 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3556/7191] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Jul 26 20:48:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:48:04.127358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49dbcec4-a4d9-4e83-b240-65e8a264e108 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:04.128009 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-49dbcec4-a4d9-4e83-b240-65e8a264e108 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:04.134096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49dbcec4-a4d9-4e83-b240-65e8a264e108 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:04.134549 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49dbcec4-a4d9-4e83-b240-65e8a264e108 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:04.135323 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49dbcec4-a4d9-4e83-b240-65e8a264e108 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:04.135795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49dbcec4-a4d9-4e83-b240-65e8a264e108 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:04.262355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-49dbcec4-a4d9-4e83-b240-65e8a264e108 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:04.270104 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-49dbcec4-a4d9-4e83-b240-65e8a264e108 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1548 microversion: 2.1 time: 0.147298 Jul 26 20:48:04.270858 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3636/7192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:04 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:05.775088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b548e04f-3ac7-439d-a4ec-c87ceb681087 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32b81f8d-40a2-40f2-9162-0b3ce3ace29a"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:48:05.777523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b548e04f-3ac7-439d-a4ec-c87ceb681087 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:05.785659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b548e04f-3ac7-439d-a4ec-c87ceb681087 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:05.786123 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b548e04f-3ac7-439d-a4ec-c87ceb681087 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:05.786907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b548e04f-3ac7-439d-a4ec-c87ceb681087 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:05.787359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b548e04f-3ac7-439d-a4ec-c87ceb681087 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:06.024994 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b548e04f-3ac7-439d-a4ec-c87ceb681087 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253655 Jul 26 20:48:06.025612 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3557/7193] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Jul 26 20:48:05 2022] POST /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:48:16.771978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d642c839-b587-42e8-93ee-7c04d1617bd4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:16.772603 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d642c839-b587-42e8-93ee-7c04d1617bd4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:16.775356 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=19 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:16.776209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=58 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:16.782364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d642c839-b587-42e8-93ee-7c04d1617bd4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:16.782820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d642c839-b587-42e8-93ee-7c04d1617bd4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:16.783599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d642c839-b587-42e8-93ee-7c04d1617bd4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:16.784068 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d642c839-b587-42e8-93ee-7c04d1617bd4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:16.914215 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d642c839-b587-42e8-93ee-7c04d1617bd4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:16.923189 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d642c839-b587-42e8-93ee-7c04d1617bd4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1594 microversion: 2.1 time: 0.154984 Jul 26 20:48:16.923823 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3637/7194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:16 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:18.770644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:18.772234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=19 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:18.773605 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:18.780380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-bfedf5c9-7d96-4a25-a3b3-b8a67a00f988 req-c8035d5f-ee88-4a5f-8110-830843ec0d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eab8121-d5b0-469b-9004-a146355c4780", "tag": "c5b1de0a-f0c8-4438-8eec-3851336a8975"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:48:18.796060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bfedf5c9-7d96-4a25-a3b3-b8a67a00f988 req-c8035d5f-ee88-4a5f-8110-830843ec0d8e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:18.796984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-bfedf5c9-7d96-4a25-a3b3-b8a67a00f988 req-c8035d5f-ee88-4a5f-8110-830843ec0d8e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:18.815234 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-bfedf5c9-7d96-4a25-a3b3-b8a67a00f988 req-c8035d5f-ee88-4a5f-8110-830843ec0d8e service nova] Creating event network-changed:c5b1de0a-f0c8-4438-8eec-3851336a8975 for instance 5eab8121-d5b0-469b-9004-a146355c4780 on n-h2-708768-8 Jul 26 20:48:18.821793 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-bfedf5c9-7d96-4a25-a3b3-b8a67a00f988 req-c8035d5f-ee88-4a5f-8110-830843ec0d8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053830 Jul 26 20:48:18.823409 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3558/7195] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:48:19.907106 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8626517f-2192-44cb-8063-c5e3d3bbab99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1855851344"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:48:19.907722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8626517f-2192-44cb-8063-c5e3d3bbab99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:19.915143 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8626517f-2192-44cb-8063-c5e3d3bbab99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:19.915849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8626517f-2192-44cb-8063-c5e3d3bbab99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:19.916961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8626517f-2192-44cb-8063-c5e3d3bbab99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:19.917348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8626517f-2192-44cb-8063-c5e3d3bbab99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:20.046452 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.network.security_group_api [None req-8626517f-2192-44cb-8063-c5e3d3bbab99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Adding security group 9b473fcc-2849-43ea-a51f-02b2d0adc54d to port c5b1de0a-f0c8-4438-8eec-3851336a8975 Jul 26 20:48:20.391434 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8626517f-2192-44cb-8063-c5e3d3bbab99 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/action" status: 202 len: 0 microversion: 2.1 time: 0.488998 Jul 26 20:48:20.396341 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3638/7196] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:48:19 2022] POST /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:48:20.406013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ad669a58-f131-46df-8034-42440f800ca4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:20.406831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ad669a58-f131-46df-8034-42440f800ca4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:20.416156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad669a58-f131-46df-8034-42440f800ca4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:20.416619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad669a58-f131-46df-8034-42440f800ca4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:20.424435 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad669a58-f131-46df-8034-42440f800ca4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:20.424909 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ad669a58-f131-46df-8034-42440f800ca4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:20.585147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ad669a58-f131-46df-8034-42440f800ca4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:20.594869 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ad669a58-f131-46df-8034-42440f800ca4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1760 microversion: 2.1 time: 0.195881 Jul 26 20:48:20.608282 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3559/7197] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:20 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1760 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:20.837486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-de84d395-f4af-4d51-a012-540356848cc6 req-46448911-82a0-4d2a-9070-2133dd2e2d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eab8121-d5b0-469b-9004-a146355c4780", "tag": "c5b1de0a-f0c8-4438-8eec-3851336a8975"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:48:20.847972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-de84d395-f4af-4d51-a012-540356848cc6 req-46448911-82a0-4d2a-9070-2133dd2e2d07 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:20.848421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-de84d395-f4af-4d51-a012-540356848cc6 req-46448911-82a0-4d2a-9070-2133dd2e2d07 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:20.860373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-de84d395-f4af-4d51-a012-540356848cc6 req-46448911-82a0-4d2a-9070-2133dd2e2d07 service nova] Creating event network-changed:c5b1de0a-f0c8-4438-8eec-3851336a8975 for instance 5eab8121-d5b0-469b-9004-a146355c4780 on n-h2-708768-8 Jul 26 20:48:20.866152 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-de84d395-f4af-4d51-a012-540356848cc6 req-46448911-82a0-4d2a-9070-2133dd2e2d07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 Jul 26 20:48:20.867108 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3639/7198] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:48:37.647559 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:37.648418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:37.693507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a963600b-d927-430a-8399-d5754dd6b426 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:48:37.695835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a963600b-d927-430a-8399-d5754dd6b426 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:37.701906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a963600b-d927-430a-8399-d5754dd6b426 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:37.702364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a963600b-d927-430a-8399-d5754dd6b426 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:37.703124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a963600b-d927-430a-8399-d5754dd6b426 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:37.703568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a963600b-d927-430a-8399-d5754dd6b426 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:37.775864 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a963600b-d927-430a-8399-d5754dd6b426 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/action" status: 202 len: 0 microversion: 2.1 time: 0.133565 Jul 26 20:48:37.776486 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3560/7199] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:48:37 2022] POST /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:48:37.786382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e3de980b-82d5-4f7f-a791-6316da0d2020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:37.787134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e3de980b-82d5-4f7f-a791-6316da0d2020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:37.789592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:37.790250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=12 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:48:37.796782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3de980b-82d5-4f7f-a791-6316da0d2020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:37.797259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3de980b-82d5-4f7f-a791-6316da0d2020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:37.798046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3de980b-82d5-4f7f-a791-6316da0d2020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:37.798490 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e3de980b-82d5-4f7f-a791-6316da0d2020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:37.952669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e3de980b-82d5-4f7f-a791-6316da0d2020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:37.961506 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e3de980b-82d5-4f7f-a791-6316da0d2020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1752 microversion: 2.1 time: 0.180136 Jul 26 20:48:37.962208 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3640/7200] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:37 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:48:38.985245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b611b9af-92b7-429c-a565-2edd1ae2a8ee tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:38.985956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b611b9af-92b7-429c-a565-2edd1ae2a8ee tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:38.993054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b611b9af-92b7-429c-a565-2edd1ae2a8ee tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:38.993510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b611b9af-92b7-429c-a565-2edd1ae2a8ee tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:38.994280 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b611b9af-92b7-429c-a565-2edd1ae2a8ee tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:38.994722 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b611b9af-92b7-429c-a565-2edd1ae2a8ee tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:39.142752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b611b9af-92b7-429c-a565-2edd1ae2a8ee tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:39.151324 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b611b9af-92b7-429c-a565-2edd1ae2a8ee tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.170427 Jul 26 20:48:39.151928 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3561/7201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:38 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:40.172841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0cb29a2e-9505-4f9b-a15d-6e3031339d31 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:40.173511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0cb29a2e-9505-4f9b-a15d-6e3031339d31 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:40.181380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cb29a2e-9505-4f9b-a15d-6e3031339d31 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:40.181869 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cb29a2e-9505-4f9b-a15d-6e3031339d31 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:40.182643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cb29a2e-9505-4f9b-a15d-6e3031339d31 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:40.183088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0cb29a2e-9505-4f9b-a15d-6e3031339d31 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:40.326398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0cb29a2e-9505-4f9b-a15d-6e3031339d31 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:40.334791 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0cb29a2e-9505-4f9b-a15d-6e3031339d31 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.165875 Jul 26 20:48:40.335360 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3641/7202] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:40 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:41.356506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c7799bf-b880-434c-bfc4-495d0fd2577f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:41.357135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8c7799bf-b880-434c-bfc4-495d0fd2577f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:41.364510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c7799bf-b880-434c-bfc4-495d0fd2577f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:41.364973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c7799bf-b880-434c-bfc4-495d0fd2577f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:41.365767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c7799bf-b880-434c-bfc4-495d0fd2577f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:41.366216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c7799bf-b880-434c-bfc4-495d0fd2577f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:41.508067 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8c7799bf-b880-434c-bfc4-495d0fd2577f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:41.521535 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c7799bf-b880-434c-bfc4-495d0fd2577f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.168848 Jul 26 20:48:41.522149 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3562/7203] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:41 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:42.543236 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3e671ba2-d59a-4a6a-baf6-02f6ce02a79b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:42.543862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3e671ba2-d59a-4a6a-baf6-02f6ce02a79b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:42.551014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e671ba2-d59a-4a6a-baf6-02f6ce02a79b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:42.551392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e671ba2-d59a-4a6a-baf6-02f6ce02a79b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:42.552179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e671ba2-d59a-4a6a-baf6-02f6ce02a79b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:42.552616 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3e671ba2-d59a-4a6a-baf6-02f6ce02a79b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:42.694280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3e671ba2-d59a-4a6a-baf6-02f6ce02a79b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:42.702315 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3e671ba2-d59a-4a6a-baf6-02f6ce02a79b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.162954 Jul 26 20:48:42.702891 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3642/7204] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:42 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:43.726453 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c6f6d22b-eb12-483d-bb5b-a0dc1cd2a561 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:43.727086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c6f6d22b-eb12-483d-bb5b-a0dc1cd2a561 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:43.734039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6f6d22b-eb12-483d-bb5b-a0dc1cd2a561 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:43.734500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6f6d22b-eb12-483d-bb5b-a0dc1cd2a561 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:43.735270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6f6d22b-eb12-483d-bb5b-a0dc1cd2a561 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:43.735754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c6f6d22b-eb12-483d-bb5b-a0dc1cd2a561 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:43.880955 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c6f6d22b-eb12-483d-bb5b-a0dc1cd2a561 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:43.888941 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c6f6d22b-eb12-483d-bb5b-a0dc1cd2a561 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.166996 Jul 26 20:48:43.889527 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3563/7205] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:43 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:44.910583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e820ca47-0997-4b15-b121-1b0473c4da7f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:44.911205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e820ca47-0997-4b15-b121-1b0473c4da7f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:44.918200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e820ca47-0997-4b15-b121-1b0473c4da7f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:44.918659 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e820ca47-0997-4b15-b121-1b0473c4da7f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:44.919433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e820ca47-0997-4b15-b121-1b0473c4da7f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:44.919913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e820ca47-0997-4b15-b121-1b0473c4da7f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:45.066878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e820ca47-0997-4b15-b121-1b0473c4da7f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:45.074959 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e820ca47-0997-4b15-b121-1b0473c4da7f tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.168607 Jul 26 20:48:45.075529 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3643/7206] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:44 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:46.096477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-03c2bd83-97d1-4e56-b3c8-c5b9fd463acb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:46.097102 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-03c2bd83-97d1-4e56-b3c8-c5b9fd463acb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:46.104210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03c2bd83-97d1-4e56-b3c8-c5b9fd463acb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:46.104700 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03c2bd83-97d1-4e56-b3c8-c5b9fd463acb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:46.105484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03c2bd83-97d1-4e56-b3c8-c5b9fd463acb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:46.105970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-03c2bd83-97d1-4e56-b3c8-c5b9fd463acb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:46.249313 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-03c2bd83-97d1-4e56-b3c8-c5b9fd463acb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:46.258026 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-03c2bd83-97d1-4e56-b3c8-c5b9fd463acb tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.165601 Jul 26 20:48:46.258604 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3564/7207] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:46 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:47.279385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a6a82f4f-533a-40f6-8ea4-be31c7e8bb3e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:47.279940 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a6a82f4f-533a-40f6-8ea4-be31c7e8bb3e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:47.286965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6a82f4f-533a-40f6-8ea4-be31c7e8bb3e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:47.287421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6a82f4f-533a-40f6-8ea4-be31c7e8bb3e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:47.288219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6a82f4f-533a-40f6-8ea4-be31c7e8bb3e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:47.288660 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6a82f4f-533a-40f6-8ea4-be31c7e8bb3e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:47.428057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6a82f4f-533a-40f6-8ea4-be31c7e8bb3e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:47.436508 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a6a82f4f-533a-40f6-8ea4-be31c7e8bb3e tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.162091 Jul 26 20:48:47.437303 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3644/7208] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:47 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:48.458762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-10b023e3-5daa-4654-b86f-f4214906d1f6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:48.459325 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-10b023e3-5daa-4654-b86f-f4214906d1f6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:48.466091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10b023e3-5daa-4654-b86f-f4214906d1f6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:48.466546 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10b023e3-5daa-4654-b86f-f4214906d1f6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:48.467309 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10b023e3-5daa-4654-b86f-f4214906d1f6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:48.467814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-10b023e3-5daa-4654-b86f-f4214906d1f6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:48.616655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-10b023e3-5daa-4654-b86f-f4214906d1f6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:48.624699 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-10b023e3-5daa-4654-b86f-f4214906d1f6 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1757 microversion: 2.1 time: 0.170063 Jul 26 20:48:48.625279 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3565/7209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:48 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:48:49.647156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-71ee26dc-8d2c-4c37-84ca-cc5125745630 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:48:49.647796 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-71ee26dc-8d2c-4c37-84ca-cc5125745630 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:48:49.654808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71ee26dc-8d2c-4c37-84ca-cc5125745630 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:49.655255 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71ee26dc-8d2c-4c37-84ca-cc5125745630 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:49.656054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71ee26dc-8d2c-4c37-84ca-cc5125745630 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:48:49.656494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71ee26dc-8d2c-4c37-84ca-cc5125745630 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:48:49.802565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-71ee26dc-8d2c-4c37-84ca-cc5125745630 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:48:49.811001 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-71ee26dc-8d2c-4c37-84ca-cc5125745630 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1760 microversion: 2.1 time: 0.168265 Jul 26 20:48:49.811520 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3645/7210] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:48:49 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:22.279511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-67357032-3dc5-4e5d-b14d-326303246657 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1855851344"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:49:22.280111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-67357032-3dc5-4e5d-b14d-326303246657 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:22.282308 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=12 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:49:22.282978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:49:22.289489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67357032-3dc5-4e5d-b14d-326303246657 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:22.289949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67357032-3dc5-4e5d-b14d-326303246657 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:22.290728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67357032-3dc5-4e5d-b14d-326303246657 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:22.291178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-67357032-3dc5-4e5d-b14d-326303246657 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:22.418397 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.network.security_group_api [None req-67357032-3dc5-4e5d-b14d-326303246657 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Removing security group 9b473fcc-2849-43ea-a51f-02b2d0adc54d from port c5b1de0a-f0c8-4438-8eec-3851336a8975 Jul 26 20:49:22.765572 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-67357032-3dc5-4e5d-b14d-326303246657 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "POST /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/action" status: 202 len: 0 microversion: 2.1 time: 0.490277 Jul 26 20:49:22.767506 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3566/7211] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:49:22 2022] POST /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:49:22.780891 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ba52d625-30db-4c0d-9e15-8ec156766d53 req-a1cc5c72-2879-46bc-a1c7-abe140aca0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eab8121-d5b0-469b-9004-a146355c4780", "tag": "c5b1de0a-f0c8-4438-8eec-3851336a8975"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:49:22.808783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=12 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:49:22.812433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=36 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:49:22.825233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ba52d625-30db-4c0d-9e15-8ec156766d53 req-a1cc5c72-2879-46bc-a1c7-abe140aca0a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:22.832329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ba52d625-30db-4c0d-9e15-8ec156766d53 req-a1cc5c72-2879-46bc-a1c7-abe140aca0a5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:22.849782 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ba52d625-30db-4c0d-9e15-8ec156766d53 req-a1cc5c72-2879-46bc-a1c7-abe140aca0a5 service nova] Creating event network-changed:c5b1de0a-f0c8-4438-8eec-3851336a8975 for instance 5eab8121-d5b0-469b-9004-a146355c4780 on n-h2-708768-8 Jul 26 20:49:22.857396 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ba52d625-30db-4c0d-9e15-8ec156766d53 req-a1cc5c72-2879-46bc-a1c7-abe140aca0a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082490 Jul 26 20:49:22.861801 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3646/7212] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:24.141830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-59886bd9-fc7e-4430-acd2-39dc7ac510b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:24.142356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-59886bd9-fc7e-4430-acd2-39dc7ac510b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:24.148879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59886bd9-fc7e-4430-acd2-39dc7ac510b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:24.149336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59886bd9-fc7e-4430-acd2-39dc7ac510b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:24.150107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59886bd9-fc7e-4430-acd2-39dc7ac510b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:24.150550 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59886bd9-fc7e-4430-acd2-39dc7ac510b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:24.233357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-59886bd9-fc7e-4430-acd2-39dc7ac510b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lazy-loading 'services' on Instance uuid 5eab8121-d5b0-469b-9004-a146355c4780 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:49:24.307224 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-59886bd9-fc7e-4430-acd2-39dc7ac510b1 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments/32b81f8d-40a2-40f2-9162-0b3ce3ace29a" status: 202 len: 0 microversion: 2.1 time: 0.170131 Jul 26 20:49:24.307890 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3567/7213] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:49:24 2022] DELETE /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments/32b81f8d-40a2-40f2-9162-0b3ce3ace29a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:49:24.317577 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f5d24caa-5a2e-4f98-b67f-24b83eb0b85b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:24.319951 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f5d24caa-5a2e-4f98-b67f-24b83eb0b85b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:24.327168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5d24caa-5a2e-4f98-b67f-24b83eb0b85b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:24.327681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5d24caa-5a2e-4f98-b67f-24b83eb0b85b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:24.328593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5d24caa-5a2e-4f98-b67f-24b83eb0b85b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:24.329212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f5d24caa-5a2e-4f98-b67f-24b83eb0b85b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:24.362036 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f5d24caa-5a2e-4f98-b67f-24b83eb0b85b tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049584 Jul 26 20:49:24.362890 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3647/7214] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:49:24 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:24.880006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-959fc58b-66a3-4693-8e71-5ff1d6091391 req-290a7e28-a9e3-44d1-8754-2b1b1cb065d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eab8121-d5b0-469b-9004-a146355c4780", "tag": "c5b1de0a-f0c8-4438-8eec-3851336a8975"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:49:24.891707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-959fc58b-66a3-4693-8e71-5ff1d6091391 req-290a7e28-a9e3-44d1-8754-2b1b1cb065d6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:24.892219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-959fc58b-66a3-4693-8e71-5ff1d6091391 req-290a7e28-a9e3-44d1-8754-2b1b1cb065d6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:24.905077 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-959fc58b-66a3-4693-8e71-5ff1d6091391 req-290a7e28-a9e3-44d1-8754-2b1b1cb065d6 service nova] Creating event network-changed:c5b1de0a-f0c8-4438-8eec-3851336a8975 for instance 5eab8121-d5b0-469b-9004-a146355c4780 on n-h2-708768-8 Jul 26 20:49:24.910030 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-959fc58b-66a3-4693-8e71-5ff1d6091391 req-290a7e28-a9e3-44d1-8754-2b1b1cb065d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034552 Jul 26 20:49:24.910620 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3568/7215] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:25.374826 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9f03e38a-7bbc-4d26-8419-9aef921c7cc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:25.376907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9f03e38a-7bbc-4d26-8419-9aef921c7cc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:25.384168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f03e38a-7bbc-4d26-8419-9aef921c7cc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:25.384625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f03e38a-7bbc-4d26-8419-9aef921c7cc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:25.385597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f03e38a-7bbc-4d26-8419-9aef921c7cc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:25.385874 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9f03e38a-7bbc-4d26-8419-9aef921c7cc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:25.419232 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9f03e38a-7bbc-4d26-8419-9aef921c7cc9 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048675 Jul 26 20:49:25.423766 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3648/7216] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:49:25 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:26.434523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1a306cc4-ec16-4eb3-8416-a94fa732d2ca tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:26.436782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1a306cc4-ec16-4eb3-8416-a94fa732d2ca tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:26.445486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a306cc4-ec16-4eb3-8416-a94fa732d2ca tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:26.446162 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a306cc4-ec16-4eb3-8416-a94fa732d2ca tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:26.446981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a306cc4-ec16-4eb3-8416-a94fa732d2ca tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:26.447432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1a306cc4-ec16-4eb3-8416-a94fa732d2ca tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:26.478754 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1a306cc4-ec16-4eb3-8416-a94fa732d2ca tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050821 Jul 26 20:49:26.479526 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3569/7217] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:49:26 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:27.490677 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c7b0f036-824b-4e38-994f-dc9845954020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:27.492978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c7b0f036-824b-4e38-994f-dc9845954020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:27.499976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7b0f036-824b-4e38-994f-dc9845954020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:27.500435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7b0f036-824b-4e38-994f-dc9845954020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:27.501212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7b0f036-824b-4e38-994f-dc9845954020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:27.501661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c7b0f036-824b-4e38-994f-dc9845954020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:27.531916 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c7b0f036-824b-4e38-994f-dc9845954020 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Jul 26 20:49:27.532495 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3649/7218] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:49:27 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:28.543943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fe3d2baf-9cda-4120-9108-225b086d1c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:28.546150 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fe3d2baf-9cda-4120-9108-225b086d1c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:28.553373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe3d2baf-9cda-4120-9108-225b086d1c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:28.554592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe3d2baf-9cda-4120-9108-225b086d1c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:28.555567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe3d2baf-9cda-4120-9108-225b086d1c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:28.556040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fe3d2baf-9cda-4120-9108-225b086d1c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:28.584491 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fe3d2baf-9cda-4120-9108-225b086d1c2d tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Jul 26 20:49:28.585376 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3570/7219] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:49:28 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:29.597340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5ff6027e-4d4a-4a23-8775-1fdda9bfd8c5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:29.599529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5ff6027e-4d4a-4a23-8775-1fdda9bfd8c5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:29.606140 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ff6027e-4d4a-4a23-8775-1fdda9bfd8c5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:29.606596 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ff6027e-4d4a-4a23-8775-1fdda9bfd8c5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:29.607371 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ff6027e-4d4a-4a23-8775-1fdda9bfd8c5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:29.609742 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5ff6027e-4d4a-4a23-8775-1fdda9bfd8c5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:29.639140 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5ff6027e-4d4a-4a23-8775-1fdda9bfd8c5 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046008 Jul 26 20:49:29.639728 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3650/7220] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Jul 26 20:49:29 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 20:49:29.650109 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:29.650615 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:29.658084 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:29.658665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:29.659452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:29.659947 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:29.733421 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] HTTP exception thrown: Instance 5eab8121-d5b0-469b-9004-a146355c4780 is not attached to volume 32b81f8d-40a2-40f2-9162-0b3ce3ace29a Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Request method failure captured: Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: request: DELETE /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments/32b81f8d-40a2-40f2-9162-0b3ce3ace29a HTTP/1.1 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FH0GHRauTnvWm0kjHQjafD3JFStrPn1qmX2xN47KkfKeISg9w5PrgqVjsbNSGzZ0SolsJ73H0UTQcCtj3UfEPOieyc95nIB7QEYH3uxMmEmizUvk_ScZYgAuDG-EDREEag8E7-zvC79QzHX-TiUzfMXIpSTncPTy4FV8Qnsi08f_oQ Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: af17484fbafb4e9b85d49a463933e298 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/af17484fbafb4e9b85d49a463933e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/af17484fbafb4e9b85d49a463933e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_af17484fbafb4e9b85d49a463933e298", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/af17484fbafb4e9b85d49a463933e298"}]}] Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: af17484fbafb4e9b85d49a463933e298 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestMinimumBasicScenario-186414633-project Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 1c37a6e94cb241d48d52d1b4af7e359c Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestMinimumBasicScenario-186414633-project Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 5eab8121-d5b0-469b-9004-a146355c4780 is not attached to volume 32b81f8d-40a2-40f2-9162-0b3ce3ace29a Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'server_id': '5eab8121-d5b0-469b-9004-a146355c4780', 'id': '32b81f8d-40a2-40f2-9162-0b3ce3ace29a'} Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 32b81f8d-40a2-40f2-9162-0b3ce3ace29a. Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eab8121-d5b0-469b-9004-a146355c4780 is not attached to volume 32b81f8d-40a2-40f2-9162-0b3ce3ace29a Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:49:29.735047 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:49:29.739148 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:49:29.739148 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:49:29.739148 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eab8121-d5b0-469b-9004-a146355c4780 is not attached to volume 32b81f8d-40a2-40f2-9162-0b3ce3ace29a Jul 26 20:49:29.739148 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:49:29.739148 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Returning 404 to user: Instance 5eab8121-d5b0-469b-9004-a146355c4780 is not attached to volume 32b81f8d-40a2-40f2-9162-0b3ce3ace29a {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:49:29.739148 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d156d73b-76dc-4a84-883d-e349b3f4ddad tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments/32b81f8d-40a2-40f2-9162-0b3ce3ace29a" status: 404 len: 154 microversion: 2.1 time: 0.090479 Jul 26 20:49:29.739148 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3571/7221] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Jul 26 20:49:29 2022] DELETE /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780/os-volume_attachments/32b81f8d-40a2-40f2-9162-0b3ce3ace29a => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:49:32.984662 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-20663aa9-4e24-486d-b3f4-8b9988662de8 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:32.985287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-20663aa9-4e24-486d-b3f4-8b9988662de8 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:32.993364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20663aa9-4e24-486d-b3f4-8b9988662de8 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:32.993818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20663aa9-4e24-486d-b3f4-8b9988662de8 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:32.994612 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20663aa9-4e24-486d-b3f4-8b9988662de8 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:32.995054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20663aa9-4e24-486d-b3f4-8b9988662de8 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:33.022111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-20663aa9-4e24-486d-b3f4-8b9988662de8 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:49:33.109468 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-20663aa9-4e24-486d-b3f4-8b9988662de8 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 204 len: 0 microversion: 2.1 time: 0.128280 Jul 26 20:49:33.110771 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3651/7222] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:49:32 2022] DELETE /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:49:33.119566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-78243274-50ea-453a-b72e-ee275ed4a451 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:33.120391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-78243274-50ea-453a-b72e-ee275ed4a451 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:33.128655 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78243274-50ea-453a-b72e-ee275ed4a451 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:33.129196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78243274-50ea-453a-b72e-ee275ed4a451 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:33.130050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78243274-50ea-453a-b72e-ee275ed4a451 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:33.130588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-78243274-50ea-453a-b72e-ee275ed4a451 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:33.264708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-78243274-50ea-453a-b72e-ee275ed4a451 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:33.272334 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-78243274-50ea-453a-b72e-ee275ed4a451 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1554 microversion: 2.1 time: 0.157279 Jul 26 20:49:33.273466 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3572/7223] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:33 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:34.295181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d74c3cc7-950b-46fa-9675-2c04ad938212 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:34.295862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d74c3cc7-950b-46fa-9675-2c04ad938212 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:34.302364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d74c3cc7-950b-46fa-9675-2c04ad938212 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:34.302810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d74c3cc7-950b-46fa-9675-2c04ad938212 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:34.303567 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d74c3cc7-950b-46fa-9675-2c04ad938212 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:34.304647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d74c3cc7-950b-46fa-9675-2c04ad938212 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:34.438154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d74c3cc7-950b-46fa-9675-2c04ad938212 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:34.446746 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d74c3cc7-950b-46fa-9675-2c04ad938212 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1554 microversion: 2.1 time: 0.156047 Jul 26 20:49:34.447372 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3652/7224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:34 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:35.467849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33fc1b4e-717d-492c-be1b-a5027d0e437c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:35.468479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-33fc1b4e-717d-492c-be1b-a5027d0e437c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:35.475488 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33fc1b4e-717d-492c-be1b-a5027d0e437c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:35.476752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33fc1b4e-717d-492c-be1b-a5027d0e437c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:35.477625 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33fc1b4e-717d-492c-be1b-a5027d0e437c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:35.478073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33fc1b4e-717d-492c-be1b-a5027d0e437c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:35.506438 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-540d9b63-959b-4720-ba6d-7d884f2cd19e req-d9e16aa5-a8c9-416c-a1f9-cde14c7e986b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eab8121-d5b0-469b-9004-a146355c4780", "name": "network-vif-deleted", "tag": "c5b1de0a-f0c8-4438-8eec-3851336a8975"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:49:35.517162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-540d9b63-959b-4720-ba6d-7d884f2cd19e req-d9e16aa5-a8c9-416c-a1f9-cde14c7e986b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:35.517964 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-540d9b63-959b-4720-ba6d-7d884f2cd19e req-d9e16aa5-a8c9-416c-a1f9-cde14c7e986b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:35.531251 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-540d9b63-959b-4720-ba6d-7d884f2cd19e req-d9e16aa5-a8c9-416c-a1f9-cde14c7e986b service nova] Creating event network-vif-deleted:c5b1de0a-f0c8-4438-8eec-3851336a8975 for instance 5eab8121-d5b0-469b-9004-a146355c4780 on n-h2-708768-8 Jul 26 20:49:35.536857 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-540d9b63-959b-4720-ba6d-7d884f2cd19e req-d9e16aa5-a8c9-416c-a1f9-cde14c7e986b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033972 Jul 26 20:49:35.537474 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3653/7225] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:49:35.554590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-33fc1b4e-717d-492c-be1b-a5027d0e437c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c37a6e94cb241d48d52d1b4af7e359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af17484fbafb4e9b85d49a463933e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:35.563038 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-33fc1b4e-717d-492c-be1b-a5027d0e437c tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 200 len: 1512 microversion: 2.1 time: 0.099375 Jul 26 20:49:35.563717 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3573/7226] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:35 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:36.586335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:36.587054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] [instance: 5eab8121-d5b0-469b-9004-a146355c4780] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:36.593273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:36.593722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:36.594501 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:36.594936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:36.609065 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] HTTP exception thrown: Instance 5eab8121-d5b0-469b-9004-a146355c4780 could not be found. Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Request method failure captured: Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 HTTP/1.1 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FH0GHRauTnvWm0kjHQjafD3JFStrPn1qmX2xN47KkfKeISg9w5PrgqVjsbNSGzZ0SolsJ73H0UTQcCtj3UfEPOieyc95nIB7QEYH3uxMmEmizUvk_ScZYgAuDG-EDREEag8E7-zvC79QzHX-TiUzfMXIpSTncPTy4FV8Qnsi08f_oQ Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: af17484fbafb4e9b85d49a463933e298 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/af17484fbafb4e9b85d49a463933e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/af17484fbafb4e9b85d49a463933e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_af17484fbafb4e9b85d49a463933e298", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/af17484fbafb4e9b85d49a463933e298"}]}] Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: af17484fbafb4e9b85d49a463933e298 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestMinimumBasicScenario-186414633 Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestMinimumBasicScenario-186414633-project Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 1c37a6e94cb241d48d52d1b4af7e359c Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestMinimumBasicScenario-186414633-project Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 5eab8121-d5b0-469b-9004-a146355c4780 could not be found. Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '5eab8121-d5b0-469b-9004-a146355c4780'} Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eab8121-d5b0-469b-9004-a146355c4780 could not be found. Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eab8121-d5b0-469b-9004-a146355c4780 could not be found. Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:49:36.610678 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eab8121-d5b0-469b-9004-a146355c4780 could not be found. Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Returning 404 to user: Instance 5eab8121-d5b0-469b-9004-a146355c4780 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9474c8e2-5b22-4b55-bdfe-b24b5267807a tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780" status: 404 len: 111 microversion: 2.1 time: 0.031203 Jul 26 20:49:36.615642 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3654/7227] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:36 2022] GET /compute/v2.1/servers/5eab8121-d5b0-469b-9004-a146355c4780 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:49:36.621670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0a098414-ec78-460b-afb6-0b0b911d74b4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] Calling method '.version_select at 0x7f875f12b1f0>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:36.643242 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0a098414-ec78-460b-afb6-0b0b911d74b4 tempest-TestMinimumBasicScenario-186414633 tempest-TestMinimumBasicScenario-186414633-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1030065093" status: 202 len: 0 microversion: 2.1 time: 0.025295 Jul 26 20:49:36.643859 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3574/7228] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Jul 26 20:49:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1030065093 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:49:39.998313 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:49:39.998858 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 20:49:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:49:44.717054 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:49:44.717502 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:49:45.543113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5fbd3ec1-8254-4c04-91a4-725262002ba3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: .version_select at 0x7f8755f8d0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2097078279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBE1823pte/J8rTP8poemBRR2UX6sCKhvJ9fSDaZC7PUfPYuNXphZMxkf/WjLGugQgBfqBeU6AAaywOPC7zVSK8O1onpmKHX3whD8jE8TlkT6KQ6hFZPfXnKcnKfsAlbA=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:49:45.559971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5fbd3ec1-8254-4c04-91a4-725262002ba3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:49:45.565054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-5fbd3ec1-8254-4c04-91a4-725262002ba3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:49:45.595094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5fbd3ec1-8254-4c04-91a4-725262002ba3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.218895 Jul 26 20:49:45.596006 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3655/7229] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:49:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:51.335254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:49:51.335801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:49:51.340058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-868411602", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "bf15e9d2-d179-4e7d-8cb9-24d86fb23355"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2097078279", "security_groups": [{"name": "tempest-secgroup-smoke-344996850"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:49:51.464796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] validate_networks() for [('bf15e9d2-d179-4e7d-8cb9-24d86fb23355', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:49:52.013794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:49:52.015637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:49:52.018086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:49:52.018958 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:49:52.027198 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:49:52.044329 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:52.045211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:52.046576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:52.050272 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:52.074999 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:49:52.081971 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:49:52.101246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:49:52.104911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:49:52.168760 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-40859b91-74a0-4d01-ad30-94b31ec4ec16 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.835469 Jul 26 20:49:52.169772 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3575/7230] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:49:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:49:52.182387 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d7ff2fd-3994-4001-ae75-b49270fdff4f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:52.183021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0d7ff2fd-3994-4001-ae75-b49270fdff4f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:52.196076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:49:52.277495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0d7ff2fd-3994-4001-ae75-b49270fdff4f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:52.287638 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d7ff2fd-3994-4001-ae75-b49270fdff4f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1266 microversion: 2.1 time: 0.110549 Jul 26 20:49:52.289503 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3656/7231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:52 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:53.311285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f143cfc0-2f77-4bb0-9235-e2347153d12c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:53.312055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f143cfc0-2f77-4bb0-9235-e2347153d12c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:53.326060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f143cfc0-2f77-4bb0-9235-e2347153d12c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:53.326526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f143cfc0-2f77-4bb0-9235-e2347153d12c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:53.330549 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f143cfc0-2f77-4bb0-9235-e2347153d12c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:53.331255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f143cfc0-2f77-4bb0-9235-e2347153d12c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:53.522307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f143cfc0-2f77-4bb0-9235-e2347153d12c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:53.532299 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f143cfc0-2f77-4bb0-9235-e2347153d12c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1326 microversion: 2.1 time: 0.225705 Jul 26 20:49:53.532903 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3576/7232] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:53 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1326 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:49:54.556232 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2c774f8a-c347-4215-ac71-aec0729143fa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:54.557643 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2c774f8a-c347-4215-ac71-aec0729143fa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:54.560382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:49:54.566602 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c774f8a-c347-4215-ac71-aec0729143fa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:54.567324 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c774f8a-c347-4215-ac71-aec0729143fa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:54.568281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c774f8a-c347-4215-ac71-aec0729143fa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:54.568599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2c774f8a-c347-4215-ac71-aec0729143fa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:54.795012 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2c774f8a-c347-4215-ac71-aec0729143fa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:54.803623 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2c774f8a-c347-4215-ac71-aec0729143fa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1391 microversion: 2.1 time: 0.252639 Jul 26 20:49:54.804549 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3657/7233] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:54 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:54.987957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a73442e3-1814-4955-b267-3e7b0a4f36fc req-500f271c-42bf-4206-8d78-b9e184d2ea4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477b23db-0130-4829-a28b-50beee863dfb", "tag": "0a667a62-ef8b-416f-b6b9-f0ac05f89f94"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:49:54.998855 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a73442e3-1814-4955-b267-3e7b0a4f36fc req-500f271c-42bf-4206-8d78-b9e184d2ea4b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:54.999314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a73442e3-1814-4955-b267-3e7b0a4f36fc req-500f271c-42bf-4206-8d78-b9e184d2ea4b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:55.017171 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a73442e3-1814-4955-b267-3e7b0a4f36fc req-500f271c-42bf-4206-8d78-b9e184d2ea4b service nova] Creating event network-changed:0a667a62-ef8b-416f-b6b9-f0ac05f89f94 for instance 477b23db-0130-4829-a28b-50beee863dfb on n-h1-708768-8 Jul 26 20:49:55.023109 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a73442e3-1814-4955-b267-3e7b0a4f36fc req-500f271c-42bf-4206-8d78-b9e184d2ea4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038313 Jul 26 20:49:55.031906 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3577/7234] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:49:55.825883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-37f6e513-30e1-4617-a7e9-a4384dec9d11 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:55.826498 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-37f6e513-30e1-4617-a7e9-a4384dec9d11 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:55.833529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37f6e513-30e1-4617-a7e9-a4384dec9d11 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:55.833972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37f6e513-30e1-4617-a7e9-a4384dec9d11 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:55.834766 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37f6e513-30e1-4617-a7e9-a4384dec9d11 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:55.835205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-37f6e513-30e1-4617-a7e9-a4384dec9d11 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:55.963242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-37f6e513-30e1-4617-a7e9-a4384dec9d11 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:55.971122 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-37f6e513-30e1-4617-a7e9-a4384dec9d11 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1391 microversion: 2.1 time: 0.149193 Jul 26 20:49:55.971715 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3658/7235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:55 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1391 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:56.994278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4e81e1e0-671f-4d59-baf7-dd14fc604557 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:56.994898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4e81e1e0-671f-4d59-baf7-dd14fc604557 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:57.001537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e81e1e0-671f-4d59-baf7-dd14fc604557 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:57.001998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e81e1e0-671f-4d59-baf7-dd14fc604557 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:57.002795 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e81e1e0-671f-4d59-baf7-dd14fc604557 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:57.003238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4e81e1e0-671f-4d59-baf7-dd14fc604557 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:57.134770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4e81e1e0-671f-4d59-baf7-dd14fc604557 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:57.142198 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4e81e1e0-671f-4d59-baf7-dd14fc604557 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1391 microversion: 2.1 time: 0.154392 Jul 26 20:49:57.142778 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3578/7236] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:56 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:58.165166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ceb60667-fc46-454b-b1c1-1cfca0b00afd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:58.165806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ceb60667-fc46-454b-b1c1-1cfca0b00afd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:58.172476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ceb60667-fc46-454b-b1c1-1cfca0b00afd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:58.172932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ceb60667-fc46-454b-b1c1-1cfca0b00afd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:58.173712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ceb60667-fc46-454b-b1c1-1cfca0b00afd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:58.174157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ceb60667-fc46-454b-b1c1-1cfca0b00afd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:58.312441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ceb60667-fc46-454b-b1c1-1cfca0b00afd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:58.320679 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ceb60667-fc46-454b-b1c1-1cfca0b00afd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1391 microversion: 2.1 time: 0.161575 Jul 26 20:49:58.321256 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3659/7237] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:58 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:49:59.341497 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2c3125be-4c12-4faf-b77e-d1d6937cf4d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:49:59.342100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2c3125be-4c12-4faf-b77e-d1d6937cf4d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:49:59.348946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c3125be-4c12-4faf-b77e-d1d6937cf4d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:59.349400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c3125be-4c12-4faf-b77e-d1d6937cf4d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:59.350340 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c3125be-4c12-4faf-b77e-d1d6937cf4d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:49:59.350827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2c3125be-4c12-4faf-b77e-d1d6937cf4d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:49:59.485883 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2c3125be-4c12-4faf-b77e-d1d6937cf4d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:49:59.493570 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2c3125be-4c12-4faf-b77e-d1d6937cf4d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1391 microversion: 2.1 time: 0.156137 Jul 26 20:49:59.494137 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3579/7238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:49:59 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:00.337575 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-ccb68ead-97be-47e7-accd-5cbee00e166d req-3e32f181-afeb-4323-a01c-bed89807f899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477b23db-0130-4829-a28b-50beee863dfb", "name": "network-vif-plugged", "status": "completed", "tag": "0a667a62-ef8b-416f-b6b9-f0ac05f89f94"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:00.347886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ccb68ead-97be-47e7-accd-5cbee00e166d req-3e32f181-afeb-4323-a01c-bed89807f899 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:00.348334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-ccb68ead-97be-47e7-accd-5cbee00e166d req-3e32f181-afeb-4323-a01c-bed89807f899 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:00.360245 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-ccb68ead-97be-47e7-accd-5cbee00e166d req-3e32f181-afeb-4323-a01c-bed89807f899 service nova] Creating event network-vif-plugged:0a667a62-ef8b-416f-b6b9-f0ac05f89f94 for instance 477b23db-0130-4829-a28b-50beee863dfb on n-h1-708768-8 Jul 26 20:50:00.365176 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-ccb68ead-97be-47e7-accd-5cbee00e166d req-3e32f181-afeb-4323-a01c-bed89807f899 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031371 Jul 26 20:50:00.366419 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3660/7239] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:50:00.514963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d45f0a5d-cbdb-4cbb-91e6-81932dcd09e9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:00.515581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d45f0a5d-cbdb-4cbb-91e6-81932dcd09e9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:00.523124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d45f0a5d-cbdb-4cbb-91e6-81932dcd09e9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:00.523588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d45f0a5d-cbdb-4cbb-91e6-81932dcd09e9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:00.524420 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d45f0a5d-cbdb-4cbb-91e6-81932dcd09e9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:00.524863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d45f0a5d-cbdb-4cbb-91e6-81932dcd09e9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:00.671100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d45f0a5d-cbdb-4cbb-91e6-81932dcd09e9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:00.679701 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d45f0a5d-cbdb-4cbb-91e6-81932dcd09e9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1391 microversion: 2.1 time: 0.168779 Jul 26 20:50:00.680283 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3580/7240] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:00 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:01.702553 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6c27136e-e8ac-417c-a73d-3f05502c9a2a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:01.703206 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6c27136e-e8ac-417c-a73d-3f05502c9a2a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:01.709580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c27136e-e8ac-417c-a73d-3f05502c9a2a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:01.710280 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c27136e-e8ac-417c-a73d-3f05502c9a2a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:01.711048 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c27136e-e8ac-417c-a73d-3f05502c9a2a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:01.711511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c27136e-e8ac-417c-a73d-3f05502c9a2a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:01.845841 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c27136e-e8ac-417c-a73d-3f05502c9a2a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:01.853962 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6c27136e-e8ac-417c-a73d-3f05502c9a2a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1563 microversion: 2.1 time: 0.156543 Jul 26 20:50:01.854528 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3661/7241] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:01 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:01.876465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a594f2fd-2d3b-4ab3-9799-6df36053e939 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:01.877087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a594f2fd-2d3b-4ab3-9799-6df36053e939 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:01.884096 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a594f2fd-2d3b-4ab3-9799-6df36053e939 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:01.884555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a594f2fd-2d3b-4ab3-9799-6df36053e939 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:01.885335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a594f2fd-2d3b-4ab3-9799-6df36053e939 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:01.885783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a594f2fd-2d3b-4ab3-9799-6df36053e939 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:02.026050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a594f2fd-2d3b-4ab3-9799-6df36053e939 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:02.034178 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a594f2fd-2d3b-4ab3-9799-6df36053e939 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1563 microversion: 2.1 time: 0.161593 Jul 26 20:50:02.034750 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3581/7242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:01 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:03.896174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45557862-a4fa-460b-bdd0-a374913bac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:03.901391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-fb3d9170-ae42-4098-a264-0fefdf654c62 req-360821f7-e1a6-41bc-a92d-8eb395e093db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477b23db-0130-4829-a28b-50beee863dfb", "tag": "0a667a62-ef8b-416f-b6b9-f0ac05f89f94"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:03.906307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:03.907021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:03.912295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45557862-a4fa-460b-bdd0-a374913bac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:03.914377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:03.920565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45557862-a4fa-460b-bdd0-a374913bac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:03.921016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45557862-a4fa-460b-bdd0-a374913bac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:03.921798 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45557862-a4fa-460b-bdd0-a374913bac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:03.922238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45557862-a4fa-460b-bdd0-a374913bac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:03.926512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fb3d9170-ae42-4098-a264-0fefdf654c62 req-360821f7-e1a6-41bc-a92d-8eb395e093db service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:03.926969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fb3d9170-ae42-4098-a264-0fefdf654c62 req-360821f7-e1a6-41bc-a92d-8eb395e093db service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:03.940039 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-fb3d9170-ae42-4098-a264-0fefdf654c62 req-360821f7-e1a6-41bc-a92d-8eb395e093db service nova] Creating event network-changed:0a667a62-ef8b-416f-b6b9-f0ac05f89f94 for instance 477b23db-0130-4829-a28b-50beee863dfb on n-h1-708768-8 Jul 26 20:50:03.945911 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-fb3d9170-ae42-4098-a264-0fefdf654c62 req-360821f7-e1a6-41bc-a92d-8eb395e093db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048041 Jul 26 20:50:03.946830 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3582/7243] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:50:04.171565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45557862-a4fa-460b-bdd0-a374913bac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:04.181751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45557862-a4fa-460b-bdd0-a374913bac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1563 microversion: 2.1 time: 0.289446 Jul 26 20:50:04.182641 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3662/7244] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:03 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1563 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:25.452648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:25.453521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=36 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:25.458106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d51db95-ff46-4d2d-a853-a75dbb07bcf5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:25.461437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1d51db95-ff46-4d2d-a853-a75dbb07bcf5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:25.468835 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d51db95-ff46-4d2d-a853-a75dbb07bcf5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:25.469300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d51db95-ff46-4d2d-a853-a75dbb07bcf5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:25.470076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d51db95-ff46-4d2d-a853-a75dbb07bcf5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:25.470524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d51db95-ff46-4d2d-a853-a75dbb07bcf5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:25.530085 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1d51db95-ff46-4d2d-a853-a75dbb07bcf5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action" status: 200 len: 24574 microversion: 2.1 time: 0.079258 Jul 26 20:50:25.530715 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3583/7245] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:50:25 2022] POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action => generated 24574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:50:36.582169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f88340c3-39f0-4755-8bdd-7c7a98707e54 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:36.582773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f88340c3-39f0-4755-8bdd-7c7a98707e54 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:36.584806 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=11 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:36.585519 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=32 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:36.591936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f88340c3-39f0-4755-8bdd-7c7a98707e54 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:36.592394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f88340c3-39f0-4755-8bdd-7c7a98707e54 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:36.593181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f88340c3-39f0-4755-8bdd-7c7a98707e54 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:36.593629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f88340c3-39f0-4755-8bdd-7c7a98707e54 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:36.659578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f88340c3-39f0-4755-8bdd-7c7a98707e54 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.081554 Jul 26 20:50:36.660243 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3663/7246] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:50:36 2022] POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:50:36.669870 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-58a8685c-c35a-4acd-af1f-69677653be67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:36.670579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-58a8685c-c35a-4acd-af1f-69677653be67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:36.673557 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:36.674233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:36.682459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58a8685c-c35a-4acd-af1f-69677653be67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:36.682920 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58a8685c-c35a-4acd-af1f-69677653be67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:36.683730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58a8685c-c35a-4acd-af1f-69677653be67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:36.684196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-58a8685c-c35a-4acd-af1f-69677653be67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:36.817755 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-58a8685c-c35a-4acd-af1f-69677653be67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:36.826565 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-58a8685c-c35a-4acd-af1f-69677653be67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1687 microversion: 2.1 time: 0.160963 Jul 26 20:50:36.827149 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3584/7247] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:36 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:50:37.850008 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-277a7f0f-dfba-4b0a-bd87-e24de812588d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:37.850720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-277a7f0f-dfba-4b0a-bd87-e24de812588d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:37.857905 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-277a7f0f-dfba-4b0a-bd87-e24de812588d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:37.858359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-277a7f0f-dfba-4b0a-bd87-e24de812588d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:37.859126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-277a7f0f-dfba-4b0a-bd87-e24de812588d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:37.859566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-277a7f0f-dfba-4b0a-bd87-e24de812588d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:37.992160 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-277a7f0f-dfba-4b0a-bd87-e24de812588d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:37.999726 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-277a7f0f-dfba-4b0a-bd87-e24de812588d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1667 microversion: 2.1 time: 0.154132 Jul 26 20:50:38.000300 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3664/7248] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:37 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:39.091781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7af2d103-df33-402c-9e50-cc473162d7fd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:39.093989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7af2d103-df33-402c-9e50-cc473162d7fd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:39.102474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7af2d103-df33-402c-9e50-cc473162d7fd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:39.102943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7af2d103-df33-402c-9e50-cc473162d7fd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:39.103777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7af2d103-df33-402c-9e50-cc473162d7fd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:39.104233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7af2d103-df33-402c-9e50-cc473162d7fd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:39.154016 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7af2d103-df33-402c-9e50-cc473162d7fd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action" status: 200 len: 32641 microversion: 2.1 time: 0.066105 Jul 26 20:50:39.154649 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3585/7249] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:50:39 2022] POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action => generated 32641 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:50:39.167078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1d4f6e5a-59c4-410f-b1ec-4f7d7ab14e20 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:39.167601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1d4f6e5a-59c4-410f-b1ec-4f7d7ab14e20 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:39.174485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d4f6e5a-59c4-410f-b1ec-4f7d7ab14e20 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:39.174939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d4f6e5a-59c4-410f-b1ec-4f7d7ab14e20 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:39.175730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d4f6e5a-59c4-410f-b1ec-4f7d7ab14e20 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:39.176169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1d4f6e5a-59c4-410f-b1ec-4f7d7ab14e20 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:39.242135 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1d4f6e5a-59c4-410f-b1ec-4f7d7ab14e20 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.078810 Jul 26 20:50:39.242782 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3665/7250] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:50:39 2022] POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:50:39.251810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-68f5a2bb-7bdf-4849-8bec-715264bfd68a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:39.252520 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-68f5a2bb-7bdf-4849-8bec-715264bfd68a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:39.260362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68f5a2bb-7bdf-4849-8bec-715264bfd68a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:39.260819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68f5a2bb-7bdf-4849-8bec-715264bfd68a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:39.261597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68f5a2bb-7bdf-4849-8bec-715264bfd68a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:39.262087 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-68f5a2bb-7bdf-4849-8bec-715264bfd68a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:39.404799 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-68f5a2bb-7bdf-4849-8bec-715264bfd68a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:39.417973 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-68f5a2bb-7bdf-4849-8bec-715264bfd68a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1674 microversion: 2.1 time: 0.170326 Jul 26 20:50:39.418553 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3586/7251] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:39 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:50:40.441775 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4694abf9-5e4f-4716-8c79-129bee3010c6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:40.442477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4694abf9-5e4f-4716-8c79-129bee3010c6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:40.453071 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4694abf9-5e4f-4716-8c79-129bee3010c6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:40.453521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4694abf9-5e4f-4716-8c79-129bee3010c6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:40.454286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4694abf9-5e4f-4716-8c79-129bee3010c6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:40.454722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4694abf9-5e4f-4716-8c79-129bee3010c6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:40.590988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4694abf9-5e4f-4716-8c79-129bee3010c6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:40.598439 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4694abf9-5e4f-4716-8c79-129bee3010c6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1682 microversion: 2.1 time: 0.161809 Jul 26 20:50:40.599001 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3666/7252] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:40 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:40.690892 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-087db306-a1fc-40bc-b9d8-116d67251181 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:40.693739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-087db306-a1fc-40bc-b9d8-116d67251181 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:40.701411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-087db306-a1fc-40bc-b9d8-116d67251181 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:40.702180 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-087db306-a1fc-40bc-b9d8-116d67251181 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:40.702949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-087db306-a1fc-40bc-b9d8-116d67251181 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:40.703398 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-087db306-a1fc-40bc-b9d8-116d67251181 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:40.751728 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-087db306-a1fc-40bc-b9d8-116d67251181 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action" status: 200 len: 38385 microversion: 2.1 time: 0.064512 Jul 26 20:50:40.752376 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3587/7253] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:50:40 2022] POST /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb/action => generated 38385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:50:41.730283 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cc804cd9-207f-4755-8abe-956e93883640 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:41.731739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc804cd9-207f-4755-8abe-956e93883640 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:41.733001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-fd3b8575-0a0e-4ed0-890b-f6dbf2f67095 req-d34623bc-464c-4e76-8523-afd876c90797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477b23db-0130-4829-a28b-50beee863dfb", "tag": "0a667a62-ef8b-416f-b6b9-f0ac05f89f94"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:41.739134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc804cd9-207f-4755-8abe-956e93883640 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:41.740503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc804cd9-207f-4755-8abe-956e93883640 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:41.741794 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc804cd9-207f-4755-8abe-956e93883640 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:41.742431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cc804cd9-207f-4755-8abe-956e93883640 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:41.744681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fd3b8575-0a0e-4ed0-890b-f6dbf2f67095 req-d34623bc-464c-4e76-8523-afd876c90797 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:41.745136 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-fd3b8575-0a0e-4ed0-890b-f6dbf2f67095 req-d34623bc-464c-4e76-8523-afd876c90797 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:41.757012 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-fd3b8575-0a0e-4ed0-890b-f6dbf2f67095 req-d34623bc-464c-4e76-8523-afd876c90797 service nova] Creating event network-changed:0a667a62-ef8b-416f-b6b9-f0ac05f89f94 for instance 477b23db-0130-4829-a28b-50beee863dfb on n-h1-708768-8 Jul 26 20:50:41.762158 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-fd3b8575-0a0e-4ed0-890b-f6dbf2f67095 req-d34623bc-464c-4e76-8523-afd876c90797 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033428 Jul 26 20:50:41.763108 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3588/7254] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:50:41.770325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cc804cd9-207f-4755-8abe-956e93883640 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:50:41.855329 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cc804cd9-207f-4755-8abe-956e93883640 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 204 len: 0 microversion: 2.1 time: 0.128597 Jul 26 20:50:41.856331 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3667/7255] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:50:41 2022] DELETE /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:50:41.865426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-849d8477-6a89-4e64-a0c3-1ac63744a28b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:41.866558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-849d8477-6a89-4e64-a0c3-1ac63744a28b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:41.873782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-849d8477-6a89-4e64-a0c3-1ac63744a28b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:41.874562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-849d8477-6a89-4e64-a0c3-1ac63744a28b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:41.875363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-849d8477-6a89-4e64-a0c3-1ac63744a28b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:41.875851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-849d8477-6a89-4e64-a0c3-1ac63744a28b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:42.014353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-849d8477-6a89-4e64-a0c3-1ac63744a28b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:42.022801 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-849d8477-6a89-4e64-a0c3-1ac63744a28b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1688 microversion: 2.1 time: 0.162106 Jul 26 20:50:42.023699 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3589/7256] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:41 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:43.046666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-db2fb23a-6bbe-4539-8ebd-0c7a92d82bb9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:43.047375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-db2fb23a-6bbe-4539-8ebd-0c7a92d82bb9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:43.055115 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db2fb23a-6bbe-4539-8ebd-0c7a92d82bb9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:43.055568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db2fb23a-6bbe-4539-8ebd-0c7a92d82bb9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:43.056358 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db2fb23a-6bbe-4539-8ebd-0c7a92d82bb9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:43.057050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-db2fb23a-6bbe-4539-8ebd-0c7a92d82bb9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:43.204939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-db2fb23a-6bbe-4539-8ebd-0c7a92d82bb9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:43.212751 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-db2fb23a-6bbe-4539-8ebd-0c7a92d82bb9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1688 microversion: 2.1 time: 0.170392 Jul 26 20:50:43.213312 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3668/7257] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:43 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:44.235514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-39cbf2fd-38a8-4b72-bae2-bae784bb491c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:44.236196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-39cbf2fd-38a8-4b72-bae2-bae784bb491c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:44.243438 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39cbf2fd-38a8-4b72-bae2-bae784bb491c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:44.243928 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39cbf2fd-38a8-4b72-bae2-bae784bb491c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:44.244708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39cbf2fd-38a8-4b72-bae2-bae784bb491c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:44.245154 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-39cbf2fd-38a8-4b72-bae2-bae784bb491c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:44.294046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-3299b9bf-708e-4d38-90cc-41d78a6c0d71 req-21173164-8258-424e-be57-e2f0423114bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477b23db-0130-4829-a28b-50beee863dfb", "name": "network-vif-deleted", "tag": "0a667a62-ef8b-416f-b6b9-f0ac05f89f94"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:44.305485 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3299b9bf-708e-4d38-90cc-41d78a6c0d71 req-21173164-8258-424e-be57-e2f0423114bf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:44.305827 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-3299b9bf-708e-4d38-90cc-41d78a6c0d71 req-21173164-8258-424e-be57-e2f0423114bf service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:44.311576 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-39cbf2fd-38a8-4b72-bae2-bae784bb491c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:44.319149 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-3299b9bf-708e-4d38-90cc-41d78a6c0d71 req-21173164-8258-424e-be57-e2f0423114bf service nova] Creating event network-vif-deleted:0a667a62-ef8b-416f-b6b9-f0ac05f89f94 for instance 477b23db-0130-4829-a28b-50beee863dfb on n-h1-708768-8 Jul 26 20:50:44.321178 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-39cbf2fd-38a8-4b72-bae2-bae784bb491c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 200 len: 1502 microversion: 2.1 time: 0.090619 Jul 26 20:50:44.323743 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3590/7258] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:44 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 1502 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:44.324178 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-3299b9bf-708e-4d38-90cc-41d78a6c0d71 req-21173164-8258-424e-be57-e2f0423114bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033764 Jul 26 20:50:44.324775 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3669/7259] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:50:45.342318 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:45.342956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 477b23db-0130-4829-a28b-50beee863dfb] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:45.350000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:45.350465 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:45.351244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:45.351727 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:45.364975 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] HTTP exception thrown: Instance 477b23db-0130-4829-a28b-50beee863dfb could not be found. Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Request method failure captured: Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb HTTP/1.1 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FNoxa1srlcvH6r_yC7S2A1Gpmd7eRmaEPJLohqg5KwlBmToGSscey-8jKCumBHfCYTXvguGGlopnfORkXL6tF-VV_3Wx74xjuSG8Xyn2a44PloGF7Fy20kjidPR73Z1sde9RoW9DtFMWfc1zl2jD8ktKip3Ix8reW1kLveuLT8Psaw Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f9b9fa87c564bfc827b8ef31ecd2309", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}] Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7dbc7e95221342da8d288a98b4cb4bee Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 477b23db-0130-4829-a28b-50beee863dfb could not be found. Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '477b23db-0130-4829-a28b-50beee863dfb'} Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477b23db-0130-4829-a28b-50beee863dfb could not be found. Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477b23db-0130-4829-a28b-50beee863dfb could not be found. Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:50:45.366640 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477b23db-0130-4829-a28b-50beee863dfb could not be found. Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Returning 404 to user: Instance 477b23db-0130-4829-a28b-50beee863dfb could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-47b34d8d-5490-455d-86f4-b4f6bb928148 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb" status: 404 len: 111 microversion: 2.1 time: 0.029664 Jul 26 20:50:45.370983 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3591/7260] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:45 2022] GET /compute/v2.1/servers/477b23db-0130-4829-a28b-50beee863dfb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:50:48.603458 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2f38853a-b0ea-4a54-924f-2b31cac1568a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '.version_select at 0x7f8755f8d940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:48.636023 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2f38853a-b0ea-4a54-924f-2b31cac1568a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2097078279" status: 202 len: 0 microversion: 2.1 time: 0.038401 Jul 26 20:50:48.636626 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3670/7261] 10.222.0.58 () {58 vars in 1284 bytes} [Tue Jul 26 20:50:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2097078279 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:50:48.667724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ccb359df-ac26-4cea-8e74-d99659fafad4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: .version_select at 0x7f875c783af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-830840724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/U3XrYFLCQBp1mTApXr4wGsr5+sZw3HqH+hcHbx2nq20k59vDzWed2MCflaaU9VKAPLIibAdCFKqVGYbN40VpdZel+O++J7l8PrCnzyQ4nlgsYGah4dgfX/P5kr2rl4g=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:48.683888 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ccb359df-ac26-4cea-8e74-d99659fafad4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:50:48.689984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-ccb359df-ac26-4cea-8e74-d99659fafad4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:50:48.713151 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ccb359df-ac26-4cea-8e74-d99659fafad4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049529 Jul 26 20:50:48.713737 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3592/7262] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:50:48 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:50:54.529480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-344261600", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "40996139-f2f0-4f50-887c-83da829a6610"}], "key_name": "tempest-TestNetworkAdvancedServerOps-830840724", "security_groups": [{"name": "tempest-secgroup-smoke-1537293174"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:54.549060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:54.670090 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] validate_networks() for [('40996139-f2f0-4f50-887c-83da829a6610', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:50:55.079247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:50:55.079795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:50:55.080265 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:50:55.080687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:50:55.081111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:50:55.090875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:55.091330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:55.092173 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:55.092620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:55.110621 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:50:55.116211 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:50:55.128593 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:50:55.131804 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:50:55.181269 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d936fb5e-daeb-4471-be84-72349d021dd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.655834 Jul 26 20:50:55.182391 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3671/7263] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:50:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:50:55.195482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a35722c5-ab6b-4ef4-8c11-0e99f03203f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:55.196273 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a35722c5-ab6b-4ef4-8c11-0e99f03203f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:55.256040 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a35722c5-ab6b-4ef4-8c11-0e99f03203f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:55.279764 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a35722c5-ab6b-4ef4-8c11-0e99f03203f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1265 microversion: 2.1 time: 0.074481 Jul 26 20:50:55.280459 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3593/7264] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:55 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:56.302791 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8a48e084-c6f7-45e3-9c85-acb5e7d0e93a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:56.304079 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8a48e084-c6f7-45e3-9c85-acb5e7d0e93a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:56.323178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a48e084-c6f7-45e3-9c85-acb5e7d0e93a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:56.323526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a48e084-c6f7-45e3-9c85-acb5e7d0e93a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:56.324681 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a48e084-c6f7-45e3-9c85-acb5e7d0e93a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:56.325125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8a48e084-c6f7-45e3-9c85-acb5e7d0e93a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:56.425572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8a48e084-c6f7-45e3-9c85-acb5e7d0e93a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:56.435959 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8a48e084-c6f7-45e3-9c85-acb5e7d0e93a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1325 microversion: 2.1 time: 0.138452 Jul 26 20:50:56.436736 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3672/7265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:56 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1325 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:57.471911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c280d80a-494e-45da-9020-aee9c7adb825 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:57.472736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c280d80a-494e-45da-9020-aee9c7adb825 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:57.477197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=36 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:50:57.495963 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c280d80a-494e-45da-9020-aee9c7adb825 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:57.496445 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c280d80a-494e-45da-9020-aee9c7adb825 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:57.497380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c280d80a-494e-45da-9020-aee9c7adb825 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:57.497708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c280d80a-494e-45da-9020-aee9c7adb825 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:57.685960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c280d80a-494e-45da-9020-aee9c7adb825 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:57.700182 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c280d80a-494e-45da-9020-aee9c7adb825 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1391 microversion: 2.1 time: 0.242850 Jul 26 20:50:57.700777 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3594/7266] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:57 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1391 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:57.885595 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4b006742-2ead-4452-84ae-f637c1deb77f req-f5af4a52-d916-4559-a65c-552ac842501d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3819f20c-eb01-4f07-9b66-60d3d3b1f52e", "tag": "1a0ca537-c942-4489-ae75-c0afca00e694"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:50:57.899026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4b006742-2ead-4452-84ae-f637c1deb77f req-f5af4a52-d916-4559-a65c-552ac842501d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:57.902007 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4b006742-2ead-4452-84ae-f637c1deb77f req-f5af4a52-d916-4559-a65c-552ac842501d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:57.920478 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4b006742-2ead-4452-84ae-f637c1deb77f req-f5af4a52-d916-4559-a65c-552ac842501d service nova] Creating event network-changed:1a0ca537-c942-4489-ae75-c0afca00e694 for instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e on n-h1-708768-8 Jul 26 20:50:57.925874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4b006742-2ead-4452-84ae-f637c1deb77f req-f5af4a52-d916-4559-a65c-552ac842501d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043938 Jul 26 20:50:57.926811 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3673/7267] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:50:58.721948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a6426b1f-58a9-4d49-ac78-7304460a3c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:58.722582 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a6426b1f-58a9-4d49-ac78-7304460a3c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:58.730248 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6426b1f-58a9-4d49-ac78-7304460a3c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:58.730719 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6426b1f-58a9-4d49-ac78-7304460a3c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:58.731531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6426b1f-58a9-4d49-ac78-7304460a3c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:58.732011 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a6426b1f-58a9-4d49-ac78-7304460a3c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:58.867524 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a6426b1f-58a9-4d49-ac78-7304460a3c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:50:58.876424 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a6426b1f-58a9-4d49-ac78-7304460a3c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1391 microversion: 2.1 time: 0.158181 Jul 26 20:50:58.877016 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3595/7268] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:58 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:50:59.899425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-24d956cf-9e81-4bac-a184-bd2c5d8f21d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:50:59.900161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-24d956cf-9e81-4bac-a184-bd2c5d8f21d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:50:59.906481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24d956cf-9e81-4bac-a184-bd2c5d8f21d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:59.906936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24d956cf-9e81-4bac-a184-bd2c5d8f21d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:50:59.907734 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24d956cf-9e81-4bac-a184-bd2c5d8f21d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:50:59.908181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-24d956cf-9e81-4bac-a184-bd2c5d8f21d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:00.042162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-24d956cf-9e81-4bac-a184-bd2c5d8f21d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:00.049793 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-24d956cf-9e81-4bac-a184-bd2c5d8f21d7 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1391 microversion: 2.1 time: 0.156201 Jul 26 20:51:00.050370 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3674/7269] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:50:59 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:01.072177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-06faf71f-acfc-43da-b66e-8e4c52bc3e06 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:01.072801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-06faf71f-acfc-43da-b66e-8e4c52bc3e06 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:01.079548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06faf71f-acfc-43da-b66e-8e4c52bc3e06 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:01.080047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06faf71f-acfc-43da-b66e-8e4c52bc3e06 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:01.080820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06faf71f-acfc-43da-b66e-8e4c52bc3e06 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:01.081263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-06faf71f-acfc-43da-b66e-8e4c52bc3e06 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:01.214689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-06faf71f-acfc-43da-b66e-8e4c52bc3e06 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:01.222108 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-06faf71f-acfc-43da-b66e-8e4c52bc3e06 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1391 microversion: 2.1 time: 0.154500 Jul 26 20:51:01.222686 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3596/7270] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:01 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:02.243109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-61dbfd7f-1b14-4e32-bf39-091d4f590040 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:02.243753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-61dbfd7f-1b14-4e32-bf39-091d4f590040 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:02.250679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61dbfd7f-1b14-4e32-bf39-091d4f590040 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:02.251131 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61dbfd7f-1b14-4e32-bf39-091d4f590040 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:02.252043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61dbfd7f-1b14-4e32-bf39-091d4f590040 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:02.252479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-61dbfd7f-1b14-4e32-bf39-091d4f590040 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:02.387374 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-61dbfd7f-1b14-4e32-bf39-091d4f590040 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:02.394983 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-61dbfd7f-1b14-4e32-bf39-091d4f590040 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1391 microversion: 2.1 time: 0.155854 Jul 26 20:51:02.396185 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3675/7271] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:02 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:02.684814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5cde7435-5ffc-4aa9-bc8e-d0196fc0f845 req-37553db0-2092-4b30-bfd7-7c79e35c7633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3819f20c-eb01-4f07-9b66-60d3d3b1f52e", "name": "network-vif-plugged", "status": "completed", "tag": "1a0ca537-c942-4489-ae75-c0afca00e694"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:51:02.696043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cde7435-5ffc-4aa9-bc8e-d0196fc0f845 req-37553db0-2092-4b30-bfd7-7c79e35c7633 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:02.697952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5cde7435-5ffc-4aa9-bc8e-d0196fc0f845 req-37553db0-2092-4b30-bfd7-7c79e35c7633 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:02.707724 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5cde7435-5ffc-4aa9-bc8e-d0196fc0f845 req-37553db0-2092-4b30-bfd7-7c79e35c7633 service nova] Creating event network-vif-plugged:1a0ca537-c942-4489-ae75-c0afca00e694 for instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e on n-h1-708768-8 Jul 26 20:51:02.713380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5cde7435-5ffc-4aa9-bc8e-d0196fc0f845 req-37553db0-2092-4b30-bfd7-7c79e35c7633 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032590 Jul 26 20:51:02.713987 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3597/7272] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:51:03.416818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6c6eea65-bf0c-4c77-b0b3-73f822fa3f3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:03.417431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6c6eea65-bf0c-4c77-b0b3-73f822fa3f3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:03.424385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c6eea65-bf0c-4c77-b0b3-73f822fa3f3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:03.424833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c6eea65-bf0c-4c77-b0b3-73f822fa3f3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:03.425590 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c6eea65-bf0c-4c77-b0b3-73f822fa3f3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:03.426024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6c6eea65-bf0c-4c77-b0b3-73f822fa3f3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:03.560731 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6c6eea65-bf0c-4c77-b0b3-73f822fa3f3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:03.568255 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6c6eea65-bf0c-4c77-b0b3-73f822fa3f3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1391 microversion: 2.1 time: 0.155276 Jul 26 20:51:03.568834 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3676/7273] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:03 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:51:04.590591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e0fea848-284c-49e0-b113-bb1c588f96d1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:04.591305 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e0fea848-284c-49e0-b113-bb1c588f96d1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:04.597508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0fea848-284c-49e0-b113-bb1c588f96d1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:04.597967 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0fea848-284c-49e0-b113-bb1c588f96d1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:04.598818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0fea848-284c-49e0-b113-bb1c588f96d1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:04.599492 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e0fea848-284c-49e0-b113-bb1c588f96d1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:04.729906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e0fea848-284c-49e0-b113-bb1c588f96d1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:04.737421 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e0fea848-284c-49e0-b113-bb1c588f96d1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1562 microversion: 2.1 time: 0.152106 Jul 26 20:51:04.737994 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3598/7274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:04 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:04.838295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6c45506-f665-45af-9af7-1a3c6c1b5639 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:04.838833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b6c45506-f665-45af-9af7-1a3c6c1b5639 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:04.845487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6c45506-f665-45af-9af7-1a3c6c1b5639 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:04.845936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6c45506-f665-45af-9af7-1a3c6c1b5639 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:04.846693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6c45506-f665-45af-9af7-1a3c6c1b5639 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:04.847126 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6c45506-f665-45af-9af7-1a3c6c1b5639 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:04.977637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b6c45506-f665-45af-9af7-1a3c6c1b5639 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:04.985094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b6c45506-f665-45af-9af7-1a3c6c1b5639 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1562 microversion: 2.1 time: 0.150800 Jul 26 20:51:04.985662 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3677/7275] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:04 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:06.687791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-082c2b35-cda6-46a3-af66-6d969f3ac57e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:06.689089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-082c2b35-cda6-46a3-af66-6d969f3ac57e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:06.689486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2b7e731b-69a7-4866-ba45-079760d6df42 req-62eb05d3-20b4-4c76-8049-cf13d6b2c2ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3819f20c-eb01-4f07-9b66-60d3d3b1f52e", "tag": "1a0ca537-c942-4489-ae75-c0afca00e694"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:51:06.691278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:06.693637 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:06.700301 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-082c2b35-cda6-46a3-af66-6d969f3ac57e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:06.700948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-082c2b35-cda6-46a3-af66-6d969f3ac57e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:06.701916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-082c2b35-cda6-46a3-af66-6d969f3ac57e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:06.702158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:06.702531 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-082c2b35-cda6-46a3-af66-6d969f3ac57e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:06.703229 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:06.705093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:06.709161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2b7e731b-69a7-4866-ba45-079760d6df42 req-62eb05d3-20b4-4c76-8049-cf13d6b2c2ab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:06.709497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2b7e731b-69a7-4866-ba45-079760d6df42 req-62eb05d3-20b4-4c76-8049-cf13d6b2c2ab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:06.727344 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2b7e731b-69a7-4866-ba45-079760d6df42 req-62eb05d3-20b4-4c76-8049-cf13d6b2c2ab service nova] Creating event network-changed:1a0ca537-c942-4489-ae75-c0afca00e694 for instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e on n-h1-708768-8 Jul 26 20:51:06.733767 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2b7e731b-69a7-4866-ba45-079760d6df42 req-62eb05d3-20b4-4c76-8049-cf13d6b2c2ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047525 Jul 26 20:51:06.734564 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3678/7276] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:51:06.855359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-082c2b35-cda6-46a3-af66-6d969f3ac57e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:06.864071 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-082c2b35-cda6-46a3-af66-6d969f3ac57e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1562 microversion: 2.1 time: 0.180387 Jul 26 20:51:06.865879 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3599/7277] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:06 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1562 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:28.120571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7eca25d4-a03a-404c-b9e5-c6db5d7b0d18 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:51:28.122821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7eca25d4-a03a-404c-b9e5-c6db5d7b0d18 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:28.125819 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=36 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:28.132996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7eca25d4-a03a-404c-b9e5-c6db5d7b0d18 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:28.133440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7eca25d4-a03a-404c-b9e5-c6db5d7b0d18 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:28.134200 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7eca25d4-a03a-404c-b9e5-c6db5d7b0d18 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:28.134629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7eca25d4-a03a-404c-b9e5-c6db5d7b0d18 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:28.195525 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7eca25d4-a03a-404c-b9e5-c6db5d7b0d18 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e/action" status: 200 len: 24571 microversion: 2.1 time: 0.078978 Jul 26 20:51:28.196204 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3679/7278] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:51:28 2022] POST /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e/action => generated 24571 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:51:39.229682 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-437e044a-dca6-4a9c-bb97-5fd3672a6fbf tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:51:39.231933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-437e044a-dca6-4a9c-bb97-5fd3672a6fbf tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:39.234163 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:39.234827 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=32 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:39.240598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-437e044a-dca6-4a9c-bb97-5fd3672a6fbf tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:39.241630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-437e044a-dca6-4a9c-bb97-5fd3672a6fbf tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:39.242455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-437e044a-dca6-4a9c-bb97-5fd3672a6fbf tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:39.242910 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-437e044a-dca6-4a9c-bb97-5fd3672a6fbf tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:39.314821 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-437e044a-dca6-4a9c-bb97-5fd3672a6fbf tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e/action" status: 202 len: 0 microversion: 2.1 time: 0.089230 Jul 26 20:51:39.315377 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3600/7279] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:51:39 2022] POST /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:51:39.324981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad2c0b5b-f914-4002-a948-917b035720e4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:39.325688 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad2c0b5b-f914-4002-a948-917b035720e4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:39.328369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:39.329512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:51:39.336077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad2c0b5b-f914-4002-a948-917b035720e4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:39.336666 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad2c0b5b-f914-4002-a948-917b035720e4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:39.337560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad2c0b5b-f914-4002-a948-917b035720e4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:39.338199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad2c0b5b-f914-4002-a948-917b035720e4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:39.516550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ad2c0b5b-f914-4002-a948-917b035720e4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:39.524385 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad2c0b5b-f914-4002-a948-917b035720e4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1673 microversion: 2.1 time: 0.203879 Jul 26 20:51:39.524995 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3680/7280] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:39 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:40.548106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ceff607d-3b94-4fd3-b517-b3bc3c1148b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:40.548824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ceff607d-3b94-4fd3-b517-b3bc3c1148b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:40.555240 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ceff607d-3b94-4fd3-b517-b3bc3c1148b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:40.555730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ceff607d-3b94-4fd3-b517-b3bc3c1148b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:40.556511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ceff607d-3b94-4fd3-b517-b3bc3c1148b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:40.556961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ceff607d-3b94-4fd3-b517-b3bc3c1148b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:40.695866 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ceff607d-3b94-4fd3-b517-b3bc3c1148b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:40.703349 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ceff607d-3b94-4fd3-b517-b3bc3c1148b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.160626 Jul 26 20:51:40.703978 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3601/7281] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:40 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:41.723987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-25b41994-e0fc-4399-ada4-32603c58908b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:41.724599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-25b41994-e0fc-4399-ada4-32603c58908b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:41.732208 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25b41994-e0fc-4399-ada4-32603c58908b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:41.732656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25b41994-e0fc-4399-ada4-32603c58908b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:41.733407 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25b41994-e0fc-4399-ada4-32603c58908b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:41.733846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-25b41994-e0fc-4399-ada4-32603c58908b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:41.863968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-25b41994-e0fc-4399-ada4-32603c58908b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:41.871638 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-25b41994-e0fc-4399-ada4-32603c58908b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.151578 Jul 26 20:51:41.872207 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3681/7282] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:41 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:42.893800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6f560bf4-4813-474f-a065-3556a598916a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:42.894425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6f560bf4-4813-474f-a065-3556a598916a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:42.902017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f560bf4-4813-474f-a065-3556a598916a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:42.902480 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f560bf4-4813-474f-a065-3556a598916a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:42.903263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f560bf4-4813-474f-a065-3556a598916a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:42.903754 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6f560bf4-4813-474f-a065-3556a598916a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:43.033629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6f560bf4-4813-474f-a065-3556a598916a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:43.041868 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6f560bf4-4813-474f-a065-3556a598916a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.151956 Jul 26 20:51:43.042445 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3602/7283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:42 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:44.062750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c4e11ae2-079f-41a3-bb1c-9bc2b5820996 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:44.063408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c4e11ae2-079f-41a3-bb1c-9bc2b5820996 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:44.070425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4e11ae2-079f-41a3-bb1c-9bc2b5820996 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:44.070876 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4e11ae2-079f-41a3-bb1c-9bc2b5820996 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:44.071673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4e11ae2-079f-41a3-bb1c-9bc2b5820996 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:44.072116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4e11ae2-079f-41a3-bb1c-9bc2b5820996 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:44.205221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c4e11ae2-079f-41a3-bb1c-9bc2b5820996 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:44.212990 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c4e11ae2-079f-41a3-bb1c-9bc2b5820996 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.154152 Jul 26 20:51:44.213572 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3682/7284] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:44 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:45.235063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c613f0c7-d863-4c57-b27e-cd356fbf205a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:45.235707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c613f0c7-d863-4c57-b27e-cd356fbf205a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:45.242724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c613f0c7-d863-4c57-b27e-cd356fbf205a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:45.243177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c613f0c7-d863-4c57-b27e-cd356fbf205a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:45.243985 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c613f0c7-d863-4c57-b27e-cd356fbf205a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:45.244427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c613f0c7-d863-4c57-b27e-cd356fbf205a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:45.379687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c613f0c7-d863-4c57-b27e-cd356fbf205a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:45.388067 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c613f0c7-d863-4c57-b27e-cd356fbf205a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.156826 Jul 26 20:51:45.388633 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3603/7285] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:45 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:46.409860 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8f0b24cf-37fb-4b15-af8a-5c05d6d0ec0b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:46.410423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8f0b24cf-37fb-4b15-af8a-5c05d6d0ec0b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:46.417802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f0b24cf-37fb-4b15-af8a-5c05d6d0ec0b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:46.418253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f0b24cf-37fb-4b15-af8a-5c05d6d0ec0b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:46.419025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f0b24cf-37fb-4b15-af8a-5c05d6d0ec0b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:46.419467 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8f0b24cf-37fb-4b15-af8a-5c05d6d0ec0b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:46.552900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8f0b24cf-37fb-4b15-af8a-5c05d6d0ec0b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:46.561697 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8f0b24cf-37fb-4b15-af8a-5c05d6d0ec0b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.155814 Jul 26 20:51:46.562305 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3683/7286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:46 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:47.584195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bb5c7cb2-36e4-4f9f-a741-74e35ecf951f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:47.584814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bb5c7cb2-36e4-4f9f-a741-74e35ecf951f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:47.591485 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb5c7cb2-36e4-4f9f-a741-74e35ecf951f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:47.591989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb5c7cb2-36e4-4f9f-a741-74e35ecf951f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:47.592757 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb5c7cb2-36e4-4f9f-a741-74e35ecf951f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:47.593202 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bb5c7cb2-36e4-4f9f-a741-74e35ecf951f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:47.725696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bb5c7cb2-36e4-4f9f-a741-74e35ecf951f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:47.733475 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bb5c7cb2-36e4-4f9f-a741-74e35ecf951f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.153350 Jul 26 20:51:47.734054 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3604/7287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:47 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:48.755954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-edfaff05-ddae-48aa-bad0-bdfcccc76a07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:48.756572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-edfaff05-ddae-48aa-bad0-bdfcccc76a07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:48.764017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edfaff05-ddae-48aa-bad0-bdfcccc76a07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:48.764473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edfaff05-ddae-48aa-bad0-bdfcccc76a07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:48.765295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edfaff05-ddae-48aa-bad0-bdfcccc76a07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:48.765758 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-edfaff05-ddae-48aa-bad0-bdfcccc76a07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:48.900204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-edfaff05-ddae-48aa-bad0-bdfcccc76a07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:48.907707 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-edfaff05-ddae-48aa-bad0-bdfcccc76a07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.155744 Jul 26 20:51:48.908290 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3684/7288] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:48 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:49.929085 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-76980467-c5dd-436c-af20-ed9afde506eb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:49.930210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-76980467-c5dd-436c-af20-ed9afde506eb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:49.937489 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76980467-c5dd-436c-af20-ed9afde506eb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:49.937957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76980467-c5dd-436c-af20-ed9afde506eb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:49.938738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76980467-c5dd-436c-af20-ed9afde506eb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:49.939192 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76980467-c5dd-436c-af20-ed9afde506eb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:50.069797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-76980467-c5dd-436c-af20-ed9afde506eb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:50.077478 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-76980467-c5dd-436c-af20-ed9afde506eb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.152461 Jul 26 20:51:50.078050 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3605/7289] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:49 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:51.098623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a5b899bd-04f7-40aa-9dde-30d245c78b9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:51.099247 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a5b899bd-04f7-40aa-9dde-30d245c78b9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:51.106792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5b899bd-04f7-40aa-9dde-30d245c78b9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:51.107246 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5b899bd-04f7-40aa-9dde-30d245c78b9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:51.108049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5b899bd-04f7-40aa-9dde-30d245c78b9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:51.108493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a5b899bd-04f7-40aa-9dde-30d245c78b9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:51.240756 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a5b899bd-04f7-40aa-9dde-30d245c78b9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:51.248369 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a5b899bd-04f7-40aa-9dde-30d245c78b9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.153703 Jul 26 20:51:51.248954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3685/7290] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:51 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:52.269671 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2430f9e8-0ce7-4e5a-9cb0-acc8051699f5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:52.270314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2430f9e8-0ce7-4e5a-9cb0-acc8051699f5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:52.277814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2430f9e8-0ce7-4e5a-9cb0-acc8051699f5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:52.278213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2430f9e8-0ce7-4e5a-9cb0-acc8051699f5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:52.278982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2430f9e8-0ce7-4e5a-9cb0-acc8051699f5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:52.279426 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2430f9e8-0ce7-4e5a-9cb0-acc8051699f5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:52.412796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2430f9e8-0ce7-4e5a-9cb0-acc8051699f5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:52.420855 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2430f9e8-0ce7-4e5a-9cb0-acc8051699f5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.155039 Jul 26 20:51:52.421435 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3606/7291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:52 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:53.443054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-889409b1-d453-4414-a8e6-68e88c45273f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:53.443633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-889409b1-d453-4414-a8e6-68e88c45273f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:53.451213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-889409b1-d453-4414-a8e6-68e88c45273f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:53.451708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-889409b1-d453-4414-a8e6-68e88c45273f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:53.452484 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-889409b1-d453-4414-a8e6-68e88c45273f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:53.452928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-889409b1-d453-4414-a8e6-68e88c45273f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:53.586521 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-889409b1-d453-4414-a8e6-68e88c45273f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:53.594278 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-889409b1-d453-4414-a8e6-68e88c45273f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.155203 Jul 26 20:51:53.594856 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3686/7292] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:53 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:54.615853 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4ed860c1-7665-4633-8874-a7b64d7a2d8e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:54.616481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4ed860c1-7665-4633-8874-a7b64d7a2d8e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:54.623477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ed860c1-7665-4633-8874-a7b64d7a2d8e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:54.623965 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ed860c1-7665-4633-8874-a7b64d7a2d8e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:54.624739 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ed860c1-7665-4633-8874-a7b64d7a2d8e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:54.625188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4ed860c1-7665-4633-8874-a7b64d7a2d8e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:54.759841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4ed860c1-7665-4633-8874-a7b64d7a2d8e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:54.767886 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4ed860c1-7665-4633-8874-a7b64d7a2d8e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.155930 Jul 26 20:51:54.768462 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3607/7293] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:54 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:55.789015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1a8adbd9-650c-4918-a3a1-39c15b98be1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:55.789604 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1a8adbd9-650c-4918-a3a1-39c15b98be1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:55.797235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a8adbd9-650c-4918-a3a1-39c15b98be1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:55.797691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a8adbd9-650c-4918-a3a1-39c15b98be1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:55.798518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a8adbd9-650c-4918-a3a1-39c15b98be1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:55.798959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1a8adbd9-650c-4918-a3a1-39c15b98be1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:55.939991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1a8adbd9-650c-4918-a3a1-39c15b98be1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:55.947763 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1a8adbd9-650c-4918-a3a1-39c15b98be1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1678 microversion: 2.1 time: 0.162733 Jul 26 20:51:55.948346 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3687/7294] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:55 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:51:56.970344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0ab3dee-9062-42ef-879f-6c61ec7b367d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:51:56.970975 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0ab3dee-9062-42ef-879f-6c61ec7b367d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:51:56.978764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ab3dee-9062-42ef-879f-6c61ec7b367d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:56.979227 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ab3dee-9062-42ef-879f-6c61ec7b367d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:56.980064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ab3dee-9062-42ef-879f-6c61ec7b367d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:51:56.980518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0ab3dee-9062-42ef-879f-6c61ec7b367d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:51:57.113525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0ab3dee-9062-42ef-879f-6c61ec7b367d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:51:57.121881 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0ab3dee-9062-42ef-879f-6c61ec7b367d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1681 microversion: 2.1 time: 0.155512 Jul 26 20:51:57.122462 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3608/7295] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:51:56 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:21.311258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d857bbb-f603-4559-8e53-0207d9681176 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:52:21.313385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0d857bbb-f603-4559-8e53-0207d9681176 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:21.315985 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=16 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:21.316646 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=48 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:21.323002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d857bbb-f603-4559-8e53-0207d9681176 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:21.323461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d857bbb-f603-4559-8e53-0207d9681176 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:21.324273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d857bbb-f603-4559-8e53-0207d9681176 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:21.324716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d857bbb-f603-4559-8e53-0207d9681176 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:21.379358 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d857bbb-f603-4559-8e53-0207d9681176 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e/action" status: 200 len: 68920 microversion: 2.1 time: 0.072325 Jul 26 20:52:21.380142 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3688/7296] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:52:21 2022] POST /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e/action => generated 68920 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:52:28.528798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bd8088b-1f9b-4c4a-a0ce-0a4f87abcc85 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:28.529335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0bd8088b-1f9b-4c4a-a0ce-0a4f87abcc85 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:28.531065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c56c3e9a-a988-4a81-9d31-2891960e7264 req-399660b8-1998-4863-9d17-5f8e41a880d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3819f20c-eb01-4f07-9b66-60d3d3b1f52e", "tag": "1a0ca537-c942-4489-ae75-c0afca00e694"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:52:28.531506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=18 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:28.532356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:28.539201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bd8088b-1f9b-4c4a-a0ce-0a4f87abcc85 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:28.539684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bd8088b-1f9b-4c4a-a0ce-0a4f87abcc85 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:28.540475 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bd8088b-1f9b-4c4a-a0ce-0a4f87abcc85 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:28.540927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bd8088b-1f9b-4c4a-a0ce-0a4f87abcc85 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:28.542880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c56c3e9a-a988-4a81-9d31-2891960e7264 req-399660b8-1998-4863-9d17-5f8e41a880d4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:28.543328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c56c3e9a-a988-4a81-9d31-2891960e7264 req-399660b8-1998-4863-9d17-5f8e41a880d4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:28.557072 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c56c3e9a-a988-4a81-9d31-2891960e7264 req-399660b8-1998-4863-9d17-5f8e41a880d4 service nova] Creating event network-changed:1a0ca537-c942-4489-ae75-c0afca00e694 for instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e on n-h1-708768-8 Jul 26 20:52:28.564337 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c56c3e9a-a988-4a81-9d31-2891960e7264 req-399660b8-1998-4863-9d17-5f8e41a880d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037174 Jul 26 20:52:28.566309 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3689/7297] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:52:28.572077 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0bd8088b-1f9b-4c4a-a0ce-0a4f87abcc85 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:52:28.663786 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0bd8088b-1f9b-4c4a-a0ce-0a4f87abcc85 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 204 len: 0 microversion: 2.1 time: 0.138763 Jul 26 20:52:28.664904 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3609/7298] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:52:28 2022] DELETE /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:52:28.674849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-661ae230-d768-4870-bca5-3f967bad02d5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:28.676093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-661ae230-d768-4870-bca5-3f967bad02d5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:28.684341 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-661ae230-d768-4870-bca5-3f967bad02d5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:28.684801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-661ae230-d768-4870-bca5-3f967bad02d5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:28.685584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-661ae230-d768-4870-bca5-3f967bad02d5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:28.687001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-661ae230-d768-4870-bca5-3f967bad02d5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:28.839417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-661ae230-d768-4870-bca5-3f967bad02d5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:28.848184 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-661ae230-d768-4870-bca5-3f967bad02d5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1687 microversion: 2.1 time: 0.178999 Jul 26 20:52:28.848770 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3690/7299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:28 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:29.870895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0e3e4b74-ea0f-4513-a83d-c0907fef99f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:29.872263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0e3e4b74-ea0f-4513-a83d-c0907fef99f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:29.880120 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e3e4b74-ea0f-4513-a83d-c0907fef99f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:29.880579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e3e4b74-ea0f-4513-a83d-c0907fef99f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:29.881360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e3e4b74-ea0f-4513-a83d-c0907fef99f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:29.881805 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0e3e4b74-ea0f-4513-a83d-c0907fef99f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:30.101878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0e3e4b74-ea0f-4513-a83d-c0907fef99f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:30.109792 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0e3e4b74-ea0f-4513-a83d-c0907fef99f4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 200 len: 1687 microversion: 2.1 time: 0.242995 Jul 26 20:52:30.110650 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3610/7300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:29 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 1687 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:30.728312 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-84242bd0-b5ec-4525-9acf-d3eb08fe3a40 req-d189065c-6862-4198-8dcb-de00115488ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3819f20c-eb01-4f07-9b66-60d3d3b1f52e", "name": "network-vif-deleted", "tag": "1a0ca537-c942-4489-ae75-c0afca00e694"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:52:30.739342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-84242bd0-b5ec-4525-9acf-d3eb08fe3a40 req-d189065c-6862-4198-8dcb-de00115488ab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:30.739836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-84242bd0-b5ec-4525-9acf-d3eb08fe3a40 req-d189065c-6862-4198-8dcb-de00115488ab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:30.750473 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-84242bd0-b5ec-4525-9acf-d3eb08fe3a40 req-d189065c-6862-4198-8dcb-de00115488ab service nova] Creating event network-vif-deleted:1a0ca537-c942-4489-ae75-c0afca00e694 for instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e on n-h1-708768-8 Jul 26 20:52:30.755222 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-84242bd0-b5ec-4525-9acf-d3eb08fe3a40 req-d189065c-6862-4198-8dcb-de00115488ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088569 Jul 26 20:52:30.755855 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3691/7301] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:52:31.131677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:31.132316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 3819f20c-eb01-4f07-9b66-60d3d3b1f52e] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:31.139849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:31.140581 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:31.141528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:31.142041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:31.158858 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] HTTP exception thrown: Instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e could not be found. Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Request method failure captured: Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e HTTP/1.1 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FNoxa1srlcvH6r_yC7S2A1Gpmd7eRmaEPJLohqg5KwlBmToGSscey-8jKCumBHfCYTXvguGGlopnfORkXL6tF-VV_3Wx74xjuSG8Xyn2a44PloGF7Fy20kjidPR73Z1sde9RoW9DtFMWfc1zl2jD8ktKip3Ix8reW1kLveuLT8Psaw Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f9b9fa87c564bfc827b8ef31ecd2309", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}] Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7dbc7e95221342da8d288a98b4cb4bee Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e could not be found. Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '3819f20c-eb01-4f07-9b66-60d3d3b1f52e'} Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e could not be found. Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e could not be found. Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:52:31.160591 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e could not be found. Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Returning 404 to user: Instance 3819f20c-eb01-4f07-9b66-60d3d3b1f52e could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-82014e92-ac28-47e4-aaaf-684ff7d31a3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e" status: 404 len: 111 microversion: 2.1 time: 0.034317 Jul 26 20:52:31.165441 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3611/7302] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:31 2022] GET /compute/v2.1/servers/3819f20c-eb01-4f07-9b66-60d3d3b1f52e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:52:34.445175 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-868b8543-3d49-46f4-b55a-bd5ecf5cfc4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '.version_select at 0x7f8756fe8f70>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:34.472292 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-868b8543-3d49-46f4-b55a-bd5ecf5cfc4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-830840724" status: 202 len: 0 microversion: 2.1 time: 0.032709 Jul 26 20:52:34.472967 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3692/7303] 10.222.0.58 () {58 vars in 1281 bytes} [Tue Jul 26 20:52:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-830840724 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:52:34.502246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-845c8bb2-aac6-48bf-8950-055a4436d1fb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: .version_select at 0x7f875d9db820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-954775164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNABVqyczfli6jcHxMKZ0oWnRhAYxBcp0FY7pzTsW3N1HrnGhE2mI2De2yP6krAZwbjg4aOVfhPnYeV94A07vXcr+29SGeNHBikx/EqodjVDjlF9/Iiy+mOpWZt722BalQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:52:34.519058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-845c8bb2-aac6-48bf-8950-055a4436d1fb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:52:34.524395 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-845c8bb2-aac6-48bf-8950-055a4436d1fb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:52:34.547186 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-845c8bb2-aac6-48bf-8950-055a4436d1fb tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.048854 Jul 26 20:52:34.547854 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3612/7304] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:52:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:52:40.085380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2086538779", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "81c42861-5bb1-4f45-b772-dbf3c1649c9e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-954775164", "security_groups": [{"name": "tempest-secgroup-smoke-114761272"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:52:40.340637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] validate_networks() for [('81c42861-5bb1-4f45-b772-dbf3c1649c9e', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:52:40.744496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=14 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:40.803790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:52:40.804550 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:52:40.806179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:52:40.806852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:52:40.807500 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:52:40.821310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:40.821773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:40.822592 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:40.823035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:40.848098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:52:40.853607 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:52:40.869120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:52:40.871846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:52:40.927467 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-678b0ca5-cc6c-474b-9d14-8010beefb190 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.846203 Jul 26 20:52:40.934481 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3693/7305] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:52:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:52:40.941125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e9d3bdc9-106d-464c-a8eb-e1f83598f236 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:40.941833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e9d3bdc9-106d-464c-a8eb-e1f83598f236 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:41.013984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e9d3bdc9-106d-464c-a8eb-e1f83598f236 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:41.022487 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e9d3bdc9-106d-464c-a8eb-e1f83598f236 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1266 microversion: 2.1 time: 0.086872 Jul 26 20:52:41.032190 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3613/7306] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:40 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:52:42.045083 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c17ff5e1-adc8-4dbb-956b-c6cd8941eb7d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:42.045712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c17ff5e1-adc8-4dbb-956b-c6cd8941eb7d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:42.065641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c17ff5e1-adc8-4dbb-956b-c6cd8941eb7d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:42.066287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c17ff5e1-adc8-4dbb-956b-c6cd8941eb7d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:42.067454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c17ff5e1-adc8-4dbb-956b-c6cd8941eb7d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:42.069257 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c17ff5e1-adc8-4dbb-956b-c6cd8941eb7d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:42.199969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c17ff5e1-adc8-4dbb-956b-c6cd8941eb7d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:42.211578 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c17ff5e1-adc8-4dbb-956b-c6cd8941eb7d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1326 microversion: 2.1 time: 0.171878 Jul 26 20:52:42.212230 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3694/7307] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:42 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1326 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:43.233948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b9961434-2756-4f13-b611-c11751d69bda tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:43.234598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b9961434-2756-4f13-b611-c11751d69bda tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:43.237007 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:43.245218 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9961434-2756-4f13-b611-c11751d69bda tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:43.245925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9961434-2756-4f13-b611-c11751d69bda tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:43.247046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9961434-2756-4f13-b611-c11751d69bda tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:43.247677 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b9961434-2756-4f13-b611-c11751d69bda tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:43.488789 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b9961434-2756-4f13-b611-c11751d69bda tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:43.497417 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b9961434-2756-4f13-b611-c11751d69bda tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1391 microversion: 2.1 time: 0.267253 Jul 26 20:52:43.498013 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3614/7308] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:43 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:43.656289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-bdb93da8-3539-481f-9427-37119d39e6fb req-debb55a3-d659-4319-b21e-7a7a9f65c912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37689728-75ab-4c7a-b024-a8bb88110ed6", "tag": "a2f322b7-2731-4577-96e5-7b7c91ce7e54"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:52:43.680169 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bdb93da8-3539-481f-9427-37119d39e6fb req-debb55a3-d659-4319-b21e-7a7a9f65c912 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:43.681297 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-bdb93da8-3539-481f-9427-37119d39e6fb req-debb55a3-d659-4319-b21e-7a7a9f65c912 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:43.695651 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-bdb93da8-3539-481f-9427-37119d39e6fb req-debb55a3-d659-4319-b21e-7a7a9f65c912 service nova] Creating event network-changed:a2f322b7-2731-4577-96e5-7b7c91ce7e54 for instance 37689728-75ab-4c7a-b024-a8bb88110ed6 on n-h2-708768-8 Jul 26 20:52:43.703165 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-bdb93da8-3539-481f-9427-37119d39e6fb req-debb55a3-d659-4319-b21e-7a7a9f65c912 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049774 Jul 26 20:52:43.704394 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3695/7309] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:52:44.519030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-93561dbb-df91-4d24-a913-19741badc784 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:44.519680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-93561dbb-df91-4d24-a913-19741badc784 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:44.526684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93561dbb-df91-4d24-a913-19741badc784 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:44.527146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93561dbb-df91-4d24-a913-19741badc784 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:44.527969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93561dbb-df91-4d24-a913-19741badc784 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:44.528425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93561dbb-df91-4d24-a913-19741badc784 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:44.661195 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-93561dbb-df91-4d24-a913-19741badc784 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:44.668768 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-93561dbb-df91-4d24-a913-19741badc784 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1391 microversion: 2.1 time: 0.154255 Jul 26 20:52:44.669357 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3615/7310] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:44 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:45.692523 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-957d0de0-c903-4569-8441-63d8a4eef362 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:45.693220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-957d0de0-c903-4569-8441-63d8a4eef362 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:45.699434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-957d0de0-c903-4569-8441-63d8a4eef362 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:45.699923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-957d0de0-c903-4569-8441-63d8a4eef362 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:45.700682 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-957d0de0-c903-4569-8441-63d8a4eef362 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:45.701123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-957d0de0-c903-4569-8441-63d8a4eef362 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:45.832900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-957d0de0-c903-4569-8441-63d8a4eef362 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:45.840307 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-957d0de0-c903-4569-8441-63d8a4eef362 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1391 microversion: 2.1 time: 0.153467 Jul 26 20:52:45.840877 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3696/7311] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:45 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:46.861915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cdb2a6a3-b23a-43a8-98fb-764138b09539 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:46.862434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cdb2a6a3-b23a-43a8-98fb-764138b09539 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:46.870111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdb2a6a3-b23a-43a8-98fb-764138b09539 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:46.870567 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdb2a6a3-b23a-43a8-98fb-764138b09539 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:46.871338 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdb2a6a3-b23a-43a8-98fb-764138b09539 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:46.871818 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cdb2a6a3-b23a-43a8-98fb-764138b09539 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:47.009810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cdb2a6a3-b23a-43a8-98fb-764138b09539 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:47.017893 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cdb2a6a3-b23a-43a8-98fb-764138b09539 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1391 microversion: 2.1 time: 0.159862 Jul 26 20:52:47.018523 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3616/7312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:46 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:48.039004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a0f2bf02-8872-4319-8691-6b4b1a1570ab tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:48.039656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a0f2bf02-8872-4319-8691-6b4b1a1570ab tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:48.046709 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0f2bf02-8872-4319-8691-6b4b1a1570ab tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:48.047157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0f2bf02-8872-4319-8691-6b4b1a1570ab tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:48.047965 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0f2bf02-8872-4319-8691-6b4b1a1570ab tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:48.048419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a0f2bf02-8872-4319-8691-6b4b1a1570ab tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:48.183995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a0f2bf02-8872-4319-8691-6b4b1a1570ab tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:48.191666 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a0f2bf02-8872-4319-8691-6b4b1a1570ab tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1391 microversion: 2.1 time: 0.156575 Jul 26 20:52:48.192236 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3697/7313] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:48 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:49.140575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-662fe4bf-43ef-4457-b8b3-836d4d00ffda req-442d7f11-f5a4-41fd-87a3-f05c35f6454e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37689728-75ab-4c7a-b024-a8bb88110ed6", "name": "network-vif-plugged", "status": "completed", "tag": "a2f322b7-2731-4577-96e5-7b7c91ce7e54"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:52:49.150884 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-662fe4bf-43ef-4457-b8b3-836d4d00ffda req-442d7f11-f5a4-41fd-87a3-f05c35f6454e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:49.151330 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-662fe4bf-43ef-4457-b8b3-836d4d00ffda req-442d7f11-f5a4-41fd-87a3-f05c35f6454e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:49.162435 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-662fe4bf-43ef-4457-b8b3-836d4d00ffda req-442d7f11-f5a4-41fd-87a3-f05c35f6454e service nova] Creating event network-vif-plugged:a2f322b7-2731-4577-96e5-7b7c91ce7e54 for instance 37689728-75ab-4c7a-b024-a8bb88110ed6 on n-h2-708768-8 Jul 26 20:52:49.167317 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-662fe4bf-43ef-4457-b8b3-836d4d00ffda req-442d7f11-f5a4-41fd-87a3-f05c35f6454e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030549 Jul 26 20:52:49.167941 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3617/7314] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:52:49.211942 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a7b23d84-7743-43cf-9dd0-2d886d68eb8d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:49.212620 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a7b23d84-7743-43cf-9dd0-2d886d68eb8d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:49.219503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7b23d84-7743-43cf-9dd0-2d886d68eb8d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:49.220093 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7b23d84-7743-43cf-9dd0-2d886d68eb8d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:49.221107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7b23d84-7743-43cf-9dd0-2d886d68eb8d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:49.221644 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a7b23d84-7743-43cf-9dd0-2d886d68eb8d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:49.357107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a7b23d84-7743-43cf-9dd0-2d886d68eb8d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:49.365873 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a7b23d84-7743-43cf-9dd0-2d886d68eb8d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1391 microversion: 2.1 time: 0.158148 Jul 26 20:52:49.366448 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3698/7315] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:49 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:50.388994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-27beed80-4c65-443b-a4fd-6d5c5373a6ac tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:50.389631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-27beed80-4c65-443b-a4fd-6d5c5373a6ac tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:50.397188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27beed80-4c65-443b-a4fd-6d5c5373a6ac tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:50.397650 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27beed80-4c65-443b-a4fd-6d5c5373a6ac tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:50.398428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27beed80-4c65-443b-a4fd-6d5c5373a6ac tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:50.398878 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27beed80-4c65-443b-a4fd-6d5c5373a6ac tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:50.533051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-27beed80-4c65-443b-a4fd-6d5c5373a6ac tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:50.540605 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-27beed80-4c65-443b-a4fd-6d5c5373a6ac tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1563 microversion: 2.1 time: 0.156807 Jul 26 20:52:50.541176 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3618/7316] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:50 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:50.561672 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-924efce6-9aed-4148-89f1-afa5ddf813a1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:50.562281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-924efce6-9aed-4148-89f1-afa5ddf813a1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:50.569759 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-924efce6-9aed-4148-89f1-afa5ddf813a1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:50.570201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-924efce6-9aed-4148-89f1-afa5ddf813a1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:50.571039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-924efce6-9aed-4148-89f1-afa5ddf813a1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:50.571470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-924efce6-9aed-4148-89f1-afa5ddf813a1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:50.701786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-924efce6-9aed-4148-89f1-afa5ddf813a1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:50.709330 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-924efce6-9aed-4148-89f1-afa5ddf813a1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1563 microversion: 2.1 time: 0.151717 Jul 26 20:52:50.709902 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3699/7317] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:50 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:52:52.310664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d269ace0-2e89-4c9b-8d55-273102b9c17e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:52:52.311289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d269ace0-2e89-4c9b-8d55-273102b9c17e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:52:52.313286 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-44c91bd9-3ab9-4f13-833e-8bc921cc2c3c req-571051e3-0f4e-428e-b890-b8905e734b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37689728-75ab-4c7a-b024-a8bb88110ed6", "tag": "a2f322b7-2731-4577-96e5-7b7c91ce7e54"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:52:52.313723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:52.320544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:52.320929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d269ace0-2e89-4c9b-8d55-273102b9c17e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:52.321630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:52.321756 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d269ace0-2e89-4c9b-8d55-273102b9c17e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:52.322751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d269ace0-2e89-4c9b-8d55-273102b9c17e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:52.323193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d269ace0-2e89-4c9b-8d55-273102b9c17e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:52.323658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:52:52.334228 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-44c91bd9-3ab9-4f13-833e-8bc921cc2c3c req-571051e3-0f4e-428e-b890-b8905e734b0b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:52:52.334676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-44c91bd9-3ab9-4f13-833e-8bc921cc2c3c req-571051e3-0f4e-428e-b890-b8905e734b0b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:52:52.348143 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-44c91bd9-3ab9-4f13-833e-8bc921cc2c3c req-571051e3-0f4e-428e-b890-b8905e734b0b service nova] Creating event network-changed:a2f322b7-2731-4577-96e5-7b7c91ce7e54 for instance 37689728-75ab-4c7a-b024-a8bb88110ed6 on n-h2-708768-8 Jul 26 20:52:52.353893 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-44c91bd9-3ab9-4f13-833e-8bc921cc2c3c req-571051e3-0f4e-428e-b890-b8905e734b0b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044928 Jul 26 20:52:52.354880 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3700/7318] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:52:52.555449 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d269ace0-2e89-4c9b-8d55-273102b9c17e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:52:52.564738 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d269ace0-2e89-4c9b-8d55-273102b9c17e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1563 microversion: 2.1 time: 0.257750 Jul 26 20:52:52.565869 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3619/7319] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:52:52 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:53:04.726553 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:53:04.727169 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:53:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:53:15.809678 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=36 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:53:15.814344 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-26c88cee-642a-4819-8b62-ab302bedbbe8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:53:15.816762 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-26c88cee-642a-4819-8b62-ab302bedbbe8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:15.823489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26c88cee-642a-4819-8b62-ab302bedbbe8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:15.823972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26c88cee-642a-4819-8b62-ab302bedbbe8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:15.824773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26c88cee-642a-4819-8b62-ab302bedbbe8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:15.825217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-26c88cee-642a-4819-8b62-ab302bedbbe8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:15.876546 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-26c88cee-642a-4819-8b62-ab302bedbbe8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6/action" status: 200 len: 24550 microversion: 2.1 time: 0.069090 Jul 26 20:53:15.877424 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3701/7320] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:53:15 2022] POST /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6/action => generated 24550 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:53:26.941261 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:53:26.944731 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:26.946793 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:53:26.947509 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=32 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:53:26.953783 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:26.954244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:26.955017 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:26.955461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:26.995364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:27.001684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Old instance type m1.heat2, new instance type m1.heat {{(pid=125963) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 20:53:27.008517 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:53:27.008944 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:53:27.009424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:53:27.009840 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:53:27.010259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:53:27.074211 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf775a6c-3b5a-4c9b-828e-2e0344aeb07d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6/action" status: 202 len: 0 microversion: 2.1 time: 0.137238 Jul 26 20:53:27.074827 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3620/7321] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:53:26 2022] POST /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:53:27.084330 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-cd29acbe-de9c-4d7f-a600-b9232920ed67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:27.085042 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-cd29acbe-de9c-4d7f-a600-b9232920ed67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:27.088096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:53:27.088866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:53:27.095223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd29acbe-de9c-4d7f-a600-b9232920ed67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:27.095741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd29acbe-de9c-4d7f-a600-b9232920ed67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:27.096639 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd29acbe-de9c-4d7f-a600-b9232920ed67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:27.097108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-cd29acbe-de9c-4d7f-a600-b9232920ed67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:27.234303 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-cd29acbe-de9c-4d7f-a600-b9232920ed67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:27.242896 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-cd29acbe-de9c-4d7f-a600-b9232920ed67 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1690 microversion: 2.1 time: 0.163517 Jul 26 20:53:27.243480 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3702/7322] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:27 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:28.268250 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9544eb5a-552c-419a-b4df-cc4859e12cea tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:28.268801 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9544eb5a-552c-419a-b4df-cc4859e12cea tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:28.274924 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9544eb5a-552c-419a-b4df-cc4859e12cea tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:28.275378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9544eb5a-552c-419a-b4df-cc4859e12cea tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:28.276183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9544eb5a-552c-419a-b4df-cc4859e12cea tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:28.276629 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9544eb5a-552c-419a-b4df-cc4859e12cea tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:28.415455 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9544eb5a-552c-419a-b4df-cc4859e12cea tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:28.422955 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9544eb5a-552c-419a-b4df-cc4859e12cea tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1690 microversion: 2.1 time: 0.160546 Jul 26 20:53:28.423521 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3621/7323] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:28 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:29.444635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6178a59c-4be7-4107-95c3-7069d547f07e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:29.445250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6178a59c-4be7-4107-95c3-7069d547f07e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:29.452275 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6178a59c-4be7-4107-95c3-7069d547f07e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:29.452702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6178a59c-4be7-4107-95c3-7069d547f07e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:29.453477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6178a59c-4be7-4107-95c3-7069d547f07e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:29.453916 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6178a59c-4be7-4107-95c3-7069d547f07e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:29.590002 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6178a59c-4be7-4107-95c3-7069d547f07e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:29.597521 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6178a59c-4be7-4107-95c3-7069d547f07e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.156834 Jul 26 20:53:29.598088 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3703/7324] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:29 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:30.620572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ba93abae-ad64-42c7-ac6e-d968964c4561 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:30.621201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ba93abae-ad64-42c7-ac6e-d968964c4561 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:30.628115 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba93abae-ad64-42c7-ac6e-d968964c4561 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:30.628578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba93abae-ad64-42c7-ac6e-d968964c4561 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:30.629357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba93abae-ad64-42c7-ac6e-d968964c4561 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:30.629806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba93abae-ad64-42c7-ac6e-d968964c4561 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:30.760982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ba93abae-ad64-42c7-ac6e-d968964c4561 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:30.768520 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ba93abae-ad64-42c7-ac6e-d968964c4561 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.151886 Jul 26 20:53:30.769085 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3622/7325] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:30 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:31.790466 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e072836c-dafd-4696-8657-0f9e906088b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:31.791021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e072836c-dafd-4696-8657-0f9e906088b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:31.798335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e072836c-dafd-4696-8657-0f9e906088b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:31.798779 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e072836c-dafd-4696-8657-0f9e906088b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:31.799542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e072836c-dafd-4696-8657-0f9e906088b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:31.800001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e072836c-dafd-4696-8657-0f9e906088b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:31.931716 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e072836c-dafd-4696-8657-0f9e906088b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:31.939484 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e072836c-dafd-4696-8657-0f9e906088b5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.153517 Jul 26 20:53:31.940088 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3704/7326] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:31 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:32.961952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9fa17ebf-ce65-4868-a7ba-47f08c0f487d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:32.962612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9fa17ebf-ce65-4868-a7ba-47f08c0f487d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:32.969523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9fa17ebf-ce65-4868-a7ba-47f08c0f487d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:32.969976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9fa17ebf-ce65-4868-a7ba-47f08c0f487d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:32.970741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9fa17ebf-ce65-4868-a7ba-47f08c0f487d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:32.971187 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9fa17ebf-ce65-4868-a7ba-47f08c0f487d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:33.105224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9fa17ebf-ce65-4868-a7ba-47f08c0f487d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:33.113025 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9fa17ebf-ce65-4868-a7ba-47f08c0f487d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.155506 Jul 26 20:53:33.113706 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3623/7327] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:32 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:34.135690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6599a757-2bb2-4d57-bfbd-bbacb172e612 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:34.136306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6599a757-2bb2-4d57-bfbd-bbacb172e612 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:34.143404 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6599a757-2bb2-4d57-bfbd-bbacb172e612 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:34.143883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6599a757-2bb2-4d57-bfbd-bbacb172e612 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:34.144655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6599a757-2bb2-4d57-bfbd-bbacb172e612 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:34.145094 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6599a757-2bb2-4d57-bfbd-bbacb172e612 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:34.280875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6599a757-2bb2-4d57-bfbd-bbacb172e612 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:34.289290 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6599a757-2bb2-4d57-bfbd-bbacb172e612 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.157559 Jul 26 20:53:34.289863 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3705/7328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:34 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:35.311744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d10352d3-86a0-440a-8f9e-46c2c0c08b2f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:35.312370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d10352d3-86a0-440a-8f9e-46c2c0c08b2f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:35.319828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d10352d3-86a0-440a-8f9e-46c2c0c08b2f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:35.320311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d10352d3-86a0-440a-8f9e-46c2c0c08b2f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:35.321093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d10352d3-86a0-440a-8f9e-46c2c0c08b2f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:35.321542 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d10352d3-86a0-440a-8f9e-46c2c0c08b2f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:35.454796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d10352d3-86a0-440a-8f9e-46c2c0c08b2f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:35.462390 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d10352d3-86a0-440a-8f9e-46c2c0c08b2f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.154767 Jul 26 20:53:35.462957 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3624/7329] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:35 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:36.483904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be19cfbd-15ae-408e-8149-d0fd6cb923a4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:36.484528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-be19cfbd-15ae-408e-8149-d0fd6cb923a4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:36.491392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be19cfbd-15ae-408e-8149-d0fd6cb923a4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:36.491865 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be19cfbd-15ae-408e-8149-d0fd6cb923a4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:36.492627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be19cfbd-15ae-408e-8149-d0fd6cb923a4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:36.493062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be19cfbd-15ae-408e-8149-d0fd6cb923a4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:36.626393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-be19cfbd-15ae-408e-8149-d0fd6cb923a4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:36.635160 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-be19cfbd-15ae-408e-8149-d0fd6cb923a4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.155177 Jul 26 20:53:36.635762 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3706/7330] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:36 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:37.657553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7c21977e-e118-44f4-af9b-b54dfb2db685 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:37.658204 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7c21977e-e118-44f4-af9b-b54dfb2db685 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:37.665621 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c21977e-e118-44f4-af9b-b54dfb2db685 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:37.666080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c21977e-e118-44f4-af9b-b54dfb2db685 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:37.666847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c21977e-e118-44f4-af9b-b54dfb2db685 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:37.667292 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7c21977e-e118-44f4-af9b-b54dfb2db685 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:37.803279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7c21977e-e118-44f4-af9b-b54dfb2db685 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:37.811013 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7c21977e-e118-44f4-af9b-b54dfb2db685 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.157357 Jul 26 20:53:37.811594 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3625/7331] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:37 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:38.831850 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0f6c8ae9-94b9-418d-8abf-035e7186d7c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:38.832376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0f6c8ae9-94b9-418d-8abf-035e7186d7c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:38.839340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f6c8ae9-94b9-418d-8abf-035e7186d7c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:38.839839 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f6c8ae9-94b9-418d-8abf-035e7186d7c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:38.840599 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f6c8ae9-94b9-418d-8abf-035e7186d7c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:38.841037 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0f6c8ae9-94b9-418d-8abf-035e7186d7c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:38.983161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0f6c8ae9-94b9-418d-8abf-035e7186d7c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:38.991673 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0f6c8ae9-94b9-418d-8abf-035e7186d7c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.163779 Jul 26 20:53:38.992264 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3707/7332] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:38 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:40.013403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-33e3f087-f67f-4d03-becf-b2162d99e3a5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:40.014051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-33e3f087-f67f-4d03-becf-b2162d99e3a5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:40.021216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33e3f087-f67f-4d03-becf-b2162d99e3a5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:40.021704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33e3f087-f67f-4d03-becf-b2162d99e3a5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:40.022482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33e3f087-f67f-4d03-becf-b2162d99e3a5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:40.022932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-33e3f087-f67f-4d03-becf-b2162d99e3a5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:40.154191 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-33e3f087-f67f-4d03-becf-b2162d99e3a5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:40.161717 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-33e3f087-f67f-4d03-becf-b2162d99e3a5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.152232 Jul 26 20:53:40.162294 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3626/7333] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:40 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:41.183429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ca94af18-be38-474d-b6e4-01df7ffa35aa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:41.184108 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ca94af18-be38-474d-b6e4-01df7ffa35aa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:41.191285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca94af18-be38-474d-b6e4-01df7ffa35aa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:41.191782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca94af18-be38-474d-b6e4-01df7ffa35aa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:41.193120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca94af18-be38-474d-b6e4-01df7ffa35aa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:41.194267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ca94af18-be38-474d-b6e4-01df7ffa35aa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:41.322833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ca94af18-be38-474d-b6e4-01df7ffa35aa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:41.330381 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ca94af18-be38-474d-b6e4-01df7ffa35aa tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.150998 Jul 26 20:53:41.330956 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3708/7334] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:41 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:42.352588 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-757aabf9-b370-4350-a91f-ce91374ba9a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:42.353174 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-757aabf9-b370-4350-a91f-ce91374ba9a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:42.360113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-757aabf9-b370-4350-a91f-ce91374ba9a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:42.360577 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-757aabf9-b370-4350-a91f-ce91374ba9a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:42.361356 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-757aabf9-b370-4350-a91f-ce91374ba9a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:42.361810 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-757aabf9-b370-4350-a91f-ce91374ba9a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:42.494078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-757aabf9-b370-4350-a91f-ce91374ba9a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:42.501664 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-757aabf9-b370-4350-a91f-ce91374ba9a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.153843 Jul 26 20:53:42.502229 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3627/7335] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:42 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:43.523667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8e2e694d-9f8e-4304-90e5-4f1fbc09e38a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:43.524285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8e2e694d-9f8e-4304-90e5-4f1fbc09e38a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:43.531114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e2e694d-9f8e-4304-90e5-4f1fbc09e38a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:43.531566 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e2e694d-9f8e-4304-90e5-4f1fbc09e38a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:43.532360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e2e694d-9f8e-4304-90e5-4f1fbc09e38a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:43.532799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8e2e694d-9f8e-4304-90e5-4f1fbc09e38a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:43.662786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8e2e694d-9f8e-4304-90e5-4f1fbc09e38a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:43.670421 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8e2e694d-9f8e-4304-90e5-4f1fbc09e38a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.150832 Jul 26 20:53:43.670999 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3709/7336] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:43 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:44.691510 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c7419617-0da0-49fc-b41a-28f61f29ab86 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:44.692181 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c7419617-0da0-49fc-b41a-28f61f29ab86 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:44.699952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7419617-0da0-49fc-b41a-28f61f29ab86 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:44.700417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7419617-0da0-49fc-b41a-28f61f29ab86 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:44.701206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7419617-0da0-49fc-b41a-28f61f29ab86 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:44.701661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c7419617-0da0-49fc-b41a-28f61f29ab86 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:44.837634 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c7419617-0da0-49fc-b41a-28f61f29ab86 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:44.845183 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c7419617-0da0-49fc-b41a-28f61f29ab86 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.157602 Jul 26 20:53:44.845753 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3628/7337] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:44 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:45.867706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5c3a95d0-da05-4281-8aa9-77c47d283c42 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:45.868336 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5c3a95d0-da05-4281-8aa9-77c47d283c42 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:45.875357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3a95d0-da05-4281-8aa9-77c47d283c42 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:45.875880 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3a95d0-da05-4281-8aa9-77c47d283c42 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:45.876653 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3a95d0-da05-4281-8aa9-77c47d283c42 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:45.877098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5c3a95d0-da05-4281-8aa9-77c47d283c42 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:46.050058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-5c3a95d0-da05-4281-8aa9-77c47d283c42 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:46.058364 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5c3a95d0-da05-4281-8aa9-77c47d283c42 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1695 microversion: 2.1 time: 0.195268 Jul 26 20:53:46.058841 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3710/7338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:45 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:46.414353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5e3d7842-e4a9-4f40-a11e-6cd8e9e0cfab req-1108bd6c-b9a2-46e5-b2fa-90a24d7947d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37689728-75ab-4c7a-b024-a8bb88110ed6", "name": "network-vif-unplugged", "status": "completed", "tag": "a2f322b7-2731-4577-96e5-7b7c91ce7e54"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:53:46.424797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5e3d7842-e4a9-4f40-a11e-6cd8e9e0cfab req-1108bd6c-b9a2-46e5-b2fa-90a24d7947d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:46.425256 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5e3d7842-e4a9-4f40-a11e-6cd8e9e0cfab req-1108bd6c-b9a2-46e5-b2fa-90a24d7947d1 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:46.437578 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5e3d7842-e4a9-4f40-a11e-6cd8e9e0cfab req-1108bd6c-b9a2-46e5-b2fa-90a24d7947d1 service nova] Creating event network-vif-unplugged:a2f322b7-2731-4577-96e5-7b7c91ce7e54 for instance 37689728-75ab-4c7a-b024-a8bb88110ed6 on n-h1-708768-8 Jul 26 20:53:46.444068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [req-5e3d7842-e4a9-4f40-a11e-6cd8e9e0cfab req-1108bd6c-b9a2-46e5-b2fa-90a24d7947d1 service nova] Instance 37689728-75ab-4c7a-b024-a8bb88110ed6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125963) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:53:46.454712 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5e3d7842-e4a9-4f40-a11e-6cd8e9e0cfab req-1108bd6c-b9a2-46e5-b2fa-90a24d7947d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044553 Jul 26 20:53:46.455337 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3629/7339] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:53:47.082460 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dd18d13c-8a5b-4528-8674-1b7a8aefe616 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:47.083857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dd18d13c-8a5b-4528-8674-1b7a8aefe616 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:47.090868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd18d13c-8a5b-4528-8674-1b7a8aefe616 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:47.091322 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd18d13c-8a5b-4528-8674-1b7a8aefe616 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:47.092199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd18d13c-8a5b-4528-8674-1b7a8aefe616 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:47.092572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dd18d13c-8a5b-4528-8674-1b7a8aefe616 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:47.228767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dd18d13c-8a5b-4528-8674-1b7a8aefe616 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:47.236541 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dd18d13c-8a5b-4528-8674-1b7a8aefe616 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1694 microversion: 2.1 time: 0.158152 Jul 26 20:53:47.237429 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3711/7340] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:47 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:48.259042 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e41dbef7-f2ec-46fb-a008-3a4ceb2ab6d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:48.259791 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e41dbef7-f2ec-46fb-a008-3a4ceb2ab6d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:48.265983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e41dbef7-f2ec-46fb-a008-3a4ceb2ab6d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:48.266443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e41dbef7-f2ec-46fb-a008-3a4ceb2ab6d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:48.267216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e41dbef7-f2ec-46fb-a008-3a4ceb2ab6d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:48.267704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e41dbef7-f2ec-46fb-a008-3a4ceb2ab6d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:48.405452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e41dbef7-f2ec-46fb-a008-3a4ceb2ab6d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:48.413111 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e41dbef7-f2ec-46fb-a008-3a4ceb2ab6d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1692 microversion: 2.1 time: 0.159403 Jul 26 20:53:48.413683 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3630/7341] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:48 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:48.470453 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-05c5e87b-37e1-419b-a0f3-0072b4133191 req-3ed9e6e6-0e28-4ce4-a397-3a273cf9a78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37689728-75ab-4c7a-b024-a8bb88110ed6", "tag": "a2f322b7-2731-4577-96e5-7b7c91ce7e54"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:53:48.480656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-05c5e87b-37e1-419b-a0f3-0072b4133191 req-3ed9e6e6-0e28-4ce4-a397-3a273cf9a78e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:48.481100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-05c5e87b-37e1-419b-a0f3-0072b4133191 req-3ed9e6e6-0e28-4ce4-a397-3a273cf9a78e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:48.493039 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-05c5e87b-37e1-419b-a0f3-0072b4133191 req-3ed9e6e6-0e28-4ce4-a397-3a273cf9a78e service nova] Creating event network-changed:a2f322b7-2731-4577-96e5-7b7c91ce7e54 for instance 37689728-75ab-4c7a-b024-a8bb88110ed6 on n-h1-708768-8 Jul 26 20:53:48.498289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [req-05c5e87b-37e1-419b-a0f3-0072b4133191 req-3ed9e6e6-0e28-4ce4-a397-3a273cf9a78e service nova] Instance 37689728-75ab-4c7a-b024-a8bb88110ed6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-708768-8', 'n-h1-708768-8'} {{(pid=125964) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 20:53:48.509791 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-05c5e87b-37e1-419b-a0f3-0072b4133191 req-3ed9e6e6-0e28-4ce4-a397-3a273cf9a78e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042953 Jul 26 20:53:48.510314 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3712/7342] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:53:49.435477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0ebafb39-b8c7-45b4-9592-79826cc0791e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:49.436775 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0ebafb39-b8c7-45b4-9592-79826cc0791e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:49.444749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ebafb39-b8c7-45b4-9592-79826cc0791e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:49.445131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ebafb39-b8c7-45b4-9592-79826cc0791e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:49.446145 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ebafb39-b8c7-45b4-9592-79826cc0791e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:49.446545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0ebafb39-b8c7-45b4-9592-79826cc0791e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:49.604091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0ebafb39-b8c7-45b4-9592-79826cc0791e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:49.612236 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0ebafb39-b8c7-45b4-9592-79826cc0791e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1689 microversion: 2.1 time: 0.180927 Jul 26 20:53:49.612825 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3631/7343] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:49 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:49.635493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9a01bf61-6d41-412c-be37-7340bb3ff626 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:53:49.636805 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9a01bf61-6d41-412c-be37-7340bb3ff626 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:49.643250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a01bf61-6d41-412c-be37-7340bb3ff626 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:49.643720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a01bf61-6d41-412c-be37-7340bb3ff626 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:49.644752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a01bf61-6d41-412c-be37-7340bb3ff626 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:49.645190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9a01bf61-6d41-412c-be37-7340bb3ff626 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:49.708804 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9a01bf61-6d41-412c-be37-7340bb3ff626 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6/action" status: 204 len: 0 microversion: 2.1 time: 0.079244 Jul 26 20:53:49.709744 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3713/7344] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:53:49 2022] POST /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:53:49.717989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-73afa4e6-3552-4cb1-9651-8d5f3648ddf1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:49.718720 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-73afa4e6-3552-4cb1-9651-8d5f3648ddf1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:49.725089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73afa4e6-3552-4cb1-9651-8d5f3648ddf1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:49.725558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73afa4e6-3552-4cb1-9651-8d5f3648ddf1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:49.726351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73afa4e6-3552-4cb1-9651-8d5f3648ddf1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:49.726812 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-73afa4e6-3552-4cb1-9651-8d5f3648ddf1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:49.949343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-73afa4e6-3552-4cb1-9651-8d5f3648ddf1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:49.957127 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-73afa4e6-3552-4cb1-9651-8d5f3648ddf1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1689 microversion: 2.1 time: 0.243084 Jul 26 20:53:49.957807 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3632/7345] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:49 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1689 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:49.979539 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3f7c897f-c773-4f3d-af0a-9969a40f5a46 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:49.980231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3f7c897f-c773-4f3d-af0a-9969a40f5a46 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:49.986786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f7c897f-c773-4f3d-af0a-9969a40f5a46 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:49.987240 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f7c897f-c773-4f3d-af0a-9969a40f5a46 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:49.988049 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f7c897f-c773-4f3d-af0a-9969a40f5a46 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:49.988692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3f7c897f-c773-4f3d-af0a-9969a40f5a46 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:50.133789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3f7c897f-c773-4f3d-af0a-9969a40f5a46 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:50.141330 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3f7c897f-c773-4f3d-af0a-9969a40f5a46 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1689 microversion: 2.1 time: 0.166455 Jul 26 20:53:50.141910 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3714/7346] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:49 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:51.164219 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-444f85cd-ffe4-4ec3-8ebb-8b1e26b72c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:53:51.164868 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-444f85cd-ffe4-4ec3-8ebb-8b1e26b72c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:53:51.171725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-444f85cd-ffe4-4ec3-8ebb-8b1e26b72c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:51.172182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-444f85cd-ffe4-4ec3-8ebb-8b1e26b72c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:51.172946 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-444f85cd-ffe4-4ec3-8ebb-8b1e26b72c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:51.173390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-444f85cd-ffe4-4ec3-8ebb-8b1e26b72c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:51.311022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-444f85cd-ffe4-4ec3-8ebb-8b1e26b72c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:53:51.318612 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-444f85cd-ffe4-4ec3-8ebb-8b1e26b72c0c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1681 microversion: 2.1 time: 0.159303 Jul 26 20:53:51.319190 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3633/7347] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:53:51 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:53:51.618650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-70de487b-dfbc-4498-9465-33f306d58c35 req-5499b648-e841-4165-9bb9-5c1e5191fbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37689728-75ab-4c7a-b024-a8bb88110ed6", "name": "network-vif-plugged", "status": "completed", "tag": "a2f322b7-2731-4577-96e5-7b7c91ce7e54"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:53:51.629711 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-70de487b-dfbc-4498-9465-33f306d58c35 req-5499b648-e841-4165-9bb9-5c1e5191fbc4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:53:51.630151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-70de487b-dfbc-4498-9465-33f306d58c35 req-5499b648-e841-4165-9bb9-5c1e5191fbc4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:53:51.641934 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-70de487b-dfbc-4498-9465-33f306d58c35 req-5499b648-e841-4165-9bb9-5c1e5191fbc4 service nova] Creating event network-vif-plugged:a2f322b7-2731-4577-96e5-7b7c91ce7e54 for instance 37689728-75ab-4c7a-b024-a8bb88110ed6 on n-h1-708768-8 Jul 26 20:53:51.647446 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-70de487b-dfbc-4498-9465-33f306d58c35 req-5499b648-e841-4165-9bb9-5c1e5191fbc4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088117 Jul 26 20:53:51.648077 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3715/7348] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:54:13.503083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-76e7eef2-0c40-4b69-9767-6fb24a63c530 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:54:13.505288 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-76e7eef2-0c40-4b69-9767-6fb24a63c530 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:13.508553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=32 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:54:13.509234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:54:13.514813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76e7eef2-0c40-4b69-9767-6fb24a63c530 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:13.515278 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76e7eef2-0c40-4b69-9767-6fb24a63c530 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:13.516114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76e7eef2-0c40-4b69-9767-6fb24a63c530 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:13.516566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-76e7eef2-0c40-4b69-9767-6fb24a63c530 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:13.571678 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-76e7eef2-0c40-4b69-9767-6fb24a63c530 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6/action" status: 200 len: 24582 microversion: 2.1 time: 0.072467 Jul 26 20:54:13.572311 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3634/7349] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:54:13 2022] POST /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6/action => generated 24582 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:54:20.623351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=28 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:54:20.624695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:54:20.629258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a94e1b53-b1ee-4ca1-9fb2-75db564f2e3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:20.630573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a94e1b53-b1ee-4ca1-9fb2-75db564f2e3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:20.639335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a94e1b53-b1ee-4ca1-9fb2-75db564f2e3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:20.639907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a94e1b53-b1ee-4ca1-9fb2-75db564f2e3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:20.640771 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a94e1b53-b1ee-4ca1-9fb2-75db564f2e3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:20.641429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a94e1b53-b1ee-4ca1-9fb2-75db564f2e3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:20.669355 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a94e1b53-b1ee-4ca1-9fb2-75db564f2e3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:54:20.683151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-69290799-ca39-47a2-b932-e9ac0a26e219 req-b4bfab9a-1a0a-42d3-9b1c-248eca8bb3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37689728-75ab-4c7a-b024-a8bb88110ed6", "tag": "a2f322b7-2731-4577-96e5-7b7c91ce7e54"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:54:20.696507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-69290799-ca39-47a2-b932-e9ac0a26e219 req-b4bfab9a-1a0a-42d3-9b1c-248eca8bb3d2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:20.696507 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-69290799-ca39-47a2-b932-e9ac0a26e219 req-b4bfab9a-1a0a-42d3-9b1c-248eca8bb3d2 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:20.707934 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-69290799-ca39-47a2-b932-e9ac0a26e219 req-b4bfab9a-1a0a-42d3-9b1c-248eca8bb3d2 service nova] Creating event network-changed:a2f322b7-2731-4577-96e5-7b7c91ce7e54 for instance 37689728-75ab-4c7a-b024-a8bb88110ed6 on n-h1-708768-8 Jul 26 20:54:20.713971 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-69290799-ca39-47a2-b932-e9ac0a26e219 req-b4bfab9a-1a0a-42d3-9b1c-248eca8bb3d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097738 Jul 26 20:54:20.714830 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3635/7350] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:54:20.761953 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a94e1b53-b1ee-4ca1-9fb2-75db564f2e3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 204 len: 0 microversion: 2.1 time: 0.146847 Jul 26 20:54:20.763174 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3716/7351] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:54:20 2022] DELETE /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:54:20.772832 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ece15ea3-38c1-4b3f-a18a-031199d48dc4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:20.773851 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ece15ea3-38c1-4b3f-a18a-031199d48dc4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:20.780603 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ece15ea3-38c1-4b3f-a18a-031199d48dc4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:20.781095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ece15ea3-38c1-4b3f-a18a-031199d48dc4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:20.781894 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ece15ea3-38c1-4b3f-a18a-031199d48dc4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:20.782345 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ece15ea3-38c1-4b3f-a18a-031199d48dc4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:20.925745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ece15ea3-38c1-4b3f-a18a-031199d48dc4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:20.934336 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ece15ea3-38c1-4b3f-a18a-031199d48dc4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1687 microversion: 2.1 time: 0.166436 Jul 26 20:54:20.934924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3636/7352] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:20 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:21.957069 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3ed655e7-98f2-42f9-a8ba-8d05fc1d9172 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:21.957698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3ed655e7-98f2-42f9-a8ba-8d05fc1d9172 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:21.964512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed655e7-98f2-42f9-a8ba-8d05fc1d9172 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:21.965373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed655e7-98f2-42f9-a8ba-8d05fc1d9172 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:21.966138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed655e7-98f2-42f9-a8ba-8d05fc1d9172 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:21.966571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3ed655e7-98f2-42f9-a8ba-8d05fc1d9172 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:22.266104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3ed655e7-98f2-42f9-a8ba-8d05fc1d9172 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:22.274132 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3ed655e7-98f2-42f9-a8ba-8d05fc1d9172 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 200 len: 1687 microversion: 2.1 time: 0.321394 Jul 26 20:54:22.274720 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3717/7353] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:21 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 1687 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:22.791665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-572c85ae-bbf3-4e56-9d12-4df5e25ca16c req-9870bc2b-1231-404a-8858-9bf8ac9d74a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37689728-75ab-4c7a-b024-a8bb88110ed6", "name": "network-vif-deleted", "tag": "a2f322b7-2731-4577-96e5-7b7c91ce7e54"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:54:22.804981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-572c85ae-bbf3-4e56-9d12-4df5e25ca16c req-9870bc2b-1231-404a-8858-9bf8ac9d74a9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:22.805444 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-572c85ae-bbf3-4e56-9d12-4df5e25ca16c req-9870bc2b-1231-404a-8858-9bf8ac9d74a9 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:22.818076 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-572c85ae-bbf3-4e56-9d12-4df5e25ca16c req-9870bc2b-1231-404a-8858-9bf8ac9d74a9 service nova] Creating event network-vif-deleted:a2f322b7-2731-4577-96e5-7b7c91ce7e54 for instance 37689728-75ab-4c7a-b024-a8bb88110ed6 on n-h1-708768-8 Jul 26 20:54:22.823236 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-572c85ae-bbf3-4e56-9d12-4df5e25ca16c req-9870bc2b-1231-404a-8858-9bf8ac9d74a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036006 Jul 26 20:54:22.823862 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3637/7354] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:54:23.296082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:23.296695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 37689728-75ab-4c7a-b024-a8bb88110ed6] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:23.303898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:23.304292 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:23.305046 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:23.305479 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:23.319532 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] HTTP exception thrown: Instance 37689728-75ab-4c7a-b024-a8bb88110ed6 could not be found. Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Request method failure captured: Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 HTTP/1.1 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FNoxa1srlcvH6r_yC7S2A1Gpmd7eRmaEPJLohqg5KwlBmToGSscey-8jKCumBHfCYTXvguGGlopnfORkXL6tF-VV_3Wx74xjuSG8Xyn2a44PloGF7Fy20kjidPR73Z1sde9RoW9DtFMWfc1zl2jD8ktKip3Ix8reW1kLveuLT8Psaw Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f9b9fa87c564bfc827b8ef31ecd2309", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}] Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 7dbc7e95221342da8d288a98b4cb4bee Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 37689728-75ab-4c7a-b024-a8bb88110ed6 could not be found. Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '37689728-75ab-4c7a-b024-a8bb88110ed6'} Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37689728-75ab-4c7a-b024-a8bb88110ed6 could not be found. Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37689728-75ab-4c7a-b024-a8bb88110ed6 could not be found. Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:54:23.321197 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37689728-75ab-4c7a-b024-a8bb88110ed6 could not be found. Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Returning 404 to user: Instance 37689728-75ab-4c7a-b024-a8bb88110ed6 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ab7aa419-2749-4d37-9377-31ec1c00316c tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6" status: 404 len: 111 microversion: 2.1 time: 0.030398 Jul 26 20:54:23.325548 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3718/7355] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:23 2022] GET /compute/v2.1/servers/37689728-75ab-4c7a-b024-a8bb88110ed6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:54:26.568467 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cb7958e4-886f-4f4a-9294-7dcbb771e31d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '.version_select at 0x7f875c608e50>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:26.594035 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cb7958e4-886f-4f4a-9294-7dcbb771e31d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-954775164" status: 202 len: 0 microversion: 2.1 time: 0.030731 Jul 26 20:54:26.599581 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3638/7356] 10.222.0.58 () {58 vars in 1281 bytes} [Tue Jul 26 20:54:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-954775164 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:54:26.626308 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a257e3d4-c295-4d6c-92ce-8a169f0eac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: .version_select at 0x7f876830ed30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1754321235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvPHaTwthO/Ps8zKupoOdu9abL27fut7Di7G+HlX0rPM0O85Xi8iiXqVWiIbhOHsOsE0HF7PM1fJsILXOqpdfDLxfBKjsLiu7hix3hm6CWANeEtElQ93kQPkXuisvh2aQ=="}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:54:26.643968 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-a257e3d4-c295-4d6c-92ce-8a169f0eac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:54:26.649544 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-a257e3d4-c295-4d6c-92ce-8a169f0eac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:54:26.672754 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a257e3d4-c295-4d6c-92ce-8a169f0eac4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050443 Jul 26 20:54:26.673275 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3719/7357] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:54:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:54:32.115594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1719136733", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "635a74f1-4927-4eab-a1fb-36e5b40872f5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1754321235", "security_groups": [{"name": "tempest-secgroup-smoke-1723226365"}]}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:54:32.251228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.network.neutron [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] validate_networks() for [('635a74f1-4927-4eab-a1fb-36e5b40872f5', None, None, None, None, None)] {{(pid=125963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:54:32.681232 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:54:32.681665 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image limits 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:54:32.682173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:54:32.682592 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image pref 0:0:0 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:54:32.683013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.virt.hardware [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:54:32.692382 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:32.692769 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:32.693575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:32.694726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:32.712164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:54:32.717373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:54:32.730213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Going to run 1 instances... {{(pid=125963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:54:32.732674 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:54:32.780292 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-90ad4983-4866-4582-b41a-76c2816872ce tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.668722 Jul 26 20:54:32.787145 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3639/7358] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:54:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:54:32.793514 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7181be8d-f65b-4953-8e58-e267d4a4b96e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:32.794668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7181be8d-f65b-4953-8e58-e267d4a4b96e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:32.860991 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7181be8d-f65b-4953-8e58-e267d4a4b96e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:32.869822 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7181be8d-f65b-4953-8e58-e267d4a4b96e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1267 microversion: 2.1 time: 0.081175 Jul 26 20:54:32.870679 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3720/7359] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:32 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:54:33.892178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-be8e908a-d4c3-4338-8fa4-c44d41d72b0a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:33.893440 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-be8e908a-d4c3-4338-8fa4-c44d41d72b0a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:33.906003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be8e908a-d4c3-4338-8fa4-c44d41d72b0a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:33.906419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be8e908a-d4c3-4338-8fa4-c44d41d72b0a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:33.907407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be8e908a-d4c3-4338-8fa4-c44d41d72b0a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:33.907945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-be8e908a-d4c3-4338-8fa4-c44d41d72b0a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:34.002784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-be8e908a-d4c3-4338-8fa4-c44d41d72b0a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:34.013543 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-be8e908a-d4c3-4338-8fa4-c44d41d72b0a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1325 microversion: 2.1 time: 0.126644 Jul 26 20:54:34.014964 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3640/7360] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:33 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1325 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:35.036773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-8badbef9-d7cd-4255-8869-e5ddcd45ecc8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:35.037388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-8badbef9-d7cd-4255-8869-e5ddcd45ecc8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:35.043204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:54:35.045896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8badbef9-d7cd-4255-8869-e5ddcd45ecc8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:35.046335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8badbef9-d7cd-4255-8869-e5ddcd45ecc8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:35.047109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8badbef9-d7cd-4255-8869-e5ddcd45ecc8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:35.047545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-8badbef9-d7cd-4255-8869-e5ddcd45ecc8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:35.214835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-8badbef9-d7cd-4255-8869-e5ddcd45ecc8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:35.224129 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-8badbef9-d7cd-4255-8869-e5ddcd45ecc8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1393 microversion: 2.1 time: 0.191065 Jul 26 20:54:35.225015 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3721/7361] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:35 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1393 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:35.344193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-7826dcac-45b5-44cd-9dff-4065f4f2818b req-0b0d30de-f864-40f8-8e3b-dd02c427627f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cbd3779-ea40-4e44-a081-54bb54040c0f", "tag": "da0c02d3-d4f1-4d55-bccd-b2579bf4774a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:54:35.371656 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7826dcac-45b5-44cd-9dff-4065f4f2818b req-0b0d30de-f864-40f8-8e3b-dd02c427627f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:35.372193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-7826dcac-45b5-44cd-9dff-4065f4f2818b req-0b0d30de-f864-40f8-8e3b-dd02c427627f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:35.390539 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-7826dcac-45b5-44cd-9dff-4065f4f2818b req-0b0d30de-f864-40f8-8e3b-dd02c427627f service nova] Creating event network-changed:da0c02d3-d4f1-4d55-bccd-b2579bf4774a for instance 0cbd3779-ea40-4e44-a081-54bb54040c0f on n-h2-708768-8 Jul 26 20:54:35.397170 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-7826dcac-45b5-44cd-9dff-4065f4f2818b req-0b0d30de-f864-40f8-8e3b-dd02c427627f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057552 Jul 26 20:54:35.398271 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3641/7362] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:54:36.246627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e053e75a-2178-48e8-bdfd-263d74274f04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:36.247237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e053e75a-2178-48e8-bdfd-263d74274f04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:36.254209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e053e75a-2178-48e8-bdfd-263d74274f04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:36.254655 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e053e75a-2178-48e8-bdfd-263d74274f04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:36.255410 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e053e75a-2178-48e8-bdfd-263d74274f04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:36.255875 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e053e75a-2178-48e8-bdfd-263d74274f04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:36.386431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e053e75a-2178-48e8-bdfd-263d74274f04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:36.393802 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e053e75a-2178-48e8-bdfd-263d74274f04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1393 microversion: 2.1 time: 0.151045 Jul 26 20:54:36.394376 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3722/7363] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:36 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:37.416390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9e8a0ef2-0e2e-47dc-b88f-99a654d5d495 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:37.417107 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9e8a0ef2-0e2e-47dc-b88f-99a654d5d495 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:37.423320 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8a0ef2-0e2e-47dc-b88f-99a654d5d495 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:37.423816 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8a0ef2-0e2e-47dc-b88f-99a654d5d495 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:37.424589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8a0ef2-0e2e-47dc-b88f-99a654d5d495 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:37.425039 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9e8a0ef2-0e2e-47dc-b88f-99a654d5d495 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:37.575553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9e8a0ef2-0e2e-47dc-b88f-99a654d5d495 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:37.583650 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9e8a0ef2-0e2e-47dc-b88f-99a654d5d495 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1393 microversion: 2.1 time: 0.172493 Jul 26 20:54:37.584358 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3642/7364] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:37 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:38.606153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-91eb7f27-12df-4559-bdc9-4fa534208aa8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:38.606769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-91eb7f27-12df-4559-bdc9-4fa534208aa8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:38.613684 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91eb7f27-12df-4559-bdc9-4fa534208aa8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:38.614135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91eb7f27-12df-4559-bdc9-4fa534208aa8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:38.614908 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91eb7f27-12df-4559-bdc9-4fa534208aa8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:38.615347 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-91eb7f27-12df-4559-bdc9-4fa534208aa8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:38.753717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-91eb7f27-12df-4559-bdc9-4fa534208aa8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:38.761812 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-91eb7f27-12df-4559-bdc9-4fa534208aa8 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1393 microversion: 2.1 time: 0.159592 Jul 26 20:54:38.762377 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3723/7365] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:38 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:39.606092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-99dde31c-e94f-496e-86c9-e134cb497679 req-bf0f90b1-941b-4dac-8979-1d81a1f20ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbd3779-ea40-4e44-a081-54bb54040c0f", "name": "network-vif-plugged", "status": "completed", "tag": "da0c02d3-d4f1-4d55-bccd-b2579bf4774a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:54:39.619591 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-99dde31c-e94f-496e-86c9-e134cb497679 req-bf0f90b1-941b-4dac-8979-1d81a1f20ec6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:39.620076 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-99dde31c-e94f-496e-86c9-e134cb497679 req-bf0f90b1-941b-4dac-8979-1d81a1f20ec6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:39.631248 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-99dde31c-e94f-496e-86c9-e134cb497679 req-bf0f90b1-941b-4dac-8979-1d81a1f20ec6 service nova] Creating event network-vif-plugged:da0c02d3-d4f1-4d55-bccd-b2579bf4774a for instance 0cbd3779-ea40-4e44-a081-54bb54040c0f on n-h2-708768-8 Jul 26 20:54:39.636308 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-99dde31c-e94f-496e-86c9-e134cb497679 req-bf0f90b1-941b-4dac-8979-1d81a1f20ec6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033894 Jul 26 20:54:39.637090 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3643/7366] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 20:54:39.783097 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3b55280d-b20f-4830-9410-b8a50a141cdc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:39.784650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3b55280d-b20f-4830-9410-b8a50a141cdc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:39.792989 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b55280d-b20f-4830-9410-b8a50a141cdc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:39.793537 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b55280d-b20f-4830-9410-b8a50a141cdc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:39.794351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b55280d-b20f-4830-9410-b8a50a141cdc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:39.794785 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3b55280d-b20f-4830-9410-b8a50a141cdc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:39.927722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3b55280d-b20f-4830-9410-b8a50a141cdc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:39.935279 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3b55280d-b20f-4830-9410-b8a50a141cdc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1393 microversion: 2.1 time: 0.156712 Jul 26 20:54:39.936147 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3724/7367] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:39 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:40.956837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9ea95661-54c6-496f-a76f-5d93fffc54c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:40.957544 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9ea95661-54c6-496f-a76f-5d93fffc54c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:40.965029 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ea95661-54c6-496f-a76f-5d93fffc54c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:40.965481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ea95661-54c6-496f-a76f-5d93fffc54c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:40.966244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ea95661-54c6-496f-a76f-5d93fffc54c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:40.966688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9ea95661-54c6-496f-a76f-5d93fffc54c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:41.102949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9ea95661-54c6-496f-a76f-5d93fffc54c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:41.110564 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9ea95661-54c6-496f-a76f-5d93fffc54c1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1564 microversion: 2.1 time: 0.157963 Jul 26 20:54:41.111139 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3644/7368] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:40 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:41.131953 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c4323d30-4760-4c9c-962c-4605786d5cad tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:41.132574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c4323d30-4760-4c9c-962c-4605786d5cad tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:41.139319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4323d30-4760-4c9c-962c-4605786d5cad tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:41.139836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4323d30-4760-4c9c-962c-4605786d5cad tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:41.140597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4323d30-4760-4c9c-962c-4605786d5cad tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:41.141032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c4323d30-4760-4c9c-962c-4605786d5cad tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:41.283193 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c4323d30-4760-4c9c-962c-4605786d5cad tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:41.291520 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c4323d30-4760-4c9c-962c-4605786d5cad tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1564 microversion: 2.1 time: 0.163762 Jul 26 20:54:41.292126 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3725/7369] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:41 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:54:43.175082 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c09eb9ff-ef05-4e80-a72a-80851250e075 req-045711d5-79c4-495c-9782-ef49110d5683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cbd3779-ea40-4e44-a081-54bb54040c0f", "tag": "da0c02d3-d4f1-4d55-bccd-b2579bf4774a"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:54:43.182246 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1d860e5e-9ccf-444e-8ac5-3a2ca2c4ea3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:54:43.182885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1d860e5e-9ccf-444e-8ac5-3a2ca2c4ea3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:54:43.187111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:54:43.187833 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:54:43.192969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:54:43.197196 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d860e5e-9ccf-444e-8ac5-3a2ca2c4ea3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:43.197676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d860e5e-9ccf-444e-8ac5-3a2ca2c4ea3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:43.198486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d860e5e-9ccf-444e-8ac5-3a2ca2c4ea3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:43.198943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1d860e5e-9ccf-444e-8ac5-3a2ca2c4ea3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:43.203748 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c09eb9ff-ef05-4e80-a72a-80851250e075 req-045711d5-79c4-495c-9782-ef49110d5683 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:54:43.204203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c09eb9ff-ef05-4e80-a72a-80851250e075 req-045711d5-79c4-495c-9782-ef49110d5683 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:54:43.217205 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c09eb9ff-ef05-4e80-a72a-80851250e075 req-045711d5-79c4-495c-9782-ef49110d5683 service nova] Creating event network-changed:da0c02d3-d4f1-4d55-bccd-b2579bf4774a for instance 0cbd3779-ea40-4e44-a081-54bb54040c0f on n-h2-708768-8 Jul 26 20:54:43.223222 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c09eb9ff-ef05-4e80-a72a-80851250e075 req-045711d5-79c4-495c-9782-ef49110d5683 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051608 Jul 26 20:54:43.224248 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3726/7370] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:54:43.429952 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1d860e5e-9ccf-444e-8ac5-3a2ca2c4ea3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:54:43.438272 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1d860e5e-9ccf-444e-8ac5-3a2ca2c4ea3f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1564 microversion: 2.1 time: 0.269648 Jul 26 20:54:43.438939 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3645/7371] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:54:43 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:04.686755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:55:04.687565 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=32 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:55:04.738512 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bd045911-65f8-4597-8ff3-f49700d74c76 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:55:04.741017 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bd045911-65f8-4597-8ff3-f49700d74c76 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:04.747233 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd045911-65f8-4597-8ff3-f49700d74c76 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:04.747720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd045911-65f8-4597-8ff3-f49700d74c76 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:04.748487 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd045911-65f8-4597-8ff3-f49700d74c76 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:04.748931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bd045911-65f8-4597-8ff3-f49700d74c76 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:04.802036 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bd045911-65f8-4597-8ff3-f49700d74c76 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action" status: 200 len: 24564 microversion: 2.1 time: 0.117354 Jul 26 20:55:04.802644 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3727/7372] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:55:04 2022] POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action => generated 24564 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:55:15.759448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b244e08a-87a0-4b3c-a5a0-8af422ea1f55 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:55:15.761639 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:55:15.762414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=44 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:55:15.768740 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b244e08a-87a0-4b3c-a5a0-8af422ea1f55 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:15.769194 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b244e08a-87a0-4b3c-a5a0-8af422ea1f55 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:15.791900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b244e08a-87a0-4b3c-a5a0-8af422ea1f55 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Going to try to stop instance {{(pid=125963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 20:55:15.833993 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b244e08a-87a0-4b3c-a5a0-8af422ea1f55 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.079535 Jul 26 20:55:15.834607 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3646/7373] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:55:15 2022] POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:55:15.843545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a4571b9-c067-4014-b68c-7880bd1e9de3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:15.844222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a4571b9-c067-4014-b68c-7880bd1e9de3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:15.847111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:55:15.847862 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:55:15.857923 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a4571b9-c067-4014-b68c-7880bd1e9de3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:15.858398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a4571b9-c067-4014-b68c-7880bd1e9de3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:15.859164 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a4571b9-c067-4014-b68c-7880bd1e9de3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:15.859629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a4571b9-c067-4014-b68c-7880bd1e9de3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:15.992431 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4a4571b9-c067-4014-b68c-7880bd1e9de3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:15.999934 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a4571b9-c067-4014-b68c-7880bd1e9de3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.160717 Jul 26 20:55:16.000513 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3728/7374] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:15 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:55:17.024307 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-09ae901e-b488-470a-9164-c42c3ea8fe80 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:17.025063 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-09ae901e-b488-470a-9164-c42c3ea8fe80 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:17.031668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09ae901e-b488-470a-9164-c42c3ea8fe80 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:17.032138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09ae901e-b488-470a-9164-c42c3ea8fe80 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:17.032937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09ae901e-b488-470a-9164-c42c3ea8fe80 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:17.033393 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-09ae901e-b488-470a-9164-c42c3ea8fe80 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:17.163930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-09ae901e-b488-470a-9164-c42c3ea8fe80 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:17.171473 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-09ae901e-b488-470a-9164-c42c3ea8fe80 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.153120 Jul 26 20:55:17.172081 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3647/7375] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:17 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:18.193461 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-68ccea80-a9d4-412c-8d52-5c1fe505d74a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:18.194096 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-68ccea80-a9d4-412c-8d52-5c1fe505d74a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:18.201578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68ccea80-a9d4-412c-8d52-5c1fe505d74a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:18.202023 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68ccea80-a9d4-412c-8d52-5c1fe505d74a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:18.202787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68ccea80-a9d4-412c-8d52-5c1fe505d74a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:18.203218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-68ccea80-a9d4-412c-8d52-5c1fe505d74a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:18.340457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-68ccea80-a9d4-412c-8d52-5c1fe505d74a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:18.347991 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-68ccea80-a9d4-412c-8d52-5c1fe505d74a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.158360 Jul 26 20:55:18.348565 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3729/7376] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:18 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:19.369526 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1036682-8ff0-483d-af25-23dace89fce4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:19.370058 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1036682-8ff0-483d-af25-23dace89fce4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:19.377242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1036682-8ff0-483d-af25-23dace89fce4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:19.377699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1036682-8ff0-483d-af25-23dace89fce4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:19.378477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1036682-8ff0-483d-af25-23dace89fce4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:19.378927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1036682-8ff0-483d-af25-23dace89fce4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:19.515784 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1036682-8ff0-483d-af25-23dace89fce4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:19.523227 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1036682-8ff0-483d-af25-23dace89fce4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.157854 Jul 26 20:55:19.523825 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3648/7377] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:19 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:20.545704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aeacd6d6-33dc-422f-b49d-972ab4617a88 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:20.546319 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aeacd6d6-33dc-422f-b49d-972ab4617a88 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:20.553242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aeacd6d6-33dc-422f-b49d-972ab4617a88 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:20.553693 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aeacd6d6-33dc-422f-b49d-972ab4617a88 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:20.554459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aeacd6d6-33dc-422f-b49d-972ab4617a88 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:20.554903 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aeacd6d6-33dc-422f-b49d-972ab4617a88 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:20.685636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-aeacd6d6-33dc-422f-b49d-972ab4617a88 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:20.693336 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aeacd6d6-33dc-422f-b49d-972ab4617a88 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.151659 Jul 26 20:55:20.693918 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3730/7378] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:20 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:21.715199 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-89923f5a-5f8c-4d58-a1a1-5e3e582456e2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:21.715860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-89923f5a-5f8c-4d58-a1a1-5e3e582456e2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:21.723925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89923f5a-5f8c-4d58-a1a1-5e3e582456e2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:21.723925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89923f5a-5f8c-4d58-a1a1-5e3e582456e2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:21.725299 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89923f5a-5f8c-4d58-a1a1-5e3e582456e2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:21.725927 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-89923f5a-5f8c-4d58-a1a1-5e3e582456e2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:21.860237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-89923f5a-5f8c-4d58-a1a1-5e3e582456e2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:21.867708 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-89923f5a-5f8c-4d58-a1a1-5e3e582456e2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.157029 Jul 26 20:55:21.868920 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3649/7379] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:21 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:22.890415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-29751ebf-f457-4dcc-b99d-fa24d2584f01 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:22.891031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-29751ebf-f457-4dcc-b99d-fa24d2584f01 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:22.897994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29751ebf-f457-4dcc-b99d-fa24d2584f01 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:22.898449 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29751ebf-f457-4dcc-b99d-fa24d2584f01 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:22.899910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29751ebf-f457-4dcc-b99d-fa24d2584f01 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:22.900360 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-29751ebf-f457-4dcc-b99d-fa24d2584f01 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:23.033600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-29751ebf-f457-4dcc-b99d-fa24d2584f01 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:23.041795 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-29751ebf-f457-4dcc-b99d-fa24d2584f01 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.155321 Jul 26 20:55:23.042375 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3731/7380] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:22 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:24.063038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cac35b71-7f26-4de7-8b1d-836b434d0a9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:24.067670 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cac35b71-7f26-4de7-8b1d-836b434d0a9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:24.072915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cac35b71-7f26-4de7-8b1d-836b434d0a9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:24.073460 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cac35b71-7f26-4de7-8b1d-836b434d0a9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:24.074319 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cac35b71-7f26-4de7-8b1d-836b434d0a9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:24.074781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cac35b71-7f26-4de7-8b1d-836b434d0a9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:24.208528 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cac35b71-7f26-4de7-8b1d-836b434d0a9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:24.216989 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cac35b71-7f26-4de7-8b1d-836b434d0a9d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.158067 Jul 26 20:55:24.217570 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3650/7381] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:24 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:25.238650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-09b846b5-7aef-439a-bca0-b101ac5ccff1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:25.239267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-09b846b5-7aef-439a-bca0-b101ac5ccff1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:25.247201 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09b846b5-7aef-439a-bca0-b101ac5ccff1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:25.247695 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09b846b5-7aef-439a-bca0-b101ac5ccff1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:25.248456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09b846b5-7aef-439a-bca0-b101ac5ccff1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:25.249000 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-09b846b5-7aef-439a-bca0-b101ac5ccff1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:25.379029 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-09b846b5-7aef-439a-bca0-b101ac5ccff1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:25.386819 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-09b846b5-7aef-439a-bca0-b101ac5ccff1 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.152170 Jul 26 20:55:25.387403 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3732/7382] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:25 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:26.408523 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0574236-937e-43d2-bcae-811543d71fbd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:26.409074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0574236-937e-43d2-bcae-811543d71fbd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:26.416716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0574236-937e-43d2-bcae-811543d71fbd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:26.417173 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0574236-937e-43d2-bcae-811543d71fbd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:26.417945 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0574236-937e-43d2-bcae-811543d71fbd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:26.418396 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f0574236-937e-43d2-bcae-811543d71fbd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:26.551114 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0574236-937e-43d2-bcae-811543d71fbd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:26.558876 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0574236-937e-43d2-bcae-811543d71fbd tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.154397 Jul 26 20:55:26.559461 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3651/7383] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:26 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:27.580817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f86db88-a6d8-4325-99ea-679c9c42ef04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:27.581433 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f86db88-a6d8-4325-99ea-679c9c42ef04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:27.589382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f86db88-a6d8-4325-99ea-679c9c42ef04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:27.589835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f86db88-a6d8-4325-99ea-679c9c42ef04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:27.590611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f86db88-a6d8-4325-99ea-679c9c42ef04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:27.591063 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f86db88-a6d8-4325-99ea-679c9c42ef04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:27.725581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f86db88-a6d8-4325-99ea-679c9c42ef04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:27.733439 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f86db88-a6d8-4325-99ea-679c9c42ef04 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.156748 Jul 26 20:55:27.734013 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3733/7384] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:27 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:28.755706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3108748e-b038-4c11-a0a6-ebf9caee8870 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:28.756328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3108748e-b038-4c11-a0a6-ebf9caee8870 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:28.763425 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3108748e-b038-4c11-a0a6-ebf9caee8870 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:28.763911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3108748e-b038-4c11-a0a6-ebf9caee8870 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:28.764678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3108748e-b038-4c11-a0a6-ebf9caee8870 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:28.765118 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3108748e-b038-4c11-a0a6-ebf9caee8870 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:28.901160 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3108748e-b038-4c11-a0a6-ebf9caee8870 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:28.908603 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3108748e-b038-4c11-a0a6-ebf9caee8870 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.156823 Jul 26 20:55:28.909174 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3652/7385] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:28 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:55:29.930196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4c9a1b6f-5589-4227-888d-5f952c008db3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:29.930890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4c9a1b6f-5589-4227-888d-5f952c008db3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:29.938698 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c9a1b6f-5589-4227-888d-5f952c008db3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:29.939146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c9a1b6f-5589-4227-888d-5f952c008db3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:29.939949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c9a1b6f-5589-4227-888d-5f952c008db3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:29.940386 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4c9a1b6f-5589-4227-888d-5f952c008db3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:30.073843 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4c9a1b6f-5589-4227-888d-5f952c008db3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:30.081435 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4c9a1b6f-5589-4227-888d-5f952c008db3 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.155100 Jul 26 20:55:30.082009 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3734/7386] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:29 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:31.103714 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9cc5b188-57de-4029-8421-989caa901036 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:31.104335 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9cc5b188-57de-4029-8421-989caa901036 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:31.111221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cc5b188-57de-4029-8421-989caa901036 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:31.111701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cc5b188-57de-4029-8421-989caa901036 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:31.112471 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cc5b188-57de-4029-8421-989caa901036 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:31.112917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9cc5b188-57de-4029-8421-989caa901036 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:31.250043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9cc5b188-57de-4029-8421-989caa901036 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:31.257476 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9cc5b188-57de-4029-8421-989caa901036 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1692 microversion: 2.1 time: 0.157643 Jul 26 20:55:31.258056 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3653/7387] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:31 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:32.279113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d6044151-e91b-4b05-ba88-1b1b83c89728 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:32.279664 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d6044151-e91b-4b05-ba88-1b1b83c89728 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:32.286568 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6044151-e91b-4b05-ba88-1b1b83c89728 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:32.287018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6044151-e91b-4b05-ba88-1b1b83c89728 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:32.287816 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6044151-e91b-4b05-ba88-1b1b83c89728 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:32.288260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d6044151-e91b-4b05-ba88-1b1b83c89728 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:32.420213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d6044151-e91b-4b05-ba88-1b1b83c89728 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:32.427876 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d6044151-e91b-4b05-ba88-1b1b83c89728 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1669 microversion: 2.1 time: 0.152751 Jul 26 20:55:32.428462 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3735/7388] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:32 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:33.519342 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e56b3b97-d002-4998-a3a4-a229066508db tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:55:33.521586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e56b3b97-d002-4998-a3a4-a229066508db tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:33.529176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e56b3b97-d002-4998-a3a4-a229066508db tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:33.529641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e56b3b97-d002-4998-a3a4-a229066508db tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:33.530430 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e56b3b97-d002-4998-a3a4-a229066508db tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:33.530895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e56b3b97-d002-4998-a3a4-a229066508db tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:33.581058 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e56b3b97-d002-4998-a3a4-a229066508db tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action" status: 200 len: 38348 microversion: 2.1 time: 0.065459 Jul 26 20:55:33.581699 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3654/7389] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:55:33 2022] POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action => generated 38348 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:55:33.595065 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-74e4baa4-4090-4188-9a9b-b0d5ee9f8b77 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:55:33.602120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74e4baa4-4090-4188-9a9b-b0d5ee9f8b77 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:33.602636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-74e4baa4-4090-4188-9a9b-b0d5ee9f8b77 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:33.624273 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-74e4baa4-4090-4188-9a9b-b0d5ee9f8b77 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Going to try to start instance {{(pid=125964) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 20:55:33.665682 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-74e4baa4-4090-4188-9a9b-b0d5ee9f8b77 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.074064 Jul 26 20:55:33.666291 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3736/7390] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:55:33 2022] POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:55:33.675499 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2fca7227-cf5c-42f6-96c2-10c155bca7d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:33.676359 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2fca7227-cf5c-42f6-96c2-10c155bca7d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:33.685088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fca7227-cf5c-42f6-96c2-10c155bca7d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:33.685937 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fca7227-cf5c-42f6-96c2-10c155bca7d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:33.686502 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fca7227-cf5c-42f6-96c2-10c155bca7d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:33.687229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2fca7227-cf5c-42f6-96c2-10c155bca7d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:33.916024 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2fca7227-cf5c-42f6-96c2-10c155bca7d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:33.923948 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2fca7227-cf5c-42f6-96c2-10c155bca7d9 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1678 microversion: 2.1 time: 0.252685 Jul 26 20:55:33.924534 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3655/7391] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:33 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:34.947890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-48b4e0e4-4b5f-4b88-80de-f1878841c094 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:55:34.948528 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-48b4e0e4-4b5f-4b88-80de-f1878841c094 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:34.954818 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48b4e0e4-4b5f-4b88-80de-f1878841c094 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:34.955256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48b4e0e4-4b5f-4b88-80de-f1878841c094 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:34.956057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48b4e0e4-4b5f-4b88-80de-f1878841c094 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:34.956499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48b4e0e4-4b5f-4b88-80de-f1878841c094 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:35.091508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-48b4e0e4-4b5f-4b88-80de-f1878841c094 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:55:35.099119 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-48b4e0e4-4b5f-4b88-80de-f1878841c094 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1682 microversion: 2.1 time: 0.157090 Jul 26 20:55:35.099720 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3737/7392] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:55:34 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:55:59.288126 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3d2181f3-0038-47e8-aeaa-dc7c1bbe9cff tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:55:59.290921 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3d2181f3-0038-47e8-aeaa-dc7c1bbe9cff tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:55:59.293728 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=20 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:55:59.294403 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:55:59.300676 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d2181f3-0038-47e8-aeaa-dc7c1bbe9cff tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:59.301131 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d2181f3-0038-47e8-aeaa-dc7c1bbe9cff tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:59.301919 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d2181f3-0038-47e8-aeaa-dc7c1bbe9cff tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:55:59.302370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3d2181f3-0038-47e8-aeaa-dc7c1bbe9cff tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:55:59.355885 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3d2181f3-0038-47e8-aeaa-dc7c1bbe9cff tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action" status: 200 len: 62881 microversion: 2.1 time: 0.071992 Jul 26 20:55:59.356571 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3656/7393] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:55:59 2022] POST /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f/action => generated 62881 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:56:06.424320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-5a64d305-00aa-4a32-881a-095deed5e8d0 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:06.430222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-e1599b87-f159-4f2a-83b0-05d29ae12b9c req-4ee897a7-e013-44c6-ad76-7482fc4dd989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cbd3779-ea40-4e44-a081-54bb54040c0f", "tag": "da0c02d3-d4f1-4d55-bccd-b2579bf4774a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:56:06.431451 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a64d305-00aa-4a32-881a-095deed5e8d0 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:06.434132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=20 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:06.441441 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:06.446002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e1599b87-f159-4f2a-83b0-05d29ae12b9c req-4ee897a7-e013-44c6-ad76-7482fc4dd989 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:06.446436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-e1599b87-f159-4f2a-83b0-05d29ae12b9c req-4ee897a7-e013-44c6-ad76-7482fc4dd989 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:06.447511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a64d305-00aa-4a32-881a-095deed5e8d0 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:06.448073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a64d305-00aa-4a32-881a-095deed5e8d0 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:06.449135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a64d305-00aa-4a32-881a-095deed5e8d0 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:06.449657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-5a64d305-00aa-4a32-881a-095deed5e8d0 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:06.458517 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-e1599b87-f159-4f2a-83b0-05d29ae12b9c req-4ee897a7-e013-44c6-ad76-7482fc4dd989 service nova] Creating event network-changed:da0c02d3-d4f1-4d55-bccd-b2579bf4774a for instance 0cbd3779-ea40-4e44-a081-54bb54040c0f on n-h2-708768-8 Jul 26 20:56:06.464160 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-e1599b87-f159-4f2a-83b0-05d29ae12b9c req-4ee897a7-e013-44c6-ad76-7482fc4dd989 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037841 Jul 26 20:56:06.464994 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3657/7394] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:56:06.479491 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-5a64d305-00aa-4a32-881a-095deed5e8d0 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:56:06.568446 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-5a64d305-00aa-4a32-881a-095deed5e8d0 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 204 len: 0 microversion: 2.1 time: 0.147545 Jul 26 20:56:06.569548 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3738/7395] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:56:06 2022] DELETE /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:56:06.580259 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9f105e6f-f100-44a1-8544-d095827c2b07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:06.580979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9f105e6f-f100-44a1-8544-d095827c2b07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:06.588746 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f105e6f-f100-44a1-8544-d095827c2b07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:06.589207 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f105e6f-f100-44a1-8544-d095827c2b07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:06.589998 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f105e6f-f100-44a1-8544-d095827c2b07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:06.591314 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9f105e6f-f100-44a1-8544-d095827c2b07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:06.750809 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9f105e6f-f100-44a1-8544-d095827c2b07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:06.758357 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9f105e6f-f100-44a1-8544-d095827c2b07 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1688 microversion: 2.1 time: 0.183044 Jul 26 20:56:06.760611 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3658/7396] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:06 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:07.782253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0e2f20da-9093-4158-80aa-f2b13cac0ac2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:07.782972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0e2f20da-9093-4158-80aa-f2b13cac0ac2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:07.790673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e2f20da-9093-4158-80aa-f2b13cac0ac2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:07.791132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e2f20da-9093-4158-80aa-f2b13cac0ac2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:07.791950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e2f20da-9093-4158-80aa-f2b13cac0ac2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:07.792398 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e2f20da-9093-4158-80aa-f2b13cac0ac2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:07.927835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0e2f20da-9093-4158-80aa-f2b13cac0ac2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:07.935698 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0e2f20da-9093-4158-80aa-f2b13cac0ac2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1688 microversion: 2.1 time: 0.157681 Jul 26 20:56:07.936288 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3739/7397] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:07 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:08.671545 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-67e4f40b-0be8-491d-a281-84509a650c64 req-e1f72324-9b32-4e26-b7e4-e85762bc0757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbd3779-ea40-4e44-a081-54bb54040c0f", "name": "network-vif-deleted", "tag": "da0c02d3-d4f1-4d55-bccd-b2579bf4774a"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:56:08.684224 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-67e4f40b-0be8-491d-a281-84509a650c64 req-e1f72324-9b32-4e26-b7e4-e85762bc0757 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:08.685018 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-67e4f40b-0be8-491d-a281-84509a650c64 req-e1f72324-9b32-4e26-b7e4-e85762bc0757 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:08.700093 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-67e4f40b-0be8-491d-a281-84509a650c64 req-e1f72324-9b32-4e26-b7e4-e85762bc0757 service nova] Creating event network-vif-deleted:da0c02d3-d4f1-4d55-bccd-b2579bf4774a for instance 0cbd3779-ea40-4e44-a081-54bb54040c0f on n-h2-708768-8 Jul 26 20:56:08.708064 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-67e4f40b-0be8-491d-a281-84509a650c64 req-e1f72324-9b32-4e26-b7e4-e85762bc0757 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040203 Jul 26 20:56:08.708686 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3659/7398] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:56:08.958432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:08.959081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:08.967054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:08.967506 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:08.968345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:08.968782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:09.006922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:09.007507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:09.008038 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lazy-loading 'fault' on Instance uuid 0cbd3779-ea40-4e44-a081-54bb54040c0f {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:56:09.061375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:09.070204 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4112ea9d-ec53-4546-b292-b3b8a1bce537 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 200 len: 1357 microversion: 2.1 time: 0.115613 Jul 26 20:56:09.075590 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3740/7399] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:08 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 1357 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:10.098034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:10.098752 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: 0cbd3779-ea40-4e44-a081-54bb54040c0f] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:10.105908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:10.106374 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:10.107156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:10.107631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:10.121463 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] HTTP exception thrown: Instance 0cbd3779-ea40-4e44-a081-54bb54040c0f could not be found. Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Request method failure captured: Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f HTTP/1.1 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FNoxa1srlcvH6r_yC7S2A1Gpmd7eRmaEPJLohqg5KwlBmToGSscey-8jKCumBHfCYTXvguGGlopnfORkXL6tF-VV_3Wx74xjuSG8Xyn2a44PloGF7Fy20kjidPR73Z1sde9RoW9DtFMWfc1zl2jD8ktKip3Ix8reW1kLveuLT8Psaw Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f9b9fa87c564bfc827b8ef31ecd2309", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}] Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7dbc7e95221342da8d288a98b4cb4bee Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 0cbd3779-ea40-4e44-a081-54bb54040c0f could not be found. Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '0cbd3779-ea40-4e44-a081-54bb54040c0f'} Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbd3779-ea40-4e44-a081-54bb54040c0f could not be found. Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbd3779-ea40-4e44-a081-54bb54040c0f could not be found. Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:56:10.123031 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbd3779-ea40-4e44-a081-54bb54040c0f could not be found. Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Returning 404 to user: Instance 0cbd3779-ea40-4e44-a081-54bb54040c0f could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3ac4671b-7dde-48e1-b0da-059af9a6698e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f" status: 404 len: 111 microversion: 2.1 time: 0.031669 Jul 26 20:56:10.127938 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3660/7400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:10 2022] GET /compute/v2.1/servers/0cbd3779-ea40-4e44-a081-54bb54040c0f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:56:13.355277 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-848df227-0cc0-4a27-b0be-dc794da600f6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '.version_select at 0x7f87570f6d30>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:13.375453 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-848df227-0cc0-4a27-b0be-dc794da600f6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1754321235" status: 202 len: 0 microversion: 2.1 time: 0.023861 Jul 26 20:56:13.376626 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3741/7401] 10.222.0.58 () {58 vars in 1284 bytes} [Tue Jul 26 20:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1754321235 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:56:13.411401 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5d019084-9ae8-43b8-84d4-08d5a4aeb96f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: .version_select at 0x7f875c7a03a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1019417231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw49b4u7B6XLDPEnkJnOF8vafXuzEMMDUDEugGCYLHT2jv1em4JsGTtp3rqsywQoyHYL88eo8ScnxdQsUAQJ82ze57nnhcsYFfhxohJ7RDk/XABylGGPdSix67KTeDZuQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:56:13.427984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-5d019084-9ae8-43b8-84d4-08d5a4aeb96f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:56:13.433070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-5d019084-9ae8-43b8-84d4-08d5a4aeb96f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:56:13.458387 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5d019084-9ae8-43b8-84d4-08d5a4aeb96f tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050912 Jul 26 20:56:13.458983 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3661/7402] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:56:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:56:19.183225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2116152905", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "networks": [{"uuid": "0d3d6f68-9884-4319-bd2e-60594710dabf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1019417231", "security_groups": [{"name": "tempest-secgroup-smoke-1701246877"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:56:19.194427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:19.305569 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] validate_networks() for [('0d3d6f68-9884-4319-bd2e-60594710dabf', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:56:19.817912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:56:19.818526 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:56:19.819101 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:56:19.819648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:56:19.820317 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:56:19.829853 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:19.830661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:19.831674 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:19.832171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:19.850214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:56:19.856669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Getting quotas for user 7dbc7e95221342da8d288a98b4cb4bee and project 2f9b9fa87c564bfc827b8ef31ecd2309. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:56:19.870447 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:56:19.872780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:56:19.926147 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-418436ae-970f-4524-bab3-cadad7919346 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745982 Jul 26 20:56:19.927461 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3742/7403] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:56:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:56:19.939106 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9685f969-edda-4ea4-b57a-2f523a5f2625 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:19.940877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9685f969-edda-4ea4-b57a-2f523a5f2625 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:19.997461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9685f969-edda-4ea4-b57a-2f523a5f2625 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:20.005007 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9685f969-edda-4ea4-b57a-2f523a5f2625 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1267 microversion: 2.1 time: 0.069956 Jul 26 20:56:20.005907 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3662/7404] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:19 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:21.026673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fd5a89c1-d77a-4c41-8100-8bab2480ce58 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:21.028732 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fd5a89c1-d77a-4c41-8100-8bab2480ce58 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:21.091802 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fd5a89c1-d77a-4c41-8100-8bab2480ce58 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:21.101373 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fd5a89c1-d77a-4c41-8100-8bab2480ce58 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1267 microversion: 2.1 time: 0.078716 Jul 26 20:56:21.102306 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3743/7405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:21 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:22.122365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1b2b4c45-09c1-46b3-a54f-e135ded11898 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:22.123083 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1b2b4c45-09c1-46b3-a54f-e135ded11898 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:22.126415 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=16 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:22.182556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1b2b4c45-09c1-46b3-a54f-e135ded11898 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:22.189691 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1b2b4c45-09c1-46b3-a54f-e135ded11898 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1267 microversion: 2.1 time: 0.071223 Jul 26 20:56:22.190289 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3663/7406] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:22 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:23.212253 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-744ace66-422a-44e2-84ec-4229f1f6a06e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:23.212873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-744ace66-422a-44e2-84ec-4229f1f6a06e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:23.266422 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-744ace66-422a-44e2-84ec-4229f1f6a06e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:23.273777 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-744ace66-422a-44e2-84ec-4229f1f6a06e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1267 microversion: 2.1 time: 0.066323 Jul 26 20:56:23.275073 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3744/7407] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:23 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:24.295675 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d22dcc40-3f28-4d8a-ab87-3091ceb9737a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:24.296380 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d22dcc40-3f28-4d8a-ab87-3091ceb9737a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:24.303786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d22dcc40-3f28-4d8a-ab87-3091ceb9737a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:24.304254 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d22dcc40-3f28-4d8a-ab87-3091ceb9737a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:24.305558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d22dcc40-3f28-4d8a-ab87-3091ceb9737a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:24.306032 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d22dcc40-3f28-4d8a-ab87-3091ceb9737a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:24.368905 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d22dcc40-3f28-4d8a-ab87-3091ceb9737a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:24.376360 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d22dcc40-3f28-4d8a-ab87-3091ceb9737a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1271 microversion: 2.1 time: 0.084710 Jul 26 20:56:24.376927 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3664/7408] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:24 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:25.398010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-48eaa342-a705-4b99-bb07-d26bfc87cdd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:25.398564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-48eaa342-a705-4b99-bb07-d26bfc87cdd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:25.407202 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48eaa342-a705-4b99-bb07-d26bfc87cdd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:25.407679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48eaa342-a705-4b99-bb07-d26bfc87cdd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:25.408462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48eaa342-a705-4b99-bb07-d26bfc87cdd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:25.408900 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-48eaa342-a705-4b99-bb07-d26bfc87cdd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:25.522803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-48eaa342-a705-4b99-bb07-d26bfc87cdd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:25.530916 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-48eaa342-a705-4b99-bb07-d26bfc87cdd6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1325 microversion: 2.1 time: 0.136904 Jul 26 20:56:25.531498 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3745/7409] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:25 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1325 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:26.552990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0948a552-fcd0-4ffc-88b7-0b1501dbd4de tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:26.553690 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0948a552-fcd0-4ffc-88b7-0b1501dbd4de tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:26.561511 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0948a552-fcd0-4ffc-88b7-0b1501dbd4de tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:26.561977 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0948a552-fcd0-4ffc-88b7-0b1501dbd4de tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:26.562774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0948a552-fcd0-4ffc-88b7-0b1501dbd4de tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:26.563522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0948a552-fcd0-4ffc-88b7-0b1501dbd4de tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:26.616052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-a46306ad-454f-478b-9bf9-0d20232ff968 req-b17d57d5-243e-448a-9689-c76a4f6f12ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a", "tag": "593abdf0-5468-4fee-b221-c9ddd528b510"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:56:26.631497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a46306ad-454f-478b-9bf9-0d20232ff968 req-b17d57d5-243e-448a-9689-c76a4f6f12ae service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:26.632504 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-a46306ad-454f-478b-9bf9-0d20232ff968 req-b17d57d5-243e-448a-9689-c76a4f6f12ae service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:26.646471 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-a46306ad-454f-478b-9bf9-0d20232ff968 req-b17d57d5-243e-448a-9689-c76a4f6f12ae service nova] Creating event network-changed:593abdf0-5468-4fee-b221-c9ddd528b510 for instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a on n-h1-708768-8 Jul 26 20:56:26.651597 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-a46306ad-454f-478b-9bf9-0d20232ff968 req-b17d57d5-243e-448a-9689-c76a4f6f12ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039458 Jul 26 20:56:26.653221 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3746/7410] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:56:26.757075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0948a552-fcd0-4ffc-88b7-0b1501dbd4de tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:26.766958 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0948a552-fcd0-4ffc-88b7-0b1501dbd4de tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1393 microversion: 2.1 time: 0.217626 Jul 26 20:56:26.767565 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3665/7411] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:26 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1393 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:56:27.790657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-03865d23-068d-47c3-ae00-20a004678c28 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:27.791454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-03865d23-068d-47c3-ae00-20a004678c28 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:27.797833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03865d23-068d-47c3-ae00-20a004678c28 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:27.798304 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03865d23-068d-47c3-ae00-20a004678c28 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:27.799055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03865d23-068d-47c3-ae00-20a004678c28 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:27.799493 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-03865d23-068d-47c3-ae00-20a004678c28 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:28.021979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-03865d23-068d-47c3-ae00-20a004678c28 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:28.030572 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-03865d23-068d-47c3-ae00-20a004678c28 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1393 microversion: 2.1 time: 0.245612 Jul 26 20:56:28.031161 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3747/7412] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:27 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1393 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:29.051257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8dd1a0c3-42be-4ff3-a929-b688f9da0c74 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:29.051930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8dd1a0c3-42be-4ff3-a929-b688f9da0c74 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:29.059172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8dd1a0c3-42be-4ff3-a929-b688f9da0c74 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:29.059658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8dd1a0c3-42be-4ff3-a929-b688f9da0c74 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:29.060441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8dd1a0c3-42be-4ff3-a929-b688f9da0c74 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:29.060895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8dd1a0c3-42be-4ff3-a929-b688f9da0c74 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:29.189586 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8dd1a0c3-42be-4ff3-a929-b688f9da0c74 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:29.197560 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8dd1a0c3-42be-4ff3-a929-b688f9da0c74 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1393 microversion: 2.1 time: 0.150209 Jul 26 20:56:29.198131 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3666/7413] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:29 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:30.218415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12554d7c-a19f-487d-bf8e-8a43e2e19a1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:30.219021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-12554d7c-a19f-487d-bf8e-8a43e2e19a1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:30.221836 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:30.227448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12554d7c-a19f-487d-bf8e-8a43e2e19a1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:30.227911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12554d7c-a19f-487d-bf8e-8a43e2e19a1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:30.228673 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12554d7c-a19f-487d-bf8e-8a43e2e19a1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:30.229104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12554d7c-a19f-487d-bf8e-8a43e2e19a1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:30.364873 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-12554d7c-a19f-487d-bf8e-8a43e2e19a1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:30.372683 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-12554d7c-a19f-487d-bf8e-8a43e2e19a1d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1393 microversion: 2.1 time: 0.158029 Jul 26 20:56:30.373496 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3748/7414] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:30 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:30.612127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5c795a67-6d5b-4732-8987-c32ba288f13a req-39152d3b-3982-4688-8642-442dd98879e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a", "name": "network-vif-plugged", "status": "completed", "tag": "593abdf0-5468-4fee-b221-c9ddd528b510"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:56:30.618436 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:30.624736 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5c795a67-6d5b-4732-8987-c32ba288f13a req-39152d3b-3982-4688-8642-442dd98879e6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:30.625188 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5c795a67-6d5b-4732-8987-c32ba288f13a req-39152d3b-3982-4688-8642-442dd98879e6 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:30.636514 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5c795a67-6d5b-4732-8987-c32ba288f13a req-39152d3b-3982-4688-8642-442dd98879e6 service nova] Creating event network-vif-plugged:593abdf0-5468-4fee-b221-c9ddd528b510 for instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a on n-h1-708768-8 Jul 26 20:56:30.641709 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5c795a67-6d5b-4732-8987-c32ba288f13a req-39152d3b-3982-4688-8642-442dd98879e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033253 Jul 26 20:56:30.642356 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3667/7415] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:56:31.394726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2d679fc5-ae66-4aaf-9f3c-61d141040d3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:31.395349 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2d679fc5-ae66-4aaf-9f3c-61d141040d3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:31.402855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d679fc5-ae66-4aaf-9f3c-61d141040d3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:31.403310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d679fc5-ae66-4aaf-9f3c-61d141040d3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:31.404111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d679fc5-ae66-4aaf-9f3c-61d141040d3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:31.404555 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d679fc5-ae66-4aaf-9f3c-61d141040d3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:31.537062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2d679fc5-ae66-4aaf-9f3c-61d141040d3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:31.545548 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2d679fc5-ae66-4aaf-9f3c-61d141040d3e tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1393 microversion: 2.1 time: 0.154757 Jul 26 20:56:31.546163 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3749/7416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:31 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:32.565349 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=8 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:32.569532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-df2d6d07-ed93-45a0-852f-6a1a9fcc34d6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:32.570235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-df2d6d07-ed93-45a0-852f-6a1a9fcc34d6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:32.576898 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df2d6d07-ed93-45a0-852f-6a1a9fcc34d6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:32.577355 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df2d6d07-ed93-45a0-852f-6a1a9fcc34d6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:32.578127 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df2d6d07-ed93-45a0-852f-6a1a9fcc34d6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:32.578575 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-df2d6d07-ed93-45a0-852f-6a1a9fcc34d6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:32.713193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-df2d6d07-ed93-45a0-852f-6a1a9fcc34d6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:32.720816 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-df2d6d07-ed93-45a0-852f-6a1a9fcc34d6 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1565 microversion: 2.1 time: 0.157598 Jul 26 20:56:32.721396 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3668/7417] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:32 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:32.741450 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-12c14ff9-c5a7-457c-9c1e-756462de7c4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:32.742163 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-12c14ff9-c5a7-457c-9c1e-756462de7c4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:32.749689 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12c14ff9-c5a7-457c-9c1e-756462de7c4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:32.750130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12c14ff9-c5a7-457c-9c1e-756462de7c4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:32.750889 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12c14ff9-c5a7-457c-9c1e-756462de7c4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:32.751325 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-12c14ff9-c5a7-457c-9c1e-756462de7c4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:32.885091 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-12c14ff9-c5a7-457c-9c1e-756462de7c4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:32.892560 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-12c14ff9-c5a7-457c-9c1e-756462de7c4d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1565 microversion: 2.1 time: 0.154918 Jul 26 20:56:32.893136 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3750/7418] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:32 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:34.471019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e72ff430-e90e-449a-aa0f-5ecdcc7d054c req-4773dd65-c131-47af-90d9-6718f816ca40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a", "tag": "593abdf0-5468-4fee-b221-c9ddd528b510"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:56:34.471929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e34f57aa-b71f-4efb-b927-bc6300e00610 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:56:34.472590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e34f57aa-b71f-4efb-b927-bc6300e00610 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:34.482182 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e34f57aa-b71f-4efb-b927-bc6300e00610 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:34.482661 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e34f57aa-b71f-4efb-b927-bc6300e00610 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:34.483463 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e34f57aa-b71f-4efb-b927-bc6300e00610 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:34.483957 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e34f57aa-b71f-4efb-b927-bc6300e00610 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:34.484918 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:34.491696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e72ff430-e90e-449a-aa0f-5ecdcc7d054c req-4773dd65-c131-47af-90d9-6718f816ca40 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:34.492364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e72ff430-e90e-449a-aa0f-5ecdcc7d054c req-4773dd65-c131-47af-90d9-6718f816ca40 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:34.505318 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e72ff430-e90e-449a-aa0f-5ecdcc7d054c req-4773dd65-c131-47af-90d9-6718f816ca40 service nova] Creating event network-changed:593abdf0-5468-4fee-b221-c9ddd528b510 for instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a on n-h1-708768-8 Jul 26 20:56:34.510553 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e72ff430-e90e-449a-aa0f-5ecdcc7d054c req-4773dd65-c131-47af-90d9-6718f816ca40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043021 Jul 26 20:56:34.511244 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3751/7419] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:56:34.635729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e34f57aa-b71f-4efb-b927-bc6300e00610 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:56:34.643756 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e34f57aa-b71f-4efb-b927-bc6300e00610 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1565 microversion: 2.1 time: 0.181548 Jul 26 20:56:34.644695 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3669/7420] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:56:34 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:56:55.895345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-15e55722-7d15-42a8-b7c3-a028a0fefd2d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:56:55.897656 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-15e55722-7d15-42a8-b7c3-a028a0fefd2d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:56:55.900753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:55.901834 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=36 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:56:55.908117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15e55722-7d15-42a8-b7c3-a028a0fefd2d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:55.908572 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15e55722-7d15-42a8-b7c3-a028a0fefd2d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:55.909352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15e55722-7d15-42a8-b7c3-a028a0fefd2d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:56:55.909792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-15e55722-7d15-42a8-b7c3-a028a0fefd2d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:56:55.974037 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-15e55722-7d15-42a8-b7c3-a028a0fefd2d tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action" status: 200 len: 24566 microversion: 2.1 time: 0.082748 Jul 26 20:56:55.974717 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3752/7421] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:56:55 2022] POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action => generated 24566 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:57:06.992172 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-81a15573-700d-483b-9e2d-c1b7e9612f9a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:06.992724 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-81a15573-700d-483b-9e2d-c1b7e9612f9a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:06.995023 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=5 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:06.995735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=32 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:07.001397 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81a15573-700d-483b-9e2d-c1b7e9612f9a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:07.001860 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81a15573-700d-483b-9e2d-c1b7e9612f9a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:07.002648 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81a15573-700d-483b-9e2d-c1b7e9612f9a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:07.003097 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-81a15573-700d-483b-9e2d-c1b7e9612f9a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:07.026780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-81a15573-700d-483b-9e2d-c1b7e9612f9a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lazy-loading 'flavor' on Instance uuid f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:57:07.094498 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-81a15573-700d-483b-9e2d-c1b7e9612f9a tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action" status: 202 len: 0 microversion: 2.1 time: 0.106086 Jul 26 20:57:07.095133 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3670/7422] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:57:06 2022] POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:57:07.103933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c004a9b4-9d87-45c0-abd4-c25af2339718 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:07.104642 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c004a9b4-9d87-45c0-abd4-c25af2339718 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:07.107188 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=4 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:07.107886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:07.116878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c004a9b4-9d87-45c0-abd4-c25af2339718 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:07.117327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c004a9b4-9d87-45c0-abd4-c25af2339718 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:07.118102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c004a9b4-9d87-45c0-abd4-c25af2339718 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:07.118540 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c004a9b4-9d87-45c0-abd4-c25af2339718 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:07.558630 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-c004a9b4-9d87-45c0-abd4-c25af2339718 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:07.567100 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c004a9b4-9d87-45c0-abd4-c25af2339718 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1692 microversion: 2.1 time: 0.467582 Jul 26 20:57:07.567687 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3753/7423] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:07 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1692 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:08.591214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c590cc29-91ce-4603-9966-74fb3719a3c5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:08.592568 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c590cc29-91ce-4603-9966-74fb3719a3c5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:08.598813 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c590cc29-91ce-4603-9966-74fb3719a3c5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:08.599274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c590cc29-91ce-4603-9966-74fb3719a3c5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:08.600081 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c590cc29-91ce-4603-9966-74fb3719a3c5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:08.600532 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c590cc29-91ce-4603-9966-74fb3719a3c5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:08.734378 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c590cc29-91ce-4603-9966-74fb3719a3c5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:08.741917 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c590cc29-91ce-4603-9966-74fb3719a3c5 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1675 microversion: 2.1 time: 0.156052 Jul 26 20:57:08.742490 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3671/7424] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:08 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:09.836868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ad5600bf-8f2c-4f2c-8804-ceea2f47fc83 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:09.839147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ad5600bf-8f2c-4f2c-8804-ceea2f47fc83 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:09.847928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5600bf-8f2c-4f2c-8804-ceea2f47fc83 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:09.848392 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5600bf-8f2c-4f2c-8804-ceea2f47fc83 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:09.849168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5600bf-8f2c-4f2c-8804-ceea2f47fc83 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:09.849611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ad5600bf-8f2c-4f2c-8804-ceea2f47fc83 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:09.900689 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ad5600bf-8f2c-4f2c-8804-ceea2f47fc83 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action" status: 200 len: 38378 microversion: 2.1 time: 0.067450 Jul 26 20:57:09.908879 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3754/7425] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:57:09 2022] POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action => generated 38378 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 20:57:09.913973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c5ceb585-b550-4c50-a5b9-86e01dfc64bc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:09.914514 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c5ceb585-b550-4c50-a5b9-86e01dfc64bc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:09.922373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5ceb585-b550-4c50-a5b9-86e01dfc64bc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:09.922831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5ceb585-b550-4c50-a5b9-86e01dfc64bc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:09.923792 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5ceb585-b550-4c50-a5b9-86e01dfc64bc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:09.924247 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c5ceb585-b550-4c50-a5b9-86e01dfc64bc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:09.990460 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c5ceb585-b550-4c50-a5b9-86e01dfc64bc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action" status: 202 len: 0 microversion: 2.1 time: 0.080183 Jul 26 20:57:09.994452 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3672/7426] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:57:09 2022] POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 20:57:10.000998 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b7976f1c-c215-4661-aa00-c391bdfc5848 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:10.001810 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b7976f1c-c215-4661-aa00-c391bdfc5848 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:10.010214 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7976f1c-c215-4661-aa00-c391bdfc5848 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:10.010764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7976f1c-c215-4661-aa00-c391bdfc5848 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:10.011696 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7976f1c-c215-4661-aa00-c391bdfc5848 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:10.012138 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b7976f1c-c215-4661-aa00-c391bdfc5848 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:10.247885 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b7976f1c-c215-4661-aa00-c391bdfc5848 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:10.256643 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b7976f1c-c215-4661-aa00-c391bdfc5848 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1681 microversion: 2.1 time: 0.260538 Jul 26 20:57:10.257602 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3755/7427] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:09 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:11.282208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-558ad6e6-e544-40fd-a068-575595e48e15 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:11.282914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-558ad6e6-e544-40fd-a068-575595e48e15 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:11.289141 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-558ad6e6-e544-40fd-a068-575595e48e15 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:11.289596 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-558ad6e6-e544-40fd-a068-575595e48e15 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:11.290361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-558ad6e6-e544-40fd-a068-575595e48e15 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:11.290804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-558ad6e6-e544-40fd-a068-575595e48e15 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:11.423710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-558ad6e6-e544-40fd-a068-575595e48e15 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:11.431792 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-558ad6e6-e544-40fd-a068-575595e48e15 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1681 microversion: 2.1 time: 0.155007 Jul 26 20:57:11.432366 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3673/7428] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:11 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:12.453618 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-47165961-2dc8-4b78-a320-6b18e087b5c4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:12.454159 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-47165961-2dc8-4b78-a320-6b18e087b5c4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:12.461100 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47165961-2dc8-4b78-a320-6b18e087b5c4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:12.461561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47165961-2dc8-4b78-a320-6b18e087b5c4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:12.462335 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47165961-2dc8-4b78-a320-6b18e087b5c4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:12.462781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-47165961-2dc8-4b78-a320-6b18e087b5c4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:12.595041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-47165961-2dc8-4b78-a320-6b18e087b5c4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:12.602619 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-47165961-2dc8-4b78-a320-6b18e087b5c4 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1684 microversion: 2.1 time: 0.153149 Jul 26 20:57:12.603198 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3756/7429] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:12 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:12.699214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0c4e388d-1470-4386-b780-9085788fd758 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:12.701589 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0c4e388d-1470-4386-b780-9085788fd758 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:12.708476 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c4e388d-1470-4386-b780-9085788fd758 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:12.708899 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c4e388d-1470-4386-b780-9085788fd758 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:12.709681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c4e388d-1470-4386-b780-9085788fd758 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:12.710129 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0c4e388d-1470-4386-b780-9085788fd758 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:12.751561 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0c4e388d-1470-4386-b780-9085788fd758 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action" status: 200 len: 38378 microversion: 2.1 time: 0.056220 Jul 26 20:57:12.752207 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3674/7430] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:57:12 2022] POST /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a/action => generated 38378 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 20:57:13.734516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-85956c17-d33b-46e4-b168-d743da99b157 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:13.735073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85956c17-d33b-46e4-b168-d743da99b157 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:13.737709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-a181c394-ef76-4aa5-af5b-ca93a1a7251a req-57ac8e47-b53d-4bf4-b46d-2152a744499b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a", "tag": "593abdf0-5468-4fee-b221-c9ddd528b510"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:13.742647 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85956c17-d33b-46e4-b168-d743da99b157 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:13.742988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85956c17-d33b-46e4-b168-d743da99b157 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:13.743886 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85956c17-d33b-46e4-b168-d743da99b157 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:13.744389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-85956c17-d33b-46e4-b168-d743da99b157 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:13.749990 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a181c394-ef76-4aa5-af5b-ca93a1a7251a req-57ac8e47-b53d-4bf4-b46d-2152a744499b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:13.750599 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-a181c394-ef76-4aa5-af5b-ca93a1a7251a req-57ac8e47-b53d-4bf4-b46d-2152a744499b service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:13.762478 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-a181c394-ef76-4aa5-af5b-ca93a1a7251a req-57ac8e47-b53d-4bf4-b46d-2152a744499b service nova] Creating event network-changed:593abdf0-5468-4fee-b221-c9ddd528b510 for instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a on n-h1-708768-8 Jul 26 20:57:13.767847 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-a181c394-ef76-4aa5-af5b-ca93a1a7251a req-57ac8e47-b53d-4bf4-b46d-2152a744499b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034353 Jul 26 20:57:13.768668 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3675/7431] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:57:13.771365 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-85956c17-d33b-46e4-b168-d743da99b157 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Going to try to terminate instance {{(pid=125964) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 20:57:13.856322 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-85956c17-d33b-46e4-b168-d743da99b157 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 204 len: 0 microversion: 2.1 time: 0.126117 Jul 26 20:57:13.856911 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3757/7432] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 20:57:13 2022] DELETE /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 20:57:13.867774 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-04305a09-28df-4c23-a2c6-fb13a4ad2a47 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:13.868911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-04305a09-28df-4c23-a2c6-fb13a4ad2a47 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:13.876138 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04305a09-28df-4c23-a2c6-fb13a4ad2a47 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:13.877035 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04305a09-28df-4c23-a2c6-fb13a4ad2a47 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:13.878111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04305a09-28df-4c23-a2c6-fb13a4ad2a47 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:13.878764 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-04305a09-28df-4c23-a2c6-fb13a4ad2a47 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:14.020183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-04305a09-28df-4c23-a2c6-fb13a4ad2a47 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:14.028294 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-04305a09-28df-4c23-a2c6-fb13a4ad2a47 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1690 microversion: 2.1 time: 0.165838 Jul 26 20:57:14.028980 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3676/7433] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:13 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:15.050948 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d0f29d47-ddb2-4d6f-8b80-894473437c4b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:15.051717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d0f29d47-ddb2-4d6f-8b80-894473437c4b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:15.058668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0f29d47-ddb2-4d6f-8b80-894473437c4b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:15.059114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0f29d47-ddb2-4d6f-8b80-894473437c4b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:15.059935 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0f29d47-ddb2-4d6f-8b80-894473437c4b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:15.060890 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d0f29d47-ddb2-4d6f-8b80-894473437c4b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:15.239081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d0f29d47-ddb2-4d6f-8b80-894473437c4b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:15.246715 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d0f29d47-ddb2-4d6f-8b80-894473437c4b tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1690 microversion: 2.1 time: 0.200023 Jul 26 20:57:15.247295 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3758/7434] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:15 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:15.891070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-90a5f266-3128-4804-aeb9-b77a825b0610 req-fea9c355-fb2a-4719-a19e-0ead8c514049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a", "name": "network-vif-deleted", "tag": "593abdf0-5468-4fee-b221-c9ddd528b510"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:15.901597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-90a5f266-3128-4804-aeb9-b77a825b0610 req-fea9c355-fb2a-4719-a19e-0ead8c514049 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:15.902054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-90a5f266-3128-4804-aeb9-b77a825b0610 req-fea9c355-fb2a-4719-a19e-0ead8c514049 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:15.914482 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-90a5f266-3128-4804-aeb9-b77a825b0610 req-fea9c355-fb2a-4719-a19e-0ead8c514049 service nova] Creating event network-vif-deleted:593abdf0-5468-4fee-b221-c9ddd528b510 for instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a on n-h1-708768-8 Jul 26 20:57:15.919289 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-90a5f266-3128-4804-aeb9-b77a825b0610 req-fea9c355-fb2a-4719-a19e-0ead8c514049 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032044 Jul 26 20:57:15.920538 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3677/7435] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:57:16.270391 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:16.272001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:16.280917 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:16.281388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:16.282362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:16.282847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:16.317287 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:16.317733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:16.318191 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.objects.instance [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lazy-loading 'fault' on Instance uuid f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a {{(pid=125964) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:57:16.360625 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbc7e95221342da8d288a98b4cb4bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9b9fa87c564bfc827b8ef31ecd2309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:16.368874 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-746cd50a-d80b-4f18-94ac-a6369adce0a2 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 200 len: 1357 microversion: 2.1 time: 0.102434 Jul 26 20:57:16.369455 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3759/7436] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:16 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:57:17.392647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:17.393279 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] [instance: f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:17.399527 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:17.400021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:17.400794 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:17.401244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:17.414688 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] HTTP exception thrown: Instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a could not be found. Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Request method failure captured: Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a HTTP/1.1 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FNoxa1srlcvH6r_yC7S2A1Gpmd7eRmaEPJLohqg5KwlBmToGSscey-8jKCumBHfCYTXvguGGlopnfORkXL6tF-VV_3Wx74xjuSG8Xyn2a44PloGF7Fy20kjidPR73Z1sde9RoW9DtFMWfc1zl2jD8ktKip3Ix8reW1kLveuLT8Psaw Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f9b9fa87c564bfc827b8ef31ecd2309", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f9b9fa87c564bfc827b8ef31ecd2309"}]}] Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: 2f9b9fa87c564bfc827b8ef31ecd2309 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1263788519 Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 7dbc7e95221342da8d288a98b4cb4bee Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1263788519-project Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a could not be found. Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a'} Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a could not be found. Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a could not be found. Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:57:17.416343 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a could not be found. Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Returning 404 to user: Instance f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d10c810-42fb-4a7b-b993-050cd72303dc tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a" status: 404 len: 111 microversion: 2.1 time: 0.030783 Jul 26 20:57:17.421562 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3678/7437] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:17 2022] GET /compute/v2.1/servers/f7b0ff5e-2f09-47d0-a9c8-6bd64dfe839a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 20:57:20.655483 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-52fddab6-6a0e-470a-86b4-6f17ff46ba00 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] Calling method '.version_select at 0x7f8755fa1a60>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:20.677597 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-52fddab6-6a0e-470a-86b4-6f17ff46ba00 tempest-TestNetworkAdvancedServerOps-1263788519 tempest-TestNetworkAdvancedServerOps-1263788519-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1019417231" status: 202 len: 0 microversion: 2.1 time: 0.025919 Jul 26 20:57:20.682226 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3760/7438] 10.222.0.58 () {58 vars in 1284 bytes} [Tue Jul 26 20:57:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1019417231 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:57:31.788241 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=18 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:31.789001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:32.027758 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a52f8080-9491-454a-ae4a-3d6eb1a1698b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Action: 'create', calling method: .version_select at 0x7f875c6263a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2088395894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlL7frg8JV19lrs0nbDbZ45StIhAinYLLUIZBFSrQ41p7nCJe3q1QyO/Kt3kq/D9nLZUkgCFuXHu+m/mZLJNB5Z388eIjfYXYjCKR3bPGPRppmS13xvsSNR4E+cnC4O2A=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:32.050269 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a52f8080-9491-454a-ae4a-3d6eb1a1698b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Getting quotas for project dc7e71d41ee44f1296c8715c1e3b3955. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:57:32.055716 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-a52f8080-9491-454a-ae4a-3d6eb1a1698b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Getting quotas for user 1e5496dff2fa4d07b063a546b482eb49 and project dc7e71d41ee44f1296c8715c1e3b3955. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:57:32.084168 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a52f8080-9491-454a-ae4a-3d6eb1a1698b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.302931 Jul 26 20:57:32.090895 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3679/7439] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 20:57:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:57:33.054412 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:33.055282 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:33.059481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-263536087", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2088395894", "security_groups": [{"name": "tempest-secgroup-smoke-1764112976"}], "networks": [{"uuid": "6bd60cc7-76ca-4554-beae-9b35268a2fec"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:33.172475 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] validate_networks() for [('6bd60cc7-76ca-4554-beae-9b35268a2fec', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 20:57:33.551427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 20:57:33.551871 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 20:57:33.552352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 20:57:33.552755 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 20:57:33.553162 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 20:57:33.563496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:33.563974 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:33.565043 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:33.565527 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:33.582893 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Getting quotas for project dc7e71d41ee44f1296c8715c1e3b3955. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 20:57:33.588256 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Getting quotas for user 1e5496dff2fa4d07b063a546b482eb49 and project dc7e71d41ee44f1296c8715c1e3b3955. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 20:57:33.602328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 20:57:33.604790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 20:57:33.651701 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ba2b2608-9822-4b2f-88f6-d0f14fb37d4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.598813 Jul 26 20:57:33.652277 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3761/7440] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 20:57:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 20:57:33.665659 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-28542446-6468-403a-b9ff-fac79f21812f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:33.666363 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-28542446-6468-403a-b9ff-fac79f21812f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:33.860103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-28542446-6468-403a-b9ff-fac79f21812f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:33.867146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-28542446-6468-403a-b9ff-fac79f21812f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1246 microversion: 2.1 time: 0.206256 Jul 26 20:57:33.867677 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3680/7441] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:33 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1246 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:34.889906 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-71f04fde-9e19-4a14-8ce7-a19e90b60823 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:34.890533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-71f04fde-9e19-4a14-8ce7-a19e90b60823 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:34.902052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71f04fde-9e19-4a14-8ce7-a19e90b60823 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:34.902782 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71f04fde-9e19-4a14-8ce7-a19e90b60823 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:34.904320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71f04fde-9e19-4a14-8ce7-a19e90b60823 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:34.905028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-71f04fde-9e19-4a14-8ce7-a19e90b60823 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:34.991178 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-71f04fde-9e19-4a14-8ce7-a19e90b60823 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:35.001094 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-71f04fde-9e19-4a14-8ce7-a19e90b60823 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1304 microversion: 2.1 time: 0.116176 Jul 26 20:57:35.001817 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3762/7442] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:34 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:36.037064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3fe3b0d1-60a1-4889-aab9-a41db83adfc4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:36.038456 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3fe3b0d1-60a1-4889-aab9-a41db83adfc4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:36.048515 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fe3b0d1-60a1-4889-aab9-a41db83adfc4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:36.049274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fe3b0d1-60a1-4889-aab9-a41db83adfc4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:36.050245 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fe3b0d1-60a1-4889-aab9-a41db83adfc4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:36.050863 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fe3b0d1-60a1-4889-aab9-a41db83adfc4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:36.190130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3fe3b0d1-60a1-4889-aab9-a41db83adfc4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:36.197809 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3fe3b0d1-60a1-4889-aab9-a41db83adfc4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1372 microversion: 2.1 time: 0.178002 Jul 26 20:57:36.198383 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3681/7443] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:36 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:36.743786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fd75f5b9-08cf-4dd0-a637-9df781cbd88d req-2d21c94d-9921-4470-bbbd-97b7f6f596bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:36.754370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fd75f5b9-08cf-4dd0-a637-9df781cbd88d req-2d21c94d-9921-4470-bbbd-97b7f6f596bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:36.754812 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fd75f5b9-08cf-4dd0-a637-9df781cbd88d req-2d21c94d-9921-4470-bbbd-97b7f6f596bb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:36.768285 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fd75f5b9-08cf-4dd0-a637-9df781cbd88d req-2d21c94d-9921-4470-bbbd-97b7f6f596bb service nova] Creating event network-changed:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h2-708768-8 Jul 26 20:57:36.773795 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fd75f5b9-08cf-4dd0-a637-9df781cbd88d req-2d21c94d-9921-4470-bbbd-97b7f6f596bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108634 Jul 26 20:57:36.774410 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3763/7444] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:57:37.222030 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d36424f-8676-41fc-b140-53bd88081613 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:37.222651 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8d36424f-8676-41fc-b140-53bd88081613 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:37.230103 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d36424f-8676-41fc-b140-53bd88081613 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:37.230563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d36424f-8676-41fc-b140-53bd88081613 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:37.231348 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d36424f-8676-41fc-b140-53bd88081613 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:37.232904 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8d36424f-8676-41fc-b140-53bd88081613 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:37.372976 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8d36424f-8676-41fc-b140-53bd88081613 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:37.380555 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d36424f-8676-41fc-b140-53bd88081613 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1372 microversion: 2.1 time: 0.162491 Jul 26 20:57:37.381185 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3682/7445] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:37 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:38.403359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fa958b00-3cc3-4a11-a5f3-a986996168cc tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:38.404801 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fa958b00-3cc3-4a11-a5f3-a986996168cc tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:38.411179 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa958b00-3cc3-4a11-a5f3-a986996168cc tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:38.411658 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa958b00-3cc3-4a11-a5f3-a986996168cc tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:38.412583 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa958b00-3cc3-4a11-a5f3-a986996168cc tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:38.413024 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fa958b00-3cc3-4a11-a5f3-a986996168cc tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:38.554988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fa958b00-3cc3-4a11-a5f3-a986996168cc tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:38.563110 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fa958b00-3cc3-4a11-a5f3-a986996168cc tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1372 microversion: 2.1 time: 0.165068 Jul 26 20:57:38.563698 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3764/7446] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:38 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:39.584003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4af479fa-33bc-4b10-90f3-032631cd84d2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:39.584630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4af479fa-33bc-4b10-90f3-032631cd84d2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:39.592362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4af479fa-33bc-4b10-90f3-032631cd84d2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:39.592828 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4af479fa-33bc-4b10-90f3-032631cd84d2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:39.593644 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4af479fa-33bc-4b10-90f3-032631cd84d2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:39.594088 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4af479fa-33bc-4b10-90f3-032631cd84d2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:39.726619 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4af479fa-33bc-4b10-90f3-032631cd84d2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:39.734952 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4af479fa-33bc-4b10-90f3-032631cd84d2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1372 microversion: 2.1 time: 0.154832 Jul 26 20:57:39.735522 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3683/7447] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:39 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:40.475809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5dc87b9d-eeec-41d7-859a-d25211f87e5e req-2f86f4d9-8ffb-48f2-9d65-3cc404213a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "name": "network-vif-plugged", "status": "completed", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:40.487251 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5dc87b9d-eeec-41d7-859a-d25211f87e5e req-2f86f4d9-8ffb-48f2-9d65-3cc404213a08 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:40.487790 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5dc87b9d-eeec-41d7-859a-d25211f87e5e req-2f86f4d9-8ffb-48f2-9d65-3cc404213a08 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:40.500426 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5dc87b9d-eeec-41d7-859a-d25211f87e5e req-2f86f4d9-8ffb-48f2-9d65-3cc404213a08 service nova] Creating event network-vif-plugged:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h2-708768-8 Jul 26 20:57:40.505550 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5dc87b9d-eeec-41d7-859a-d25211f87e5e req-2f86f4d9-8ffb-48f2-9d65-3cc404213a08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033543 Jul 26 20:57:40.506239 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3765/7448] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:57:40.755960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-679f72b8-03e9-454d-b8fb-497a4853da51 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:40.756579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-679f72b8-03e9-454d-b8fb-497a4853da51 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:40.763729 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-679f72b8-03e9-454d-b8fb-497a4853da51 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:40.764277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-679f72b8-03e9-454d-b8fb-497a4853da51 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:40.765064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-679f72b8-03e9-454d-b8fb-497a4853da51 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:40.765556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-679f72b8-03e9-454d-b8fb-497a4853da51 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:40.899525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-679f72b8-03e9-454d-b8fb-497a4853da51 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:40.907602 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-679f72b8-03e9-454d-b8fb-497a4853da51 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1372 microversion: 2.1 time: 0.155538 Jul 26 20:57:40.908184 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3684/7449] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:40 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:41.930421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-35b8043a-b95d-4817-9bb3-3bbb62632157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:41.931066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-35b8043a-b95d-4817-9bb3-3bbb62632157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:41.938098 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35b8043a-b95d-4817-9bb3-3bbb62632157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:41.938542 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35b8043a-b95d-4817-9bb3-3bbb62632157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:41.939556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35b8043a-b95d-4817-9bb3-3bbb62632157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:41.940022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-35b8043a-b95d-4817-9bb3-3bbb62632157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:42.130080 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-35b8043a-b95d-4817-9bb3-3bbb62632157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:42.137579 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-35b8043a-b95d-4817-9bb3-3bbb62632157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1556 microversion: 2.1 time: 0.212358 Jul 26 20:57:42.138140 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3766/7450] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:41 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:42.159427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-23cefae9-7256-4bd2-859b-cfabc501f91b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:57:42.160089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-23cefae9-7256-4bd2-859b-cfabc501f91b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:57:42.166978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23cefae9-7256-4bd2-859b-cfabc501f91b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:42.167434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23cefae9-7256-4bd2-859b-cfabc501f91b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:42.168238 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23cefae9-7256-4bd2-859b-cfabc501f91b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:42.168683 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-23cefae9-7256-4bd2-859b-cfabc501f91b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:42.299907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-23cefae9-7256-4bd2-859b-cfabc501f91b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:57:42.307515 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-23cefae9-7256-4bd2-859b-cfabc501f91b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1556 microversion: 2.1 time: 0.152335 Jul 26 20:57:42.308120 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3685/7451] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:57:42 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:57:44.215981 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-2cfdd641-cf8b-445b-9c39-6c51a8c3f762 req-c1655609-f735-4739-9502-04a4146171f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:57:44.223584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:44.224258 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:57:44.229494 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2cfdd641-cf8b-445b-9c39-6c51a8c3f762 req-c1655609-f735-4739-9502-04a4146171f4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:57:44.230135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-2cfdd641-cf8b-445b-9c39-6c51a8c3f762 req-c1655609-f735-4739-9502-04a4146171f4 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:57:44.242273 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-2cfdd641-cf8b-445b-9c39-6c51a8c3f762 req-c1655609-f735-4739-9502-04a4146171f4 service nova] Creating event network-changed:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h2-708768-8 Jul 26 20:57:44.247345 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-2cfdd641-cf8b-445b-9c39-6c51a8c3f762 req-c1655609-f735-4739-9502-04a4146171f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035054 Jul 26 20:57:44.248006 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3767/7452] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:59:39.491359 n-d-708768-8 devstack@n-api.service[125963]: ERROR oslo.messaging._drivers.impl_rabbit [-] [126f5d12-0094-4580-8dac-f2bd48a90f54] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 20:59:39.491954 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:59:39.492681 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:59:39.493421 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=30 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:59:39.498060 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-689e7612-d1b0-4bf0-bcef-e857ad78e30f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:59:39.498725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-689e7612-d1b0-4bf0-bcef-e857ad78e30f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:39.508707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-689e7612-d1b0-4bf0-bcef-e857ad78e30f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:39.509168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-689e7612-d1b0-4bf0-bcef-e857ad78e30f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:39.509932 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-689e7612-d1b0-4bf0-bcef-e857ad78e30f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:39.510373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-689e7612-d1b0-4bf0-bcef-e857ad78e30f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:39.535197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-689e7612-d1b0-4bf0-bcef-e857ad78e30f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lazy-loading 'flavor' on Instance uuid 6949960b-a0a6-49ca-8f41-e82ae038fcc4 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 20:59:39.714612 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-689e7612-d1b0-4bf0-bcef-e857ad78e30f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "POST /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4/action" status: 202 len: 0 microversion: 2.1 time: 0.225510 Jul 26 20:59:39.715231 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3686/7453] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 20:59:39 2022] POST /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 20:59:39.722571 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 20:59:39.723499 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 20:59:39.724014 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:59:39.725334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=26 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 20:59:39.730267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-10be3b58-3c6d-423f-a4bf-b7f9bcfb2da4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:39.730971 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-10be3b58-3c6d-423f-a4bf-b7f9bcfb2da4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:39.739276 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10be3b58-3c6d-423f-a4bf-b7f9bcfb2da4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:39.739741 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10be3b58-3c6d-423f-a4bf-b7f9bcfb2da4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:39.740510 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10be3b58-3c6d-423f-a4bf-b7f9bcfb2da4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:39.740946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-10be3b58-3c6d-423f-a4bf-b7f9bcfb2da4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:39.878207 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-10be3b58-3c6d-423f-a4bf-b7f9bcfb2da4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:39.885757 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-10be3b58-3c6d-423f-a4bf-b7f9bcfb2da4 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.165150 Jul 26 20:59:39.886323 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3768/7454] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:39 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:59:40.910010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-18aeeed9-3140-4476-be90-b70f5cb70e82 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:40.910718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-18aeeed9-3140-4476-be90-b70f5cb70e82 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:40.918075 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18aeeed9-3140-4476-be90-b70f5cb70e82 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:40.918537 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18aeeed9-3140-4476-be90-b70f5cb70e82 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:40.919311 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18aeeed9-3140-4476-be90-b70f5cb70e82 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:40.919798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-18aeeed9-3140-4476-be90-b70f5cb70e82 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:40.927054 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] [126f5d12-0094-4580-8dac-f2bd48a90f54] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 46726. Jul 26 20:59:41.057111 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-18aeeed9-3140-4476-be90-b70f5cb70e82 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:41.065475 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-18aeeed9-3140-4476-be90-b70f5cb70e82 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.161529 Jul 26 20:59:41.066039 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3687/7455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:40 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:42.087316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3598e6ed-fc9f-4b33-8a4a-955224518436 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:42.087995 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3598e6ed-fc9f-4b33-8a4a-955224518436 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:42.097212 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3598e6ed-fc9f-4b33-8a4a-955224518436 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:42.097668 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3598e6ed-fc9f-4b33-8a4a-955224518436 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:42.098440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3598e6ed-fc9f-4b33-8a4a-955224518436 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:42.098879 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3598e6ed-fc9f-4b33-8a4a-955224518436 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:42.106173 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 46732. Jul 26 20:59:42.106907 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 46734. Jul 26 20:59:42.232970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3598e6ed-fc9f-4b33-8a4a-955224518436 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:42.240545 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3598e6ed-fc9f-4b33-8a4a-955224518436 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.157214 Jul 26 20:59:42.241124 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3769/7456] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:42 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:43.262598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8afdd43f-8254-48bb-b8bb-5b02a5d45d81 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:43.263221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8afdd43f-8254-48bb-b8bb-5b02a5d45d81 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:43.270344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8afdd43f-8254-48bb-b8bb-5b02a5d45d81 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:43.270829 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8afdd43f-8254-48bb-b8bb-5b02a5d45d81 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:43.271627 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8afdd43f-8254-48bb-b8bb-5b02a5d45d81 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:43.272074 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8afdd43f-8254-48bb-b8bb-5b02a5d45d81 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:43.406341 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8afdd43f-8254-48bb-b8bb-5b02a5d45d81 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:43.413831 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8afdd43f-8254-48bb-b8bb-5b02a5d45d81 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.155257 Jul 26 20:59:43.414383 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3688/7457] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:43 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:44.436158 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-482db182-c6c5-419b-99b4-a08602c62cc6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:44.436944 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-482db182-c6c5-419b-99b4-a08602c62cc6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:44.444375 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-482db182-c6c5-419b-99b4-a08602c62cc6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:44.444821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-482db182-c6c5-419b-99b4-a08602c62cc6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:44.445576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-482db182-c6c5-419b-99b4-a08602c62cc6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:44.446003 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-482db182-c6c5-419b-99b4-a08602c62cc6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:44.582340 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-482db182-c6c5-419b-99b4-a08602c62cc6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:44.589984 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-482db182-c6c5-419b-99b4-a08602c62cc6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.157806 Jul 26 20:59:44.590554 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3770/7458] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:44 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:44.738662 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 20:59:44.739226 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 20:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 20:59:45.611158 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8ac813b3-57d0-4f50-ad63-1ec1b46386ed tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:45.611814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8ac813b3-57d0-4f50-ad63-1ec1b46386ed tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:45.618641 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ac813b3-57d0-4f50-ad63-1ec1b46386ed tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:45.619095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ac813b3-57d0-4f50-ad63-1ec1b46386ed tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:45.619916 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ac813b3-57d0-4f50-ad63-1ec1b46386ed tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:45.620357 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8ac813b3-57d0-4f50-ad63-1ec1b46386ed tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:45.749723 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8ac813b3-57d0-4f50-ad63-1ec1b46386ed tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:45.757642 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8ac813b3-57d0-4f50-ad63-1ec1b46386ed tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.150465 Jul 26 20:59:45.758206 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3689/7459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:45 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:46.779690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-9bb05ca6-58ce-49bf-a6e9-e557a660c012 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:46.780284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-9bb05ca6-58ce-49bf-a6e9-e557a660c012 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:46.789238 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bb05ca6-58ce-49bf-a6e9-e557a660c012 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:46.789691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bb05ca6-58ce-49bf-a6e9-e557a660c012 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:46.790468 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bb05ca6-58ce-49bf-a6e9-e557a660c012 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:46.790907 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-9bb05ca6-58ce-49bf-a6e9-e557a660c012 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:46.920457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-9bb05ca6-58ce-49bf-a6e9-e557a660c012 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:46.928943 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-9bb05ca6-58ce-49bf-a6e9-e557a660c012 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.153175 Jul 26 20:59:46.929516 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3771/7460] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:46 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:47.950413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5dfc0025-bf2f-4fcf-8262-a1c3c5c49c65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:47.950948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5dfc0025-bf2f-4fcf-8262-a1c3c5c49c65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:47.957689 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dfc0025-bf2f-4fcf-8262-a1c3c5c49c65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:47.958142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dfc0025-bf2f-4fcf-8262-a1c3c5c49c65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:47.958913 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dfc0025-bf2f-4fcf-8262-a1c3c5c49c65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:47.959353 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-5dfc0025-bf2f-4fcf-8262-a1c3c5c49c65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:48.093664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5dfc0025-bf2f-4fcf-8262-a1c3c5c49c65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:48.101884 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5dfc0025-bf2f-4fcf-8262-a1c3c5c49c65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.155440 Jul 26 20:59:48.102455 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3690/7461] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:47 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:49.124209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ef5a7c5a-5d5a-44dd-9745-8acf4d8c5e61 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:49.124817 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ef5a7c5a-5d5a-44dd-9745-8acf4d8c5e61 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:49.132342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef5a7c5a-5d5a-44dd-9745-8acf4d8c5e61 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:49.132789 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef5a7c5a-5d5a-44dd-9745-8acf4d8c5e61 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:49.133546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef5a7c5a-5d5a-44dd-9745-8acf4d8c5e61 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:49.133977 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ef5a7c5a-5d5a-44dd-9745-8acf4d8c5e61 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:49.263157 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ef5a7c5a-5d5a-44dd-9745-8acf4d8c5e61 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:49.270841 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ef5a7c5a-5d5a-44dd-9745-8acf4d8c5e61 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.150497 Jul 26 20:59:49.271411 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3772/7462] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:49 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:50.292015 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b0185e8f-31e5-4ed7-a5da-b0ec4bf6f5a6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:50.292608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b0185e8f-31e5-4ed7-a5da-b0ec4bf6f5a6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:50.299981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0185e8f-31e5-4ed7-a5da-b0ec4bf6f5a6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:50.300443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0185e8f-31e5-4ed7-a5da-b0ec4bf6f5a6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:50.301210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0185e8f-31e5-4ed7-a5da-b0ec4bf6f5a6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:50.301657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b0185e8f-31e5-4ed7-a5da-b0ec4bf6f5a6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:50.435190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b0185e8f-31e5-4ed7-a5da-b0ec4bf6f5a6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:50.443049 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b0185e8f-31e5-4ed7-a5da-b0ec4bf6f5a6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1701 microversion: 2.1 time: 0.155014 Jul 26 20:59:50.443621 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3691/7463] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:50 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:51.464269 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-7965c794-7256-455e-99d1-faa53594ea77 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:51.464911 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-7965c794-7256-455e-99d1-faa53594ea77 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:51.472135 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7965c794-7256-455e-99d1-faa53594ea77 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:51.472581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7965c794-7256-455e-99d1-faa53594ea77 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:51.473342 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7965c794-7256-455e-99d1-faa53594ea77 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:51.473868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-7965c794-7256-455e-99d1-faa53594ea77 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:51.606380 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-7965c794-7256-455e-99d1-faa53594ea77 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:51.614509 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-7965c794-7256-455e-99d1-faa53594ea77 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1701 microversion: 2.1 time: 0.154145 Jul 26 20:59:51.615082 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3773/7464] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:51 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:52.637217 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4b62521a-a716-4c9e-bd59-cbd7f9b7d7fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:52.637772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4b62521a-a716-4c9e-bd59-cbd7f9b7d7fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:52.647156 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b62521a-a716-4c9e-bd59-cbd7f9b7d7fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:52.647994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b62521a-a716-4c9e-bd59-cbd7f9b7d7fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:52.649368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b62521a-a716-4c9e-bd59-cbd7f9b7d7fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:52.649820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4b62521a-a716-4c9e-bd59-cbd7f9b7d7fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:52.828994 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4b62521a-a716-4c9e-bd59-cbd7f9b7d7fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:52.837870 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4b62521a-a716-4c9e-bd59-cbd7f9b7d7fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1696 microversion: 2.1 time: 0.204681 Jul 26 20:59:52.839027 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3692/7465] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:52 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 20:59:53.861235 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ed6ac0b7-0cf9-4531-bcc4-3aa8f69de528 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:53.861972 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ed6ac0b7-0cf9-4531-bcc4-3aa8f69de528 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:53.869165 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed6ac0b7-0cf9-4531-bcc4-3aa8f69de528 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:53.869852 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed6ac0b7-0cf9-4531-bcc4-3aa8f69de528 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:53.870979 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed6ac0b7-0cf9-4531-bcc4-3aa8f69de528 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:53.871581 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ed6ac0b7-0cf9-4531-bcc4-3aa8f69de528 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:54.020180 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ed6ac0b7-0cf9-4531-bcc4-3aa8f69de528 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:54.029833 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ed6ac0b7-0cf9-4531-bcc4-3aa8f69de528 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1696 microversion: 2.1 time: 0.173425 Jul 26 20:59:54.046103 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3774/7466] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:53 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:55.053068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-69d8cf13-3490-4c65-b6ff-28553b95719a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:55.053709 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-69d8cf13-3490-4c65-b6ff-28553b95719a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:55.061701 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69d8cf13-3490-4c65-b6ff-28553b95719a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:55.062220 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69d8cf13-3490-4c65-b6ff-28553b95719a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:55.063571 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69d8cf13-3490-4c65-b6ff-28553b95719a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:55.064354 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-69d8cf13-3490-4c65-b6ff-28553b95719a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:55.260605 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-42677737-c2fa-4d76-a3f4-7d7ba8efd6ae req-ef1383d4-2aa9-45c4-9589-b661e1cdb2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "name": "network-vif-plugged", "status": "completed", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 20:59:55.273116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-42677737-c2fa-4d76-a3f4-7d7ba8efd6ae req-ef1383d4-2aa9-45c4-9589-b661e1cdb2cb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:55.273570 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-42677737-c2fa-4d76-a3f4-7d7ba8efd6ae req-ef1383d4-2aa9-45c4-9589-b661e1cdb2cb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:55.281553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-69d8cf13-3490-4c65-b6ff-28553b95719a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:55.295045 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-42677737-c2fa-4d76-a3f4-7d7ba8efd6ae req-ef1383d4-2aa9-45c4-9589-b661e1cdb2cb service nova] Creating event network-vif-plugged:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h2-708768-8 Jul 26 20:59:55.295285 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-69d8cf13-3490-4c65-b6ff-28553b95719a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1696 microversion: 2.1 time: 0.245613 Jul 26 20:59:55.305355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-42677737-c2fa-4d76-a3f4-7d7ba8efd6ae req-ef1383d4-2aa9-45c4-9589-b661e1cdb2cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174769 Jul 26 20:59:55.306875 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3775/7467] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 20:59:55.313924 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3693/7468] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:55 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1696 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:56.332190 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f35ee005-0096-4745-9beb-ad5a53d9115e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:56.335088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f35ee005-0096-4745-9beb-ad5a53d9115e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:56.343470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f35ee005-0096-4745-9beb-ad5a53d9115e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:56.345481 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f35ee005-0096-4745-9beb-ad5a53d9115e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:56.346337 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f35ee005-0096-4745-9beb-ad5a53d9115e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:56.346984 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f35ee005-0096-4745-9beb-ad5a53d9115e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:56.510671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f35ee005-0096-4745-9beb-ad5a53d9115e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:56.519166 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f35ee005-0096-4745-9beb-ad5a53d9115e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1696 microversion: 2.1 time: 0.192381 Jul 26 20:59:56.531634 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3776/7469] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:56 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:57.549612 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37fd1901-385e-495f-924f-c0e90fc89e52 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:57.551100 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37fd1901-385e-495f-924f-c0e90fc89e52 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:57.559147 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37fd1901-385e-495f-924f-c0e90fc89e52 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:57.559886 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37fd1901-385e-495f-924f-c0e90fc89e52 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:57.560691 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37fd1901-385e-495f-924f-c0e90fc89e52 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:57.561406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37fd1901-385e-495f-924f-c0e90fc89e52 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:57.713367 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-37fd1901-385e-495f-924f-c0e90fc89e52 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:57.722406 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37fd1901-385e-495f-924f-c0e90fc89e52 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1696 microversion: 2.1 time: 0.177924 Jul 26 20:59:57.723096 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3694/7470] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:57 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:58.746142 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4a860e83-f3e0-4baf-97ec-358c21516746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:58.747403 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4a860e83-f3e0-4baf-97ec-358c21516746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:58.757291 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a860e83-f3e0-4baf-97ec-358c21516746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:58.758031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a860e83-f3e0-4baf-97ec-358c21516746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:58.758854 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a860e83-f3e0-4baf-97ec-358c21516746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:58.759298 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4a860e83-f3e0-4baf-97ec-358c21516746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:58.925107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-4a860e83-f3e0-4baf-97ec-358c21516746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 20:59:58.934561 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4a860e83-f3e0-4baf-97ec-358c21516746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1696 microversion: 2.1 time: 0.192224 Jul 26 20:59:58.935266 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3777/7471] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:58 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 20:59:59.958819 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c8a049e8-7356-438b-8bfa-356f625375c3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 20:59:59.959525 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c8a049e8-7356-438b-8bfa-356f625375c3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 20:59:59.967062 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8a049e8-7356-438b-8bfa-356f625375c3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:59.967646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8a049e8-7356-438b-8bfa-356f625375c3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 20:59:59.968561 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8a049e8-7356-438b-8bfa-356f625375c3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 20:59:59.969121 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c8a049e8-7356-438b-8bfa-356f625375c3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:00.140236 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-c8a049e8-7356-438b-8bfa-356f625375c3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:00.148611 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c8a049e8-7356-438b-8bfa-356f625375c3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1696 microversion: 2.1 time: 0.193707 Jul 26 21:00:00.151637 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3695/7472] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 20:59:59 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:01.177171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2d2c87c5-ae3c-4d94-8bdd-a10e0221644e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:01.177171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2d2c87c5-ae3c-4d94-8bdd-a10e0221644e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:01.182829 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d2c87c5-ae3c-4d94-8bdd-a10e0221644e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:01.183281 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d2c87c5-ae3c-4d94-8bdd-a10e0221644e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:01.184085 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d2c87c5-ae3c-4d94-8bdd-a10e0221644e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:01.184535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2d2c87c5-ae3c-4d94-8bdd-a10e0221644e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:01.324181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2d2c87c5-ae3c-4d94-8bdd-a10e0221644e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:01.333405 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2d2c87c5-ae3c-4d94-8bdd-a10e0221644e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1696 microversion: 2.1 time: 0.163691 Jul 26 21:00:01.334112 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3778/7473] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:01 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:02.354931 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3cdb6408-3afc-422d-9e5b-8f93ff33778b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:02.355553 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3cdb6408-3afc-422d-9e5b-8f93ff33778b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:02.363128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cdb6408-3afc-422d-9e5b-8f93ff33778b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:02.363597 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cdb6408-3afc-422d-9e5b-8f93ff33778b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:02.364417 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cdb6408-3afc-422d-9e5b-8f93ff33778b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:02.364871 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3cdb6408-3afc-422d-9e5b-8f93ff33778b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:02.494890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3cdb6408-3afc-422d-9e5b-8f93ff33778b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:02.503367 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3cdb6408-3afc-422d-9e5b-8f93ff33778b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1678 microversion: 2.1 time: 0.152484 Jul 26 21:00:02.503997 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3696/7474] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:02 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:03.525496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a6f00257-6478-48c6-98c7-7b325abe8f65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:03.526118 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a6f00257-6478-48c6-98c7-7b325abe8f65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:03.533408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6f00257-6478-48c6-98c7-7b325abe8f65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:03.533858 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6f00257-6478-48c6-98c7-7b325abe8f65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:03.534627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6f00257-6478-48c6-98c7-7b325abe8f65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:03.535066 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a6f00257-6478-48c6-98c7-7b325abe8f65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:03.665357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a6f00257-6478-48c6-98c7-7b325abe8f65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:03.673352 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a6f00257-6478-48c6-98c7-7b325abe8f65 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1678 microversion: 2.1 time: 0.151712 Jul 26 21:00:03.673920 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3779/7475] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:03 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:04.695028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0b0cc236-3ea4-4c6f-aaff-8b57f1fda11b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:04.695786 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0b0cc236-3ea4-4c6f-aaff-8b57f1fda11b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:04.703346 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b0cc236-3ea4-4c6f-aaff-8b57f1fda11b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:04.703838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b0cc236-3ea4-4c6f-aaff-8b57f1fda11b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:04.704608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b0cc236-3ea4-4c6f-aaff-8b57f1fda11b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:04.705049 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0b0cc236-3ea4-4c6f-aaff-8b57f1fda11b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:04.839296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0b0cc236-3ea4-4c6f-aaff-8b57f1fda11b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:04.846812 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0b0cc236-3ea4-4c6f-aaff-8b57f1fda11b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1621 microversion: 2.1 time: 0.156038 Jul 26 21:00:04.847378 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3697/7476] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:04 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1621 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:04.867440 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d747353e-a522-4dc6-b685-0f2dfb0ca02f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:00:04.868050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d747353e-a522-4dc6-b685-0f2dfb0ca02f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:04.875545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d747353e-a522-4dc6-b685-0f2dfb0ca02f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:04.876028 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d747353e-a522-4dc6-b685-0f2dfb0ca02f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:04.876799 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d747353e-a522-4dc6-b685-0f2dfb0ca02f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:04.877243 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d747353e-a522-4dc6-b685-0f2dfb0ca02f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:04.964860 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d747353e-a522-4dc6-b685-0f2dfb0ca02f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "POST /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4/action" status: 202 len: 0 microversion: 2.1 time: 0.101324 Jul 26 21:00:04.965805 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3780/7477] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 21:00:04 2022] POST /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 21:00:04.974171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-518ef359-a5f5-4d65-b7a4-1c62bf232c87 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:04.974796 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-518ef359-a5f5-4d65-b7a4-1c62bf232c87 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:04.980750 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-518ef359-a5f5-4d65-b7a4-1c62bf232c87 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:04.981242 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-518ef359-a5f5-4d65-b7a4-1c62bf232c87 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:04.982019 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-518ef359-a5f5-4d65-b7a4-1c62bf232c87 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:04.982461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-518ef359-a5f5-4d65-b7a4-1c62bf232c87 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:05.127222 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-518ef359-a5f5-4d65-b7a4-1c62bf232c87 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:05.136631 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-518ef359-a5f5-4d65-b7a4-1c62bf232c87 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1629 microversion: 2.1 time: 0.166286 Jul 26 21:00:05.137202 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3698/7478] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:04 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1629 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:06.160073 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-73744d80-0fd5-4978-bf32-569ff7101161 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:06.160713 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-73744d80-0fd5-4978-bf32-569ff7101161 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:06.166868 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73744d80-0fd5-4978-bf32-569ff7101161 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:06.167316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73744d80-0fd5-4978-bf32-569ff7101161 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:06.168116 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73744d80-0fd5-4978-bf32-569ff7101161 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:06.168546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-73744d80-0fd5-4978-bf32-569ff7101161 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:06.385648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-73744d80-0fd5-4978-bf32-569ff7101161 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:06.394656 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-73744d80-0fd5-4978-bf32-569ff7101161 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.240589 Jul 26 21:00:06.395229 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3781/7479] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:06 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:06.614437 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-33604e8c-b980-4dea-846a-4473ff229772 req-b900a0e2-1846-48d0-b2c5-6299525f7c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "name": "network-vif-unplugged", "status": "completed", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:00:06.624995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-33604e8c-b980-4dea-846a-4473ff229772 req-b900a0e2-1846-48d0-b2c5-6299525f7c6e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:06.625462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-33604e8c-b980-4dea-846a-4473ff229772 req-b900a0e2-1846-48d0-b2c5-6299525f7c6e service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:06.636635 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-33604e8c-b980-4dea-846a-4473ff229772 req-b900a0e2-1846-48d0-b2c5-6299525f7c6e service nova] Creating event network-vif-unplugged:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h1-708768-8 Jul 26 21:00:06.642186 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-33604e8c-b980-4dea-846a-4473ff229772 req-b900a0e2-1846-48d0-b2c5-6299525f7c6e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031424 Jul 26 21:00:06.642799 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3699/7480] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:00:07.417457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1ad51123-9f57-4c3e-ad7c-5e88b5b680c1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:07.418661 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1ad51123-9f57-4c3e-ad7c-5e88b5b680c1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:07.426825 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ad51123-9f57-4c3e-ad7c-5e88b5b680c1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:07.427524 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ad51123-9f57-4c3e-ad7c-5e88b5b680c1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:07.428320 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ad51123-9f57-4c3e-ad7c-5e88b5b680c1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:07.428922 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1ad51123-9f57-4c3e-ad7c-5e88b5b680c1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:07.646793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1ad51123-9f57-4c3e-ad7c-5e88b5b680c1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:07.654741 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1ad51123-9f57-4c3e-ad7c-5e88b5b680c1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.241105 Jul 26 21:00:07.655858 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3782/7481] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:07 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:08.663484 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5b2daa32-3c7f-4fbd-b487-604431e963bf req-87822e60-424d-4799-ae7e-69a511d9724c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:00:08.673984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5b2daa32-3c7f-4fbd-b487-604431e963bf req-87822e60-424d-4799-ae7e-69a511d9724c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:08.674443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5b2daa32-3c7f-4fbd-b487-604431e963bf req-87822e60-424d-4799-ae7e-69a511d9724c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:08.677370 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-83137226-e44b-4249-97c3-e750c5a1b09f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:08.679267 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-83137226-e44b-4249-97c3-e750c5a1b09f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:08.687209 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5b2daa32-3c7f-4fbd-b487-604431e963bf req-87822e60-424d-4799-ae7e-69a511d9724c service nova] Creating event network-changed:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h1-708768-8 Jul 26 21:00:08.689379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83137226-e44b-4249-97c3-e750c5a1b09f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:08.689849 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83137226-e44b-4249-97c3-e750c5a1b09f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:08.690702 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83137226-e44b-4249-97c3-e750c5a1b09f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:08.691574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-83137226-e44b-4249-97c3-e750c5a1b09f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:08.694136 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5b2daa32-3c7f-4fbd-b487-604431e963bf req-87822e60-424d-4799-ae7e-69a511d9724c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035427 Jul 26 21:00:08.695114 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3700/7482] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:00:08.841627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-83137226-e44b-4249-97c3-e750c5a1b09f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:08.849942 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-83137226-e44b-4249-97c3-e750c5a1b09f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.176766 Jul 26 21:00:08.850510 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3783/7483] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:08 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:09.873698 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e3a6da2f-7acc-4834-9ce5-65c311aedb0e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:09.874890 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e3a6da2f-7acc-4834-9ce5-65c311aedb0e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:09.876906 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=31 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:00:09.883235 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3a6da2f-7acc-4834-9ce5-65c311aedb0e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:09.884005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3a6da2f-7acc-4834-9ce5-65c311aedb0e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:09.885390 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3a6da2f-7acc-4834-9ce5-65c311aedb0e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:09.886003 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e3a6da2f-7acc-4834-9ce5-65c311aedb0e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:09.890051 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:00:10.085696 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e3a6da2f-7acc-4834-9ce5-65c311aedb0e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:10.094606 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e3a6da2f-7acc-4834-9ce5-65c311aedb0e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.225882 Jul 26 21:00:10.095642 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3701/7484] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:09 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:11.117264 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-031c3ae6-8ad9-406e-b886-0e3b1e257741 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:11.117950 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-031c3ae6-8ad9-406e-b886-0e3b1e257741 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:11.120866 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=35 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:00:11.127797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-031c3ae6-8ad9-406e-b886-0e3b1e257741 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:11.128476 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-031c3ae6-8ad9-406e-b886-0e3b1e257741 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:11.129457 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-031c3ae6-8ad9-406e-b886-0e3b1e257741 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:11.130050 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-031c3ae6-8ad9-406e-b886-0e3b1e257741 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:11.133114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:00:11.277548 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-031c3ae6-8ad9-406e-b886-0e3b1e257741 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:11.285754 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-031c3ae6-8ad9-406e-b886-0e3b1e257741 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.172394 Jul 26 21:00:11.287120 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3784/7485] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:11 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:12.308858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-0bafffa2-9d7e-48f6-9d0f-77be34abb285 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:12.309427 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-0bafffa2-9d7e-48f6-9d0f-77be34abb285 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:12.316210 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bafffa2-9d7e-48f6-9d0f-77be34abb285 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:12.316664 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bafffa2-9d7e-48f6-9d0f-77be34abb285 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:12.317428 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bafffa2-9d7e-48f6-9d0f-77be34abb285 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:12.317872 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-0bafffa2-9d7e-48f6-9d0f-77be34abb285 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:12.468418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-0bafffa2-9d7e-48f6-9d0f-77be34abb285 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:12.478130 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-0bafffa2-9d7e-48f6-9d0f-77be34abb285 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.173370 Jul 26 21:00:12.479393 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3702/7486] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:12 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:13.502786 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf942a39-6bbd-40e0-a1bc-d567a3452c2b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:13.503425 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf942a39-6bbd-40e0-a1bc-d567a3452c2b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:13.510576 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf942a39-6bbd-40e0-a1bc-d567a3452c2b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:13.510988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf942a39-6bbd-40e0-a1bc-d567a3452c2b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:13.511833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf942a39-6bbd-40e0-a1bc-d567a3452c2b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:13.512397 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf942a39-6bbd-40e0-a1bc-d567a3452c2b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:13.682792 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf942a39-6bbd-40e0-a1bc-d567a3452c2b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:13.692355 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf942a39-6bbd-40e0-a1bc-d567a3452c2b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.194993 Jul 26 21:00:13.692959 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3785/7487] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:13 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:14.723285 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a5c40211-6479-4dbc-ae74-c35df9b2c6ac tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:14.724964 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a5c40211-6479-4dbc-ae74-c35df9b2c6ac tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:14.736554 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5c40211-6479-4dbc-ae74-c35df9b2c6ac tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:14.737135 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5c40211-6479-4dbc-ae74-c35df9b2c6ac tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:14.738010 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5c40211-6479-4dbc-ae74-c35df9b2c6ac tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:14.738533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a5c40211-6479-4dbc-ae74-c35df9b2c6ac tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:14.886830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a5c40211-6479-4dbc-ae74-c35df9b2c6ac tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:14.895368 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a5c40211-6479-4dbc-ae74-c35df9b2c6ac tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.176613 Jul 26 21:00:14.896299 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3703/7488] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:14 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:15.917637 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6f0093c0-b11a-4de7-bfa0-be40d69c9919 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:15.918350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-6f0093c0-b11a-4de7-bfa0-be40d69c9919 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:15.925552 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f0093c0-b11a-4de7-bfa0-be40d69c9919 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:15.926010 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f0093c0-b11a-4de7-bfa0-be40d69c9919 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:15.926783 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f0093c0-b11a-4de7-bfa0-be40d69c9919 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:15.927226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-6f0093c0-b11a-4de7-bfa0-be40d69c9919 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:16.083635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-6f0093c0-b11a-4de7-bfa0-be40d69c9919 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:16.091695 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6f0093c0-b11a-4de7-bfa0-be40d69c9919 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.177791 Jul 26 21:00:16.106954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3786/7489] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:15 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:17.117432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ac052f80-6ea7-44bd-b604-babd63418429 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:17.118271 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ac052f80-6ea7-44bd-b604-babd63418429 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:17.125274 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac052f80-6ea7-44bd-b604-babd63418429 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:17.125808 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac052f80-6ea7-44bd-b604-babd63418429 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:17.126598 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac052f80-6ea7-44bd-b604-babd63418429 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:17.127046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ac052f80-6ea7-44bd-b604-babd63418429 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:17.257080 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ac052f80-6ea7-44bd-b604-babd63418429 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:17.265137 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ac052f80-6ea7-44bd-b604-babd63418429 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.151728 Jul 26 21:00:17.265876 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3704/7490] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:17 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:18.286855 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-76d87d25-43f1-4482-8f6f-ad72265ae96f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:18.287456 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-76d87d25-43f1-4482-8f6f-ad72265ae96f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:18.294372 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76d87d25-43f1-4482-8f6f-ad72265ae96f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:18.294824 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76d87d25-43f1-4482-8f6f-ad72265ae96f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:18.296306 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76d87d25-43f1-4482-8f6f-ad72265ae96f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:18.296752 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-76d87d25-43f1-4482-8f6f-ad72265ae96f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:18.426611 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-76d87d25-43f1-4482-8f6f-ad72265ae96f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:18.434098 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-76d87d25-43f1-4482-8f6f-ad72265ae96f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.151129 Jul 26 21:00:18.434671 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3787/7491] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:18 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:19.456237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a31f72ab-2abe-4714-8eb5-53104803dc13 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:19.456780 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a31f72ab-2abe-4714-8eb5-53104803dc13 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:19.463798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a31f72ab-2abe-4714-8eb5-53104803dc13 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:19.464267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a31f72ab-2abe-4714-8eb5-53104803dc13 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:19.465047 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a31f72ab-2abe-4714-8eb5-53104803dc13 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:19.465498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a31f72ab-2abe-4714-8eb5-53104803dc13 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:19.607149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a31f72ab-2abe-4714-8eb5-53104803dc13 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:19.615380 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a31f72ab-2abe-4714-8eb5-53104803dc13 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.163053 Jul 26 21:00:19.616000 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3705/7492] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:19 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:20.638511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45d0c225-d0cc-45d5-92d6-b76f04c79b4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:20.639938 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45d0c225-d0cc-45d5-92d6-b76f04c79b4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:20.646997 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45d0c225-d0cc-45d5-92d6-b76f04c79b4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:20.647446 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45d0c225-d0cc-45d5-92d6-b76f04c79b4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:20.648252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45d0c225-d0cc-45d5-92d6-b76f04c79b4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:20.648691 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45d0c225-d0cc-45d5-92d6-b76f04c79b4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:20.784219 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-45d0c225-d0cc-45d5-92d6-b76f04c79b4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:20.791919 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45d0c225-d0cc-45d5-92d6-b76f04c79b4d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.157285 Jul 26 21:00:20.792506 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3788/7493] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:20 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:21.655282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-75fafc23-87bf-47ce-9ac2-7d417eb46cb2 req-f8ad5410-f930-4498-8677-0a9c971a2753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "name": "network-vif-plugged", "status": "completed", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:00:21.665578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-75fafc23-87bf-47ce-9ac2-7d417eb46cb2 req-f8ad5410-f930-4498-8677-0a9c971a2753 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:21.666038 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-75fafc23-87bf-47ce-9ac2-7d417eb46cb2 req-f8ad5410-f930-4498-8677-0a9c971a2753 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:21.679281 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-75fafc23-87bf-47ce-9ac2-7d417eb46cb2 req-f8ad5410-f930-4498-8677-0a9c971a2753 service nova] Creating event network-vif-plugged:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h1-708768-8 Jul 26 21:00:21.684400 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-75fafc23-87bf-47ce-9ac2-7d417eb46cb2 req-f8ad5410-f930-4498-8677-0a9c971a2753 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Jul 26 21:00:21.685179 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3706/7494] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:00:21.814170 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f7748d2e-e2a7-4092-b93c-c91c5cd8a257 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:21.814767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f7748d2e-e2a7-4092-b93c-c91c5cd8a257 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:21.821750 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7748d2e-e2a7-4092-b93c-c91c5cd8a257 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:21.822203 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7748d2e-e2a7-4092-b93c-c91c5cd8a257 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:21.822978 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7748d2e-e2a7-4092-b93c-c91c5cd8a257 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:21.823418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f7748d2e-e2a7-4092-b93c-c91c5cd8a257 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:21.987019 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f7748d2e-e2a7-4092-b93c-c91c5cd8a257 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:21.994730 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f7748d2e-e2a7-4092-b93c-c91c5cd8a257 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.184889 Jul 26 21:00:21.995243 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3789/7495] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:21 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:23.016613 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2b5dfe08-7233-489b-a48f-7934267a7988 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:23.017332 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2b5dfe08-7233-489b-a48f-7934267a7988 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:23.025743 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b5dfe08-7233-489b-a48f-7934267a7988 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:23.026215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b5dfe08-7233-489b-a48f-7934267a7988 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:23.027229 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b5dfe08-7233-489b-a48f-7934267a7988 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:23.027711 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-2b5dfe08-7233-489b-a48f-7934267a7988 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:23.173370 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2b5dfe08-7233-489b-a48f-7934267a7988 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:23.196669 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2b5dfe08-7233-489b-a48f-7934267a7988 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1687 microversion: 2.1 time: 0.184694 Jul 26 21:00:23.197268 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3707/7496] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:23 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:24.219351 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-679d963b-6d79-4ae3-9ad7-3899c5212a96 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:00:24.220128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-679d963b-6d79-4ae3-9ad7-3899c5212a96 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:00:24.227128 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-679d963b-6d79-4ae3-9ad7-3899c5212a96 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:24.227580 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-679d963b-6d79-4ae3-9ad7-3899c5212a96 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:24.228377 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-679d963b-6d79-4ae3-9ad7-3899c5212a96 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:00:24.228846 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-679d963b-6d79-4ae3-9ad7-3899c5212a96 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:00:24.360508 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-679d963b-6d79-4ae3-9ad7-3899c5212a96 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:00:24.368058 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-679d963b-6d79-4ae3-9ad7-3899c5212a96 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1674 microversion: 2.1 time: 0.153157 Jul 26 21:00:24.368627 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3790/7497] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:00:24 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:00:25.909260 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:00:25.909775 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:01:36.094454 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=13 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:36.095817 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=37 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:36.099874 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dde46b0f-16c2-45a5-9ba9-64e545570152 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:36.100124 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=13 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:36.100530 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dde46b0f-16c2-45a5-9ba9-64e545570152 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:01:36.101210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=41 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:36.108657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dde46b0f-16c2-45a5-9ba9-64e545570152 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:36.109260 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dde46b0f-16c2-45a5-9ba9-64e545570152 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:36.110055 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dde46b0f-16c2-45a5-9ba9-64e545570152 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:36.110501 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dde46b0f-16c2-45a5-9ba9-64e545570152 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:36.136843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dde46b0f-16c2-45a5-9ba9-64e545570152 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 21:01:36.159499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-09b80e99-2492-45b4-92c3-b4695851ea8f req-64c556e9-8c6e-4ae0-bd15-a650e579d26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:01:36.171976 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-09b80e99-2492-45b4-92c3-b4695851ea8f req-64c556e9-8c6e-4ae0-bd15-a650e579d26a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:36.172627 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-09b80e99-2492-45b4-92c3-b4695851ea8f req-64c556e9-8c6e-4ae0-bd15-a650e579d26a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:36.186666 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-09b80e99-2492-45b4-92c3-b4695851ea8f req-64c556e9-8c6e-4ae0-bd15-a650e579d26a service nova] Creating event network-changed:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h1-708768-8 Jul 26 21:01:36.192235 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-09b80e99-2492-45b4-92c3-b4695851ea8f req-64c556e9-8c6e-4ae0-bd15-a650e579d26a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097421 Jul 26 21:01:36.193026 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3791/7498] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 21:01:36.221431 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dde46b0f-16c2-45a5-9ba9-64e545570152 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 204 len: 0 microversion: 2.1 time: 0.128719 Jul 26 21:01:36.222398 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3708/7499] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 21:01:36 2022] DELETE /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 21:01:36.233884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e6d248b8-8600-4b0c-8654-2b79b777e620 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:36.233884 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e6d248b8-8600-4b0c-8654-2b79b777e620 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:01:36.240145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e6d248b8-8600-4b0c-8654-2b79b777e620 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:36.240722 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e6d248b8-8600-4b0c-8654-2b79b777e620 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:36.241608 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e6d248b8-8600-4b0c-8654-2b79b777e620 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:36.242237 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e6d248b8-8600-4b0c-8654-2b79b777e620 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:36.382350 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e6d248b8-8600-4b0c-8654-2b79b777e620 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:01:36.391341 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e6d248b8-8600-4b0c-8654-2b79b777e620 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.164530 Jul 26 21:01:36.391954 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3792/7500] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:01:36 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 21:01:37.414657 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-86e1dc2a-abea-4505-9de1-3720f71a321c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:37.415283 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-86e1dc2a-abea-4505-9de1-3720f71a321c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:01:37.423249 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86e1dc2a-abea-4505-9de1-3720f71a321c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:37.423732 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86e1dc2a-abea-4505-9de1-3720f71a321c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:37.424504 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86e1dc2a-abea-4505-9de1-3720f71a321c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:37.424949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-86e1dc2a-abea-4505-9de1-3720f71a321c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:37.563413 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-86e1dc2a-abea-4505-9de1-3720f71a321c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:01:37.575854 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-86e1dc2a-abea-4505-9de1-3720f71a321c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 200 len: 1680 microversion: 2.1 time: 0.165556 Jul 26 21:01:37.577172 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3709/7501] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:01:37 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:01:38.159531 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-fb3e0ad1-abc9-4e70-ae57-5109b55a2274 req-bc1c8204-59ed-4c02-a6d9-453f7fad9cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6949960b-a0a6-49ca-8f41-e82ae038fcc4", "name": "network-vif-deleted", "tag": "554e7445-00ee-4802-9156-da5136d0a295"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:01:38.171703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fb3e0ad1-abc9-4e70-ae57-5109b55a2274 req-bc1c8204-59ed-4c02-a6d9-453f7fad9cab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:38.173892 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-fb3e0ad1-abc9-4e70-ae57-5109b55a2274 req-bc1c8204-59ed-4c02-a6d9-453f7fad9cab service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:38.186864 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-fb3e0ad1-abc9-4e70-ae57-5109b55a2274 req-bc1c8204-59ed-4c02-a6d9-453f7fad9cab service nova] Creating event network-vif-deleted:554e7445-00ee-4802-9156-da5136d0a295 for instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 on n-h1-708768-8 Jul 26 21:01:38.192775 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-fb3e0ad1-abc9-4e70-ae57-5109b55a2274 req-bc1c8204-59ed-4c02-a6d9-453f7fad9cab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037399 Jul 26 21:01:38.193384 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3793/7502] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:01:38.597649 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:38.598270 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: 6949960b-a0a6-49ca-8f41-e82ae038fcc4] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:01:38.605790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:38.606365 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:38.608626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:38.609186 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:38.625945 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] HTTP exception thrown: Instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 could not be found. Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Request method failure captured: Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 HTTP/1.1 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FU26ktoWChAHZqrP-kiwkFpcXYVeC6b7WZCosaPrT4Ig0m02huJIdwg3OBpI_nLiMQB4TKVuDKH1yqdQ0RAcNLtBs2HbLbDzTVrgarazJvTEsz0LEY6Czwrj0eCZpiYsriKovOncbNVhTyyTBf8ExK4mpTcOIGzt1gSA2CBHug6qdE Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: dc7e71d41ee44f1296c8715c1e3b3955 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestShelveInstance-1494268344 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc7e71d41ee44f1296c8715c1e3b3955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc7e71d41ee44f1296c8715c1e3b3955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc7e71d41ee44f1296c8715c1e3b3955", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc7e71d41ee44f1296c8715c1e3b3955"}]}] Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestShelveInstance-1494268344 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: dc7e71d41ee44f1296c8715c1e3b3955 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestShelveInstance-1494268344 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestShelveInstance-1494268344-project Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 1e5496dff2fa4d07b063a546b482eb49 Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestShelveInstance-1494268344-project Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 could not be found. Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': '6949960b-a0a6-49ca-8f41-e82ae038fcc4'} Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 could not be found. Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 could not be found. Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 21:01:38.627631 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 could not be found. Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Returning 404 to user: Instance 6949960b-a0a6-49ca-8f41-e82ae038fcc4 could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d7c13a52-e884-4fe2-82b8-a8b69ae1bad8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4" status: 404 len: 111 microversion: 2.1 time: 0.035411 Jul 26 21:01:38.632652 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3710/7503] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:01:38 2022] GET /compute/v2.1/servers/6949960b-a0a6-49ca-8f41-e82ae038fcc4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 21:01:38.794181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-eb115990-63d0-4d67-a711-f7fadde5c1be tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '.version_select at 0x7f8755f1b700>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:38.816264 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-eb115990-63d0-4d67-a711-f7fadde5c1be tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2088395894" status: 202 len: 0 microversion: 2.1 time: 0.026120 Jul 26 21:01:38.816831 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3794/7504] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Jul 26 21:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2088395894 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 21:01:38.841973 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-58d27d1b-549f-4094-a19b-905da94a95c0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Action: 'create', calling method: .version_select at 0x7f875c635790>, body: {"keypair": {"name": "tempest-TestShelveInstance-305534641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG91LNj4+LYv+y2EvBOlf7R2Rl3OVzER+IDUYQ2scy7VFh6OYnlJlZOa5koCOuN55vOuzIhvRD27TMO5bp7G3BSvSGefCkPuFNZktv25kZdsGZzEfV9zrQFbHvUJYxDiA=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:01:38.857095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-58d27d1b-549f-4094-a19b-905da94a95c0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Getting quotas for project dc7e71d41ee44f1296c8715c1e3b3955. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 21:01:38.862891 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-58d27d1b-549f-4094-a19b-905da94a95c0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Getting quotas for user 1e5496dff2fa4d07b063a546b482eb49 and project dc7e71d41ee44f1296c8715c1e3b3955. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 21:01:38.889033 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-58d27d1b-549f-4094-a19b-905da94a95c0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.051652 Jul 26 21:01:38.889639 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3711/7505] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 21:01:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:01:55.044087 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1245853331", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-305534641", "security_groups": [{"name": "tempest-secgroup-smoke-1625753283"}], "networks": [{"uuid": "6bd60cc7-76ca-4554-beae-9b35268a2fec"}], "block_device_mapping_v2": [{"uuid": "0dbab91d-c923-4c09-a64d-44a65dccb4ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:01:55.053820 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=10 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:55.055013 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:55.160545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] validate_networks() for [('6bd60cc7-76ca-4554-beae-9b35268a2fec', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 21:01:55.590424 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 21:01:55.590877 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 21:01:55.591354 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 21:01:55.591803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 21:01:55.592217 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 21:01:55.601035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:55.601480 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:55.602272 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:55.602706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:55.620052 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Getting quotas for project dc7e71d41ee44f1296c8715c1e3b3955. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 21:01:55.625636 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Getting quotas for user 1e5496dff2fa4d07b063a546b482eb49 and project dc7e71d41ee44f1296c8715c1e3b3955. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 21:01:55.684357 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 21:01:55.686635 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0dbab91d-c923-4c09-a64d-44a65dccb4ca',volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 21:01:55.812871 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-45993397-d39b-49a5-8552-bb6dc59e2db7 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773118 Jul 26 21:01:55.813533 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3795/7506] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 21:01:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 21:01:55.822347 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:55.823959 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=4 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:55.824830 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:01:55.829539 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-2d525903-f93c-4cac-b38c-46774e337b66 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:55.830176 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-2d525903-f93c-4cac-b38c-46774e337b66 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:01:55.889203 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-2d525903-f93c-4cac-b38c-46774e337b66 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:01:55.897130 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-2d525903-f93c-4cac-b38c-46774e337b66 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1088 microversion: 2.1 time: 0.076662 Jul 26 21:01:55.897861 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3712/7507] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:01:55 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:01:56.919120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0dc6eda0-f109-4249-b40b-b82ec5854ac6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:56.919878 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0dc6eda0-f109-4249-b40b-b82ec5854ac6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:01:56.926955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0dc6eda0-f109-4249-b40b-b82ec5854ac6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:56.927474 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0dc6eda0-f109-4249-b40b-b82ec5854ac6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:56.928399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0dc6eda0-f109-4249-b40b-b82ec5854ac6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:56.928955 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0dc6eda0-f109-4249-b40b-b82ec5854ac6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:57.005416 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0dc6eda0-f109-4249-b40b-b82ec5854ac6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:01:57.015167 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0dc6eda0-f109-4249-b40b-b82ec5854ac6 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1204 microversion: 2.1 time: 0.100788 Jul 26 21:01:57.015806 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3796/7508] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:01:56 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:01:58.044762 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-93c42b21-2be9-4b5e-9ea2-cf2154f007f3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:58.048215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-93c42b21-2be9-4b5e-9ea2-cf2154f007f3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:01:58.059369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93c42b21-2be9-4b5e-9ea2-cf2154f007f3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:58.060006 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93c42b21-2be9-4b5e-9ea2-cf2154f007f3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:58.060908 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93c42b21-2be9-4b5e-9ea2-cf2154f007f3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:58.064289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93c42b21-2be9-4b5e-9ea2-cf2154f007f3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:58.228244 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-93c42b21-2be9-4b5e-9ea2-cf2154f007f3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:01:58.239428 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-93c42b21-2be9-4b5e-9ea2-cf2154f007f3 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1272 microversion: 2.1 time: 0.200379 Jul 26 21:01:58.240704 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3713/7509] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:01:58 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:01:58.589883 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-e4781659-f562-4b67-a1cd-6412b34b6b38 req-4ea3ce4b-9323-4db7-9a98-ad5ef4c00234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d801aba8-55cf-4a98-954d-98ad5565b94d", "tag": "a8b58e01-c9c2-494a-baf7-5e8c5906aa7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:01:58.612004 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e4781659-f562-4b67-a1cd-6412b34b6b38 req-4ea3ce4b-9323-4db7-9a98-ad5ef4c00234 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:58.612560 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-e4781659-f562-4b67-a1cd-6412b34b6b38 req-4ea3ce4b-9323-4db7-9a98-ad5ef4c00234 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:58.627077 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-e4781659-f562-4b67-a1cd-6412b34b6b38 req-4ea3ce4b-9323-4db7-9a98-ad5ef4c00234 service nova] Creating event network-changed:a8b58e01-c9c2-494a-baf7-5e8c5906aa7b for instance d801aba8-55cf-4a98-954d-98ad5565b94d on n-h2-708768-8 Jul 26 21:01:58.632631 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-e4781659-f562-4b67-a1cd-6412b34b6b38 req-4ea3ce4b-9323-4db7-9a98-ad5ef4c00234 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053879 Jul 26 21:01:58.633920 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3797/7510] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:01:59.261960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75b5ef8f-51fd-4a2b-90a3-1846123eb76e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:01:59.262761 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-75b5ef8f-51fd-4a2b-90a3-1846123eb76e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:01:59.270206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75b5ef8f-51fd-4a2b-90a3-1846123eb76e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:59.270982 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75b5ef8f-51fd-4a2b-90a3-1846123eb76e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:59.272558 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75b5ef8f-51fd-4a2b-90a3-1846123eb76e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:01:59.273140 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75b5ef8f-51fd-4a2b-90a3-1846123eb76e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:01:59.421556 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-75b5ef8f-51fd-4a2b-90a3-1846123eb76e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:01:59.429283 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-75b5ef8f-51fd-4a2b-90a3-1846123eb76e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1272 microversion: 2.1 time: 0.171827 Jul 26 21:01:59.429871 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3714/7511] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:01:59 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:00.453898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-475d6f65-b41c-4caa-a459-e2c143531a68 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:00.454497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-475d6f65-b41c-4caa-a459-e2c143531a68 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:00.460835 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-475d6f65-b41c-4caa-a459-e2c143531a68 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:00.461289 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-475d6f65-b41c-4caa-a459-e2c143531a68 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:00.462058 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-475d6f65-b41c-4caa-a459-e2c143531a68 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:00.462495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-475d6f65-b41c-4caa-a459-e2c143531a68 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:00.604030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-475d6f65-b41c-4caa-a459-e2c143531a68 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:00.612139 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-475d6f65-b41c-4caa-a459-e2c143531a68 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1272 microversion: 2.1 time: 0.165379 Jul 26 21:02:00.612723 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3798/7512] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:00 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 21:02:01.633457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f527ee89-516f-44d0-bb48-bf6b92dd2363 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:01.634092 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f527ee89-516f-44d0-bb48-bf6b92dd2363 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:01.641110 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f527ee89-516f-44d0-bb48-bf6b92dd2363 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:01.641573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f527ee89-516f-44d0-bb48-bf6b92dd2363 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:01.642360 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f527ee89-516f-44d0-bb48-bf6b92dd2363 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:01.642815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f527ee89-516f-44d0-bb48-bf6b92dd2363 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:01.778468 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f527ee89-516f-44d0-bb48-bf6b92dd2363 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:01.786519 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f527ee89-516f-44d0-bb48-bf6b92dd2363 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1272 microversion: 2.1 time: 0.156901 Jul 26 21:02:01.787665 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3715/7513] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:01 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:02.810218 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3bf39dd2-7e27-4fd2-8cd1-f2312350d3a0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:02.810814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3bf39dd2-7e27-4fd2-8cd1-f2312350d3a0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:02.817703 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bf39dd2-7e27-4fd2-8cd1-f2312350d3a0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:02.818151 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bf39dd2-7e27-4fd2-8cd1-f2312350d3a0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:02.818928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bf39dd2-7e27-4fd2-8cd1-f2312350d3a0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:02.819362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3bf39dd2-7e27-4fd2-8cd1-f2312350d3a0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:02.948921 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-3bf39dd2-7e27-4fd2-8cd1-f2312350d3a0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:02.956554 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3bf39dd2-7e27-4fd2-8cd1-f2312350d3a0 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.151206 Jul 26 21:02:02.957122 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3799/7514] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:02 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:03.979726 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-37eb6c35-cd57-4dea-b10c-7164077edaf2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:03.980361 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-37eb6c35-cd57-4dea-b10c-7164077edaf2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:03.987214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37eb6c35-cd57-4dea-b10c-7164077edaf2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:03.987699 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37eb6c35-cd57-4dea-b10c-7164077edaf2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:03.988474 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37eb6c35-cd57-4dea-b10c-7164077edaf2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:03.988922 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-37eb6c35-cd57-4dea-b10c-7164077edaf2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:04.122289 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-37eb6c35-cd57-4dea-b10c-7164077edaf2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:04.129750 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-37eb6c35-cd57-4dea-b10c-7164077edaf2 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.153969 Jul 26 21:02:04.130551 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3716/7515] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:03 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:05.150274 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-001300ca-9a4b-41e2-975b-88a211e5d383 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:05.151739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-001300ca-9a4b-41e2-975b-88a211e5d383 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:05.158676 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-001300ca-9a4b-41e2-975b-88a211e5d383 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:05.159121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-001300ca-9a4b-41e2-975b-88a211e5d383 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:05.159915 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-001300ca-9a4b-41e2-975b-88a211e5d383 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:05.160348 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-001300ca-9a4b-41e2-975b-88a211e5d383 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:05.293216 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-001300ca-9a4b-41e2-975b-88a211e5d383 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:05.300820 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-001300ca-9a4b-41e2-975b-88a211e5d383 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.154419 Jul 26 21:02:05.301396 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3800/7516] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:05 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:06.322895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1eb33652-79a0-47a7-b4ae-6613a5e42a03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:06.323741 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1eb33652-79a0-47a7-b4ae-6613a5e42a03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:06.326462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:02:06.332255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1eb33652-79a0-47a7-b4ae-6613a5e42a03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:06.332718 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1eb33652-79a0-47a7-b4ae-6613a5e42a03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:06.333498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1eb33652-79a0-47a7-b4ae-6613a5e42a03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:06.333948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1eb33652-79a0-47a7-b4ae-6613a5e42a03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:06.467091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1eb33652-79a0-47a7-b4ae-6613a5e42a03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:06.474541 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1eb33652-79a0-47a7-b4ae-6613a5e42a03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.156011 Jul 26 21:02:06.475106 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3717/7517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:06 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:07.495754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-aa08f129-cb21-4f99-a793-0c1ede9cf0da tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:07.496389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-aa08f129-cb21-4f99-a793-0c1ede9cf0da tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:07.498376 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:02:07.499204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:02:07.505847 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa08f129-cb21-4f99-a793-0c1ede9cf0da tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:07.506299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa08f129-cb21-4f99-a793-0c1ede9cf0da tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:07.507104 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa08f129-cb21-4f99-a793-0c1ede9cf0da tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:07.507546 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-aa08f129-cb21-4f99-a793-0c1ede9cf0da tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:07.641715 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-aa08f129-cb21-4f99-a793-0c1ede9cf0da tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:07.649831 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-aa08f129-cb21-4f99-a793-0c1ede9cf0da tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.158127 Jul 26 21:02:07.650941 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3801/7518] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:07 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:08.671995 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-24cc8c0d-3f73-4bc5-b6b7-8fabe88a3ec1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:08.672620 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-24cc8c0d-3f73-4bc5-b6b7-8fabe88a3ec1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:08.679533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24cc8c0d-3f73-4bc5-b6b7-8fabe88a3ec1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:08.680012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24cc8c0d-3f73-4bc5-b6b7-8fabe88a3ec1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:08.680777 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24cc8c0d-3f73-4bc5-b6b7-8fabe88a3ec1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:08.681215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-24cc8c0d-3f73-4bc5-b6b7-8fabe88a3ec1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:08.811228 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-24cc8c0d-3f73-4bc5-b6b7-8fabe88a3ec1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:08.818698 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-24cc8c0d-3f73-4bc5-b6b7-8fabe88a3ec1 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.150641 Jul 26 21:02:08.819270 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3718/7519] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:08 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:09.840597 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e13f7c5d-92d9-4865-9752-151cc7c03028 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:09.841223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e13f7c5d-92d9-4865-9752-151cc7c03028 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:09.848477 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e13f7c5d-92d9-4865-9752-151cc7c03028 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:09.848924 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e13f7c5d-92d9-4865-9752-151cc7c03028 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:09.849704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e13f7c5d-92d9-4865-9752-151cc7c03028 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:09.850145 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e13f7c5d-92d9-4865-9752-151cc7c03028 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:09.989113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e13f7c5d-92d9-4865-9752-151cc7c03028 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:09.996939 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e13f7c5d-92d9-4865-9752-151cc7c03028 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.160792 Jul 26 21:02:09.997783 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3802/7520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:09 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:11.017882 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-dc5bc477-6e18-474b-b5c2-16990a9efd49 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:11.018516 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-dc5bc477-6e18-474b-b5c2-16990a9efd49 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:11.025190 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dc5bc477-6e18-474b-b5c2-16990a9efd49 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:11.025658 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dc5bc477-6e18-474b-b5c2-16990a9efd49 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:11.026635 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dc5bc477-6e18-474b-b5c2-16990a9efd49 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:11.027090 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-dc5bc477-6e18-474b-b5c2-16990a9efd49 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:11.156669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-dc5bc477-6e18-474b-b5c2-16990a9efd49 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:11.164172 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-dc5bc477-6e18-474b-b5c2-16990a9efd49 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.150323 Jul 26 21:02:11.164746 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3719/7521] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:11 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:11.736436 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-d7a9b543-8ecd-4720-aef1-716d40214852 req-b28ca413-7a2c-4378-bd9d-808e8ca27d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d801aba8-55cf-4a98-954d-98ad5565b94d", "name": "network-vif-plugged", "status": "completed", "tag": "a8b58e01-c9c2-494a-baf7-5e8c5906aa7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:02:11.748300 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d7a9b543-8ecd-4720-aef1-716d40214852 req-b28ca413-7a2c-4378-bd9d-808e8ca27d4d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:11.748745 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-d7a9b543-8ecd-4720-aef1-716d40214852 req-b28ca413-7a2c-4378-bd9d-808e8ca27d4d service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:12.010524 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-d7a9b543-8ecd-4720-aef1-716d40214852 req-b28ca413-7a2c-4378-bd9d-808e8ca27d4d service nova] Creating event network-vif-plugged:a8b58e01-c9c2-494a-baf7-5e8c5906aa7b for instance d801aba8-55cf-4a98-954d-98ad5565b94d on n-h2-708768-8 Jul 26 21:02:12.016042 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-d7a9b543-8ecd-4720-aef1-716d40214852 req-b28ca413-7a2c-4378-bd9d-808e8ca27d4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283524 Jul 26 21:02:12.016637 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3803/7522] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:02:12.185304 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-cf8f4515-3fd6-4f22-855e-7413ac68c94e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:12.185926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-cf8f4515-3fd6-4f22-855e-7413ac68c94e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:12.192837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf8f4515-3fd6-4f22-855e-7413ac68c94e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:12.193295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf8f4515-3fd6-4f22-855e-7413ac68c94e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:12.194064 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf8f4515-3fd6-4f22-855e-7413ac68c94e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:12.194508 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-cf8f4515-3fd6-4f22-855e-7413ac68c94e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:12.330807 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-cf8f4515-3fd6-4f22-855e-7413ac68c94e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:12.338261 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-cf8f4515-3fd6-4f22-855e-7413ac68c94e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1260 microversion: 2.1 time: 0.157170 Jul 26 21:02:12.339389 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3720/7523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:12 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:13.364787 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f496f9a7-0d8a-4233-a21a-aa7d5cbd1237 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:13.366547 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f496f9a7-0d8a-4233-a21a-aa7d5cbd1237 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:13.375578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f496f9a7-0d8a-4233-a21a-aa7d5cbd1237 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:13.376196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f496f9a7-0d8a-4233-a21a-aa7d5cbd1237 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:13.378723 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f496f9a7-0d8a-4233-a21a-aa7d5cbd1237 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:13.379022 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f496f9a7-0d8a-4233-a21a-aa7d5cbd1237 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:13.515123 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f496f9a7-0d8a-4233-a21a-aa7d5cbd1237 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:13.522714 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f496f9a7-0d8a-4233-a21a-aa7d5cbd1237 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1444 microversion: 2.1 time: 0.165819 Jul 26 21:02:13.523284 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3804/7524] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:13 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 21:02:13.542875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8c3b6c2c-c2ea-4b70-b827-f8e367df8229 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:02:13.543506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-8c3b6c2c-c2ea-4b70-b827-f8e367df8229 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:02:13.550459 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c3b6c2c-c2ea-4b70-b827-f8e367df8229 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:13.550926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c3b6c2c-c2ea-4b70-b827-f8e367df8229 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:13.551735 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c3b6c2c-c2ea-4b70-b827-f8e367df8229 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:13.552193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-8c3b6c2c-c2ea-4b70-b827-f8e367df8229 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:13.683264 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-8c3b6c2c-c2ea-4b70-b827-f8e367df8229 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:02:13.690867 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8c3b6c2c-c2ea-4b70-b827-f8e367df8229 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1444 microversion: 2.1 time: 0.151940 Jul 26 21:02:13.691434 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3721/7525] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:02:13 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:02:15.548242 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-58771b66-e855-4097-83b3-b8b2088483b6 req-a7beb95e-cbaa-4729-8c9b-d360445a82ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d801aba8-55cf-4a98-954d-98ad5565b94d", "tag": "a8b58e01-c9c2-494a-baf7-5e8c5906aa7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:02:15.559379 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-58771b66-e855-4097-83b3-b8b2088483b6 req-a7beb95e-cbaa-4729-8c9b-d360445a82ce service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:02:15.559932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-58771b66-e855-4097-83b3-b8b2088483b6 req-a7beb95e-cbaa-4729-8c9b-d360445a82ce service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:02:15.571200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-58771b66-e855-4097-83b3-b8b2088483b6 req-a7beb95e-cbaa-4729-8c9b-d360445a82ce service nova] Creating event network-changed:a8b58e01-c9c2-494a-baf7-5e8c5906aa7b for instance d801aba8-55cf-4a98-954d-98ad5565b94d on n-h2-708768-8 Jul 26 21:02:15.577237 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-58771b66-e855-4097-83b3-b8b2088483b6 req-a7beb95e-cbaa-4729-8c9b-d360445a82ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032607 Jul 26 21:02:15.578299 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3805/7526] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:03:04.746945 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:03:04.747447 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:03:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:04:11.048667 n-d-708768-8 devstack@n-api.service[125963]: ERROR oslo.messaging._drivers.impl_rabbit [-] [126f5d12-0094-4580-8dac-f2bd48a90f54] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 21:04:11.049237 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=22 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:04:11.050447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=54 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:04:11.135751 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00f4b72d-d26f-426d-9aed-b1b26ef059dd tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:04:11.136302 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00f4b72d-d26f-426d-9aed-b1b26ef059dd tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:11.142233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f4b72d-d26f-426d-9aed-b1b26ef059dd tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:11.142688 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f4b72d-d26f-426d-9aed-b1b26ef059dd tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:11.143513 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f4b72d-d26f-426d-9aed-b1b26ef059dd tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:11.144048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00f4b72d-d26f-426d-9aed-b1b26ef059dd tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:11.165970 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-00f4b72d-d26f-426d-9aed-b1b26ef059dd tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lazy-loading 'flavor' on Instance uuid d801aba8-55cf-4a98-954d-98ad5565b94d {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 21:04:11.235758 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00f4b72d-d26f-426d-9aed-b1b26ef059dd tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "POST /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d/action" status: 202 len: 0 microversion: 2.1 time: 0.189092 Jul 26 21:04:11.236317 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3722/7527] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 21:04:11 2022] POST /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 21:04:11.243404 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 21:04:11.247321 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-49633cbd-1d33-4c8a-8d27-1cfef6849115 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:11.248053 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-49633cbd-1d33-4c8a-8d27-1cfef6849115 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:11.250485 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 21:04:11.251005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:04:11.251670 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=50 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:04:11.258669 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49633cbd-1d33-4c8a-8d27-1cfef6849115 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:11.259114 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49633cbd-1d33-4c8a-8d27-1cfef6849115 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:11.260099 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49633cbd-1d33-4c8a-8d27-1cfef6849115 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:11.260535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-49633cbd-1d33-4c8a-8d27-1cfef6849115 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:11.439111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-49633cbd-1d33-4c8a-8d27-1cfef6849115 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:11.446697 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-49633cbd-1d33-4c8a-8d27-1cfef6849115 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.205194 Jul 26 21:04:11.447252 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3806/7528] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:11 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:12.470400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ba8a99f8-3062-486d-ae14-9b3d57740001 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:12.471119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ba8a99f8-3062-486d-ae14-9b3d57740001 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:12.479209 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba8a99f8-3062-486d-ae14-9b3d57740001 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:12.479702 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba8a99f8-3062-486d-ae14-9b3d57740001 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:12.480481 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba8a99f8-3062-486d-ae14-9b3d57740001 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:12.480934 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ba8a99f8-3062-486d-ae14-9b3d57740001 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:12.485124 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] [126f5d12-0094-4580-8dac-f2bd48a90f54] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47276. Jul 26 21:04:12.672201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ba8a99f8-3062-486d-ae14-9b3d57740001 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:12.679815 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ba8a99f8-3062-486d-ae14-9b3d57740001 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.215112 Jul 26 21:04:12.680379 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3723/7529] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:12 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:13.701172 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e5768d95-a8bc-4b20-ac10-c3f3e5c40e8c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:13.701795 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e5768d95-a8bc-4b20-ac10-c3f3e5c40e8c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:13.717529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5768d95-a8bc-4b20-ac10-c3f3e5c40e8c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:13.717988 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5768d95-a8bc-4b20-ac10-c3f3e5c40e8c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:13.718770 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5768d95-a8bc-4b20-ac10-c3f3e5c40e8c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:13.719213 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e5768d95-a8bc-4b20-ac10-c3f3e5c40e8c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:13.719889 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47286. Jul 26 21:04:13.726964 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47284. Jul 26 21:04:13.854996 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e5768d95-a8bc-4b20-ac10-c3f3e5c40e8c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:13.863624 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e5768d95-a8bc-4b20-ac10-c3f3e5c40e8c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.165951 Jul 26 21:04:13.864295 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3807/7530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:13 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:14.884744 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-07f05cd3-09dd-423b-b41e-3831e91135e9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:14.885369 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-07f05cd3-09dd-423b-b41e-3831e91135e9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:14.892519 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07f05cd3-09dd-423b-b41e-3831e91135e9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:14.892984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07f05cd3-09dd-423b-b41e-3831e91135e9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:14.894500 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07f05cd3-09dd-423b-b41e-3831e91135e9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:14.894953 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-07f05cd3-09dd-423b-b41e-3831e91135e9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:15.026178 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-07f05cd3-09dd-423b-b41e-3831e91135e9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:15.033838 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-07f05cd3-09dd-423b-b41e-3831e91135e9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.153066 Jul 26 21:04:15.034637 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3724/7531] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:14 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 21:04:16.056559 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-66064134-92d4-4ed5-9f3e-8ffffce6c2b9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:16.057111 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-66064134-92d4-4ed5-9f3e-8ffffce6c2b9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:16.064060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66064134-92d4-4ed5-9f3e-8ffffce6c2b9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:16.064507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66064134-92d4-4ed5-9f3e-8ffffce6c2b9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:16.065316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66064134-92d4-4ed5-9f3e-8ffffce6c2b9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:16.065751 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-66064134-92d4-4ed5-9f3e-8ffffce6c2b9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:16.194400 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-66064134-92d4-4ed5-9f3e-8ffffce6c2b9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:16.201916 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-66064134-92d4-4ed5-9f3e-8ffffce6c2b9 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.149611 Jul 26 21:04:16.202478 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3808/7532] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:16 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:17.223233 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f1aea472-9cf3-4765-bcab-a2c5b992afea tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:17.223926 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f1aea472-9cf3-4765-bcab-a2c5b992afea tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:17.230824 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1aea472-9cf3-4765-bcab-a2c5b992afea tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:17.231282 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1aea472-9cf3-4765-bcab-a2c5b992afea tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:17.232082 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1aea472-9cf3-4765-bcab-a2c5b992afea tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:17.232533 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f1aea472-9cf3-4765-bcab-a2c5b992afea tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:17.362686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f1aea472-9cf3-4765-bcab-a2c5b992afea tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:17.370505 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f1aea472-9cf3-4765-bcab-a2c5b992afea tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.151495 Jul 26 21:04:17.371060 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3725/7533] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:17 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:18.392345 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-205bc0f6-d985-4048-a0f3-3e94f49de52e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:18.392943 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-205bc0f6-d985-4048-a0f3-3e94f49de52e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:18.400018 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-205bc0f6-d985-4048-a0f3-3e94f49de52e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:18.400470 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-205bc0f6-d985-4048-a0f3-3e94f49de52e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:18.401245 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-205bc0f6-d985-4048-a0f3-3e94f49de52e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:18.401687 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-205bc0f6-d985-4048-a0f3-3e94f49de52e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:18.554225 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-205bc0f6-d985-4048-a0f3-3e94f49de52e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:18.562196 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-205bc0f6-d985-4048-a0f3-3e94f49de52e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.174419 Jul 26 21:04:18.562780 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3809/7534] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:18 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:19.584416 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b25d87a7-3dde-4a4e-a2a7-85bb73040f48 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:19.585041 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b25d87a7-3dde-4a4e-a2a7-85bb73040f48 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:19.591981 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b25d87a7-3dde-4a4e-a2a7-85bb73040f48 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:19.592472 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b25d87a7-3dde-4a4e-a2a7-85bb73040f48 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:19.593255 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b25d87a7-3dde-4a4e-a2a7-85bb73040f48 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:19.593705 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b25d87a7-3dde-4a4e-a2a7-85bb73040f48 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:19.731825 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b25d87a7-3dde-4a4e-a2a7-85bb73040f48 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:19.739619 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b25d87a7-3dde-4a4e-a2a7-85bb73040f48 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.159899 Jul 26 21:04:19.740201 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3726/7535] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:19 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 21:04:20.760967 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0e8e3f7d-aeef-4f2c-aa91-4695c278854d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:20.761588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0e8e3f7d-aeef-4f2c-aa91-4695c278854d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:20.768650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e8e3f7d-aeef-4f2c-aa91-4695c278854d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:20.769119 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e8e3f7d-aeef-4f2c-aa91-4695c278854d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:20.770373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e8e3f7d-aeef-4f2c-aa91-4695c278854d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:20.770807 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0e8e3f7d-aeef-4f2c-aa91-4695c278854d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:20.901432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0e8e3f7d-aeef-4f2c-aa91-4695c278854d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:20.909069 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0e8e3f7d-aeef-4f2c-aa91-4695c278854d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.152005 Jul 26 21:04:20.909641 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3810/7536] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:20 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:21.932447 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b23cec3c-ff72-417f-afea-d48a17d4f69d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:21.933068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b23cec3c-ff72-417f-afea-d48a17d4f69d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:21.940142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b23cec3c-ff72-417f-afea-d48a17d4f69d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:21.940608 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b23cec3c-ff72-417f-afea-d48a17d4f69d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:21.941573 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b23cec3c-ff72-417f-afea-d48a17d4f69d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:21.942113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b23cec3c-ff72-417f-afea-d48a17d4f69d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:22.071053 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b23cec3c-ff72-417f-afea-d48a17d4f69d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:22.078666 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b23cec3c-ff72-417f-afea-d48a17d4f69d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.150384 Jul 26 21:04:22.079226 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3727/7537] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:21 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:23.100381 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-819cd5e6-c061-4898-9c9a-c837c6d85a2d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:23.101005 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-819cd5e6-c061-4898-9c9a-c837c6d85a2d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:23.108060 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-819cd5e6-c061-4898-9c9a-c837c6d85a2d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:23.108518 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-819cd5e6-c061-4898-9c9a-c837c6d85a2d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:23.109293 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-819cd5e6-c061-4898-9c9a-c837c6d85a2d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:23.109737 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-819cd5e6-c061-4898-9c9a-c837c6d85a2d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:23.244631 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-819cd5e6-c061-4898-9c9a-c837c6d85a2d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:23.252278 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-819cd5e6-c061-4898-9c9a-c837c6d85a2d tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.155939 Jul 26 21:04:23.252849 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3811/7538] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:23 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:24.274572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-60e74e5c-e0d4-4954-8247-6e953e4d1207 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:24.275197 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-60e74e5c-e0d4-4954-8247-6e953e4d1207 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:24.282505 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60e74e5c-e0d4-4954-8247-6e953e4d1207 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:24.282979 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60e74e5c-e0d4-4954-8247-6e953e4d1207 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:24.283815 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60e74e5c-e0d4-4954-8247-6e953e4d1207 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:24.284267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-60e74e5c-e0d4-4954-8247-6e953e4d1207 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:24.421300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-60e74e5c-e0d4-4954-8247-6e953e4d1207 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:24.429675 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-60e74e5c-e0d4-4954-8247-6e953e4d1207 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.159098 Jul 26 21:04:24.430258 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3728/7539] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:24 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:25.453561 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a2e927a9-4cf0-46ab-a50e-a51cd5eea28e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:25.454103 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a2e927a9-4cf0-46ab-a50e-a51cd5eea28e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:25.461959 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2e927a9-4cf0-46ab-a50e-a51cd5eea28e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:25.462408 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2e927a9-4cf0-46ab-a50e-a51cd5eea28e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:25.463177 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2e927a9-4cf0-46ab-a50e-a51cd5eea28e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:25.463729 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a2e927a9-4cf0-46ab-a50e-a51cd5eea28e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:25.600760 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a2e927a9-4cf0-46ab-a50e-a51cd5eea28e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:25.608511 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a2e927a9-4cf0-46ab-a50e-a51cd5eea28e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1570 microversion: 2.1 time: 0.160334 Jul 26 21:04:25.609084 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3812/7540] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:25 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:25.629419 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-27e07440-cf6f-425e-ac00-f8af98ac0a62 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:04:25.630093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-27e07440-cf6f-425e-ac00-f8af98ac0a62 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:25.636949 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27e07440-cf6f-425e-ac00-f8af98ac0a62 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:25.637418 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27e07440-cf6f-425e-ac00-f8af98ac0a62 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:25.638193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27e07440-cf6f-425e-ac00-f8af98ac0a62 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:25.638645 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-27e07440-cf6f-425e-ac00-f8af98ac0a62 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:25.781780 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-27e07440-cf6f-425e-ac00-f8af98ac0a62 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "POST /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d/action" status: 202 len: 0 microversion: 2.1 time: 0.156874 Jul 26 21:04:25.782439 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3729/7541] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 21:04:25 2022] POST /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 21:04:25.790530 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-989d1b1c-9e33-4fe2-afe4-17def89e497b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:25.791152 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-989d1b1c-9e33-4fe2-afe4-17def89e497b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:25.797109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-989d1b1c-9e33-4fe2-afe4-17def89e497b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:25.797558 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-989d1b1c-9e33-4fe2-afe4-17def89e497b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:25.798326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-989d1b1c-9e33-4fe2-afe4-17def89e497b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:25.798767 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-989d1b1c-9e33-4fe2-afe4-17def89e497b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:25.933137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-989d1b1c-9e33-4fe2-afe4-17def89e497b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:25.940886 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-989d1b1c-9e33-4fe2-afe4-17def89e497b tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1518 microversion: 2.1 time: 0.154198 Jul 26 21:04:25.942103 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3813/7542] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:25 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:26.963137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-7520caed-d5f8-4ee8-ace7-aa3cda29ba6e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:26.963797 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-7520caed-d5f8-4ee8-ace7-aa3cda29ba6e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:26.970895 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7520caed-d5f8-4ee8-ace7-aa3cda29ba6e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:26.971358 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7520caed-d5f8-4ee8-ace7-aa3cda29ba6e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:26.972715 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7520caed-d5f8-4ee8-ace7-aa3cda29ba6e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:26.973601 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-7520caed-d5f8-4ee8-ace7-aa3cda29ba6e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:27.113630 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-7520caed-d5f8-4ee8-ace7-aa3cda29ba6e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:27.122797 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-7520caed-d5f8-4ee8-ace7-aa3cda29ba6e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1520 microversion: 2.1 time: 0.163487 Jul 26 21:04:27.123395 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3730/7543] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:26 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:28.146315 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-bf2e0267-58ab-45ea-972d-e75c255d3157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:28.146857 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-bf2e0267-58ab-45ea-972d-e75c255d3157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:28.153814 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf2e0267-58ab-45ea-972d-e75c255d3157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:28.154260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf2e0267-58ab-45ea-972d-e75c255d3157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:28.155031 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf2e0267-58ab-45ea-972d-e75c255d3157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:28.155464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-bf2e0267-58ab-45ea-972d-e75c255d3157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:28.294156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-bf2e0267-58ab-45ea-972d-e75c255d3157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:28.302615 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-bf2e0267-58ab-45ea-972d-e75c255d3157 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1520 microversion: 2.1 time: 0.161016 Jul 26 21:04:28.303419 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3814/7544] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:28 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:28.424164 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d60758d5-073e-4d94-964a-310440b12f42 req-5834da55-b199-47f6-82b9-6965a14e4692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d801aba8-55cf-4a98-954d-98ad5565b94d", "name": "network-vif-unplugged", "status": "completed", "tag": "a8b58e01-c9c2-494a-baf7-5e8c5906aa7b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:04:28.437498 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d60758d5-073e-4d94-964a-310440b12f42 req-5834da55-b199-47f6-82b9-6965a14e4692 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:28.437993 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d60758d5-073e-4d94-964a-310440b12f42 req-5834da55-b199-47f6-82b9-6965a14e4692 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:28.450276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.compute.server_external_events [req-d60758d5-073e-4d94-964a-310440b12f42 req-5834da55-b199-47f6-82b9-6965a14e4692 service nova] Unable to find a host for instance d801aba8-55cf-4a98-954d-98ad5565b94d. Dropping event network-vif-unplugged {{(pid=125963) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 21:04:28.451185 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d60758d5-073e-4d94-964a-310440b12f42 req-5834da55-b199-47f6-82b9-6965a14e4692 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031402 Jul 26 21:04:28.451815 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3731/7545] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 21:04:29.325134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-a38aa647-d01a-4398-a9d6-e9d5828161fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:29.325707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-a38aa647-d01a-4398-a9d6-e9d5828161fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:29.332777 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a38aa647-d01a-4398-a9d6-e9d5828161fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:29.333222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a38aa647-d01a-4398-a9d6-e9d5828161fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:29.333982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a38aa647-d01a-4398-a9d6-e9d5828161fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:29.334421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-a38aa647-d01a-4398-a9d6-e9d5828161fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:29.469793 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-a38aa647-d01a-4398-a9d6-e9d5828161fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:29.478424 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-a38aa647-d01a-4398-a9d6-e9d5828161fe tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1520 microversion: 2.1 time: 0.157179 Jul 26 21:04:29.479024 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3815/7546] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:29 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:30.501433 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a3585f71-14f4-4be3-acba-d9b901a447ca tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:30.502048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a3585f71-14f4-4be3-acba-d9b901a447ca tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:30.509745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3585f71-14f4-4be3-acba-d9b901a447ca tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:30.510213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3585f71-14f4-4be3-acba-d9b901a447ca tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:30.511001 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3585f71-14f4-4be3-acba-d9b901a447ca tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:30.511458 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a3585f71-14f4-4be3-acba-d9b901a447ca tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:30.648961 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a3585f71-14f4-4be3-acba-d9b901a447ca tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:30.656989 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a3585f71-14f4-4be3-acba-d9b901a447ca tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1520 microversion: 2.1 time: 0.159525 Jul 26 21:04:30.657572 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3732/7547] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:30 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:31.677803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-2e986a36-8704-46d4-b63b-f569855a5423 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:31.678421 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-2e986a36-8704-46d4-b63b-f569855a5423 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:31.685507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e986a36-8704-46d4-b63b-f569855a5423 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:31.685961 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e986a36-8704-46d4-b63b-f569855a5423 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:31.686726 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e986a36-8704-46d4-b63b-f569855a5423 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:31.687161 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-2e986a36-8704-46d4-b63b-f569855a5423 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:31.911896 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-2e986a36-8704-46d4-b63b-f569855a5423 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:31.919463 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-2e986a36-8704-46d4-b63b-f569855a5423 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.245547 Jul 26 21:04:31.920075 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3816/7548] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:31 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:32.633849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-5bc417f4-f7b1-47a4-baa1-be9ed71b8e83 req-1da37b46-3d94-4f9a-838b-054e9cd7b20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d801aba8-55cf-4a98-954d-98ad5565b94d", "tag": "a8b58e01-c9c2-494a-baf7-5e8c5906aa7b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:04:32.644296 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5bc417f4-f7b1-47a4-baa1-be9ed71b8e83 req-1da37b46-3d94-4f9a-838b-054e9cd7b20c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:32.644907 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-5bc417f4-f7b1-47a4-baa1-be9ed71b8e83 req-1da37b46-3d94-4f9a-838b-054e9cd7b20c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:32.657243 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-5bc417f4-f7b1-47a4-baa1-be9ed71b8e83 req-1da37b46-3d94-4f9a-838b-054e9cd7b20c service nova] Creating event network-changed:a8b58e01-c9c2-494a-baf7-5e8c5906aa7b for instance d801aba8-55cf-4a98-954d-98ad5565b94d on n-h1-708768-8 Jul 26 21:04:32.663376 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-5bc417f4-f7b1-47a4-baa1-be9ed71b8e83 req-1da37b46-3d94-4f9a-838b-054e9cd7b20c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093640 Jul 26 21:04:32.664368 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3733/7549] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:04:32.942120 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-ced0e522-baec-4e73-917a-fdf19c12b330 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:32.942773 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-ced0e522-baec-4e73-917a-fdf19c12b330 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:32.949975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ced0e522-baec-4e73-917a-fdf19c12b330 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:32.950427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ced0e522-baec-4e73-917a-fdf19c12b330 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:32.951209 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ced0e522-baec-4e73-917a-fdf19c12b330 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:32.951690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-ced0e522-baec-4e73-917a-fdf19c12b330 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:33.243429 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-ced0e522-baec-4e73-917a-fdf19c12b330 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:33.251200 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-ced0e522-baec-4e73-917a-fdf19c12b330 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.313750 Jul 26 21:04:33.251901 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3817/7550] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:32 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:34.274847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f68215b6-9305-4918-bb34-39f61908cfee tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:34.275687 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f68215b6-9305-4918-bb34-39f61908cfee tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:34.281911 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f68215b6-9305-4918-bb34-39f61908cfee tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:34.282368 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f68215b6-9305-4918-bb34-39f61908cfee tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:34.283146 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f68215b6-9305-4918-bb34-39f61908cfee tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:34.283590 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f68215b6-9305-4918-bb34-39f61908cfee tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:34.415730 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f68215b6-9305-4918-bb34-39f61908cfee tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:34.423176 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f68215b6-9305-4918-bb34-39f61908cfee tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.153715 Jul 26 21:04:34.423767 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3734/7551] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:34 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:35.446056 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b812c875-d5ac-4ab7-bd05-2f015b00b34e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:35.446600 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b812c875-d5ac-4ab7-bd05-2f015b00b34e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:35.453571 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b812c875-d5ac-4ab7-bd05-2f015b00b34e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:35.454025 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b812c875-d5ac-4ab7-bd05-2f015b00b34e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:35.454797 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b812c875-d5ac-4ab7-bd05-2f015b00b34e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:35.455239 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b812c875-d5ac-4ab7-bd05-2f015b00b34e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:35.587373 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b812c875-d5ac-4ab7-bd05-2f015b00b34e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:35.594986 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b812c875-d5ac-4ab7-bd05-2f015b00b34e tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.152979 Jul 26 21:04:35.595589 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3818/7552] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:35 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 21:04:36.616521 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-9be9c161-adaf-4099-a415-a21dc9c93c80 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:36.617073 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-9be9c161-adaf-4099-a415-a21dc9c93c80 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:36.623956 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9be9c161-adaf-4099-a415-a21dc9c93c80 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:36.624414 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9be9c161-adaf-4099-a415-a21dc9c93c80 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:36.625184 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9be9c161-adaf-4099-a415-a21dc9c93c80 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:36.625626 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-9be9c161-adaf-4099-a415-a21dc9c93c80 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:36.762336 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-9be9c161-adaf-4099-a415-a21dc9c93c80 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:36.770957 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-9be9c161-adaf-4099-a415-a21dc9c93c80 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.158590 Jul 26 21:04:36.771661 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3735/7553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:36 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:37.793390 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-98422f67-1ead-44ee-972d-39a7fdcb507a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:37.794210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-98422f67-1ead-44ee-972d-39a7fdcb507a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:37.801314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98422f67-1ead-44ee-972d-39a7fdcb507a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:37.801769 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98422f67-1ead-44ee-972d-39a7fdcb507a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:37.802534 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98422f67-1ead-44ee-972d-39a7fdcb507a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:37.803030 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-98422f67-1ead-44ee-972d-39a7fdcb507a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:37.938006 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-98422f67-1ead-44ee-972d-39a7fdcb507a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:37.946268 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-98422f67-1ead-44ee-972d-39a7fdcb507a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.157618 Jul 26 21:04:37.946847 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3819/7554] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:37 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:38.967900 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a988d612-c8f6-4167-bfb3-fd79c31718ff tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:38.968506 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a988d612-c8f6-4167-bfb3-fd79c31718ff tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:38.976211 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a988d612-c8f6-4167-bfb3-fd79c31718ff tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:38.976668 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a988d612-c8f6-4167-bfb3-fd79c31718ff tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:38.977432 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a988d612-c8f6-4167-bfb3-fd79c31718ff tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:38.977877 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a988d612-c8f6-4167-bfb3-fd79c31718ff tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:39.111806 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a988d612-c8f6-4167-bfb3-fd79c31718ff tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:39.116078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:04:39.120974 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a988d612-c8f6-4167-bfb3-fd79c31718ff tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.156977 Jul 26 21:04:39.121552 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3736/7555] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:38 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:40.018209 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:04:40.019588 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 21:04:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:04:40.143055 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-dab70a17-76b5-45e5-96bf-f122d2821574 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:40.143667 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-dab70a17-76b5-45e5-96bf-f122d2821574 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:40.150813 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dab70a17-76b5-45e5-96bf-f122d2821574 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:40.151266 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dab70a17-76b5-45e5-96bf-f122d2821574 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:40.152059 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dab70a17-76b5-45e5-96bf-f122d2821574 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:40.152499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-dab70a17-76b5-45e5-96bf-f122d2821574 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:40.281359 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-dab70a17-76b5-45e5-96bf-f122d2821574 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:40.289178 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-dab70a17-76b5-45e5-96bf-f122d2821574 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.150133 Jul 26 21:04:40.289750 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3820/7556] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:40 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:41.311333 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-d72c6ba8-953d-47ee-ab85-3f01897e9871 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:41.312086 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-d72c6ba8-953d-47ee-ab85-3f01897e9871 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:41.316137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=33 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:04:41.323423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72c6ba8-953d-47ee-ab85-3f01897e9871 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:41.323917 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72c6ba8-953d-47ee-ab85-3f01897e9871 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:41.324710 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72c6ba8-953d-47ee-ab85-3f01897e9871 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:41.325165 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-d72c6ba8-953d-47ee-ab85-3f01897e9871 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:41.459482 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-d72c6ba8-953d-47ee-ab85-3f01897e9871 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:41.467013 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-d72c6ba8-953d-47ee-ab85-3f01897e9871 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.160005 Jul 26 21:04:41.467595 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3737/7557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:41 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:42.488706 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-d732686b-51f3-4604-909f-70edacf090c8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:42.489352 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-d732686b-51f3-4604-909f-70edacf090c8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:42.492044 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=31 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:04:42.497327 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d732686b-51f3-4604-909f-70edacf090c8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:42.497772 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d732686b-51f3-4604-909f-70edacf090c8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:42.498535 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d732686b-51f3-4604-909f-70edacf090c8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:42.498969 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-d732686b-51f3-4604-909f-70edacf090c8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:42.503015 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=91 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:04:42.640735 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-d732686b-51f3-4604-909f-70edacf090c8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:42.649511 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-d732686b-51f3-4604-909f-70edacf090c8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.164687 Jul 26 21:04:42.650089 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3821/7558] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:42 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:43.671050 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a0d9b9e6-c0d8-4507-b005-0f75ed31d288 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:43.671684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a0d9b9e6-c0d8-4507-b005-0f75ed31d288 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:43.678873 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0d9b9e6-c0d8-4507-b005-0f75ed31d288 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:43.679324 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0d9b9e6-c0d8-4507-b005-0f75ed31d288 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:43.680124 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0d9b9e6-c0d8-4507-b005-0f75ed31d288 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:43.680820 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a0d9b9e6-c0d8-4507-b005-0f75ed31d288 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:43.809276 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a0d9b9e6-c0d8-4507-b005-0f75ed31d288 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:43.818213 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a0d9b9e6-c0d8-4507-b005-0f75ed31d288 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.150795 Jul 26 21:04:43.818779 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3738/7559] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:43 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:44.840326 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1dc6e204-5130-432a-837f-26cc9f205746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:44.840947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1dc6e204-5130-432a-837f-26cc9f205746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:44.854478 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dc6e204-5130-432a-837f-26cc9f205746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:44.854928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dc6e204-5130-432a-837f-26cc9f205746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:44.855739 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dc6e204-5130-432a-837f-26cc9f205746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:44.856174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1dc6e204-5130-432a-837f-26cc9f205746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:44.911821 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-493cf40c-93b6-4cd6-a94c-39a2b0eb8e79 req-290f5fc5-093f-4b81-a35d-6882b54cb4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d801aba8-55cf-4a98-954d-98ad5565b94d", "name": "network-vif-plugged", "status": "completed", "tag": "a8b58e01-c9c2-494a-baf7-5e8c5906aa7b"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:04:44.923838 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-493cf40c-93b6-4cd6-a94c-39a2b0eb8e79 req-290f5fc5-093f-4b81-a35d-6882b54cb4c5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:44.925179 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-493cf40c-93b6-4cd6-a94c-39a2b0eb8e79 req-290f5fc5-093f-4b81-a35d-6882b54cb4c5 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:44.942706 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-493cf40c-93b6-4cd6-a94c-39a2b0eb8e79 req-290f5fc5-093f-4b81-a35d-6882b54cb4c5 service nova] Creating event network-vif-plugged:a8b58e01-c9c2-494a-baf7-5e8c5906aa7b for instance d801aba8-55cf-4a98-954d-98ad5565b94d on n-h1-708768-8 Jul 26 21:04:44.951072 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-493cf40c-93b6-4cd6-a94c-39a2b0eb8e79 req-290f5fc5-093f-4b81-a35d-6882b54cb4c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043650 Jul 26 21:04:44.951885 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3739/7560] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 21:04:45.001261 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1dc6e204-5130-432a-837f-26cc9f205746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:45.010379 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1dc6e204-5130-432a-837f-26cc9f205746 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.174212 Jul 26 21:04:45.011060 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3822/7561] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:44 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:46.033831 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-00ce4e19-85a2-45bd-93ae-1d58280e89ef tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:46.035137 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-00ce4e19-85a2-45bd-93ae-1d58280e89ef tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:46.043277 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00ce4e19-85a2-45bd-93ae-1d58280e89ef tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:46.043785 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00ce4e19-85a2-45bd-93ae-1d58280e89ef tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:46.044572 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00ce4e19-85a2-45bd-93ae-1d58280e89ef tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:46.045089 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-00ce4e19-85a2-45bd-93ae-1d58280e89ef tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:46.186091 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-00ce4e19-85a2-45bd-93ae-1d58280e89ef tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:46.194346 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-00ce4e19-85a2-45bd-93ae-1d58280e89ef tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1576 microversion: 2.1 time: 0.164834 Jul 26 21:04:46.194930 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3740/7562] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:46 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:47.216464 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e9585d3e-2256-4b46-809e-6c433bfffe24 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:04:47.217078 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e9585d3e-2256-4b46-809e-6c433bfffe24 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:04:47.224541 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9585d3e-2256-4b46-809e-6c433bfffe24 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:47.224975 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9585d3e-2256-4b46-809e-6c433bfffe24 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:47.225736 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9585d3e-2256-4b46-809e-6c433bfffe24 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:04:47.226196 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e9585d3e-2256-4b46-809e-6c433bfffe24 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:04:47.364754 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e9585d3e-2256-4b46-809e-6c433bfffe24 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:04:47.372330 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e9585d3e-2256-4b46-809e-6c433bfffe24 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1563 microversion: 2.1 time: 0.159786 Jul 26 21:04:47.372897 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3823/7563] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:04:47 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:04:56.110048 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:04:56.110710 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 21:04:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:06:01.074533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=5 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:01.076013 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=7 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:01.077507 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=17 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:01.078201 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=20 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:01.085548 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-c0fed619-1634-408c-be86-de108307781f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:01.086078 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c0fed619-1634-408c-be86-de108307781f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:01.093012 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0fed619-1634-408c-be86-de108307781f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:01.093478 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0fed619-1634-408c-be86-de108307781f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:01.094263 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0fed619-1634-408c-be86-de108307781f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:01.094717 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-c0fed619-1634-408c-be86-de108307781f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:01.097432 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-89352352-c1fb-4ed6-bf30-269451f5e7fd req-3c44aec2-0526-49c2-9efd-6a4e6cd42629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d801aba8-55cf-4a98-954d-98ad5565b94d", "tag": "a8b58e01-c9c2-494a-baf7-5e8c5906aa7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:06:01.108156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-89352352-c1fb-4ed6-bf30-269451f5e7fd req-3c44aec2-0526-49c2-9efd-6a4e6cd42629 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:01.108606 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-89352352-c1fb-4ed6-bf30-269451f5e7fd req-3c44aec2-0526-49c2-9efd-6a4e6cd42629 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:01.120591 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-89352352-c1fb-4ed6-bf30-269451f5e7fd req-3c44aec2-0526-49c2-9efd-6a4e6cd42629 service nova] Creating event network-changed:a8b58e01-c9c2-494a-baf7-5e8c5906aa7b for instance d801aba8-55cf-4a98-954d-98ad5565b94d on n-h1-708768-8 Jul 26 21:06:01.125446 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-c0fed619-1634-408c-be86-de108307781f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 21:06:01.127652 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-89352352-c1fb-4ed6-bf30-269451f5e7fd req-3c44aec2-0526-49c2-9efd-6a4e6cd42629 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054213 Jul 26 21:06:01.128449 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3824/7564] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:06:01.210441 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-c0fed619-1634-408c-be86-de108307781f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 204 len: 0 microversion: 2.1 time: 0.139957 Jul 26 21:06:01.211067 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3741/7565] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 21:06:01 2022] DELETE /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 21:06:01.222301 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-43792036-5da2-4479-a11c-51e41cf5ef1c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:01.223259 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-43792036-5da2-4479-a11c-51e41cf5ef1c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:01.229690 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43792036-5da2-4479-a11c-51e41cf5ef1c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:01.230220 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43792036-5da2-4479-a11c-51e41cf5ef1c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:01.231062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43792036-5da2-4479-a11c-51e41cf5ef1c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:01.231584 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-43792036-5da2-4479-a11c-51e41cf5ef1c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:01.398912 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-43792036-5da2-4479-a11c-51e41cf5ef1c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:01.406656 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-43792036-5da2-4479-a11c-51e41cf5ef1c tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.190669 Jul 26 21:06:01.407321 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3825/7566] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:01 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 21:06:02.429443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-db89e680-5a2c-4e05-8f3b-d410169c7c03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:02.430424 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-db89e680-5a2c-4e05-8f3b-d410169c7c03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:02.437725 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db89e680-5a2c-4e05-8f3b-d410169c7c03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:02.438183 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db89e680-5a2c-4e05-8f3b-d410169c7c03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:02.439529 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db89e680-5a2c-4e05-8f3b-d410169c7c03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:02.440351 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-db89e680-5a2c-4e05-8f3b-d410169c7c03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:02.580566 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-db89e680-5a2c-4e05-8f3b-d410169c7c03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:02.588318 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-db89e680-5a2c-4e05-8f3b-d410169c7c03 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1569 microversion: 2.1 time: 0.163181 Jul 26 21:06:02.588895 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3742/7567] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:02 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:03.178166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-24bbae8f-aeee-4ca2-b594-e7595a6e02f0 req-30db2668-cc9b-48fd-8a11-687e50a04493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d801aba8-55cf-4a98-954d-98ad5565b94d", "name": "network-vif-deleted", "tag": "a8b58e01-c9c2-494a-baf7-5e8c5906aa7b"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:06:03.190041 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-24bbae8f-aeee-4ca2-b594-e7595a6e02f0 req-30db2668-cc9b-48fd-8a11-687e50a04493 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:03.190497 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-24bbae8f-aeee-4ca2-b594-e7595a6e02f0 req-30db2668-cc9b-48fd-8a11-687e50a04493 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:03.202497 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-24bbae8f-aeee-4ca2-b594-e7595a6e02f0 req-30db2668-cc9b-48fd-8a11-687e50a04493 service nova] Creating event network-vif-deleted:a8b58e01-c9c2-494a-baf7-5e8c5906aa7b for instance d801aba8-55cf-4a98-954d-98ad5565b94d on n-h1-708768-8 Jul 26 21:06:03.207780 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-24bbae8f-aeee-4ca2-b594-e7595a6e02f0 req-30db2668-cc9b-48fd-8a11-687e50a04493 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033797 Jul 26 21:06:03.208383 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3826/7568] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:06:03.610215 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-949ffc8d-2a84-41a5-a75f-72a77b4e9879 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:03.610929 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-949ffc8d-2a84-41a5-a75f-72a77b4e9879 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:03.617987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-949ffc8d-2a84-41a5-a75f-72a77b4e9879 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:03.618441 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-949ffc8d-2a84-41a5-a75f-72a77b4e9879 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:03.619214 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-949ffc8d-2a84-41a5-a75f-72a77b4e9879 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:03.619678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-949ffc8d-2a84-41a5-a75f-72a77b4e9879 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:03.681486 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-949ffc8d-2a84-41a5-a75f-72a77b4e9879 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:03.689656 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-949ffc8d-2a84-41a5-a75f-72a77b4e9879 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1219 microversion: 2.1 time: 0.082912 Jul 26 21:06:03.690350 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3743/7569] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:03 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:04.711913 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-1f06a2de-25f1-411f-9a3c-c21ba56825a8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:04.712623 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-1f06a2de-25f1-411f-9a3c-c21ba56825a8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:04.718946 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06a2de-25f1-411f-9a3c-c21ba56825a8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:04.719393 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06a2de-25f1-411f-9a3c-c21ba56825a8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:04.720730 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06a2de-25f1-411f-9a3c-c21ba56825a8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:04.721174 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-1f06a2de-25f1-411f-9a3c-c21ba56825a8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:04.785511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-1f06a2de-25f1-411f-9a3c-c21ba56825a8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:04.793627 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-1f06a2de-25f1-411f-9a3c-c21ba56825a8 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1219 microversion: 2.1 time: 0.086803 Jul 26 21:06:04.794226 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3827/7570] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:04 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:05.815518 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-904881bc-3379-4bd0-907c-c10d63336d4f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:05.816208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-904881bc-3379-4bd0-907c-c10d63336d4f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:05.823152 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-904881bc-3379-4bd0-907c-c10d63336d4f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:05.823632 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-904881bc-3379-4bd0-907c-c10d63336d4f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:05.824431 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-904881bc-3379-4bd0-907c-c10d63336d4f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:05.824885 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-904881bc-3379-4bd0-907c-c10d63336d4f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:05.887766 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-904881bc-3379-4bd0-907c-c10d63336d4f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:05.895738 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-904881bc-3379-4bd0-907c-c10d63336d4f tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1219 microversion: 2.1 time: 0.084780 Jul 26 21:06:05.896320 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3744/7571] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:05 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 21:06:06.916633 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-e64d7b00-1e83-47cf-838b-217a2d4d8966 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:06.918249 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-e64d7b00-1e83-47cf-838b-217a2d4d8966 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:06.925936 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e64d7b00-1e83-47cf-838b-217a2d4d8966 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:06.926385 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e64d7b00-1e83-47cf-838b-217a2d4d8966 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:06.927154 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e64d7b00-1e83-47cf-838b-217a2d4d8966 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:06.927588 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-e64d7b00-1e83-47cf-838b-217a2d4d8966 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:06.992821 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-e64d7b00-1e83-47cf-838b-217a2d4d8966 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e5496dff2fa4d07b063a546b482eb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7e71d41ee44f1296c8715c1e3b3955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:07.000440 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-e64d7b00-1e83-47cf-838b-217a2d4d8966 tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 200 len: 1219 microversion: 2.1 time: 0.087698 Jul 26 21:06:07.001006 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3828/7572] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:06 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:08.022362 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:08.022984 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] [instance: d801aba8-55cf-4a98-954d-98ad5565b94d] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:08.030410 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:08.031155 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:08.032407 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:08.032633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:08.046777 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.wsgi [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] HTTP exception thrown: Instance d801aba8-55cf-4a98-954d-98ad5565b94d could not be found. Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Request method failure captured: Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: request: GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d HTTP/1.1 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: Accept: application/json Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: Accept-Encoding: identity Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: Connection: close Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: Content-Length: 0 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: Content-Type: application/json Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: Host: 10.222.0.58 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: Openstack-System-Scope: None Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: User-Agent: python-urllib3/1.26.10 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Auth-Token: gAAAAABi4FU26ktoWChAHZqrP-kiwkFpcXYVeC6b7WZCosaPrT4Ig0m02huJIdwg3OBpI_nLiMQB4TKVuDKH1yqdQ0RAcNLtBs2HbLbDzTVrgarazJvTEsz0LEY6Czwrj0eCZpiYsriKovOncbNVhTyyTBf8ExK4mpTcOIGzt1gSA2CBHug6qdE Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Id: None Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Domain-Name: None Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Identity-Status: Confirmed Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Is-Admin-Project: True Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Id: default Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Domain-Name: Default Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Id: dc7e71d41ee44f1296c8715c1e3b3955 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Project-Name: tempest-TestShelveInstance-1494268344 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Role: member,reader Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Roles: member,reader Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dc7e71d41ee44f1296c8715c1e3b3955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc7e71d41ee44f1296c8715c1e3b3955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dc7e71d41ee44f1296c8715c1e3b3955", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dc7e71d41ee44f1296c8715c1e3b3955"}]}] Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant: tempest-TestShelveInstance-1494268344 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Id: dc7e71d41ee44f1296c8715c1e3b3955 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-Tenant-Name: tempest-TestShelveInstance-1494268344 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-User: tempest-TestShelveInstance-1494268344-project Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Id: default Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-User-Domain-Name: Default Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-User-Id: 1e5496dff2fa4d07b063a546b482eb49 Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: X-User-Name: tempest-TestShelveInstance-1494268344-project Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: method: > Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: exception: Instance d801aba8-55cf-4a98-954d-98ad5565b94d could not be found. Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: action_args: {'id': 'd801aba8-55cf-4a98-954d-98ad5565b94d'} Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d801aba8-55cf-4a98-954d-98ad5565b94d could not be found. Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d801aba8-55cf-4a98-954d-98ad5565b94d could not be found. Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 21:06:08.048776 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d801aba8-55cf-4a98-954d-98ad5565b94d could not be found. Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: ERROR nova.api.openstack.wsgi Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Returning 404 to user: Instance d801aba8-55cf-4a98-954d-98ad5565b94d could not be found. {{(pid=125963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-065cb52a-a666-4ae6-a42c-a8223cc7a90a tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d" status: 404 len: 111 microversion: 2.1 time: 0.032363 Jul 26 21:06:08.054216 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3745/7573] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:08 2022] GET /compute/v2.1/servers/d801aba8-55cf-4a98-954d-98ad5565b94d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 21:06:08.232574 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-6eebaa6d-9b64-44da-a5d0-3201769fabba tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] Calling method '.version_select at 0x7f87561b4940>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:08.273206 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-6eebaa6d-9b64-44da-a5d0-3201769fabba tempest-TestShelveInstance-1494268344 tempest-TestShelveInstance-1494268344-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305534641" status: 202 len: 0 microversion: 2.1 time: 0.044823 Jul 26 21:06:08.276326 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3829/7574] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Jul 26 21:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305534641 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 21:06:26.225337 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:26.227479 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:26.468387 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-46ab4498-2f7f-4804-a073-b8b4ea01f470 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Action: 'create', calling method: .version_select at 0x7f875c6318b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1119046921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr1hhrMmagxar7H7TIvNQ/93zy0QUBKzTd0Jca9tFpIVRr1mKfQTZUnh3ZrETBoREU2uj/o3gPPU+HreKQUf9Tmm0Q+kxYMS2A8zJLfQO3LTBq+vnDil9MlZ58XC/lQVQ=="}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:06:26.490733 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-46ab4498-2f7f-4804-a073-b8b4ea01f470 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Getting quotas for project 6446e76d04f1474884ede8727ae45d52. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 21:06:26.498000 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.quota [None req-46ab4498-2f7f-4804-a073-b8b4ea01f470 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Getting quotas for user 8b03eb3a737041faaf75aa87eccb25e5 and project 6446e76d04f1474884ede8727ae45d52. Resources: {'key_pairs'} {{(pid=125963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 21:06:26.519826 n-d-708768-8 devstack@n-api.service[125963]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46ab4498-2f7f-4804-a073-b8b4ea01f470 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [606db1f9-ea3c-4056-b87c-53875ed4dbc7] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 21:06:27.528315 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [None req-46ab4498-2f7f-4804-a073-b8b4ea01f470 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [606db1f9-ea3c-4056-b87c-53875ed4dbc7] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47544. Jul 26 21:06:27.544716 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-46ab4498-2f7f-4804-a073-b8b4ea01f470 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.327209 Jul 26 21:06:27.545318 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3746/7575] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Jul 26 21:06:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:06:28.544708 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=22 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:28.546503 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:28.554181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1617520166", "imageRef": "d3881918-9bf6-46c2-abd0-edc31f73f7fa", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1119046921", "security_groups": [{"name": "tempest-secgroup-smoke-1503384018"}], "networks": [{"uuid": "7f868cbf-a8ee-4670-ad8b-41d72c04d4b1"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:06:28.661994 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] validate_networks() for [('7f868cbf-a8ee-4670-ad8b-41d72c04d4b1', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 21:06:29.084427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 21:06:29.085285 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 21:06:29.086564 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 21:06:29.087511 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 21:06:29.088166 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 21:06:29.098963 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:29.099533 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:29.100455 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:29.100970 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:29.121671 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Getting quotas for project 6446e76d04f1474884ede8727ae45d52. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 21:06:29.128109 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Getting quotas for user 8b03eb3a737041faaf75aa87eccb25e5 and project 6446e76d04f1474884ede8727ae45d52. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 21:06:29.141545 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 21:06:29.144129 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3881918-9bf6-46c2-abd0-edc31f73f7fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 21:06:29.194580 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-4e4d3d2b-318e-4fa5-bbea-fec320356326 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.651801 Jul 26 21:06:29.195602 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3830/7576] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 21:06:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 21:06:29.208409 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-5e84dbd7-5f58-47f2-b8ed-3ca92e12ad2d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:29.215978 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-5e84dbd7-5f58-47f2-b8ed-3ca92e12ad2d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:29.274669 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-5e84dbd7-5f58-47f2-b8ed-3ca92e12ad2d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:29.284181 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-5e84dbd7-5f58-47f2-b8ed-3ca92e12ad2d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1249 microversion: 2.1 time: 0.081815 Jul 26 21:06:29.284963 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3747/7577] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:29 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:30.306837 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-21df3aa1-b4d8-400b-918a-528535531df3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:30.307753 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-21df3aa1-b4d8-400b-918a-528535531df3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:30.316130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21df3aa1-b4d8-400b-918a-528535531df3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:30.316740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21df3aa1-b4d8-400b-918a-528535531df3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:30.318290 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21df3aa1-b4d8-400b-918a-528535531df3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:30.320134 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-21df3aa1-b4d8-400b-918a-528535531df3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:30.442692 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-21df3aa1-b4d8-400b-918a-528535531df3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:30.450655 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-21df3aa1-b4d8-400b-918a-528535531df3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1309 microversion: 2.1 time: 0.148953 Jul 26 21:06:30.463634 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3831/7578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:30 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:31.474119 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-1120ecfb-dc75-4532-913f-400d9d266f93 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:31.475034 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-1120ecfb-dc75-4532-913f-400d9d266f93 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:31.482749 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1120ecfb-dc75-4532-913f-400d9d266f93 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:31.483344 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1120ecfb-dc75-4532-913f-400d9d266f93 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:31.484295 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1120ecfb-dc75-4532-913f-400d9d266f93 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:31.485930 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-1120ecfb-dc75-4532-913f-400d9d266f93 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:31.664738 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-1120ecfb-dc75-4532-913f-400d9d266f93 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:31.677529 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-1120ecfb-dc75-4532-913f-400d9d266f93 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1375 microversion: 2.1 time: 0.208383 Jul 26 21:06:31.678131 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3748/7579] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:31 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:31.801122 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-4bc5e427-da4e-44e6-bf9d-eb6efa22f0c3 req-70dab6a0-455e-4f36-9fc2-bd6b6549e97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1e09f5-a89c-4aa5-a915-0308db587987", "tag": "08de2c62-e494-40f0-996f-94def34be9d3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:06:31.813382 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4bc5e427-da4e-44e6-bf9d-eb6efa22f0c3 req-70dab6a0-455e-4f36-9fc2-bd6b6549e97f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:31.814198 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-4bc5e427-da4e-44e6-bf9d-eb6efa22f0c3 req-70dab6a0-455e-4f36-9fc2-bd6b6549e97f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:31.825549 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-4bc5e427-da4e-44e6-bf9d-eb6efa22f0c3 req-70dab6a0-455e-4f36-9fc2-bd6b6549e97f service nova] Creating event network-changed:08de2c62-e494-40f0-996f-94def34be9d3 for instance ec1e09f5-a89c-4aa5-a915-0308db587987 on n-h2-708768-8 Jul 26 21:06:31.831309 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-4bc5e427-da4e-44e6-bf9d-eb6efa22f0c3 req-70dab6a0-455e-4f36-9fc2-bd6b6549e97f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034553 Jul 26 21:06:31.832409 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3832/7580] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 21:06:32.699522 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-b82e37b4-d0d3-4127-a428-51e1f6fa7bea tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:32.700166 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-b82e37b4-d0d3-4127-a428-51e1f6fa7bea tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:32.707781 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b82e37b4-d0d3-4127-a428-51e1f6fa7bea tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:32.708267 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b82e37b4-d0d3-4127-a428-51e1f6fa7bea tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:32.709068 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b82e37b4-d0d3-4127-a428-51e1f6fa7bea tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:32.709512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-b82e37b4-d0d3-4127-a428-51e1f6fa7bea tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:32.845423 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-b82e37b4-d0d3-4127-a428-51e1f6fa7bea tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:32.852954 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-b82e37b4-d0d3-4127-a428-51e1f6fa7bea tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1375 microversion: 2.1 time: 0.157348 Jul 26 21:06:32.853530 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3749/7581] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:32 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:33.876329 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-20c57dfc-58c6-4dc5-9342-dfc3b69ad811 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:33.877039 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-20c57dfc-58c6-4dc5-9342-dfc3b69ad811 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:33.883263 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20c57dfc-58c6-4dc5-9342-dfc3b69ad811 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:33.883749 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20c57dfc-58c6-4dc5-9342-dfc3b69ad811 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:33.884516 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20c57dfc-58c6-4dc5-9342-dfc3b69ad811 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:33.884954 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-20c57dfc-58c6-4dc5-9342-dfc3b69ad811 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:34.015486 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-20c57dfc-58c6-4dc5-9342-dfc3b69ad811 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:34.024010 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-20c57dfc-58c6-4dc5-9342-dfc3b69ad811 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1375 microversion: 2.1 time: 0.153279 Jul 26 21:06:34.024608 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3833/7582] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:33 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:35.046323 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-75e06563-d6e7-428c-a5c7-4f5b2717ba87 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:35.046943 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-75e06563-d6e7-428c-a5c7-4f5b2717ba87 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:35.053841 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75e06563-d6e7-428c-a5c7-4f5b2717ba87 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:35.054563 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75e06563-d6e7-428c-a5c7-4f5b2717ba87 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:35.055339 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75e06563-d6e7-428c-a5c7-4f5b2717ba87 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:35.055814 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-75e06563-d6e7-428c-a5c7-4f5b2717ba87 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:35.188843 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-75e06563-d6e7-428c-a5c7-4f5b2717ba87 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:35.196665 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-75e06563-d6e7-428c-a5c7-4f5b2717ba87 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1375 microversion: 2.1 time: 0.154164 Jul 26 21:06:35.197452 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3750/7583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:35 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:36.217222 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-728a98e1-b607-426b-816b-203352a8d187 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:36.217838 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-728a98e1-b607-426b-816b-203352a8d187 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:36.225939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-728a98e1-b607-426b-816b-203352a8d187 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:36.226389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-728a98e1-b607-426b-816b-203352a8d187 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:36.227141 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-728a98e1-b607-426b-816b-203352a8d187 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:36.227573 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-728a98e1-b607-426b-816b-203352a8d187 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:36.363001 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-728a98e1-b607-426b-816b-203352a8d187 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:36.370689 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-728a98e1-b607-426b-816b-203352a8d187 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1375 microversion: 2.1 time: 0.157364 Jul 26 21:06:36.371262 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3834/7584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:36 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:37.206328 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-897ed9dc-2b92-4127-b454-1d31b74e839a req-7a461877-d743-4d0f-af74-db3d820cfc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e09f5-a89c-4aa5-a915-0308db587987", "name": "network-vif-plugged", "status": "completed", "tag": "08de2c62-e494-40f0-996f-94def34be9d3"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:06:37.215933 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-897ed9dc-2b92-4127-b454-1d31b74e839a req-7a461877-d743-4d0f-af74-db3d820cfc84 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:37.216383 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-897ed9dc-2b92-4127-b454-1d31b74e839a req-7a461877-d743-4d0f-af74-db3d820cfc84 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:37.227754 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-897ed9dc-2b92-4127-b454-1d31b74e839a req-7a461877-d743-4d0f-af74-db3d820cfc84 service nova] Creating event network-vif-plugged:08de2c62-e494-40f0-996f-94def34be9d3 for instance ec1e09f5-a89c-4aa5-a915-0308db587987 on n-h2-708768-8 Jul 26 21:06:37.232688 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-897ed9dc-2b92-4127-b454-1d31b74e839a req-7a461877-d743-4d0f-af74-db3d820cfc84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088363 Jul 26 21:06:37.233284 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3751/7585] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:06:37.391842 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-be0d0193-09eb-4e29-83ca-badcfc63936d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:37.392439 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-be0d0193-09eb-4e29-83ca-badcfc63936d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:37.399316 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be0d0193-09eb-4e29-83ca-badcfc63936d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:37.399808 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be0d0193-09eb-4e29-83ca-badcfc63936d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:37.400578 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be0d0193-09eb-4e29-83ca-badcfc63936d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:37.401016 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-be0d0193-09eb-4e29-83ca-badcfc63936d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:37.529809 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-be0d0193-09eb-4e29-83ca-badcfc63936d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:37.538250 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-be0d0193-09eb-4e29-83ca-badcfc63936d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1375 microversion: 2.1 time: 0.150517 Jul 26 21:06:37.538930 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3835/7586] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:37 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:38.560070 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f27a315a-7edb-45d1-a8f6-e57556bff65a tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:38.560803 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f27a315a-7edb-45d1-a8f6-e57556bff65a tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:38.567149 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f27a315a-7edb-45d1-a8f6-e57556bff65a tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:38.567633 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f27a315a-7edb-45d1-a8f6-e57556bff65a tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:38.568411 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f27a315a-7edb-45d1-a8f6-e57556bff65a tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:38.568864 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-f27a315a-7edb-45d1-a8f6-e57556bff65a tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:38.703373 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f27a315a-7edb-45d1-a8f6-e57556bff65a tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:38.711887 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f27a315a-7edb-45d1-a8f6-e57556bff65a tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1560 microversion: 2.1 time: 0.157242 Jul 26 21:06:38.712459 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3752/7587] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:38 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:38.733047 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-51693057-cc32-49ec-99eb-a2db9ffc7c9b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:06:38.733657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-51693057-cc32-49ec-99eb-a2db9ffc7c9b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:06:38.741088 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51693057-cc32-49ec-99eb-a2db9ffc7c9b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:38.741532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51693057-cc32-49ec-99eb-a2db9ffc7c9b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:38.742295 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51693057-cc32-49ec-99eb-a2db9ffc7c9b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:38.742764 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-51693057-cc32-49ec-99eb-a2db9ffc7c9b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:38.879127 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-51693057-cc32-49ec-99eb-a2db9ffc7c9b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:06:38.886761 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-51693057-cc32-49ec-99eb-a2db9ffc7c9b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1560 microversion: 2.1 time: 0.157678 Jul 26 21:06:38.887350 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3836/7588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:06:38 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:06:40.845054 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-36e639c6-92a6-428b-a358-f43f0ea69fe2 req-86ca8a0a-3dbd-4bd4-9eaf-8cac2eb2b001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1e09f5-a89c-4aa5-a915-0308db587987", "tag": "08de2c62-e494-40f0-996f-94def34be9d3"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:06:40.851143 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=6 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:06:40.856745 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-36e639c6-92a6-428b-a358-f43f0ea69fe2 req-86ca8a0a-3dbd-4bd4-9eaf-8cac2eb2b001 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:06:40.857205 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-36e639c6-92a6-428b-a358-f43f0ea69fe2 req-86ca8a0a-3dbd-4bd4-9eaf-8cac2eb2b001 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:06:40.869299 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-36e639c6-92a6-428b-a358-f43f0ea69fe2 req-86ca8a0a-3dbd-4bd4-9eaf-8cac2eb2b001 service nova] Creating event network-changed:08de2c62-e494-40f0-996f-94def34be9d3 for instance ec1e09f5-a89c-4aa5-a915-0308db587987 on n-h2-708768-8 Jul 26 21:06:40.874456 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-36e639c6-92a6-428b-a358-f43f0ea69fe2 req-86ca8a0a-3dbd-4bd4-9eaf-8cac2eb2b001 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033093 Jul 26 21:06:40.875046 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3753/7589] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 21:08:36.029075 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 21:08:36.030033 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 21:08:36.030657 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:36.031419 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:36.032199 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:36.032982 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=34 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:36.038062 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-3307ea4e-84bb-4793-88d8-35a279047190 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1819856676"}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:08:36.040448 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-3307ea4e-84bb-4793-88d8-35a279047190 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:36.048933 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3307ea4e-84bb-4793-88d8-35a279047190 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:36.049388 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3307ea4e-84bb-4793-88d8-35a279047190 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:36.050156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3307ea4e-84bb-4793-88d8-35a279047190 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:36.050598 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-3307ea4e-84bb-4793-88d8-35a279047190 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:36.235623 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-3307ea4e-84bb-4793-88d8-35a279047190 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987/action" status: 202 len: 0 microversion: 2.1 time: 0.208181 Jul 26 21:08:36.236196 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3837/7590] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 21:08:36 2022] POST /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 21:08:41.638231 n-d-708768-8 devstack@n-api.service[125963]: ERROR oslo.messaging._drivers.impl_rabbit [-] [126f5d12-0094-4580-8dac-f2bd48a90f54] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 21:08:41.639186 n-d-708768-8 devstack@n-api.service[125963]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2aaae370-da13-49b4-9123-d72edfc530d8] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 21:08:41.640022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:41.641171 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=28 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:41.649377 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-f9b30c7d-f57d-41be-beb4-f657e29dc84c req-27d3cf51-6444-46db-afa8-5b778d829e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e09f5-a89c-4aa5-a915-0308db587987", "name": "network-vif-plugged", "status": "completed", "tag": "08de2c62-e494-40f0-996f-94def34be9d3"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:08:41.669005 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f9b30c7d-f57d-41be-beb4-f657e29dc84c req-27d3cf51-6444-46db-afa8-5b778d829e0a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:41.670213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-f9b30c7d-f57d-41be-beb4-f657e29dc84c req-27d3cf51-6444-46db-afa8-5b778d829e0a service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:41.685599 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-f9b30c7d-f57d-41be-beb4-f657e29dc84c req-27d3cf51-6444-46db-afa8-5b778d829e0a service nova] Creating event network-vif-plugged:08de2c62-e494-40f0-996f-94def34be9d3 for instance ec1e09f5-a89c-4aa5-a915-0308db587987 on n-h2-708768-8 Jul 26 21:08:41.693504 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-f9b30c7d-f57d-41be-beb4-f657e29dc84c req-27d3cf51-6444-46db-afa8-5b778d829e0a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056750 Jul 26 21:08:41.695242 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3754/7591] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:08:49.783061 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:49.783904 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:49.788529 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-996036122", "imageRef": "2eda0345-2572-4ec8-9844-99ec42987fee", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1119046921", "security_groups": [{"name": "tempest-secgroup-smoke-1503384018"}], "networks": [{"uuid": "7f868cbf-a8ee-4670-ad8b-41d72c04d4b1"}]}} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:08:49.815324 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47780. Jul 26 21:08:49.818349 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47782. Jul 26 21:08:49.899032 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.network.neutron [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] validate_networks() for [('7f868cbf-a8ee-4670-ad8b-41d72c04d4b1', None, None, None, None, None)] {{(pid=125964) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 21:08:50.316833 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Flavor limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 21:08:50.317260 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Image limits 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 21:08:50.317803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Flavor pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 21:08:50.318310 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Image pref 0:0:0 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 21:08:50.318720 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.virt.hardware [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125964) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 21:08:50.327780 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:50.328231 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:50.329021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:50.329454 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:50.346130 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Getting quotas for project 6446e76d04f1474884ede8727ae45d52. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 21:08:50.352271 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.quota [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Getting quotas for user 8b03eb3a737041faaf75aa87eccb25e5 and project 6446e76d04f1474884ede8727ae45d52. Resources: {'cores', 'instances', 'ram'} {{(pid=125964) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 21:08:50.365112 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Going to run 1 instances... {{(pid=125964) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 21:08:50.367532 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2eda0345-2572-4ec8-9844-99ec42987fee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125964) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 21:08:50.413516 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [d9c29890-be1b-42cd-aa5e-1486c6deda58] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 21:08:51.421022 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [d9c29890-be1b-42cd-aa5e-1486c6deda58] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47794. Jul 26 21:08:51.424929 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fdf4e37c-89e7-4dfb-979f-683c88b2ae65 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.644073 Jul 26 21:08:51.426084 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3838/7592] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Jul 26 21:08:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 21:08:51.439969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-f0dfbe92-8e0a-4d86-b3a2-154a0fbe5600 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:08:51.441451 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-f0dfbe92-8e0a-4d86-b3a2-154a0fbe5600 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:51.453674 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] [126f5d12-0094-4580-8dac-f2bd48a90f54] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47798. Jul 26 21:08:51.467448 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] [2aaae370-da13-49b4-9123-d72edfc530d8] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47800. Jul 26 21:08:51.501594 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-f0dfbe92-8e0a-4d86-b3a2-154a0fbe5600 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:08:51.509039 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-f0dfbe92-8e0a-4d86-b3a2-154a0fbe5600 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1248 microversion: 2.1 time: 0.075624 Jul 26 21:08:51.509606 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3755/7593] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:08:51 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:08:52.531026 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-876eced7-5908-4196-96fe-83407786b2fd tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:08:52.532057 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-876eced7-5908-4196-96fe-83407786b2fd tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:52.539717 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-876eced7-5908-4196-96fe-83407786b2fd tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:52.540167 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-876eced7-5908-4196-96fe-83407786b2fd tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:52.540932 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-876eced7-5908-4196-96fe-83407786b2fd tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:52.541369 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-876eced7-5908-4196-96fe-83407786b2fd tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:52.622189 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-876eced7-5908-4196-96fe-83407786b2fd tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:08:52.631722 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-876eced7-5908-4196-96fe-83407786b2fd tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1306 microversion: 2.1 time: 0.105958 Jul 26 21:08:52.632296 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3839/7594] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:08:52 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:08:53.658189 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bf2d754a-d4c1-410f-8778-0b0c3f31683f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:08:53.658867 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bf2d754a-d4c1-410f-8778-0b0c3f31683f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:53.662213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:08:53.676117 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-64c85995-dde5-4bd0-9703-057de58dbebf req-da072cf0-7369-43f7-ac2c-bb736c43f06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e09f5-a89c-4aa5-a915-0308db587987", "name": "network-vif-unplugged", "status": "completed", "tag": "08de2c62-e494-40f0-996f-94def34be9d3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:08:53.678213 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf2d754a-d4c1-410f-8778-0b0c3f31683f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:53.679193 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf2d754a-d4c1-410f-8778-0b0c3f31683f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:53.680448 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf2d754a-d4c1-410f-8778-0b0c3f31683f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:53.681177 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bf2d754a-d4c1-410f-8778-0b0c3f31683f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:53.689586 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-64c85995-dde5-4bd0-9703-057de58dbebf req-da072cf0-7369-43f7-ac2c-bb736c43f06c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:53.690364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-64c85995-dde5-4bd0-9703-057de58dbebf req-da072cf0-7369-43f7-ac2c-bb736c43f06c service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:53.710384 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-64c85995-dde5-4bd0-9703-057de58dbebf req-da072cf0-7369-43f7-ac2c-bb736c43f06c service nova] Creating event network-vif-unplugged:08de2c62-e494-40f0-996f-94def34be9d3 for instance ec1e09f5-a89c-4aa5-a915-0308db587987 on n-h2-708768-8 Jul 26 21:08:53.716859 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-64c85995-dde5-4bd0-9703-057de58dbebf req-da072cf0-7369-43f7-ac2c-bb736c43f06c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051838 Jul 26 21:08:53.718811 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3840/7595] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:08:53.849804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bf2d754a-d4c1-410f-8778-0b0c3f31683f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:08:53.858271 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bf2d754a-d4c1-410f-8778-0b0c3f31683f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.206295 Jul 26 21:08:53.859065 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3756/7596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:08:53 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:08:54.881434 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-23ce0db8-332f-4758-b64a-80c8ff8468a6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:08:54.882781 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-23ce0db8-332f-4758-b64a-80c8ff8468a6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:54.890462 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23ce0db8-332f-4758-b64a-80c8ff8468a6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:54.890910 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23ce0db8-332f-4758-b64a-80c8ff8468a6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:54.891800 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23ce0db8-332f-4758-b64a-80c8ff8468a6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:54.892299 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-23ce0db8-332f-4758-b64a-80c8ff8468a6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:55.048146 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-23ce0db8-332f-4758-b64a-80c8ff8468a6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:08:55.059933 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-23ce0db8-332f-4758-b64a-80c8ff8468a6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.184050 Jul 26 21:08:55.074418 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3841/7597] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:08:54 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:08:56.081391 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e129acec-7392-42b5-b51b-3b73253e622e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:08:56.082914 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e129acec-7392-42b5-b51b-3b73253e622e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:56.090221 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e129acec-7392-42b5-b51b-3b73253e622e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:56.090684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e129acec-7392-42b5-b51b-3b73253e622e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:56.091477 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e129acec-7392-42b5-b51b-3b73253e622e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:56.091960 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e129acec-7392-42b5-b51b-3b73253e622e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:56.236300 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e129acec-7392-42b5-b51b-3b73253e622e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:08:56.245097 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e129acec-7392-42b5-b51b-3b73253e622e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.167526 Jul 26 21:08:56.245831 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3757/7598] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:08:56 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:08:57.265334 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-0d9c2987-ba95-43ba-8181-852316683249 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:08:57.266081 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-0d9c2987-ba95-43ba-8181-852316683249 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:57.273641 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d9c2987-ba95-43ba-8181-852316683249 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:57.274102 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d9c2987-ba95-43ba-8181-852316683249 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:57.274898 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d9c2987-ba95-43ba-8181-852316683249 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:57.275364 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-0d9c2987-ba95-43ba-8181-852316683249 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:57.416362 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-0d9c2987-ba95-43ba-8181-852316683249 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:08:57.423972 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-0d9c2987-ba95-43ba-8181-852316683249 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.162502 Jul 26 21:08:57.424552 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3842/7599] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:08:57 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:08:58.446680 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-bbdc2458-f240-4e48-8547-823b58e7e63b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:08:58.447579 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-bbdc2458-f240-4e48-8547-823b58e7e63b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:58.454989 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbdc2458-f240-4e48-8547-823b58e7e63b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:58.455452 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbdc2458-f240-4e48-8547-823b58e7e63b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:58.456297 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbdc2458-f240-4e48-8547-823b58e7e63b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:58.456747 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-bbdc2458-f240-4e48-8547-823b58e7e63b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:58.602678 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-bbdc2458-f240-4e48-8547-823b58e7e63b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:08:58.611009 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-bbdc2458-f240-4e48-8547-823b58e7e63b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.168136 Jul 26 21:08:58.611596 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3758/7600] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:08:58 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:08:59.633244 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-497eaa0d-c2a3-4856-ab13-473767645b00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:08:59.634137 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-497eaa0d-c2a3-4856-ab13-473767645b00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:08:59.641492 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-497eaa0d-c2a3-4856-ab13-473767645b00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:59.641947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-497eaa0d-c2a3-4856-ab13-473767645b00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:59.642823 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-497eaa0d-c2a3-4856-ab13-473767645b00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:08:59.643168 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-497eaa0d-c2a3-4856-ab13-473767645b00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:08:59.795765 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-497eaa0d-c2a3-4856-ab13-473767645b00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:08:59.804858 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-497eaa0d-c2a3-4856-ab13-473767645b00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.176664 Jul 26 21:08:59.819687 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3843/7601] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:08:59 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:00.826595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-6abdbb4b-9561-4180-a44c-60f6b8170794 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:00.827925 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-6abdbb4b-9561-4180-a44c-60f6b8170794 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:00.835540 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6abdbb4b-9561-4180-a44c-60f6b8170794 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:00.836046 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6abdbb4b-9561-4180-a44c-60f6b8170794 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:00.836865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6abdbb4b-9561-4180-a44c-60f6b8170794 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:00.837317 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-6abdbb4b-9561-4180-a44c-60f6b8170794 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:00.983004 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-6abdbb4b-9561-4180-a44c-60f6b8170794 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:00.990960 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-6abdbb4b-9561-4180-a44c-60f6b8170794 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.168328 Jul 26 21:09:00.991636 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3759/7602] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:00 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:01.323418 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-af723d3c-bc1c-4230-9a62-30d4a2db9c85 req-add8b8b6-467a-4d17-a15f-03f4cc999eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bb87e3-fd15-46b5-be08-46d792683471", "tag": "d99552f3-d98d-4c16-a9a1-01a4baa6faac"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:09:01.335987 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=2 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:09:01.337171 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell0:SELECT=6 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:09:01.354788 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-af723d3c-bc1c-4230-9a62-30d4a2db9c85 req-add8b8b6-467a-4d17-a15f-03f4cc999eeb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:01.355389 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-af723d3c-bc1c-4230-9a62-30d4a2db9c85 req-add8b8b6-467a-4d17-a15f-03f4cc999eeb service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:01.370127 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-af723d3c-bc1c-4230-9a62-30d4a2db9c85 req-add8b8b6-467a-4d17-a15f-03f4cc999eeb service nova] Creating event network-changed:d99552f3-d98d-4c16-a9a1-01a4baa6faac for instance 86bb87e3-fd15-46b5-be08-46d792683471 on n-h1-708768-8 Jul 26 21:09:01.375331 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-af723d3c-bc1c-4230-9a62-30d4a2db9c85 req-add8b8b6-467a-4d17-a15f-03f4cc999eeb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059383 Jul 26 21:09:01.376030 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3844/7603] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:09:02.012168 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-4d4c218d-ddf5-4074-9705-b1f3c691b26d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:02.012798 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-4d4c218d-ddf5-4074-9705-b1f3c691b26d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:02.014708 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell0:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:09:02.022185 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d4c218d-ddf5-4074-9705-b1f3c691b26d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:02.022646 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d4c218d-ddf5-4074-9705-b1f3c691b26d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:02.024578 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d4c218d-ddf5-4074-9705-b1f3c691b26d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:02.025043 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-4d4c218d-ddf5-4074-9705-b1f3c691b26d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:02.158772 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-4d4c218d-ddf5-4074-9705-b1f3c691b26d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:02.166714 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-4d4c218d-ddf5-4074-9705-b1f3c691b26d tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.158455 Jul 26 21:09:02.167320 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3760/7604] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:02 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:03.188077 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-42a862c3-0e2e-4708-b2a6-25ae11718e64 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:03.188701 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-42a862c3-0e2e-4708-b2a6-25ae11718e64 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:03.196496 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42a862c3-0e2e-4708-b2a6-25ae11718e64 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:03.196939 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42a862c3-0e2e-4708-b2a6-25ae11718e64 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:03.197694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42a862c3-0e2e-4708-b2a6-25ae11718e64 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:03.198125 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-42a862c3-0e2e-4708-b2a6-25ae11718e64 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:03.337861 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-42a862c3-0e2e-4708-b2a6-25ae11718e64 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:03.345286 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-42a862c3-0e2e-4708-b2a6-25ae11718e64 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.161548 Jul 26 21:09:03.345852 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3845/7605] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:03 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:04.366350 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-a1836db9-b5bb-4e05-af31-61088a6fdd05 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:04.366983 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-a1836db9-b5bb-4e05-af31-61088a6fdd05 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:04.374044 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1836db9-b5bb-4e05-af31-61088a6fdd05 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:04.374512 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1836db9-b5bb-4e05-af31-61088a6fdd05 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:04.375298 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1836db9-b5bb-4e05-af31-61088a6fdd05 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:04.375782 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-a1836db9-b5bb-4e05-af31-61088a6fdd05 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:04.513826 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-a1836db9-b5bb-4e05-af31-61088a6fdd05 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:04.522136 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-a1836db9-b5bb-4e05-af31-61088a6fdd05 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.159702 Jul 26 21:09:04.522733 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3761/7606] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:04 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:05.542459 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-f8472114-533c-49a6-aa94-6ef66d570297 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:05.543076 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-f8472114-533c-49a6-aa94-6ef66d570297 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:05.550427 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8472114-533c-49a6-aa94-6ef66d570297 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:05.550928 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8472114-533c-49a6-aa94-6ef66d570297 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:05.551733 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8472114-533c-49a6-aa94-6ef66d570297 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:05.552181 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-f8472114-533c-49a6-aa94-6ef66d570297 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:05.685803 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-f8472114-533c-49a6-aa94-6ef66d570297 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:05.693561 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-f8472114-533c-49a6-aa94-6ef66d570297 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.155016 Jul 26 21:09:05.694138 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3846/7607] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:05 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:06.326800 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [req-d80d9a13-1997-4091-9b1b-3521e3e73baa req-95fbf5a1-1f6c-41ac-99b3-aa54e15b9242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bb87e3-fd15-46b5-be08-46d792683471", "name": "network-vif-plugged", "status": "completed", "tag": "d99552f3-d98d-4c16-a9a1-01a4baa6faac"}]} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:09:06.339555 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d80d9a13-1997-4091-9b1b-3521e3e73baa req-95fbf5a1-1f6c-41ac-99b3-aa54e15b9242 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:06.340048 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [req-d80d9a13-1997-4091-9b1b-3521e3e73baa req-95fbf5a1-1f6c-41ac-99b3-aa54e15b9242 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:06.637891 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.compute.server_external_events [req-d80d9a13-1997-4091-9b1b-3521e3e73baa req-95fbf5a1-1f6c-41ac-99b3-aa54e15b9242 service nova] Creating event network-vif-plugged:d99552f3-d98d-4c16-a9a1-01a4baa6faac for instance 86bb87e3-fd15-46b5-be08-46d792683471 on n-h1-708768-8 Jul 26 21:09:06.643070 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [req-d80d9a13-1997-4091-9b1b-3521e3e73baa req-95fbf5a1-1f6c-41ac-99b3-aa54e15b9242 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.320043 Jul 26 21:09:06.643703 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3762/7608] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:09:06.714495 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b6b59502-9f69-4aaf-8651-c49fbbb34d00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:06.715121 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b6b59502-9f69-4aaf-8651-c49fbbb34d00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:06.722156 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6b59502-9f69-4aaf-8651-c49fbbb34d00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:06.723147 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6b59502-9f69-4aaf-8651-c49fbbb34d00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:06.723952 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6b59502-9f69-4aaf-8651-c49fbbb34d00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:06.724394 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b6b59502-9f69-4aaf-8651-c49fbbb34d00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:06.879113 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b6b59502-9f69-4aaf-8651-c49fbbb34d00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:06.886730 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b6b59502-9f69-4aaf-8651-c49fbbb34d00 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.176227 Jul 26 21:09:06.887317 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3847/7609] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:06 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:07.909020 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-e2705c1c-c839-4905-9fe8-e15682640820 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:07.909753 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-e2705c1c-c839-4905-9fe8-e15682640820 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:07.917408 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2705c1c-c839-4905-9fe8-e15682640820 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:07.917865 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2705c1c-c839-4905-9fe8-e15682640820 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:07.918647 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2705c1c-c839-4905-9fe8-e15682640820 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:07.919093 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-e2705c1c-c839-4905-9fe8-e15682640820 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:08.059002 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-e2705c1c-c839-4905-9fe8-e15682640820 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:08.069451 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-e2705c1c-c839-4905-9fe8-e15682640820 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1374 microversion: 2.1 time: 0.164585 Jul 26 21:09:08.070011 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3763/7610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:07 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:09.090601 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-05495b1f-1b62-4624-b4f1-db2b0eb0f1b5 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:09.091221 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-05495b1f-1b62-4624-b4f1-db2b0eb0f1b5 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:09.099027 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05495b1f-1b62-4624-b4f1-db2b0eb0f1b5 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:09.099482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05495b1f-1b62-4624-b4f1-db2b0eb0f1b5 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:09.100284 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05495b1f-1b62-4624-b4f1-db2b0eb0f1b5 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:09.100727 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-05495b1f-1b62-4624-b4f1-db2b0eb0f1b5 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:09.234650 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-05495b1f-1b62-4624-b4f1-db2b0eb0f1b5 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:09.242407 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-05495b1f-1b62-4624-b4f1-db2b0eb0f1b5 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1559 microversion: 2.1 time: 0.155695 Jul 26 21:09:09.242988 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3848/7611] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:09 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:09.262400 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-fa00a924-f045-45c3-a35c-a7eb4e4234d3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:09:09.263021 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-fa00a924-f045-45c3-a35c-a7eb4e4234d3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:09:09.270457 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa00a924-f045-45c3-a35c-a7eb4e4234d3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:09.270915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa00a924-f045-45c3-a35c-a7eb4e4234d3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:09.271707 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa00a924-f045-45c3-a35c-a7eb4e4234d3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:09.272151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-fa00a924-f045-45c3-a35c-a7eb4e4234d3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:09.402095 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-fa00a924-f045-45c3-a35c-a7eb4e4234d3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:09:09.409528 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-fa00a924-f045-45c3-a35c-a7eb4e4234d3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1559 microversion: 2.1 time: 0.151007 Jul 26 21:09:09.410774 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3764/7612] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:09:09 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:09:11.409314 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-5961fd37-fe0f-4076-bb79-77b3b31ee71f req-0aa8a325-7c20-42d8-ae53-43ad4de8e959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bb87e3-fd15-46b5-be08-46d792683471", "tag": "d99552f3-d98d-4c16-a9a1-01a4baa6faac"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:09:11.419035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5961fd37-fe0f-4076-bb79-77b3b31ee71f req-0aa8a325-7c20-42d8-ae53-43ad4de8e959 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:09:11.419482 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-5961fd37-fe0f-4076-bb79-77b3b31ee71f req-0aa8a325-7c20-42d8-ae53-43ad4de8e959 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:09:11.436999 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-5961fd37-fe0f-4076-bb79-77b3b31ee71f req-0aa8a325-7c20-42d8-ae53-43ad4de8e959 service nova] Creating event network-changed:d99552f3-d98d-4c16-a9a1-01a4baa6faac for instance 86bb87e3-fd15-46b5-be08-46d792683471 on n-h1-708768-8 Jul 26 21:09:11.442983 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-5961fd37-fe0f-4076-bb79-77b3b31ee71f req-0aa8a325-7c20-42d8-ae53-43ad4de8e959 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121240 Jul 26 21:09:11.443596 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3849/7613] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:09:44.762687 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:09:44.763339 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:09:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:10:50.130704 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=24 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:10:50.131462 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=50 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:10:50.136804 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3f7c1d32-c844-4aec-b67d-b3f5d891b6dc tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-963662733"}} {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:10:50.139113 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3f7c1d32-c844-4aec-b67d-b3f5d891b6dc tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:10:50.145912 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f7c1d32-c844-4aec-b67d-b3f5d891b6dc tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:10:50.146371 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f7c1d32-c844-4aec-b67d-b3f5d891b6dc tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:10:50.147151 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f7c1d32-c844-4aec-b67d-b3f5d891b6dc tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:10:50.147595 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3f7c1d32-c844-4aec-b67d-b3f5d891b6dc tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:10:50.506066 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3f7c1d32-c844-4aec-b67d-b3f5d891b6dc tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "POST /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471/action" status: 202 len: 0 microversion: 2.1 time: 0.377095 Jul 26 21:10:50.506785 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3765/7614] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Jul 26 21:10:50 2022] POST /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 21:10:55.009859 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 21:10:55.013019 n-d-708768-8 devstack@n-api.service[125964]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 21:10:55.043278 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:10:55.044931 n-d-708768-8 devstack@n-api.service[125964]: DEBUG dbcounter [-] [125964] Writing DB stats nova_cell1:SELECT=56 {{(pid=125964) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:10:55.064489 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-37486bc3-8832-4bf1-b4a9-b335f58ec0b1 req-d20d5d15-ee18-4b9d-af84-be1c6a52e313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bb87e3-fd15-46b5-be08-46d792683471", "name": "network-vif-plugged", "status": "completed", "tag": "d99552f3-d98d-4c16-a9a1-01a4baa6faac"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:10:55.076473 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-37486bc3-8832-4bf1-b4a9-b335f58ec0b1 req-d20d5d15-ee18-4b9d-af84-be1c6a52e313 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:10:55.077223 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-37486bc3-8832-4bf1-b4a9-b335f58ec0b1 req-d20d5d15-ee18-4b9d-af84-be1c6a52e313 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:10:55.099829 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-37486bc3-8832-4bf1-b4a9-b335f58ec0b1 req-d20d5d15-ee18-4b9d-af84-be1c6a52e313 service nova] Creating event network-vif-plugged:d99552f3-d98d-4c16-a9a1-01a4baa6faac for instance 86bb87e3-fd15-46b5-be08-46d792683471 on n-h1-708768-8 Jul 26 21:10:55.106288 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-37486bc3-8832-4bf1-b4a9-b335f58ec0b1 req-d20d5d15-ee18-4b9d-af84-be1c6a52e313 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099473 Jul 26 21:10:55.107261 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3850/7615] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:11:04.095125 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_api:SELECT=2 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:11:04.096028 n-d-708768-8 devstack@n-api.service[125963]: DEBUG dbcounter [-] [125963] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 21:11:04.100234 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-93105587-2b82-4d93-a871-7834f01675fa tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:04.100847 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-93105587-2b82-4d93-a871-7834f01675fa tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:04.102704 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-86315938-a59a-4579-80cf-8184fef098c8 req-328bc537-505c-4fb2-8bb9-020543e22cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bb87e3-fd15-46b5-be08-46d792683471", "tag": "d99552f3-d98d-4c16-a9a1-01a4baa6faac"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:11:04.109684 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93105587-2b82-4d93-a871-7834f01675fa tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:04.110153 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93105587-2b82-4d93-a871-7834f01675fa tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:04.110988 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93105587-2b82-4d93-a871-7834f01675fa tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:04.111443 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-93105587-2b82-4d93-a871-7834f01675fa tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:04.121740 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-86315938-a59a-4579-80cf-8184fef098c8 req-328bc537-505c-4fb2-8bb9-020543e22cad service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:04.128983 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-86315938-a59a-4579-80cf-8184fef098c8 req-328bc537-505c-4fb2-8bb9-020543e22cad service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:04.142128 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-93105587-2b82-4d93-a871-7834f01675fa tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 21:11:04.148298 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-86315938-a59a-4579-80cf-8184fef098c8 req-328bc537-505c-4fb2-8bb9-020543e22cad service nova] Creating event network-changed:d99552f3-d98d-4c16-a9a1-01a4baa6faac for instance 86bb87e3-fd15-46b5-be08-46d792683471 on n-h1-708768-8 Jul 26 21:11:04.154281 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-86315938-a59a-4579-80cf-8184fef098c8 req-328bc537-505c-4fb2-8bb9-020543e22cad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056936 Jul 26 21:11:04.155411 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3851/7616] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:11:04.225925 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-93105587-2b82-4d93-a871-7834f01675fa tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "DELETE /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 204 len: 0 microversion: 2.1 time: 0.132643 Jul 26 21:11:04.231451 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3766/7617] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 21:11:04 2022] DELETE /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 21:11:04.237417 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-b9321281-178c-46e0-8067-b98b37faca8c tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:04.238153 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-b9321281-178c-46e0-8067-b98b37faca8c tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:04.248956 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9321281-178c-46e0-8067-b98b37faca8c tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:04.249415 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9321281-178c-46e0-8067-b98b37faca8c tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:04.250204 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9321281-178c-46e0-8067-b98b37faca8c tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:04.250947 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-b9321281-178c-46e0-8067-b98b37faca8c tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:04.257644 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [446d0440-4a4b-478e-9601-7ad71e54ac43] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48100. Jul 26 21:11:04.272734 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8c6d4b2-5a08-4459-ac00-2a2600637be1] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48102. Jul 26 21:11:04.456252 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-b9321281-178c-46e0-8067-b98b37faca8c tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:11:04.464112 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-b9321281-178c-46e0-8067-b98b37faca8c tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1684 microversion: 2.1 time: 0.231424 Jul 26 21:11:04.464763 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3852/7618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:11:04 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1684 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:11:05.487130 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-59a5bc6e-0201-453d-9de9-d04d288101ab tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:05.487869 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-59a5bc6e-0201-453d-9de9-d04d288101ab tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:05.495406 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59a5bc6e-0201-453d-9de9-d04d288101ab tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:05.495915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59a5bc6e-0201-453d-9de9-d04d288101ab tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:05.496706 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59a5bc6e-0201-453d-9de9-d04d288101ab tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:05.497157 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-59a5bc6e-0201-453d-9de9-d04d288101ab tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:05.645139 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-59a5bc6e-0201-453d-9de9-d04d288101ab tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:11:05.653598 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-59a5bc6e-0201-453d-9de9-d04d288101ab tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1684 microversion: 2.1 time: 0.170852 Jul 26 21:11:05.654169 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3767/7619] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:11:05 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:11:06.433205 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-92704166-b5f9-4361-b46e-1f64ae640e8f req-a7c249b0-bbe6-4acd-952e-caecd3ce5964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bb87e3-fd15-46b5-be08-46d792683471", "name": "network-vif-deleted", "tag": "d99552f3-d98d-4c16-a9a1-01a4baa6faac"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:11:06.443136 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-92704166-b5f9-4361-b46e-1f64ae640e8f req-a7c249b0-bbe6-4acd-952e-caecd3ce5964 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:06.443707 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-92704166-b5f9-4361-b46e-1f64ae640e8f req-a7c249b0-bbe6-4acd-952e-caecd3ce5964 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:06.457520 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-92704166-b5f9-4361-b46e-1f64ae640e8f req-a7c249b0-bbe6-4acd-952e-caecd3ce5964 service nova] Creating event network-vif-deleted:d99552f3-d98d-4c16-a9a1-01a4baa6faac for instance 86bb87e3-fd15-46b5-be08-46d792683471 on n-h1-708768-8 Jul 26 21:11:06.464765 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-92704166-b5f9-4361-b46e-1f64ae640e8f req-a7c249b0-bbe6-4acd-952e-caecd3ce5964 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091810 Jul 26 21:11:06.465390 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3853/7620] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:11:06.674434 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:06.675061 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:06.683879 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:06.684767 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:06.685987 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:06.686614 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:06.722849 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:06.723858 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:06.724889 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lazy-loading 'fault' on Instance uuid 86bb87e3-fd15-46b5-be08-46d792683471 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 21:11:06.776969 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:11:06.789972 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-ecbbe3be-5f78-4e84-8500-dbbe6117a5c6 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 200 len: 1338 microversion: 2.1 time: 0.119412 Jul 26 21:11:06.796222 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3768/7621] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:11:06 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 1338 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:11:07.818499 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:07.819210 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: 86bb87e3-fd15-46b5-be08-46d792683471] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:07.827629 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:07.828035 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:07.828811 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:07.829250 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:07.843253 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] HTTP exception thrown: Instance 86bb87e3-fd15-46b5-be08-46d792683471 could not be found. Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Request method failure captured: Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 HTTP/1.1 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FdMkltCmN0K6cB30S51uS7s826sLo1fzcX17v3f-EzPNIc4JGvc6n6SP2E4zVCh89zZy2ULhGtq7ogZC1QNgXnusGF89W6Btg58bOB6-vAAKKl0XsQ8sVvFwlsFY1Qrh1FtXJzOsbzK7SrNYAnjIo21C-EnLge-SUG-d_y6xJr6erk Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6446e76d04f1474884ede8727ae45d52 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestSnapshotPattern-251826671 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6446e76d04f1474884ede8727ae45d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6446e76d04f1474884ede8727ae45d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6446e76d04f1474884ede8727ae45d52", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6446e76d04f1474884ede8727ae45d52"}]}] Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestSnapshotPattern-251826671 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6446e76d04f1474884ede8727ae45d52 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestSnapshotPattern-251826671 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestSnapshotPattern-251826671-project Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8b03eb3a737041faaf75aa87eccb25e5 Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestSnapshotPattern-251826671-project Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance 86bb87e3-fd15-46b5-be08-46d792683471 could not be found. Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': '86bb87e3-fd15-46b5-be08-46d792683471'} Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86bb87e3-fd15-46b5-be08-46d792683471 could not be found. Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86bb87e3-fd15-46b5-be08-46d792683471 could not be found. Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 21:11:07.844949 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86bb87e3-fd15-46b5-be08-46d792683471 could not be found. Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Returning 404 to user: Instance 86bb87e3-fd15-46b5-be08-46d792683471 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-986283e0-5998-4cc4-9433-393ef2e288a8 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471" status: 404 len: 111 microversion: 2.1 time: 0.032189 Jul 26 21:11:07.849556 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3854/7622] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:11:07 2022] GET /compute/v2.1/servers/86bb87e3-fd15-46b5-be08-46d792683471 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 21:11:09.186257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-380bc321-a081-441e-ad2b-ba22709f569b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:09.187364 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-380bc321-a081-441e-ad2b-ba22709f569b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:09.190399 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-49853866-532b-4d69-936d-cb82632ba14c req-d1d48ae7-8fa1-467b-a0c0-eadbce115127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1e09f5-a89c-4aa5-a915-0308db587987", "tag": "08de2c62-e494-40f0-996f-94def34be9d3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:11:09.194543 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-380bc321-a081-441e-ad2b-ba22709f569b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:09.194948 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-380bc321-a081-441e-ad2b-ba22709f569b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:09.195770 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-380bc321-a081-441e-ad2b-ba22709f569b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:09.196223 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-380bc321-a081-441e-ad2b-ba22709f569b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:09.204694 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-49853866-532b-4d69-936d-cb82632ba14c req-d1d48ae7-8fa1-467b-a0c0-eadbce115127 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:09.205226 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-49853866-532b-4d69-936d-cb82632ba14c req-d1d48ae7-8fa1-467b-a0c0-eadbce115127 service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:09.217083 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-49853866-532b-4d69-936d-cb82632ba14c req-d1d48ae7-8fa1-467b-a0c0-eadbce115127 service nova] Creating event network-changed:08de2c62-e494-40f0-996f-94def34be9d3 for instance ec1e09f5-a89c-4aa5-a915-0308db587987 on n-h2-708768-8 Jul 26 21:11:09.223139 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-49853866-532b-4d69-936d-cb82632ba14c req-d1d48ae7-8fa1-467b-a0c0-eadbce115127 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036885 Jul 26 21:11:09.223316 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-380bc321-a081-441e-ad2b-ba22709f569b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Going to try to terminate instance {{(pid=125963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 21:11:09.224237 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3855/7623] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:11:09.308769 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-380bc321-a081-441e-ad2b-ba22709f569b tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 204 len: 0 microversion: 2.1 time: 0.126465 Jul 26 21:11:09.309664 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3769/7624] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Jul 26 21:11:09 2022] DELETE /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 21:11:09.318305 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-fec2c471-605a-4459-aed8-20c1db2e9d6f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:09.319328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-fec2c471-605a-4459-aed8-20c1db2e9d6f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:09.327021 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fec2c471-605a-4459-aed8-20c1db2e9d6f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:09.328844 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fec2c471-605a-4459-aed8-20c1db2e9d6f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:09.330132 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fec2c471-605a-4459-aed8-20c1db2e9d6f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:09.330645 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-fec2c471-605a-4459-aed8-20c1db2e9d6f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:09.490423 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.policy [None req-fec2c471-605a-4459-aed8-20c1db2e9d6f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125964) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:11:09.499097 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-fec2c471-605a-4459-aed8-20c1db2e9d6f tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1685 microversion: 2.1 time: 0.185224 Jul 26 21:11:09.512910 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3856/7625] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:11:09 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1685 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:11:10.521022 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-3fd4ab4c-b283-4d7e-b959-35f1168069f4 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:10.521875 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-3fd4ab4c-b283-4d7e-b959-35f1168069f4 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:10.529206 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fd4ab4c-b283-4d7e-b959-35f1168069f4 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:10.529672 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fd4ab4c-b283-4d7e-b959-35f1168069f4 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:10.530461 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fd4ab4c-b283-4d7e-b959-35f1168069f4 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:10.530915 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-3fd4ab4c-b283-4d7e-b959-35f1168069f4 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:10.670036 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-3fd4ab4c-b283-4d7e-b959-35f1168069f4 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:11:10.678192 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-3fd4ab4c-b283-4d7e-b959-35f1168069f4 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1685 microversion: 2.1 time: 0.161420 Jul 26 21:11:10.679053 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3770/7626] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:11:10 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:11:11.374194 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [req-c1d4efb4-cadd-4dd2-b83e-183b514a6f83 req-06d7472d-b95d-4bd2-981b-c2158805384f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e09f5-a89c-4aa5-a915-0308db587987", "name": "network-vif-deleted", "tag": "08de2c62-e494-40f0-996f-94def34be9d3"}]} {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 21:11:11.387679 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c1d4efb4-cadd-4dd2-b83e-183b514a6f83 req-06d7472d-b95d-4bd2-981b-c2158805384f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:11.388054 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [req-c1d4efb4-cadd-4dd2-b83e-183b514a6f83 req-06d7472d-b95d-4bd2-981b-c2158805384f service nova] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:11.401936 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.compute.server_external_events [req-c1d4efb4-cadd-4dd2-b83e-183b514a6f83 req-06d7472d-b95d-4bd2-981b-c2158805384f service nova] Creating event network-vif-deleted:08de2c62-e494-40f0-996f-94def34be9d3 for instance ec1e09f5-a89c-4aa5-a915-0308db587987 on n-h2-708768-8 Jul 26 21:11:11.407752 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [req-c1d4efb4-cadd-4dd2-b83e-183b514a6f83 req-06d7472d-b95d-4bd2-981b-c2158805384f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037380 Jul 26 21:11:11.408364 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3857/7627] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Jul 26 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 21:11:11.702837 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:11.704208 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.compute.api [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:11.711686 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:11.712117 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:11.712923 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:11.714104 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:11.753790 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:11.754257 n-d-708768-8 devstack@n-api.service[125963]: DEBUG oslo_concurrency.lockutils [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:11.754765 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.objects.instance [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lazy-loading 'fault' on Instance uuid ec1e09f5-a89c-4aa5-a915-0308db587987 {{(pid=125963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 21:11:11.802142 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.policy [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b03eb3a737041faaf75aa87eccb25e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6446e76d04f1474884ede8727ae45d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 21:11:11.811146 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-12ee86b5-34c4-47a3-8e06-933bba17e789 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 200 len: 1339 microversion: 2.1 time: 0.112706 Jul 26 21:11:11.812320 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3771/7628] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:11:11 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 21:11:12.839718 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '>' {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:12.840435 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.compute.api [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] [instance: ec1e09f5-a89c-4aa5-a915-0308db587987] Fetching instance by UUID {{(pid=125964) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 21:11:12.847648 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:12.848107 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:12.848882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 21:11:12.849328 n-d-708768-8 devstack@n-api.service[125964]: DEBUG oslo_concurrency.lockutils [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Lock "0393313e-ce6a-41bc-abff-62c7ad1eab5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 21:11:12.863205 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.wsgi [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] HTTP exception thrown: Instance ec1e09f5-a89c-4aa5-a915-0308db587987 could not be found. Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Request method failure captured: Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: request: GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 HTTP/1.1 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: Accept: application/json Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: Accept-Encoding: identity Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: Connection: close Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: Content-Length: 0 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: Content-Type: application/json Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: Host: 10.222.0.58 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: Openstack-System-Scope: None Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: User-Agent: python-urllib3/1.26.10 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Auth-Token: gAAAAABi4FdMkltCmN0K6cB30S51uS7s826sLo1fzcX17v3f-EzPNIc4JGvc6n6SP2E4zVCh89zZy2ULhGtq7ogZC1QNgXnusGF89W6Btg58bOB6-vAAKKl0XsQ8sVvFwlsFY1Qrh1FtXJzOsbzK7SrNYAnjIo21C-EnLge-SUG-d_y6xJr6erk Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Id: None Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Domain-Name: None Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Identity-Status: Confirmed Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Is-Admin-Project: True Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Id: default Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Domain-Name: Default Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Id: 6446e76d04f1474884ede8727ae45d52 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Project-Name: tempest-TestSnapshotPattern-251826671 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Role: member,reader Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Roles: member,reader Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6446e76d04f1474884ede8727ae45d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6446e76d04f1474884ede8727ae45d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6446e76d04f1474884ede8727ae45d52", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6446e76d04f1474884ede8727ae45d52"}]}] Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant: tempest-TestSnapshotPattern-251826671 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Id: 6446e76d04f1474884ede8727ae45d52 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-Tenant-Name: tempest-TestSnapshotPattern-251826671 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-User: tempest-TestSnapshotPattern-251826671-project Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Id: default Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-User-Domain-Name: Default Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-User-Id: 8b03eb3a737041faaf75aa87eccb25e5 Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: X-User-Name: tempest-TestSnapshotPattern-251826671-project Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: method: > Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: exception: Instance ec1e09f5-a89c-4aa5-a915-0308db587987 could not be found. Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: action_args: {'id': 'ec1e09f5-a89c-4aa5-a915-0308db587987'} Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: {{(pid=125964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1e09f5-a89c-4aa5-a915-0308db587987 could not be found. Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1e09f5-a89c-4aa5-a915-0308db587987 could not be found. Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 21:11:12.864882 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1e09f5-a89c-4aa5-a915-0308db587987 could not be found. Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: ERROR nova.api.openstack.wsgi Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: DEBUG nova.api.openstack.wsgi [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Returning 404 to user: Instance ec1e09f5-a89c-4aa5-a915-0308db587987 could not be found. {{(pid=125964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: INFO nova.api.openstack.requestlog [None req-c2639637-d153-4b97-8613-3c5aed5c8ab3 tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987" status: 404 len: 111 microversion: 2.1 time: 0.031507 Jul 26 21:11:12.869712 n-d-708768-8 devstack@n-api.service[125964]: [pid: 125964|app: 0|req: 3858/7629] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Jul 26 21:11:12 2022] GET /compute/v2.1/servers/ec1e09f5-a89c-4aa5-a915-0308db587987 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 21:11:13.036503 n-d-708768-8 devstack@n-api.service[125963]: DEBUG nova.api.openstack.wsgi [None req-8d871128-0580-4343-a9d2-844f5b2fdc5e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] Calling method '.version_select at 0x7f875c59e820>' {{(pid=125963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 21:11:13.066073 n-d-708768-8 devstack@n-api.service[125963]: INFO nova.api.openstack.requestlog [None req-8d871128-0580-4343-a9d2-844f5b2fdc5e tempest-TestSnapshotPattern-251826671 tempest-TestSnapshotPattern-251826671-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1119046921" status: 202 len: 0 microversion: 2.1 time: 0.033340 Jul 26 21:11:13.066691 n-d-708768-8 devstack@n-api.service[125963]: [pid: 125963|app: 0|req: 3772/7630] 10.222.0.58 () {58 vars in 1257 bytes} [Tue Jul 26 21:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1119046921 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 21:11:20.037416 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:11:20.037899 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 21:11:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:13:04.771000 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:13:04.771489 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:13:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:13:45.928257 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:13:45.929220 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:14:40.046819 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:14:40.047335 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 21:14:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:14:40.066624 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:14:40.066769 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 21:14:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:16:24.779851 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:16:24.780372 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:16:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:16:36.126884 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:16:36.127341 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 21:16:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:16:55.195640 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:16:55.196154 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:16:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:17:05.939239 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:17:05.939891 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:18:00.058342 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:18:00.058849 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 21:18:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:18:00.076252 n-d-708768-8 devstack@n-api.service[125964]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:18:00.076393 n-d-708768-8 devstack@n-api.service[125964]: Tue Jul 26 21:18:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 21:19:44.788709 n-d-708768-8 devstack@n-api.service[125963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 21:19:44.789265 n-d-708768-8 devstack@n-api.service[125963]: Tue Jul 26 21:19:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!